-
- Downloads
gh-96268: Fix loading invalid UTF-8 (#96270)
This makes tokenizer.c:valid_utf8 match stringlib/codecs.h:decode_utf8. It also fixes an off-by-one error introduced in 3.10 for the line number when the tokenizer reports bad UTF8.
Showing
- Lib/test/test_source_encoding.py 10 additions, 3 deletionsLib/test/test_source_encoding.py
- Misc/NEWS.d/next/Core and Builtins/2022-08-25-10-19-34.gh-issue-96268.AbYrLB.rst 2 additions, 0 deletions...nd Builtins/2022-08-25-10-19-34.gh-issue-96268.AbYrLB.rst
- Parser/tokenizer.c 45 additions, 13 deletionsParser/tokenizer.c
Loading
Please register or sign in to comment