Skip to content

bpo-39219: Fix SyntaxError attributes in the tokenizer. #17828

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged

Conversation

serhiy-storchaka
Copy link
Member

@serhiy-storchaka serhiy-storchaka commented Jan 5, 2020

  • Always set the text attribute.
  • Correct the offset attribute for non-ascii sources.

https://bugs.python.org/issue39219

@serhiy-storchaka serhiy-storchaka added type-bug An unexpected behavior, bug, or error needs backport to 3.8 labels Jan 5, 2020
@serhiy-storchaka serhiy-storchaka changed the title bpo-359331: Fix SyntaxError attributes in the tokenizer. bpo-39219: Fix SyntaxError attributes in the tokenizer. Jan 11, 2020
@serhiy-storchaka serhiy-storchaka force-pushed the tokenizer-syntax-error-text branch from aa5be8f to 309b924 Compare January 11, 2020 10:54
* Always set the text attribute.
* Correct the offset attribute for non-ascii sources.
@serhiy-storchaka serhiy-storchaka force-pushed the tokenizer-syntax-error-text branch from 309b924 to 51d0cdc Compare January 11, 2020 10:55
@serhiy-storchaka serhiy-storchaka merged commit 0cc6b5e into python:master Feb 12, 2020
@miss-islington
Copy link
Contributor

Thanks @serhiy-storchaka for the PR 🌮🎉.. I'm working now to backport this PR to: 3.8.
🐍🍒⛏🤖

@serhiy-storchaka serhiy-storchaka deleted the tokenizer-syntax-error-text branch February 12, 2020 10:17
miss-islington pushed a commit to miss-islington/cpython that referenced this pull request Feb 12, 2020
* Always set the text attribute.
* Correct the offset attribute for non-ascii sources.
(cherry picked from commit 0cc6b5e)

Co-authored-by: Serhiy Storchaka <[email protected]>
@bedevere-bot
Copy link

GH-18479 is a backport of this pull request to the 3.8 branch.

miss-islington added a commit that referenced this pull request Feb 12, 2020
* Always set the text attribute.
* Correct the offset attribute for non-ascii sources.
(cherry picked from commit 0cc6b5e)

Co-authored-by: Serhiy Storchaka <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
type-bug An unexpected behavior, bug, or error
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants