Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Error while read_tokenizer #6

Open
AyaRabea opened this issue Feb 12, 2023 · 4 comments
Open

Error while read_tokenizer #6

AyaRabea opened this issue Feb 12, 2023 · 4 comments

Comments

@AyaRabea
Copy link

whine i run
from transphone import read_tokenizer
eng = read_tokenizer('eng')
i got error
UnicodeDecodeError: 'charmap' codec can't decode byte 0x90 in position 970: character maps to
any solution?
@xinjli
Copy link
Owner

xinjli commented Feb 12, 2023

can you tell me more about your environment? e.g.: python version, OS version. are you using python2 ?

@AyaRabea
Copy link
Author

the os version is windows 10 and python 3.9
thanks

@xinjli
Copy link
Owner

xinjli commented Feb 15, 2023

it seems that windows is probably using its own codecs instead of utf8 if not specified. Can you show the exact file where it fails to read? (i.e. its detailed stack trace when it failed)

@AyaRabea
Copy link
Author

her is the error
error
error2

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@xinjli @AyaRabea