Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Special characters cause SQL error #9

Open
maikschneider opened this issue Jun 2, 2023 · 1 comment
Open

Special characters cause SQL error #9

maikschneider opened this issue Jun 2, 2023 · 1 comment

Comments

@maikschneider
Copy link
Member

If a tweet contains special characters like emojis (not all emojis in general), errors can be found in the error log.

Example:

SQL error: 'Incorrect string value: '\xF0\x9F\x96\xA4 \x0A...' for column `dbname`.`tx_ximatwitterclient_domain_model_tweet`.`text` at row 1' (tx_ximatwitterclient_domain_model_tweet:NEW4) 

There should be a check for the configured database charset and do a convert / replacement of not supported characters.

@pixelbrackets
Copy link

pixelbrackets commented Jun 6, 2023

Watch out. Replacing a part of the content may change the whole meaning of the message. Emoji are often used to add context to a message.

There should be a check for the configured database charset and collation for the column (uft8mb4). Maybe a general setup check (API connection, database, fields)? (see related issue #2 as well).

convert / replacement of not supported characters The error message should remain, since this is a factual error → the database needs to be changed to prevent this.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants