-
1. Re: Incorrect string value
The Hex value 0xE2 0x80 0x8B is the representation in UTF-8 of the 'zero-width space' character. You may remove it from the string - for example, by replacing it with a blank space - before the string enters the query.
Assuming that chr(8203) represents the zero-width character, you could replace it as follows:
<cfset myString = replace(myString,chr(8203),"","all")>
-
2. Re: Incorrect string value
Thanks Dan.
Is there an inbuilt cf function I can use to strip out any weird characters like that do you happen to know? Or alternatively maybe I need to tell my database (mysql) not to be so fussy and accept those chrs?
Hope you're well - thanks for the help, much appreciated.
Nick
-
3. Re: Incorrect string value
You could filter out the characters as I suggested, before storing the string in the database.
-
4. Re: Incorrect string value
Thanks Dan - yes that was what I was hoping to do (filter out the characters before inserting to the db). I'm just trying to find the most efficient way to remove those characters; I had been using safetext.cfm but that seems a bit out of date now.. http://www.cflib.org/udf/SafeText
It'd be great if there was an inbuilt cf function like RemoveOddCharacters() for use on strings before inserting them into dbs - maybe there is one.. anyone?
Thanks
Nick
-
5. Re: Incorrect string value
I suggested one, single line for the job: <cfset myString = replace(myString,chr(8203),"","all")>
-
6. Re: Incorrect string value
Hi again - yes I know but that only removes that one particular special character; I believe there are quite a few that cause problems if stored in the db. I'm wondering if there is a function that removes all the various troublesome special characters in one go. Failing that I wonder if there is a list of all these characters that i can loop through (using the replace as you say)?..
-
7. Re: Incorrect string value
There are thousands of special characters, and infinitely many combinations of them. To be practical and efficient, therefore, you have to focus on removing just the ones that are troublesome.
-
8. Re: Incorrect string value
FYR I am hoping that this will eventually provide anyone who's interested with a way to remove special characters from a string before inserting in the db
-
-
10. Re: Incorrect string value
Thanks Dan - seems ok from my end, think that's because it's a post I've put in here (getting started forum) that hasn't yet been approved for publication by the moderators - hopefully link will work shortly..
-
-
-
-
-
15. Re: Incorrect string value
turns out the issue was the charset in db was set to latin_sweedish
i changed it to utf8_general_ci and that sorted it.
there was one additional twist to this which i solved by looking here MySQL Bugs: #33475: Incorrect string value when inserting unicode codepoint \xC2\x92
the key part being at the bottom "
[9 Dec 2011 0:07] Arkadiy Kulev
This problem solves easily. Don't forget to not only set the database, table and collation to utf8, BUT THE COLUMNS ALSO!
That's what cause the problem for me. I created the table in latin, then switch to utf8, but forgot to also change the columns."
that caught me out but got there in the end.
HTH anyone else who has this.
-