Hi Giang/Lior,
I have see some issue like pasting invisible character like BOM causing issue. I generally recommend authors as best practice for interoperability instead of copying directly from other sites/systems into cq, Use any text editor (Text Wrangler) with encoding as "UTF-8 no BOM" which filter BOM characters etc and from there paste into CQ.
In your case you have given example of two characters & looking at it I am guessing you might be passing Device Control Characters[1].
The posible solution I can think of is
Option1:- Inform authors to filter those characters using any editors that and then update the content copying from filtered text editor. I am sure you do not like this.
Option2:- Implement a Sling Post Processor or POST operation which validates the supplied input when posted. In that logic check for invalid character, if exists modify the property to replace invalid character with an empty string. Pseudo code of ETX at [2]. This could take care of future content updates. For existing one write a small scritp to interate through repository and clean those. With post processor you do not have to worry about the component that is posting. Hope this make sense.
[1] http://www.w3ctutorial.com/tags/ref_ascii
[2]
// The pattern matches control characters
Pattern p = Pattern.compile("\\p{Cntrl}");
Matcher m = p.matcher("");
m.reset(args[0]);
//Replaces control characters with an empty
//string.
if(m.find()){
String result = m.replaceAll("");
}
Thanks,
Sham
