JOIN Conditions with Unicode and ASCII
I cannot stress the dangers of copying data from Excel or HTML and assuming that it’s ASCII. For example U+0040 is the unicode version of @. We ingested the unicode version and couldn’t see why a JOIN condition on the data table wasn’t working.
I looked at the source JSON ( a FHIR DSTU2 Group ) and loaded in VIM and used the following trick:
We ended up showing that our data table’s contents were different using:
SELECT HEX(RESOURCE_VALUE) FROM FHIR.DIM_GROUP 0A40 vs 40