We found repeated Accession Number from different data sources. When loading new HL7 file, the HL7 pipeline attempts to create duplicated entry if it detects existing same accession number in the database(column DOCUMENT_HL7). As a result the pipeline stopped due to cannot insert error.
this turned out to be related to hidden unicode within some of the text reports. developed a method to strip these out.
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
Ticket moved from /p/caties/feature-requests/99/
Can't be converted:
We found repeated Accession Number from different data sources. When loading new HL7 file, the HL7 pipeline attempts to create duplicated entry if it detects existing same accession number in the database(column DOCUMENT_HL7). As a result the pipeline stopped due to cannot insert error.
this turned out to be related to hidden unicode within some of the text reports. developed a method to strip these out.