I have a PDF where I'm trying to extract a table. I'm using the Camelot package, but the package is not able to properly extract the foreign text. Table from PDF So I'm using Camelot to extract columns 1-15 and an LLM to extract columns 15 and 16, then do a merge on column 15. Most of the time, I can do a proper merge. However in certain instances I cannot properly match column 15 values. For example, the name "ANDRABAHA" does not match properly. See the following notebook output where I copied and pasted the string from the Camelot output and compared it against the LLM output. They are spelled exactly the same, but they are not equal for some reason. I have tried to encode them to the same encoding by using string.encode(utf-8) and also using a normalizer, but neither worked. [Notebook Output] word1 = "ANDRABAHA" word2 = "ANDRABAHА" word1 == word2 Based on a suggestion in the comments, I compared ord(char) of the two strings and they were indeed different. How do I force these two strings to have the same ord values? (65, 78, 68, 82, 65, 66, 65, 72, 65) vs (65, 78, 68, 82, 65, 66, 65, 72, 1040) Continue reading...
