I'm working on a big dataset encoded in UTF-16LE that holds 1 Billion records containing text strings in over 50 languages ( not all known to me).

I need to get these into our database MySql 5.7 using LOAD DATA INFILE(for import speed) but i just found out that MySql does not support UTF-16LEtext encoding while trying to load this using the workbench import too and also querying this data with Athena gives me no records back with this encoding.

  1. Best encoding relative to MySQl 5.7 that handles multi language and can LOAD DATA INFILE?
  2. Will this keep the text safe and not garble the text strings?
0

There are 0 best solutions below