I want to load a CSV file into memory using the loadText function but the system fails to correctly parse the column names in Chinese. To solve this issue, I use Python to read the CSV file by specifying encoding = 'gb18030' before loading, but it is very slow. So I switch to loadTextEx for parallel writing, but a prompt message pops up, indicating that as strings in DolphinDB are encoded in UTF-8, input text files are required to be encoded in UTF-8. Is there an effective way to solve this issue?
DolphinDB: Fail to correctly parse the Chinese column names in a CSV file using loadText
14 Views Asked by winnie At
1
There are 1 best solutions below
Related Questions in UTF-8
- Can't we make a better variable-length character encoding with just using the 1 bit extra in the 7 bit ASCII?
- UTF-8 issue with excel
- UTF-8 string has too many bytes using SBCL and babel on Windows 64 bits
- How to convert from Java ASCII properties to UTF8 (Java 9) properties
- How to read a file that contains both ANSI and UTF-8 encoded characters
- BSONError in MongoDB Compass
- Create HMAC SHA-1 in JS with byte array
- pdftk unicode works in preview but not adobe acrobat
- xml file from ISO-8859-2 to UTF-8 in python
- How to store metadata for a UTF-8 text file cross-platform?
- Encoding problem on MySQL: Why some non-ASCII characters get encoded on more than 4 bytes?
- How to get character position in a text file encode in UTF-8 in C?
- Unicode character ſ is matched as itself and as 's.'
- VS Code integrated terminal UTF-8 input problem
- pdftk generated pdf does not render correct utf-8
Related Questions in DOLPHINDB
- How to append an array vector to a database?
- Does the following value partition cover the day of December 31st?
- How can three int variables, start_year, start_month, and start_day, which are 2024, 3, and 4 respectively, be merged into a date variable (date)?
- How to specify multiple databases when connecting to DolphinDB Server with JDBC interface？
- The Asof join engine output does not match expectations
- Why does having GROUP BY in an IN clause cause the query to become unexecutable?
- Why the same regular expression outputs different results in Linux and Windows?
- Fail to write to a DFS table due to the error The column used for value-partitioning cannot contain NULL values
- DolphinDB: How to solve the error The number of partitions [xxxx] relevant to the query is too large?
- How to retrieve the row/column names of a matrix in DolphinDB?
- How to boost the data distribution speed of stream tables in DolphinDB?
- How to rename multiple columns?
- Fail to run overly long DolphinDB scripts with Python API
- asof join returns empty for unmatched partitioned data
- How to quickly create an empty wide table in DolphinDB?
Related Questions in LOADDATA
- Liquibase 4.26 while importing the csv file it's taking long time
- DolphinDB: Fail to correctly parse the Chinese column names in a CSV file using loadText
- How can I temporarily disable events in a WPF solution?
- Load data functions not working correctly on CSV(Comma Delimited) file
- Problem with using Read10x function of Seurat
- Mysql data load disabled/restrictions
- import a CSV file with JSONB into postgresql 14
- Error when using manage.py loaddata to load Django JSON file created with dumpdata
- Pulling the firebase documents those that comes before/above the specified document
- How to proper load async data
- Trying to save and load data in unity- why does a file exist in a certain path even though ive never created it? details below
- Loading data with Provider: Flutter
- Unable to load fixture for through model django
- Android WebView .loadData Trims the text
- Django dumpdata-loaddata error serializing custom class: ' Syntax error near "F" '
Trending Questions
- UIImageView Frame Doesn't Reflect Constraints
- Is it possible to use adb commands to click on a view by finding its ID?
- How to create a new web character symbol recognizable by html/javascript?
- Why isn't my CSS3 animation smooth in Google Chrome (but very smooth on other browsers)?
- Heap Gives Page Fault
- Connect ffmpeg to Visual Studio 2008
- Both Object- and ValueAnimator jumps when Duration is set above API LvL 24
- How to avoid default initialization of objects in std::vector?
- second argument of the command line arguments in a format other than char** argv or char* argv[]
- How to improve efficiency of algorithm which generates next lexicographic permutation?
- Navigating to the another actvity app getting crash in android
- How to read the particular message format in android and store in sqlite database?
- Resetting inventory status after order is cancelled
- Efficiently compute powers of X in SSE/AVX
- Insert into an external database using ajax and php : POST 500 (Internal Server Error)
Popular Questions
- How do I undo the most recent local commits in Git?
- How can I remove a specific item from an array in JavaScript?
- How do I delete a Git branch locally and remotely?
- Find all files containing a specific text (string) on Linux?
- How do I revert a Git repository to a previous commit?
- How do I create an HTML button that acts like a link?
- How do I check out a remote Git branch?
- How do I force "git pull" to overwrite local files?
- How do I list all files of a directory?
- How to check whether a string contains a substring in JavaScript?
- How do I redirect to another webpage?
- How can I iterate over rows in a Pandas DataFrame?
- How do I convert a String to an int in Java?
- Does Python have a string 'contains' substring method?
- How do I check if a string contains a specific word?
Generate the schema table for the input data file using the
extractTextSchemafunction:Change the encoding of strings to UTF-8 using
toUTF8orconvertEncode:Load the CSV file using
loadTextorloadTextExwith the parameter schema specified as the schema table: