I am using Python 3.5.2 and Pandas based on Anaconda 4.2.0 (64bit, Windows 10) and want to import a csv file with 74 columns and ~51000 records, the size of the file is ~ 42.9MB on disk:
import pandas as pd df = pd.read_csv('MyCSVFile',dtype=str,delimiter=',',skipinitalspace=True, quotechar='"'
This code works fine also for additional operations to convert the strings into the desired data types. But for some strange reasons there seems to be a limitation in the total number of records. The length of the data frame shows only 39812 records, ie. not the full content of the csv file has been imported. Is there a limitation in the maximum number of records to be imported into a pandas dataframe ?
Thank you for a hint.