I am running a parallelized(using multiprocessing module) python script during data processing and am doing many operations on pandas dataframe. However, during the execution when I used strace on one of the process instance, I observe below:
stat("/home/anaconda3/lib/python3.5/site-packages/pandas/operator",0x7ffcef5329b0) = -1 ENOENT (No such file or directory)
stat("/home/anaconda3/lib/python3.5/site-packages/pandas/operator.pye",0x7ffcef5329b0) = -1 ENOENT (No such file or directory)
stat("/home/anaconda3/lib/python3.5/site-packages/pandas",{st_mode=S_IFDIR|0777, st_size=4096, ...}) = 0
I think the file operator.pye must belong to python pyconcrete module, but since I did not used pyconcerete to encrypt my python script, so my running script should not be looking for them.
So my question is:
Are the missing directory(s)/file(s) a pandas bug, or someone else have seen something like this before, and can suggest what could be the cause of it.
OR I can ignore these messages.
Really appreciate some comments!
You should ignore this. It is not indicative of a problem unless it is happening thousands of times per process.
More on where Python searches for imports: How does python find a module file if the import statement only contains the filename?