I'm using SVM-light for my researches and it's doing fine (at least it's still processing)
svm_learn.exe -t 3 -m 4000 learn_data model
Learn_data here is about 14.000.000 lines of of data with 20.000 of features.
But as for -z p flag for ranking mode it's crashes with 1.000.000 lines of data:
svm_learn.exe -t 3 -z p -m 4000 learn_data_1mil model
As a result:
OK. (10000000 examples read)
Constructing 1380570988 rank constrains...Out of memory!: Not enough space
Current setup is 64GB of RAM and It doesn't seem SVM tries to use all of it. I've tried to use more than 4000 MB as a cache up to 20000. But it didn't help and if it was a cache error SVM should tell about cache not just memory error. Didn't find documented way to solve it. What can be done to make my data processed?