rbindlist on 23GB list of data frames

396 Views Asked by At

I have a problem with function rbindlist. I'm trying to merge large list of size 23.1Gb or bigger with rbindlist(data.list, fill=T, use.names = T) but the R session always abort during it. (I have only 8Gb RAM maybe there is a problem.) So how could I merge this big list (or even bigger one)?

It's a list, which I made from real dataset by some transformations etc. and I need to merge it to work with all data (I want to compute cosine similarity etc.)

> summary(data.inv[1])
  Length Class      Mode
1 11291  data.frame list

> summary(data.inv[25])
   Length Class      Mode
25 9807   data.frame list

> length(data.inv)
[1] 25
0

There are 0 best solutions below