Big matrix multiplication using apache hama

322 Views Asked by At

I am trying to multiply a dense matrix A for its transpose A'. The matrix is about 2 million rows and 4 hundred columns. I implemented the multiplication in hadoop map reduce, but it runs too slowly because of the non locality of the job (every record must be multiplied by every other record). Therefore, I am trying to use Apache Hama for the multiplication. There is a class called DenseDoubleMatrix, but I think it is not useful because it seems that it does not distribute the calculations across the cluster using bsp.

Is there any other facility already implemented in Hama for matrix multiplication or do I have to implement it myself using the bsp model?

0

There are 0 best solutions below