How to read value of accumulators in worker task in spark?

523 Views Asked by At

As per the documentation of accumulators in spark:

Note that tasks on worker nodes cannot access the accumulator’s value()—from the point of view of these tasks, accumulators are write-only variables. This allows accu‐ mulators to be implemented efficiently, without having to communicate every update.

Accumulators are write-only variable for worker nodes.

Is there any way we can read the accumulators value in worker node and use its value for some business logic?

0

There are 0 best solutions below