Failed to get scheduler location from state manager Heron Tutorial

86 Views Asked by At

I'm working through the heron tutorial found here: https://apache.github.io/incubator-heron/docs/getting-started/'

I didn't get very far before I encountered this error:

$: heron activate local WindowedWordCountTopology

[2019-02-01 15:55:11 +0000] [INFO]: Using cluster definition in /home/<my-user>/.heron/conf/local
[2019-02-01 15:55:11 +0000] [ERROR]: Failed to get scheduler location from state manager
[2019-02-01 15:55:11 +0000] [ERROR]: Failed to activate topology: WindowedWordCountTopology

I'm very new to Heron. Any idea what could be causing this?

1

There are 1 best solutions below

0
Ning Wang On

This is not really an answer. It is too long for comment, so I have to create an answer....

Hard to tell the issue so far, this is the expected output with almost latest code fyi.

$ ~/.heron/bin/heron submit local   ~/.heron/examples/heron-streamlet-examples.jar   org.apache.heron.examples.streamlet.WindowedWordCountTopology   WindowedWordCountTopology --deploy-deactivated
[2019-02-05 15:09:53 -0800] [INFO]: Using cluster definition in /Users/<user>/.heron/conf/local
Feb 05, 2019 3:09:54 PM org.apache.heron.streamlet.impl.StreamletImpl defaultNameCalculator
INFO: Calculated stage Name as consumer1
[2019-02-05 15:09:54 -0800] [INFO]: Launching topology: 'WindowedWordCountTopology'
[2019-02-05 15:09:55 -0800] [INFO] org.apache.heron.packing.roundrobin.RoundRobinPacking: Initalizing RoundRobinPacking. CPU default: 1.000000, RAM default: ByteAmount{1.0 GB (1073741824 bytes)}, DISK default: ByteAmount{1.0 GB (1073741824 bytes)}, RAM padding: ByteAmount{2.0 GB (2147483648 bytes)}.  
[2019-02-05 15:09:55 -0800] [INFO] org.apache.heron.packing.roundrobin.RoundRobinPacking: Pack internal: container CPU hint: 3.000, RAM hint: ByteAmount{-1 bytes}, disk hint: ByteAmount{14.0 GB (15032385536 bytes)}.  
[2019-02-05 15:09:55 -0800] [INFO] org.apache.heron.packing.roundrobin.RoundRobinPacking: Pack internal finalized: container#1 CPU: 3.000000, RAM: ByteAmount{4.0 GB (4294967296 bytes)}, disk: ByteAmount{14.0 GB (15032385536 bytes)}.  
[2019-02-05 15:09:55 -0800] [INFO] org.apache.heron.packing.roundrobin.RoundRobinPacking: Pack internal finalized: container#2 CPU: 3.000000, RAM: ByteAmount{4.0 GB (4294967296 bytes)}, disk: ByteAmount{14.0 GB (15032385536 bytes)}.  
[2019-02-05 15:09:55 -0800] [INFO] org.apache.heron.packing.roundrobin.RoundRobinPacking: Initalizing RoundRobinPacking. CPU default: 1.000000, RAM default: ByteAmount{1.0 GB (1073741824 bytes)}, DISK default: ByteAmount{1.0 GB (1073741824 bytes)}, RAM padding: ByteAmount{2.0 GB (2147483648 bytes)}.  
[2019-02-05 15:09:55 -0800] [INFO] org.apache.heron.packing.roundrobin.RoundRobinPacking: Pack internal: container CPU hint: 3.000, RAM hint: ByteAmount{-1 bytes}, disk hint: ByteAmount{14.0 GB (15032385536 bytes)}.  
[2019-02-05 15:09:55 -0800] [INFO] org.apache.heron.packing.roundrobin.RoundRobinPacking: Pack internal finalized: container#1 CPU: 3.000000, RAM: ByteAmount{4.0 GB (4294967296 bytes)}, disk: ByteAmount{14.0 GB (15032385536 bytes)}.  
[2019-02-05 15:09:55 -0800] [INFO] org.apache.heron.packing.roundrobin.RoundRobinPacking: Pack internal finalized: container#2 CPU: 3.000000, RAM: ByteAmount{4.0 GB (4294967296 bytes)}, disk: ByteAmount{14.0 GB (15032385536 bytes)}.  
[2019-02-05 15:09:55 -0800] [INFO]: Successfully launched topology 'WindowedWordCountTopology' 


$ ~/.heron/bin/heron activate local     WindowedWordCountTopology[2019-02-05 15:10:08 -0800] [INFO]: Using cluster definition in /Users/<user>/.heron/conf/local
[2019-02-05 15:10:09 -0800] [INFO] org.apache.heron.spi.utils.TMasterUtils: Topology command ACTIVATE completed successfully.  
[2019-02-05 15:10:09 -0800] [INFO]: Successfully activate topology: WindowedWordCountTopology

For "local", the topology state data is stored in ~/.herondata/repository/state/local//. In your case, you may check if this file is created and contains correct information: ~/.herondata/repository/state/local/schedulers/WindowedWordCountTopology