HAWQ - how to choose a node to install segments

59 Views Asked by At

I have six-node cluster and I want to install HAWQ database and PXF on it. My cluster looks like that:

Node1 - NameNode, ResourceManager, HiveMetastore, HiveClient
Node2 - SNameNode, NodeManager
Node3 - DataNode, NodeManager
Node4 - DataNode, NodeManager
Node5 - DataNode, NodeManager
Node6 - HiveClient

On which node I have to install HAWQ Master, HAWQ Segments and PXF? Is it possible to do this only on three first nodes or I have to install HAWQ Segments and PXF on each node?

1

There are 1 best solutions below

1
On

I would install the Master on Node6, Standby on Node2, and the Segments with PXF on Node3, Node4, and Node5. You want a Segment on every Datanode.

I also would avoid putting the Master or Standby on the same node you have Ambari. Ambari uses a PostgreSQL database and listens on port 5432 which is the same port used by HAWQ. You can change either Ambari or HAWQ to make it work on the same node but it is just easier to keep these separate.