Requirement: The nameservice for a Hadoop Namenode HA should be discoverable across clusters.
Solution #1: One solution I found online is to add the nameservice configurations to all the hdfs-site.xml files in the clusters involved.
Problem: We have 10 clusters and growing, we cannot add new cluster definitions in all the clusters everytime a new cluster is deployed.
Pros: Manageble for few clusters. Cons: Not scalable to more clusters.
Solution #2: We are planning working on a second solution to have a central service to resolve the name service across clusters and have a custom class extending org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider class.
Please provide any inputs on any better solutions or any existing patches that are already filed for this issue.