I am experimenting with using Akubra-HDFS as the low level storage for the fedora commons server. I followed the procedure similar to installation of IRODS to setup Akubra-HDFS. The fedora server worked with Hadoop (version 1.0.4) as its storage. But, I had trouble using the Akubra-HDFS library with either Cloudera CDH4 / Apache Hadoop 2.0.3alpha - the High Availability (HA) distributions. I wanted to share my findings.
Using Akubra-HDFS with Cloudera CDH4
299 Views Asked by Mohamed At
1
There are 1 best solutions below
Related Questions in HADOOP
- pcap to Avro on Hadoop
- schedule and automate sqoop import/export tasks
- How to diagnose Kafka topics failing globally to be found
- Only 32 bit available in Oracle VM - Hadoop Installation
- Using HDFS with Apache Spark on Amazon EC2
- How to get raw hadoop metrics
- How to output multiple values with the same key in reducer?
- Loading chararray from embedded JSON using Pig
- Oozie Pig action stuck in PREP state and job is in RUNNING state
- InstanceProfile is required for creating cluster - create python function to install module
- mapreduce job not setting compression codec correctly
- What does namespace and block pool mean in MapReduce 2.0 YARN?
- Hadoop distributed mode
- Building apache hadoop 2.6.0 throwing maven error
- I am using Hbase 1.0.0 and Apache phoenix 4.3.0 on CDH5.4. When I restart Hbase regionserver is down
Related Questions in STORAGE
- Grabbing Edits from two strings
- How to determine which Windows drives map to which SAN storage devices using WMI?
- Send alert for 80% threshold comparing two values from Disk partition
- How to get storage capacity of mac programmatically?
- Store pdf from assets to internal storage(private)
- Storing images in MSSQL vs Disk
- Using puppet to create a lvm with dynamic size
- Is the storage location "storage" for all Android devices and versions fixed?
- Dismissing items from news feed in my app. Android - Java
- Access videos both in internal storage and external SD card - Android
- How to get total internal memory (including system memory)
- Use case HBase on EMR
- Best Data Type for Storing AWS ARNs in MySQL?
- Android ZTE Blade III camera intent not returning with data
- Historical data in Cassandra
Related Questions in HDFS
- Using HDFS with Apache Spark on Amazon EC2
- How to read a CSV file from HDFS via Hadoopy?
- How can I migrate data from one HDFS cluster to another over the network?
- Spark/Spark Streaming in production without HDFS
- Jcascalog to query thrift data on HDFS
- What is Metadata DB Derby?
- Can Solr or ElasticSearch be configured to use HDFS as their persistence layer in a way that also supports MapReduce?
- How to import only new data by using Sqoop?
- How to access hdfs by URI consisting of H/A namenodes in Spark which is outer hadoop cluster?
- Force HDFS globStatus to skip directories it doesn't have permissions to
- Trying to use WinInet to upload a file to HDFS
- Apache Spark architecture
- Is possible to set hadoop blocksize 24 MB?
- Unable to create file using Pail DFS
- Hadoop Distributed File Systmes
Related Questions in CLOUDERA
- Loading chararray from embedded JSON using Pig
- Hive Queries are not executing. Showing Exceptions in CLI
- Using Oozie to create a hive table on hbase causes an error with libthrift?
- Creating a hive table with ~40K columns
- Setting mapreduce.job.jar with a jar in path containing space
- Solr and schemaless
- How to specify the mappers failure threshold for a hadoop mapreduce job?
- Can you use a proxy to connect to HDFS using the Kite SDK?
- Spark saveAsNewAPIHadoopFile works on local mode but not on Cluster mode
- Convert 6 digit date to 8 digit
- How to get all mapreduce jobs' status through REST API?
- Hadoop "hadoop dfsadmin -safemode leave" command deprecated
- Hive not detecting timestamp format
- hadoop permissions issue (hdfs-site.xml dfs.permissions.enabled)
- SparkException: local class incompatible
Related Questions in FEDORA-COMMONS
- Why is JMS messaging client unable to start, with fedora-commons 3.8.1?
- fedora-commons MySQL database table updated to delete records but is not reflected on fez front-end
- Put forms.DateField parameter into view method
- How to write XACML Policy using Custom Attributes
- Fedora Commons starting problems
- How do I use requests.put() to upload a file using Python?
- How to restart SOLR search using Solrj from page?
- Switch off Soap EndPoint of Fedora 3.6.2
- Index json file to fedora 4 using apache camel
- While uploading large file size of 2.4 MB with 200 pages, getting this error
- Importing data into Fedora Commons
- Using Akubra-HDFS with Cloudera CDH4
- How to deploy Fedora Commons 4.1 on WildFly
- what does low level storage management like iRODS exactly for (in fedora-commons)?
- How to call Fedora Commons findObjects method (web service)
Trending Questions
- UIImageView Frame Doesn't Reflect Constraints
- Is it possible to use adb commands to click on a view by finding its ID?
- How to create a new web character symbol recognizable by html/javascript?
- Why isn't my CSS3 animation smooth in Google Chrome (but very smooth on other browsers)?
- Heap Gives Page Fault
- Connect ffmpeg to Visual Studio 2008
- Both Object- and ValueAnimator jumps when Duration is set above API LvL 24
- How to avoid default initialization of objects in std::vector?
- second argument of the command line arguments in a format other than char** argv or char* argv[]
- How to improve efficiency of algorithm which generates next lexicographic permutation?
- Navigating to the another actvity app getting crash in android
- How to read the particular message format in android and store in sqlite database?
- Resetting inventory status after order is cancelled
- Efficiently compute powers of X in SSE/AVX
- Insert into an external database using ajax and php : POST 500 (Internal Server Error)
Popular Questions
- How do I undo the most recent local commits in Git?
- How can I remove a specific item from an array in JavaScript?
- How do I delete a Git branch locally and remotely?
- Find all files containing a specific text (string) on Linux?
- How do I revert a Git repository to a previous commit?
- How do I create an HTML button that acts like a link?
- How do I check out a remote Git branch?
- How do I force "git pull" to overwrite local files?
- How do I list all files of a directory?
- How to check whether a string contains a substring in JavaScript?
- How do I redirect to another webpage?
- How can I iterate over rows in a Pandas DataFrame?
- How do I convert a String to an int in Java?
- Does Python have a string 'contains' substring method?
- How do I check if a string contains a specific word?
As AKubra-HDFS is a new experimental library there is not much resources about it in the internet. I had to figure out the solution by experimenting out with different dependency jars.
Follow the instructions at https://github.com/fasseg/akubra-hdfs
Instead of the jars listed there for Hadoop 1.x.x, Copy the below jar files from CDH4 (installation folder) to the fedora lib folder.