Instead of using a DAG plan generated by TEZ in Hive, I want to use custom DAG plan created by me. Is it Possible? If Yes, can anyone explain?
Can we impose custom DAG plan over generated DAG plan in TEZ? If possible, How?
89 Views Asked by Ramprakash At
1
There are 1 best solutions below
Related Questions in HIVE
- How do I set the Hive user to something different than the Spark user from within a Spark program?
- schedule and automate sqoop import/export tasks
- PIG merge two lines in the log
- Elephant bird with hive to query protobuf file
- How can we decide the total no. of buckets for a hive table
- How to create a table in Hive with a column of data type array<map<string, string>>
- How to find number of unique connection using hive/pig
- sqoop-export is failing when I have \N as data
- How can we test expressions in hive
- Run Hive Query in R with Config
- Rhive: The messages shows: Not Connected to Hiveserver2 (But can connect HDFS)
- HIVE Query Deleting source data blob
- Hive JOIN of query with subquery takes forever
- What is Metadata DB Derby?
- How could I set the number or size of output files in an "insert" script?
Related Questions in DIRECTED-ACYCLIC-GRAPHS
- Error in DAG destructor
- Independent Nodes
- An example of finding the longest path in DAG with both positive and negative weights
- Create a Reduced Ordered Binary Decision Diagram from boolean expression in Haskell
- How can I explain the Apache Spark RDD Lineage Graph?
- Applying solution for LCA in DAGs on cyclic graphs?
- Understanding spark process behaviour
- Add a second Exchange 2010 server to enable upgrade to SP3
- Prolog, Determine if graph is acyclic
- Maximum weighted path between two vertices in a directed acyclic Graph
- Longest path between all pairs in a DAG
- Is it practical to store unique paths through a directed acyclic graph?
- DAG - Algorithm to ensure there is a single source and a single sink
- finding static scheduling of DAG for multiprocessors - library?
- What do you call a relation that is transitive and reflexive
Related Questions in TEZ
- When does HIVE (not) use WHERE clause on partition as predicate filter
- How can I add additional libraries to Tez to support a different HDFS backend?
- Add Filesystem to Hive with Tez execution engine
- Using Hive to distribute over Reducers?
- Hadoop cluster. Large number of TCP retransmissions
- Hive / Tez job won't start
- Why is hive join taking too long?
- Tez vertex error shown while execution of query in hive
- Executing query with Hive, Tez and offset
- Hive execute "insert into ... values ..." very slow
- Failed Vertex re-running
- Hive complex data type querying
- Hive query does not start the map phase
- Record too large for in-memory buffer. Error when working with Hive's ORC tables via TEZ
- Are Apache Phoenix JARs causing error in Tez?
Trending Questions
- UIImageView Frame Doesn't Reflect Constraints
- Is it possible to use adb commands to click on a view by finding its ID?
- How to create a new web character symbol recognizable by html/javascript?
- Why isn't my CSS3 animation smooth in Google Chrome (but very smooth on other browsers)?
- Heap Gives Page Fault
- Connect ffmpeg to Visual Studio 2008
- Both Object- and ValueAnimator jumps when Duration is set above API LvL 24
- How to avoid default initialization of objects in std::vector?
- second argument of the command line arguments in a format other than char** argv or char* argv[]
- How to improve efficiency of algorithm which generates next lexicographic permutation?
- Navigating to the another actvity app getting crash in android
- How to read the particular message format in android and store in sqlite database?
- Resetting inventory status after order is cancelled
- Efficiently compute powers of X in SSE/AVX
- Insert into an external database using ajax and php : POST 500 (Internal Server Error)
Popular Questions
- How do I undo the most recent local commits in Git?
- How can I remove a specific item from an array in JavaScript?
- How do I delete a Git branch locally and remotely?
- Find all files containing a specific text (string) on Linux?
- How do I revert a Git repository to a previous commit?
- How do I create an HTML button that acts like a link?
- How do I check out a remote Git branch?
- How do I force "git pull" to overwrite local files?
- How do I list all files of a directory?
- How to check whether a string contains a substring in JavaScript?
- How do I redirect to another webpage?
- How can I iterate over rows in a Pandas DataFrame?
- How do I convert a String to an int in Java?
- Does Python have a string 'contains' substring method?
- How do I check if a string contains a specific word?
If you are using Hive for running queries then you cannot use custom DAG. If you do low level programming Tez application using API, you can. See High level docs here: https://hortonworks.com/blog/expressing-data-processing-in-apache-tez/
Something like this:
See apache project examples: https://git-wip-us.apache.org/repos/asf?p=tez.git;a=blob;f=tez-examples/src/main/java/org/apache/tez/examples/HashJoinExample.java