From the sqoop documention ,It says Sqoop can be used to import data to Hive with dynamic partition.But couldn't find any example for it. Has anyone tried it.
The Sqoop HCatalog feature supports the following table types:
- Unpartitioned tables
- Partitioned tables with a static partitioning key specified
- Partitioned tables with dynamic partition keys from the database result set
- Partitioned tables with a combination of a static key and additional dynamic partitioning keys
I'm looking for option # 3.
Thanks in Advance.
I guess the Sqoop documentation is lagging. It's common in the Hadoop ecosystem to have features introduced in version X and documented in version X+1.
On the other hand, it's a HCatalog feature exposed into Sqoop, so why don't you check the HCatalog documentation under entry "Dynamic Partitioning" ?
;-)