Hive TestBench on ARM64

About Hive TestBench

The information available on Hive TestBench web page.

Compilation and Run of Hive TestBench

Create a local clone

Clone the Hive TestBench

$ git clone https://github.com/hortonworks/hive-testbench.git

Compile the benchmark

Compile the benchmark using the scripts

$ ./tpcds-build.sh 
$ ./tpch-build.sh

Choose the scale of data on which to run the tests Under 4 nodes, less than 100-250GB, 4-10 nodes should handle 1TB, Large clusters can scale up to higher values

Prepare data for the scale

As an example

$ ./tpcds-setup.sh 1000 
$ ./tpch-setup.sh 1000

By default this creates tables in ORC format, you can choose a different format by setting

FORMAT=<SEQUENCEFILE, TEXTFILE, RCFILE, ORC, PARQUET, orAVRO>
For example; FORMAT=rcfile ./tpcds-setup.sh 30000

Run queries

You can use hive, beeline or any SQL tool

TPC-DS

cd sample-queries-tpcds                                       
hive -i testbench.settings                                      
hive> use tpcds_bin_partitioned_orc_1000;      
hive> source query55.sql;                                     

TPC-H

cd sample-queries-tpch
hive -i testbench.settings
hive> use tpch_flat_orc_1000;
hive> source tpch_query1.sql;

LEG/Engineering/BigData/HiveTestBench (last modified 2016-09-21 05:40:14)