Estimate the Performance of Cloudera Decision Support Queries

Authors

  • Tahani M. Allam Computer and Control Engineering Dept. Faculty of Engineering, Tanta University, Tanta, Egypt

DOI:

https://doi.org/10.3991/ijoe.v18i01.27877

Keywords:

Hadoop, Impala, Hive, Massive parallel processing, Big data, TPC-H, Graphics Data expo 2009

Abstract


Hive and Impala queries are used to process a big amount of data. The overwriting amount of information requires an efficient data processing system. When we deal with a long-term batch query and analysis Hive will be more suitable for this query. Impala is the most powerful system suitable for real-time interactive Structured Query Language (SQL) query which are added a massive parallel processing to Hadoop distributed cluster. The data growth makes a problem with SQL Cluster because the execution processing time is increased. In this paper, a comparison is demonstrated between the performance time of Hive, Impala and SQL on two different data models with different queries chosen to test the performance. The results demonstrate that Impala outperforms Hive and SQL cluster when it comes to analyze data and processing tasks. Using two benchmark datasets, TPC-H and statistical computing, we compare the performance of Hive, Impala, and SQL clusters 2009 Statistical Graphics Data Expo.
Covr iJOE Vol. 18 No. 01 (2022)

Downloads

Published

2022-01-26

How to Cite

Allam, T. M. (2022). Estimate the Performance of Cloudera Decision Support Queries. International Journal of Online and Biomedical Engineering (iJOE), 18(01), pp. 127–138. https://doi.org/10.3991/ijoe.v18i01.27877

Issue

Vol. 18 No. 01 (2022)

Section

Papers

License

Copyright (c) 2021 Tahani M. Allam

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

The submitting author warrants that the submission is original and that she/he is the author of the submission together with the named co-authors; to the extend the submission incorporates text passages, figures, data or other material from the work of others, the submitting author has obtained any necessary permission.
Articles in this journal are published under the Creative Commons Attribution Licence (CC-BY What does this mean?). This is to get more legal certainty about what readers can do with published articles, and thus a wider dissemination and archiving, which in turn makes publishing with this journal more valuable for you, the authors.
By submitting an article the author grants to this journal the non-exclusive right to publish it. The author retains the copyright and the publishing rights for his article without any restrictions.