EFFICIENT APPROACH FOR VIEW SELECTION FOR DATA WAREHOUSE USING TREE MINING AND EVOLUTIONARY COMPUTATION

Atul Thakare, Parag Deshpande

Abstract


Selection of a proper set of views to materialize plays an important role in
database performance. There are many methods of view selection which uses different techniques and frameworks to select an efficient set of views for materialization. In this paper, we present a new efficient, scalable method for view selection under the given storage constraints using a tree mining approach and evolutionary optimization. Tree mining algorithm is designed to determine the exact frequency of (sub)queries in the historical SQL dataset. Query Cost model achieves the objective of maximizing the performance benefits from the final view set which is derived from the frequent view set given by tree mining algorithm. Performance benefit of a query is defined as a function of query
frequency, query creation cost, and query maintenance cost. The experimental results shows that the proposed method is successful in recommending a solution which is fairly close to optimal solution.


Keywords


Database Management Systems , Data Warehousing and Data Mining , Query Optimization , Graph Mining , Algorithms for Parallel Computing , Evolutionary computations , Genetic Algorithms.

Full Text:

PDF

References


. Harinarayan V, Rajaraman A, Ullman JD (1996) Implementing data cubes efficiently. In Proceedings of ACM SIGMOD international conference on management of data, (Vol. 25 No. 2, pp. 205-216), ACM.

. Ross K, Srivastava D, Sudarshan S, Materialized View Maintenance and Integrity Constraint Checking: Trading Space for Time, ACM-SIGMOD Conference (6) 96 447-458 (1996)

. Gupta H, Selection of views to materialize in a data warehouse, Proceedings of the 5th international conference on database theory, Delphi, Greece, January 1997 98-112 (1997)

. Ezeife CI,A uniform approach for selecting views and indexes in a data warehouse, Proceedings of the 2nd international database engineering and applications symposium, Montreal, Canada, August 1997 151-160 (1997)

. J.Yang, K. Karlapalem, and Q. Li.,A framework for designing materialized views in data warehousing environment, Proceedings of 17th IEEE International conference on Distributed Computing Systems, Maryland, U.S.A., May 1997. (1997)

. J.Yang, K. Karlapalem, and Q. Li.,Algorithms for materialized view design in data warehousing environment, VLDB, 136-145 (1997)

. C. Zhang and J. Yang.,Genetic algorithm for materialized view selection in data warehouse environments., DaWaK, 116-125 (1999)

. H. Gupta, I.S. Mumick,Selection of views to materialize under a maintenance cost constraint., Proc. 7th International Conference on Database Theory (ICDT'99), Jerusalem, Israel, 453-470 (1999)

. Horng, J-T., Chang Y-J., and Liu B-J.(2003). Applying evolutionary algorithms to materialized view selection in a data warehouse. Soft Computing 7(8), 574-581.

. Lin W.Y., Kuo I.C.,A genetic selection algorithm for OLAP data cubes,Knowledge and Information Systems 6 (1), 83-102 (2004)

. Gupta H,Selection of views to materialize in a data warehouse,Proceedings of sixth ICDT (17)1, 98-112 (2005)

. Aouiche K., Jouve P. and Darmont J.,Clustering-based materialized view selection in data warehouses, In ADBIS06, volume 4152 of LNCS, 81-95 (2006)

. Hung M.-C., Huang M.-L., Yang D.-L., Hsueh N.-L.,Ecient approaches for materialized views selection in a data warehouse, International Journal of Information Sciences 177, 1333-1348 (2007)

. An Gong, W. Z.,Clustering-Based Dynamic Materialized View Selection Algorithm, Fifth International Conference on Fuzzy Systems and Knowledge Discovery, FSKD '08. Shandong, China: IEEE., 1333-1348 (2008)

. Afrati F., Chirkova R.,Selecting and using views to compute aggregate queries, Journal of Computer and System Sciences 77, 1079-1107 (2011)

. Ray Hylock, Faiz Currim.,A maintenance centric approach to the view selection problem.,Information Systems 38:7, 971-987 (2013)

. Mohammad K S, Vahid G,Materialized View Selection for a Data Warehouse Using Frequent Itemset Mining,Journal of Computers 11(2), 140-148 (2015)

. P . R . Vishwanath, S. R.,An Association Rule Mining for Materialized View Selection and View Maintenance.,International Journal of Computer Applications., (2015)

. R Goswami, D. K Bhattacharyya, M Dutta.,Materialized view selection using evolutionary algorithm for speeding up big data query processing.,Journal of Intelligent Information Systems 49:3, 407-433 (2017)

. Amit Kumar, T. V. Vijay Kumar.,Improved Quality View Selection for Analytical Query Performance Enhancement Using Particle Swarm Optimization.,International Journal of Reliability, Quality and Safety Engineering 24:06.

https://doi.org/10.1142/S0218539317400010 (2017)




DOI: https://doi.org/10.7494/csci.2018.19.4.3006

Refbacks

  • There are currently no refbacks.