A TOOLKIT FOR STORAGE QOS PROVISIONING FOR DATA-INTENSIVE APPLICATIONS

Renata Słota; Dariusz Krol; Kornel Skałkowski; Michal Orzechowski; Darin Nikolow; Bartosz Kryza; Michal Wrzeszcz; Jacek Kitowski

doi:10.7494/csci.2012.13.1.63

Authors

Renata Słota AGH University of Science and Technology, Faculty of Electrical Engineering, Automatics, Computer Science and Electronics, Department of Computer Science, Krakow, Poland; AGH University of Science and Technology, ACC Cyfronet AGH, Krakow,
Dariusz Krol AGH University of Science and Technology, Faculty of Electrical Engineering, Automatics, Computer Science and Electronics, Department of Computer Science, Krakow,
Kornel Skałkowski AGH University of Science and Technology, Faculty of Electrical Engineering, Automatics, Computer Science and Electronics, Department of Computer Science, Krakow, Poland; AGH University of Science and Technology, ACC Cyfronet AGH, Krakow,
Michal Orzechowski AGH University of Science and Technology, Faculty of Electrical Engineering, Automatics, Computer Science and Electronics, Department of Computer Science, Krakow
Darin Nikolow AGH University of Science and Technology, Faculty of Electrical Engineering, Automatics, Computer Science and Electronics, Department of Computer Science, Krakow, Poland; AGH University of Science and Technology, ACC Cyfronet AGH, Krakow,
Bartosz Kryza AGH University of Science and Technology, Faculty of Electrical Engineering, Automatics, Computer Science and Electronics, Department of Computer Science, Krakow, Poland, AGH University of Science and Technology
Michal Wrzeszcz AGH University of Science and Technology, Faculty of Electrical Engineering, Automatics, Computer Science and Electronics, Department of Computer Science, Krakow
Jacek Kitowski AGH University of Science and Technology, Faculty of Electrical Engineering, Automatics, Computer Science and Electronics, Department of Computer Science, Krakow, Poland; AGH University of Science and Technology, ACC Cyfronet AGH, Krakow

DOI:

https://doi.org/10.7494/csci.2012.13.1.63

Abstract

This paper describes a programming toolkit developed in the PL-Grid project, named QStorMan, which supports storage QoS provisioning for data-intensive applications in distributed environments. QStorMan exploits knowledge-oriented methods for matching storage resources to non-functional requirements, which are defined for a data-intensive application. In order to support various usage scenarios, QStorMan provides two interfaces, such as programming libraries or a web portal. The interfaces allow to define the requirements either directly in an application source code or by using an intuitive graphical interface. The first way provides finer granularity, e.g., each portion of data processed by an application can define a different set of requirements. The second method is aimed at legacy applications support, which source code can not be modified. The toolkit has been evaluated using synthetic benchmarks and the production infrastructure of PL-Grid, in particular its storage infrastructure, which utilizes the Lustre file system.