Analysis of Distributed Systems Dynamics with Erlang Performance Lab

Michał Ślaski, Wojciech Turek, Arkadiusz Gil, Bartosz Szafran, Mateusz Paciorek, Aleksander Byrski

Abstract


Modern, highly concurrent and large-scale systems require new methods for design, testing and monitoring. Their dynamics and scale require real-time tools, providing a holistic view of the whole system and the ability of showing a more detailed view when needed. Such tools can help identifying the causes of unwanted states, which is hardly possible with static analysis or metrics-based approach. In this paper a new tool for analysis of distributed systems in Erlang is presented. It provides real-time monitoring of system dynamics on different levels of abstraction. The tool has been used for analyzing a large-scale urban traffic simulation system running on a cluster of 20 computing nodes.

Keywords


software engineering, distributed computing and simulation, distributed systems monitoring

Full Text:

PDF

References


Allen J.: Effective Akka. O’Reilly Media, 2013.

Armstrong J.: Programming Erlang: Software for a Concurrent World. The Pragmatic Programmers, LLC, North Carolina, USA, 2013.

Basiri A., Behnam N., de Rooij R., Hochstein L., Kosewski L., Reynolds J., Rosenthal C.: Chaos engineering. In: IEEE Software, vol. 33(3), pp. 35–41, 2016.

Byrski A., Kisiel-Dorohinicki M.: Evolutionary Multi-Agent Systems: from inspirations to applications. Studies in Computational Intelligence, vol. 680. Springer, 2017.

Horanyi G.: Intuition Engineering with Docker. https://medium.com/@ghoranyi/, 2016. Accessed 25.05.2017.

Isaacs K.E., Gim ́enez A., Jusufi I., Gamblin T., Bhatele A., Schulz M., Hamann B., Bremer P.T.: State of the art of performance visualization. In: EuroVis 2014, 2014.

Kazirod M., Korczynski W., Fern ́andez E., Byrski A., Kisiel-Dorohinicki M., Topa P., Tyszka J., Komosinski M.: Agent-oriented Foraminifera Habitat Simulation. In: Procedia Computer Science, vol. 51, pp. 1062 – 1071, 2015. ISSN 1877- 0509. URL http://dx.doi.org/https://doi.org/10.1016/j.procs.2015. 05.264. International Conference On Computational Science, ICCS 2015.

Lamarche-Perrin R., Schnorr L.M., Vincent J.M., Demazeau Y.: Evaluating trace aggregation for performance visualization of large distributed systems. In: Per- formance Analysis of Systems and Software (ISPASS), 2014 IEEE International Symposium on, pp. 139–140. IEEE, 2014.

Nagel K., Schreckenberg M.: A cellular automaton model for freeway traffic. In: Journal de physique I, vol. 2(12), pp. 2221–2229, 1992.

Reynolds J., Rosenthal C.: Vizceral Open Source. https://medium.com/ netflix-techblog/vizceral-open-source-acc0c32113fe, 2016. Netflix Tech- nology Blog, accessed 22.05.2017. 2018/01/11; 00:22 str. 15/16

Ros`a A., Chen L.Y., Binder W.: Profiling actor utilization and communication in Akka. In: Proceedings of the 15th International Workshop on Erlang, pp. 24–32. ACM, 2016.

Schnorr L.M., Huard G., Navaux P.O.A.: A hierarchical aggregation model to achieve visualization scalability in the analysis of parallel applications. In: Par- allel Computing, vol. 38(3), pp. 91–110, 2012.

Slaski M.: Erlang Performance Lab. https://www.youtube.com/watch? v=ncedupb-Rqw, 2017. Slides available at https://speakerdeck.com/ michalslaski/erlang-performance-lab.

Slaski M.: Open source under the Apache License 2.0. https://twitter.com/ erlanglab/status/834339893555900416, 2017. @erlanglab Twitter micro blog, accessed 22.05.2017.

Turek W.: Erlang-based Desynchronised Urban Traffic Simulation for High- Performance Computing Systems. In: Future Generation Computer Systems (accepted for printing), 2017.




DOI: http://dx.doi.org/10.7494/csci.2018.19.2.2752

Refbacks

  • There are currently no refbacks.