DSpace Repository

Pipeline – oriented scripting language for data processing

Show simple item record

dc.contributor BRÎNZAN, Leon
dc.contributor.author PASCAL, Adrian
dc.contributor.author SUNGUR, Emre-Batuhan
dc.contributor.author CLEPA, Rodion
dc.contributor.author GAVRILIUC, Tudor
dc.date.accessioned 2024-10-17T07:33:13Z
dc.date.available 2024-10-17T07:33:13Z
dc.date.issued 2024
dc.identifier.citation PASCAL, Adrian; Emre-Batuhan SUNGUR; Rodion CLEPA and Tudor GAVRILIUC. Pipeline – oriented scripting language for data processing. In: Conferinţa tehnico-ştiinţifică a studenţilor, masteranzilor şi doctoranzilor = Technical Scientific Conference of Undergraduate, Master and PhD Students, Universitatea Tehnică a Moldovei, 27-29 martie 2024. Chișinău, 2024, vol. 2, pp. 828-831. ISBN 978-9975-64-458-7, ISBN 978 9975-64-460-0 (Vol.2). en_US
dc.identifier.isbn 978-9975-64-458-7
dc.identifier.isbn 978 9975-64-460-0
dc.identifier.uri http://repository.utm.md/handle/5014/28116
dc.description.abstract This article explores the field of pipeline-oriented scripting languages, focusing on the development and use of a Python-based pipeline language. Pipeline-oriented scripting languages offer an approach that will optimize workflows through interconnections between processes. Benefits include optimized workflow, modularity-which refers to the ease of breaking down a system into interconnected modules, clean and simple syntax, efficient use of resources, and full compatibility. The study outlines the key requirements for building large-scale data pipelines and describes existing solutions that meet them. The article addresses common issues in data science, automation, integration, maintainability, and scalability, and highlights the benefits of Python's pipeline language. The designed tool is used to simplify complex data processing tasks. Design considerations for a Python pipeline language include domain-specific abstractions, support for pipeline composition, declarative syntax, integration with an existing ecosystem. The proposal is to develop a special Python pipeline language to improve data processing and analysis. en_US
dc.language.iso en en_US
dc.publisher Universitatea Tehnică a Moldovei en_US
dc.relation.ispartofseries Conferinţa tehnico-ştiinţifică a studenţilor, masteranzilor şi doctoranzilor = Technical Scientific Conference of Undergraduate, Master and PhD Students: Chişinău, 27-29 martie 2024. Vol. 2;
dc.rights Attribution-NonCommercial-NoDerivs 3.0 United States *
dc.rights.uri http://creativecommons.org/licenses/by-nc-nd/3.0/us/ *
dc.subject ANTLR 4 en_US
dc.subject automation en_US
dc.subject machine learning en_US
dc.subject Python programming language en_US
dc.title Pipeline – oriented scripting language for data processing en_US
dc.type Article en_US


Files in this item

The following license files are associated with this item:

This item appears in the following Collection(s)

Show simple item record

Attribution-NonCommercial-NoDerivs 3.0 United States Except where otherwise noted, this item's license is described as Attribution-NonCommercial-NoDerivs 3.0 United States

Search DSpace


Advanced Search

Browse

My Account