Data Engineer (SNS02510)
Job Description
We currently have a vacancy for a Data Engineer fluent in English, to offer his/her services as an expert who will be based in Vienna, Austria. The work will be carried out either in the company’s premises or on site at customer premises.
Your tasks:
- Design databases and data warehouses with data models optimized for analysis;
- Design and develop data pipelines including ETL to move data from source systems to data warehouses and data lakes;
- Ensure quality of the data through extensive data validation, data cleaning and profiling;
- Optimize the data processing and management systems for performance;
- Work closely with data scientists to provide them access to data they need for analysis;
- Assistance in technical documentation for the system components.
Requirements:
- University degree in IT or relevant discipline, combined with minimum 7 years of relevant working experience in IT;
- Minimum 3 years of experience with on-premises Data Lake(house) architecture and components and Data Engineering;
- Minimum 3 years of experience in defining enterprise data products together with business analysts and subject matter experts;
- Minimum 3 years of experience in development of data pipelines using tools like dbt, Trino, Spark;
- Minimum 3 years of experience in extraction from source systems like MS SQL Server, Elastic, SharePoint;
- Minimum 3 years of experience in orchestration using Airflow or similar workflow tool;
- Minimum 1 year of experience with Agile and setup logging and auditing (Grafana, Loki etc.);
- Experience with Data catalogs (OpenMetadata) and data lineage tools (OpenLineage) would be considered an asset;
- Experience with Artificial Intelligence and Machine Learning frameworks would be considered an asset;
- Experience with Data Lake infrastructure and platforms (Linux, S3, Kubernetes) would be considered an asset;
- Excellent command of the English language.
Hiring Team Member
