Big Data Engineer (SN0425)
Job Description
We are looking for a Big Data Engineer to standardize, integrate, and optimize data pipelines across multiple platforms.
- You will be responsible for automating data ingestion, ensuring data consistency, and building efficient data models to support business intelligence and forecasting.
- Collaborating with stakeholders, you will drive data-driven decision-making while mentoring junior engineers and maintaining high-performance data systems.
Key Responsibilities
- Standardize and integrate data from SAP and related systems into Snowflake using Qlik Replicate.
- Automate data ingestion and transformation processes to enhance data accuracy and consistency.
- Develop and optimize SQL queries in Snowflake for efficient data transformation and reporting.
- Design and implement scalable data models to support diverse business use cases.
- Apply forecasting techniques to generate actionable insights for business strategy development.
- Work closely with finance and business teams to understand data needs and requirements.
- Clearly communicate data pipeline developments, integrations, and changes to stakeholders.
- Manage multiple priorities while ensuring business teams can effectively leverage data insights.
- Develop automation solutions to improve operational efficiency and minimize manual processes.
- Maintain and optimize existing data integration processes for performance and data quality assurance.
- Work alongside the lead engineer to deliver high-quality, scalable solutions.
- Support and mentor junior engineers, providing guidance on best practices and technical challenges.
Required Skills & Qualifications
- 3+ years of experience in Big Data Engineering, Data Integration, or Data Analytics.
- Snowflake, Qlik Replicate, and SQL development.
- data pipeline automation and ETL/ELT processes.
- data modeling, forecasting techniques, and business analytics.
- SAP data sources
- Python or other scripting languages
- problem-solving skills
Preferred Qualifications
- Cloud Platforms (AWS, Azure, or GCP).
- machine learning-based forecasting techniques.
- CI/CD for data engineering and DevOps practices.
Hiring Team Member
