We are seeking a skilled Big Data Engineer to join our team. The ideal candidate will be responsible for designing, building, and maintaining scalable data pipelines that handle large volumes of data.
You will work with various stakeholders, including data scientists, analysts, and other engineers, to ensure smooth data flow across the system.
This role requires expertise in handling big data technologies and a strong understanding of data processing and storage. Key Responsibilities:
Design, build, and manage robust, scalable data pipelines for efficient data collection, storage, and analysis.
Architect and implement big data solutions using technologies such as Hadoop, Spark, and NoSQL databases.
Integrate various data sources and ensure the proper transformation, aggregation, and storage of data for analytical purposes.
Monitor data pipelines to ensure data accuracy and optimize for performance, ensuring real-time data processing when required.
Work closely with data scientists, analysts, and business units to understand requirements and deliver appropriate data solutions. Technical Skills:
