Data Engineer
About Candidate
Introduction:
A Data Engineer with over 15 years of experience specializing in designing, building, and optimizing data pipelines, databases, and scalable solutions. Expertise in creating data models, implementing complex business logic, and writing efficient queries across various database systems like MSSQL, Oracle, PostgreSQL, and MySQL. Skilled in developing ELT/ETL pipelines using Databricks, Apache Spark, and Hadoop, with a strong focus on cloud platforms such as AWS and GCP. Proven ability to migrate legacy systems to modern environments, ensuring seamless integration and enhanced performance.Demonstrated success in automating reporting systems, reducing manual efforts, and improving data reliability. Adept at resolving critical technical issues, optimizing data flows, and collaborating with stakeholders to deliver business-driven solutions. Experienced in managing data migration, orchestrating workflows with tools like Airflow, and ensuring data integrity across systems. Known for simplifying processes, automating tasks, and translating technical concepts for non-technical audiences. A results-oriented professional focused on driving innovation and delivering high-quality, data-driven solutions.
Responsibilities:
- Designed and optimized data pipelines and ETL/ELT processes using tools like Databricks, Apache Spark, and Hadoop.
- Migrated legacy systems to cloud platforms such as AWS and GCP, ensuring seamless integration and improved performance.
- Developed complex data models and database objects to implement business logic and enhance data flow efficiency.
- Automated reporting systems, reducing manual effort by up to 60% across industries like finance, e-commerce, and logistics.
- Built and maintained large-scale databases using MSSQL, Oracle, PostgreSQL, and MySQL for various applications.
- Resolved critical data flow and performance issues, ensuring system reliability and data integrity.
- Created clear and comprehensive documentation for workflows, onboarding processes, and existing solutions.
- Collaborated with cross-functional teams to translate business requirements into scalable, data-driven solutions.
- Led analysis and development of custom database solutions, ensuring on-time delivery and client satisfaction.
- Mentored team members and facilitated knowledge-sharing sessions to improve team performance and expertise.