Data Engineer

The candidate has over 10 years of experience in data engineering, focusing on the development, transformation, and optimization of data pipelines and architectures. With expertise in data modeling, data integration, and cloud technologies, the candidate has demonstrated a strong capability in leading technical teams and managing complex projects.In recent roles, the candidate has pioneered the integration of machine-generated data into data warehouses, developed custom algorithms, and built scalable cloud data architectures. They have implemented advanced data transformation techniques using DBT and have designed interactive dashboards that have significantly improved data-driven decision-making across organizations.

As a Senior Data Engineer, the candidate led efforts to migrate data from various sources to enterprise data warehouses, utilizing tools like Teradata, Knime, and Qliksense for data transformation and reporting. They also automated data loading using Python and pandas, ensuring efficiency in data processing. The candidate has a strong background in mentoring junior team members, performing code reviews, and enforcing coding standards.In previous roles, the candidate worked extensively with Teradata, focusing on performance tuning and optimization through techniques such as indexing, compression, and query optimization. They have a deep understanding of SQL and have created complex scripts for data extraction and transformation. The candidate has also worked with ETL tools like Informatica, contributing to large-scale projects in the healthcare and banking sectors.

The candidate has a proven track record of managing risk, gathering requirements, and delivering high-quality solutions. They have worked with cloud platforms like Microsoft Azure and Databricks, and are proficient in tools such as Snowflake, Airflow, and Microsoft Power BI. Their expertise extends to Python, Shell scripting, and GitHub, allowing them to efficiently manage and deploy data solutions.Throughout their career, the candidate has consistently demonstrated leadership and problem-solving skills, taking on architecture responsibilities and ensuring the delivery of high-performance, scalable solutions. Their experience spans a range of industries, including healthcare, banking, and retail, showcasing their versatility and ability to adapt to different business needs.