Senior Data Engineer

Job Description:

JOB DESCRIPTIONS

Data Engineering Roles | Databricks & SQL Focus

SENIOR DATA ENGINEER (5 Years Experience)

Position Overview

We are seeking a Data Engineer with 5 years of experience to develop and maintain robust data pipelines and analytics infrastructure. This role focuses on hands-on implementation using Databricks and SQL, contributing to data platform initiatives while continuously growing technical expertise in cloud-native data solutions.

Key Responsibilities

- Develop and deploy ETL/ELT pipelines using Databricks, PySpark, and SQL for data ingestion, transformation, and loading

- Write clean, efficient SQL and Python code for data processing, validation, and analytics

- Support data pipeline maintenance, monitor job executions, and troubleshoot data quality issues within SLA timelines

- Collaborate with Senior Engineers, Data Scientists, and Analytics teams to understand requirements and deliver solutions

- Implement data validation, error handling, and logging mechanisms to ensure pipeline reliability

- Document code, architecture decisions, and runbooks for operational excellence

- Participate in code reviews and contribute to knowledge sharing within the engineering team

Required Skills & Experience

- 5+ years of professional experience in data engineering, ETL development, or data analytics engineering

- Strong proficiency in Databricks (Spark SQL, PySpark) with real-world pipeline development experience

- Solid SQL skills including query optimization, joins, aggregations, and window functions

- Hands-on experience with Python for data processing and scripting

- Experience with cloud platforms such as Azure Data Factory, AWS Glue, or similar ETL services

- Understanding of data architecture, data modeling, and relational databases

- Strong problem-solving skills with attention to data quality and accuracy

Required Certifications (Nice to Have)

- Databricks Certified Data Engineer (Associate) OR

- Snowflake SnowPro Core Certified OR

- AWS Certified Data Engineer (Associate) OR equivalent professional data engineering certification

Preferred Qualifications

- Experience with orchestration tools (Apache Airflow, Tidal, Control-M, etc.)

- Familiarity with cloud data warehousing (Snowflake, Redshift, BigQuery)

- Experience with Git, CI/CD pipelines, and version control

- Knowledge of Agile methodologies and experience working in cross-functional teams

- Background in data validation frameworks and data quality testing

Location:
DGS India - Mumbai - Thane Ashar IT Park

Brand:
Merkle

Time Type:
Full time

Contract Type:
Consultant