About this role
Python Databricks Developer
Role Overview:
We are looking for a Python Databricks Developer with strong experience in data engineering, ETL development, and cloud-based data platforms. The candidate will be responsible for developing and optimizing data pipelines using Python, Databricks, and Apache Spark.
Key Responsibilities:
- Develop and maintain scalable data pipelines using Python, Databricks, and PySpark .
- Design and implement ETL/ELT workflows for large-scale data processing.
- Develop and optimize Databricks notebooks, jobs, and workflows.
- Work with Apache Spark for distributed data processing.
- Integrate data from multiple sources and build reliable data solutions.
- Perform data transformation, cleansing, validation, and optimization.
- Troubleshoot pipeline failures and performance issues.
- Collaborate with data engineers, analysts, and business stakeholders.
- Follow data quality, security, and development best practices.
Required Skills:
- Strong experience with Python and PySpark .
- Hands-on experience with Databricks .
- Good understanding of Apache Spark and distributed data processing.
- Strong SQL skills and experience with relational databases.
- Experience in ETL/ELT and data pipeline development.
- Knowledge of cloud platforms such as Azure, AWS, or GCP .
- Experience with Delta Lake and Databricks Workflows is preferred.
- Good problem-solving and communication skills.
Experience: 4–8 years
Role: Python Databricks Developer
Python,
SQL, Databricks, Apache Spark, REST APIs, Data Modeling, Git, Cache
development
Good to have – LLM Integration,