Data Engineer - Python Job

YASH TechnologiesOn-siteFull-timeSenior, 5–8 yearsListed 3 hours ago

Apply now

About this role

YASH Technologies is a leading technology integrator specializing in helping clients reimagine operating models, enhance competitiveness, optimize costs, foster exceptional stakeholder experiences, and drive business transformation.

At YASH, we’re a cluster of the brightest stars working with cutting-edge technologies. Our purpose is anchored in a single truth – bringing real positive changes in an increasingly virtual world and it drives us beyond generational gaps and disruptions of the future.

We are looking forward to hire Python Professionals in the following areas :

Job description:

Position: Data Engineer
Location: Chennai
Experience: 4-6 Years

Role Overview
We are looking for a highly skilled Data Engineer with strong Python development expertise to design, develop, and maintain scalable data pipelines and data platforms. The ideal candidate should have hands-on experience in building ETL/ELT solutions, processing large datasets, and working with cloud-based data ecosystems. The role involves partnering with data analysts, Power BI developers, product teams, and business stakeholders to deliver reliable and high-quality data solutions.

Key Responsibilities
• Design, develop, and maintain scalable data pipelines using Python and SQL.
• Build and optimize ETL/ELT processes for structured and unstructured data.
• Develop data ingestion frameworks from APIs, databases, files, and cloud storage.
• Perform data transformation, cleansing, validation, and quality checks.
• Work with cloud platforms (AWS/Azure) to build and support modern data solutions.
• Design and maintain data models, data marts, and analytical datasets.
• Optimize performance of data pipelines and database queries.
• Implement monitoring, logging, and operational support for production workloads.
• Collaborate with Power BI, Data Science, and application teams to deliver business solutions.
• Follow best practices for version control, code reviews, CI/CD, and automated testing.

Required Skills
Strong Must-Have Skills
• Expert-level Python programming
• Strong SQL and database design concepts
• ETL/ELT development experience
• Data pipeline development and orchestration
• Data validation and data quality frameworks
• Git version control
• Linux/Unix scripting

Data Engineering Technologies
• PySpark / Apache Spark
• Apache Airflow or equivalent scheduling tools
• Data Warehousing concepts
• Snowflake, SQL Server, PostgreSQL, Redshift, or similar platforms
• REST API integration

Cloud Technologies (Preferred)
• AWS (S3, Glue, Lambda, EMR, RDS) OR
• Azure (Data Factory, Databricks, Synapse, ADLS)

Preferred Qualifications
• Experience handling large-scale datasets and big data workloads.
• Experience with Power BI reporting datasets and semantic models.
• Exposure to real-time or near real-time data processing.
• Knowledge of CI/CD pipelines and DevOps practices.
• Experience supporting production data platforms.

Qualifications
• Bachelor's degree in Computer Science, Information Technology, Engineering, or related field.
• 4-6 years of experience in Data Engineering.
• Relevant cloud certifications (AWS/Azure) are a plus.

At YASH, you are empowered to create a career that will take you to where you want to go while working in an inclusive team environment. We leverage career-oriented skilling models and optimize our collective intelligence aided with technology for continuous learning, unlearning, and relearning at a rapid pace and scale.

Our Hyperlearning workplace is grounded upon four principles

- Flexible work arrangements, Free spirit, and emotional positivity

- Agile self-determination, trust, transparency, and open collaboration

- All Support needed for the realization of business goals,

- Stable employment with a great atmosphere and ethical corporate culture