About this role
Experience: 4–6 years of experience in data engineering or software development.
Technical Expertise:
• Strong hands-on experience with Apache Spark / PySpark.
• Proficiency in Python programming (data manipulation, error handling, packaging).
• Solid understanding of distributed computing concepts (RDDs, DataFrames, partitions, shuffles).
• Proficient in SQL and data modeling for both structured and semi-structured data.
• Understanding of version control (Git), CI/CD, and Agile methodologies.
• Strong debugging, performance tuning, and analytical skills.