About this role
We are looking for a skilled Data Engineer with around 2-4 years of experience to join our data engineering team. The ideal candidate should have strong hands-on experience in Snowflake, SQL, Python, PySpark, Spark Architecture and along with a solid understanding of data modeling and ETL pipeline development .
The candidate will be responsible for designing, developing, and maintaining scalable data pipelines, transforming and processing large datasets, and implementing data solutions using Snowflake and distributed data processing technologies. This role requires strong problem-solving skills and the ability to work effectively with cross-functional teams.
Qualifications :
- Bachelor’s degree in computer science, Information Technology, Engineering, or a related field.
- Around 2-4 years of professional experience in Data Engineering or a related field.
- Mandatory: Strong hands-on experience with Snowflake and Snowpark including its data warehousing capabilities.
- Mandatory: Strong hands-on experience with internal and external stages, file formats, data loading, Snowpipe, Streams, Tasks, stored procedures, and Snowflake security/access controls .
- Mandatory: Experience with Snowpark , particularly using Python/Snowpark for data processing and transformation within Snowflake.
- Mandatory: Good understanding of Snowflake architecture , including virtual warehouses, databases, schemas, compute/storage separation, and basic performance and cost optimization techniques.
- Mandatory: Familiarity with cloud storage technologies such as Amazon S3 or Azure Data Lake Storage.
- Mandatory: Strong hands-on experience with SQL.
- Mandatory: Strong programming experience in Python and hands-on experience with PySpark for large-scale data processing.
- God understanding of data modeling concepts, including relational and dimensional modeling.
- Experience in designing and developing ETL/ELT pipelines.
- Strong understanding of data transformation, data integration, and data processing concepts.
- Good analytical and problem-solving skills.
- Ability to work independently as well as collaboratively in a team environment.