Data Engineer

Job Requirements

As a Fabric Data Engineer, you will be responsible to design, develop and optimize enterprise-scale data solutions leveraging Microsoft Fabric. You will work closely with cross-functional teams to integrate data from various sources, including SAP ERP and non-ERP systems. The ideal candidate will possess strong expertise in PySpark, Python,SQL Fabric Lakehouse, Data Factory and Data Warehousing.

Work Experience

· Design and implement data integration solutions using Microsoft Fabric.

· Integrate data from API, SAP ERP and non-ERP sources like Zoho CRM, Wrench, ManageEngine ITSM tool, Sourcing Tool, HRMS, and other digital solutions.

· Develop and maintain ETL processes using PySpark and Python to ensure data accuracy and consistency.

· Design, develop and maintain scalable data pipelines using Microsoft Fabric.

· Develop solutions leveraging Fabric Lakehouse, Data Warehouse, Notebooks and Data Factory.

· Implement medallion architecture (Bronze, Silver, Gold) for enterprise data platforms.

· Perform data transformation, cleansing, validation and enrichment activities.

· Develop reusable frameworks and accelerators for data processing.

· Collaborate with business stakeholders to understand data requirements and deliver actionable insights.

· Create and optimize data models and dashboards in Power BI.

· Monitor and troubleshoot data integration workflows to ensure optimal performance.

· Good exposure on Fabric Administration, Governance, Monitoring and Automation.

· Document data integration processes and provide training to end-users.

· Communicate with IT business partners to elicit, analyze, communicate, document, and validate requirements.

· Documentation and adherence to change control policies & procedures of software development or project management lifecycle methodologies.

Qualifications:

· Bachelor’s degree in computer science, Information Technology, or a related field.

· Proven experience as a Data Engineer, with expertise in Microsoft Fabric and Power BI.

· Strong knowledge of SAP ERP and non-ERP systems integration.

· Proficiency in ETL tools and techniques.

· Experience with data modeling and visualization in Power BI.

· Excellent problem-solving skills and attention to detail.

· Strong communication and collaboration skills.