Senior Lead Data Engineer - R01573561

BrillioBengaluru, KarnatakaOn-siteFull-timeSenior, 5–8 yearsListed 45 minutes ago

Apply now

About this role

Senior Lead Data Engineer

Primary Skills

- Google Cloud Platform Administration, Google Cloud Platform (GCP), Gsuite, Apigee, GCP Security

Specialization

- GCP Infrastructure Engineering: Engineer, Database & Middleware

Job requirements

- Experience Range: With at least 5 to 8 years of hands-on experience in data engineering, including significant expertise in GCP infrastructure and cloud-based ETL solutions Key Responsibilities: 1. Design, develop, and optimize scalable data pipelines and ETL workflows on Google Cloud Platform using IICS and BigQuery 2. Implement, maintain, and troubleshoot GCP infrastructure components, ensuring high availability and security compliance 3. Automate data integration processes utilizing Python, SQL, and shell scripting to support business analytics and reporting 4. Configure and manage GCP security protocols, including IAM roles, audit logging, and data encryption to safeguard sensitive information 5. Integrate Salesforce data with cloud data warehouses, ensuring seamless data flow and accuracy 6. Monitor and tune BigQuery performance, optimizing queries and resource utilization for large-scale datasets 7. Lead migration and modernization initiatives, transitioning legacy systems to GCP-based architectures 8. Document technical solutions, workflow processes, and best practices for ongoing knowledge sharing and operational excellence Required Skills: 1. Google Cloud Platform (GCP) administration 2. IICS (Informatica Intelligent Cloud Services) 3. BigQuery 4. Shell scripting 5. Python 6. Advanced SQL Preferred Skills: 1. Experience with Salesforce data integration 2. Expertise in cloud migration strategies 3. Knowledge of data governance frameworks 4. Proficiency with Terraform or similar infrastructure-as-code tools 5. Familiarity with Kubernetes on GCP 6. Experience with real-time data streaming solutions Desired Qualifications: 1. Bachelor's degree in Computer Science, Information Technology, or a closely related discipline 2. Google Professional Data Engineer certification or equivalent relevant GCP certification 3. Informatica Cloud certification