Lead Software Engineer - Big Data(Data Engineer), Python, and AWS

We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible.

As a Lead Software Engineer at JPMorganChase within the CIB, you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading technology data products in a secure, stable, and scalable way. As a core technical contributor, you are responsible for maintaining critical data pipelines and architectures across multiple technical areas within various business functions in support of the firm’s business objectives.
Job responsibilities
- Executes creative software solutions, design, development, and technical troubleshooting with ability to think beyond routine or conventional approaches to build solutions or breakdown technical problems

- Delivers data collection, storage, access, and analytics data platform solutions in a secure, stable, and scalable way
- Uses enterprise-authorized AI capabilities within the work environment to accelerate data products and model design analysis and documentation, validating outputs and handling data according to sensitivity and security requirements.
- Evaluates and reports on access control processes to determine effectiveness of data asset security with minimal supervision
- Applies reuse-first, AI-assisted practices within delivery and operational routines (e.g., backup/recovery validation and access control review support), ensuring traceability/auditability and alignment to resiliency and security expectations.
- Develops secure and high-quality production code, and reviews and debugs code written by others
- Identifies opportunities to eliminate or automate remediation of recurring issues to improve overall operational stability of software applications and systems

Required qualifications, capabilities, and skills
- Formal training or certification on data engineering concepts and 5+ years applied experience
- Proficient at processing and analyzing large datasets using Big Data technologies, including Apache Spark, across data platforms comprising of Redshift, SQL DB, RDS and Databricks.
- Design, development, and implementation of scalable data pipelines and data matching solutions on AWS, utilizing Python for data engineering tasks.
- Strong experience in setup and configuration of services such as S3, Step Functions, EMR, Glue, Lambda, RDS, EventBridge, Step-Functions and API Gateway for scripting, automation, and orchestration of data workflows.
- Strong hands-on experience with Databricks and distributed data processing technologies.
- Understanding of data architecture, data modeling, data integration, and data product principles.
- Experience designing and operating large-scale data platforms and data products in complex enterprise environments.
- Development of semantic layer for data consumption using Iceberg tables and APIs.
- Implementation of continuous deployment and integration processes using Infrastructure as Code tools, including Terraform.
- Troubleshoot and resolve issues related to application code and data workflows.
- Demonstrated experience using enterprise-authorized AI capabilities within the work environment to support data engineering workflows with strong validation habits and awareness of data sensitivity.
- Working experience with both relational and NoSQL databases
- Advanced in one or more programming language(s)
- Advanced understanding of agile methodologies such as CI/CD, Application Resiliency, and Security

Preferred qualifications, capabilities, and skills

- Experience working with modern enterprise data platforms and cloud-native data architectures.
- Experience supporting real-time, analytical, or AI/ML-oriented data use cases.
- Databricks, Snowflake, AWS cloud, or Data Engineering certifications