About this role
We are recruiting for a Databricks Application Developer in the Legal, Risk Management and Compliance (LRMC) team.
Mandatory technical & functional skills
• 3-5 years of experience in data engineering, data platform development, or Databricks application development.
• Hands-on expertise with Azure Databricks, Python, PySpark, Spark SQL, SQL, Delta Lake, and notebook-based development.
• Experience creating reliable ETL/ELT pipelines for batch and streaming data processing, including validation and error handling.
• Strong understanding of Medallion Architecture, dimensional data modelling, database design, indexing, query optimization, and performance tuning.
• Experience building Databricks applications, backend logic, REST APIs, and integrations with enterprise systems and data services.
• Hands-on experience with Databricks Workflows, jobs, scheduling, task orchestration, monitoring, logging, and production support.
• Experience with Unity Catalog, access controls, data lineage, governance, secrets, and secure data handling.
• Proficiency with GitHub source control, branching, pull requests, code reviews, GitHub Actions, and CI/CD deployment pipelines.
• Understanding of automated testing, Agile delivery, technical documentation, and operational readiness.
Preferred technical & functional skills
• Experience with Databricks Asset Bundles, Databricks SQL, Lakehouse architecture, and Infrastructure as Code.
• Exposure to Azure services such as Azure Data Lake Storage, Key Vault, Data Factory, Entra ID, and Azure DevOps.
• Experience integrating machine learning, generative AI, or governed AI services into Databricks applications.
• Knowledge of Power BI or other analytics and data visualization platforms.
• Understanding of risk management, compliance, governance, or other regulated business domains.