Databricks Architect

PerficientColombiaOn-siteFull-timePrincipal, 12–15+ yearsListed 3 hours ago

Apply now

About this role

- Responsibilities

• Drive project requirements by interviewing business and IT stakeholders.
• Own and aggressively drive forward end-to-end Lakehouse and AI solutions. Provide architectural solutions/designs to project execution teams for implementation.
• Architect Databricks solutions on various Cloud platforms (Azure, AWS, and GCP). This includes multi-cloud integration, data ingestion and streaming, data transformation, data modeling, data governance and data sharing.
• Architect Databricks AI/BI solutions that drive business insights with Databricks ML, AI and BI features.
• Integrate Databricks solutions with cloud platforms like Azure (ADF, ADLS, Event Hub, Azure DevOps) or AWS (S3, Lamda, Glue).
• Evaluate and integrate innovative solutions with GenAI, Delta Live Tables/Lakeflow, Lakebridge, etc.
• Design and implement analytical data models and star schemas for BI and AI consumption.
• Provide architectural assessments, strategies, and roadmaps for one or more technological domains.
• Work with Product Owner and Business SMEs to understand functional requirements and interact with other cross-functional teams to architect, design, develop, test, and release features.
• Project and solution estimation and team structure definition.
• Develop Proof-of-Concept projects to validate new architectures and solutions.
• Support multiple Agile Scrum teams with planning, scoping and creation of technical solutions for the new product capabilities throughout continuous delivery to production.
• Liaise with offshore team and clients for resolving technical dependencies, issues, and risks.
• Mentor and provide architectural guidance to multiple teams building innovative applications.
• Drive common vision, practice and capabilities across teams.
• Engage with Technical Architects and technical staff to determine the most appropriate technical strategy and designs to meet business needs.
• Demonstrate broad solutions technical leadership, impacting significant technical direction, exerting influence outside of the immediate team and driving change.

- Qualifications
• Minimum of 10 years of professional experience with Data Management and Cloud technologies including Enterprise Data Warehouses, Data Lakes and Lakehouses
• 3-5 years of professional experience with Databricks and Lakehouse Architecture.
• 4-5 years of hands-on experience with big data technologies such Spark, Hadoop, Kafka, Data Lakehouse.
• Experience implementing, designing, and building solutions leveraging Databricks Unity Catalog, ML/AI and Workflows.
• At least 3 Databricks project implementations that exploit the full capabilities (discover, design, implement and optimize) – is a MUST.
• At least 5 Years architecting ETL/ELT solutions using commercial tools.
• Proficiency with Classic ML/AI, Gen AI and Agentic AI type solutions and architectures.
• DevOps experience with Databricks CI/CD (Asset Bundles), Git, Terraform
• Design and architecture experience supporting both batched and streaming workloads for Big Data Pipelines.
• At least 3 years of experience in a professional services company, consulting firm, or agency
• Have a solid understanding of delivery methodology and lead teams in the implementation of the solution according to the designed architecture.
• Experience in project and solution estimation and team structure definition.
• Fluent and current on architecture trends with an eye on market/technical conditions and future direction.
• Experience in defining new architectures and ability to drive an independent project from an architectural standpoint.
• Demonstrated success in performing work and managing complex and/or large consulting projects.
• Proficient in authoring, editing and presenting technical documents.
• Ability to elicit requirements and communicate clearly with non-technical individuals, development teams, and other ancillary project members.
• Strong written and oral communication skills; Ability to communicate effectively with technical and non-technical staff.
• Track record of leadership roles delivering solutions within defined timeframes
• Experience working with a globally distributed team and managing off-shore teams
• Desire to mentor younger team members and develop their skills.
• Experience working on multiple concurrent projects.
• Excellent problem-solving skills.
• Be independent and self-driven.
• Bachelor’s degree in Computer Science, Engineering, Information Systems, or a related field.
• Work is expected to be out of the local Perficient office.
• Must be open to travel and work at client site when required.

Preferred Skills & Education

• Master’s degree in Computer Science or related field
• Certification in Databricks (Champion or Professional), Apache Spark and/or Cloud Platforms (AWS/Azure) preferred.
• Leadership and team management experience with the ability to provide strategic planning and oversight
• Experience leading customer workshop sessions to educate customers on the latest technology trends and best practices

Perficient full-time employees receive complete and competitive benefits. We offer a collaborative work environment, competitive compensation, generous work/life opportunities and an outstanding benefits package that includes paid time off plus holidays. In addition, all colleagues are eligible for a number of rewards and recognition programs including billable bonus opportunities. Encouraging a healthy work/life balance and providing our colleagues great benefits are just part of what makes Perficient a great place to work.

WHO WE ARE

Perficient is a leading global digital consultancy. We imagine, create, engineer, and run digital transformation solutions that help our clients exceed customers’ expectations, outpace competition, and grow their business. With unparalleled strategy, creative, and technology capabilities, our colleagues bring big thinking and innovative ideas, along with a practical approach to help our clients – the world’s largest enterprises and biggest brands succeed.

WHAT WE BELIEVE

At Perficient, we promise to challenge, champion, and celebrate our people. You will experience a unique and collaborative culture that values every voice. Join our team, and you’ll become part of something truly special.

We believe in developing a workforce that is as diverse and inclusive as the clients we work with. We’re committed to actively listening, learning, and acting to further advance our organization, our communities, and our future leaders… and we’re not done yet.

Perficient, Inc. proudly provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, gender, sexual orientation, national origin, age, disability, genetic information, marital status, amnesty, or status as a protected veteran in accordance with applicable federal, state and local laws. Perficient, Inc. complies with applicable state and local laws governing non-discrimination in employment in every location in which the company has facilities. This policy applies to all terms and conditions of employment, including, but not limited to, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation, and training. Perficient, Inc. expressly prohibits any form of unlawful employee harassment based on race, color, religion, gender, sexual orientation, national origin, age, genetic information, disability, or covered veterans. Improper interference with the ability of Perficient, Inc. employees to perform their expected job duties is absolutely not tolerated.

Disability Accommodations:

Perficient is committed to providing a barrier-free employment process with reasonable accommodations for qualified individuals with disabilities and disabled veterans in our job application procedures. If you need assistance or accommodation due to a disability, please contact us.

Disclaimer: The above statements are not intended to be a complete statement of job content, rather to act as a guide to the essential functions performed by the employee assigned to this classification. Management retains the discretion to add or change the duties of the position at any time.