Confluent - Staff Software Engineer - Stream Processing & Analytics

IBMOn-siteFull-timeStaff, 8–12 yearsListed 1 hour ago

Apply now

About this role

At IBM Software, we transform client challenges into solutions. Building the world’s leading AI-powered, cloud-native products that shape the future of business and society. Our legacy of innovation creates endless opportunities for IBMers to learn, grow, and make an impact on a global scale. Working in Software means joining a team fueled by curiosity and collaboration. You’ll work with diverse technologies, partners, and industries to design, develop, and deliver solutions that power digital transformation. With a culture that values innovation, growth, and continuous learning, IBM Software places you at the heart of IBM’s product and technology landscape. Here, you’ll have the tools and opportunities to advance your career while creating software that changes the world.     About the Role:   The Flink Platform team is at the forefront of building a robust control plane for the Flink product, leveraging advanced database storage to ensure high reliability and efficiency. With a vision centered on innovation and excellence, this team is critical to advancing Confluent's Data in Motion initiative and is committed to supplying the industry with solutions that cater to evolving stream processing demands.   What You Will Do: Developing the control plane services that orchestrate Flink job lifecycles (submission, scaling, recovery). Building Kubernetes operators and orchestrators for serverless resource management. Designing APIs for job management, multi-tenancy, and isolation. Following a holistic development approach you will be responsible for the code quality, test coverage, documentation and maintainability of the components you and your team work on. Designing Components: You will not only implement aspects of Flink Control Plane but also draft designs, discuss them and curate and moderate a decision with involved stakeholders. Team: As part of the team you will help to follow and maintain processes, by being an active part of the team, leading meetings and taking initiatives where feasible and participating in on-call rotations. Mentoring: You will mentor other engineers with less experience in Control plane architecture to get started in the community and more junior developers to get into the area of serverless Apache Flink. What You Will Bring: 10+ years of relevant software development experience. Technical Expertise: Deep knowledge of distributed systems orchestration (e.g., Kubernetes, control loops). Experience building high-scale control planes, API servers, or cloud-native infrastructure. Knowledge of containerization, networking, and resource isolation. Problem Solving: Strong problem-solving skills, capable of translating complex requirements into effective solutions. Communication: Excellent communication skills, both written and verbal, with the ability to collaborate across teams. • Leading-Edge Technologies: Experience with designing, developing, and delivering software solutions using leading-edge technologies, with a focus on innovation and quality. • Advanced Agile Methodologies: Deep expertise in working in Agile environments, collaborating with stakeholders to understand requirements and deliver high-quality solutions that meet business needs and goals. United States Software Engineering Remote Professional Multiple Cities (0147) International Business Machines Corporation