Senior Software Engineer- Machine Learning and AI Integration

Company: Confluent
Location: Hartford
Posted on: April 15, 2024

Job Description:

Confluent is pioneering a fundamentally new category of data infrastructure focused on data in motion. Have you ever found a new favorite series on Netflix, picked up groceries curbside at Walmart, or paid for something using Square? That's the power of data in motion in action-giving organizations instant access to the massive amounts of data that is constantly flowing throughout their business. At Confluent, we're building the foundational platform for this new paradigm of data infrastructure. Our cloud-native offering is designed to be the intelligent connective tissue enabling real-time data, from multiple sources, to constantly stream across the organization. With Confluent, organizations can create a central nervous system to innovate and win in a digital-first world.

We're looking for self-motivated team members who crave a challenge and feel energized to roll up their sleeves and help realize Confluent's enormous potential. Chart your own path and take healthy risks as we solve big problems together. We value having diverse teams and want you to grow as we grow-whether you're just starting out in your career or managing a large team, you'll be amazed at the magnitude of your impact.

About the Role:

Confluent is seeking an innovative and visionary Senior / Staff Software Engineer to help lead the design and development of a cutting-edge Machine Learning (ML) and Artificial Intelligence (AI) foundation seamlessly integrated with Confluent Cloud data processing infrastructure, including Flink SQL and Table API. In this role, you will be instrumental in shaping the architecture and strategy for building transparent ML and AI capabilities that empower our customers to unlock the full potential of their data. You will be responsible for both building the infrastructure as well as designing and implementing different categories of ML and AI algorithms, including classification, inference, clustering, regression, feature engineering, recommendation, GenAI, and others.

The infrastructure you build will support both externally trained models and the ability to train models natively within Confluent Cloud, including incremental training as data streams in real-time.

What You Will Do:

Technical Leadership: Act as a technical leader, driving the architecture, design, and implementation of ML and AI functionality for Confluent Cloud. Translate complex requirements into pragmatic and scalable technical solutions

Solution Design: Define and deliver customer-focused ML and AI solutions that seamlessly integrate with Confluent Cloud data processing, enabling the extraction of valuable insights from streaming data. Collaborate closely with cross-functional teams to ensure holistic integration

Transparent Integration: Architect ML and AI capabilities that can be seamlessly integrated with Flink SQL, Table API, and other components of Confluent Cloud. Ensure that ML and AI functionality is accessible and usable by non-experts

Diverse Functionality: Design and implement feature classification, inference, clustering, regression, feature engineering, recommendation systems, and the GenAI platform, addressing a wide range of customer needs

Model Training: Create infrastructure that supports both externally trained models and native model training within Confluent Cloud. Enable incremental model training as data is streamed, ensuring the models remain up-to-date

Influence Strategy: Provide technical expertise and insights to shape the ML and AI strategy for Confluent Cloud. Drive innovation by identifying opportunities to enhance customer value and platform capabilities

Mentorship: Assist in the development and growth of technical talent within the organization. Mentor junior engineers, fostering their technical skills and leadership potential

Collaboration: Foster collaboration across Confluent, sharing your deep ML and AI knowledge to enhance productivity and effectiveness across teams.

Quality Assurance: Ensure the quality of the architecture and design of ML and AI capabilities, adhering to best practices, scalability, and performance

Problem Solving: Decompose complex ML and AI challenges into actionable and effective solutions, considering real-time data streaming requirements.

Industry Engagement: Represent Confluent Engineering in external ML and AI communities, conferences, and industry events, building a strong network and contributing to Confluent's industry presence

What You Will Bring:

4+ years of software development

Technical Expertise: Extensive experience in software engineering, including hands-on experience in designing and developing complex distributed systems, with a strong background in building and integrating ML and AI functionality. Familiarity with ML frameworks, tools, and libraries

Architecture Design: Proven ability to design and implement ML and AI solutions that seamlessly integrate with data processing systems like Flink SQL and Table API

Model Training: Hands-on experience in model training, both externally and natively within cloud platforms. Ability to handle incremental training and real-time updates

Feature Engineering: Proficiency in feature engineering, classification, inference, clustering, regression, and recommendation systems Leadership: Track record of technical leadership, mentoring engineers, and driving impactful technical decisions

Problem Solving: Strong problem-solving skills, capable of translating complex requirements into effective solutions

Communication: Excellent communication skills, both written and verbal, with the ability to collaborate across teams

Industry Engagement: Active involvement in ML and AI communities, conferences, and a strong network within the industry

Come As You Are

At Confluent, equality is a core tenet of our culture. We are committed to building an inclusive global team that represents a variety of backgrounds, perspectives, beliefs, and experiences. The more diverse we are, the richer our community and the broader our impact. Employment decisions are made on the basis of job-related criteria without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, veteran status, or any other classification protected by applicable law.

At Confluent, we are committed to providing competitive pay and benefits that are in line with industry standards. We analyze and carefully consider several factors when determining compensation, including work history, education, professional experience, and location. This position has an annual estimated salary of 155,900 - 183,240 USD, an annual bonus, and a competitive equity package. The actual pay may vary depending on your skills, qualifications, experience, and work location. In addition, Confluent offers a wide range of employee benefits. To learn more about our benefits click HERE (https://confluentbenefits.com/) .

Click HERE to review our Candidate Privacy Notice which describes how and when Confluent, Inc., and its group companies, collects, uses, and shares certain personal information of California job applicants and prospective employees.

#LI-Remote

Keywords: Confluent, Leominster , Senior Software Engineer- Machine Learning and AI Integration, IT / Software / Systems , Hartford, Massachusetts