Job ID Number
R5291
Employment Type
Full timeWorksite Flexibility
RemoteJob Summary
As the Lead Confluent/Kafka Engineer, you will be responsible for architecting and designing scalable, fault-tolerant, and high-performance Kafka-based data streaming solutions.Job Description
We are looking for a Lead Confluent/Kafka Engineer for a contract-to-hire opportunity that is full-time and fully remote.
What You’ll Do
Architect and design scalable, fault-tolerant, and high-performance Kafka-based data streaming solutions
Lead technical design sessions and provide architectural guidance to junior engineers
Want more jobs like this?
Get jobs in Gunnison, CO delivered to your inbox every week.
Develop and maintain Confluent Platform components, including Kafka Connect, Kafka Streams, Flink, TableFlow and ksqlDB
Implement and manage monitoring and alerting systems for the Kafka cluster
Lead troubleshooting and resolution of complex issues within the data streaming platform
Perform root cause analysis and implement corrective actions to prevent future occurrences
Mentor and guide junior engineers
Collaborate with other engineering teams to integrate data streams into their applications
Develop and maintain comprehensive documentation for the data streaming platform
Provide technical leadership and guidance on best practices
Participate in code reviews and ensure adherence to coding standards and best practices
Proactively identify and address potential performance bottlenecks and scalability issues
Contribute to continuous improvement initiatives
Stay up to date on the latest Confluent Platform and Kafka technologies
What You’ll Need
Required:
Bachelor's degree in Computer Science, Engineering, or a related field. Master's degree preferred.
5+ years of experience with Confluent Platform and Kafka, including experience in designing and implementing large-scale data streaming solutions
Experience as a developer/operator of the Kafka technology (NOT interested in candidates who set up clusters for others to use)
Must have real-world experience setting up after Kafka real-time data streaming
Proficient in Java or other JVM languages (e.g., Scala, Kotlin)
Experience with Kafka Connect, Kafka Streams, and ksqlDB. Strong understanding of Kafka architecture and concepts (topics, partitions, consumers, producers)
Experience with message queuing systems
Familiarity with cloud-based environments (AWS, Azure, GCP)
Excellent problem-solving and debugging skills
Experience with CI/CD
Experience leading and mentoring engineering teams
Strong architectural skills
Experience with performance tuning and optimization
Experience with schema registries (e.g., Avro)
Ability to work independently and as part of a team
Excellent communication and collaboration skills
Preferred:
Confluent Certified Engineer
Experience with other streaming technologies (e.g., Spark Streaming, Flink)
Experience with containerization technologies (e.g., Docker, Kubernetes)
Experience with data visualization and analytics tools
Physical Demands
Ability to safely and successfully perform the essential job functions consistent with the ADA and other federal, state, and local standards
Sedentary work that involves sitting or remaining stationary most of the time with occasional need to move around the office to attend meetings, etc.
Ability to conduct repetitive tasks on a computer, utilizing a mouse, keyboard, and monitor
#LI-JM1
Reasonable Accommodation Statement
If you require a reasonable accommodation in completing this application, interviewing, completing any pre-employment testing, or otherwise participating in the employment selection process, please direct your inquiries to application.accommodations@cai.io or (888) 824 – 8111.
Equal Employment Opportunity Policy Statement
CAI is committed to equal employment opportunity. We do not discriminate based on race, color, religion, sex, sexual orientation, gender identity, national origin, age, marital status, genetic information, disability, or veteran status. All employment decisions are based on valid job requirements, including hiring, promotion, and compensation. Harassment and retaliation are prohibited.