Sr. Kafka Engineer

Remote,
Direct Hire
  • Location: Remote
  • Type: Direct Hire
  • Job #258

ROLE DESCRIPTION:

In the role of Sr. Kafka Engineer, you will be responsible for the technical aspects of ensuring that our hybrid cloud Kafka infrastructure is used in effective and sustainable ways by hundreds of developers. You will work closely with the Kafka Engineering Manager, software development leadership, technical operations leadership, architecture, PMO and vendors from around the globe to deliver these services.

 

ROLE RESPONSIBILITIES:

  • Work with the Kafka Engineering Manager to assess the needs of Software Engineering within the Kafka ecosystem
  • Establish, communicate, and advocate best practices and design patterns related to Kafka consumption
  • Build tools and libraries for use by software engineering teams to best leverage Kafka
  • Consult with Development teams on design patterns, architecture, and coding practices
  • Assess and size effort associated with work backlog and participate in grooming
  • Advise and inform a program of work to mature the streams processing service offering
  • Collaborate with other operations team to ensure highly available service and response respective to developer support
  • Interview and participate in building a team to establish a center of excellence and expertise in streams processing
  • Participate in regular planning cycles to align business priorities to programs of work within your organization
  • Inform recommendations, including resourcing, of strategic projects to mature and improve the service
  • Lead proofs of concepts, engineering, and implementation projects

 

TECHNICAL REQUIREMENTS:

  • Strong knowledge of Java and the Kafka API’s and libraries
  • Understanding of Kafka, Kafka Connect, Kafka Streams and KSQL
  • Strong understanding of Kafka broker, connect, and topic tuning and architectures
  • Strong understanding of Linux fundamentals as related to Kafka performance: Filesystem tuning and related kernel tuning and troubleshooting, Storage hardware and trade-offs, Network TCP stack tuning and troubleshooting
  • Background Software Engineering at enterprise scale
  • Expert developing software in 1 or more high level language
  • Competent operating Java Runtime Environment (JRE) in large scale environments -(runtime settings, JMX, troubleshooting, garbage collection, etc... )
  • Passionate about data driven operations; building and leveraging observability with tools such as Prometheus and Grafana
  • Knowledge and experience of containers and Kubernetes cluster
  • Hands on experience delivering complex software in an enterprise environment
  • Experience working in a remote team across multiple regions and time zones
  • Comfortable working with structured Change and Incident Management

 

 

Attach a resume file. Accepted file types are DOC, DOCX, PDF, HTML, and TXT.

We are uploading your application. It may take a few moments to read your resume. Please wait!

envelope