In the role of Sr. Kafka Engineer, you will be responsible for the technical aspects of ensuring that our hybrid cloud Kafka infrastructure is used in effective and sustainable ways by hundreds of developers. You will work closely with the Kafka Engineering Manager, software development leadership, technical operations leadership, architecture, PMO and vendors from around the globe to deliver these services.
ROLE RESPONSIBILITIES:
Work with the Kafka Engineering Manager to assess the needs of Software Engineering within the Kafka ecosystem
Establish, communicate, and advocate best practices and design patterns related to Kafka consumption
Build tools and libraries for use by software engineering teams to best leverage Kafka
Consult with Development teams on design patterns, architecture, and coding practices
Assess and size effort associated with work backlog and participate in grooming
Advise and inform a program of work to mature the streams processing service offering
Collaborate with other operations team to ensure highly available service and response respective to developer support
Interview and participate in building a team to establish a center of excellence and expertise in streams processing
Participate in regular planning cycles to align business priorities to programs of work within your organization
Inform recommendations, including resourcing, of strategic projects to mature and improve the service
Lead proofs of concepts, engineering, and implementation projects
TECHNICAL REQUIREMENTS:
Strong knowledge of Java and the Kafka API’s and libraries
Understanding of Kafka, Kafka Connect, Kafka Streams and KSQL
Strong understanding of Kafka broker, connect, and topic tuning and architectures
Strong understanding of Linux fundamentals as related to Kafka performance: Filesystem tuning and related kernel tuning and troubleshooting, Storage hardware and trade-offs, Network TCP stack tuning and troubleshooting
Background Software Engineering at enterprise scale
Expert developing software in 1 or more high level language
Competent operating Java Runtime Environment (JRE) in large scale environments -(runtime settings, JMX, troubleshooting, garbage collection, etc... )
Passionate about data driven operations; building and leveraging observability with tools such as Prometheus and Grafana
Knowledge and experience of containers and Kubernetes cluster
Hands on experience delivering complex software in an enterprise environment
Experience working in a remote team across multiple regions and time zones
Comfortable working with structured Change and Incident Management
