Software Engineer - Data Infrastructure - Kafka

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by Canonical, so some details may not match this job. The employer's own page has the real description.

Job Overview

The Software Engineer - Data Infrastructure - Kafka at Canonical will be responsible for the design, development, and implementation of robust data infrastructure solutions focused on Kafka technologies. This role requires a strong understanding of distributed systems, data streaming, and the complexities involved in processing large volumes of data efficiently. The ideal candidate will collaborate with cross-functional teams to enhance data pipelines and improve the overall performance of data systems, ensuring reliability and scalability in various applications.

Job Responsibilities

• Design and implement data streaming solutions utilizing Kafka to meet organizational data processing needs.
• Collaborate with engineering teams to integrate data applications and improve data quality and performance.
• Monitor and troubleshoot Kafka clusters and environments, ensuring high availability and reliability.
• Develop and maintain documentation for data pipelines and streaming solutions.
• Conduct performance tuning and optimization of Kafka configurations and related tools.
• Implement best practices for data governance and security in data infrastructure.
• Participate in code reviews, providing guidance to junior developers and fostering a culture of continuous improvement.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or a related field.
• Proven experience in software development with a strong focus on data infrastructure.
• Extensive knowledge of Apache Kafka and its ecosystem.
• Experience with programming languages such as Java, Scala, or Python.
• Solid understanding of distributed systems and cloud computing environments.
• Familiarity with data processing frameworks such as Apache Spark or Flink is a plus.
• Strong analytical and problem-solving skills with a capacity for managing complex technical issues.

Technologies & Tools

In this position, candidates will utilize a variety of technologies and tools including Apache Kafka for data streaming, cloud services like AWS or Azure for deployment, and programming languages such as Java, Scala, or Python for development. Familiarity with data processing tools like Apache Spark or Flink will also be beneficial, as well as experience with containerization technologies like Docker and orchestration tools such as Kubernetes.

Ideal Candidates

The ideal candidates for the Software Engineer - Data Infrastructure - Kafka role at Canonical will possess a strong technical flair combined with excellent communication skills. They should demonstrate an eagerness to learn and adapt in a fast-paced environment while showing a passion for working collaboratively with cross-disciplinary teams. A commitment to quality, attention to detail, and a proactive approach to problem-solving will distinguish the most suitable candidates for this position.