Software Engineer - Data Infrastructure - Kafka

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by Canonical, so some details may not match this job. The employer's own page has the real description.

Job Overview

The Software Engineer - Data Infrastructure - Kafka at Canonical will be responsible for designing, developing, and maintaining scalable data infrastructure solutions that leverage Kafka technology. This role involves working closely with cross-functional teams to ensure efficient data flow and processing capabilities while optimizing systems for performance and reliability. You will play a vital role in streamlining data operations and improving data-driven decision-making across the organization.

Job Responsibilities

• Design, implement, and maintain robust data pipelines using Kafka and related technologies.
• Collaborate with data scientists and analysts to understand data requirements and support analytical needs.
• Optimize existing data infrastructure for performance, reliability, and scalability.
• Troubleshoot and resolve data processing issues in a timely manner.
• Develop best practices for data governance and security compliance.
• Document system configurations, data models, and processes for clarity and future reference.
• Engage in performance tuning and monitoring of data infrastructure components.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or a related field.
• Proven experience in software engineering with a focus on data infrastructure.
• Strong proficiency in Kafka and experience with data streaming technologies.
• Familiarity with programming languages such as Python, Java, or Scala.
• Experience with data modeling and database design (SQL and NoSQL databases).
• Knowledge of cloud platforms like AWS, Google Cloud, or Azure.
• Excellent problem-solving skills and a proactive approach to challenges.

Technologies & Tools

This position will primarily utilize technologies and tools such as Apache Kafka for data streaming, Apache Flink for data processing, SQL and NoSQL databases for storage, and cloud-based services from providers like AWS and Azure for deployment and scalability.

Ideal Candidates

The ideal candidates for the Software Engineer - Data Infrastructure - Kafka role will possess a strong analytical mindset, excellent communication skills, and the ability to work collaboratively within a team. They should demonstrate a passion for data engineering, possess a keen interest in emerging technologies, and have a results-oriented approach that aligns with Canonical’s mission of delivering cutting-edge data solutions. A proactive attitude towards continuous improvement and a willingness to learn new skills will be highly valued.