Software Engineer - Data Infrastructure - Kafka

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by Canonical, so some details may not match this job. The employer's own page has the real description.

Overview

Canonical is seeking a skilled Software Engineer specialized in Data Infrastructure, particularly with experience in Apache Kafka. In this role, you will be instrumental in designing, implementing, and maintaining robust data pipelines and streaming platforms that are integral to our data-driven applications. Your contributions will enhance the efficiency of our data management processes, enabling real-time analytics and ensuring data integrity across various services.

Job Responsibilities

• Design, develop, and maintain data streaming applications using Apache Kafka.
• Collaborate with cross-functional teams to gather and analyze data requirements.
• Implement data models and data flow architecture to optimize performance.
• Monitor and troubleshoot data pipelines to ensure reliability and efficiency.
• Develop best practices for data management and processing.
• Stay updated with industry trends and emerging technologies related to data infrastructure.

Qualifications

• Bachelor's degree in Computer Science, Engineering, or related field.
• Proven experience in software development with a focus on data infrastructure.
• Strong proficiency in Apache Kafka, including the knowledge of its architecture and ecosystem.
• Experience with programming languages such as Java, Scala, or Python.
• Familiarity with cloud platforms and data warehousing solutions.
• Understanding of data modeling, ETL processes, and data governance.

Technologies & Tools

The Software Engineer - Data Infrastructure role at Canonical extensively utilizes Apache Kafka for stream processing, along with other complementary tools and technologies such as Apache Flink, Apache Spark, and cloud services like AWS or Google Cloud Platform. Familiarity with containerization technologies like Docker and orchestration tools such as Kubernetes is advantageous, as these are often integrated into our data infrastructure.

Ideal Candidates

The ideal candidates for this position possess a strong analytical mindset, excellent problem-solving abilities, and the capacity to work collaboratively in a fast-paced environment. A passion for data-driven decision-making and a commitment to building scalable solutions are essential. Additionally, adaptability and a proactive approach to learning and adopting new technologies will set candidates apart as valuable members of the Canonical team.