Software Engineer - Data Infrastructure

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by Canonical, so some details may not match this job. The employer's own page has the real description.

Job Overview

As a Software Engineer - Data Infrastructure at Canonical, you will play a pivotal role in designing, implementing, and maintaining robust data infrastructure systems. You will collaborate closely with cross-functional teams to develop innovative solutions that enhance our data management and processing capabilities. Your core focus will be on building scalable architectures that streamline data flow and ensure seamless integration across various platforms and applications. This position requires a deep understanding of data systems, as well as the ability to troubleshoot and optimize data performance to meet our growing needs.

Job Responsibilities

• Design, develop, and deploy scalable data infrastructure systems to support data-driven applications.
• Collaborate with data scientists and analysts to understand data needs and optimize data workflows.
• Implement data storage solutions, including databases and data lakes, ensuring data integrity and accessibility.
• Monitor and troubleshoot data pipeline performance, making necessary adjustments for optimization.
• Write clean, maintainable code while adhering to best practices and standards.
• Document architecture, processes, and technologies used for data infrastructure.
• Participate in code reviews and contribute to team knowledge sharing.

Qualifications

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
• Proven experience in software development and data engineering, with expertise in data infrastructure.
• Strong programming skills in languages such as Python, Java, or Go.
• Experience with databases (SQL and NoSQL), ETL processes, and data pipeline orchestration tools.
• Familiarity with cloud platforms (AWS, Azure, Google Cloud) and containerization technologies (Docker, Kubernetes).
• Solid understanding of data modeling, design patterns, and data architecture.

Technologies & Tools

In this role, you will work with a variety of technologies and tools to facilitate a high-performance data infrastructure. Key technologies include cloud services such as AWS and Google Cloud Platform, data pipeline frameworks like Apache Airflow, and database management systems including PostgreSQL and MongoDB. Familiarity with container orchestration tools like Kubernetes and ETL tools will also be essential for efficiently managing the data workflows.

Ideal Candidates

The ideal candidate for the Software Engineer - Data Infrastructure position at Canonical possesses a strong analytical mindset and a passion for problem-solving. They are proactive in their approach, detail-oriented, and able to work collaboratively within a team. An excellent communicator, they can articulate complex ideas clearly to both technical and non-technical stakeholders. The candidate should also demonstrate a strong enthusiasm for learning new technologies and adapting to evolving industry trends, thereby contributing to Canonical’s commitment to innovation and excellence.