Software Engineer - Data Infrastructure

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by Canonical, so some details may not match this job. The employer's own page has the real description.

Job Overview

The Software Engineer - Data Infrastructure at Canonical will play a crucial role in building and maintaining scalable data infrastructures that empower our product development teams. This position requires a keen understanding of data architecture, data processing frameworks, and cloud technologies. The successful candidate will work collaboratively with cross-functional teams to optimize data flow, ensuring high availability and reliability while implementing best practices for data governance and security.

Job Responsibilities

• Design, develop, and implement robust data pipelines to extract, transform, and load data from various sources.
• Collaborate with data scientists and analysts to understand data requirements and ensure timely data access.
• Optimize system performance, reliability, and scalability of data infrastructure.
• Conduct code reviews and participate in pair programming to foster a culture of excellence.
• Ensure compliance with data privacy regulations and data governance standards.
• Monitor and troubleshoot data-related issues across the infrastructure.
• Stay updated on industry trends and advancements in data technologies.

Qualifications

• Bachelor’s degree in Computer Science, Information Technology, or a related field.
• 3+ years of professional experience in software engineering, focusing on data infrastructure.
• Strong proficiency in programming languages such as Python, Java, or Scala.
• Experience with cloud platforms (AWS, Google Cloud, Azure) and big data technologies (Hadoop, Spark).
• Familiarity with database management systems (SQL and NoSQL) and data warehousing solutions.
• Understanding of data modeling, ETL processes, and data analysis techniques.
• Excellent problem-solving skills and attention to detail.

Technologies & Tools

The Software Engineer - Data Infrastructure will utilize a wide array of technologies and tools to support their responsibilities. Key technologies include cloud services such as AWS and Azure, big data frameworks like Hadoop and Apache Spark, relational and NoSQL databases such as PostgreSQL and MongoDB, as well as data orchestration tools such as Apache Airflow. Familiarity with version control systems like Git and CI/CD pipelines will also be advantageous for managing code and deployment processes.

Ideal Candidates

The ideal candidate for the Software Engineer - Data Infrastructure role at Canonical is both innovative and pragmatic, demonstrating a strong capability for analytical thinking and problem solving. They possess excellent communication skills, which enable effective collaboration across diverse teams. A proactive attitude towards learning and adaptation to new technologies is essential. Candidates should also exhibit a commitment to best practices in coding and data management, ensuring that the infrastructure is not only functional but also efficient and secure.