Software Engineer - Data Infrastructure

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by Canonical, so some details may not match this job. The employer's own page has the real description.

Job Overview

As a Software Engineer specializing in Data Infrastructure at Canonical, you will be a key player in designing, building, and maintaining scalable data solutions that empower our products and services. You will work closely with stakeholders to understand their needs, implement efficient data pipelines, and ensure data integrity. Your expertise will contribute to the development of innovative data architecture that supports Canonical's mission of enabling open-source software across the globe.

Job Responsibilities

• Design and implement data pipelines, platforms, and architecture to support advanced analytics.
• Collaborate with cross-functional teams to gather requirements and propose data-centric solutions.
• Develop and maintain database systems, ensuring high performance and reliability.
• Conduct data quality assessments and implement necessary improvements.
• Optimize existing data infrastructure for scalability and performance enhancements.
• Stay updated with industry trends and technologies to apply best practices in data engineering.
• Provide technical guidance and mentorship to junior team members.

Qualifications

• Bachelor's degree in Computer Science, Engineering, or a related field.
• Proven experience in data engineering or related software development roles.
• Strong proficiency in programming languages such as Python, Java, or Go.
• Experience with data warehousing solutions and ETL (Extract, Transform, Load) processes.
• Familiarity with SQL and NoSQL databases such as PostgreSQL, MongoDB, or Cassandra.
• Knowledge of big data technologies such as Apache Hadoop, Spark, or Kafka is a plus.
• Ability to work in a fast-paced, agile environment while managing multiple projects.

Technologies & Tools

The position of Software Engineer - Data Infrastructure at Canonical involves working with a range of technologies and tools, including but not limited to cloud services (AWS, GCP), container orchestration (Kubernetes), databases (PostgreSQL, MongoDB), and data processing frameworks (Apache Spark, Apache Kafka). Familiarity with DevOps practices, CI/CD tools, and version control systems (Git) is also essential to successful performance in this role.

Ideal Candidates

The ideal candidate for the Software Engineer - Data Infrastructure position is someone who is not only technically proficient but also possesses strong analytical and problem-solving skills. They should be highly collaborative, able to communicate complex ideas clearly, and possess a strong aptitude for learning new technologies. A passion for open-source solutions and innovation in data management practices is crucial, as is the ability to adapt to changing requirements in a dynamic environment. Additionally, self-motivation and a proactive approach to challenges are key attributes that will contribute to their success at Canonical.