Software Engineer - Data Infrastructure

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by Canonical, so some details may not match this job. The employer's own page has the real description.

Job Overview

As a Software Engineer specializing in Data Infrastructure at Canonical, you will be responsible for designing, developing, and maintaining robust data systems that serve as the backbone for analytics and operational needs. Your expertise will be pivotal in building scalable architectures and ensuring data integrity and accessibility. The role entails collaborating with cross-functional teams to create data solutions that enhance our products' performance and drive business impact.

Job Responsibilities

• Design and implement scalable data pipelines and architectures to support data-driven applications.
• Develop and maintain data storage solutions ensuring high availability and performance.
• Collaborate closely with data scientists, analysts, and other engineers to gather requirements and deliver effective data solutions.
• Monitor and optimize existing data systems for resilience, throughput, and efficiency.
• Ensure data quality and integrity through effective validation and testing processes.
• Contribute to the documentation of data architecture, processes, and best practices.
• Stay updated with industry trends and emerging technologies to incorporate improvements into data infrastructure.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or a related field.
• 3+ years of experience in software engineering with a focus on data infrastructure.
• Proficient in programming languages such as Python, Java, or Scala.
• Experience with data warehousing solutions and data modeling.
• Familiarity with big data technologies such as Hadoop, Spark, or Kafka.
• Solid understanding of SQL and database management systems (e.g., PostgreSQL, MySQL).
• Experience with cloud platforms (AWS, GCP, Azure) and related data services.
• Strong problem-solving and analytical skills.

Technologies & Tools

The Data Infrastructure Engineer at Canonical will work with a diverse set of technologies and tools, including but not limited to Python for scripting, SQL for database queries, Apache Hadoop and Spark for big data processing, and cloud services such as Amazon Web Services (AWS) or Google Cloud Platform (GCP) for data storage and analytics solutions. Familiarity with containerization tools like Docker and orchestration platforms like Kubernetes may also be beneficial in this role.

Ideal Candidates

The ideal candidate for the Software Engineer - Data Infrastructure position at Canonical will possess a strong technical background combined with a passion for data and its potential to drive business decisions. They will be proactive, highly analytical, and capable of thinking critically about complex data challenges. A collaborative mindset is crucial, as this role involves working closely with various teams. Additionally, an eagerness to learn and adapt to new technologies and methodologies in the rapidly evolving field of data infrastructure is essential.