Software Engineer - Data Infrastructure

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by Canonical, so some details may not match this job. The employer's own page has the real description.

Overview

The Software Engineer - Data Infrastructure at Canonical will play a pivotal role in the development and maintenance of robust data infrastructure solutions. This position involves designing, implementing, and optimizing systems that handle large volumes of data efficiently. The successful candidate will work collaboratively within an agile team, contributing to data processing architectures that facilitate high-performance data management and analytics, thereby supporting Canonical's commitment to innovation and excellence in the tech industry.

Job Responsibilities

• Design and develop scalable data pipelines to manage and process vast amounts of data.
• Optimize existing data infrastructure for performance, reliability, and cost-effectiveness.
• Collaborate with cross-functional teams to gather requirements and deliver data-driven solutions.
• Implement data governance practices to ensure data quality and integrity.
• Write clean, maintainable code and document technical processes and systems.
• Monitor and troubleshoot production data environments to proactively address issues.
• Stay updated with the latest trends in data technology to continuously enhance the data infrastructure.

Qualifications

• Bachelor’s degree in Computer Science, Software Engineering, or a related field.
• Demonstrated experience in data engineering or similar roles, typically 3+ years.
• Proficiency in programming languages such as Python, Java, or Scala.
• Strong understanding of data modeling, ETL processes, and data warehousing concepts.
• Experience with cloud platforms (e.g., AWS, Google Cloud, Azure) for data storage and processing.
• Familiarity with big data technologies such as Hadoop, Spark, or Kafka.
• Excellent problem-solving skills and a proactive attitude towards tackling challenges.

Technologies & Tools

The Software Engineer - Data Infrastructure will utilize a variety of technologies and tools, including but not limited to cloud-based platforms like AWS and Google Cloud for data management, as well as programming languages such as Python and Java for developing data solutions. Familiarity with big data processing frameworks, including Apache Spark and Hadoop, as well as database management systems like PostgreSQL and MongoDB, will be essential for success in this role.

Ideal Candidates

The ideal candidates for this position will possess a strong analytical mindset combined with technical expertise in data infrastructure. They should demonstrate a keen interest in emerging technologies and a passion for building efficient data systems that drive organizational success. Additionally, candidates should have excellent communication skills to convey complex technical information to non-technical stakeholders and a collaborative spirit to work effectively within diverse teams. A commitment to quality and an innovative approach to problem-solving will further distinguish successful applicants.