Software Engineer - Data Infrastructure

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by Canonical, so some details may not match this job. The employer's own page has the real description.

Job Overview

As a Software Engineer specializing in Data Infrastructure at Canonical, you will play a critical role in designing and implementing robust data solutions that ensure the scalability and reliability of our data pipelines. You will work collaboratively with cross-functional teams to develop innovative data infrastructure and employ best practices in data processing and management. Your efforts will contribute to enhancing data availability and performance, ultimately supporting the operational requirements of Canonical’s products and services.

Job Responsibilities

• Design, develop, and maintain scalable data infrastructures to facilitate data collection, storage, and processing.
• Collaborate with product and engineering teams to define and deliver data requirements.
• Implement data governance practices and ensure compliance with data policies.
• Optimize data pipelines for maximum efficiency and performance.
• Monitor and troubleshoot data issues, ensuring data integrity and reliability.
• Evaluate and integrate new data technologies that enhance existing infrastructure.
• Document data processes, architectures, and implemented solutions clearly and concisely.

Qualifications

• Bachelor's degree in Computer Science, Engineering, or a related field.
• Proven experience in software engineering, specifically in data infrastructure development.
• Strong proficiency in programming languages such as Python, Java, or Scala.
• Experience with database management systems like PostgreSQL, MySQL, or NoSQL databases.
• Familiarity with cloud platforms, such as AWS, Google Cloud, or Azure.
• Understanding of data architectures, data warehousing, and ETL processes.
• Excellent problem-solving abilities and debugging skills.

Technologies & Tools

This position requires familiarity with several technologies and tools essential for data infrastructure development. Key technologies include Apache Kafka for stream processing, Hadoop for distributed storage and processing, and data orchestration tools like Airflow. Knowledge of containerization technologies such as Docker and Kubernetes is also beneficial, along with experience in using version control systems like Git.

Ideal Candidates

The ideal candidate for the Software Engineer - Data Infrastructure position is one who combines technical expertise with a strong analytical mindset. They should demonstrate a proactive approach to problem-solving and possess effective communication skills for collaborating with diverse teams. A passion for data-driven decision-making and an eagerness to stay updated with emerging data technologies will further distinguish them in this role.