Software Engineer - Data Infrastructure

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by Canonical, so some details may not match this job. The employer's own page has the real description.

Job Overview

The Software Engineer - Data Infrastructure at Canonical is responsible for designing, developing, and maintaining robust data solutions that enable seamless data flow and accessibility across various platforms. The individual will work closely with cross-functional teams to support data-driven decision-making processes and optimize data storage solutions. This role is vital in enhancing the scalability and reliability of our data infrastructure, ensuring high performance and security standards are met throughout all stages of the data lifecycle.

Job Responsibilities

• Design and implement scalable data infrastructure solutions that meet organizational needs.
• Develop data pipelines and ETL processes to facilitate data integration from diverse sources.
• Collaborate with data scientists and analysts to optimize data access and processing workflows.
• Monitor and troubleshoot performance issues within data storage and retrieval systems.
• Ensure data security and compliance with applicable regulations within all data handling processes.
• Participate in code reviews and contribute to a culture of quality, maintainability, and continuous improvement.
• Document system architectures, procedures, and data definitions for internal reference.

Qualifications

• Bachelor’s degree in Computer Science, Information Technology, or a related field.
• Proven experience in software development, specifically in data infrastructure projects.
• Strong proficiency in programming languages such as Python, Java, or Go.
• Experience with cloud platforms (e.g., AWS, Google Cloud, Azure) and their data services.
• Familiarity with data storage solutions like SQL/NoSQL databases, data lakes, and data warehouses.
• Knowledge of data processing frameworks such as Apache Spark, Kafka, or Hadoop.
• Excellent problem-solving skills and attention to detail.

Technologies & Tools

In this position, candidates will work with a variety of technologies and tools, including but not limited to programming languages such as Python and Java, data processing frameworks like Apache Spark and Hadoop, cloud platforms including AWS and Google Cloud, as well as database systems such as PostgreSQL, MongoDB, and Elasticsearch. Familiarity with DevOps tools and practices, along with data visualization software, is also beneficial for this role.

Ideal Candidates

Ideal candidates for the Software Engineer - Data Infrastructure role are innovative thinkers who thrive in a collaborative environment. They possess strong analytical skills and are adept at problem-solving, with a keen ability to translate complex datasets into actionable insights. Excellent communication skills, both verbal and written, are necessary to effectively interact with various stakeholders. Candidates should also demonstrate a commitment to continuous learning and show enthusiasm for adapting to new technologies and processes that enhance data infrastructure.