Software Engineer - Data Infrastructure

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by Canonical, so some details may not match this job. The employer's own page has the real description.

Overview

The Software Engineer - Data Infrastructure at Canonical will play a crucial role in the design, construction, and optimization of data systems to support the organization's broad range of applications and services. The successful candidate will collaborate with cross-functional teams to enhance and maintain scalable data solutions, ensuring data integrity, performance, and security. This position involves leveraging data to contribute to automation and operational efficiencies, enabling the organization to make informed decisions rapidly and accurately.

Job Responsibilities

• Design and implement robust data architectures and pipelines to facilitate data ingestion, processing, and storage.
• Collaborate with product and engineering teams to develop data solutions that address both functional and technical requirements.
• Monitor and optimize data workflows for performance, reliability, and scalability.
• Ensure data quality and accuracy through validation processes and data governance frameworks.
• Develop and maintain comprehensive documentation for data processes and systems.
• Engage in troubleshooting and debugging of data-related issues, delivering timely resolution.
• Stay current with industry trends and best practices in data engineering and analytics.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or a related field.
• 3+ years of experience in data engineering, software development, or a related role.
• Proficiency in programming languages such as Python, Java, or Scala.
• Strong experience with SQL and NoSQL databases such as PostgreSQL, MongoDB, or Cassandra.
• Familiarity with data processing frameworks like Apache Spark or Apache Kafka.
• Solid understanding of cloud technologies, including AWS, Azure, or Google Cloud Platform.
• Excellent problem-solving skills and ability to work in a collaborative environment.

Technologies & Tools

This position will utilize various technologies and tools including, but not limited to, PostgreSQL for relational database management, Apache Kafka for real-time data streaming, and cloud-based services like AWS for scalable data solutions. Knowledge of modern data frameworks such as Apache Spark for big data processing and Terraform for infrastructure as code will be advantageous.

Ideal Candidates

Ideal candidates for the Software Engineer - Data Infrastructure position demonstrate strong analytical and critical thinking skills. They excel in a team environment and have effective communication abilities to articulate complex data solutions. A proactive approach to problem-solving, combined with a robust curiosity and eagerness to learn new technologies, will contribute to the success of the individual and the organization as a whole. Passion for data and its application in driving business decisions will be key traits of a successful candidate.