Software Engineer - Data Infrastructure

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by Canonical, so some details may not match this job. The employer's own page has the real description.

Overview

As a Software Engineer specializing in Data Infrastructure at Canonical, you will play a vital role in developing and maintaining robust, scalable data systems that support our cloud and container platforms. You will be responsible for architecting and implementing data solutions that facilitate high-performance analytics and data processing workflows. The ideal candidate will collaborate closely with cross-functional teams, ensuring that our data infrastructure aligns with business objectives and enhances our overall technological capability.

Job Responsibilities

• Design, implement, and maintain data pipelines and workflows that are efficient and scalable.
• Collaborate with software engineering teams to integrate data solutions into existing applications.
• Monitor system performance and troubleshoot issues to ensure data integrity and availability.
• Work with data scientists and analysts to define data requirements and optimize data storage solutions.
• Implement data governance and security protocols to protect sensitive information.
• Document data processes, architectures, and models for future reference and team onboarding.
• Stay current with industry trends and emerging technologies relevant to data infrastructure.

Qualifications

• Bachelor’s degree in Computer Science, Software Engineering, or a related field.
• Proven experience as a software engineer, with a focus on data infrastructure.
• Strong programming skills in languages such as Python, Java, or Go.
• Experience with data architecture design and management, particularly in big data technologies.
• Familiarity with cloud services such as AWS, Azure, or Google Cloud Platform.
• Solid understanding of relational and non-relational database systems.
• Excellent analytical and problem-solving abilities.

Technologies & Tools

The role will involve working with a variety of technologies and tools, including but not limited to Apache Kafka, Apache Spark, Hadoop, SQL and NoSQL databases, and cloud computing platforms. Experience with containerization tools such as Docker and orchestration systems like Kubernetes is also advantageous. Familiarity with data governance tools and frameworks will be beneficial in ensuring compliance and data management best practices.

Ideal Candidates

The ideal candidate is proactive, detail-oriented, and possesses a strong passion for data engineering and infrastructure. A good fit for this position is someone who communicates effectively within teams and enjoys collaborating across disciplines. Candidates who exhibit a strong commitment to continuous learning and improvement, as well as those who can demonstrate innovative problem-solving skills, will excel in this role. Moreover, an adaptable mindset and a willingness to embrace new challenges in a fast-paced environment are crucial for success at Canonical.