Software Engineer - Data Infrastructure

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by Jobs via Dice, so some details may not match this job. The employer's own page has the real description.

Job Overview

The Software Engineer - Data Infrastructure is responsible for designing, building, and optimizing scalable data architecture solutions to enhance the data-driven decision-making capabilities of the organization. This role combines strong engineering skills with an analytical mindset to ensure the effective management of vast data sets. The successful candidate will collaborate with cross-functional teams to develop and maintain efficient data pipelines, facilitate data accessibility, and support analytics initiatives. You will play a critical role in enabling the organization to leverage data as a strategic asset.

Job Responsibilities

• Design and implement robust data models and architectures for data storage and processing.
• Develop and optimize data pipelines to facilitate seamless data integration and management.
• Collaborate with data scientists and analysts to understand data requirements, ensuring data availability and integrity.
• Monitor data flows and troubleshoot performance issues, implementing solutions to improve efficiency.
• Conduct regular assessments of data quality, implementing appropriate measures to enhance data governance.
• Document data processes, architecture specifications, and workflows to ensure knowledge transfer and standardization.
• Stay abreast of emerging technologies and industry trends to continually improve data infrastructure.

Qualifications

• Bachelor's degree in Computer Science, Data Science, or a related field.
• Minimum of 3 years of experience in software engineering with a focus on data infrastructure.
• Proficiency in programming languages such as Python, Java, or Scala.
• Extensive experience with SQL and NoSQL databases, such as PostgreSQL, MongoDB, or Apache Cassandra.
• Hands-on experience with big data technologies including Hadoop, Spark, or Kafka.
• Familiarity with cloud platforms like AWS, Azure, or Google Cloud for data storage and processing.
• Strong understanding of data warehousing solutions and ETL processes.

Technologies & Tools

The Software Engineer - Data Infrastructure will utilize a variety of technologies and tools to manage and process data. This includes programming languages such as Python and Java, database management systems such as PostgreSQL and MongoDB, and big data frameworks like Apache Hadoop and Apache Spark. Additionally, familiarity with cloud services from AWS or Azure will be essential for deploying and integrating data solutions within the cloud environment.

Ideal Candidates

Ideal candidates for the Software Engineer - Data Infrastructure position will possess a combination of strong analytical skills and technical acumen. They demonstrate a passion for data and a proactive approach to solving complex problems. Excellent communication skills are essential, as the role requires collaboration across various teams. Candidates should also exhibit a growth mindset, eagerly embracing new technologies and methodologies to drive continuous improvement within the data infrastructure domain.