Software Engineer - Data Infrastructure

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by Jobs via Dice, so some details may not match this job. The employer's own page has the real description.

Job Overview

The Software Engineer - Data Infrastructure position at Jobs via Dice is a pivotal role designed to enhance our data management systems and streamline data processes. The candidate will be responsible for designing, developing, and maintaining robust data pipelines and infrastructure that support analytical tools and dashboards. The successful individual will collaborate with cross-functional teams to ensure the reliability and scalability of data processes, contributing to data-driven decision-making across the organization.

Job Responsibilities

• Design and implement scalable data pipelines for data ingestion and transformation.
• Collaborate with data scientists and analysts to understand data needs and optimize data delivery.
• Monitor data infrastructure performance and troubleshoot any issues that arise.
• Develop and maintain standards for data quality and documentation.
• Engage in code reviews and provide guidance on best practices for data engineering.
• Implement data security protocols to safeguard sensitive information.
• Participate in the evaluation and integration of new technologies in the data landscape.

Qualifications

• Bachelor’s degree in Computer Science, Software Engineering, or a related field.
• 3+ years of experience in software engineering with a focus on data infrastructure.
• Proficiency in programming languages such as Python, Java, or Scala.
• Experience with data warehousing solutions and ETL processes.
• Strong knowledge of SQL and NoSQL databases like MySQL, PostgreSQL, MongoDB, or Cassandra.
• Familiarity with data pipeline tools such as Apache Kafka, Apache Spark, or similar technologies.
• Excellent problem-solving skills and a collaborative mindset.

Technologies & Tools

The Software Engineer - Data Infrastructure will utilize a diverse set of technologies and tools to perform their duties effectively. These include data pipeline frameworks such as Apache Kafka and Apache Spark for real-time data processing, relational databases like MySQL and PostgreSQL for structured data, and NoSQL databases such as MongoDB for unstructured data storage. Additionally, experience with cloud platforms, including AWS or Google Cloud, is crucial for deploying scalable data solutions.

Ideal Candidates

The ideal candidate for the Software Engineer - Data Infrastructure position will demonstrate a strong analytical mindset and a passion for leveraging data to drive solutions. They will possess excellent communication skills, allowing them to work effectively with technical and non-technical stakeholders. A proactive approach to learning and adapting to new technologies is essential, as is the ability to work collaboratively in a team-oriented environment. Empathy and a dedication to data accuracy and integrity are also key qualities that will contribute to their success in this role.