Software Engineer - Data Infrastructure

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by Jobs via Dice, so some details may not match this job. The employer's own page has the real description.

Job Overview

The Software Engineer - Data Infrastructure at Jobs via Dice will play a critical role in designing, building, and maintaining a robust and scalable data infrastructure that supports the organization's data-driven initiatives. This individual will work collaboratively with cross-functional teams to establish data pipelines, ensure data quality, and optimize the performance of data storage solutions. The position demands a deep understanding of data architecture and engineering practices, enabling the company to harness the full potential of its data assets.

Job Responsibilities

• Design and implement scalable data architectures to support analytics and reporting.
• Develop and maintain data pipelines to ensure timely and accurate data flow.
• Collaborate with data scientists and analysts to define data requirements and optimize data models.
• Monitor and optimize data infrastructure for performance, reliability, and scalability.
• Conduct data quality assessments and implement data governance best practices.
• Utilize modern ETL tools and technologies for efficient data processing.
• Provide support for data-related queries and troubleshoot data issues as they arise.

Qualifications

• Bachelor's degree in Computer Science, Information Technology, or a related field.
• 3+ years of experience in data engineering, software development, or a related discipline.
• Proficient in programming languages such as Python, Java, or Scala.
• Experience with big data technologies such as Hadoop, Apache Spark, or Kafka.
• Strong understanding of database systems (SQL and NoSQL).
• Familiarity with cloud technologies (AWS, Azure, or Google Cloud Platform).
• Excellent problem-solving skills and attention to detail.

Technologies & Tools

The Software Engineer - Data Infrastructure position utilizes a range of technologies and tools including but not limited to Apache Hadoop, Apache Spark, Kafka, cloud platforms such as AWS or Azure, SQL and NoSQL databases, ETL tools, and data pipeline orchestration frameworks. Familiarity with containerization technologies such as Docker and orchestration tools like Kubernetes is a plus.

Ideal Candidates

The ideal candidate for the Software Engineer - Data Infrastructure role is a driven and analytical individual who possesses both technical proficiency and a proactive attitude towards problem-solving. A strong collaborator, they excel in team environments and contribute effectively to cross-disciplinary projects. They should have a passion for working with data, an eagerness to learn new technologies, and a commitment to delivering high-quality solutions that meet business needs.