Software Development Engineer – Data Engineering

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by Veridix AI, part of Emmes Group, so some details may not match this job. The employer's own page has the real description.

Overview

Veridix AI, part of Emmes Group, is seeking a highly skilled Software Development Engineer specializing in Data Engineering to join our innovative team. The successful candidate will be responsible for developing data pipelines and architectures, ensuring data integrity and accessibility, and collaborating with cross-functional teams to create strategic data solutions. This role will require leveraging your technical expertise to design, build, and deploy efficient data processing systems, facilitating data-driven decision-making while maintaining a focus on performance and scalability.

Job Responsibilities

• Design, implement, and maintain data pipelines to support various analytical and operational processes.
• Collaborate with data scientists, analysts, and business leaders to understand data requirements and develop data solutions.
• Monitor and optimize data storage and processing for performance, scalability, and cost-efficiency.
• Ensure data integrity and security by implementing robust ETL processes and validation techniques.
• Participate in code reviews and enforce best practices in software development.
• Stay up-to-date with emerging technologies and industry trends to continuously improve the organization's data capabilities.

Qualifications

• Bachelor's degree in Computer Science, Software Engineering, Data Science, or a related field.
• Minimum of 3 years' experience in data engineering or software development with a focus on data-related projects.
• Proven experience with ETL tools and data warehousing solutions.
• Strong programming skills in languages such as Python, Java, or Scala.
• Familiarity with database technologies, including SQL and NoSQL databases.
• Experience working with cloud platforms, such as AWS, Azure, or Google Cloud.
• Understanding of data modeling and data architecture principles.
• Excellent problem-solving and analytical skills, combined with strong attention to detail.
• Effective communication skills and ability to work collaboratively in a team environment.

Technologies & Tools

The Software Development Engineer in Data Engineering will utilize a variety of tools and technologies including, but not limited to, Apache Kafka, Apache Spark, Hadoop, SQL & NoSQL databases, cloud services (AWS, Azure, Google Cloud), and ETL tools like Apache Airflow or Talend. Proficiency in these technologies will enable the engineer to design and implement efficient data pipelines that support the organization’s data-driven objectives.

Ideal Candidates

The ideal candidate for this position will possess a combination of technical expertise in data engineering and strong collaborative skills. They will be proactive in identifying data needs, innovative in their approach to problem-solving, and motivated to create scalable data solutions that enhance business performance. An exceptional candidate will demonstrate adaptability to fast-changing environments and will thrive in a team-centric atmosphere, contributing positively to project and organizational goals.