Software Engineer (Data Engineer) - Remote | WFH

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by Get It Recruit - Information Technology, so some details may not match this job. The employer's own page has the real description.

Job Overview

The Software Engineer (Data Engineer) position at Get It Recruit - Information Technology involves designing, developing, and maintaining data architectures and data models to ensure optimal data flow within various applications. The ideal candidate will work collaboratively with cross-functional teams to gather requirements, implement complex data pipelines, and promote data quality with a strong focus on performance optimization. This role requires a blend of analytical and programming skills, as well as a deep understanding of data management technologies to drive business intelligence and data analytics initiatives.

Job Responsibilities

• Design and implement scalable data pipelines to accommodate large datasets and high throughput.
• Collaborate with data scientists and analysts to define data requirements for analytical solutions.
• Develop and maintain data models that support various analytical and reporting solutions.
• Monitor and optimize data performance, ensuring high availability and reliability of data systems.
• Conduct data profiling and cleansing to enhance data accuracy and consistency.
• Implement data governance best practices to ensure compliance and maintain data integrity.

Qualifications

• Bachelor's degree in Computer Science, Information Technology, or a related field.
• Proven experience as a Data Engineer or Software Engineer with a focus on data architecture.
• Strong proficiency in programming languages such as Python, Java, or Scala.
• Experience with database technologies, including SQL, NoSQL, and data warehousing solutions.
• Familiarity with big data technologies, such as Hadoop, Spark, or Kafka.
• Understanding of cloud platforms (AWS, Google Cloud Platform, or Azure) and ETL processes.
• Excellent problem-solving skills and a detail-oriented mindset.

Technologies & Tools

The Software Engineer (Data Engineer) will work extensively with various technologies and tools including but not limited to data pipeline frameworks (such as Apache Airflow), ETL tools (like Apache Nifi), big data processing frameworks (Apache Spark, Apache Kafka), relational and non-relational databases (MySQL, MongoDB, etc.), along with cloud services (AWS, Google Cloud Platform or Azure). A solid understanding of data visualization tools like Tableau or Power BI may also be beneficial.

Ideal Candidates

The ideal candidate for this position will possess a strong analytical mindset and demonstrate a keen interest in data management and infrastructure. They should have excellent communication skills to work effectively with diverse teams, ensuring clarity in project requirements and data-related challenges. Adaptability and a willingness to stay current with evolving technologies in the data ecosystem are essential traits, while a proactive approach to problem-solving will contribute to the success of projects and overall organizational goals.