Software Engineer (Data Engineer) - Remote | WFH

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by Get It Recruit - Information Technology, so some details may not match this job. The employer's own page has the real description.

Overview

As a Software Engineer specializing in Data Engineering at Get It Recruit - Information Technology, you will play a crucial role in designing, developing, and maintaining robust data pipelines and architectures. This remote position demands a collaborative mindset as you will work closely with cross-functional teams to facilitate data-driven decision-making. Your expertise will be pivotal in transforming complex data into actionable insights, ensuring the integrity, availability, and performance of data infrastructure.

Job Responsibilities

• Design and implement scalable data pipelines to handle large volumes of data from various sources.
• Collaborate with data scientists and analysts to understand data requirements and optimize data workflows.
• Develop and maintain data models and metadata to enhance data quality and accessibility.
• Monitor, troubleshoot, and optimize ETL processes to ensure data accuracy and reliability.
• Utilize appropriate tools and technologies to ensure efficient data storage, processing, and retrieval.
• Document technical processes and data architectures for future reference and maintenance.
• Stay updated with industry trends and best practices in data engineering and cloud technologies.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or a related field.
• 3+ years of experience in data engineering or a similar role.
• Proficiency in data engineering languages such as Python, Java, or Scala.
• Experience with ETL frameworks and data pipeline orchestration tools (e.g., Apache Airflow, AWS Glue).
• Strong knowledge of relational and non-relational databases (e.g., SQL, NoSQL).
• Familiarity with cloud platforms such as AWS, Azure, or Google Cloud Platform.
• Excellent problem-solving skills and the ability to work independently in a remote setting.

Technologies & Tools

The role requires expertise in modern technologies such as Apache Spark for big data processing, along with experience in cloud storage solutions including Amazon S3, Azure Blob Storage, or Google Cloud Storage. Familiarity with containerization technologies like Docker and orchestration tools is also beneficial. Additionally, knowledge of data warehouse solutions such as Snowflake or Redshift is advantageous.

Ideal Candidates

The ideal candidate for this position is a proactive and detail-oriented individual who thrives in a dynamic, fast-paced environment. A strong analytical mindset combined with excellent communication skills is essential to collaborate effectively with team members. Candidates should demonstrate a passion for leveraging data to drive insights, with a continuous improvement attitude and a commitment to delivering high-quality work. Adaptability and a willingness to learn new technologies will also be key attributes for success in this role.