Senior Data Engineer

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by Team Remotely Inc, so some details may not match this job. The employer's own page has the real description.

Job Overview

Team Remotely Inc. is seeking a Senior Data Engineer to join our rapidly growing team. The successful candidate will play a pivotal role in designing, developing, and maintaining robust data pipelines and architecture. They will collaborate with cross-functional teams to facilitate data-driven decision-making processes and enable advanced analytics across the organization. The ideal candidate should be proficient in contemporary data engineering practices, with a strong focus on performance, scalability, and data governance.

Job Responsibilities

• Design, implement, and manage scalable data pipelines that support real-time data processing.
• Develop and optimize data models for applications and analytics requirements.
• Collaborate with data scientists and analysts to ensure data availability and reliability.
• Monitor data quality, troubleshoot issues, and implement effective data governance strategies.
• Manage ETL processes, data integration, and data migration across various platforms.
• Stay updated on emerging technologies and industry trends to refine data engineering practices.
• Document data systems, processes, and workflows for future reference and compliance.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or a related field; Master's degree preferred.
• Minimum of 5 years of experience in data engineering or related fields.
• Proficiency in SQL and experience with databases such as PostgreSQL, MySQL, or MongoDB.
• Extensive experience with data pipeline tools (e.g., Apache Airflow, Apache NiFi, or similar).
• Strong programming skills in languages such as Python, Java, or Scala.
• Experience working with cloud platforms (e.g., AWS, GCP, Azure) and big data technologies (e.g., Hadoop, Spark).
• Understanding of data governance and data security best practices.

Technologies & Tools

The Senior Data Engineer will work with a variety of technologies and tools including, but not limited to, Apache Spark, AWS Glue, Apache Kafka, PostgreSQL, and various ETL tools. Familiarity with containerization and orchestration tools such as Docker and Kubernetes is advantageous, as well as experience with data visualization tools like Tableau or Looker for reporting purposes.

Ideal Candidates

The ideal candidate for the Senior Data Engineer position will possess a curious and analytical mindset with a problem-solving attitude. They will have a passion for data and a commitment to quality, ensuring that all initiatives contribute to the overall goals of the organization. Strong communication skills and teamwork are essential, as the candidate will often collaborate with various departments. They will also exhibit a continuous improvement mentality, always seeking ways to optimize performance and enhance data processes.