Senior Data Engineer

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by Team Remotely Inc, so some details may not match this job. The employer's own page has the real description.

Job Overview

Team Remotely Inc. is seeking a Senior Data Engineer to play a pivotal role in the design, development, and management of robust data pipelines and architecture. The successful candidate will be responsible for ensuring the availability, accessibility, and reliability of data throughout its lifecycle. This role involves collaborating with data scientists, analysts, and other stakeholders to optimize data usage and to create systems that facilitate efficient data retrieval and analysis.

Job Responsibilities

• Design, construct, install, and maintain scalable data pipelines and architecture to support data collection, transformation, and storage.
• Collaborate with data scientists and business analysts to understand data requirements and identify key performance indicators.
• Optimize data systems and pipelines for performance and scalability based on business needs.
• Ensure data quality and integrity by implementing appropriate data validation and cleansing techniques.
• Create and maintain comprehensive data documentation, including data workflows and architecture diagrams.
• Conduct research and make recommendations on cloud services, database technologies, and data processing frameworks.
• Monitor systems for performance issues, troubleshoot, and optimize as necessary.
• Mentor junior data engineers, providing guidance and best practices in data engineering.

Qualifications

• Bachelor’s degree in Computer Science, Information Technology, or a related field; Master’s degree preferred.
• Minimum of 5 years of experience in data engineering, data architecture, or a similar role.
• Strong proficiency with SQL and experience with NoSQL databases (e.g., MongoDB, Cassandra).
• Experience in data warehousing solutions and ETL (Extract, Transform, Load) tools.
• Proven experience with cloud computing platforms (e.g., AWS, Azure, Google Cloud Platform).
• Familiarity with programming languages such as Python, Java, or Scala.
• Understanding of data modeling, data governance, and best practices for data management.
• Excellent problem-solving skills and ability to work in a fast-paced environment.

Technologies & Tools

The Senior Data Engineer will work with a variety of technologies and tools including but not limited to AWS services (such as S3, Redshift, and Glue), Apache Hadoop, Apache Spark, Airflow, Kafka, and data visualization tools like Tableau or Power BI. Proficiency in SQL and scripting languages will also be essential in the everyday execution of responsibilities.

Ideal Candidates

The ideal candidates for this position are results-driven, detail-oriented professionals with a strong analytical mindset. They should exhibit exceptional communication skills, allowing them to effectively collaborate across departments. An eagerness to learn and adapt to new technologies and trends in data engineering is essential. Candidates should possess the ability to manage multiple projects simultaneously while maintaining high standards of quality and efficiency.