Full Time

Senior Data Platform Engineer

Jobot
$120,000 - $160,000* / year (about $58–$77 an hour)

Job Description

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by Jobot, so some details may not match this job. The employer's own page has the real description.

Overview

The Senior Data Platform Engineer at Jobot will play a crucial role in developing and maintaining robust, scalable, and secure data architectures that support business intelligence and analytics initiatives. This position requires a deep understanding of data processing frameworks, as well as experience in implementing data-flow pipelines. The engineer will work collaboratively with cross-functional teams to ensure data is accessible, reliable, and efficiently managed, enabling the organization to derive actionable insights from data assets.



Job Responsibilities

  • Design, build, and maintain scalable data pipelines and ETL processes to enable reliable data processing.
  • Collaborate with data scientists, data analysts, and other stakeholders to understand data requirements and translate them into technical specifications.
  • Optimize data storage solutions for speed and cost-effectiveness across various environments.
  • Ensure data quality and integrity by enforcing data governance policies and best practices.
  • Identify and troubleshoot data issues, providing timely resolutions to minimize impact on business operations.
  • Stay updated on industry trends, technologies, and best practices related to data engineering to continuously improve processes and solutions.


Qualifications

  • Bachelor's degree in Computer Science, Information Technology, or a related field.
  • Minimum of 5 years of experience in data engineering or a similar role.
  • Proficiency in programming languages such as Python, Java, or Scala.
  • Experience with data processing frameworks such as Apache Spark or Hadoop.
  • Strong knowledge of SQL and experience with relational databases (e.g., PostgreSQL, MySQL).
  • Familiarity with cloud platforms (AWS, Azure, Google Cloud) and related services.
  • Solid understanding of data warehousing concepts and technologies.
  • Excellent problem-solving skills and ability to work independently or within a team.


Technologies & Tools

The Senior Data Platform Engineer will utilize a variety of technologies and tools in their role, including but not limited to Apache Spark, Apache Kafka, Airflow, AWS (S3, Redshift, Glue), and traditional relational databases like PostgreSQL. Familiarity with containerization technologies such as Docker and orchestration frameworks like Kubernetes will also be advantageous for this position.



Ideal Candidates

Ideal candidates for the Senior Data Platform Engineer position will possess strong analytical thinking, a passion for working with data, and an aptitude for solving complex problems. They will have excellent communication skills, allowing them to articulate technical concepts to non-technical stakeholders effectively. A proactive mindset and the ability to collaborate with diverse teams will make an individual successful in this role, alongside a commitment to continuous learning and improvement in data engineering practices.

In 98 of the 191 countries we compare, we found no unemployment benefit on official sites. Compare countries →

View Similar Jobs

Matches Jobs

Similar jobs which you may be interested in. Typically using your existing skillset.