Sr. Data Engineer

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by Planet Technology, so some details may not match this job. The employer's own page has the real description.

Job Overview

As a Sr. Data Engineer at Planet Technology, you will play a critical role in designing, implementing, and maintaining data infrastructure that supports our various data-driven initiatives. You will collaborate closely with cross-functional teams, including data scientists and business analysts, to enable robust data solutions that drive decision-making processes. Your expertise in building scalable and efficient data pipelines will ensure reliable data availability and integrity, helping to foster a data-centric culture within the organization.

Job Responsibilities

• Design and develop scalable data architectures, pipelines, and systems to support large-scale data processing.
• Collaborate with data scientists and analysts to understand data requirements and deliver optimal data solutions.
• Ensure data quality, integrity, and availability by implementing robust data validation and monitoring processes.
• Troubleshoot and optimize existing data pipelines and system performance.
• Document data flows, architecture designs, and processes to maintain transparency and knowledge sharing.
• Assist in migrating on-premises data solutions to cloud-based platforms.
• Mentor junior data engineers and contribute to their professional development.

Qualifications

• Bachelor's degree in Computer Science, Engineering, or a related field; Master's degree preferred.
• 5+ years of experience in data engineering or a related field.
• Proficiency in programming languages such as Python, Java, or Scala.
• Strong experience with SQL and NoSQL databases (e.g., PostgreSQL, MongoDB).
• Hands-on experience with big data technologies (e.g., Hadoop, Spark, Kafka).
• Familiarity with cloud data solutions (e.g., AWS, Azure, Google Cloud Platform).
• Knowledge of data modeling concepts and ETL processes.
• Excellent problem-solving skills and attention to detail.

Technologies & Tools

In this position, you will be working with a diverse set of technologies and tools, including big data processing frameworks like Apache Spark and Hadoop, data warehousing solutions such as Amazon Redshift or Google BigQuery, and cloud platforms including AWS, Azure, or Google Cloud Platform. Additionally, you will utilize ETL tools, containerization technologies like Docker, and orchestration tools such as Apache Airflow or Kubernetes to manage data workflows efficiently.

Ideal Candidates

The ideal candidate for the Sr. Data Engineer position will possess a strong analytical mindset coupled with a passion for data and technology. They should demonstrate excellent communication and collaboration skills to effectively work with cross-functional teams. Furthermore, a proactive approach to problem-solving, a keen attention to detail, and a desire to mentor and guide junior team members are key characteristics that will contribute to success in this role. A continual learner who thrives in a fast-paced environment will be particularly well-suited for our organization.