Sr. Data Engineer

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by Planet Technology, so some details may not match this job. The employer's own page has the real description.

Job Overview

As a Senior Data Engineer at Planet Technology, you will play a pivotal role in designing, constructing, and maintaining the data infrastructure that drives our analytics and decision-making efforts. You will collaborate with cross-functional teams to understand data requirements and help implement data pipelines and architectures that facilitate efficient data flow and accessibility. We expect you to leverage your expertise in big data technologies while ensuring adherence to best practices in data governance and quality.

Job Responsibilities

• Design, develop, and optimize data pipelines to support analytics and business intelligence initiatives.
• Collaborate with data analysts, data scientists, and other stakeholders to gather and define data requirements.
• Implement and maintain data storage solutions, ensuring data integrity and accessibility.
• Utilize ETL tools and frameworks to extract, transform, and load data from various sources into the data ecosystem.
• Monitor system performance and troubleshoot data-related issues to ensure high availability and reliability.
• Ensure compliance with data governance policies and standards while maintaining data security protocols.
• Mentor junior data engineering staff, sharing best practices and promoting team growth.

Qualifications

• Bachelor's degree in Computer Science, Data Science, Engineering, or a related field; Master's degree preferred.
• Minimum of 5 years of experience in data engineering or a similar role.
• Proficient in programming languages such as Python, Java, or Scala.
• Extensive experience with SQL and no-SQL databases, alongside big data technologies like Hadoop or Spark.
• Strong understanding of data warehousing concepts, data modeling, and data pipeline architecture.
• Experience with cloud platforms (AWS, Azure, or GCP) and their data services.
• Familiarity with data governance, data quality, and compliance standards.

Technologies & Tools

This position involves the use of various technologies and tools including, but not limited to, Apache Hadoop, Apache Spark, ETL tools (such as Talend, Informatica), SQL/NoSQL databases (like PostgreSQL, MongoDB), data visualization tools (e.g., Tableau, Power BI), and cloud platforms (AWS, Azure, GCP) for building scalable data solutions.

Ideal Candidates

The ideal candidate will possess strong analytical and problem-solving skills, demonstrating a passion for data and a proactive approach to challenges. You should have excellent communication skills and the ability to work collaboratively in a team-oriented environment. A commitment to continuous learning and staying current with emerging data technologies will further enhance your fit in this dynamic role.