Data Engineer - 1691

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by Certec, Inc., so some details may not match this job. The employer's own page has the real description.

Position Overview

The Data Engineer at Certec, Inc. will be responsible for designing, constructing, and maintaining robust data processing systems. The successful candidate will work closely with data architects and analytics teams to implement data solutions that ensure high data integrity, provide effective data transformation processes, and leverage large datasets to meet organizational needs. This role demands proficiency in data manipulation, optimization of data workflows, and the ability to adapt to changing data requirements across various projects.

Job Responsibilities

• Design, develop, and maintain scalable data processing frameworks and systems.
• Implement ETL processes to extract, transform, and load data from various sources into centralized databases.
• Collaborate with data scientists and analysts to understand data requirements and provide actionable data solutions.
• Ensure data quality and maintain documentation for data pipelines and architectures.
• Optimize and improve existing data infrastructure and workflows for better performance and efficiency.
• Monitor and troubleshoot system performance, addressing issues and implementing solutions as needed.
• Stay updated with emerging technologies and suggest improvements to existing data practices.

Qualifications

• Bachelor's degree in Computer Science, Information Technology, Data Science, or a related field.
• Minimum of 3 years of professional experience in data engineering or a related field.
• Proficiency in SQL and expertise in database management systems such as PostgreSQL, MySQL, or similar.
• Hands-on experience with data lake and data warehouse solutions.
• Knowledge of programming languages (e.g., Python, Java, Scala) for data manipulation and ETL processes.
• Familiarity with cloud platforms (e.g., AWS, Google Cloud, Azure) and their data-related services.
• Understanding of data modeling, schema design, and data governance principles.

Technologies & Tools

The Data Engineer role at Certec, Inc. will involve working with a variety of technologies and tools including but not limited to Apache Spark, Hadoop, Kafka for stream processing, and ETL tools such as Talend or Informatica. Additionally, proficiency in using version control systems like Git and containerization technologies like Docker is recommended. Familiarity with business intelligence tools and data visualization platforms will also be beneficial.

Ideal Candidates

Ideal candidates for the Data Engineer position will possess strong analytical skills and a passion for working with data. They should be proactive problem-solvers with a keen attention to detail and the ability to work independently as well as collaboratively within a team. Excellent communication skills are also essential to effectively convey technical concepts to non-technical stakeholders. An adaptable mindset and eagerness to learn new technologies will further enhance their fit for this dynamic role at Certec, Inc.