Sr. Data Engineer

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by Chelsoft Solutions Co., so some details may not match this job. The employer's own page has the real description.

Job Overview

The Senior Data Engineer at Chelsoft Solutions Co. will play a critical role in enhancing our data management capabilities by designing, constructing, and maintaining robust data systems and pipelines. This position requires a seasoned professional to collaborate with cross-functional teams in gathering requirements, optimizing data storage, and ensuring the integrity and availability of data across various platforms. The ideal candidate will leverage advanced data engineering techniques and tools while driving data initiatives that support business objectives and analytical needs.

Job Responsibilities

• Design, implement, and maintain scalable data pipelines and systems to gather, process, and store large volumes of data.
• Collaborate with data scientists, analysts, and other stakeholders to define data requirements and ensure data availability for analytic initiatives.
• Monitor performance of data infrastructure and optimize to improve efficiency and responsiveness.
• Implement data governance and quality standards to ensure accuracy and consistency of data across all platforms.
• Develop or assist in the creation of data integration processes, including ETL (Extract, Transform, Load) procedures.
• Utilize cloud services for data storage, processing, and warehousing.
• Document data systems architecture and workflows, maintaining up-to-date information for team members and stakeholders.
• Conduct performance tuning and troubleshooting in data retrieval and processing methodologies.

Qualifications

• Bachelor’s degree in Computer Science, Information Technology, or a related field. A Master’s degree is preferred.
• Minimum of 5 years of experience as a Data Engineer or in a related role.
• Proven expertise in SQL and proficiency in programming languages such as Python, Java, or Scala.
• Experience with data warehousing solutions and architecture, as well as ETL tools.
• Familiarity with big data technologies such as Hadoop, Spark, or Kafka.
• Strong understanding of data modeling concepts, schema design, and data integration techniques.
• Solid experience with cloud platforms, preferably AWS, Azure, or Google Cloud Platform.
• Excellent problem-solving skills and the ability to work independently and collaboratively in a team environment.

Technologies & Tools

This position utilizes a variety of technologies and tools to support data engineering tasks. Candidates should be familiar with SQL databases such as MySQL or PostgreSQL, NoSQL databases like MongoDB or Cassandra, and big data frameworks such as Apache Hadoop and Apache Spark. Additionally, knowledge of cloud platforms like AWS, Azure, or Google Cloud, as well as experience with data visualization tools, will be beneficial.

Ideal Candidates

The ideal candidate for the Senior Data Engineer position will possess strong analytical and problem-solving skills, demonstrating a keen ability to translate complex data requirements into actionable plans. They should exhibit exceptional attention to detail and have a proactive approach to identifying and resolving data-related issues. Strong communication skills are essential to effectively collaborate with various teams and stakeholders. A passion for continuous learning and staying updated with industry trends will further benefit candidates in this fast-paced and evolving environment.