Sr. Data Engineer

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by Excel Hire Staffing,LLC, so some details may not match this job. The employer's own page has the real description.

Overview

Excel Hire Staffing, LLC is seeking a highly skilled Sr. Data Engineer to join our dynamic team. The ideal candidate will play a crucial role in designing, building, and maintaining our data architecture and pipelines to support data-driven decision-making processes. This position requires a blend of technical expertise and problem-solving abilities to optimize data workflows and ensure high-quality data is accessible for analytical purposes. The Sr. Data Engineer will collaborate with cross-functional teams to translate business requirements into data solutions, enhancing our operational efficiency and engagement.

Job Responsibilities

• Design and implement scalable data pipelines to ingest, process, and store vast amounts of data.
• Develop and maintain robust ETL processes to ensure data quality and accessibility.
• Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver optimal solutions.
• Monitor data systems for performance and reliability, resolving any issues that arise rapidly.
• Establish and enforce best practices for data management, governance, and security.
• Optimize database performance, ensuring efficient query processing and data retrieval.
• Document all processes and frameworks, contributing to knowledge sharing and continuous improvement.

Qualifications

• Bachelor’s degree in Computer Science, Information Technology, or a related field; Master’s degree preferred.
• Minimum of 5 years of professional experience in data engineering or related roles.
• Strong proficiency in SQL and experience with NoSQL databases.
• Expertise in programming languages such as Python, Java, or Scala.
• Experience with data modeling, ETL tools, and cloud data services (e.g., AWS, Azure, or Google Cloud).
• Proficient in data warehousing concepts and architecture.
• Familiarity with data governance, compliance, and security standards.

Technologies & Tools

The Sr. Data Engineer will work with a variety of technologies and tools, including but not limited to: Apache Hadoop, Spark, Kafka, AWS services (such as S3, Redshift, and EMR), Python, SQL databases (such as MySQL and PostgreSQL), NoSQL databases (such as MongoDB), and data visualization tools like Tableau or Power BI. Proficiency in these tools is essential for delivering high-quality data solutions and ensuring the effectiveness of data-driven projects.

Ideal Candidates

The ideal candidate for the Sr. Data Engineer position will exhibit strong analytical and problem-solving skills, with a passion for working with data. They should possess excellent communication skills, facilitating seamless collaboration with technical and non-technical teams. Additionally, a proactive attitude towards learning and adapting to new technologies, coupled with a meticulous attention to detail, will pave the way for success in this role. Candidates should demonstrate a commitment to maintaining high standards of data integrity and security while effectively managing multiple tasks in a dynamic environment.