Sr. Data Engineer

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by ISmile Technologies, so some details may not match this job. The employer's own page has the real description.

Job Overview

ISmile Technologies is seeking a Sr. Data Engineer who will play a critical role in our data architecture and analytics initiatives. This position involves designing, developing, and managing scalable data pipelines and ensuring that the data systems are built for reliability and efficiency. The ideal candidate will collaborate closely with data scientists, analysts, and other stakeholders to enhance data availability and usability, ultimately enabling data-driven decision-making across the organization.

Job Responsibilities

• Design, develop, and maintain robust data pipelines and ETL processes to facilitate seamless data integration.
• Implement data models and database structures that support business intelligence and analytics efforts.
• Ensure the performance and scalability of data systems through optimization and best practices.
• Collaborate with data analysts and data scientists to understand data requirements and improve data accessibility.
• Monitor and troubleshoot data integration issues, ensuring data quality and integrity.
• Document data engineering processes and maintain up-to-date technical specifications.
• Actively participate in code reviews and contribute to a culture of continuous improvement.

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Data Engineering, or a related field.
• A minimum of 5 years of experience in data engineering or a related domain.
• Proficient in programming languages such as Python, Java, or Scala.
• Extensive experience with SQL and NoSQL databases, including technologies like PostgreSQL, MongoDB, or Cassandra.
• Strong understanding of data warehousing principles and cloud-based data solutions such as AWS, Azure, or Google Cloud Platform.
• Experience with big data technologies such as Hadoop, Spark, or Kafka is highly desirable.
• Demonstrated ability to work with large datasets and complex data architectures.

Technologies & Tools

In this position, candidates will work extensively with a range of technologies and tools including data processing frameworks such as Apache Spark and Hadoop, cloud storage solutions like AWS S3 or Azure Blob Storage, and database management systems including PostgreSQL and MongoDB. Familiarity with tools for orchestration such as Apache Airflow and data visualization platforms will also be part of the role to facilitate effective data management and reporting.

Ideal Candidates

The ideal candidates for the Sr. Data Engineer role at ISmile Technologies are those who possess a deep passion for data engineering along with a strong analytical mindset. They should demonstrate exceptional problem-solving abilities and maintain a keen attention to detail. Strong communication skills are essential for effectively collaborating with cross-functional teams. Candidates should also exhibit a proactive attitude, taking initiative in exploring new technologies and methodologies that can enhance data processing and analysis capabilities.