Sr Data Engineer with Devops Experience

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by VFourTech Inc, so some details may not match this job. The employer's own page has the real description.

Job Overview

VFourTech Inc. is seeking a highly skilled Senior Data Engineer with DevOps experience to join our dynamic team. The ideal candidate will be responsible for designing, implementing, and maintaining scalable data pipelines and infrastructures while integrating DevOps practices to improve operational efficiency. This role will involve collaborating with cross-functional teams to support data initiatives and ensure data integrity and availability while driving innovative solutions that leverage cloud technologies and big data frameworks.

Job Responsibilities

• Design, construct, test, and maintain data architectures, including large scale datasets and data pipelines.
• Implement and manage ETL processes to transform and structure data for analytical purposes.
• Collaborate with data scientists and analysts to understand data requirements and deliver appropriate data solutions.
• Develop and maintain infrastructure as code (IaC) to facilitate modular deployments and maintainability of services.
• Monitor and optimize system performance, ensuring high availability and low latency in data feeds.
• Drive DevOps practices for continuous integration and continuous deployment (CI/CD) of data applications.
• Create and maintain documentation for data models, data flow, and systems architecture.
• Stay updated on industry trends and technologies to improve data team capabilities and efficiency.

Qualifications

• Bachelor's degree in Computer Science, Information Technology, or a related field; Master's degree preferred.
• 5+ years of professional experience in data engineering, with a strong emphasis on data integration and architecture.
• Proficient in programming languages such as Python, Java, or Scala.
• Experience with cloud platforms (AWS, Azure, or Google Cloud) and related services.
• Solid understanding of databases (SQL, NoSQL) and data warehousing solutions.
• Hands-on experience with containerization tools and orchestration frameworks (Docker, Kubernetes).
• Familiarity with CI/CD tools (Jenkins, GitLab CI) and version control systems (Git).
• Strong problem-solving skills and ability to work in a fast-paced environment.

Technologies & Tools

The Senior Data Engineer will be expected to work with a variety of tools and technologies, including but not limited to Apache Spark, Hadoop, Kafka, Airflow, and various cloud-based databases. Familiarity with visualization tools (Tableau, Power BI) may also be advantaged. Proficiency in using Docker for containerization and Kubernetes for orchestration to streamline deployment processes is essential.

Ideal Candidates

The ideal candidate for the Senior Data Engineer position at VFourTech Inc. will possess a strong analytical mindset and a passion for data-driven solutions. They should be detail-oriented and adaptive, with excellent communication skills to collaborate effectively across teams. A proactive and innovative approach to problem-solving is crucial, as well as the ability to thrive under pressure while managing multiple priorities. Strong leadership skills to mentor and guide junior data engineers will also be highly valued.