Data Engineer, 750000 Peso mexicano (Globalmente remoto) [Big data, Google Cloud Platform (GCP)]

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by Listopro, so some details may not match this job. The employer's own page has the real description.

Job Overview

As a Data Engineer at Listopro, you will play a pivotal role in the management and orchestration of large-scale data processing systems. Your main responsibility will be to design, implement, and maintain data pipelines and architectures that facilitate seamless data movement and integration, with a focus on Big Data technologies and leveraging Google Cloud Platform (GCP). You will collaborate cross-functionally with data scientists and analysts to ensure that data is accessible and usable, enabling informed decision-making across the organization. Your contributions will be integral in shaping the data strategy and improving data quality in a fast-paced, globally remote environment.

Job Responsibilities

• Design, develop, and implement robust data pipelines to process and transform large datasets.
• Collaborate with data scientists, analysts, and business stakeholders to gather requirements and define project goals.
• Ensure data integration from various sources, maintaining high levels of accuracy and quality.
• Monitor and optimize data processing performance and troubleshoot any issues that arise.
• Create and maintain documentation for data processes, data flows, and architectural designs.
• Implement best practices in data storage, retrieval, and processing techniques using Google Cloud Platform services.
• Work with data governance frameworks to ensure compliance with data protection regulations.

Qualifications

• Bachelor’s degree in Computer Science, Information Technology, or a related field.
• Minimum of 3 years of experience in data engineering or a related role.
• Proficiency in programming languages such as Python, Java, or Scala.
• Strong understanding of Big Data technologies including Hadoop, Spark, and Kafka.
• Hands-on experience with Google Cloud Platform services such as BigQuery, Dataflow, or Dataproc.
• Familiarity with SQL and NoSQL databases.
• Experience with data modeling, data warehousing, and ETL processes.
• Excellent problem-solving skills and ability to work independently in a remote environment.

Technologies & Tools

The Data Engineer will utilize a variety of technologies and tools essential for data processing and analysis. Those include, but are not limited to, Google Cloud Platform (GCP) services such as BigQuery for data warehousing, Dataflow for stream and batch processing, and Dataproc for deploying Apache Spark clusters. Additionally, proficiency in tools like Apache Kafka for real-time data streaming, Hadoop for distributed storage and processing, and various SQL and NoSQL database systems will be crucial for success in this role.

Ideal Candidates

Ideal candidates for the Data Engineer position at Listopro will exhibit a strong blend of technical skills and soft skills. They will demonstrate an analytical mindset with a passion for problem-solving, coupled with strong attention to detail. Effective communication and teamwork skills are essential, as collaboration with cross-functional teams will be a key part of the role. Furthermore, candidates will need to exhibit adaptability and a continuous learning spirit in a rapidly evolving technology landscape, driven to optimize processes and deliver innovative solutions.