Sr Big Data Engineer (GCP)

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by Techaxis, Inc, so some details may not match this job. The employer's own page has the real description.

Job Overview

Techaxis, Inc. is seeking a highly skilled and experienced Senior Big Data Engineer specializing in Google Cloud Platform (GCP) to advance our data processing and analytics capabilities. The ideal candidate will be responsible for designing and implementing scalable big data infrastructure, developing robust data pipelines, and managing data integration processes. This role involves collaborating with cross-functional teams to leverage data insights and contribute to data-driven decision-making while ensuring data accuracy and performance optimization.

Job Responsibilities

• Design, build, and maintain scalable big data solutions on Google Cloud Platform.
• Develop data pipelines for extracting, transforming, and loading (ETL) data from various sources into big data environments.
• Optimize data storage solutions, ensuring high availability and performance.
• Collaborate with data scientists and analysts to understand data requirements and provide the necessary infrastructure.
• Implement data governance and security policies to protect sensitive information.
• Monitor and troubleshoot data processing issues to ensure minimal downtime.
• Build automation scripts for recurring data integration tasks to enhance operational efficiency.
• Provide mentorship and guidance to junior data engineers and team members.

Qualifications

• Bachelor's or Master's degree in Computer Science, Information Technology, or related field.
• 5+ years of experience in big data engineering or related roles, with a focus on GCP technologies.
• Strong proficiency in programming languages such as Python, Java, or Scala.
• Experience with GCP services including BigQuery, Dataflow, Dataproc, Cloud Storage, and Pub/Sub.
• Knowledge of data modeling, data warehousing concepts, and best practices.
• Familiarity with containerization technologies like Docker and orchestration tools like Kubernetes.
• Excellent problem-solving skills and the ability to work under tight deadlines.
• Strong communication skills, both written and verbal, enabling effective collaboration with diverse teams.

Technologies & Tools

The Senior Big Data Engineer will engage with a wide range of technologies and tools, primarily focusing on Google Cloud Platform services such as BigQuery, Dataflow, and Dataproc. The role also involves utilizing data orchestration tools, containerization platforms like Docker, and data integration software to ensure seamless data management and processing. Familiarity with machine learning frameworks may also be beneficial.

Ideal Candidates

Ideal candidates for the Senior Big Data Engineer role will possess a strong analytical mindset, showcasing a passion for turning complex data into actionable insights. They should display a proactive approach to problem-solving and excel in a collaborative environment where innovative ideas are welcomed. A focus on continuous improvement and a desire to stay current with industry trends and advancements in big data technology are essential traits for success in this position.