100% Remote Big Data Operations Engineer [24-00095]

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by Summit Human Capital, so some details may not match this job. The employer's own page has the real description.

Position Overview

The Big Data Operations Engineer at Summit Human Capital is a vital role that encompasses the management, optimization, and operational efficiency of large data infrastructures. This position entails collaborating with cross-functional teams to maintain performance, scalability, and reliability of big data systems while deploying and automating data pipelines. The candidate will leverage their technical expertise to troubleshoot issues, implement best practices, and ensure seamless data integration and processing workflows.

Job Responsibilities

• Design, implement, and maintain big data solutions to ensure high availability and efficiency.
• Monitor and optimize the performance of data pipelines and systems.
• Develop automation scripts for data processing workflows.
• Collaborate with data scientists and analysts to facilitate data accessibility.
• Troubleshoot and resolve issues related to data ingestion and processing.
• Ensure data quality and integrity by implementing validation mechanisms.
• Document processes, configurations, and best practices for operational transparency.
• Stay updated with the latest trends in big data technologies and practices.

Qualifications

• Bachelor's degree in Computer Science, Information Technology, or a related field.
• Minimum of 3 years of experience with big data technologies and cloud environments.
• Proficient in programming languages such as Python, Java, or Scala.
• Experience with Hadoop, Spark, or Kafka frameworks.
• Strong understanding of data modeling, ETL processes, and database systems.
• Familiarity with containerization technologies like Docker and orchestration tools like Kubernetes.
• Excellent communication and teamwork skills, with an ability to work independently in a remote setting.

Technologies & Tools

The Big Data Operations Engineer will work with cutting-edge technologies and tools, including Hadoop, Apache Spark, Kafka, AWS, Google Cloud Platform, and various database systems like MongoDB and MySQL. Proficiency with data visualization tools such as Tableau or Power BI may also be advantageous. The role demands familiarity with automation scripting and monitoring tools to enhance operational efficiencies.

Ideal Candidates

Ideal candidates for the Big Data Operations Engineer position possess a strong analytical mindset and a passion for leveraging data to solve complex challenges. They demonstrate exceptional problem-solving skills and a commitment to fostering teamwork and innovation. Candidates should be self-motivated and adaptable, capable of managing multiple priorities in a dynamic remote work environment. A proactive approach to continuous learning and keeping abreast of industry advancements is essential for success in this role.