100% Remote || Big Data Engineer

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by Pro IT, Inc, so some details may not match this job. The employer's own page has the real description.

Job Overview

Pro IT, Inc. is seeking a highly skilled Big Data Engineer to join our dynamic team on a 100% remote basis. The successful candidate will be responsible for designing, building, and maintaining scalable data pipelines and large data processing systems. This role requires expertise in big data technologies and an ability to work collaboratively with cross-functional teams to ensure seamless data integration and analytics. The Big Data Engineer will play a crucial role in transforming raw data into actionable insights, thereby supporting data-driven decision-making across the organization.

Job Responsibilities

• Design and implement efficient data processing frameworks and pipelines using big data technologies.
• Develop and maintain ETL processes to extract, transform, and load data from various sources.
• Collaborate with data scientists and analysts to integrate new data sources into existing systems.
• Optimize data storage and retrieval processes for maximum efficiency.
• Monitor and troubleshoot performance issues in data systems and provide solutions for improvement.
• Document system architecture and design decisions for future reference.
• Stay updated with industry trends and advancements in big data technologies and practices.

Qualifications

• Bachelor's degree in Computer Science, Information Technology, or a related field.
• Proven experience as a Big Data Engineer or in similar roles.
• Strong proficiency in big data tools such as Apache Hadoop, Spark, and Kafka.
• Experience with programming languages such as Python, Java, or Scala.
• Familiarity with SQL and NoSQL databases including but not limited to MongoDB, Cassandra, and HDFS.
• Understanding of cloud platforms such as AWS, Google Cloud, or Azure.
• Excellent problem-solving skills and attention to detail.

Technologies & Tools

The Big Data Engineer will utilize a variety of technologies and tools, including Apache Hadoop for distributed storage, Apache Spark for data processing, and Apache Kafka for handling real-time data streams. Additionally, familiarity with cloud services, such as AWS or Microsoft Azure, will be instrumental in deploying scalable data solutions. Use of data visualization tools and scripting languages is also essential for transforming complex data sets into comprehensible visual formats.

Ideal Candidates

The ideal candidate for this Big Data Engineer position at Pro IT, Inc. will possess strong analytical abilities coupled with excellent communication skills to articulate complex technical concepts to non-technical stakeholders. They should have a passion for working with large data sets and a proactive approach to problem-solving. Candidates who exhibit adaptability, continuous learning, and an enthusiasm for new technologies will thrive in our fast-paced environment, making significant contributions to the company's data initiatives.