Big Data Software Engineer - IoT and Platform Development

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by CloudPro IT Solutions LLC, so some details may not match this job. The employer's own page has the real description.

Job Overview

The Big Data Software Engineer - IoT and Platform Development at CloudPro IT Solutions LLC will be responsible for designing, implementing, and maintaining robust data processing frameworks and real-time analytics solutions tailored to IoT applications. This role requires a solid foundation in big data technologies and the ability to integrate various data sources and platforms. The candidate will collaborate with cross-functional teams to ensure seamless operation and scalability of solutions that drive insights and enhance decision-making capabilities across the organization.

Job Responsibilities

• Design, develop, and maintain scalable big data solutions tailored to IoT requirements.
• Implement real-time data processing systems, ensuring low latency and efficient data handling.
• Collaborate with data scientists and IoT engineers to develop end-to-end data pipelines.
• Integrate various IoT devices and sensors to capture and process data effectively.
• Optimize existing data processing frameworks, enhancing performance and reliability.
• Participate in code reviews and contribute to the team's continuous improvement efforts.
• Document system designs and processes for future reference and onboarding.
• Stay updated with emerging big data and IoT technologies to incorporate best practices.

Qualifications

• Bachelor’s degree in Computer Science, Software Engineering, or a related field.
• 3+ years of experience in software development, focusing on big data technologies.
• Proficiency in programming languages such as Java, Python, or Scala.
• Experience with big data frameworks like Hadoop, Spark, or Kafka.
• Familiarity with cloud platforms such as AWS, Azure, or Google Cloud.
• Understanding of IoT protocols and frameworks, including MQTT and AMQP.
• Strong problem-solving skills and the ability to work independently and in teams.

Technologies & Tools

The candidate will regularly work with various technologies and tools including but not limited to Apache Hadoop, Apache Spark, Apache Kafka, Elasticsearch, SQL and NoSQL databases, and cloud services like Amazon Web Services (AWS). Familiarity with containerization tools such as Docker and orchestration platforms like Kubernetes will also be beneficial. The role requires utilizing both programming languages and data processing frameworks that facilitate the collection, storage, and analysis of large datasets derived from IoT devices.

Ideal Candidates

The ideal candidate for this position is one who possesses a strong analytical mind and is driven by innovation in technology. They should have an intrinsic curiosity and passion for working on challenging projects in the big data and IoT space. Teamwork and communication skills are essential, as collaboration with multiple departments is crucial. A proactive attitude toward problem-solving and a commitment to continuous learning to adapt to new tools and methodologies will set a strong candidate apart in this role.