Big Data Software Engineer IV (Remote)

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by Availity, so some details may not match this job. The employer's own page has the real description.

Job Overview

The Big Data Software Engineer IV at Availity will play a pivotal role in designing, developing, and optimizing robust data solutions that facilitate insightful decision-making and enhance operational efficiency. This remote position requires a proficient individual capable of handling large volumes of data to ensure seamless integration with various systems. The engineer will leverage their expertise in big data technologies to develop advanced analytics and data processing solutions that align with the company's strategic goals.

Job Responsibilities

• Design and implement scalable data processing solutions using big data technologies.
• Collaborate with cross-functional teams to gather requirements and translate them into technical specifications.
• Perform performance tuning and optimize existing data pipelines for better efficiency and reliability.
• Develop and maintain data models and ETL processes to support business analytics initiatives.
• Utilize data visualization tools to present findings and recommend actions based on data analysis.
• Ensure data quality and governance practices are followed throughout the data lifecycle.
• Mentor junior engineers and contribute to team knowledge sharing practices.
• Stay current with industry trends and emerging technologies to enhance data solutions.

Qualifications

• Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
• Minimum of 5 years of experience in big data engineering or a relevant software engineering role.
• Strong proficiency in programming languages such as Java, Scala, or Python.
• Experience with big data technologies and frameworks such as Hadoop, Spark, and Kafka.
• Proficiency in SQL and experience with relational and NoSQL databases.
• In-depth understanding of data warehousing concepts and architecture.
• Familiarity with cloud platforms like AWS, Azure, or Google Cloud.
• Excellent analytical and problem-solving skills with a strong attention to detail.

Technologies & Tools

The Big Data Software Engineer IV position requires proficiency in a range of technologies and tools essential for data processing and analysis. Key technologies include Apache Hadoop, Apache Spark, Apache Kafka, relational and NoSQL databases such as MySQL and MongoDB, as well as cloud platforms like Amazon Web Services (AWS) and Microsoft Azure. Familiarity with data visualization software and data governance tools is also important for effectively communicating analytical findings.

Ideal Candidates

Ideal candidates for the Big Data Software Engineer IV position at Availity will possess a strong passion for technology and data analytics, complemented by a proactive and innovative mindset. They should thrive in collaborative environments and demonstrate exceptional communication skills to convey complex technical concepts. The ability to adapt to rapidly changing technologies and business requirements, coupled with a commitment to continuous learning and skills enhancement, will set candidates apart in this dynamic role.