Software Engineer-Spark

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by VeeAR Projects Inc., so some details may not match this job. The employer's own page has the real description.

Job Overview

VeeAR Projects Inc. is seeking a highly skilled Software Engineer-Spark to join our dynamic team. The successful candidate will play a vital role in developing and implementing scalable data processing solutions using Apache Spark. This position will entail collaborating with cross-functional teams to define data infrastructure requirements, design efficient data pipelines, and optimize performance to meet the business's analytical needs. The ideal individual will have a robust understanding of big data technologies, exceptional programming skills, and a commitment to delivering high-quality software solutions.

Job Responsibilities

• Design and implement robust data processing workflows using Apache Spark.
• Collaborate with data scientists and analysts to understand data requirements and translate them into technical specifications.
• Optimize existing Spark applications for performance and scalability.
• Develop and maintain ETL processes to ensure the availability of high-quality data.
• Conduct code reviews and contribute to the overall software architecture.
• Troubleshoot and resolve data-related issues effectively and efficiently.
• Keep abreast of emerging technologies and best practices related to big data processing.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or a related field.
• Proven experience with Apache Spark and related big data technologies.
• Strong programming skills in Scala, Java, or Python.
• Familiarity with cloud-based data solutions (AWS, Azure, or Google Cloud).
• Experience with data modeling and query optimization.
• Knowledge of distributed computing principles and data processing frameworks.
• Excellent problem-solving skills and a strong attention to detail.

Technologies & Tools

The Software Engineer-Spark will primarily utilize Apache Spark for large-scale data processing. Additional technologies include Hadoop, Kafka, and various cloud platforms such as AWS and Azure. Experience with SQL databases, NoSQL solutions, and data visualization tools will also be relevant to fulfilling the job responsibilities effectively. Familiarity with version control systems such as Git and CI/CD pipelines will enhance the candidate's ability to work collaboratively within development teams.

Ideal Candidates

The ideal candidate for the Software Engineer-Spark position is an innovative thinker with a proactive approach to problem-solving. They demonstrate strong analytical skills and a passion for leveraging data to drive business outcomes. Effective communication and collaboration skills are essential, as the role requires continual interaction with various stakeholders. An enthusiasm for personal and professional growth, along with a commitment to exceeding project expectations, will further distinguish the perfect fit for our organization.