Principal Software Engineer, Data Platform (Remote)

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by WorkatHome-JobBoard, so some details may not match this job. The employer's own page has the real description.

Overview

The Principal Software Engineer, Data Platform at WorkatHome-JobBoard will play a pivotal role in designing, developing, and maintaining robust data platform solutions that support a variety of applications and services. The ideal candidate will lead a team of engineers, ensuring best practices for data management and architecture are followed, while collaborating with cross-functional teams to drive innovation and improve data accessibility and efficiency. This remote position offers the opportunity to influence key technologies and practices that shape the organization's data strategy.

Job Responsibilities

• Lead the design and architecture of scalable data platforms, ensuring optimal performance and reliability.
• Manage the end-to-end data lifecycle, from ingestion to processing and storage, while enforcing data governance and quality standards.
• Collaborate with Product Management and other stakeholders to define requirements and refine data solutions that align with business objectives.
• Mentor junior engineers, fostering a culture of continuous learning and improvement within the team.
• Conduct code reviews and provide feedback to ensure adherence to best practices and coding standards.
• Identify and implement innovative solutions to enhance data processing efficiency and reduce latency.
• Participate in on-call duties, troubleshooting and resolving production incidents related to data services.

Qualifications

• Bachelor’s degree in Computer Science, Software Engineering, or a related field; Master’s degree preferred.
• Proven experience (8+ years) in software development, with a strong focus on data architecture and engineering.
• Extensive knowledge of distributed computing frameworks such as Apache Hadoop, Spark, or similar technologies.
• Strong proficiency in programming languages such as Java, Python, or Scala.
• Experience with cloud platforms (AWS, Azure, or Google Cloud) and their data services.
• Understanding of database management systems (SQL and NoSQL) and data warehousing solutions.
• Exceptional problem-solving skills and the ability to work collaboratively in a remote team environment.

Technologies & Tools

This position utilizes a variety of technologies and tools including, but not limited to, Apache Kafka for data streaming, Apache Airflow for workflow management, MongoDB for NoSQL database solutions, and various JavaScript frameworks for front-end development. Familiarity with Docker and Kubernetes for container orchestration will also be beneficial, along with DevOps tools for continuous integration and deployment.

Ideal Candidates

The ideal candidate for the Principal Software Engineer, Data Platform role will possess strong leadership skills complemented by a passion for technology and a deep understanding of data architecture. They should exhibit excellent communication abilities, enabling effective collaboration with technical and non-technical teams alike. An innovative mindset, coupled with a proactive approach to identifying and solving challenges, is essential. A commitment to fostering an inclusive and diverse team environment will also be highly valued.