Principal Software Engineer, Data Platform (Remote)

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by Jobs via Dice, so some details may not match this job. The employer's own page has the real description.

Overview

As a Principal Software Engineer for the Data Platform at Jobs via Dice, you will play a critical role in shaping and developing our data infrastructure. You will leverage your extensive experience in software development and architecture to lead technical initiatives while collaborating with cross-functional teams to deliver innovative solutions. Your expertise in data engineering will contribute to the creation of scalable systems that enhance data ingestion, processing, and analysis, ultimately supporting data-driven decision-making for the organization.

Job Responsibilities

• Design and implement robust data architectures for large-scale data processing and analytics.
• Collaborate with product management and other engineering teams to define and prioritize product features and enhancements.
• Lead the development of new data pipelines and data processing frameworks, ensuring efficiency and scalability.
• Conduct code reviews and mentor junior engineers to promote best practices in software development.
• Evaluate and recommend technologies, tools, and frameworks that improve team productivity and performance.
• Ensure high-quality software delivery through rigorous unit and integration testing practices.
• Monitor application performance and troubleshoot issues in production environments.
• Stay current on industry trends and emerging technologies to continuously improve the data platform.

Qualifications

• Bachelor’s degree in Computer Science, Information Technology, or a related field; Master’s degree preferred.
• 10+ years of experience in software engineering, with a focus on data platforms and infrastructure.
• Proficient in programming languages such as Java, Python, or Scala.
• Experience with big data technologies such as Apache Hadoop, Spark, or Kafka.
• Strong understanding of database technologies, both SQL and NoSQL.
• Proven track record of designing and implementing distributed systems and data pipelines.
• Excellent problem-solving skills and ability to work in a fast-paced environment.
• Outstanding communication and collaboration skills to work effectively with diverse teams.

Technologies & Tools

The Principal Software Engineer in this role will work with a variety of modern technologies and tools. Key technologies include Apache Hive, Apache Airflow, AWS services (such as S3, Redshift, and EMR), Docker containers, and Kubernetes for orchestration. Familiarity with CI/CD pipelines, Git version control, and monitoring tools like Prometheus or Grafana will also be essential for ensuring the success of the data platform initiatives.

Ideal Candidates

Ideal candidates for the Principal Software Engineer, Data Platform position are strategic thinkers who demonstrate strong technical acumen and possess a passion for data engineering. They should exhibit strong leadership qualities, guiding teams towards achieving shared goals while fostering an environment of collaboration and innovation. Effective communicators who can translate complex technical concepts to non-technical stakeholders will thrive in this role. A proactive approach to challenges, combined with a commitment to continuous learning and improvement, will contribute significantly to the team's success and the overall objectives of Jobs via Dice.