Software Engineer - Data Platform

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by Sciata, so some details may not match this job. The employer's own page has the real description.

Overview

As a Software Engineer - Data Platform at Sciata, you will play a pivotal role in the design, development, and maintenance of our data infrastructure. Your primary responsibility will be to enhance and optimize data processing pipelines, ensuring scalability and efficiency to support various analytical needs across the organization. You will collaborate closely with cross-functional teams to drive innovations in data management and analysis, enabling data-driven decision-making and insightful business outcomes.

Job Responsibilities

• Design and implement scalable data pipelines to process large datasets efficiently.
• Collaborate with data scientists and analysts to understand data requirements and deliver analytical solutions.
• Monitor and optimize data workflows for performance and efficiency.
• Create and maintain documentation for data architecture, pipelines, and processes.
• Develop and implement data quality checks to ensure data integrity.
• Troubleshoot and resolve data-related issues, providing timely support to stakeholders.
• Stay updated with emerging technologies and best practices in data engineering and analytics.

Qualifications

• Bachelor’s degree in Computer Science, Information Technology, or a related field.
• 3+ years of experience in software engineering, with a strong focus on data platforms.
• Proficiency in programming languages such as Python, Java, or Scala.
• Experience with data warehousing solutions and ETL processes.
• Familiarity with big data technologies like Apache Spark, Hadoop, or similar frameworks.
• Understanding of database technologies, including relational and NoSQL databases.
• Strong analytical skills and problem-solving abilities.

Technologies & Tools

In this position, you will work with a variety of technologies and tools aimed at optimizing data handling and analysis. This includes platforms like Apache Spark for big data processing, SQL and NoSQL databases for data storage and retrieval, as well as tools for data visualization and reporting. Familiarity with cloud computing platforms such as AWS or Azure is also essential for managing and deploying data solutions effectively.

Ideal Candidates

The ideal candidates for this role will possess a blend of technical expertise and interpersonal skills. They should be passionate about data and technology, demonstrating a proactive approach to problem-solving and continuous improvement. Effective communication skills are vital, as the role requires collaboration with diverse teams and stakeholders. A keen interest in learning new technologies and adapting to evolving challenges will also distinguish successful applicants for this position.