Senior Software Engineer (CDP Platform and Data Engineering experience)

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by New York Technology Partners, so some details may not match this job. The employer's own page has the real description.

Job Overview

The Senior Software Engineer at New York Technology Partners will play a pivotal role in the design, development, and optimization of our Centralized Data Platform (CDP) and data engineering solutions. This position requires a deep understanding of advanced software engineering principles and experience with data-centric architectures. The ideal candidate will collaborate closely with cross-functional teams to create robust, scalable applications that enhance our data capabilities, ensuring high performance and maintainability.

Job Responsibilities

• Design and implement scalable data pipelines and efficient data workflows to support the organization's analytical needs.
• Collaborate with data scientists, analysts, and other stakeholders to enhance the existing data infrastructure.
• Develop high-quality software components, frameworks, and services that adhere to data engineering best practices.
• Optimize and monitor data processing tasks for performance and reliability, ensuring low latency and integrity.
• Mentor and guide junior software engineers to foster skill development and enhance team productivity.
• Engage in code reviews and architectural discussions to promote a culture of quality and innovation.
• Stay current with industry trends, emerging technologies, and methodologies in software engineering and data management.

Qualifications

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
• Minimum of 5 years of professional software engineering experience, particularly in data platforms and data engineering.
• Strong proficiency in programming languages such as Python, Java, or Scala.
• Deep understanding of data storage solutions, including SQL and NoSQL databases.
• Experience with cloud-based services (AWS, Azure, or Google Cloud Platform) and containerization technologies (Docker, Kubernetes).
• Familiarity with ETL processes, data warehousing, and data lake architectures.
• Excellent problem-solving skills and a strong attention to detail.
• Outstanding communication skills and ability to work collaboratively in a fast-paced environment.

Technologies & Tools

The ideal candidate will work with a variety of technologies and tools, including but not limited to Python for data manipulation, SQL for database querying, Spark for big data processing, and AWS services such as S3, Lambda, and Redshift. Familiarity with CI/CD tools, version control systems such as Git, and frameworks that facilitate data integration will also be highly beneficial.

Ideal Candidates

Ideal candidates for the Senior Software Engineer position should possess a passion for data and software engineering, exhibiting strong analytical and problem-solving abilities. They should be proactive in their approach, demonstrating a willingness to learn and adapt to changing technologies. Successful candidates will also have a collaborative mindset, being able to effectively work in teams and communicate their ideas clearly to both technical and non-technical stakeholders.