Distributed Systems Engineer - ML Training

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by DeepRec.ai, so some details may not match this job. The employer's own page has the real description.

Job Overview

As a Distributed Systems Engineer specializing in ML Training at DeepRec.ai, you will play a pivotal role in designing and implementing robust distributed systems that facilitate efficient machine learning training processes. Your expertise will be instrumental in optimizing performance, reliability, and scalability in our AI systems. Leveraging your technical knowledge, you will collaborate closely with data scientists and software engineers to develop innovative solutions that accelerate the deployment of machine learning models in various applications.

Job Responsibilities

• Design and architect distributed systems for machine learning training workflows.
• Optimize and enhance existing ML training pipelines to improve performance and efficiency.
• Collaborate with cross-functional teams to gather requirements and translate them into technical specifications.
• Implement and maintain monitoring tools to ensure system reliability and performance metrics.
• Conduct performance testing and debugging of distributed systems.
• Stay current with the latest advancements in distributed computing and machine learning technologies.
• Document design, processes, and best practices for system implementation and maintenance.

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
• Proven experience in distributed systems design and implementation.
• Strong understanding of machine learning concepts and algorithms.
• Proficiency in programming languages such as Python, Java, or Go.
• Familiarity with cloud platforms (AWS, Azure, Google Cloud) and containerization technologies (Docker, Kubernetes).
• Experience with data processing frameworks such as Apache Spark or Hadoop.
• Excellent problem-solving skills and ability to work in a fast-paced environment.

Technologies & Tools

The position of Distributed Systems Engineer at DeepRec.ai will primarily involve the use of various cutting-edge technologies and tools including but not limited to: Apache Spark for big data processing, Docker and Kubernetes for container orchestration, Python for scripting and API development, and cloud services such as AWS, Azure, or Google Cloud. You will also engage with machine learning frameworks and tools like TensorFlow and PyTorch to facilitate efficient model training in distributed environments.

Ideal Candidates

The ideal candidates for this role will exhibit a strong foundational knowledge in both distributed systems and machine learning technologies. They will demonstrate a passion for innovation and possess the ability to tackle complex technical challenges. A collaborative mindset, coupled with excellent communication skills, will be critical for effectively working with diverse teams. Additionally, individuals who are proactive learners, able to adapt to new technologies and approaches, will thrive in the dynamic environment at DeepRec.ai.