Software Engineer, Sr. (AI Infra + Systems) - Remote

About the Company

The company is a well-funded, early-stage AI startup focused on redefining how users interact with intelligent systems. It is building a new AI platform and expanding its services with a team of experienced engineers.

About the Role

The company is seeking an experienced backend engineer to improve the performance, reliability, and efficiency of its AI-powered applications while expanding its model-serving capabilities.

This role focuses on backend engineering, distributed systems, and production AI infrastructure. You will work on optimizing model inference, reducing latency, improving system performance, and evaluating opportunities to transition from managed AI services to self-hosted models.

Key Responsibilities

• Develop and optimize production microservices using Python and Scala to support AI integrations, application APIs, and distributed backend systems.
• Identify and resolve performance bottlenecks involving latency, concurrency, throughput, and resource utilization across high-traffic applications.
• Evaluate and implement model-serving architectures, including self-hosted inference, GPU utilization, autoscaling, and cost optimization.
• Manage the performance, monitoring, deployment, and operational health of AI services running in Kubernetes.
• Collaborate with engineering teams to improve system architecture, measure performance, and deliver scalable AI capabilities.

Required Qualifications

• At least 5 years of relevant experience.
• Strong backend development skills with Python and Scala.
• Experience designing, developing, and maintaining distributed systems and production microservices.
• Hands-on experience with Kubernetes, containerized applications, and cloud infrastructure.
• Ability to diagnose and resolve performance bottlenecks involving latency, concurrency, and system throughput.
• Experience deploying or operating machine learning models through production APIs, with an understanding of inference performance.
• Practical knowledge of MLOps principles related to model serving, monitoring, deployment, and operational reliability.
• Familiarity with LLM-powered applications and the backend architecture supporting generative AI systems.
• Strong understanding of production observability, including logging, metrics, tracing, and performance monitoring.

Location and Work Arrangement

Fully remote position.

Salary and Benefits

• Annual salary: $170,000–$200,000.
• Competitive compensation.
• Equity.
• Healthcare benefits.
• Fully remote work.
• Autonomy and opportunities for career growth and advancement.
• Opportunity to work with a well-funded startup and an experienced engineering team.

Equal Employment Opportunity

Jobot is an Equal Opportunity Employer. The company provides an inclusive work environment that celebrates diversity and considers all qualified candidates without regard to race, color, sex, sexual orientation, gender identity, religion, national origin, age (40 and over), disability, military status, genetic information, or any other basis protected by applicable federal, state, or local laws.

Jobot prohibits harassment of applicants or employees based on these protected categories and complies with applicable federal, state, and local laws regarding consideration of unemployment status in hiring decisions.

Background checks may be conducted with candidate authorization. Jobot considers qualified candidates with criminal histories in accordance with applicable laws, including the Los Angeles Fair Chance Initiative for Hiring and the San Francisco Fair Chance Ordinance.

Information collected through candidate profiles and job applications is subject to Jobot's Privacy Policy, California Worker Privacy Notice, and Notice Regarding Automated Employment Decision Tools, available at jobot.com/legal.

By applying, candidates agree to receive calls, AI-generated calls, text messages, or emails from Jobot, its agents, and contracted partners. Message frequency varies, and message and data rates may apply. Candidates can reply STOP to cancel and HELP for assistance.