Senior Infrastructure Engineer - AI/ML Platform

This is a Fully Remote Job

About Our Client:

This organization operates in the health technology sector, focusing on developing reliable artificial intelligence products for legal applications. It addresses the challenge of integrating applied AI into production systems that support legal work, aiming to enhance efficiency and accuracy in this specialized field.

About the Opportunity:

The AI INFRASTRUCTURE / PRODUCT ENGINEER role is essential for advancing the deployment and operational stability of AI-driven solutions within the organization. This position is responsible for building evaluation systems, transforming research models into production workflows, and maintaining the backend infrastructure that supports these AI services. The role directly impacts the organization’s ability to deliver dependable AI tools that meet user requirements and product goals.

Responsibilities:

• Build repeatable benchmarks and evaluation pipelines for model accuracy, hallucinations, retrieval quality, latency, and cost
• Create dashboards to track system performance changes
• Convert research prototypes into production retrieval, drafting, document, and agent workflows
• Develop backend services, APIs, and internal tools to support testing and releases
• Deploy and operate cloud infrastructure, including monitoring, databases, and delivery pipelines
• Collaborate with AI research teams while aligning with product and user needs

Requirements:

• Minimum of 3 years experience in software, infrastructure, or product engineering with production system deployment
• Proficient in Python and experienced with cloud deployment
• Skilled in building evaluation pipelines, benchmarks, or assessment systems for machine learning or AI
• Familiar with APIs, databases, backend services, deployment pipelines, monitoring, and cloud operations
• Ability to convert experimental code and unclear concepts into maintainable products; experience with dashboards or monitoring systems
• Interest or experience in large language models, retrieval-augmented generation, agents, AI benchmarks, or document automation; full-stack experience is beneficial
• Knowledge of FastAPI, Docker, React, Next.js, Postgres, and vector databases is advantageous

Pay Range and Compensation Package:

• Annual base salary: $180,000 to $260,000 USD
• Visa sponsorship is not available

Equal Opportunity Statement: Our client is an equal opportunity employer. They celebrate diversity and are committed to creating an inclusive environment for all employees. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, or national origin.

Note:

TalentHop is a recruitment partner of this role. Please note that all employment decisions, including candidate assessment, interviews, hiring, compensation, and employment terms, are made exclusively by the hiring employer.