Job Description
About The Company
Certum Legal Solutions (CLS) is a pioneering legal managed services organization (MSO) dedicated to supporting mass-tort and single-event personal injury law firms. Our mission is to provide the operational infrastructure, technology, and back-office solutions that empower the firms on our platform to grow and scale efficiently while delivering industry-leading results for their clients. At CLS, we are innovating the legal services industry by building a proprietary, AI-native system designed to revolutionize how legal operations are conducted. This system integrates AI-powered agents to manage end-to-end workflows across the lifecycle of litigation matters, including critical back-office functions such as human resources, accounting, finance, and IT. Our greenfield build leverages a modern technology stack, designed from inception to be extensible and eventually productized for the broader legal services market. We are assembling a high-caliber team to create a unique solution that does not currently exist in the legal industry. If you are passionate about AI’s transformative potential in professional services and want your work to have a direct business impact, CLS offers an exceptional opportunity.
About The Role
The Applied AI/ML Engineer will own the intelligence layer of Project Interstellar, the core infrastructure that powers advanced document intelligence, conversational voice agents, multi-step task orchestration, and a variety of operational workflows. This role is focused on applied AI/ML engineering—not research—and requires building production-grade large language model (LLM) systems that operate reliably at scale within a HIPAA-regulated environment. You will collaborate closely with the Lead Backend Engineer to integrate AI capabilities into the platform architecture from the ground up. Key projects include developing a structured data extraction pipeline for complex legal documents, designing a model abstraction layer to optimize inference costs, creating an agent orchestration framework, and implementing quality assurance and training systems for AI outputs. This role offers the opportunity to build cutting-edge AI solutions that directly enhance operational efficiency and accuracy in the legal domain.
Qualifications
Certum Legal Solutions is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability status, protected veteran status, or any other characteristic protected by law.
Certum Legal Solutions (CLS) is a pioneering legal managed services organization (MSO) dedicated to supporting mass-tort and single-event personal injury law firms. Our mission is to provide the operational infrastructure, technology, and back-office solutions that empower the firms on our platform to grow and scale efficiently while delivering industry-leading results for their clients. At CLS, we are innovating the legal services industry by building a proprietary, AI-native system designed to revolutionize how legal operations are conducted. This system integrates AI-powered agents to manage end-to-end workflows across the lifecycle of litigation matters, including critical back-office functions such as human resources, accounting, finance, and IT. Our greenfield build leverages a modern technology stack, designed from inception to be extensible and eventually productized for the broader legal services market. We are assembling a high-caliber team to create a unique solution that does not currently exist in the legal industry. If you are passionate about AI’s transformative potential in professional services and want your work to have a direct business impact, CLS offers an exceptional opportunity.
About The Role
The Applied AI/ML Engineer will own the intelligence layer of Project Interstellar, the core infrastructure that powers advanced document intelligence, conversational voice agents, multi-step task orchestration, and a variety of operational workflows. This role is focused on applied AI/ML engineering—not research—and requires building production-grade large language model (LLM) systems that operate reliably at scale within a HIPAA-regulated environment. You will collaborate closely with the Lead Backend Engineer to integrate AI capabilities into the platform architecture from the ground up. Key projects include developing a structured data extraction pipeline for complex legal documents, designing a model abstraction layer to optimize inference costs, creating an agent orchestration framework, and implementing quality assurance and training systems for AI outputs. This role offers the opportunity to build cutting-edge AI solutions that directly enhance operational efficiency and accuracy in the legal domain.
Qualifications
- 5+ years of software engineering experience, including 2–3 years focused on production LLM application development
- Expert proficiency in Python programming and strong skills in API integration
- Experience deploying AI systems at production scale with a focus on reliability and security
- Deep familiarity with building reliable systems around LLM APIs such as Claude, GPT, or equivalents
- Experience with agent frameworks such as LangChain, LlamaIndex, or custom orchestration solutions
- Knowledge of Retrieval-Augmented Generation (RAG) architectures, including vector databases, embedding models, and retrieval optimization
- Strong prompt engineering discipline, including version control, systematic evaluation, A/B testing, and regression testing
- Experience handling sensitive or regulated data (HIPAA, FERPA, or similar compliance environments)
- Preferred: experience with document and text extraction from unstructured sources, OCR post-processing, or information extraction from clinical or legal documents
- Preferred: experience with conversational AI or voice AI systems, including natural language understanding (NLU), dialog management, and conversation evaluation
- Preferred: experience in legal or healthcare AI applications
- Preferred: multi-agent orchestration patterns and experience evaluating/scoring LLM outputs at scale
- Own the design and implementation of all AI/ML systems on the CLS platform
- Design and maintain prompt engineering infrastructure, including versioned prompts, A/B evaluation, and regression testing
- Build and iterate on structured data extraction pipelines for complex, regulated documents, covering parsing, multi-step reasoning, and output validation
- Design and develop the agent orchestration framework that powers task agents, quality assurance agents, and operational agents
- Establish AI quality standards such as confidence thresholds, human escalation triggers, and output validation protocols
- Collaborate with the Lead Backend Engineer on model abstraction layer design and API integration
- Partner with domain experts to define extraction schemas and workflow logic
- Ensure AI systems comply with regulatory requirements and maintain data security and privacy standards
- Competitive base salary ranging from $175,000 to $250,000 annually, based on experience and skillset
- Performance bonuses based on deliverables and KPIs, ranging from 10% to 20% of base salary
- Comprehensive medical, dental, and vision insurance plans
- Unlimited paid time off (PTO) plus company holidays
- 401(k) plan eligibility from day one with employer matching contributions
- Flexible remote or hybrid work schedule to support work-life balance
Certum Legal Solutions is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability status, protected veteran status, or any other characteristic protected by law.
No password to remember: you can log in with a link we email you. Log in →
View Similar Jobs
Matches Jobs
Similar jobs which you may be interested in. Typically using your existing skillset.