Full Time

Staff Applied AI Engineer

FUTURE MODERN
Full-time
Mid-Senior level
Technology, Information and Media
New York, NY
???* / year

Job Description

About the opportunity

Future Modern is partnering with a well-established, venture-backed B2B SaaS company that has more than a decade of product usage data across thousands of software teams. They’re building a new applied AI team from scratch to ship AI-native product intelligence: systems that connect what users do inside software with the code behind it and recommend improvements, with a human in the loop.

It’s not an AI layer bolted onto an existing product. The team moves fast, has high autonomy, and builds things without clear precedents. Applied AI engineers work closely with the company’s core software engineers to get products in front of customers.


What you’ll do

  • Design and build applied AI systems, including RAG pipelines, agentic workflows and LLM-powered features, from prototype through production
  • Decide when to prompt, when to fine-tune and when to use a different tool, and explain those tradeoffs to the team
  • Build evaluation frameworks, catch hallucinations early, and implement guardrails that hold up under real load
  • Own MLOps end to end: deployment, monitoring, latency, cost and reliability
  • Contribute full-stack when the product needs it
  • Partner with product and design to frame problems before writing code, and push back when the framing is wrong


What you bring

  • Deep hands-on experience shipping LLM-powered systems to production, including RAG, tool use and agent orchestration
  • Strong command of model evaluation and systematic hallucination mitigation
  • Solid understanding of modern model architectures and when to apply them
  • Production MLOps experience in a live environment
  • Strong full-stack fundamentals
  • Clear communication with engineers, product managers and executives
  • Product judgment: you ask “should we build this?” before “how do we build this?”


Nice to have

  • Fine-tuning experience and a point of view on when it beats prompting
  • Experience with LangChain, LlamaIndex, MCP or custom orchestration
  • A background in SaaS or product analytics
  • A founding, 0→1 or new-team launch on your resume


Compensation and benefits

  • $255,000–$276k base+ equity. Final offer depends on experience.
  • Employer-heavy health coverage ($0 premium options), strong 401(k) match, flexible time off


Logistics

  • NYC office 3 days a week
  • No visa sponsorship
  • No relocation assistance
  • This search is represented by Future Modern. The client is an equal opportunity employer and welcomes people of all backgrounds, experiences, abilities and perspectives.

Heard nothing since you applied? Our guide says when to follow up, how, and what to write. How to follow up →

View Similar Jobs

Matches Jobs

Similar jobs which you may be interested in. Typically using your existing skillset.