Job Description
About the Company
About InCycle InCycle Software is a Microsoft Solutions Partner for Digital & App Innovation and Data & AI, and a GitHub Verified Partner. We work with enterprise and mid-market clients across the United States and Canada on four things: cloud strategy and governance, application modernization, modern engineering and DevOps, and data, analytics and AI, including agentic AI strategy and GenAI solution accelerators built on Azure AI Foundry. Our consultants are senior engineers first. They work in small teams on client engagements, often alongside Microsoft, and they are trusted to make technical decisions and see them through to production. We believe there is always a better way to build and deliver software, and we are hired to find it.
About the Role
Principal AI Architect, Azure & Agentic Systems Remote, United States (anywhere in the U.S., home office, occasional travel to clients and partner events) · Full-time, W-2 · Principal level, 8+ years · up to $200,000 base salary plus performance bonus
InCycle Software is hiring a Principal AI Architect to own the architecture behind a new generation of Azure-native AI and agentic systems for our enterprise clients. You will define how large language models, agent frameworks and Azure services come together into production platforms that hold up under real traffic, real data and real security reviews. This is a hands-on principal role: you set the technical direction, write the reference implementations the engineering teams build on, and make the calls that keep these systems reliable, secure, observable and affordable. The role You are the senior technical authority on AI and agentic work across InCycle's portfolio.
On client engagements, you lead the architecture from the first strategy session through the reference implementation and the handover, for platforms built on Azure AI Foundry, Azure OpenAI and the surrounding Azure services. Internally, you own the AI reference architectures, accelerators and standards the rest of the team delivers with, and you decide which parts of a fast-moving ecosystem InCycle adopts and which it waits out.
A typical engagement runs three to nine months and might be an agentic customer-service platform for a financial services client, a RAG system over a manufacturer's engineering documents, or an evaluation and guardrail layer added to an AI product a client already shipped and now cannot trust. You are the person the CTO sends into the room when a customer asks whether their agent architecture will survive contact with production. You report to the Practice Lead, Data & AI.
Responsibilities
- What you will do • Design end-to-end architecture for Azure-hosted AI platforms, including single-agent, multiagent and human-in-the-loop orchestration patterns, and decide when an agent is the right answer and when a plain workflow is.
- Lead solution design on Azure AI Foundry, Azure OpenAI and the Foundry Agent Service, with retrieval-augmented generation (RAG), Azure AI Search and vector indexing as first-class components rather than bolt-ons.
- Set the standards for prompt and tool orchestration, function calling, Model Context Protocol (MCP) integrations, agent memory, evaluation and guardrails, and make them real through templates and reference implementations.
- Architect the services around the models: AKS and Azure Container Apps, Azure Functions, API Management, Event Grid and Service Bus, Cosmos DB and Azure SQL, with identity on Entra ID and secrets in Key Vault.
- Build the operating layer that most AI projects skip: observability for LLM calls and agent traces, offline and online evaluation, cost and latency budgets, content safety and responsible-AI governance that would pass an enterprise security review.
- Own the cost, latency and reliability trade-offs of LLM inference and vector workloads at scale, including model selection, caching, batching, provisioned throughput and fallbacks.
- Partner with product, data and delivery leads to turn business goals into technical roadmaps that engineers can execute in weeks, not quarters.
- Mentor senior and staff engineers through design reviews, pairing and proofs of concept, and raise the bar for how the whole team builds with AI, including how it uses GitHub Copilot and agentic development tools itself.
- Represent the technical vision with customers and partners, including Microsoft, in architecture reviews, briefings and the occasional conference talk.
Qualifications
- Bachelor's degree in Computer Science or equivalent experience.
- Legal authorization to work in the United States.
- We do not sponsor visas for this role.
Required Skills
- What you bring • 8+ years in software engineering and architecture, with recent, hands-on delivery on Azure; you still write code and can show it.
- Proven experience architecting LLM or agentic systems that are in production today, serving real users, with the scars to prove it: hallucination handling, tool-call failures, runaway costs, prompt injection, evaluation drift.
- Deep command of the Azure platform: compute, networking, identity, data and the AI services, including Azure AI Foundry, Azure OpenAI, Azure AI Search and the content safety and monitoring tooling around them.
- Working knowledge of the current agent ecosystem: Semantic Kernel, AutoGen or the Microsoft Agent Framework, LangGraph or similar, and MCP, with the judgment to know which to adopt and which to skip.
- Strong command of at least one of C#/.NET, Python or TypeScript, with modern API design, containers, Kubernetes (AKS), CI/CD on GitHub or Azure DevOps, and infrastructure as code in Bicep or Terraform.
- Solid grasp of RAG, embeddings, chunking and retrieval quality, evaluation methods, and AI safety and guardrail practices, and the ability to explain them to a CISO as well as to an engineer.
- The presence to influence technical and executive audiences in writing and in the room, and the professionalism to represent InCycle in front of client leadership.
Preferred Skills
- Nice to have • Azure certifications such as AI-102 (Azure AI Engineer), AZ-305 (Solutions Architect Expert) or DP-100, or GitHub certifications.
- Experience with Microsoft Fabric, Azure Databricks or Azure Machine Learning, and with MLOps or LLMOps pipelines that promote models and prompts through environments.
- Experience running AI workloads under enterprise constraints: private endpoints, customer managed keys, data residency, SOC 2, HIPAA or FedRAMP.
- Prior consulting or professional services experience, or a track record as the architect a client team relied on during an AI program.
- A public footprint: talks, blogs, open-source contributions or reference implementations people actually use.
- Experience bringing GitHub
Most job openings for the size of the industry in August: professional and business services; private education and health care, 5 for every 100 jobs. Fewest: construction, 2.9. Compare industries →
View Similar Jobs
Similar jobs which you may be interested in. Typically using your existing skillset.