Role Summary

We are seeking a Senior AI Engineer specialized in Microsoft Azure to lead the design, development, and deployment of agentic AI systems and enterprise-grade GenAI platforms. You will serve as a technical leader—defining architecture patterns (including Model Context Protocol – MCP), building RAG and LLMOps foundations, and ensuring solutions meet financial-services-grade security, compliance, and reliability standards.

Key Responsibilities

Agentic AI Architecture & Development

• Design and implement agentic AI solutions (autonomous workflows, multi-agent systems, tool-use) using Azure OpenAI / Azure AI Studio and Semantic Kernel/Lang Chain/Lang Graph.

• Define and enforce architecture patterns for agents, tools, memory, and MCP integrations.

• Implement schema-constrained prompting, output validation, and guardrails to reduce hallucinations and enforce safety.

GenAI Pipelines & RAG

• Build modular pipelines for ingestion, transformation, and orchestration across LLMs, embedding services, vector stores, SQL sources, and APIs.

• Develop hybrid RAG using Azure AI Search (vector & hybrid) plus structured sources (e.g., Azure SQL/SQL MI, Synapse, APIs).

• Implement post-retrieval re-ranking, chunking strategies, feedback/DPO-based ranking, and caching (KV) for latency & cost control.

• Monitor performance and quality with Langfuse/Prompt Flow traces, Azure Monitor, and Prometheus/Grafana.

AI Platform & Services

• Architect platform components: embedding pipelines, vector stores (Azure AI Search vectors, Cosmos DB with vector support, Redis/pgvector on Azure), document intelligence (Azure Document Intelligence / OCR), and metadata extraction.

• Define API standards and integration patterns (REST/GraphQL/gRPC) backed by Azure API Management.

Cloud Architecture & Infrastructure (Azure-first)

• Lead cloud architecture on Azure for scalability, security, and cost: AKS, Azure Functions, Event Hubs (Kafka-compatible), Service Bus, Data Lake Storage Gen2, Blob Storage, Key Vault, Private Link/VNet.

• Productionize models using Azure Machine Learning (model registry, managed endpoints, Prompt Flow, MLflow integration).

• Establish infrastructure standards for containerization (Docker), orchestration (AKS / ARO-OpenShift), monitoring, and MLOps/LLMOps.

Engineering Excellence & Leadership

• Lead design reviews, code reviews, and CI/CD (GitHub Actions or Azure DevOps) with automated prompt tests, guardrail tests, and regression suites.

• Mentor AI engineers; build internal best practices and knowledge assets.

• Define SLOs/SLAs and implement proactive alerting, rate-limits, and fallbacks.

Stakeholder & Governance

• Translate business requirements into technical designs with AI Product Owners and domain stakeholders.

• Partner with Security, Risk, and Enterprise Architecture on standards, privacy, and Responsible AI practices (e.g., Azure Content Safety).

Required Skills & Qualifications

Education

• Bachelor’s/master’s in computer science, AI/ML, Data/Software Engineering, or related field.

Experience

• 10+ years in software/data/ML engineering, including hands-on production delivery of AI/ML solutions.

• 3+ years delivering GenAI/LLM and RAG systems in production (Azure preferred).

• Proven leadership of complex technical initiatives in enterprise or financial services environments.

Technical Skills (Azure-Focused)

• LLMs & GenAI: Azure OpenAI (GPT, vision, embeddings), model selection, prompt engineering, function/tool calling, LLMOps (prompt versioning, evaluation, output validation).

• Orchestration: Semantic Kernel, Lang Chain/LangGraph, tool routing, multi-hop workflows, MCP.

• RAG & Vectors: Azure AI Search (hybrid+vector), Cosmos DB vectors/Redis/pgvector, FAISS/Qdrant (self-hosted on AKS).

• Data & Ingestion: Azure Document Intelligence (Form Recognizer/OCR), Cognitive Services, Azure Data Factory/Synapse pipelines, APIs/SQL; layout-aware parsing & chunking.

• MLOps: Azure ML (registries, pipelines, endpoints), MLflow, feature/model/version management, A/B and shadow deployments.

• Cloud & Infra: AKS/ARO, Docker, Event Hubs (Kafka), Service Bus, Functions, API Management, Key Vault, Monitor, Log Analytics, Application Insights, Managed Identities, VNet/Private Link.

• Programming: Python (advanced); experience with Transformers, Sentence Transformers, PyTorch.

• Services & APIs: REST/gRPC design, auth (Entra ID/OAuth2), RBAC, multi-tenant patterns; caching and rate limiting.

• Observability: Azure Monitor, Prometheus/Grafana, Langfuse or equivalent.

Industry & Governance

• Experience in financial services with understanding of regulatory, model risk management, security, privacy, and auditability requirements.