EXL Logo

EXL

GenAI / Agentic Architect

Posted Yesterday
Be an Early Applicant
Remote
Hiring Remotely in United States
200K-280K Annually
Expert/Leader
Remote
Hiring Remotely in United States
200K-280K Annually
Expert/Leader
Lead enterprise GenAI strategy and architecture across the 7-layer LLM stack. Advise C-suite, design scalable ingestion and RAG/agentic pipelines, implement observability (token tracing, drift/hallucination monitoring), enforce data protection/DLP and semantic caching, and oversee large onshore client delivery and technology trade-off decisions.
The summary above was generated by AI

Direct the enterprise GenAI technology portfolio and lead large-scale, onshore client engagements. 

Act as a trusted senior technical architect and advisor to client leadership, bridging the gap between cutting-edge AI capabilities and core business transformation. 

Oversee multiple architectural delivery streams, making high-impact decisions on technology stacks, framework selection, and infrastructural trade-offs across the 7-layer AI stack.

Responsibilities
  • Enterprise AI Strategy & Trade-Off Analysis: Define multi-year GenAI roadmaps by evaluating structural architecture trade-offs across the 7-layer LLM stack. Compare Commercial APIs (e.g., GPT-4o, Claude 3.5 Sonnet) vs. Hosted Open-Source LLMs (e.g., Llama 3) based on cost, latency, and data privacy.
  • Advanced Architecture Oversight: Review and approve macro-level AI architectures. Architect scalable data ingestion pipelines, selecting between standard semantic RAG, Agentic RAG, or GraphRAG depending on enterprise complexity.
  • Advanced Observability & Monitoring: Design deeply integrated AI observability (OBS) layers tailored for LLMs. Implement specialized tools (e.g., LangSmith, Phoenix, Arize) to track token consumption, trace complex agentic reasoning loops, and monitor model drift and hallucination rates in production.
  • Robust Data Protection Strategy: Architect comprehensive data protection pipelines utilizing Enterprise Data Loss Prevention (DLP) tools. Ensure data is sanitized before hitting external APIs and implement robust semantic caching to prevent sensitive data leakage.
  • Executive Consulting & Technical Pitching: Lead onshore client-facing engagements, pitching complex AI solutions to C-suite stakeholders, translating engineering trade-offs into clear financial and operational ROI frameworks.
Qualifications
  • Consulting Skills: High-impact executive presence; extensive experience in technology consulting, solution scoping, and technical proposal architecture.
  • Senior Technical Architecture Mastery: Deep hands-on background in enterprise integration patterns. Expert-level capability in comparing orchestration layers (e.g., LangChain vs. LlamaIndex vs. Semantic Kernel) and evaluating modern execution environments (vLLM, TensorRT-LLM).
  • Cloud & Vector Strategy: Deep familiarity with dictating enterprise data storage choices by comparing managed vector services (Pinecone) vs. distributed open-source engines (Milvus/Qdrant) or extending existing relational systems (pgvector).
  • Qualifications: Master’s in computer science, AI, or IT Management; 12–18 years of progressive IT/AI experience, heavily indexing on senior technical architecture and client delivery.

The typical base pay range for this role across the U.S. is USD $200,000 - $280,000 per year.

For more information on benefits and what we offer please visit us at https://www.exlservice.com/us-careers-and-benefits


The posted range is the hiring range for this role — a subset of the broader range available to employees over time — and reflects base salary across our national hiring scale.

Final offers are based on several factors, including the candidate's skills and experience, internal pay equity, work location, market conditions for the role, and the specific scope and responsibilities of the position.


The top of the range is reserved for candidates who notably exceed the requirements; the lower end applies to those with less experience or fewer preferred qualifications. For positions based in higher-cost zones (e.g., California, New York, New Jersey), actual compensation may exceed the posted range; your recruiter will share specifics during the process.

Similar Jobs

3 Days Ago
In-Office or Remote
3 Locations
184K-357K Annually
Senior level
184K-357K Annually
Senior level
Artificial Intelligence • Computer Vision • Hardware • Robotics • Metaverse
Design and deploy AI applications for telecommunications networks, focusing on generative models and infrastructure improvements, while providing technical guidance and building enterprise solutions.
Top Skills: SparkC++ElasticsearchMorpheusNemoNoSQLNvidia Data Acceleration SdksPandasPythonPyTorchRapidsSQL
29 Minutes Ago
Remote or Hybrid
United States
137K-174K Annually
Senior level
137K-174K Annually
Senior level
Artificial Intelligence • Consumer Web • Edtech • Enterprise Web • HR Tech • Social Impact • Generative AI
Lead category-level growth initiatives from diagnosis through execution to improve revenue, paid conversion, retention, and LTV. Analyze portfolio performance, prioritize high-impact opportunities, design experiments and operating mechanisms, and drive cross-functional teams to deliver measurable business outcomes and scalable decision frameworks.
Top Skills: SQL
30 Minutes Ago
Remote or Hybrid
United States
132K-166K Annually
Senior level
132K-166K Annually
Senior level
Artificial Intelligence • Consumer Web • Edtech • Enterprise Web • HR Tech • Social Impact • Generative AI
The Senior Data Scientist partners with Customer Success to perform deep-dive analyses, diagnose metric shifts, build predictive models (churn/upsell), apply causal inference and experimentation, measure business impact, and develop AI/LLM solutions. Responsibilities include self-serving across the data stack for extraction, pipelining, and dashboards, defining KPIs, and delivering actionable insights to reduce churn, drive revenue, and improve operational efficiency.
Top Skills: Ai/LlmAirflowDbtPythonSigmaSQLTableau

What you need to know about the Chicago Tech Scene

With vibrant neighborhoods, great food and more affordable housing than either coast, Chicago might be the most liveable major tech hub. It is the birthplace of modern commodities and futures trading, a national hub for logistics and commerce, and home to the American Medical Association and the American Bar Association. This diverse blend of industry influences has helped Chicago emerge as a major player in verticals like fintech, biotechnology, legal tech, e-commerce and logistics technology. It’s also a major hiring center for tech companies on both coasts.

Key Facts About Chicago Tech

  • Number of Tech Workers: 245,800; 5.2% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: McDonald’s, John Deere, Boeing, Morningstar
  • Key Industries: Artificial intelligence, biotechnology, fintech, software, logistics technology
  • Funding Landscape: $2.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Pritzker Group Venture Capital, Arch Venture Partners, MATH Venture Partners, Jump Capital, Hyde Park Venture Partners
  • Research Centers and Universities: Northwestern University, University of Chicago, University of Illinois Urbana-Champaign, Illinois Institute of Technology, Argonne National Laboratory, Fermi National Accelerator Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account