Top Tech Jobs & Startup Jobs in Chicago, IL

Reposted 17 Days AgoSaved
Hybrid
Chicago, IL, USA
148K-240K Annually
Entry level
148K-240K Annually
Entry level
Artificial Intelligence • Cloud • Internet of Things • Software • Cybersecurity • Industrial • Industrial Equipment
Leads an AI Evaluation Engineering team responsible for validating generative AI products, including intelligent agents and digital assistants. Provides technical direction, manages team performance and development, owns product quality, and establishes engineering best practices. The role requires expertise in GenAI architecture, evaluation methodologies, observability, automated testing, cloud and edge environments, reliability, safety, RAG assessment, and human-in-the-loop validation.
Top Skills: A2AAgentic SystemsAi ObservabilityAmazon BedrockAmazon SagemakerArizeAutomated TestingAWSAzureAzure Ai FoundryBlue-Green DeploymentsCanary DeploymentsCi/CdDeepevalEmbeddingsFeature FlagsGCPGenerative AiHumanloopLangchainLangfuseLanggraphLangsmithLlmsLoraMcpMultimodal ModelsPhoenixPrompt EngineeringRagRagasReal-Time ModelsSlmsSnowflake CortexSpeech ModelsTelemetryVector Databases
New

Track Smarter, Apply Better.

Ditch the spreadsheets. Organize your job search with our freeApplication Tracker.

Use For Free
Application Tracker Preview
All Filters
JobType
New Jobs
Job Category
Experience
Industry
Company Name
Company Size

Sign up now Access later

Create Free Account