AssemblyAI Logo

AssemblyAI

Senior Software Engineer, Inference

Posted 7 Days Ago
Be an Early Applicant
In-Office
Chicago, IL, USA
190K-225K Annually
Senior level
In-Office
Chicago, IL, USA
190K-225K Annually
Senior level
Design and ship customer-facing APIs exposing AI model capabilities, scale inference infrastructure, and productionize research techniques for reliable, low-latency production traffic. Collaborate with researchers, applied engineers, and customers to improve products and research direction. Contribute across backend services, inference infrastructure, SDKs, and internal tooling.
The summary above was generated by AI
Why AssemblyAI

AssemblyAI builds the best-in-class Voice AI models powering the next generation of voice applications. Our models serve 600M+ inference calls monthly, process 1M+ hours of audio daily, and power 2 billion+ end-user experiences. The Voice AI space is at an inflection point; we’re looking for folks truly excited to join a small team and help define the future of the industry.

We are one of the most capital-efficient AI companies on the planet - with under 100 people generating roughly $500K ARR per employee, we sit among the top 5 most revenue-dense teams within the fastest-growing AI companies today. That's not an accident; it's a deliberate choice to stay lean, move fast, and give every person on the team outsized ownership and impact. With thousands of customers including Granola, Fireflies, Figure AI, and CallRail, the company has real scale - processing over 2 million hours of audio daily and handling more than 1 million API calls every day. This is a rare growth-stage opportunity where the business is proven and the trajectory is steep, but the team is still small enough that your fingerprints are on everything.

If you've ever felt buried under layers of bureaucracy, starved of real ownership, or frustrated watching your work disappear into a slow-moving org, AssemblyAI is built differently. The company operates as a true meritocracy, with no heavy planning or approval processes and no gatekeeping on the tools or information you need. For anyone who genuinely cares about voice AI, not as a trend to chase, but as a technology to build,  this is the place where the most interesting problems at the most interesting scale are being solved by a team small enough that you'll actually know everyone's name.

We’re committed to creating a space where our employees can bring their full selves to work and have equal opportunity to succeed. No matter your race, gender identity or expression, sexual orientation, religion, origin, ability, age, veteran status, if joining this mission speaks to you, we encourage you to apply!

About the role:

We're hiring a Software Engineer to help turn cutting-edge AI research into products our customers rely on every day. You'll sit on a fast-paced engineering team between our research org and our Applied teams, taking new model capabilities from proof of concept to robust, well-documented APIs serving production traffic at scale.

What You’ll Do:
  • Design and ship customer-facing APIs that expose new model capabilities, owning them from prototype through launch and ongoing iteration.
  • Scale inference infrastructure to support our 1M+ api users
  • Partner with researchers to productionize new techniques. For example, turning a notebook or POC into something with the latency, reliability, and ergonomics customers expect.
  • Work with our customers and Applied teams to understand how users are building with our products, and feed that back into product design and research direction.
  • Contribute across the stack as needed: backend services, inference infrastructure, SDKs, internal tooling.
What You’ll Need:
  • Strong backend engineering experience, including building and supporting machine learning infrastructure and/or customer-facing APIs in production.
  • Comfort operating with ambiguity. Research timelines and product timelines don't always line up, and you're energized rather than frustrated by that.
  • Genuine curiosity about AI/ML. You don't need to be a researcher, but you should want to understand what the models are doing well enough to make good engineering decisions around them.
  • Strong collaboration skills. You'll be working daily with researchers, applied engineers, and sometimes customers, people with very different contexts and priorities, and the role only works if you enjoy that.

Pay Transparency:

AssemblyAI strives to recruit and retain exceptional talent from diverse backgrounds while ensuring pay equity for our team. Our salary ranges are based on paying competitively for our size, stage, and industry, and are one part of many compensation, benefit, and other reward opportunities we provide.

There are many factors that go into salary determinations, including relevant experience, skill level, qualifications assessed during the interview process, and maintaining internal equity with peers on the team. The range shared below is a general expectation for the function as posted, but we are also open to considering candidates who may be more or less experienced than outlined in the job description. In this case, we will communicate any updates in the expected salary range.

The provided range is the expected salary for candidates in the U.S. Outside of those regions, there may be a change in the range which will be communicated to candidates throughout the interview process.

Salary range: $190,000 - $225,000

AI to Interview:

If you’re selected for an interview, please review this resource to better understand how AssemblyAI approaches the use of AI in our interview process.

GDPR privacy notice:

Candidates from the EU should review this job applicant privacy notice before applying. 

Keep Exploring AssemblyAI:

Speech-to-text | Streaming speech-to-text | Speech Understanding | LLM Gateway
Try the Playground
Our $50M Series C fundraise
Check us out on YouTube!

Similar Jobs

3 Minutes Ago
Easy Apply
In-Office
Chicago, IL, USA
Easy Apply
Entry level
Entry level
Cloud • Enterprise Web • Sales • Software • Transportation
Generate and qualify sales opportunities through cold outreach, inbound lead response, discovery calls, and relationship building with trucking carriers. Collaborate with Account Executives on outreach and lead handoffs, develop expertise in Toro’s transportation management software and industry, understand competitors, and consistently achieve qualified-opportunity and sourced-ARR quotas. This is an in-office Chicago role designed for upcoming graduates beginning careers in software sales.
Top Skills: Transportation Management Software (Tms)
An Hour Ago
Remote or Hybrid
United States
191K-258K Annually
Expert/Leader
191K-258K Annually
Expert/Leader
Artificial Intelligence • Cloud • Information Technology • Sales • Security • Software • Cybersecurity
Architects and delivers foundational systems for an autonomous security investigation platform supporting MDR. Responsibilities include distributed data pipelines, query engines, orchestration, ML model infrastructure, scalability, reliability, observability, technical standards, design reviews, mentorship, and cross-team architecture. The role partners with ML, product, data science, and platform teams to solve complex technical problems across real-time security operations.
Top Skills: Amazon S3AWSData MeshDistributed Query EnginesDynamoDBEmbedding SystemsFlinkKafkaLlmsMl/Ai
4 Hours Ago
Remote or Hybrid
USA
170K-260K Annually
Expert/Leader
170K-260K Annually
Expert/Leader
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Lead product marketing strategy and go-to-market execution for Falcon Exposure Management. Develop positioning, messaging, launches, thought leadership, web strategy, and field enablement while partnering with product, sales, marketing, and executive teams. Translate cybersecurity capabilities into customer value and business outcomes, guide market education, analyze buyers and competitors, and strengthen CrowdStrike’s category leadership. The role requires deep exposure management expertise, strong cybersecurity knowledge, exceptional communication skills, and 12–15+ years of relevant experience.
Top Skills: AIB2B SaasCloud SecurityCybersecurityEnterprise SoftwareExternal Attack Surface ManagementFalcon Exposure ManagementIdentity SecuritySecurity OperationsVulnerability Management

What you need to know about the Chicago Tech Scene

With vibrant neighborhoods, great food and more affordable housing than either coast, Chicago might be the most liveable major tech hub. It is the birthplace of modern commodities and futures trading, a national hub for logistics and commerce, and home to the American Medical Association and the American Bar Association. This diverse blend of industry influences has helped Chicago emerge as a major player in verticals like fintech, biotechnology, legal tech, e-commerce and logistics technology. It’s also a major hiring center for tech companies on both coasts.

Key Facts About Chicago Tech

  • Number of Tech Workers: 245,800; 5.2% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: McDonald’s, John Deere, Boeing, Morningstar
  • Key Industries: Artificial intelligence, biotechnology, fintech, software, logistics technology
  • Funding Landscape: $2.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Pritzker Group Venture Capital, Arch Venture Partners, MATH Venture Partners, Jump Capital, Hyde Park Venture Partners
  • Research Centers and Universities: Northwestern University, University of Chicago, University of Illinois Urbana-Champaign, Illinois Institute of Technology, Argonne National Laboratory, Fermi National Accelerator Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account