Permute Logo

Permute

Senior Data Engineer

Posted 15 Days Ago
In-Office
Chicago, IL, USA
180K-280K Annually
Senior level
In-Office
Chicago, IL, USA
180K-280K Annually
Senior level
Build and operate scalable data pipelines, ingestion, transformation, and storage to support LLMs and ML systems. Create tooling for data quality, monitoring, and observability. Collaborate with engineering, product, and ML teams to enable experimentation, training, evaluation, and reliable production AI features in a fast-moving startup.
The summary above was generated by AI

Senior Data Engineer – AI Systems
Employment Type: Full-time
Company: Permute (www.permute.ai)

Overview

Permute is seeking a Senior Data Engineer to design, build, and operate the data infrastructure that powers production AI systems. This role is for builders who move quickly, think clearly in ambiguous situations, and take ownership of turning messy data and evolving requirements into reliable, scalable systems.

We care as much about how you think and build as we do about your background. The ideal candidate is someone who can reason through new data problems, prototype quickly, and build robust pipelines and infrastructure in a fast-moving startup environment.

Responsibilities
  • Design and build scalable data pipelines and infrastructure supporting AI and ML systems

  • Develop and maintain data ingestion, transformation, and storage systems for large-scale datasets

  • Build data platforms that support LLM systems, agent workflows, and model evaluation

  • Develop tooling for data quality, validation, monitoring, and observability

  • Collaborate with engineering, product, and ML teams to deliver data systems that power AI features

  • Design systems that enable efficient experimentation, training, and evaluation of models

  • Optimize performance, reliability, and scalability of data infrastructure

  • Operate effectively in ambiguous, rapidly evolving startup environments

Required Qualifications
  • Strong background in data engineering and distributed systems

  • Experience building scalable data pipelines and data platforms

  • Strong foundation in algorithms, statistics, and data modeling

  • Proficiency with Python and modern data infrastructure tools

  • 5+ years building and operating systems in AWS environments

Preferred Background
  • Degree in Mathematics, Physics, Computer Science, or a related technical field

Experience with:

  • End-to-end production data platforms

  • Streaming and batch data processing systems

  • Data infrastructure supporting ML training, MLOps, evaluation, and deployment

  • Data quality, monitoring, and observability systems

  • Infrastructure supporting AI or LLM-powered applications

Similar Jobs

Yesterday
Hybrid
2 Locations
113K-188K Annually
Senior level
113K-188K Annually
Senior level
eCommerce • Information Technology • Retail • Industrial
Designs and operates scalable batch and streaming data pipelines and AI-ready data products across Databricks, Snowflake, Kubernetes, and cloud services. Develops governed data assets, semantic models, search and retrieval capabilities, and data quality processes. Supports Snowflake Cortex and Databricks initiatives, production troubleshooting, orchestration, performance optimization, CI/CD, and observability. Partners with business and technical teams on roadmaps and adoption, evaluates AI-assisted engineering tools, mentors engineers, and establishes reusable platform patterns.
Top Skills: AisqlAmazon AthenaAmazon DynamodbAmazon S3Apache AirflowAWSAws GlueAws LambdaBashClaudeClaude CliCortex AgentsCortex AnalystCortex CodeCortex SearchCortex SenseDatabricksDatabricks RuntimeDatabricks WorkflowsDelta LakeDockerGitGithub ActionsGithub CopilotGitlab Ci/CdGraph DatabasesJenkinsKubernetesLakeflow JobsLuigiNoSQLPythonRelational DatabasesScalaSnowflakeSparkUnity CatalogUnix ShellVector DatabasesWindows Shell
10 Days Ago
Hybrid
Chicago, IL, USA
150K-187K Annually
Senior level
150K-187K Annually
Senior level
Logistics • Sales • Software • 3PL: Third Party Logistics
Build and lead the data engineering ecosystem supporting analytics, BI, and data science. Design scalable pipelines, cloud infrastructure, Snowflake data warehouses, governance controls, validation frameworks, and machine learning workflows. Collaborate with engineering, data science, product, and business stakeholders on architecture and technology decisions. Develop AI agents and secure enterprise AI integrations, participate in on-call and incident management, document standards, and mentor data engineers.
Top Skills: Amazon RedshiftApache AirflowApache KafkaBigQueryCi/CdClaudeCursorData ContractsDatabricksDbtDomain-Driven DesignGeminiLanggraphMicroservicesAzurePower BIPythonSlackSnowflakeSnowflake Cortex AiSQL
4 Days Ago
Easy Apply
Remote or Hybrid
United States
Easy Apply
140K-160K Annually
Senior level
140K-160K Annually
Senior level
AdTech • Artificial Intelligence • Marketing Tech • Software • Analytics
Build, deploy, and operate production-grade data pipelines and data products for healthcare audiences. Design transformations, data models, and governed views using Python, SQL, Airflow, S3, Snowflake, and EMR. Implement data-quality, monitoring, and privacy-by-design controls for PHI/PII. Partner with product, analytics, and platform teams to onboard sources, support audience discovery, segmentation, activation, measurement, and troubleshoot production issues.
Top Skills: Amazon EmrAmazon S3Apache AirflowAthenaHivePythonSnowflakeSQL

What you need to know about the Chicago Tech Scene

With vibrant neighborhoods, great food and more affordable housing than either coast, Chicago might be the most liveable major tech hub. It is the birthplace of modern commodities and futures trading, a national hub for logistics and commerce, and home to the American Medical Association and the American Bar Association. This diverse blend of industry influences has helped Chicago emerge as a major player in verticals like fintech, biotechnology, legal tech, e-commerce and logistics technology. It’s also a major hiring center for tech companies on both coasts.

Key Facts About Chicago Tech

  • Number of Tech Workers: 245,800; 5.2% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: McDonald’s, John Deere, Boeing, Morningstar
  • Key Industries: Artificial intelligence, biotechnology, fintech, software, logistics technology
  • Funding Landscape: $2.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Pritzker Group Venture Capital, Arch Venture Partners, MATH Venture Partners, Jump Capital, Hyde Park Venture Partners
  • Research Centers and Universities: Northwestern University, University of Chicago, University of Illinois Urbana-Champaign, Illinois Institute of Technology, Argonne National Laboratory, Fermi National Accelerator Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account