Base Operations Logo

Base Operations

Data Engineer

Posted 9 Days Ago
Remote
Hiring Remotely in United States
Mid level
Remote
Hiring Remotely in United States
Mid level
Build and maintain production ETL pipelines for structured and unstructured data, integrate machine learning models for enrichment, develop data transformations and quality monitoring, design warehouses and dimensional models, establish governance frameworks, and contribute to data architecture and platform improvements. Collaborate with data scientists, analysts, and engineering teams to deliver reliable, actionable intelligence.
The summary above was generated by AI

Base Operations - Data Engineer

Location: US-based, Remote

Who We Are:

Base Operations decodes the world’s threat landscape into actionable security insights that enable organizations to protect their people, assets, and operations. We empower security teams to better assess threats, manage risk across large footprints, and make data-driven decisions using granular, street-level intelligence.

As a category-creator in a growing market, we are looking for impact-driven individuals who are passionate about technology and are committed to helping our customers operate with efficiency and greater accuracy. We developed our technology at Harvard and MIT and use cutting-edge AI. The company is award-winning and backed by top-tier VCs. Our customers include some of the most sophisticated and relevant companies in the Fortune 500. Our team cares about solving hard problems, promoting transparency, encouraging growth in emerging markets, and empowering people to safely explore the world. We are a thoughtful, dedicated, and fun-loving group obsessed with disrupting the security intelligence industry and winning the loyalty of our customers.

Overview:

Base Operations is building the world’s largest dataset of global threat patterns and street-level intelligence. We are looking for an exceptional data engineer that can define, build, and mature the data pipelines, models, and warehouse to help us excel in this objective. This individual should have the technical acumen to contribute thought leadership relative to our architecture strategy, while also excelling at mapping that strategy into a tactical plan and executing against it.

RESPONSIBILITIES

You will:

  • Build, test, and maintain robust ETL pipelines for structured and unstructured data sources, including integration with ML models for data enrichment, with focus on production stability, performance optimization, and incident resolution

  • Develop data transformation, validation, and quality monitoring processes to ensure reliable and actionable data

  • Design and implement data warehouse solutions and data models to support analytics and reporting needs

  • Establish data quality frameworks with monitoring, alerting, and remediation processes

  • Contribute to overall data architecture decisions and lead implementation of data platform improvements

Required Experience
  • 3+ years experience building production data pipelines and working with modern data stack tools

  • 3+ years implementing and maintaining data warehouses and dimensional data models

  • Strong SQL skills and experience with data modeling best practices

  • Proficiency in Python for data engineering tasks

  • Experience with workflow orchestration and automation tools

  • Experience implementing data quality and governance practices

  • Strong collaboration skills working with data scientists, analysts, and engineering teams

Preferred Experience
  • Experience working with geospatial data

  • Working with large-scale datasets

  • Experience with web scraping

  • Understanding of ML and AI based infrastructure

  • Familiarity with JavaScript

In compliance with federal law, all persons hired will be required to verify identity and eligibility to work in the United States and to complete the required employment eligibility verification document form upon hire.

Base Operations champions diversity - we welcome and employ people regardless of race, color, ancestry, religion, gender, gender identity, genetic information, parental or pregnancy status, national origin, sexual orientation, age, citizenship, marital status, disability, or Veteran status. We are proud to be an equal opportunity employer.

Similar Jobs

2 Days Ago
In-Office or Remote
113K-193K Annually
Senior level
113K-193K Annually
Senior level
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Designs and leads scalable Azure data platforms, ETL/ELT pipelines, Spark workflows, AI integrations, and cloud applications. Responsibilities include data modeling, advanced SQL optimization, reliability improvements, API integration, AI-powered automation, architectural standards, stakeholder analysis, mentoring, and evaluating emerging technologies. The role uses Azure Databricks, Snowflake, Spark, Python, and modern software engineering practices to support analytics, machine learning, business intelligence, and healthcare data solutions.
Top Skills: Ai AgentsSparkAutomated TestingAzureAzure DatabricksAzure FunctionsAzure Service BusCi/CdGenerative AiGitGithub ActionsGraphQLInfrastructure As CodeLakebaseLlmsMicroservicesPysparkPythonRestSnowflakeSQLTerraformUnity Catalog
2 Days Ago
Remote or Hybrid
United States
160K-260K Annually
Expert/Leader
160K-260K Annually
Expert/Leader
Artificial Intelligence • Cloud • Payments • Software • Business Intelligence • Generative AI • Automation
Leads enterprise-scale data architecture across batch, streaming, warehouse, lakehouse, transactional, AI, and vector-store use cases. Establishes data quality, governance, lineage, observability, access-control, and reliability standards. Defines AI-enabled data engineering patterns, mentors engineers, resolves complex architecture issues, and influences cross-functional roadmaps. Requires hands-on technical leadership and 15+ years of software, data engineering, or architecture experience.
Top Skills: DbtGcp Bigquery
4 Days Ago
Remote or Hybrid
209K-262K Annually
Senior level
209K-262K Annually
Senior level
Fintech • Machine Learning • Payments • Software • Financial Services
Designs, builds, and operates scalable cloud data platforms, pipelines, and applications. Leads architecture decisions, data modeling, distributed and streaming workloads, and data engineering initiatives. Collaborates with product managers, engineers, analysts, and data scientists; evaluates platforms such as Snowflake and Databricks; establishes reusable engineering patterns; communicates technical outcomes; and mentors other engineers.
Top Skills: AirflowAWSAws GlueCassandraDagsterDatabricksDynamoDBEmrGCPJavaAzureMongoDBMonte CarloNosql DatabasesPythonRedshiftRelational DatabasesScalaSnowflakeSparkSplunkSQL

What you need to know about the Chicago Tech Scene

With vibrant neighborhoods, great food and more affordable housing than either coast, Chicago might be the most liveable major tech hub. It is the birthplace of modern commodities and futures trading, a national hub for logistics and commerce, and home to the American Medical Association and the American Bar Association. This diverse blend of industry influences has helped Chicago emerge as a major player in verticals like fintech, biotechnology, legal tech, e-commerce and logistics technology. It’s also a major hiring center for tech companies on both coasts.

Key Facts About Chicago Tech

  • Number of Tech Workers: 245,800; 5.2% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: McDonald’s, John Deere, Boeing, Morningstar
  • Key Industries: Artificial intelligence, biotechnology, fintech, software, logistics technology
  • Funding Landscape: $2.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Pritzker Group Venture Capital, Arch Venture Partners, MATH Venture Partners, Jump Capital, Hyde Park Venture Partners
  • Research Centers and Universities: Northwestern University, University of Chicago, University of Illinois Urbana-Champaign, Illinois Institute of Technology, Argonne National Laboratory, Fermi National Accelerator Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account