InMarket Logo

InMarket

Senior Data Engineer

Posted 2 Hours Ago
Remote
Hiring Remotely in USA
140K-175K Annually
Senior level
Remote
Hiring Remotely in USA
140K-175K Annually
Senior level
Design, build, and optimize ETL pipelines and data platform architecture using Airflow, BigQuery, Python, and Spark. Lead technical decisions, mentor engineers, collaborate with product and stakeholders, and improve data-quality and testing frameworks to support data-driven products.
The summary above was generated by AI

About InMarket

Since 2010, InMarket has been the leader in 360-degree consumer intelligence and real-time activation for thousands of today's top brands. Through InMarket's data-driven marketing platform, brands can build targeted audiences, activate media in real time, and measure success in driving return on ad spend. InMarket's proprietary Moments offering outperforms traditional mobile advertising by 6x.* Our LCI attribution platform, which won the MarTech Breakthrough Award for Best Advertising Measurement Platform, was validated by Forrester to drive an average of $40 ROAS for our clients.

*Source: Wordstream US Google Display Benchmarks for Mobile Media

About the Role

We are looking for a talented Senior Data Engineer to join the team that builds the essential data infrastructure at the heart of InMarket's product suite. You should be a quick learner who is enthusiastic about learning new technologies, and a passionate engineer who empowers fellow engineers to write clean and efficient data pipelines. You will implement technical solutions to empower internal and external customers and scale the existing data platform, working closely with end users to define key business questions, leading fellow engineers to define technical solutions, and partnering with Product Managers to build the data sets that answer those questions. You will work with huge datasets and build ETLs that bring data together to answer business questions, drive reporting, and fuel growth.

Core Areas of Responsibility

Pipeline Development & Architecture

  • Design and implement ETL pipelines in Apache Airflow, BigQuery, Python, and Spark to transform upstream source data into curated data assets used across InMarket's data-driven products

  • Architect and plan projects involving highly distributed, high-performance data platform systems

  • Identify areas for improvement in existing pipelines and processes

  • Understand business requirements and convert them into technical solutions

Technical Leadership & Best Practices

  • Stay current with and advocate internally for Data Engineering best practices, technologies, and testing frameworks that shape InMarket's technical future

  • Provide technical guidance to other engineers to help grow their knowledge and technical capabilities

  • Lead fellow engineers in defining technical solutions to business problems

Cross-Functional Collaboration

  • Work closely with end users to define key business questions, and with Product Managers to build the data sets that answer them

  • Communicate complex concepts and analysis results clearly and effectively to Product and Engineering Managers

Impact & Success Indicators

In your first 90 days:

  • Onboard onto InMarket's data stack (Airflow, BigQuery, Python, Spark) and ship your first ETL pipeline improvement or fix

  • Build working relationships with Product Managers and engineering peers across the data team

  • Develop fluency in InMarket's existing data architecture and identify at least one improvement opportunity in current pipelines

  • Actively participate in code reviews and adopt the team's engineering best practices


In your first year:

  • Design and deliver end-to-end ETL pipelines that power one or more of InMarket's data-driven products

  • Serve as a technical mentor, raising the skill level and pipeline quality of fellow engineers

  • Lead architecture decisions for a highly distributed, high-performance data platform initiative

  • Establish or improve a testing and data-quality framework adopted across the team


We're Looking for Someone With

  • Strong SQL experience

  • Expertise in at least one data pipelining orchestration framework (Airflow, Luigi, etc.)

  • Experience building ETL pipelines

  • Strong software engineering skills in an object-oriented language such as Java or Python

  • Experience building and optimizing a data warehouse on a major cloud platform (BigQuery preferred but not required)

  • Deep understanding of Big Data technologies such as Hadoop and Spark

  • Experience building and optimizing large-scale, high-performance systems

  • Extensive knowledge of data-related tools and architecture concepts on a major cloud platform

  • Knowledge of Kubernetes, Docker, Airflow, Git, and CI/CD best practices

  • Strong collaboration and communication skills within and across teams

  • B.S. or M.S. in Computer Science or a related technical field

  • At least 4 years of software engineering experience, ideally in data engineering


Nice to have:

  • Experience optimizing BigQuery performance

  • Experience building a data governance platform in a regulated environment

  • Experience with various data testing frameworks and technologies

  • Familiarity with the digital media/advertising industry

Compensation & Benefits

For candidates in California, Colorado, New York City, Illinois, Minnesota, New Jersey, Vermont, Washington, and Massachusetts, the Targeted Base Salary Range for this role is $140,000 to $175,000.

Actual salaries will vary depending on factors including, but not limited to, work experience, specialized skills and training, performance in the role, business needs, and job requirements. Base salary is subject to change and may be modified in the future. Base salary is just one component of InMarket's total rewards package, which may also include bonuses, equity, and benefits. Ask your recruiter for more information!

Additional perks and benefits:

  • Competitive salary and stock options

  • Flexible vacation / Unlimited PTO (within reason)

  • Medical, dental, and Flexible Spending Account (FSA)

  • Company-matched 401(k)

  • Paid Paternity & Maternity Leave

  • Agile Development Program for continued learning and professional development

Equal Opportunity Employer

At InMarket, diversity is not just a value; it's the very essence of who we are. It's about recognizing and celebrating the unique perspectives each of us brings, from our colleagues to the communities we serve. We are committed to embracing the full spectrum of backgrounds, beliefs, abilities, and life experiences, knowing that this diversity strengthens us. At InMarket, our commitment to Diversity, Equity, and Inclusion means valuing each individual's unique contributions. Together, we thrive.

InMarket is an Equal Opportunity Employer (EOE). Qualified applicants are considered for employment without regard to age, race, color, religion, sex, national origin, sexual orientation, disability, or veteran status.

Privacy Notice for California Job Applicants: https://inmarket.com/ca-notice-for-job-applicants/

All applicants must be authorized to work for any employer in the U.S. We are unable to sponsor or take over sponsorship of an employment visa at this time.

#LI-Remote

InMarket Chicago, Illinois, USA Office

Chicago, United States

Similar Jobs

4 Hours Ago
In-Office or Remote
92K-164K Annually
Senior level
92K-164K Annually
Senior level
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Design, build, and maintain scalable ETL/ELT data pipelines and architectures across warehouses, lakes, and streaming environments. Ensure data governance, quality, and security. Lead delivery of analytics data products, optimize production systems, collaborate with stakeholders, and mentor junior data engineers.
Top Skills: Amazon RedshiftApache AirflowSparkAzureCi/CdDatabricksEtl/EltGitJavaKafkaLinuxPythonScalaSnowflakeSQL
13 Days Ago
Easy Apply
Remote or Hybrid
United States
Easy Apply
134K-203K Annually
Senior level
134K-203K Annually
Senior level
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Lead design and operation of large-scale data pipelines and data APIs. Build Spark/PySpark workflows on Databricks, optimize job performance, manage data quality and observability, and develop MCP servers and AI-agent integrations. Mentor engineers, define standards, support production incidents and on-call rotations, and collaborate with stakeholders to deliver scalable data platform products.
Top Skills: Apache IcebergApi GatewayAWSAws LambdaAws Rds/AuroraAzureDatabricksDatadogDbtFastapiFivetranGCPGoogle BigqueryLlms/Ai AgentsMcp ServersMs Sql ServerMySQLOraclePostgresPysparkPythonS3SecretsmanagerSnowflakeSnsSparkSplunkSQLSqs
2 Hours Ago
Remote
USA
175K-205K Annually
Senior level
175K-205K Annually
Senior level
Productivity • Software
Own end-to-end data pipelines (ingest, dbt transformations, BigQuery warehousing) and consolidate the analytics stack into a single source of truth. Build and maintain dbt models with tests and documentation, establish data quality and observability, own product analytics and instrumentation, partner with GTM and marketing on reporting, and prepare for high-volume/streaming ingestion.
Top Skills: BigQueryClickhouseDbtEtl/EltHevoOmniOpentelemetryPythonSegmentSQL

What you need to know about the Chicago Tech Scene

With vibrant neighborhoods, great food and more affordable housing than either coast, Chicago might be the most liveable major tech hub. It is the birthplace of modern commodities and futures trading, a national hub for logistics and commerce, and home to the American Medical Association and the American Bar Association. This diverse blend of industry influences has helped Chicago emerge as a major player in verticals like fintech, biotechnology, legal tech, e-commerce and logistics technology. It’s also a major hiring center for tech companies on both coasts.

Key Facts About Chicago Tech

  • Number of Tech Workers: 245,800; 5.2% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: McDonald’s, John Deere, Boeing, Morningstar
  • Key Industries: Artificial intelligence, biotechnology, fintech, software, logistics technology
  • Funding Landscape: $2.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Pritzker Group Venture Capital, Arch Venture Partners, MATH Venture Partners, Jump Capital, Hyde Park Venture Partners
  • Research Centers and Universities: Northwestern University, University of Chicago, University of Illinois Urbana-Champaign, Illinois Institute of Technology, Argonne National Laboratory, Fermi National Accelerator Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account