MeridianLink Logo

MeridianLink

Data Engineer

Posted 11 Days Ago
Remote
Hiring Remotely in US
95K-120K Annually
Mid level
Remote
Hiring Remotely in US
95K-120K Annually
Mid level
Design, build, and maintain scalable batch and near-real-time data pipelines and data products using Databricks and Spark. Integrate internal/external sources, implement data models, ensure data quality, support BI (Sisense), CI/CD, and collaborate with analysts, scientists, and stakeholders to enable analytics and decision-making.
The summary above was generated by AI

We are seeking an accomplished Data Engineer to join our rapidly growing team. This role is responsible for designing, building, and evolving scalable data pipeline architecture to ensure reliable, high-quality data delivery across the organization. The ideal candidate is a hands-on engineer with strong experience building and maintaining data pipelines, and a passion for delivering robust data solutions that enable analytics and business decision-making.

The Data Engineer will partner with data architects, data analysts, data scientists, and cross-functional stakeholders to deliver trusted data assets supporting a wide range of business initiatives. They will ensure efficient and reliable data delivery across multiple teams, systems, and products in a dynamic environment. This role offers the opportunity to evolve and enhance a modern data platform by improving existing pipelines or redesigning them for greater scalability, performance, and maintainability. The successful candidate will apply modern software engineering practices, including AI-assisted development tools, to improve productivity, code quality, and delivery speed while maintaining strong engineering standards.

RESPONSIBILITIES

• Design, develop, and maintain scalable data pipelines and data products for

internal and external consumers.

• Build and optimize batch and near real-time data ingestion, transformation, and

delivery processes.

• Integrate data from internal and external sources to support business, reporting,

and analytics requirements.

• Collaborate with data architects, analysts, data scientists, and business

stakeholders to deliver scalable data solutions and support Sisense dashboards

and analytics assets.

• Design and implement data models that support reporting, analytics, and

operational use cases.

• Ensure data quality, reliability, and performance through monitoring, validation,

automated testing, and troubleshooting.

• Write maintainable, well-documented, and testable code; participate in code

reviews; and leverage AI-assisted development tools to improve quality and

efficiency.

• Support CI/CD, infrastructure automation, technical documentation, and

continuous improvements to data architecture, tooling, and engineering practices

QUALIFICATIONS

• 2–4 years of professional experience in Data Engineering, Data Warehousing, or

related roles.

• Strong hands-on experience with Python and SQL for building scalable data

pipelines and transformation logic.

• Experience with Apache Spark, Parquet, and Azure Databricks, including

Databricks workflows, Delta Lake, Delta Sharing, and Unity Catalog.

• Strong SQL expertise including performance tuning, indexing, partitioning, query

optimization, and stored procedure development.

• Solid understanding of ETL/ELT methodologies, data warehousing principles,

and modern data engineering best practices.

• Experience designing and implementing data models to support analytics,

reporting, and operational use cases.

• Experience supporting or working with BI tools such as Sisense (or similar

platforms).

• Experience with CI/CD pipelines and version control practices (e.g., GitLab,

Jenkins, or equivalent).

• Experience working in fast-paced product environments with an emphasis on

delivery, maintainability, and minimizing technical debt.

• Strong communication skills with the ability to collaborate across technical and

non-technical stakeholders

BONUS QUALIFICATIONS

• Experience building lightweight data applications or internal tools using any of

the following frameworks such as Streamlit, Dash, Flask, Gradio, Shiny, or

Node.js.

• Ability to navigate ambiguity, prioritize effectively, and adapt to changing

business needs.

• Prior experience in financial services or regulated environments is a plus

Similar Jobs

3 Days Ago
Remote or Hybrid
113K-193K Annually
Senior level
113K-193K Annually
Senior level
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Design, build, and operate scalable data pipelines and AI-ready data products from large structured and unstructured sources (OCR/images/documents). Enable production Generative AI (RAG, semantic search), ensure data quality/observability, orchestrate CI/CD and infra-as-code, and mentor engineers while collaborating with product, analytics, and compliance teams.
Top Skills: AirflowAWSAzureChartjsDatabricksDatabricksDeequDelta LakeDockerEvent HubsGCPGithub ActionsGreat ExpectationsJavaKafkaKinesisKubernetesLlmOcrPlotlyPysparkPythonRagScalaSeabornSemantic SearchSnowflakeSparkSQLTerraform
11 Days Ago
Remote or Hybrid
Chicago, IL, USA
215K-250K Annually
Senior level
215K-250K Annually
Senior level
Artificial Intelligence • Fintech • Machine Learning • Mobile • Payments • Retail • Software
Own and modernize Upsides analytics data platform: migrate pipelines, reduce cost, improve governance, design reusable modeling/orchestration patterns, deliver domain-critical data products, lead cross-functional initiatives, mentor engineers, and support ML and product teams.
Top Skills: AWSCi/CdDagsterDatabricksDbtSnowflakeTerraform
17 Days Ago
In-Office or Remote
165K-350K Annually
Senior level
165K-350K Annually
Senior level
Artificial Intelligence • Legal Tech
Founding data engineer responsible for consolidating multiple data sources into a BigQuery warehouse, building ETL/ELT pipelines, creating self-serve data tools (including natural-language/LLM agents), enabling analytics and personalization, and defining data engineering standards and infrastructure for a growing AI product.
Top Skills: BigQueryData LakeEtl/EltGoogle Cloud PlatformLlmsPythonSQLTerraformText-To-Sql

What you need to know about the Chicago Tech Scene

With vibrant neighborhoods, great food and more affordable housing than either coast, Chicago might be the most liveable major tech hub. It is the birthplace of modern commodities and futures trading, a national hub for logistics and commerce, and home to the American Medical Association and the American Bar Association. This diverse blend of industry influences has helped Chicago emerge as a major player in verticals like fintech, biotechnology, legal tech, e-commerce and logistics technology. It’s also a major hiring center for tech companies on both coasts.

Key Facts About Chicago Tech

  • Number of Tech Workers: 245,800; 5.2% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: McDonald’s, John Deere, Boeing, Morningstar
  • Key Industries: Artificial intelligence, biotechnology, fintech, software, logistics technology
  • Funding Landscape: $2.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Pritzker Group Venture Capital, Arch Venture Partners, MATH Venture Partners, Jump Capital, Hyde Park Venture Partners
  • Research Centers and Universities: Northwestern University, University of Chicago, University of Illinois Urbana-Champaign, Illinois Institute of Technology, Argonne National Laboratory, Fermi National Accelerator Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account