Senior Data Engineer

Posted 22 Days Ago
Chicago, IL
Hybrid
7+ Years Experience
Fintech • Financial Services
The Role
As a Senior Data Engineer on our Research Data Management team at DRW, you will play a key role in managing datasets for analyzing financial markets, establishing trading strategies, and optimizing trading opportunities. Responsibilities include governing data storage, collaborating with traders/researchers, designing data solutions/tools, and ensuring data quality.
Summary Generated by Built In

DRW is a diversified trading firm with over 3 decades of experience bringing sophisticated technology and exceptional people together to operate in markets around the world. We value autonomy and the ability to quickly pivot to capture opportunities, so we operate using our own capital and trading at our own risk.

Headquartered in Chicago with offices throughout the U.S., Canada, Europe, and Asia, we trade a variety of asset classes including Fixed Income, ETFs, Equities, FX, Commodities and Energy across all major global markets. We have also leveraged our expertise and technology to expand into three non-traditional strategies: real estate, venture capital and cryptoassets.

We operate with respect, curiosity and open minds. The people who thrive here share our belief that it’s not just what we do that matters–it's how we do it. DRW is a place of high expectations, integrity, innovation and a willingness to challenge consensus.

As a Senior Data Engineer on our Unified Platform team, you will play an integral role in designing and building an innovative data platform used by Traders, Quantitative Researchers, and Back-Office personnel to analyze financial markets, determine trading opportunities, establish new strategies, and ensure smooth back-office processes.

Technical requirements summary:

  • Have experience designing and building data-intensive distributed systems
  • Have experience working within the modern batch and streaming data ecosystems
  • An expert in Java/Scala or Python and have experience with SQL and Bash
  • Able to own, organize, and steer team projects
  • Be able to contribute to project management and project reporting
  • Be a leader/mentor to junior members of the team concerning engineering best-practices and code-quality

What you will do in this role:

  • Help design, build, and manage DRW's Unified Data Platform and support its users.
  • Work closely with Traders and Researchers to determine appropriate data sources and implement processes to onboard and manage new data sources for analysis to unlock future trading opportunities.
  • Design and develop data solutions to help discover, purchase, organize, track usage, manage rights, and control quality of data sets to address the needs of various DRW trading teams and strategies.
  • Continually monitor data ingestion pipelines and data quality to ensure stability, reliability, and quality of the data. Contribute to the monitoring and quality control software and processes.

What you will need in this role:

  • 7+ years of experience working with modern data technologies and/or building data-intensive distributed systems
  • Expert level skills in Java/Scala or Python with a proven ability to output high-quality, maintainable, code
  • Strong familiarity with SQL and Bash
  • Experience leveraging and building cloud-native technologies for scalable data processing.
  • Prior experience with both batch and streaming systems and an understanding of the limitations those paradigms impose
  • Experience with an array of data processing technologies (e.g. Flink, Spark, Polars, Dask, etc.)
  • Experience with an array of data storage technologies (e.g. S3, RDBMS, NoSQL, Delta/Iceberg, Cassandra, Clickhouse, Kafka, etc.)
  • Experience with an array of data formats and serialization systems (e.g. Arrow, Parquet, Protobuf/gRPC, Avro, Thrift, JSON, etc.)
  • Experience managing complex data ETL Pipelines (e.g. Kubernetes, Argo Workflows, Airflow, Prefect, Dagster, etc.)
  • Prior experience dealing with schema governance and schema evolution
  • Prior experience developing data quality control processes to detect data gaps or inaccuracies
  • A desire to mentor less experienced team-members and champion both engineering best-practices and high code-quality standards.
  • Strong technical problem-solving skills
  • Proven ability to work in an agile, fast-paced environment, prioritize multiple tasks and projects, and efficiently handle the demands of a trading environment


For more information about DRW's processing activities and our use of job applicants' data, please view our Privacy Notice at https://drw.com/privacy-notice.

California residents, please review the California Privacy Notice for information about certain legal rights at https://drw.com/california-privacy-notice.

[#LI-SK1] 

Top Skills

C++
Python

What the Team is Saying

Elaine
Omar
Eric
Kumbi
Carissa
Alex
Brawnski
Michelle
The Company
Chicago, IL
2,000 Employees
Hybrid Workplace
Year Founded: 1992

What We Do

A diversified trading firm that utilizes our own capital and trades at our own risk. We bring sophisticated technology and exceptional people together to solve complex problems in markets around the world and across many asset classes. We are motivated to compete at the highest level and commit to operate with respect, curiosity and an open mind.

Why Work With Us

The DRW approach is simple: tenure, experience and titles don’t matter as much as ideas, execution and results. We believe in creating opportunity to take on more complex problems, more interesting projects and more specialized skills. It’s a results-driven environment where friendships grow and respect is the norm.

Gallery

Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery

DRW Offices

Hybrid Workspace

Employees engage in a combination of remote and on-site work.

Typical time on-site: Flexible
Chicago, IL

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account