As a Senior Data Engineer, you'll design and build data pipelines, automate processes, and collaborate with business teams to support analytical needs, ensuring data quality and optimization for ML workloads.
Help empower our global customers to connect to culture through their passions.
Why you'll love this role
As a Senior Data Engineer, you will be empowered to leverage data to drive amazing customer experiences and business results. You will own the end to end development of data engineering solutions to support analytical needs of the business. The ideal candidate will be passionate about working with disparate datasets and be someone who loves to bring data together to answer business questions at speed. You should have deep expertise in the creation and management of datasets and the proven ability to translate the data into meaningful insights through collaboration with analysts, data scientists and business stakeholders.You will partner with accounting and finance business teams in expanding Financial Data Repository to support new business initiatives. Sr Data Engineer of Finance Data Repository is most challenging and exciting role to work for, with new business initiative launches in payments, finance , tax and ordering platform. Its highly critical to manage the changes on daily basis for proper accounting to keep our books clean and accurate.
What you'll do
- Design and build mission critical data pipelines with a highly scalable distributed architecture - including data ingestion (streaming, events and batch), data integration, data curation
- Help continually improve ongoing reporting and analysis processes, simplifying self-service support for business stakeholders
- Build and support reusable framework to ingest, integration and provision data
- Automation of end to end data pipeline with metadata, data quality checks and audit
- Build and support a big data platform on the cloud
- Define and implement automation of jobs and testing
- Optimize the data pipeline to support ML workloads and use cases
- Support mission critical applications and near real time data needs from the data platform
- Capture and publish metadata and new data to subscribed users
- Work collaboratively with business analysts, product managers, data scientists as well as business partners and actively participate in design thinking session
- Participate in design and code reviews
- Motivate, coach, and serve as a role model and mentor for other development team associates/members that leverage the platform
About you
- 5 to 7 years experience in data warehouse / data lake house technical architecture
- 3+ years of experience in using programming languages (Python / Scala / Java / C#) Minimum
- 3 years of Big Data and Big Data tools in one or more of the following: Batch Processing (e.g. Hadoop distributions, Spark), Real time processing (e.g. Kafka, Flink/Spark Streaming)
- Minimum of 2 years' experience with AWS or engineering in other cloud environments
- Strong Knowledge of Databricks SQL/Scala - Data Engineering Pipelines
- Experience with Database Architecture/Schema design
- Strong familiarity with batch processing and workflow tools such as dbt, AirFlow, NiFi
- Ability to work independently with business partners and management to understand their needs and exceed expectations in delivering tools/solutions
- Strong interpersonal, verbal and written communication skills and ability to present complex technical/analytical concepts to executive audience
- Strong business mindset with customer obsession; ability to collaborate with business partners to identify needs and opportunities for improved data management and delivery
- Experience providing technical leadership and mentoring other engineers for best practices on data engineering
- Bachelor's degree in Computer Science, or a related technical field
Pursuant to the San Francisco Fair Chance Ordinance, Los Angeles Fair Chance Initiative for Hiring Ordinance, and any other state or local hiring regulations, we will consider for employment any qualified applicant, including those with arrest and conviction records, in a manner consistent with the applicable regulation.
Pursuant to the Colorado Fair Pay Act, the base salary range in Colorado for this position is $140,000 to $160,000, plus opportunities for benefits (e.g., medical, dental), equity and discretionary bonuses. Compensation in other geographies may vary.
About StockX
StockX is proud to be a Detroit-based technology leader focused on the large and growing online market for sneakers, apparel, accessories, electronics, collectibles, trading cards, and more. StockX's powerful platform connects buyers and sellers of high-demand consumer goods from around the world using dynamic pricing mechanics. This approach affords access and market visibility powered by real-time data that empowers buyers and sellers to determine and transact based on market value. The StockX platform features hundreds of brands across verticals including Jordan Brand, adidas, Nike, Supreme, BAPE, Off-White, Louis Vuitton, Gucci; collectibles from brands including LEGO, KAWS, Bearbrick, and Pop Mart; and electronics from industry-leading manufacturers Sony, Microsoft, Meta, and Apple. Launched in 2016, StockX employs 1,000 people across offices and verification centers around the world. Learn more at www.stockx.com.
We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status. This job description is intended to convey information essential to understanding the scope of the job and the general nature and level of work performed by job holders within this job. However, this job description is not intended to be an exhaustive list of qualifications, skills, efforts, duties, responsibilities or working conditions associated with the position. StockX reserves the right to amend this job description at any time. StockX may utilize AI to rank job applicant submissions against the position requirements to assist in determining candidate alignment.
Similar Jobs
Consumer Web • eCommerce • Food • Healthtech • Natural Language Processing • Social Impact
Thrive Market seeks a Senior Data Engineer to deliver data engineering solutions, collaborate across teams, and manage data architecture, focusing on complex data processing and streaming frameworks.
Top Skills:
AirflowSparkAWSDbtGitJenkinsKafkaPythonSnowflakeSQLTerraform
Fintech • Machine Learning • Payments • Social Impact • Software • Financial Services
The Senior Data Engineer will design and build scalable data lakehouse solutions, integrate data pipelines, develop data models, manage AWS infrastructure, and collaborate with teams to enhance the data platform.
Top Skills:
AirflowAWSDbtGlue CatalogIamKubernetesPythonS3Secrets ManagerSnowflakeSQLTerraform
.png)
Big Data • Healthtech • HR Tech • Machine Learning • Software • Telehealth • Big Data Analytics
The Senior Data Engineer will build and maintain data pipelines, optimize data processing, and ensure data privacy and quality within the healthcare tech space.
Top Skills:
AirbyteAirflowArgoAWSDbtDuckdbElasticsearchIcebergPostgres/SqlPythonSnowflakeSparkTerraform
What you need to know about the Chicago Tech Scene
With vibrant neighborhoods, great food and more affordable housing than either coast, Chicago might be the most liveable major tech hub. It is the birthplace of modern commodities and futures trading, a national hub for logistics and commerce, and home to the American Medical Association and the American Bar Association. This diverse blend of industry influences has helped Chicago emerge as a major player in verticals like fintech, biotechnology, legal tech, e-commerce and logistics technology. It’s also a major hiring center for tech companies on both coasts.
Key Facts About Chicago Tech
- Number of Tech Workers: 245,800; 5.2% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: McDonald’s, John Deere, Boeing, Morningstar
- Key Industries: Artificial intelligence, biotechnology, fintech, software, logistics technology
- Funding Landscape: $2.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Pritzker Group Venture Capital, Arch Venture Partners, MATH Venture Partners, Jump Capital, Hyde Park Venture Partners
- Research Centers and Universities: Northwestern University, University of Chicago, University of Illinois Urbana-Champaign, Illinois Institute of Technology, Argonne National Laboratory, Fermi National Accelerator Laboratory
