Build and maintain Databricks ETL pipelines using Spark and Delta Lake, including transformations, quality checks, optimization, and documentation. Productionize propensity, ranking, and segmentation models through repeatable training, scoring, deployment, monitoring, versioning, and retraining workflows. Collaborate with data scientists on feature engineering and model evaluation, troubleshoot production issues, support A/B testing, and contribute to future GenAI initiatives.
Description
Overview
Darwill is a nationally recognized print and marketing communications firm based in the west suburbs of Chicago. As a premier provider of complex, data-driven marketing solutions, we help CMOs and marketing leaders drive measurable performance through advanced analytics, automation, and AI-powered insights.
We are seeking a Machine Learning Engineer (MLOps) to support the productionization of traditional machine learning models (e.g., propensity and segmentation models) while also building and maintaining the core data pipelines on Databricks that power our analytics and modeling platforms.
This role is intentionally scoped for a mid-level engineer: someone with enough experience to work independently and make sound engineering decisions, but who is still hands-on, execution-focused, and eager to grow. This is not an entry-level position, and it is not a principal or architect-level role.
Location
Chicago, IL area (Oak Brook / West Suburbs)
Hybrid work model with 1–2 days onsite per week required
Reports To
VP of Data Engineering & Data Science
Responsibilities / Essential Functions
Data Engineering & Platform Foundations
- Design, build, and maintain ETL pipelines in Databricks using Spark and Delta Lake
- Independently implement data transformations, joins, and aggregations across large, multi-source datasets
- Build and maintain data validation and quality checks to ensure reliability of downstream analytics and ML workflows
- Optimize Databricks jobs for performance, scalability, and cost efficiency
- Write and maintain clear technical documentation for data pipelines and tables
ML Engineering & MLOps
- Partner closely with Data Scientists to support traditional ML model development, including feature engineering, training, validation, and deployment
- Productionize propensity, ranking, and segmentation models used in large-scale marketing campaigns
- Build and maintain repeatable ML pipelines for training, batch scoring, and inference
- Implement model versioning, experiment tracking, and reproducibility standards
- Support model performance monitoring, drift detection, and retraining cycles
Deployment, Monitoring & Operations
- Deploy data pipelines and ML workflows into production environments serving millions of records
- Implement monitoring and alerting for data and ML pipelines
- Support A/B testing and model performance evaluation in partnership with Data Science
- Troubleshoot production issues independently and collaborate effectively when escalation is needed
GenAI (Secondary / Directional)
- Contribute to GenAI initiatives as capacity allows
- Stay informed on emerging AI technologies and tooling
- (GenAI is not the primary focus of this role today.)
Required Qualifications
Experience
- 3–6 years of professional experience in machine learning engineering, data engineering, or a closely related role
- Experience working in production environments with minimal day-to-day supervision
- Demonstrated ability to collaborate effectively with Data Scientists and translate models into production systems
Technical Skills (Must-Have)
Data Engineering & Platform
- Apache Spark (PySpark, SparkSQL)
- Databricks (ETL pipelines, workflows, Delta Lake)
- Strong SQL skills (complex queries, joins, window functions, optimization)
- Experience building and maintaining scalable data pipelines
Programming & Machine Learning
- Python (pandas, numpy, scikit-learn; experience with XGBoost or LightGBM preferred)
- Feature engineering and data preparation for ML models
- Working knowledge of supervised learning models (classification, regression, ranking)
MLOps & Production
- Experience deploying ML models into production
- Model versioning and experiment tracking (e.g., MLflow or similar)
- Monitoring data quality and model performance in production
- Supporting retraining and validation workflows
Cloud & Tooling
- Experience with a major cloud platform (Databrick, AWS)
- Familiarity with workflow orchestration tools (Databricks Workflows or similar)
Preferred Qualifications (Nice-to-Have)
- Experience with propensity modeling, customer segmentation, or marketing analytics
- Exposure to CI/CD concepts for data and ML pipelines
- Experience with Docker or containerized deployments
- Exposure to GenAI, LLMs, or RAG-based systems
- Master’s degree in Computer Science, Statistics, or a related field
- Seniority Level
Associate - Industry
- Marketing Services
- Employment Type
Full-time - Job Functions
Darwill, Inc. Hillside, Illinois, USA Office
Hillside, IL, United States
Darwill, Inc. Oakbrook Terrace, Illinois, USA Office
One Tower Lane, Suite 1920, Oakbrook Terrace, United States, 60181
Similar Jobs
Artificial Intelligence • Computer Vision • Greentech • Machine Learning • Robotics • Industrial • Automation
Develops and productionizes deep learning and machine learning perception models for robotics and recycling sortation. Responsibilities include experimenting with neural network architectures, designing computer vision solutions, conducting statistical experiments, deploying successful models, collaborating with data, modeling, and cloud infrastructure teams, and improving ML infrastructure.
Top Skills:
Computer VisionData PipelinesDeep LearningMachine LearningNeural NetworksPythonPyTorchSQLStatistical ModelingTensorrt
Fintech • Machine Learning • Payments • Software • Financial Services
Lead the design, development, deployment, and operation of machine learning systems at scale. Responsibilities include building and validating models, creating optimized data pipelines, automating testing and deployment, monitoring and retraining production models, designing cloud-based ML architectures, and applying responsible AI, governance, security, and explainability practices. The role also involves technical leadership, cross-functional Agile collaboration, and mentoring or leading teams developing production ML solutions.
Top Skills:
SparkAWSAzureDaskGoogle Cloud PlatformJavaPythonPyTorchScalaScikit-LearnTensorFlow
Fintech • Machine Learning • Payments • Software • Financial Services
Leads the design, development, deployment, and maintenance of production machine learning systems at scale. Responsibilities include developing and validating models, building optimized data pipelines, writing application code, automating testing and deployment, monitoring and retraining production models, designing cloud-based ML architectures, and applying responsible AI and governance practices. The role collaborates with Product, Data Science, and Agile engineering teams and may include people leadership.
Top Skills:
SparkAWSCi/CdCloud ComputingDaskData PipelinesDistributed ComputingGoogle Cloud PlatformJavaMachine LearningAzurePythonPyTorchScalaScikit-LearnTensorFlow
What you need to know about the Chicago Tech Scene
With vibrant neighborhoods, great food and more affordable housing than either coast, Chicago might be the most liveable major tech hub. It is the birthplace of modern commodities and futures trading, a national hub for logistics and commerce, and home to the American Medical Association and the American Bar Association. This diverse blend of industry influences has helped Chicago emerge as a major player in verticals like fintech, biotechnology, legal tech, e-commerce and logistics technology. It’s also a major hiring center for tech companies on both coasts.
Key Facts About Chicago Tech
- Number of Tech Workers: 245,800; 5.2% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: McDonald’s, John Deere, Boeing, Morningstar
- Key Industries: Artificial intelligence, biotechnology, fintech, software, logistics technology
- Funding Landscape: $2.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Pritzker Group Venture Capital, Arch Venture Partners, MATH Venture Partners, Jump Capital, Hyde Park Venture Partners
- Research Centers and Universities: Northwestern University, University of Chicago, University of Illinois Urbana-Champaign, Illinois Institute of Technology, Argonne National Laboratory, Fermi National Accelerator Laboratory
