Develop and maintain datasets for visualization and machine learning; automate data pipelines; partner with teams to build data products.
- Your team will develop datasets that enable data visualization, machine learning and data driven decision making across client product line
- Working with structured and unstructured datasets and automating data pipelines to ingest, analyze, validate, normalize and clean data in a hybrid multi-cloud environment
- Building data ingestion pipelines from multiple data sources using Data Bricks and Apache Spark
- Partnering with analysts, solution architects, modelers and developers to build data product and data pipelines.
- Providing technical and thought leadership
Requirements
- Strong T-SQL Skills with experience in Snowflake
- Familiarity with CI/CD methods
- Significant experience in Python development
- Highly proficient at PySpark development
- Solid grasp of database engineering and design principles
- Current Databricks Certification
- Experience in building business stakeholder relationships at all levels, leadership communications and managing project delivery from design to launch
Benefits
- Education Assistance/Student Loan Repayment - up to $2400 annually
- Remote work allowance
- Internet reimbursement
- Bench pay
- Profit share
- Healthcare reimbursement
- 401k - 4% match
- Short-Term disability
- Long-Term disability
- Life Insurance
Similar Jobs
Artificial Intelligence • Information Technology • Professional Services • Software • Analytics • Generative AI • Big Data Analytics
Lead complex data analyses, develop statistical models, write advanced SQL, build data models and dashboards, and establish technical standards for analytics. Mentor analysts, troubleshoot data quality and modeling challenges, partner with data engineering, translate ambiguous business questions into rigorous analyses, and communicate findings to senior stakeholders. Own the analytics function’s technical roadmap while ensuring data privacy and security practices.
Top Skills:
A/B TestingCcpaData ModelingData WarehousingDatabricksETLGdprLookerPower BIRegression AnalysisSnowflakeSQLTableau
Information Technology
Designs and delivers Microsoft Fabric, Azure AI, Power BI, and generative AI architectures for enterprise clients. Leads solution design, prototyping, implementation readiness, governance, quality assurance, and client enablement across complex engagements. Develops AI solution patterns including RAG, vector search, embeddings, semantic search, and prompt orchestration. Leads project and client teams, supports business cases and proposals, reviews technical deliverables, manages risks, and serves as a trusted technical advisor.
Top Skills:
AzureAzure AiAzure Ai SearchAzure OpenaiCi/CdCopilotEltEmbeddingsGenerative AiMicrosoft FabricOnelakePower BIPrompt EngineeringPysparkPythonRbacRetrieval-Augmented GenerationSemantic SearchSparkSQLVector Search
Aerospace • Information Technology • Professional Services • Security • Software
Design and own an event-driven data architecture that moves healthcare claims data through AWS and Snowflake into fraud, waste, and abuse alerts. Establish architecture standards, approve material changes, build complex pipeline components, and ensure scalability, reliability, and compliance with PII/PHI constraints. Collaborate with data science, compliance, technical, and investigative teams while supporting government review timelines. This is a hands-on principal role requiring strong Python, SQL, AWS, Snowflake, and production streaming pipeline experience.
Top Skills:
AWSPythonSnowflakeSQL
What you need to know about the Chicago Tech Scene
With vibrant neighborhoods, great food and more affordable housing than either coast, Chicago might be the most liveable major tech hub. It is the birthplace of modern commodities and futures trading, a national hub for logistics and commerce, and home to the American Medical Association and the American Bar Association. This diverse blend of industry influences has helped Chicago emerge as a major player in verticals like fintech, biotechnology, legal tech, e-commerce and logistics technology. It’s also a major hiring center for tech companies on both coasts.
Key Facts About Chicago Tech
- Number of Tech Workers: 245,800; 5.2% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: McDonald’s, John Deere, Boeing, Morningstar
- Key Industries: Artificial intelligence, biotechnology, fintech, software, logistics technology
- Funding Landscape: $2.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Pritzker Group Venture Capital, Arch Venture Partners, MATH Venture Partners, Jump Capital, Hyde Park Venture Partners
- Research Centers and Universities: Northwestern University, University of Chicago, University of Illinois Urbana-Champaign, Illinois Institute of Technology, Argonne National Laboratory, Fermi National Accelerator Laboratory
