CCC Intelligent Solutions Logo

CCC Intelligent Solutions

Senior Data Engineers

Posted 4 Days Ago
Be an Early Applicant
In-Office
Chicago, IL, USA
108K-125K Annually
Senior level
In-Office
Chicago, IL, USA
108K-125K Annually
Senior level
Design, build, and maintain large-scale end-to-end data pipelines across data center and AWS. Ingest, profile, cleanse, transform, and validate data; produce dimensional models, feeds, and dashboards; automate testing, orchestration, and error handling; performance-tune distributed applications; mentor junior engineers and support production troubleshooting and root-cause analysis.
The summary above was generated by AI

CCC Intelligent Solutions Inc. (CCC) is a leading cloud platform for the multi-trillion-dollar insurance economy, creating intelligent experiences for insurers, repairers, automakers, part suppliers, and more. At CCC, we’re making life just work by empowering more than 35,000 businesses with industry-leading technology to get drivers back on the road and to health quickly and seamlessly. We’re pushing boundaries with innovative AI solutions that simplify and enhance the claims and repair journey. Through purposeful innovation and the strength of its connections, CCC technologies empower the people and industry relied upon to keep lives moving forward when it matters most. Learn more about CCC at www.cccis.com.


 

The Role


 

Key Responsibilities:

Senior Data Engineers for various and unanticipated worksites throughout the U.S. (HQ: Chicago, IL). Develop large scale end to end data pipeline applications, covering multiple data sources spread across data center and AWS cloud. Use developed software applications to locate and analyze source data; create data flows to extract, profile, and store ingested data; define and build data cleansing and imputation; map to a common data model; transform to satisfy business rules and statistical computations; and validate data content. Produce software data building blocks, data models, and data flows, such as dimensional data, data feeds, dashboard reporting, and data science research and exploration. Produce automated software tests of data flow components and for data content quality. Automate orchestration and error handling for use by production operation teams. Provide technical expertise to diagnose errors from production support teams. Guide junior team members in performance tuning applications in distributed computing environments. Perform root cause analysis on all data and processes and identify opportunities for improvement. Develop metadata-driven and fully parameterized data processing tools. Mentor junior engineers. Technical Environment: Programming using Python & PySpark; Hadoop; HDFS, map-reduce, YARN, AWS EMR, Redshift, Terraform; Hive, HBase, parquet, ORC, Spark SQL, Sqoop, Apache Hudi; Orchestrating ETL pipelines involving data sourcing, transformations & publishing using Apache Airflow; Performance tuning applications in distributed computing environments; Designing & developing data pipeline applications with Apache Kafka; Advanced SQL for data profiling & data validation; Unix commands & scripting; performing root cause analysis on internal & external data & processes to identify opportunities for improvement; JIRA, Gitlab, Subversion; Development of metadata-driven & fully parameterized data processing tools; AWS.  

#LI-DNI

#NOINDEED


 

Requirements:

Master’s degree in Computer Science, Computer Engineering, Management Information Systems or related field plus 2 years of experience in software development/data processing or analysis required. Required skills: Hands-on experience with: Programming using Python & PySpark; Hadoop; HDFS, map-reduce, YARN, AWS EMR, Redshift, Terraform; Hive, HBase, parquet, ORC, Spark SQL, Sqoop, Apache Hudi; Orchestrating ETL pipelines involving data sourcing, transformations & publishing using Apache Airflow; Performance tuning applications in distributed computing environments; Designing & developing data pipeline applications with Apache Kafka; Advanced SQL for data profiling & data validation; Unix commands & scripting; performing root cause analysis on internal & external data & processes to identify opportunities for improvement; JIRA, Gitlab, Subversion; Development of metadata-driven & fully parameterized data processing tools; AWS; Telecommuting permitted.  

Salary:  

$108,077/yr.-$125,282/yr. + Benefits: www.cccis.com/careers


 

About CCC's Commitment to Employees:

CCC Intelligent Solutions understands that our employees play an integral role in our vision to shape a world where life just works. Our team is defined by our values of Integrity, Customer-Focus, Innovation, Inclusion & Diversity, Tenacity, and Connection. Through diverse perspectives, purposeful innovation, and the strength of connections, our technologies empower the people and industry relied upon to keep lives moving forward when it matters most.

At CCC, together everyone can thrive as we innovate and collaborate, creating employee experiences that just work. We are committed to providing opportunities for our people to make real-life impacts, advance in their careers, and contribute to CCC’s success.

CCC offers competitive compensation and benefits to support you and your families, including:

  • 401K Match

  • Paid time off

  • Annual Incentive Plan Performance Bonus

  • Comprehensive health insurance

  • Adoption Assistance

  • Tuition Reimbursement

  • Wellness Programs

  • Stock Purchase Plan options

  • Employee Resource Groups

For more information about our benefits, please check out our careers site.

Here, you belong. You are seen, valued, and respected. We celebrate you for who you are and all you bring. Every voice is heard and is important to our success. You can hear what employees have to say about our culture here

If you require reasonable accommodation to complete a job application, please contact (800) 621-8070.

HQ

CCC Intelligent Solutions Chicago, Illinois, USA Office

Two city blocks and twenty-five stories of innovation and culture. theMART is interwoven into the fabric of Chicago’s history as an innovator in tech

Similar Jobs

7 Months Ago
Hybrid
2 Locations
Senior level
Senior level
Artificial Intelligence • Big Data • Information Technology • Machine Learning • Software • Analytics • Financial Services
The Senior Data Engineer will build and maintain data pipelines, develop scalable ETL processes, and implement storage solutions for large financial datasets.
Top Skills: AWSAzureDockerGCPHpcKubernetesPythonRaySlurmSQL
56 Minutes Ago
Remote or Hybrid
Chicago, IL, USA
212K-244K Annually
Senior level
212K-244K Annually
Senior level
Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
The Anthropic Alliance Manager at PwC focuses on building partnerships, driving revenue growth, and executing marketing strategies to enhance brand visibility and client engagement. Responsibilities include relationship management, strategic planning, and team leadership to deliver on client expectations and organizational goals.
Top Skills: Microsoft Office SuiteSalesforce
57 Minutes Ago
Hybrid
Chicago, IL, USA
63K-153K Annually
Junior
63K-153K Annually
Junior
Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Design and build scalable data infrastructure and pipelines using Azure Data Factory and Databricks. Implement data integration, transformation, modeling, and optimization. Validate data quality and security, collaborate with teams and clients, and contribute to client projects while developing technical skills and personal brand.
Top Skills: Azure Data FactoryMicrosoft Azure DatabricksSnowflake

What you need to know about the Chicago Tech Scene

With vibrant neighborhoods, great food and more affordable housing than either coast, Chicago might be the most liveable major tech hub. It is the birthplace of modern commodities and futures trading, a national hub for logistics and commerce, and home to the American Medical Association and the American Bar Association. This diverse blend of industry influences has helped Chicago emerge as a major player in verticals like fintech, biotechnology, legal tech, e-commerce and logistics technology. It’s also a major hiring center for tech companies on both coasts.

Key Facts About Chicago Tech

  • Number of Tech Workers: 245,800; 5.2% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: McDonald’s, John Deere, Boeing, Morningstar
  • Key Industries: Artificial intelligence, biotechnology, fintech, software, logistics technology
  • Funding Landscape: $2.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Pritzker Group Venture Capital, Arch Venture Partners, MATH Venture Partners, Jump Capital, Hyde Park Venture Partners
  • Research Centers and Universities: Northwestern University, University of Chicago, University of Illinois Urbana-Champaign, Illinois Institute of Technology, Argonne National Laboratory, Fermi National Accelerator Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account