Sr. Pentaho Big Data Engineer

| Chicago

Job Description Summary

The Enterprise Analytics team at CCC has an open position for a Senior Pentaho Engineer. The team builds analytical solutions to provide insights to internal and external clients of CCC businesses in auto property damage and repair, medical claims and telematics data. Our solutions include analytical applications to identify the right claim cost to pay, claim cycle time processing, workflow productivity, financial performance, client and consumer satisfaction, and industry benchmarks.
Our data engineers use big data technology to create best-in-industry analytics capability. This position is an opportunity to use Pentaho with HDFS, Spark and Kafka technology for batch and streaming analytics. Data processes in Pentaho, if appropriate, include ingestion, standardization, metadata management, business rule curation, data enhancement, and statistical computation against data sources that include relational, XML, JSON, streaming, REST API, and unstructured data. Pentaho has provided a metadata injection layer for data ingestion across six SQLServer sources that will be leveraged for additional source ingestion.

 

Job Duties

The role has responsibility to understand, prepare, process and analyze data to drive operational, analytical and strategic business decisions. The Senior Pentaho Data Engineer will work closely with big data engineers, product owners, information engineers, data scientists, data modelers, infrastructure support and data governance positions.   This role requires exceptional Pentaho developer skills who can mentor big data engineers in the appropriate solution architecture and Pentaho development practices.   While you do not have to have big data skills, we are seeking Pentaho engineers who start with a base of programming skills but who also love to learn new tools and techniques in a big data landscape that is endlessly changing.

 

Qualifications

  • Build end to end data flows from sources to fully curated and enhanced data sets.  This can include the effort to locate and analyze source data, create data flows to extract, profile, and store ingested data, define and build data cleansing and imputation, map to a common data model, transform to satisfy business rules and statistical computations, and validate data content. 
  • Produce data building blocks, data models, and data flows for varying client demands such as dimensional data, data feeds, dashboard reporting, and data science research & exploration
  • Create, modify and maintain Pentaho code and complex SQL for BI/DW data flows
  • Learn to program in Spark and Python where Pentaho Spark co-generation is not adequate
  • Produce automated tests of data flow components
  • Use knowledge of the business to automate business-specific tests for data content quality
  • Automate code deployment and promotion
  • Build automated orchestration with Pentaho and error handling for use by production operation teams
  • Provide technical expertise to diagnose errors from production support teams
  • Collaborate with team members in an Agile team (e.g., Scrum)
  • Participate as both leader and learner in team tasks for architecture, design and analysis
  • Coordinate within collocated on-site teams as well as with work plans for off-shore resources
  • Bachelor’s Degree or Two Year Technical Program with a Programming Specialization
  • B.S. preferred in Computer Science, Information Systems, or related field
  • Minimum two years of development experience with Pentaho with a preference for five years of ETL tool experience which can be from other tools such as Talend, DataStage, and Informatica
  • Experience with development of metadata-driven and fully parameterized Pentaho environments
  • Advanced SQL coding skills for data transformations, profiling, and query tasks
  • Unix commands and scripting
  • Experience in agile environments such as scrum and Kanban
  • Preference for experience in Hadoop fundamentals and architecture: HDFS, map-reduce, job performance
  • Preference for open source big data skills in tools such as Hive, HBase, parquet, Spark SQL
  • Programming in a language such as Python (preferred), Scala, etc.

 

Why Choose CCC

 

We promote a healthy work-life balance and offer generous benefit plans and resources designed with employee satisfaction in mind.
What we value is simple - customers, employee commitment, collaboration and clear communication.

We hire people who will embrace the company’s goals and productively contribute in ways that help us serve the customer, innovate, and stay strong.
We make it a priority to keep employees healthy, happy and enriched.

  • Healthy - Wellness programs and Perkspot/employee discount program
  • Happy – Recognition programs, a confidential employee assistance program, and flexible work arrangements such as staggered start times
  • Enriched – Tuition reimbursement, training and learning programs, and leadership development opportunities

 

Our corporate headquarters is located in downtown Chicago within the historic Merchandise Mart—a certified LEED (Leadership in Energy and Environmental Design) building.

CCC Information Services was ranked #17 in the Top 100 Digital Companies in Chicago in 2017 by Built In Chicago, an online community for digital technology entrepreneurs in Chicago.

CCC is a great place to work. Join us!

Read Full Job Description

Technology we use

  • Engineering
  • Product
  • Sales & Marketing
    • JavaLanguages
    • JavascriptLanguages
    • PythonLanguages
    • jQueryLibraries
    • jQuery UILibraries
    • Twitter BootstrapLibraries
    • AngularJSFrameworks
    • DjangoFrameworks
    • SpringFrameworks
    • HadoopFrameworks
    • HBaseDatabases
    • Microsoft SQL ServerDatabases
    • MongoDBDatabases
    • MySQLDatabases
    • OracleDatabases
    • PostgreSQLDatabases
    • NoSQLDatabases
    • SparkDatabases
    • Google AnalyticsAnalytics
    • PhotoshopDesign
    • JIRAManagement
    • WordpressCMS

Location

Two city blocks and twenty-five stories of innovation and culture. theMART is interwoven into the fabric of Chicago’s history as an innovator in tech
222 Merchandise Mart, Chicago, IL 60654

Insider's spotlight

How would you describe the company’s work-life balance?

I've been here 5 years, and I learn something new everyday. I have the opportunity to grow my skill set, the flexibility to spend time with my family, and the support to accomplish my professional goals.

Prasanthi

Manager, Quality Assurance

How do you collaborate with other teams in the company?

There is a strong focus on learning and progressing from missteps, with the ultimate goal of making sure we meet
business needs. I have the flexibility to talk directly to people outside of my immediate team which speeds up the delivery process, and aids in responsiveness.

Jennifer

Services Delivery Manager - Austin, TX

How has your career grown since starting at the company?

When I started as an intern at CCC, I was trusted to work with extraordinary technology. Now, as an Architect, I get to work on those technologies and new ones with other pioneers - that type of innovation ignites my creativity.

Amin

Engineer, Architecture and DevOps

How do you empower your team to be more creative?

Our teams are technically adept and highly capable. Equally, if not more importantly, they have a passion and desire to learn. We're not satisfied just cranking out code, there is a strong desire to learn about our customers and be creative

John

Director, Product Development

How does the company support your career growth?

Employees get to learn about multiple products across our entire customer base. This allows employees to figure out what area aligns best with their strengths and interests, and where they are looking to grow.

Susanne

Manager, Operations

What are CCC Perks + Benefits

Health Insurance & Wellness Benefits
Dental Benefits
Health Insurance Benefits
Onsite Gym
Retirement & Stock Options Benefits
401(K)
401(K) Matching
Performance Bonus
Child Care & Parental Leave Benefits
Flexible Work Schedule
Remote Work Program
Vacation & Time Off Benefits
Generous PTO
Paid Holidays
Perks & Discounts
Casual Dress
Commuter Benefits
Company Outings
Game Room
Happy Hours
Professional Development Benefits
Job Training & Conferences
Tuition Reimbursement

Additional Perks + Benefits

We know that investing in employee development is crucial. Employees have access to the CCC Learning Academy. The CCC Learning Academy was created as an internal platform for you as an employee. You come here to learn new skills such as time management, cooking, financing a home or career and business development. We empower our employees to learn within these four walls, but then go out and collaborate on these ideas with friends and family

More Jobs at CCC32 open jobs
All Jobs
Finance
Data + Analytics
Design + UX
Dev + Engineer
HR
Marketing
Operations
Product
Project Mgmt
Sales
Design + UX
new
CCC
Data + Analytics
new
CCC
Developer
new
CCC
Data + Analytics
new
CCC
Developer
new
CCC
Developer
new
CCC
Developer
new
CCC
Finance
new
CCC
Product
new
CCC
Developer
new
CCC
Finance
new
CCC
Operations
new
CCC
Developer
new
CCC
Project Mgmt
new
CCC
Operations
new
CCC
Data + Analytics
new
CCC
Data + Analytics
new
CCC
Data + Analytics
new
CCC