Principal Data Engineer at KAR Global

| Chicago
!Sorry, this job was removed at 4:45 p.m. (CST) on Wednesday, September 4, 2019

DRIVIN is looking to expand our data team as we continue to grow our data platform.  The candidate should have a strong background with Python and SQL.  As a member of the data team, you will architect, plan, build, test, and deliver data solutions utilizing our AWS enterprise data platform.

 

DRIVIN has a polyglot data model using many cutting-edge data platforms including AWS Redshift for Data Warehouse, Elastic Search for location-based searching, and Postgres for transactional data and product delivery. Our delivery framework is comprised of Python/Docker on ECS, Spark on EMR, and Jenkins for CI/CD.

 

This candidate should be a self-starter who is interested in learning new systems/environments and passionate about developing quality supportable data service solutions for internal and external customers.

What you’ll do:

As a Principal Data Engineer, you’ll be responsible for the architecture of a data platform supporting multiple lines of business through internal and external delivery teams. A Principal Engineer understands frameworks and technologies are part of a toolset in order to determine what the best solutions are for any given task. You will enable and work with our other developers to define and lead the technologies in the fields of data ingestion and mapping supporting data science, product delivery, master data management, and Data As A Service stakeholders. Principal Data Engineers are empowered to evaluate our current system and potential new technologies —supporting the long-term stability, scalability, and performant cloud data delivery platform.

Responsibilities:

As a Principal Engineer, your responsibilities may include, but are not limited to, the following:

  • Take ownership including design and strategic roadmap for the data engineering team delivery framework. This includes organizing and maintaining core delivery codebase, naming conventions, and SDLC processes used by the data engineering team
  • Lead architectural evaluation, code review, and grooming sessions for team members ensuring timely and high-quality delivery of data services and projects on top of the data platform.
  • Take ownership of an enterprise cloud-based data platform and it’s architecture to ensure that internal and external customer data needs are met with timeliness, quality, and availability.
  • Work with our DevOps team to ensure that our platform is built and deployed using CI/CD best practices. Define requirements and feature needs back to DevOps teams for the effective support of the data engineering team delivery framework.
  • Own strategic business plans related to our data platform’s feature set and operational success including data migrations, infrastructure upgrades, tech-debt, or new source ingestion.

Qualifications:

  • Bachelor's degree in Computer Science or related field
  • 8+ years of data warehouse / ETL systems building experience
  • 5+ years of experience developing data pipelines using SQL, Python,  
  • A passion for operational needs of data pipelines, ensuring that data engineering approaches support long-term timeliness, quality, and availability of data flows.
  • A passion for data quality assurance testing. Understanding that data quality is paramount to the success of products and it’s customers.
  • A passion for creation of non-recurring engineering development. Identifying opportunities for common code-basis and working with the data engineering team to implement them as standard.
  • Highly proficient in programming, troubleshooting, and problem solving related to building of enterprise data solutions.
  • Excellent communication skills and ability to work using Agile methodologies. Enthusiasm for coaching other software engineers and participation or leadership of developer communities of practice.
  • Ability to work collaboratively with software engineers, project management, product owners, stakeholders, and leadership.
  • Experience with service-oriented (SOA), event-driven (EDA) architectures, cloud-based DWBI architectures, and ETL/RDBMS frameworks.  

Preferred skills:

We value these qualities, but they’re not required for this role:

  • Open source contribution
  • Strong understanding and/or experience with:
    • AWS Redshift, Aurora, Postgres
    • Python / Docker ETL framework on EC2
    • CI/CD practices and frameworks such as Jenkins, AWS Terraform, and Artifactory.
    • Big data technologies on cloud such as Spark and EMR.
    • Java application development especially surrounding data services.
Read Full Job Description

Technology we use

  • Engineering
  • Product
  • Sales & Marketing
    • JavaLanguages
    • JavascriptLanguages
    • PythonLanguages
    • RLanguages
    • SqlLanguages
    • ReactLibraries
    • DojoLibraries
    • FlaskFrameworks
    • Node.jsFrameworks
    • SparkFrameworks
    • SpringFrameworks
    • TensorFlowFrameworks
    • TorchFrameworks
    • PostgreSQLDatabases
    • RedisDatabases
    • Google AnalyticsAnalytics
    • MixpanelAnalytics
    • OptimizelyAnalytics
    • ConfluenceManagement
    • JIRAManagement
    • SalesforceCRM

Location

Our Chicago office is located in River West on the North Branch of the Chicago River. We have free shuttles to major train stations and CTA lines.

An Insider's view of KAR Global

What's something quirky about your company?

Our culture is more like a family than colleagues. One of my favorite aspects about this office is our Parents-designated Slack channel—an online team collaboration site. It is a great reminder we aren’t just employees, but we can be moms and dads at work, shamelessly sharing fun stories about our personal lives.

April

Senior Product Manager

What's the biggest problem your team is solving?

KAR Global’s DevOps teams are always solving unique problems, but tackling complexity is the real challenge. We’ve found that meaningful solutions come when we don’t focus on fighting fires reactively and instead work collaboratively on building proactive frameworks and implementing forward-thinking processes.

Brandon

Jr. DevOps Manager

What does your typical day look like?

We start the day with a 15-minute huddle to talk about progress from the day before, the day’s plan and barriers to success that need to be addressed. This gives us a clear understanding of our priorities for the day. Our teams are dynamic, so every member of our project team works together each day to discuss design approaches and share ideas.

Mo-Ting

Lead Backend Engineer

What are KAR Global Perks + Benefits

Culture
Volunteer in local community
KAR Auction Services gives every full-time employee a day with pay to volunteer with your favorite cause.
Friends outside of work
Eat lunch together
Intracompany committees
Open door policy
Team owned deliverables
Group brainstorming sessions
Open office floor plan
Health Insurance & Wellness Benefits
Flexible Spending Account (FSA)
Disability Insurance
Dental Benefits
Vision Benefits
Health Insurance Benefits
Life Insurance
Wellness Programs
Onsite Gym
Retirement & Stock Options Benefits
401(K)
401(K) Matching
Employee Stock Purchase Plan
Child Care & Parental Leave Benefits
Flexible Work Schedule
Remote Work Program
Family Medical Leave
Vacation & Time Off Benefits
Generous PTO
Paid Volunteer Time
Paid Holidays
Paid Sick Days
Perks & Discounts
Beer on Tap
Casual Dress
Commuter Benefits
Company Outings
Game Room
Our game room includes Pool Table, Foosball.
Stocked Kitchen
Some Meals Provided
Happy Hours
Professional Development Benefits
Job Training & Conferences
Acme Co. offers employees professional development opportunities like Onsite training courses, The ability to attend job related conferences and seminars.
Tuition Reimbursement
Lunch and learns
Promote from within
Continuing Education stipend
Customized development tracks
Paid industry certifications
More Jobs at KAR Global6 open jobs
All Jobs
Data + Analytics
Design + UX
Dev + Engineer
Product
Product
new
Chicago
Design + UX
new
Chicago
Developer
new
Chicago
Data + Analytics
new
Chicago
Developer
new
Chicago
Developer
new
Chicago