Caterpillar
Cat Digital uses digital technologies to help Caterpillar Inc. customers build a better world.
Chicago, IL
Remote

LEAD DATA ENGINEER at Caterpillar

| Chicago
Sorry, this job was removed at 4:42 p.m. (CST) on Monday, November 2, 2020
Find out who's hiring in Chicago.
See all Data + Analytics jobs in Chicago
Apply now
By clicking continue you agree to Built In’s Privacy Policy and Terms of Use.

JOB PURPOSE:

 

As a Lead Software Engineer you will lead the design, development, testing and deployment of data pipelines, software systems and other applications.

 

  

JOB DUTIES: 

 

Responsibilities of the incumbents are across functional lines with individuals assigned in new program development and/or maintenance of existing distributed computing systems in cloud.  Be responsible for overseeing and mentoring junior developers and handle code reviews.

 

 

  1. Competent to perform all programming, project management, and development assignments without close supervision; normally assigned the more complex aspects of systems work.
  2. Acts as team leader for development and support groups; provides programming and application/technical leadership, guidance, and assistance to other team members.
  3. Works directly on complex application/technical problem identification and resolution, including responding to off-shift and weekend support calls.
  4. Works independently on complex systems or infrastructure components that may be used by one or more applications or systems.
  5. Drives application development focused around delivering business valuable features
  6. Mentor and assist software engineers, providing technical assistance and direction as needed
  7. Maintains high standards of software quality within the team by establishing good practices and habits
  8. Identifies and encourage areas for growth and improvement within the team
  9. Guide the team to develop a structured application/interface code, new program documentation, operations documentation and user guides in a casual, flexible environment
  10. Communicate with end users and internal customers to help direct development, debugging, and testing of application software for accuracy, integrity, interoperability, and completeness
  11. Lead development of new functionality and applications on cross-functional Agile project teams
  12. Performs integrated testing and customer acceptance testing of components that requires careful planning and execution to ensure timely, quality results.
  13. Employee is also responsible for performing other job duties as assigned by Caterpillar management from time to time.

 

 

 

 

 

 

Qualifications

 

 

Basic qualifications:

 

·       Position requires a four-year degree from an accredited college or university.

 

·       7 years or more of software development experience or at least 5 years of experience with master’s degree in computer science or related field.

 

·       Demonstrated experience leading software engineering projects.

 

·       5 years or more of experience in designing and developing software applications in Java, Python Scala or at least three years of experience in Java or Scala with master’s degree in computer science or related field.

 

·       5 years or more of developing backend data pipelines in AWS using Python (PySpark) and Scala.

 

·       5 years or more of experience analyzing data using various data science libraries

 

·       3 years or more experience in the framework’s like Scalatra, Akka, Django

 

 

 

Top candidates will also have:

 

·       Proven experience in many of the following,

 

o   Designing, developing, deploying and maintaining software at scale.

 

o   Developing software applications using relational and Nosql databases.

 

o   Developing data pipelines (batch, near real-time, streaming) using AWS Technology stack.

 

o   Deep understanding of distributed data pipelines using AWS managed services.

 

o   Experience with data warehousing applications like Snowflake, Redshift

 

o   Application architectural patterns, such as MVC, Microservices, Event-driven, etc.

 

o   Deploying software using CI/CD tools such as Jenkins, GoCD, Azure Devops etc.

 

o   Deploying and maintaining software using public clouds such as AWS or Azure.

 

o   Working within an Agile framework (ideally Scrum)

 

·       Strong understanding and/or experience in many of the following,

 

o   Batch or stream processing systems such as Apache Spark, Flink, Akka, Storm

 

o   Data pipelines using python, Spark for MPP

 

o   Message brokers such as Kafka, Rabbitmq, AWS SQS, AWS SNS, Apache ActiveMQ, Kinesis.

 

o   Experience designing well-defined Restful APIs

 

o   Experience writing API proxies on platforms such as Apigee Edge, AWS API Gateway or Azure API Gateway

 

o   Hands one experience with API tools such as Swagger, Postman and Assertible

 

o   Test driven development and behavior driven development.

 

o   Hands on experience with testing tools such as Selenium and Cucumber and their integration into CI/CD pipelines.

 

o   Datastores such as MongoDB, Cassandra, Redis, Elasticsearch, MySQL, Oracle.

 

o   Debugging and maintaining software in Linux or Unix platforms.

 

·       Understanding of front-end state management libraries (redux)

 

·       Must demonstrate solid knowledge of computer science fundamentals like data structures and algorithms.

 

·       Ability to work under pressure and within time constraints

 

·       Passion for technology and an eagerness to contribute to a team-oriented environment

 

·       Demonstrated leadership on small to medium-scale projects impacting strategic priorities

 

·       Bachelor’s degree in Computer science or Electrical engineering or related field is required

 

See More
Apply now
By clicking continue you agree to Built In’s Privacy Policy and Terms of Use.

Where we are

In the heart of Chicago's lively West Loop area, we have easy access to public transport, great bars and restaurants, and an awesome office roof deck.

Technology we use

  • Engineering
  • Sales & Marketing
    • JavaLanguages
    • JavascriptLanguages
    • PythonLanguages
    • RLanguages
    • ScalaLanguages
    • SqlLanguages
    • ReactLibraries
    • ReduxLibraries
    • AngularJSFrameworks
    • Backbone.jsFrameworks
    • Ember.jsFrameworks
    • HadoopFrameworks
    • Node.jsFrameworks
    • Ruby on RailsFrameworks
    • SparkFrameworks
    • SpringFrameworks
    • Amazon Web ServicesFrameworks
    • AWS ElasticSearchFrameworks
    • AWS Code PipelineFrameworks
    • DockerFrameworks
    • ApigeeFrameworks
    • FlinkFrameworks
    • AkkaFrameworks
    • Amazon ECSFrameworks
    • MySQLDatabases
    • OracleDatabases
    • PostgreSQLDatabases
    • DynamoDBDatabases
    • RDSDatabases
    • SalesforceCRM
Previous
Next

What are Caterpillar Perks + Benefits

Culture
Volunteer in local community
Caterpillar Inc. participates in local volunteer activities such as the Chase Corporate Challenge
Partners with Nonprofits
Friends outside of work
Eat lunch together
Daily stand up
Open door policy
Team owned deliverables
Team based strategic planning
Open office floor plan
Diversity
Documented equal pay policy
Dedicated Diversity/Inclusion Staff
Unconscious bias training
Someone's primary function is managing the company’s diversity and inclusion initiatives
Diversity Employee Resource Groups
Health Insurance & Wellness Benefits
Flexible Spending Account (FSA)
Disability Insurance
Dental Benefits
Vision Benefits
Health Insurance Benefits
Life Insurance
Pet Insurance
Wellness Programs
Onsite Gym
Mental Health Benefits
Retirement & Stock Options Benefits
401(K)
401(K) Matching
Company Equity
Performance Bonus
Match charitable contributions
Child Care & Parental Leave Benefits
Generous Parental Leave
Flexible Work Schedule
Remote Work Program
Family Medical Leave
Adoption Assistance
Vacation & Time Off Benefits
Generous PTO
Paid Volunteer Time
Paid Holidays
Paid Sick Days
Perks & Discounts
Casual Dress
Game Room
Recreational Clubs
Professional Development Benefits
Job Training & Conferences
Tuition Reimbursement
Diversity Program
Lunch and learns
Cross functional training encouraged
Promote from within
Time allotted for learning
Online course subscriptions available
Customized development tracks

An Insider's view of Caterpillar

What are some social events your company does?

Whether we’re working virtually or in-person, we are always looking for ways to have fun and grow as a team. Team dinners, coffee chats, ax throwing, chess club, and virtual happy hours are just a few of the activities we do to make work more fun and connect with colleagues around the world.

Madison

Recruiter

What kinds of technical challenges do you and your team face?

It’s amazing to be able to work in an architectural framework where we can negotiate between speed to market and a solid application – software that is well-built, well-designed, well-tested. I find this negotiation both challenging and exhilarating.

MacGregor

Lead Software Engineer

How does the company support your career growth?

I’ve been with Caterpillar for 20 years now, and I’ve been lucky to work on teams that have different focuses. I’ve worked on everything from engineering applications to the latest and greatest digital technology applications.

Rakshan

Digital Product Manager

How do you make yourself accessible to the rest of the team?

The team should be comfortable approaching me with any kind of issue — like improving a process, getting rid of unnecessary ceremonies or something else — and know that I will address it. I believe a manager should be the first line of defense against bugs and conflicting priorities, and my team needs to know that I have their back.

Stan

Software Engineering Manager

What projects are you most excited about?

Deep learning algorithms, popularized in the past five years, allow us to scan huge volumes of data from Caterpillar's fleet of connected engines and machines for unusual patterns. We're now able to make sophisticated predictions that wouldn’t have been possible 20 years ago.

Dan

Analytics Director

Jobs at Caterpillar
6

All Jobs
All Jobs
Finance
Data + Analytics
Dev + Engineer
Tap to close

LEAD DATA ENGINEER

Caterpillar
Chicago
11 minutes ago
+47
Responsibilities of the incumbents are across functional lines with individuals assigned in new program development and/or maintenance of existing distributed computing systems in cloud.  Be responsible for overseeing and mentoring junior developers and handle code reviews.

COST AND DECISION SUPPORT BUSINESS MANAGER

Caterpillar
Chicago
3 days ago
+47
Cat Digital is more than a traditional service center.  Cat Digital is leading Caterpillar and our industry with the utilization of data analytics, innovation, digital channels and techniques to drive profit, create more efficient revenue growth, unlock new revenue streams and provide more durable competitive advantages for the business through unexpectedly great experiences for our customers.  We are a diverse, high energy, agile and innovative team lead by industry leaders working to drive refreshed digital culture across the enterprise.  The Cat Digital team delivers high quality data and solutions that enable Cat's Digital strategy, Enterprise Services growth initiatives and other key strategic priorities in mining, construction and engines.  As a Cost and Decision Support Business Manager, you will directly serve as the trusted advisor for one to two Digital Directors and be the key accounting contact or the organization.  This will include:

LEAD SOFTWARE ENGINEER

Caterpillar
Chicago
5 days ago
+47
JOB DUTIES: Responsibilities of the incumbents are across functional lines with individuals assigned in new program development and/or maintenance of existing mobile, WEB, Cloud, server, personal computer, mainframe, and/or distributed computing systems.

QA AUTOMATION ENGINEER (SDET)

Caterpillar
Chicago
1 week ago
+47
1.   Performing in-sprint functional acceptance automation using the relevant tools and frameworks by collaborating with the development and product teams. 2.   Development and implementation of stress and parallel tests for non-functional requirements. 3.   Design and Development of custom testing framework for better control of execution and overall management (selection, logging, reporting ...etc.). 4.   Works independently on complex systems or infrastructure components that may be used by one or more applications or systems. 5.   Maintains high standards of software quality within the team by establishing good practices and habits. 6.   Employee is also responsible for performing other job duties as assigned by Caterpillar management from time to time.

SENIOR PRINCIPAL DIGITAL ARCHITECT, CLOUD PLATFORM

Caterpillar
Chicago
3 weeks ago
+47
This position is recognized, both within Caterpillar and within the industry, as an expert in the digital field. This position plays a global leadership role in Digital Technology within Caterpillar and is very proactive in nature.  At this level, individuals must demonstrate creativity, foresight and mature judgment as they anticipate and solve unprecedented business problems, determine program objectives and requirements, organize programs and projects, and develop standards and guides for diverse digital activities. Projects are typically very complex and integrate business issues and problems, multiple application solutions, and multiple Digital Technologies across various architectures. Individuals at this level provide thought leadership and strategy to drive transformational change within Caterpillar and Digital.

PRINCIPAL SOFTWARE ENGINEER

Caterpillar
Chicago
3 weeks ago
+47
JOB DUTIES: Responsibilities of the incumbents are across functional lines with individuals assigned in new program development and/or maintenance of existing mobile, WEB, Cloud, server, personal computer, mainframe, and/or distributed computing systems. This individual will also work collaboratively with other engineering teams to ensure cross-functional goals are met.