Caterpillar
Cat Digital uses digital technologies to help Caterpillar Inc. customers build a better world.
Chicago, IL
Remote

LEAD DATA ENGINEER at Caterpillar

| Chicago
Sorry, this job was removed at 4:08 p.m. (CST) on Wednesday, December 9, 2020
Find out who's hiring in Chicago.
See all Data + Analytics jobs in Chicago
Apply now
By clicking continue you agree to Built In’s Privacy Policy and Terms of Use.

JOB DESCRIPTION

Description

 

JOB PURPOSE:

 

As a Lead Software Engineer you will lead the design, development, testing and deployment of data pipelines, software systems and other applications.

 

  

JOB DUTIES: 

 

Responsibilities of the incumbents are across functional lines with individuals assigned in new program development and/or maintenance of existing distributed computing systems in cloud.  Be responsible for overseeing and mentoring junior developers and handle code reviews.

 

 

  1. Competent to perform all programming, project management, and development assignments without close supervision; normally assigned the more complex aspects of systems work.
  2. Acts as team leader for development and support groups; provides programming and application/technical leadership, guidance, and assistance to other team members.
  3. Works directly on complex application/technical problem identification and resolution, including responding to off-shift and weekend support calls.
  4. Works independently on complex systems or infrastructure components that may be used by one or more applications or systems.
  5. Drives application development focused around delivering business valuable features
  6. Mentor and assist software engineers, providing technical assistance and direction as needed
  7. Maintains high standards of software quality within the team by establishing good practices and habits
  8. Identifies and encourage areas for growth and improvement within the team
  9. Guide the team to develop a structured application/interface code, new program documentation, operations documentation and user guides in a casual, flexible environment
  10. Communicate with end users and internal customers to help direct development, debugging, and testing of application software for accuracy, integrity, interoperability, and completeness
  11. Lead development of new functionality and applications on cross-functional Agile project teams
  12. Performs integrated testing and customer acceptance testing of components that requires careful planning and execution to ensure timely, quality results.
  13. Employee is also responsible for performing other job duties as assigned by Caterpillar management from time to time.
 

Qualifications

 

Basic qualifications:

 

·       Position requires a four-year degree from an accredited college or university.

 

·       7 years or more of software development experience or at least 5 years of experience with master’s degree in computer science or related field.

 

·       Demonstrated experience leading software engineering projects.

 

·       5 years or more of experience in designing and developing software applications in Java, Python Scala or at least three years of experience in Java or Scala with master’s degree in computer science or related field.

 

·       5 years or more of developing backend data pipelines in AWS using Python (PySpark) and Scala.

 

·       5 years or more of experience analyzing data using various data science libraries

 

·       3 years or more experience in the framework’s like Scalatra, Akka, Django

 

 

 

Top candidates will also have:

 

·       Proven experience in many of the following,

 

o   Designing, developing, deploying and maintaining software at scale.

 

o   Developing software applications using relational and Nosql databases.

 

o   Developing data pipelines (batch, near real-time, streaming) using AWS Technology stack.

 

o   Deep understanding of distributed data pipelines using AWS managed services.

 

o   Experience with data warehousing applications like Snowflake, Redshift

 

o   Application architectural patterns, such as MVC, Microservices, Event-driven, etc.

 

o   Deploying software using CI/CD tools such as Jenkins, GoCD, Azure Devops etc.

 

o   Deploying and maintaining software using public clouds such as AWS or Azure.

 

o   Working within an Agile framework (ideally Scrum)

 

·       Strong understanding and/or experience in many of the following,

 

o   Batch or stream processing systems such as Apache Spark, Flink, Akka, Storm

 

o   Data pipelines using python, Spark for MPP

 

o   Message brokers such as Kafka, Rabbitmq, AWS SQS, AWS SNS, Apache ActiveMQ, Kinesis.

 

o   Experience designing well-defined Restful APIs

 

o   Experience writing API proxies on platforms such as Apigee Edge, AWS API Gateway or Azure API Gateway

 

o   Hands one experience with API tools such as Swagger, Postman and Assertible

 

o   Test driven development and behavior driven development.

 

o   Hands on experience with testing tools such as Selenium and Cucumber and their integration into CI/CD pipelines.

 

o   Datastores such as MongoDB, Cassandra, Redis, Elasticsearch, MySQL, Oracle.

 

o   Debugging and maintaining software in Linux or Unix platforms.

 

·       Understanding of front-end state management libraries (redux)

 

·       Must demonstrate solid knowledge of computer science fundamentals like data structures and algorithms.

 

·       Ability to work under pressure and within time constraints

 

·       Passion for technology and an eagerness to contribute to a team-oriented environment

 

·       Demonstrated leadership on small to medium-scale projects impacting strategic priorities

 

·       Bachelor’s degree in Computer science or Electrical engineering or related field is required

 

See More
Apply now
By clicking continue you agree to Built In’s Privacy Policy and Terms of Use.

Where we are

In the heart of Chicago's lively West Loop area, we have easy access to public transport, great bars and restaurants, and an awesome office roof deck.

Technology we use

  • Engineering
  • Sales & Marketing
    • JavaLanguages
    • JavascriptLanguages
    • PythonLanguages
    • RLanguages
    • ScalaLanguages
    • SqlLanguages
    • ReactLibraries
    • ReduxLibraries
    • AngularJSFrameworks
    • Backbone.jsFrameworks
    • Ember.jsFrameworks
    • HadoopFrameworks
    • Node.jsFrameworks
    • Ruby on RailsFrameworks
    • SparkFrameworks
    • SpringFrameworks
    • Amazon Web ServicesFrameworks
    • AWS ElasticSearchFrameworks
    • AWS Code PipelineFrameworks
    • DockerFrameworks
    • ApigeeFrameworks
    • FlinkFrameworks
    • AkkaFrameworks
    • Amazon ECSFrameworks
    • MySQLDatabases
    • OracleDatabases
    • PostgreSQLDatabases
    • DynamoDBDatabases
    • RDSDatabases
    • SalesforceCRM
Previous
Next

What are Caterpillar Perks + Benefits

Culture
Volunteer in local community
Caterpillar Inc. participates in local volunteer activities such as the Chase Corporate Challenge
Partners with Nonprofits
Friends outside of work
Eat lunch together
Daily stand up
Open door policy
Team owned deliverables
Team based strategic planning
Open office floor plan
Diversity
Documented equal pay policy
Dedicated Diversity/Inclusion Staff
Unconscious bias training
Someone's primary function is managing the company’s diversity and inclusion initiatives
Diversity Employee Resource Groups
Health Insurance & Wellness Benefits
Flexible Spending Account (FSA)
Disability Insurance
Dental Benefits
Vision Benefits
Health Insurance Benefits
Life Insurance
Pet Insurance
Wellness Programs
Onsite Gym
Mental Health Benefits
Retirement & Stock Options Benefits
401(K)
401(K) Matching
Company Equity
Performance Bonus
Match charitable contributions
Child Care & Parental Leave Benefits
Generous Parental Leave
Flexible Work Schedule
Remote Work Program
Family Medical Leave
Adoption Assistance
Vacation & Time Off Benefits
Generous PTO
Paid Volunteer Time
Paid Holidays
Paid Sick Days
Perks & Discounts
Casual Dress
Game Room
Recreational Clubs
Professional Development Benefits
Job Training & Conferences
Tuition Reimbursement
Diversity Program
Lunch and learns
Cross functional training encouraged
Promote from within
Time allotted for learning
Online course subscriptions available
Customized development tracks

An Insider's view of Caterpillar

What are some social events your company does?

Whether we’re working virtually or in-person, we are always looking for ways to have fun and grow as a team. Team dinners, coffee chats, ax throwing, chess club, and virtual happy hours are just a few of the activities we do to make work more fun and connect with colleagues around the world.

Madison

Recruiter

What kinds of technical challenges do you and your team face?

It’s amazing to be able to work in an architectural framework where we can negotiate between speed to market and a solid application – software that is well-built, well-designed, well-tested. I find this negotiation both challenging and exhilarating.

MacGregor

Lead Software Engineer

How does the company support your career growth?

I’ve been with Caterpillar for 20 years now, and I’ve been lucky to work on teams that have different focuses. I’ve worked on everything from engineering applications to the latest and greatest digital technology applications.

Rakshan

Digital Product Manager

How do you make yourself accessible to the rest of the team?

The team should be comfortable approaching me with any kind of issue — like improving a process, getting rid of unnecessary ceremonies or something else — and know that I will address it. I believe a manager should be the first line of defense against bugs and conflicting priorities, and my team needs to know that I have their back.

Stan

Software Engineering Manager

What projects are you most excited about?

Deep learning algorithms, popularized in the past five years, allow us to scan huge volumes of data from Caterpillar's fleet of connected engines and machines for unusual patterns. We're now able to make sophisticated predictions that wouldn’t have been possible 20 years ago.

Dan

Analytics Director

Jobs at Caterpillar
12

All Jobs
All Jobs
Data + Analytics
Dev + Engineer
Internships
Operations
Tap to close

Cat Digital - Associate Software Engineer

Caterpillar
Chicago
7 hours ago
+47
Competent to perform all programming, project management, and development assignments without close supervision; normally assigned the more complex aspects of systems work. Works directly on complex application/technical problem identification and resolution, including responding to off-shift and weekend support calls. Works independently on complex systems or infrastructure components that may be used by one or more applications or systems. Drives application development focused around delivering business valuable features. Maintains high standards of software quality within the team by establishing good practices and habits. Identifies and encourage areas for growth and improvement within the team. Communicate with end users and internal customers to help direct development, debugging, and testing of application software for accuracy, integrity, interoperability, and completeness.

Corporate Intern – Software Engineer/Data Analytics

Caterpillar
Chicago
7 hours ago
+47
Software Engineer - Interns will contribute to design, development and deployment of Caterpillar’s state-of-the-art digital platform, work with an agile engineering team to provide computer programming assistance in the development of several software projects. Assist with the troubleshooting and deployment of the software projects.

Digital Architect

Caterpillar
Chicago
7 hours ago
+47
This position is recognized within the Cat Digital community as an expert in the Salesforce ecosystem.  The Salesforce Architect will create and maintain architectural best practices, addressing application, data and technology in the context of business process across the various cloud verticals.   Key areas of accountability include participating in the development of Architecture Solutions for Strategic Cat Digital projects and programs; provide input into global technology roadmaps and application evolution plans; act as a researcher and evaluator of new technology, information or integration standards; and participate in strategy development for a specific technical or business domain.

Sr. Software Engineer

Caterpillar
Chicago
7 hours ago
+47
Collaboration with PO/PM and Platform teams for refining of requirements. •                Designing of API specification, database schema and flow diagrams for HLD. •                Development and Testing (Unit, Integration and Performance) assigned features/user stories.  •                Participation and contribution for achievement of team and project goals by being an effective Scrum team member.

Software Test Engineer

Caterpillar
Chicago
7 hours ago
+47
Competent to perform all testing, project management, and quality assurance assignments without close supervision; normally assigned the complex aspects of systems work. Competent to perform all testing activities of new and existing software products. Use your understanding of systems, regression, integration, performance, and user acceptance testing. Works directly on complex application/technical problem identification and resolution. Works independently on complex systems or infrastructure components that may be used by one or more applications or systems.

Digital Quality Analyst

Caterpillar
Chicago
7 hours ago
+47
The position manages the completion of its own work assignments and coordinates work with others.  Based on past experiences and knowledge, the incumbent normally works independently with minimal management input and review of end results.

Lead Software Engineer

Caterpillar
Chicago
7 hours ago
+47
1.Competent to perform all programming and development assignments without close supervision; normally assigned the more complex aspects of systems work. 2.Works directly on complex application/technical problem identification and resolution, including responding to off-shift and weekend support calls. 3.Works independently on complex systems or infrastructure components that may be used by one or more applications or systems.

IT Architect II

Caterpillar
Chicago
6 days ago
+47
This position is recognized within the Caterpillar IT community as an expert in Application Lifecycle Development. Key areas of accountability include defining core application development platforms and languages; fostering agile development methodologies; defining dev-ops pipeline strategies; researching emerging technologies and maintaining global technology roadmaps.

Data Scientist II

Caterpillar
Chicago
6 days ago
+47
The principal responsibility of the Data Scientist II is to be an independent contributor to multi-person analytic teams. This position has a depth of knowledge in quantitative analytic methods, data management, and or associated digital technologies suitable to handle all but the most complex issues. Senior Data Analysts are expected to be familiar with the company’s processes, products, and organization, as well as its customers, competitors, and stakeholders. Work is typically directed by a direct supervisor, project or team lead through a review of results. Decisions on routine, medium risk issues that may affect the project team, suppliers or internal customers may be made by this position. Challenges include meeting expectations in delivering results, learning to refine solutions to better fit complex situations, making timely decisions, and communicating effectively with all project stakeholders. The Data Scientist II also mentors and develops the capabilities and organizational knowledge of more junior data scientists and associates.

Lead Technical Support Engineer, Cat Digital

Caterpillar
Chicago
6 days ago
+47
Summary: The main function of an analyst/developer is to develop and design web applications and web sites. A typical analyst/developer is responsible for directing web site content creation, enhancement and maintenance. Job Responsibilities: Basic design, build or maintenance of web sites, using authoring or scripting languages, content creation tools, management tools and digital media. Identify problems uncovered by testing or customer feedback and correct problems. Evaluate code to ensure it is valid, meets industry standards and is compatible with devices or operation systems. Skills: Verbal and written communication skills, problem solving skills, customer service and interpersonal skills. Basic ability to work independently and manage one’s time. Basic knowledge of circuit boards, processors, electronic equipment and computer hardware and software. Basic knowledge of design techniques and principals involved in production of drawings and models. Basic knowledge of computer software, such as Adobe, Java, SQL, etc. Education/Experience: Bachelor's degree in computer science or equivalent training required. 2-4 years experience required.

Data Architect

Caterpillar
Chicago
6 days ago
+47
Responsible and accountable for leading large-scale full-cycle MPP enterprise data warehousing (EDW) projects using on-premise and cloud native data warehousing solutions such as Teradata & Snowflake; Drive development and execution of designing, implementing, and supporting end-to-end automated data processing ETL pipelines using a variety of tools and technologies (e.g. SSIS, SnapLogic, Talend, AWS Glue); Accountable for leading data architecture development for enterprise scale systems in public cloud in AWS, Azure and hybrid eco-systems; Responsible for implementing data lakes, big data transformations, cloud data processing, SQL and NoSQL data modeling; Manage data modeling requirements for structured and non-structured data using various database management technologies such as AWS RDS (SQL Server, PostgreSQL, Aurora), DynamoDB, Timeseries database & Graph Database.

SENIOR PRINCIPAL DIGITAL ARCHITECT, CLOUD PLATFORM

Caterpillar
Chicago
1 month ago
+47
This position is recognized, both within Caterpillar and within the industry, as an expert in the digital field. This position plays a global leadership role in Digital Technology within Caterpillar and is very proactive in nature.  At this level, individuals must demonstrate creativity, foresight and mature judgment as they anticipate and solve unprecedented business problems, determine program objectives and requirements, organize programs and projects, and develop standards and guides for diverse digital activities. Projects are typically very complex and integrate business issues and problems, multiple application solutions, and multiple Digital Technologies across various architectures. Individuals at this level provide thought leadership and strategy to drive transformational change within Caterpillar and Digital.