DATA ENGINEER
Description
BE EMPOWERED & INSPIRED
We create an inclusive and diverse work environment because different perspectives result in the best ideas.
The Product Support & Logistics Division currently has an opening for a Data Engineer in our Chicago, IL facility. This position will be responsible for building scalable, high performance infrastructure and data driven and predictive analytics applications that provide actionable insights across all Caterpillar businesses. The position will work with highly motivated engineers who tackle challenges and problems that are critical to realizing significant business outcomes. Data engineers work with data scientists, business analysts, and others as part of a team that assembles large, complex data sets that provide competitive advantage.
Job Duties/Responsibilities may include, but are not limited to:
Build infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources
Design, develop, and maintain performant and scalable applications
Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability
Perform debugging, troubleshooting, modifications and unit testing of integration solutions
Operationalize the developed jobs and processes
Create databases and infrastructure to processing data at scale
Create solutions and methods to monitor systems and solutions
Automate code testing and pipelines
Engage directly with business partners to participate in design and development of data integration/transformation solutions per functional requirements.
Work in a scaled Agile environment accountable to deliver results in sprints.
Engage and actively seek industry perspectives through external engagements such as hackathons, peer groups, etc.
Generate, prepare, and catalog APIs
Work with UI Designer to build user interfaces per design specifications
Employee is also responsible for performing other job duties as assigned by Caterpillar management from time to time
Qualifications
Basic Qualifications:
BS in Computer Science, Computer Engineering, or Engineering related fields.
3-4 years software development experience with object-oriented/object function scripting languages: Python, Java, Javascript, C++, Scala, etc.
Understanding of data structures, algorithms, profiling & optimization.
Understanding of SQL, ETL design, and data modeling techniques
Top Candidates Will Also Have:
Passion for acquiring, analyzing, and transforming data to generate insights.
Thrive in a fast-paced environment that delivers results and has fun.
Strong analytical ability, judgment and problem analysis techniques.
Working knowledge of Agile Software development methodology.
Solid understanding of concepts of cloud computing.
Great verbal and written communication skills to collaborate cross functionally and enhance scalability.
Interpersonal skills with the ability to work effectively in a cross functional team.
Strong working relationships with data owners/stewards
Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
A successful history of manipulating, processing and extracting value from large disconnected datasets.
Experience with big data tools: Hadoop, Spark, Kafka, etc.
Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.
Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
Experience with AWS cloud services: EC2, EMR, RDS, Redshift
Experience with stream-processing systems: Storm, Spark-Streaming, etc.
Experience with API managers: Apigee, Azure, Catana, etc.
Caterpillar is not currently hiring individuals for this position who now or in the future require sponsorship for employment visa status; however, as a global company, Caterpillar offers many job opportunities outside of the U.S. which can be found through our employment website at www.caterpillar.com/careers.
#Li