NVIDIA is hiring a Senior Software Engineer to work on improving the data ingestion platform in our Autonomous Vehicles division! As a Data Ingestion engineer for Autonomous Vehicles Infrastructure, you will play a crucial role in managing and optimizing the flow of data from various sources into our AV systems. Your primary focus will be on ensuring the seamless ingestion and efficient serving of AV data to support critical operations.
What you'll be doing:
Implement and maintain data ingestion pipelines from diverse sources, ensuring a continuous and reliable flow of AV data into the system.
Design and optimize data serving mechanisms to deliver AV data to different teams and applications in real-time and batch processing scenarios.
Monitor data pipelines and services to proactively identify and resolve any issues, ensuring data availability and reliability.
Collaborate with cross-functional teams to improve data processing efficiency, reduce latency, and enhance overall system performance.
Implement validation and data quality checks to ensure the integrity and accuracy of ingested data.
Scale data infrastructure to handle the ever-increasing volumes of AV data generated by our expanding fleet of vehicles.
Create and maintain detailed documentation for data ingestion and serving processes, ensuring knowledge sharing across the team.
Work closely with the AV development team to understand data requirements and contribute to the enhancement of data-driven solutions.
What we need to see:
Bachelor's degree in Computer Science, Engineering, or related field (or equivalent experience).
8+ years of relevant experience working on autonomous vehicles and/or software infrastructure.
Extensive expertise in developing distributed systems.
Proven experience in designing and building data ingestion pipelines for large-scale systems.
Strong proficiency in data warehousing concepts, data modeling, and database management systems.
Proficient in Go, C++ and have experience with scripting languages such as Python or Matlab in a Linux environment
Familiarity with distributed computing frameworks like Apache Spark or Hadoop.
Hands-on experience with data streaming technologies (e.g., Kafka, RabbitMQ) is a plus.
Knowledge of cloud-based platforms (AWS, GCP, or Azure) and containerization (Docker/Kubernetes).
Excellent problem-solving skills and the ability to work in a fast-paced, collaborative environment.
You will also be eligible for equity and benefits.
This posting is for an existing vacancy.
NVIDIA uses AI tools in its recruiting processes.
NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.Similar Jobs
.jpg){kind=logo}
What you need to know about the Chicago Tech Scene
Key Facts About Chicago Tech
- Number of Tech Workers: 245,800; 5.2% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: McDonald’s, John Deere, Boeing, Morningstar
- Key Industries: Artificial intelligence, biotechnology, fintech, software, logistics technology
- Funding Landscape: $2.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Pritzker Group Venture Capital, Arch Venture Partners, MATH Venture Partners, Jump Capital, Hyde Park Venture Partners
- Research Centers and Universities: Northwestern University, University of Chicago, University of Illinois Urbana-Champaign, Illinois Institute of Technology, Argonne National Laboratory, Fermi National Accelerator Laboratory
