Lead Hadoop Engineer
What We'll BringAt TransUnion, we have a welcoming and energetic environment that encourages collaboration and innovation we’re consistently exploring new technologies and tools to be agile. This environment gives our people the opportunity to hone current skills and build new capabilities, while discovering their genius.
Come be a part of our team – you’ll work with great people, pioneering products and cutting-edge technology.
What You'll BringWhat You’ll Bring
Bachelor’s degree in computer science or a related discipline.
8+ years of database/application development in an enterprise environment.
5+ years of hands-on experience designing and implementing data pipelines in production using Hadoop ecosystem such as MapReduce, Hive, HBase, Spark, Sqoop, Oozie, Pig etc
Solid experience in writing SQL, stored procedures, query performance tuning preferably on SQL server.
Experience collaborating with data scientists for model development
Extensive experience in Python and Bash Shell Scripting
Broad knowledge of software development – including software architecture, functional and non-functional aspects, CI/CD, principles and tools.
Experience working in agile teams.
We’d Love to See
Master’s degree in computer science or related discipline
Experience writing production code in Java or Scala
Strong understanding of cloud application development best, preferably in AWS
Working knowledge of Kubernetes, Helm and Docker
Healthcare industry experience is a big plus
Impact You'll MakeYou’ll operate as a key member on one of the core teams responsible for enabling new features and optimizing our multi-petabyte platforms that support a diverse community of internal and customer based data scientists, statisticians, modelers, product developers and data strategists.
You’ll assist in technology innovation actives such as research, evaluations, and prototyping.
Deploy and Implement leading-edge analytics environments including software, end-user tools, and other data services.
You’ll collaborate with product owners and team members on requirements and implementation approaches for addressing demand and challenges.
You’ll Design and develop tools and services enabling end-user productivity and system integrations.