Senior Data Engineer
We’re looking for a Senior Data Engineer for our New York office to join us in building our next generation data processing platform. As part of the platform team you will work in multiple areas including campaign performance measurement and reporting, ad fraud, and botnet detection.
Are you someone who likes to have fun at work? Are you passionate about picking problems apart, driving results, and making an impact? Do you enjoy working in a fast-paced, dynamic environment where no two days are the same? If so, we want to speak with you!
Our platform is the engine that powers the verification, optimization, and analytics solutions we provide. It has the power to handle hundreds of thousands of transactions per second; collect tens of billions of events each day and evaluate thousands of data-points in real-time all while responding in just a few milliseconds.
What you'll do:
- Work on Big Data technologies such as Hadoop, MapReduce, Kafka, Spark/Spark Streaming and columnar databases
- Lead the design, coding and maintenance of highly scalable backend data platform for processing large throughput with controllable latency in both batch and streaming modes
- Lead the entire software lifecycle including hands-on development, code reviews, testing, continuous integration, continuous deployment and documentation for streaming & batch data processing and RESTful API's using modern programming languages (such as java, scala, python)
- Perform tuning of loaded system using statistics, queueing theory, parallel computing and advanced data structures
- Mentor junior team members
What you'll need:
- 8+ years of recent hands-on experience in one or more of the modern programming languages (Java, Scala, Python)
- Strong knowledge of collections, multi-threading, JVM memory model, etc.
- Great understanding of designing for performance, scalability, and reliability
- Superb understanding of algorithms, scalability and various tradeoffs in a Big Data setting
- In-depth understanding of object oriented programming concepts
- Excellent interpersonal and communication skills
- Understanding of full software development life cycle, agile development and continuous integration
- Good knowledge of Linux command line tools
- Experience with Hadoop MapReduce, Spark, Pig
- Solid understanding of database fundamentals, good knowledge of SQL
What puts you over the top:
- Exposure to messaging frameworks like Kafka or RabbitMQ
- Some exposure to functional programming languages like Scala
- Experience with Spark
About Integral Ad Science
Integral Ad Science (IAS) is the global market leader in digital ad verification, offering technologies that drive high-quality advertising media. IAS equips advertisers and publishers with both the insight and technology to protect their advertising investments from fraud and unsafe environments as well as to capture consumer attention, and drive business outcomes. Founded in 2009, IAS is headquartered in New York with global operations in 22 offices across 15 countries. IAS is part of the Vista Equity Partners portfolio of software companies. For more on how IAS is powering great impressions for top publishers and advertisers around the world, visit integralads.com.
Equal Opportunity Employer:
IAS is an equal opportunity employer, committed to our diversity and inclusiveness. We will consider all qualified applicants without regard to race, color, nationality, gender, gender identity or expression, sexual orientation, religion, disability or age. We strongly encourage women, people of color, members of the LGBTQIA community, people with disabilities and veterans to apply.
To learn more about us, please visit http://integralads.com/ and https://muse.cm/2t8eGlN
Attention agency/3rd party recruiters: IAS does not accept any unsolicited resumes or candidate profiles. If you are interested in becoming an IAS recruiting partner, please send an email introducing your company to [email protected]. We will get back to you if there's interest in a partnership.