Staff Big Data Engineer

Apply now
By clicking continue you agree to Built In’s Privacy Policy and Terms of Use.

Integral Ad Science (IAS) is a global technology and data company that builds verification, optimization, and analytics solutions for the advertising industry. Our technology handles hundreds of thousands of transactions per second; collects tens of billions of events each day; and evaluates thousands of data-points in real-time all while responding in just a few milliseconds.

We are looking for an experienced Big Data Engineer to join our Data Engineering team. This position will be the Senior technical resource driving architecture for the integration of large 3rd party partner integrations with companies like Facebook, Google and Twitter to name a few. The ideal candidate is naturally curious, dedicated, detail-oriented with a strong desire to work with awesome people in a highly collaborative environment. This position will require the ability to own and lead data initiatives on a cross-functional team. 

What you’ll do: 

  • Migrate existing data pipelines from on-prem regional data centers to AWS and GCP.
  • Architect a new modern event driven architecture with both batching and streaming
  • Adjust existing pipelines to fit the AWS processing model such as integration with S3, migrate to open source version of hadoop, adjustments to security model, etc...
  • Working on Big Data technologies such as Hadoop, MapReduce, Kafka, and/or Spark in columnar databases
  • Architect, design, code and maintain components for aggregating tens of billions of daily transactions
  • Lead the entire software lifecycle including hands-on development, code reviews, testing, deployment, and documentation for streaming and batch ETL's and RESTful API's
  • Partner and work closely with the QA Engineers to develop automated tests
  • Participate in training and mentoring of junior team members

Apply if you have most of this: (We have flexibility in this role to consider more, or marginally lesser, experience than requested below)

  • 8+ years of experience designing and building data-intensive applications
  • 5+ years architecting systems in a big data ecosystem using MapReduce, Spark, MPP Data Warehouses, and sql/nosql databases.
  • 5+ years recent hands-on experience with object oriented languages (Java, Scala, Python) 
  • 5+ years Hands on experience building production level systems in a cloud environment (AWS or GCP)
  • Excellent interpersonal and communication skills in English
  • Proven experience leading the design and execution of event driven architectures for distributed systems 
  • Experience designing systems for performance, scalability, and reliability
  • In-depth understanding of object oriented programming concepts
  • Low level working knowledge of collections, multi-threading, JVM memory model, etc.
  • Solid understanding of database fundamentals and SQL
  • Understanding the full software development life cycle, agile development and continuous integration
  • Ability to clearly communicate with team-members in a cross-matrix environment

What puts you over the top:

  • Built systems in a containerized environment with familiarity in Docker, ECS, Kubernetes
  • Exposure to Data Warehousing solutions like Snowflake and BigQuery
  • Prior ad tech experience

About Integral Ad Science

Integral Ad Science (IAS) is the global market leader in digital ad verification, offering technologies that drive high-quality advertising media. IAS equips advertisers and publishers with both the insight and technology to protect their advertising investments from fraud and unsafe environments as well as to capture consumer attention, and drive business outcomes. Founded in 2009, IAS is headquartered in New York with global operations in 18 offices across 13 countries. IAS is part of the Vista Equity Partners portfolio of software companies. For more on how IAS is powering great impressions for top publishers and advertisers around the world, visit integralads.com.

Equal Opportunity Employer:

IAS is an equal opportunity employer, committed to our diversity and inclusiveness. We will consider all qualified applicants without regard to race, color, nationality, gender, gender identity or expression, sexual orientation, religion, disability or age. We strongly encourage women, people of color, members of the LGBTQIA community, people with disabilities and veterans to apply.

California Applicant Pre-Collection Notice:

We collect personal information (PI) from you in connection with your application for employment or engagement with IAS, including the following categories of PI: identifiers, personal records, commercial information, professional or employment or engagement information, non-public education records, and inferences drawn from your PI. We collect your PI for our purposes, including performing services and operations related to your potential employment or engagement. For additional details or if you have questions, contact us at [email protected]

To learn more about us, please visit http://integralads.com/ and https://muse.cm/2t8eGlN

Attention agency/3rd party recruiters: IAS does not accept any unsolicited resumes or candidate profiles. If you are interested in becoming an IAS recruiting partner, please send an email introducing your company to [email protected] We will get back to you if there's interest in a partnership.

Read Full Job Description
Apply now
By clicking continue you agree to Built In’s Privacy Policy and Terms of Use.

Technology we use

  • Engineering
  • Product
  • Sales & Marketing
    • JavaLanguages
    • JavascriptLanguages
    • KotlinLanguages
    • PythonLanguages
    • RLanguages
    • ScalaLanguages
    • SqlLanguages
    • jQueryLibraries
    • jQuery UILibraries
    • Twitter BootstrapLibraries
    • AngularJSFrameworks
    • HadoopFrameworks
    • Node.jsFrameworks
    • SpringFrameworks
    • CassandraDatabases
    • HBaseDatabases
    • HiveDatabases
    • MemcachedDatabases
    • MongoDBDatabases
    • MySQLDatabases
    • RedisDatabases
    • IllustratorDesign
    • InVisionDesign
    • PhotoshopDesign
    • SketchDesign
    • Aha!Management
    • ConfluenceManagement
    • JIRAManagement
    • SmartsheetManagement
    • AgileManagement
    • WordpressCMS
    • InsightlyCRM
    • SalesforceCRM
    • MarketoEmail
    • MarketoLead Gen

Location

At the corner of State & Madison in The Loop, IAS is just a short walk away from Millennium Park, the Chicago Riverwalk, and more.

An Insider's view of Integral Ad Science

What are some social events your company does?

IAS has several employee groups - whether it’s for philanthropy, diversity, or even intramural sports - dedicated to creating opportunities for employees across the organization to meet, get together, and join efforts toward great causes. Plus, teams across the world also host fantastic summer and winter holiday parties each year.

Stephanie

Internal Marketing Associate

What makes someone successful on your team?

Success at IAS is built on raising your hand, diving in headfirst, and getting things done. IAS values curiosity, innovation and big thinking. We are results-oriented and move at high velocity as one team.

Steven

Talent Operations Manager

How do you make yourself accessible to the rest of the team?

I have always been a big believer that feedback is a gift. I encourage our employees at IAS to send me ideas directly so that I can hear directly from our employees. I’ve heard some really great ideas already. We actually changed our parental leave policy within the first few weeks I was here because of notes I received from the team.

Lisa

Chief Executive Officer

How has your career grown since starting at the company?

I get a lot of support from my direct manager, and from other managers that have helped me shape my own position and career trajectory based on things that interest me. Within 6 months I was able to shift what I was working on and take on new responsibilities on the specific areas I was interested in.

Khemi

Product Manager, Proprietary Platforms

What are Integral Ad Science Perks + Benefits

Integral Ad Science Benefits Overview

We want our employees to stay happy, healthy, and inspired. At IAS, we offer unlimited PTO, comprehensive health insurance, employer 401k match, and much more - from an employee volunteer program to happy hours and snacks in the office.

Culture
Volunteer in local community
Partners with Nonprofits
Friends outside of work
Eat lunch together
Intracompany committees
Daily stand up
Open door policy
Team owned deliverables
Team based strategic planning
Group brainstorming sessions
Pair programming
Open office floor plan
Diversity
Dedicated Diversity/Inclusion Staff
Highly diverse management team
Health Insurance & Wellness Benefits
Flexible Spending Account (FSA)
Disability Insurance
Dental Benefits
Vision Benefits
Health Insurance Benefits
Life Insurance
Pet Insurance
Wellness Programs
Onsite Gym
Retirement & Stock Options Benefits
401(K)
401(K) Matching
Performance Bonus
Child Care & Parental Leave Benefits
Generous Parental Leave
Flexible Work Schedule
Family Medical Leave
Vacation & Time Off Benefits
Unlimited Vacation Policy
Generous PTO
Paid Volunteer Time
Paid Holidays
Paid Sick Days
Perks & Discounts
Beer on Tap
Casual Dress
Commuter Benefits
Company Outings
Game Room
Our game room includes Pool Table, Foosball, Video Games.
Stocked Kitchen
Some Meals Provided
Employees get free lunch on Friday.
Happy Hours
Happy hours are hosted On occasion .
Recreational Clubs
IAS sponsors group sports like Basketball, Soccer and Volleyball.
Fitness Subsidies
Professional Development Benefits
Diversity Program
Lunch and learns
Cross functional training encouraged
Promote from within
Mentorship program
Our mentorship is part of our Manager Program and Internship Program.
Time allotted for learning
Online course subscriptions available
Customized development tracks
More Jobs at Integral Ad Science11 open jobs
All Jobs
Data + Analytics
Dev + Engineer
Legal
Operations
Sales
Data + Analytics
new
Chicago
Data + Analytics
new
Chicago
Developer
new
Chicago
Data + Analytics
new
Chicago
Data + Analytics
new
Chicago
Data + Analytics
new
Chicago
Developer
new
Chicago
Operations
new
Chicago
Data + Analytics
new
Chicago
Apply now
By clicking continue you agree to Built In’s Privacy Policy and Terms of Use.
Save jobView Integral Ad Science's full profileSee more Integral Ad Science jobs