Senior Data Engineer

| Chicago

At Sprout Social, we build software used by 20,000 companies to create stronger relationships with their customers and create the world’s most beloved brands. As a SaaS product used 24/7/365 by organizations of all sizes, sectors, and geographies, we consume and generate vast amounts of data which hold great potential to improve our business and products. We’re looking for a passionate data engineer to contribute to our data engineering practice within the data analytics and data science teams to ensure business stakeholders and data scientists get the data they need to drive reporting, analytics and machine learning at Sprout.

Relying on your experience with data warehousing and writing ETL pipelines, you will enable analytics and data science teams to provide critical insights and new product features to Sprout. Our systems touch and are used by all parts of Sprout’s business, from integrating data from across Sprout’s varying databases and partner APIs, to creating and maintaining the event service leveraged by Sprout’s product teams. Our team uses a variety of technologies, including Python, Java, Spark, Redshift, Airflow, EMR, Elasticsearch, Docker, and Kinesis.

We’re building diverse, collaborative teams that get the best results sustainably. Embedded as a member of data science and analytics team, you will work in tandem with data analysts, data scientists and business stakeholders to define requirements for data warehousing and services. 

We’re looking for a creative, collaborative, highly motivated, and inquisitive learner to build great software with us. If you confidently write data pipelines and warehouses that process and store terabytes, can write Python or Java-based services to serve up data, and are passionate about learning, we’d love to talk with you!

We’re looking for Data Engineers that have a great track record of:

  • Building and maintaining ETL pipelines and data warehousing.
  • Conducting software development in Python and/or Java, owning the entire development lifecycle, from development and testing, to deployment, monitoring and maintenance.
  • Experience with relational and non-relational databases.
  • Programmatic development of ETL pipelines through software such as Airflow, Luigi, etc.
  • Experience using and deploying to cloud-based platforms such as AWS, Azure or Google Cloud.
  • Experience working with data scientists, analysts and other business stakeholders to define data warehousing needs. 

Within 1 month, you will:

  • Complete Sprout’s New Hire training program alongside other new Sprout team members.
  • Become familiar with data sources available in our data lake.
  • Learn about Airflow and our ETL processes.
  • Pair with our other senior data engineer to learn about the libraries and processed owned by data engineering.
  • Begin meeting with data science stakeholders to understand existing responsibilities and needs.

Within 3 months, you will:

  • Add data sources to our production data warehouse.
  • Modify and/or write new data pipelines using Airflow and push them to production.
  • Become familiar with our Java-based service used to store and process all events produced by Sprout’s products.
  • Work with data science and business stakeholders to develop technical requirements for new data sources and services.

Within 6 months, you will:

  • Develop data processing pipelines using EMR and Spark.
  • Serve as on-call for support rotations.
  • Take ownership and improve existing ETL jobs in Airflow, processing hundreds of millions of data points a day.
  • Help develop processes for monitoring and alerting around our data warehouse, ETL jobs and services.
  • Form a career growth plan with your manager and work towards it.

Within 12 months, you will:

  • Help develop new frameworks and libraries to allow the data science team to iterate more quickly on new ETL and data sources.
  • Own the event-generation service used across Sprout’s products.
  • Help improve our existing deployment procedures.
  • Identify technical debt and performance bottlenecks within our systems, come up with a plan to improve the code, and get it pushed to production.
  • Create processes to improve the integrity of data stored in our data warehouse.
  • Expand your skills by learning from other engineers around Sprout.
  • Optimize Redshift tables for use in serving data into Tableau dashboards and data science models used by the whole company.
  • Surprise us! Use your unique ideas and abilities to change your team in beneficial ways that we haven’t even considered yet.

Optional: When applying, please share work samples, projects, or publications.

About Sprout Social
Sprout Social powers open communication between individuals, brands and communities through elegant, sophisticated software. We are relentless about solving hard problems for our customers and committed to both customer and team success.

Team Sprout is a group of very talented, smart and passionate people with broad interests and backgrounds. We’re proud to regularly be recognized for software, product and company culture achievements. Our team’s shared belief in Sprout’s mission promotes a culture of openness, empowerment and fun. We have built a benefits program to match the strength of our team. This program includes:

  • Insurance and benefit options that are built for both individuals and families, including generous company contributions
  • Progressive benefit programs, like our parental leave program 
  • High-quality and well-maintained equipment - your computer will never prevent you from doing your best
  • Beautiful, convenient and state-of-the-art offices in Chicago and Seattle
  • Solid programs in some of the staples: transportation, disability and life insurance
  • Wellness initiatives to ensure both health and financial well-being of our team
  • Breakfast and lunch options onsite, and more healthy snack options and beverages than you can imagine
  • Growing corporate social responsibility program that is driven by the involvement and passion of our team members

Sprout Social is proud to be an Equal Opportunity Employer and an Affirmative Action Employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, marital status, order of protection status, citizenship status, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law. If you need a reasonable accommodation for any part of the employment process, please
contact us by email at [email protected] and let us know the nature of your request and your contact information. Requests for accommodation will be considered on a case-by-case basis. Please note that only inquiries concerning a request for reasonable accommodation will be responded to from this email address.
 
For more information about our commitment to equal employment opportunity, please
click here (1) Equal Opportunity Employment Poster and (2) Sprout Social's Affirmative Action Statement.
 
Additionally, Sprout Social participates in the E-Verify program in certain locations, as required by law. We value the things that make us different and want to see how you can make our team better!

Read Full Job Description

Technology we use

  • Engineering
  • Sales & Marketing
    • JavaLanguages
    • JavascriptLanguages
    • PythonLanguages
    • SqlLanguages
    • SwiftLanguages
    • D3JSLibraries
    • ReactLibraries
    • ReduxLibraries
    • DjangoFrameworks
    • HadoopFrameworks
    • CassandraDatabases
    • HBaseDatabases
    • MySQLDatabases
    • RedisDatabases
    • SalesforceCRM

Location

131 S Dearborn, 7th Floor, Chicago, IL 60603

What are Sprout Social Perks + Benefits

Sprout Social Benefits Overview

We’re proud to regularly be recognized for software, product and company culture achievements. Our team’s shared belief in Sprout’s mission promotes a culture of openness, empowerment, and fun. We have built a benefits program to match the strength of our team. This program includes:

*Insurance and benefit options that are built for both individuals and families, including generous company contributions
*Progressive benefit programs, like our parental leave program and free Divvy bike memberships
*High-quality and well-maintained equipment - your computer will never prevent you from doing your best
*Beautiful, convenient and state-of-the-art offices in Chicago’s Loop
*Solid programs in some of the staples: transportation, disability, and life insurance
*Wellness initiatives to ensure both health and financial well-being of our team
*Breakfast and lunch options onsite, and more healthy snack options and beverages than you can imagine
*Growing corporate social responsibility program that is driven by the involvement and passion of our team members

Culture
Volunteer in local community
Partners with Nonprofits
Friends outside of work
Eat lunch together
Intracompany committees
Daily stand up
Open door policy
Team owned deliverables
Team based strategic planning
Group brainstorming sessions
Pair programming
Open office floor plan
Diversity
Documented equal pay policy
Dedicated Diversity/Inclusion Staff
Unconscious bias training
Diversity manifesto
Someone's primary function is managing the company's diversity and inclusion initiatives
Health Insurance & Wellness Benefits
Flexible Spending Account (FSA)
Disability Insurance
Dental Benefits
Vision Benefits
Health Insurance Benefits
Life Insurance
Pet Insurance
Wellness Programs
Onsite Gym
Retirement & Stock Options Benefits
401(K)
401(K) Matching
Company Equity
Child Care & Parental Leave Benefits
Generous Parental Leave
Remote Work Program
Family Medical Leave
Vacation & Time Off Benefits
Unlimited Vacation Policy
Generous PTO
Paid Volunteer Time
Paid Holidays
Paid Sick Days
Perks & Discounts
Beer on Tap
Casual Dress
Commuter Benefits
Company Outings
Free Daily Meals
Game Room
Stocked Kitchen
Happy Hours
Fitness Subsidies
Professional Development Benefits
Job Training & Conferences
Diversity Program
Lunch and learns
Promote from within
Mentorship program
Online course subscriptions available
Customized development tracks
More Jobs at Sprout Social28 open jobs
All Jobs
Data + Analytics
Dev + Engineer
Marketing
Operations
Product
Project Mgmt
Sales
Content
Sales
new
Chicago
Operations
new
Chicago
Developer
new
Chicago
Developer
new
Chicago
Content
new
Chicago
Product
new
Chicago
Marketing
new
Chicago
Developer
new
Chicago
Sales
new
Chicago
Sales
new
Chicago
Sales
new
Chicago
Project Mgmt
new
Chicago
Sales
new
Chicago
Product
new
Chicago
Developer
new
Chicago
Sales
new
Chicago
Operations
new
Chicago
Data + Analytics
new
Chicago
Sales
new
Chicago
Sales
new
Chicago
Data + Analytics
new
Chicago