Staff / Principal Data Engineer

| Chicago | Hybrid
Sorry, this job was removed at 6:52 p.m. (CST) on Tuesday, April 11, 2023
Find out who's hiring in Chicago.
See all Developer + Engineer jobs in Chicago
Apply
By clicking Apply Now you agree to share your profile information with the hiring company.

SpotHero is seeking a Staff/Principal Data Engineer to join the Data Engineering squad. This squad interacts with data consumers such as Data Science, Marketing, Engineering and Business Analysts to provide data platform solutions that meet their day-to-day needs and long term vision.


As a Staff/Principal Data Engineer, you’ll focus heavily on backend application development with a focus on building re-usable infrastructure services for our stakeholders to enable them to model, store, access, process, and analyze SpotHero’s data. You’ll also design, instantiate, observe and maintain infrastructure services, both AWS-managed and open source solutions. As a Staff/Principal Data Engineer, you’ll influence the technology choices and patterns established for data-heavy workloads at SpotHero. 


Who we are:

SpotHero is a parking reservation service that helps drivers find and reserve parking at thousands of lots and garages in all major cities. We are on a mission to bring the parking industry into the future through technology. Drivers in the U.S. and Canada use the SpotHero mobile app or website to reserve convenient, affordable parking on-the-go or in advance, and parking companies rely on us to help them reach new customers while optimizing their business. We combine hard-won industry knowledge, a large parking demand and supply dataset, and solid software engineering to serve both sides of the parking market. SpotHero leads by flexibility when it comes to a daily working environment and this role is open to candidates based in Illinois, New York, California, Washington State, Texas, Maryland, Ontario, British Columbia, and Nova Scotia. Full-time remote candidates in any of these locations are encouraged to apply! 


What will you do:

  • Work with our analytics, marketing and data science teams to understand our data processing needs.
  • Be a key hands-on contributor to the design and implementation of our data platform solutions from the infrastructure layer up to the API.
  • Model and architect our data in a way that will scale with the increasingly complex ways we’re analyzing it.
  • Build robust pipelines that make sure data is where it needs to be, when it needs to be there.
  • Build frameworks and tools to help our software engineers, data analysts, and data scientists design and build their own data pipelines in a self-service manner.
  • Performance testing and engineering to ensure that our systems always scale to meet our needs.
  • Be a key member of the team focused on pure hands-on contribution to the implementation and operation of our data platform.
  • Contribute to more junior team members' development, via thoughtful reviews and your own exemplary work


Key Responsibilities: 

  • Data Modeling/Architecting
    • Design data models with a broader understanding of underlying systems.
    • Create approachable, thorough documentation of data models describing how to access their data in a performant way.
    • Build performant models that are consistent with accompanying documentation that are built with quality in mind.
    • Consult with stakeholders on the best practices for creation and deployment of data models and data flows.
  • Data Processing
    • Define and enforce service level agreements between products owned and stakeholders, including configuration of monitoring and alerting.
    • Understand data lineage and dependencies between data pipeline.
    • Design, implement, and maintain complex data processing pipelines which involve multiple integration points, including those which rely on distributed systems like Kafka and Spark.
    • Influence data processing and infrastructure practices across all of SpotHero.
    • Determine the best architecture, batch or streaming, for applications being built.
  • Working with Infrastructure
    • Evaluate different architectures for new systems or changes to the company’s existing systems, and propose thorough, specific designs for implementing those architectures.
    • Provision new infrastructure in cloud environments.
    • Deploy and manage containerized applications running in Kubernetes.
    • Identify and remedy security, cost, and maintainability issues in the team’s infrastructure.
    • Manage and integrate autoscaling, logging, monitoring and alerting for the team’s systems.
  • Working with Infrastructure
    • Proficient at  provisioning new infrastructure across environments. 
    • Capable of  managing/integration autoscaling, logging, monitoring and alerting for the system. Your infrastructure as code is environment agnostic.


Your experience:

We care about your abilities, not how you gained them.

You might demonstrate the capabilities below through any combination of relevant professional experience, experience in a research setting, formal education, self-guided learning, open source contributions, or public speaking / writing / teaching experience.


  • You are able to design and implement high-quality software in Python and at least one JVM language (we use Kotlin, but Java or Scala experience works).
  • Strong SQL skills and data modeling experience. 
  • You have experience provisioning and managing infrastructure with infrastructure-as-code tools (we use Terraform, but experience with similar tools like CloudFormation, Pulumi, or SaltStack is ok).
  • Hands-on experience using multiple data platforms and tools (e.g. Airflow, Hive, Kafka, Postgres, Redshift, S3, Spark, Trino), and experience deploying, monitoring, and maintaining some of them.
  • Experience designing and implementing software (pipelines, services and client libraries) that is run in Docker containers, automatically tested on a continuous integration (CI) system, and versioned in git. You have experience writing shell scripts, Makefiles, or other configuration to glue together these components.
  • Ability to deploy containerized software in Kubernetes, or sufficient experience in similar technologies like Apache Mesos or Amazon ECS.
  • Experience designing and implementing architectures that rely on cloud compute, networking, storage, and security services (we’re an AWS shop, but similar experience in Azure or GCP is ok if you’re willing to learn).
  • Demonstrated experience designing and supporting technology intended to be used by other stakeholders. 
  • Passion for ensuring timeliness, availability and quality of our highest value data-sets that meets established SLOs.
  • Comfortable working on a small team with minimal direction.
  • Demonstrated experience measuring the impact of technology solutions.
  • Strong ability to communicate on both business and technical subjects.


Nice to Haves:

  • Message driven or streaming architectures, such as those with Kafka, Spark, Flink.
  • Postgres, MySql, or other RDBMS experience.
  • Redshift, Presto, or other MPP database experience.
  • Experience with cloud data pipeline services like dbt Cloud, Fivetran, or Hightouch.
  • Airflow, Luigi, or other ETL scheduling tool experience.
  • Experience contributing to open source projects that are relevant to data engineering and data science.


Technology we use:

  • Our Android Stack is: Kotlin and XML (standard for Android apps) using MVI architecture (still working on refactoring old views), our database layer is built in Realm. Bitrise for CI/CD. We also make heavy use of Dagger, RxJava, Espresso (testing). Network stack uses Retrofit.
  • Our iOS Stack isSwift using MVC architecture, CoreData for Local Storage, XCUI for UI Testing, XCTest for Unit testing, SPM for Package Management, Fastlane for app automation and build scripts, Bitrise for CI/CD, and Sentry for crash reporting.
  • Our Back End Stack is: Monolith using Django/Python/PostgreSQL. We are moving our Monolith to a Modular Monolith, using Domain Driven Design. When relevant we extract specific domains to Services currently using Java, Kotlin and Go. We also use Docker, deploy our apps via Kubernetes. We use Kafka for asynchronous-, and gRPC for synchronous service-to-service communication. Our Integrations are on a .Net CORE, moving to Kotlin.
  • Our Front End Stack is: Our Front End stack is React/Redux, Sass, Jest/React Testing Library/Cypress, and Webpack. We maintain a private npm repository with shareable UI components, utility functions, Babel/ESLint/Prettier configurations, and custom tasks
  • Our Data Stack is: Our Monolith Database is Postgres and Redis for caching. We also use Redshift as our data warehouse and S3 as our data lake. The data lake is queried using Presto. We use Airflow and Spark for ETL, as well as do some stream processing (Kafka Streams and Spark at the moment). Our Model pipeline uses scikit-learn, pandas. Our analysts utilize Looker as our Business Intelligence tool. And we use Quicksight for Dashboard on our external Data Products.
  • Our Dev Tools Stack is: AWS+Kubernetes for hosting. Terraform + Helm Charts for IaaS/Deployment. ConcourseCI for CI/CD. Prometheus/Alertmanager/VictorOps for team alerting. We’re starting to work on multi-region available services.


What we are offering:

  • Career game changer – A truly unique experience to work for a fast-growing startup in a role with unlimited potential for growth.
  • Excellent benefits – 
    • In the US we cover up to 95% of Medical Premiums, 50% of Dental & Vision Premiums, company sponsored Life Insurance, 401K, and generous parental leave. 
    • In Canada we offer Medical (prescription drug and paramedical coverage), Dental, Vision, Life Insurance, STD and LTD
  • Flexible PTO policy and great work/life balance – We value and support each individual team member.
  • Annual parking stipend – we help people park!
  • The opportunity to collaborate with fun, innovative, and passionate people in a casual, yet highly productive atmosphere.
  • A workplace recognized as the Best Consumer Web Company by Built in Chicago, Top Company Culture by Entrepreneur, a Top Workplace by Chicago Tribune, and one of Chicago’s Best Places to Work for Women Under 35 by Crain’s Chicago Business. 


Steps to apply: Please include any GitHub account, LinkedIn profile, and any project that you’re particularly proud of. We love seeing work that others loved working on.


At SpotHero, we Respect Fellow Drivers by providing an inclusive interview experience for everyone, including people with disabilities. We are happy to provide reasonable accommodations to candidates in need of individualized support during the hiring process. Please let our team know of your need when you apply or as you begin interviewing with our team.


Additionally, because we want to Remember to Signal, if you choose to provide us personal information in connection with a job application, please review our Applicant Privacy Notice which provides details about what information we collect and process about you in order to consider your candidacy.


SpotHero is an equal opportunity employer. We know that a diverse workforce is the strongest workforce, and are committed to building and supporting an inclusive environment for all.

Read Full Job Description
Apply Now
By clicking Apply Now you agree to share your profile information with the hiring company.

Technology we use

  • Engineering
  • Product
  • Sales & Marketing
    • GolangLanguages
    • JavaLanguages
    • JavascriptLanguages
    • KotlinLanguages
    • PythonLanguages
    • ScalaLanguages
    • ReactLibraries
    • DjangoFrameworks
    • HiveDatabases
    • MySQLDatabases
    • PostgreSQLDatabases
    • RedisDatabases
    • Google AnalyticsAnalytics
    • MixpanelAnalytics
    • OptimizelyAnalytics
    • AxureDesign
    • IllustratorDesign
    • InVisionDesign
    • PhotoshopDesign
    • SketchDesign
    • ConfluenceManagement
    • JIRAManagement
    • SmartsheetManagement
    • TrelloManagement
    • WordpressCMS
    • SalesforceCRM
    • BrazeCRM
    • MailChimpEmail
    • MandrillEmail
    • Oracle ResponsysEmail
    • MarketoLead Gen

Location

Our custom built office is located in the heart of the Loop, close to the Brown, Orange, Pink, Purple, and Red Lines.

An Insider's view of SpotHero

What’s the vibe like in the office?

There's a lot of collaboration and positive energy throughout the entire day at SpotHero. There are a lot of funny people that work at SpotHero; it's hard to get through the day without a few genuine hearty laughs, which is a really fun way to take a break from being nose deep in a project.

Michelle

Account Executive

How does the company support your career growth?

There’s so much room to grow at SpotHero. From the very beginning, I was encouraged to think about my career goals and steps I could take towards achieving them. I recently made the transition to a new team, and everyone has been incredibly supportive as I learn a new skill set and look to further grow my career!

Maggie

Digital Marketing Specialist

What is your vision for the company?

I joined SpotHero to contribute to the future of mobility as I imagine walking down the street with my pre-school aged children one day and being able to point out aspects of the mobility ecosystem that I played a role in building. In this vein, I believe SpotHero will emerge as the platform that powers the last quarter mile of mobility.

Paolo

Chief Business Officer

What are SpotHero Perks + Benefits

SpotHero Benefits Overview

We offer our employees a way to find community through Employee Resource Groups. We currently have six different established groups and evaluate offerings on a semi-annual basis.

In the US we cover up to 90% of Medical Premiums, 50% of Dental & Vision Premiums, company-sponsored Life Insurance, 401K, and generous parental leave.

Flexible PTO policy and great work/life balance – We value and support each individual team member.

Annual parking stipend – we help people park!

Culture
Volunteer in local community
SpotHero participates in local volunteer activities such as installing art galleries in elementary schools with I Paint My Mind and building homes with the House That Tech Built.
Partners with nonprofits
Through our monthly bake sales we partner with nonprofits such as C.A.R.E. Animal Rescue, Center on Halsted, and ALIVE rescue.
Open door policy
OKR operational model
Team based strategic planning
Pair programming
Open office floor plan
Employee resource groups
Employee-led culture committees
Employee awards
Flexible work schedule
Remote work program
Diversity
Dedicated diversity and inclusion staff
Highly diverse management team
Mandated unconscious bias training
Diversity manifesto
Mean gender pay gap below 10%
Diversity employee resource groups
In addition to our DEI Task Force team, we also have a number of ERG's including African Americans/Blacks at SpotHero, Neurodiversity ERG, Women at SpotHero, LGBTQ+ ERG, Parents at SpotHero, etc.
Hiring practices that promote diversity
Health Insurance & Wellness Benefits
Flexible Spending Account (FSA)
Disability insurance
We cover Short Term Disability at no cost to you.
Dental insurance
Our competitive Dental plan is through Guardian. Our plan has a unique rollover benefit to encourage plan use. In addition to child orthodontia, we are proud to offer adult orthodontia coverage!
Vision insurance
Our vision plan is through Guardian through VSP Choice Network. Our plan has a low co-pay for your annual exam and includes an annual stipend for lenses or frames.
Health insurance
Our medical plans are through Blue Cross Blue Shield, and we offer a High Deductible Health Plan with no employee payroll contribution required. We also contribute to HSA accounts on your behalf.
Life insurance
SpotHero covers Life & AD&D coverage, up to 100% of your salary, at no cost to you.
Pet insurance
Wellness programs
Team workouts
SpotHero sponsors an annual fitness challenge where employees can participate in hydration, sleep, and fitness challenges.
Mental health benefits
Financial & Retirement
401(K)
You’ll have the opportunity to take advantage of traditional and Roth savings options with financial advisers at Fidelity Investments who are ready to assist with your retirement planning.
401(K) matching
SpotHero's 401k plan matches 50% for an employee's contributions up to 6% of their annual based salary.
Company equity
Performance bonus
Charitable contribution matching
Child Care & Parental Leave Benefits
Generous parental leave
We provide three months of parental leave for all employees.
Family medical leave
Vacation & Time Off Benefits
Unlimited vacation policy
Generous PTO
Paid volunteer time
Paid holidays
Paid sick days
Flexible time off
Bereavement leave benefits
Office Perks
Commuter benefits
Company-sponsored outings
Free snacks and drinks
Some meals provided
Company-sponsored happy hours
Onsite office parking
Onsite gym
Professional Development Benefits
Job training & conferences
Lunch and learns
Promote from within
Mentorship program
Continuing education available during work hours
Online course subscriptions available
Customized development tracks
Paid industry certifications

Additional Perks + Benefits

Fantastic Eats - Take a break and enjoy some grub with the team, catered weekly from your favorite Chicago spots. For a midday pick me up, choose from our endless variety of snacks. • Team Events - From WhirlyBall and ice skating to rooftop happy hours and spontaneous ice cream parties - we're always looking for new ways to have fun together! • Casual Work Environment - Be comfortable while you work. Take a nap if you need it or squeeze in a few yoga poses between meetings. • Employee Wellness Program. We encourage work/life balance through financial wellness talks, meditation sessions, and mind & body nutrition education. Plus, we encourage our team to get out and give back to our local community. • Professional Development. We support personal and professional development through mentorship programs, diversity & inclusion trainings, and learning how to work with one another based on our personality types.

More Jobs at SpotHero

Apply Now
By clicking Apply Now you agree to share your profile information with the hiring company.
Learn more about SpotHeroFind similar jobs like this