Responsibilities

• Extend and maintain Groupon centralized data ingestion pipeline, specifically:

  • Streaming Transformations

  • Streaming and Batch Data Quality Validations

  • Schema design and maintenance for persistence layer, including partitioning

• Analyze and translate functional requirements/change requests into technical specifications

• Onboard new data sources and help upstream engineers/data PMs with configurations

• Coordinate and collaborate with EDW Engineering team and business users to implement required streaming transformations functions (UDFs)

• Create/execute unit tests and validate expected results

• Create and maintain clear documentation on data models/schemas as well as transformation/validation rules

• Troubleshoot and remediate data quality issues raised by pipeline alerts or downstream consumers.

• Execute and evolve proactive data quality measures, specifically:

  • Work with upstream QA teams on integrating data validation tests. Evaluate new releases from data quality perspective.

  • Contribute to anomaly detection and alerting tools evolution in the pipeline (both real-time and batch)

• Conform to adopted SDLC procedures (2-week sprints, daily standups and daily ticket triaging)

Requirements

• Technical skills:

  • 100% fluency in ANSI SQL. Hive/spark SQL. R is a plus

  • Scripting skills: python, shell, pig etc.

  • Basic OOO and/or functional programming skills (Java, Scala).

  • Working knowledge of big data persistence. Hadoop and Teradata are preferred.

  • Hands-on experience in RDMS technologies: Mysql, Oracle etc

• Knowledge of data modeling and designing relational databases, specifically for OLAP (star/snowflake schemas etc)

• Ability to work in a fast-paced environment on several projects concurrently

• Strong analytical and troubleshooting skills

• Ability to develop and organize high-quality documentation

Groupon provides a global marketplace where people can buy just about anything, anywhere, anytime. We’re enabling real-time commerce across an expanding range of categories including local businesses, travel destinations, consumer products, and live or lively events. At the same time, we are providing advertising options and tools that merchants can use to grow and manage their businesses. Culturally, we believe that great people make great companies and that starting with the customer and working backward moves us forward. Community matters to us on an internal, local and global scale—it’s fundamental to our company’s growth and to the well-being of the world at large. We also value self-awareness, candor, lunch and WiFi. If we match with you, please apply to join us.