DATA SOLUTIONS ENGINEER
The Engineering/Technology team is home to data engineers who are building data platforms that operate at petabyte scale and drive hundreds of millions of dollars in incremental revenue for marketers. Our data environments are closely integrated with data science algorithms, natural language processing routines, and data pipelines that process hundreds of billions of transactions daily. In this role, in addition to mastering the technology stack, it is also of vital importance to develop subject matter expertise on the enterprise’s data set. As a data driven company, the way we capture, store and utilize the corporate asset of the proprietary data model is what drives our best in class understanding of the consumer and equates directly to the company’s bottom line.
Role Description
We are looking for a Data Solutions Engineer to work in our Data Quality team and engage with both larger Conversant Engineering, Analytics and Business teams.
This role will be hands on in code development to drive solutions to delivery by effectively engaging with team members across the globe. The person in this role will need to be able to work both independently to meet required specifications of solution delivery and with business users to ingest new complex data quality uses cases. In both cases where the output work product will be incorporated into production environments. The person is involved with managing critical data anomaly detection, integrity checks and overall data quality processing within Conversant. Expertise required in complex Python, Spark, Elasticsearch and API development, as well as, complex SQL queries, data aggregations, data modelling and business intelligence. Ability to understand complex Conversant uses cases and work with business users to translate these uses cases to production data quality detection services.
Responsibilities
- You will design and code solutions in both standalone and clustered compute environments to include Hadoop, Spark and Greenplum in Python and Scala.
- On database advanced SQL capabilities for ensuring use case creation and implementation of critical anomaly and integrity checks to enable data driven outlier-detection and decision making for the company’s multi-faceted ad serving operations.
- Working closely with Engineering and Business resources across the globe to ensure enterprise data quality solutions and assets are actionable, accessible and evolving in lockstep with the needs of the ever-changing business model.
- Should be able to develop test cases and validation methodology to demonstrate work product meets required needs.
- Ideal candidate can lead in the areas of: data quality, solution design, code development, data modeling, cross team communication, project management, application maintenance and business facing skills
Required qualifications
- Bachelor’s Degree in Computer Science or equivalent degree is required.
- 5+ years of business analysis experience around database marketing technologies and data management with technical understanding in these areas
- Strong experience in SQL and Python
- Experience with Spark, Hadoop and ML
- Experience with scheduling applications with complex interdependencies
- Good experience in working with geographically and culturally diverse teams
- Familiarity with complex data lake environments that span OLTP, MPP and Hadoop platforms
- Excellent written and verbal communication skills
- Ability to handle complex products
- Excellent Analytical and problem-solving skills
- Ability to diagnose and troubleshoot problems quickly