Senior Data Integration Engineer at Syndigo

| Chicago
Sorry, this job was removed at 8:02 a.m. (CST) on Monday, February 1, 2021
Find out who's hiring in Chicago.
See all Data + Analytics jobs in Chicago



The Sr. Data Integration Engineer is responsible for architecting and implementing data ingestion, validation, and transformation pipelines at Syndigo.  In collaboration with the Product, Development, and Enterprise Data teams, the Sr. Data Integration Engineer will design and maintain batch and streaming integrations across a variety of data domains and platforms.  The ideal candidate is experienced in big data, cloud architecture, and is excited to advance innovative analytics solutions! The Sr. Data Integration Engineer should be able to effectively communicate ideas and concepts to peers and have experience leading projects that support the business objectives and goals.

The preference is that this role be based in one of Syndigo's offices in Brookfield WI, Nashville TN, Chicago IL, or Lisle IL, but well qualified candidates in other parts of the United States can be considered as fully remote employees.


  • Take ownership in building solutions and proposing architectural designs related to building efficient and timely data ingestion and transformation processes geared towards analytics work loads
  • Manage code deployment to various environments
  • Be proficient at positively critiquing and suggesting improvements via code reviews
  • Work with stakeholders to define and develop data ingest, validation, and transform pipelines
  • Troubleshoot data pipelines and resolve issues in alignment with SDLC
  • Ability to diagnose and troubleshoot data issues, recognizing common data integration and transformation patterns
  • Estimate, track, and communicate status of assigned items to a diverse group of stakeholders


  • 3+ years experience in developing and architecting large scale data pipelines in a cloud environment
  • Demonstrated expertise in Scala (Object Oriented Programming) / Python (Scala preferred), SPARK SQL
  • Experience with Databricks, including Delta Lake
  • Experience with Azure and cloud environments, including Azure Data Lake Storage (Gen2), Azure Blob Storage, Azure Tables, Azure SQL Database, Azure Data Factory
  • Experience with ETL/ELT patterns, preferably using Azure Data Factory and Databricks jobs
  • Fundamental knowledge of distributed data processing and storage
  • Fundamental knowledge of working with structured, unstructured, and semi structured data
  • Excellent analytical and problem solving skills
  • Ability to effectively manage time and adjust to changing priorities
  • Bachelor’s degree preferred, but not required

Equal Opportunity Employer/Protected Veterans/Individuals with Disabilities

The contractor will not discharge or in any other manner discriminate against employees or applicants because they have inquired about, discussed, or disclosed their own pay or the pay of another employee or applicant. However, employees who have access to the compensation information of other employees or applicants as a part of their essential job functions cannot disclose the pay of other employees or applicants to individuals who do not otherwise have access to compensation information, unless the disclosure is (a) in response to a formal complaint or charge, (b) in furtherance of an investigation, proceeding, hearing, or action, including an investigation conducted by the employer, or (c) consistent with the contractor’s legal duty to furnish information. 41 CFR 60-1.35(c)

Read Full Job Description


We are located in the Board of Trade building which is centrally located in the loop providing easy access to most train lines.