Senior Data Integration Engineer

| Chicago

Description

 

The Sr. Data Integration Engineer is responsible for architecting and implementing data ingestion, validation, and transformation pipelines at Syndigo.  In collaboration with the Product, Development, and Enterprise Data teams, the Sr. Data Integration Engineer will design and maintain batch and streaming integrations across a variety of data domains and platforms.  The ideal candidate is experienced in big data, cloud architecture, and is excited to advance innovative analytics solutions! The Sr. Data Integration Engineer should be able to effectively communicate ideas and concepts to peers and have experience leading projects that support the business objectives and goals.

The preference is that this role be based in one of Syndigo's offices in Brookfield WI, Nashville TN, Chicago IL, or Lisle IL, but well qualified candidates in other parts of the United States can be considered as fully remote employees.

ESSENTIAL DUTIES AND RESPONSIBILITIES:

  • Take ownership in building solutions and proposing architectural designs related to building efficient and timely data ingestion and transformation processes geared towards analytics work loads
  • Manage code deployment to various environments
  • Be proficient at positively critiquing and suggesting improvements via code reviews
  • Work with stakeholders to define and develop data ingest, validation, and transform pipelines
  • Troubleshoot data pipelines and resolve issues in alignment with SDLC
  • Ability to diagnose and troubleshoot data issues, recognizing common data integration and transformation patterns
  • Estimate, track, and communicate status of assigned items to a diverse group of stakeholders

REQUIREMENTS:

  • 3+ years experience in developing and architecting large scale data pipelines in a cloud environment
  • Demonstrated expertise in Scala (Object Oriented Programming) / Python (Scala preferred), SPARK SQL
  • Experience with Databricks, including Delta Lake
  • Experience with Azure and cloud environments, including Azure Data Lake Storage (Gen2), Azure Blob Storage, Azure Tables, Azure SQL Database, Azure Data Factory
  • Experience with ETL/ELT patterns, preferably using Azure Data Factory and Databricks jobs
  • Fundamental knowledge of distributed data processing and storage
  • Fundamental knowledge of working with structured, unstructured, and semi structured data
  • Excellent analytical and problem solving skills
  • Ability to effectively manage time and adjust to changing priorities
  • Bachelor’s degree preferred, but not required

Equal Opportunity Employer/Protected Veterans/Individuals with Disabilities

The contractor will not discharge or in any other manner discriminate against employees or applicants because they have inquired about, discussed, or disclosed their own pay or the pay of another employee or applicant. However, employees who have access to the compensation information of other employees or applicants as a part of their essential job functions cannot disclose the pay of other employees or applicants to individuals who do not otherwise have access to compensation information, unless the disclosure is (a) in response to a formal complaint or charge, (b) in furtherance of an investigation, proceeding, hearing, or action, including an investigation conducted by the employer, or (c) consistent with the contractor’s legal duty to furnish information. 41 CFR 60-1.35(c)

Read Full Job Description

Technology we use

  • Engineering
    • .NETLanguages
    • C#Languages
    • ScalaLanguages
    • SqlLanguages
    • AngularJSFrameworks
    • ASP.NETFrameworks
    • MongoDBDatabases
    • MySQLDatabases

Location

We are located in the Board of Trade building which is centrally located in the loop providing easy access to most train lines.

An Insider's view of Syndigo

What’s the vibe like in the office?

I love the passion of everyone who works in the Chicago office, never a dull day! We are a fast moving organization and it doesn't matter if you work in finance, sales, marketing or IT we help and support each other as we grow. The passion is infectious to be around.

Jenny

Director, Sales Enablement

How do you collaborate with other teams in the company?

I love the energy and willingness of other teams and departments to help my team succeed. The camaraderie between business development and other departments is outstanding and we know we are working to achieve one goal. That winning attitude of everyone at Syndigo has created a special culture that inspires my team.

Micah

Vice President, Business Development

How does the company support your career growth?

Syndigo has expanded my career by offering opportunities to meet face to face, conveying how our solutions solve unique & complex challenges, with prospects & clients that are trailblazers in their industries. I have established a foundation in a fast-paced & young organization and now direct a team of exceptional Business Development Executives.

Nick

Manager, Business Development

What unique initiatives do you have that encourage innovation?

Innovation & Empowerment are two of our core company values. We push team members to look at what ‘value’ means in new ways. Our Inspire program brings together those that are working towards the next step in their career, specifically in leadership. We have had great initiatives come out of the group that are moving the company forward.

Kristen

Vice President, Client Development

What are Syndigo Perks + Benefits

Culture
Volunteer in local community
Syndigo offers full time employees two paid volunteer days off (VTO) each year which they can use to support causes in the community important to them.
Partners with Nonprofits
Syndigo offers a donation match program for full-time employees, as well donating goods and supplies to local non-profits across Chicagoland.
Friends outside of work
Eat lunch together
Intracompany committees
Daily stand up
Open door policy
Team owned deliverables
Team based strategic planning
Group brainstorming sessions
Open office floor plan
Diversity
Unconscious bias training
Syndigo has mandatory online training for all employees, which includes unconscious bias training.
Diversity Employee Resource Groups
Syndigo has a Diversity, Equity, and Inclusion Committee and Board which is an employee-led initiative to educate & create change.
Health Insurance & Wellness Benefits
Flexible Spending Account (FSA)
Syndigo employees can contribute up to $2750 annually to their healthcare FSA. Other FSA's available are mass transit, dependent care, parking, and limited purpose.
Disability Insurance
Syndigo offers short-term (100% company-paid premiums) and long-term (employee contribution) disability insurance.
Dental Benefits
Syndigo offers 2 dental insurance plans through Blue Cross Blue Shield.
Vision Benefits
Syndigo offers vision insurance through EyeMed.
Health Insurance Benefits
Syndigo offers 2 Blue Cross Blue Shield plans for employees. There is a PPO option, and a HDHP (with HSA with employer contribution) option.
Life Insurance
Syndigo offers fully-paid policies for all employees ($50K), and offers voluntary term coverage for employees & spouse/domestic partners & dependents.
Pet Insurance
Syndigo offers pet insurance through Nationwide.
Wellness Programs
Syndigo offers health and financial wellness programs to employees.
Onsite Gym
Mental Health Benefits
Syndigo offers an EAP which includes mental health support, and the health insurance does offer coverage for mental health services.
Retirement & Stock Options Benefits
401(K)
Syndigo offers a 401k through John Hancock, both traditional and Roth.
401(K) Matching
Syndigo provides employees with a 401(k) matching plan managed by John Hancock. We match 50% of contributions up to 8% of an employee's annual gross pay (Syndigo contribution would equal 4%).
Performance Bonus
Syndigo offers annual performance bonuses to employees in eligible roles.
Match charitable contributions
Syndigo offers a charitable contribution match for employees of up to $250 annually.
Child Care & Parental Leave Benefits
Generous Parental Leave
Syndigo provides 6 weeks of paid maternity leave, 4 weeks of paid adoption leave, and 1 week of paid paternity leave.
Flexible Work Schedule
Syndigo provides employees with a flexible work schedule that includes flexible start and end times.
Remote Work Program
Our remote work program includes work from home full-time remote for specific positions.
Family Medical Leave
Employees who have been with Syndigo for 12 months are eligible for 12 weeks of family medical leave.
Adoption Assistance
Syndigo offers up to 4 weeks of paid leave for Adoption Leave.
Vacation & Time Off Benefits
Generous PTO
Syndigo employees receive between 16 and 26 days per year of paid time off based on years of service.
Paid Volunteer Time
Syndigo employees receive 16 hours per year of paid volunteer time.
Paid Holidays
Perks & Discounts
Casual Dress
Commuter Benefits
Syndigo offers pre-tax commuter benefits for all employees.
Game Room
Our game room, adjacent to our rooftop deck, includes Pool Table, Foosball and game table.
Stocked Kitchen
Syndigo offers company-paid snacks and refreshments.
Some Meals Provided
Syndigo brings in breakfast and lunch for employees several times each quarter.
Happy Hours
Happy hours are hosted on occasion .
Parking
We offer employees free parking in our Lisle location. There is no free or subsidized parking in the downtown office.
Fitness Subsidies
Syndigo's health insurance provider offers a health club membership programs.
Professional Development Benefits
Job Training & Conferences
Syndigo offers employees professional development opportunities like onsite training courses, The ability to attend job related conferences and seminars.
Tuition Reimbursement
Syndigo's tuition reimbursement plan offers an annual max of $2500 with a maximum total match of $5000.
Diversity Program
Cross functional training encouraged
Promote from within
Online course subscriptions available
Customized development tracks

Additional Perks + Benefits

Syndigo reviews benefits annually and intentionally works to create plans that reflect feedback from our employees.

More Jobs at Syndigo16 open jobs
All Jobs
Data + Analytics
Marketing
Product
Project Mgmt
Sales
Project Mgmt
new
Chicago
Data + Analytics
new
Chicago
Marketing
new
Chicago
Data + Analytics
new
Chicago
Sales
new
Chicago
Marketing
new
Chicago
Sales
new
Chicago
Data + Analytics
new
Chicago
Data + Analytics
new
Chicago
Data + Analytics
new
Chicago
Product
new
Chicago
Sales
new
Chicago
Sales
new
Chicago