Data Engineering Technical Architect (Intellio DataOps)
Ready to thrive in the next step on your career journey?
Ready to thrive in the next step on your career journey?
West Monroe has developed an innovative data management platform called Intellio™ DataOps (IDO) which is a metadata-driven, fully-managed data lake and data hub with data warehouse automation features. IDO can be deployed to the client’s cloud and be ready to start ingesting source data in just a few days. Our team then focuses on iteratively tackling client business issues, using IDO’s web-based user interface to ingest, cleanse, enrich, and publish new data as needed without worrying about technical aspects such as data modeling, change data capture, scaling, schema drift, storage, data lineage, and performance.
IDO is very popular with clients as they get a ready to use, enterprise-grade data platform and a consulting team focused on solving business issues on week one of the engagement. West Monroe is looking for an experienced architect to join our team and support IDO in the following ways:
Core Responsibilities:
- Drive the technical implementation of Intellio™ DataOps (IDO) projects by leading the technical design and data extraction approach while considering risks and tradeoffs with client resources.
- Learn the IDO platform and lead the architectural design, execution, and delivery in the following ways:
- Add configurations for data enrichments such as lookups, type conversions, calculations, and concatenations
- Add data quality rules
- Connect to new data sources
- Map multiple sources into a single output
- Interpret IDO error messages to troubleshoot data pipelines
- Create outputs that facilitate reporting, dashboarding, and semantic modeling for tools such as Tableau and Power BI
- Write custom scripts using Python or Scala that use the IDO SDK to create custom functionality
- Optimize IDO implementations by adjusting Databricks cluster sizing, job orchestration, and resource allocation
- Communicate the value of IDO as a product to Technical Developers and IT management, including data architecture strategies, pricing considerations, and IDO strengths compared to similar products
- Teach the IDO platform to West Monroe and client resources, demo functionality as needed
- Assess IDO platform issues and escalate to the internal IDO product team as appropriate
- Mentor and manage teams on client projects to develop performant code; provide project reviews and frequent, informal feedback for team members
- Conduct code reviews and quality assurance of development in Intellio DataOps
- Provide best practices and support developers and clients in technical testing and user acceptance testing of data development
- Work with our industry teams to develop industry-specific offerings on the IDO platform that include connections to particular data sources, maintenance of relevant reference data, and development of canonical models, enrichments, data quality rules, metrics, reports, and dashboards
- Help develop and deliver consultant training internally at West Monroe, especially in the area of IDO methodology training; act as an internal technology evangelist for the IDO platform
- Review features and recommend updates to functionality in the IDO platform
Qualifications:
- Minimum 6+ years of hands-on professional development experience
- Strong technical experience in ETL tools (Azure Data Factory, AWS Glue, Informatica, Talend, IBM DataStage, etc.), database platforms (Snowflake, Redshift, Azure Synapse, or Oracle,), and data visualization tools (Tableau, Power BI, IBM Cognos, or SAP Business Objects).
- Experience performing complex data migration to and from disparate data systems/platforms as well as to/from the cloud (AWS, Azure, etc.).
- Knowledge of traditional data modeling (Kimble, 3rd normal formal) in addition to modern, denormalized, flat data models
- Experience scripting data engineering pipelines in languages such as Python, Scala, and/or Java.
- Very strong SQL skills for data analysis required.
- A detailed understanding and hands on experience preferred implementing data management technologies, including data warehousing, reporting, analysis, data modeling, etc.
- Experience leading technical delivery teams of 1-6 on data warehousing and/or ETL implementations.
Ready to get started? Join our team and make an impact.
Ready to get started? Join our team and make an impact.
At West Monroe, our people are our business.
We pride ourselves on bringing a different mindset to consulting—and that takes a different approach: highly collaborative, flexible, and tenacious.
Our people-first culture is core to our identity. It’s something we care about, and something we strive to enrich and preserve. No hierarchies. No siloes. No egos. Just smart ideas, unique perspectives, and the drive to make an impact for our clients.
We also know that the best outcomes for both our people and our clients result from including diverse perspectives at the table. That’s why inclusion & diversity is one of our core values.
Every day our clients rely on us to help them tackle their greatest challenges, by strategically deploying technology through a business-focused and industry-specific lens. We bring together both the right knowledge and the right approach, so that they can capitalize on opportunities and deliver real results. That takes the right team. And that’s where you come in.
West Monroe Partners is an Equal Employment Opportunity Employer
We believe in treating each employee and applicant for employment fairly and with dignity. We base our employment decisions on merit, experience, and potential, without regard to race, color, national origin, sex, sexual orientation, gender identity, marital status, age, religion, disability, veteran status, or any other characteristic prohibited by federal, state or local law. To learn more about inclusion and diversity at West Monroe, visit www.westmonroe.com/inclusion.
If you are based in California, we encourage you to read West Monroe’s Notice at Collection for California residents, provided pursuant to the California Consumer Privacy Act (CCPA) and linked here.
