Designs and refines Microsoft Fabric architectures, builds metadata-driven ingestion frameworks, migrates Azure Synapse workloads, and develops PySpark and Spark SQL pipelines. The role includes data validation, reconciliation, CDC strategies, medallion architecture, Git-based CI/CD, governance and lineage assessment, and AI-assisted development with Claude Code. The consultant collaborates directly with client engineers through paired development, code reviews, architecture decisions, and knowledge sharing.
Who We Are
At Trility Consulting®, we’ve built a strong, remote-work culture where people thrive, grow, and support each other – earning us Great Place to Work® Certification. Headquartered in Central Iowa, we embrace flexible schedules and collaboration across geographically distributed teams serving clients from all corners of the United States and globally.
We seek team members with the grit necessary to forge paths where none previously existed, to get back up when circumstances knock them down, to adapt to the changing needs of the client even when it is uncomfortable, and to deliver on our commitments. Candidates must respect and value people, recognize that over-communication is barely good enough, thrive on solving complex problems, have a passion for building teams, and know that delivering what a client actually values is more important than their own predispositions. They understand value proposition, love delivering value, and take pride in learning the expansive and ever-changing business of clients. Candidates are self-motivated and relentlessly working to become more today than they were yesterday.
Trility Consulting is seeking an experienced Senior Data Consultant to support a client engagement focused on modernizing an existing Azure Synapse data platform and migrating prioritized workloads to Microsoft Fabric.
In this role, you'll partner with Trility consultants and client engineers to pressure-test and refine the Fabric architecture, build reusable, metadata-driven ingestion frameworks, and migrate data workloads into a modern lakehouse environment. You'll develop scalable data pipelines, implement validation processes to ensure migration accuracy, and establish automated CI/CD workflows that support reliable deployment from development through production.
This engagement follows Trility's collaborative Coach-and-Contribute delivery model. You'll work hands-on alongside client engineers, contribute to architectural decisions, and help establish repeatable patterns that enable the team to maintain and extend the platform independently. Experience using Claude Code as part of an AI-assisted development workflow is essential to this engagement.
This is a remote W2 or 1099 position.
At this time, Trility is only able to hire W2 employees who reside in the following states: Alabama, Colorado, Delaware, Florida, Georgia, Iowa, Kansas, Kentucky, Louisiana, Minnesota, Missouri, Montana, Nebraska, Nevada, North Carolina, Ohio, South Carolina, Tennessee, Texas, Virginia, and Wisconsin.
Your Responsibilities
- Evaluate and refine the existing Microsoft Fabric architecture, including metadata structures, table-level event triggering, and reusable ingestion patterns
- Design and implement a metadata-driven ingestion framework that allows new tables and sources to be onboarded through configuration rather than custom development
- Migrate prioritized data sources and workloads from Azure Synapse into Microsoft Fabric
- Develop and orchestrate Fabric data pipelines and Spark notebooks using PySpark and Spark SQL
- Analyze existing Azure Synapse pipelines, including complex and nested workflows, to understand dependencies and translate existing processing logic into Fabric solutions
- Build data validation and reconciliation processes to verify migration accuracy, including duplicate detection, key alignment, and record-level comparisons between Synapse and Fabric
- Analyze source-specific loading requirements and recommend appropriate full-load, incremental, or change data capture (CDC) patterns
- Implement Git-based CI/CD and automated environment promotion for Fabric artifacts, including pipelines and notebooks, using GitHub Actions, Azure DevOps, or similar tooling
- Leverage Claude Code to define implementation specifications, accelerate development, and review AI-generated code for quality, correctness, and maintainability
- Evaluate data dictionary, metadata, and lineage requirements, including potential catalog solutions such as Microsoft Purview
- Collaborate with client engineers through paired development, code reviews, and knowledge-sharing sessions to establish sustainable engineering standards
- Apply data engineering best practices related to performance, testing, monitoring, documentation, security, and operational support
What You Bring
- 5+ years of experience working with Azure Data Services, including Microsoft Fabric, Azure Data Factory, Databricks, or Synapse
- Hands-on Microsoft Fabric experience in production environments, including lakehouses, pipelines, notebooks, medallion architecture, workspaces, and capacity management
- Strong experience building and maintaining production ETL/ELT pipelines and reusable data ingestion frameworks
- Demonstrated experience designing and implementing a metadata-driven ingestion framework, including configuration-based onboarding and extensible processing patterns
- Experience developing Spark notebooks and data transformation workflows using PySpark and Spark SQL
- Strong SQL skills for data transformation, validation, and performance tuning, including the ability to read and understand existing T-SQL logic
- Experience working with Azure Synapse, including analyzing existing pipelines and understanding complex data processing dependencies
- Experience implementing medallion architecture patterns (Bronze, Silver, Gold)
- Experience designing and implementing Git-based CI/CD workflows for data platform artifacts using GitHub Actions, Azure DevOps, or similar tooling
- Hands-on experience using Claude Code for AI-assisted software development, including directing code generation, working across multiple files, and critically reviewing generated code
- Experience validating data migrations and ensuring data quality, accuracy, and consistency across source and target systems
- Experience integrating data from REST APIs, relational databases, and structured or semi-structured data sources
- Familiarity with data governance, lineage, metadata management, and data catalog concepts
- Ability to collaborate effectively with technical teams, challenge existing approaches constructively, and participate in client-facing technical discussions
- Strong written and verbal communication skills
Preferred Experience
- Experience migrating data platforms or workloads from Azure Synapse to Microsoft Fabric
- Experience working with Oracle and DB2 data sources
- Experience implementing incremental ingestion, change data capture (CDC), and source-specific loading strategies
- Experience developing data reconciliation and validation frameworks for large-scale migrations
- Experience evaluating Microsoft Purview or other data catalog and lineage solutions
- Experience working within consulting or professional services environments
How We Put You First
Trility’s culture is built upon the journey, character, and work ethic of our team members. We are a team of honorable and professional lifelong learners who work together to solve problems proactively.
• Work remotely anywhere in the United States with flexible work hours
• Paid time-off, company holidays, and floating holidays
• Comprehensive benefits with contributions toward premiums
• 401(k) plan
• Sponsored and supported learning opportunities
Job Requirements
• Must reside within the United States
• Must be authorized to work in the United States without sponsorship now or in the future
• Must be able to pass a background check
Similar Jobs
Aerospace • Hardware • Information Technology • Security • Software • Cybersecurity • Defense
Lead enterprise continuous-improvement initiatives using Shainin Red X, Lean, and Six Sigma. Coach and train Green/Black Belts, facilitate root-cause problem solving, track KPIs, drive implementation, and support change management across manufacturing and quality teams. Heavy site collaboration and up to 75% travel required.
Top Skills:
8DA3ApqpCritical Thinking (Is Is-Not Analysis)KaizenLeanMinitabMS OfficeOraclePdcaRed XRelyenceShainin Red XSix SigmaTipqaToyota Production System
Aerospace • Hardware • Information Technology • Security • Software • Cybersecurity • Defense
Serves as the strategic liaison between Finance, Facilities, Supply Chain, and IT. Owns technology roadmaps, demand intake, prioritization, business cases, KPI tracking, cybersecurity compliance, enterprise platform adoption, standardization, data integration, and delivery escalation. Leads governance forums, executive communications, performance reviews, and cross-functional execution while managing project managers and distributed teams.
Top Skills:
Cmmc Level 2+CybersecurityEnterprise It GovernanceKpi TrackingPmo PracticesTechnology Roadmapping
Aerospace • Hardware • Information Technology • Security • Software • Cybersecurity • Defense
Develop high-fidelity remote sensing systems-of-systems models and analysis tools using AFSIM, C++, and Python. Integrate MBSE tools, digital engineering workflows, CI/CD pipelines, DevOps automation, and secure cloud deployments. Translate mission requirements into scalable software artifacts, optimize current-to-future workflows, establish repeatable modeling processes, and provide technical guidance to customers and cross-functional teams. The role requires on-site work five days per week and an active Secret clearance with eligibility for Top Secret/SCI.
Top Skills:
AfsimBashC++CameoCi/CdGitlabLatexLinuxModel-Based Systems Engineering (Mbse)PowershellPythonSafeScrumSecure Cloud EnvironmentsWindows
What you need to know about the Chicago Tech Scene
With vibrant neighborhoods, great food and more affordable housing than either coast, Chicago might be the most liveable major tech hub. It is the birthplace of modern commodities and futures trading, a national hub for logistics and commerce, and home to the American Medical Association and the American Bar Association. This diverse blend of industry influences has helped Chicago emerge as a major player in verticals like fintech, biotechnology, legal tech, e-commerce and logistics technology. It’s also a major hiring center for tech companies on both coasts.
Key Facts About Chicago Tech
- Number of Tech Workers: 245,800; 5.2% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: McDonald’s, John Deere, Boeing, Morningstar
- Key Industries: Artificial intelligence, biotechnology, fintech, software, logistics technology
- Funding Landscape: $2.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Pritzker Group Venture Capital, Arch Venture Partners, MATH Venture Partners, Jump Capital, Hyde Park Venture Partners
- Research Centers and Universities: Northwestern University, University of Chicago, University of Illinois Urbana-Champaign, Illinois Institute of Technology, Argonne National Laboratory, Fermi National Accelerator Laboratory
