Designs, builds, and optimizes modern Azure and Databricks data platforms for clients. Responsibilities include client discovery, requirements workshops, architecture discussions, batch and streaming ingestion, lakehouse and dimensional modeling, data transformation, governance, monitoring, DevOps, security, and solution reviews. The role also communicates recommendations to technical stakeholders and leadership while delivering scalable analytics and reporting solutions.
Valorem Reply is an award-winning digital transformation firm focused on delivering solutions around data-driven enterprise, IT modernization, customer experience, product transformation and digital workplace by leveraging the power of Microsoft technologies. We provide hyper-scale and agile delivery of unique digital business services, strategic business models and design-led user experiences. Our innovative strategies and solutions securely and rapidly transform the way our clients do business.
We are seeking a Data Engineer to design, build, and optimize modern data platforms for our clients using Microsoft Azure, Microsoft Fabric, Power BI, and Databricks. This role is ideal for someone who combines deep technical expertise with strong consulting skills — someone who can engage directly with clients, understand business needs, translate requirements into scalable technical solutions, and communicate clearly with both technical and non-technical stakeholders.
As a member of the team, you will contribute to solution architecture and help deliver high-quality modern data solutions that drive measurable business value. The ideal candidate is equally comfortable discussing lakehouse architecture with engineers, facilitating design sessions with client stakeholders, and presenting recommendations to leadership teams.
Responsibilities
• Work directly with clients to understand business goals, data challenges, and technical requirements
• Lead or support discovery sessions, requirements workshops, architecture discussions, and solution reviews
• Develop and optimize batch and streaming data ingestion pipelines from enterprise applications, databases, APIs, and file-based sources.
• Implement medallion/lakehouse architectures, dimensional models, and data transformation workflows to support analytics and reporting use cases
• Engineer solutions using technologies such as PySpark, Spark SQL, SQL, Python, Delta Lake, and orchestration tools within Azure and Databricks
• Recommend best practices for data modeling, governance, lineage, monitoring, DevOps, and security
• Lead or support discovery sessions, requirements workshops, architecture discussions, and solution reviews
• Develop and optimize batch and streaming data ingestion pipelines from enterprise applications, databases, APIs, and file-based sources.
• Implement medallion/lakehouse architectures, dimensional models, and data transformation workflows to support analytics and reporting use cases
• Engineer solutions using technologies such as PySpark, Spark SQL, SQL, Python, Delta Lake, and orchestration tools within Azure and Databricks
• Recommend best practices for data modeling, governance, lineage, monitoring, DevOps, and security
Minimum Requirements
• Bachelor’s degree in Computer Science; Engineering or related field.
• 6+ years of experience in data engineering, data platform development, or cloud data solutions
• 3+ years of hands-on experience with Azure Databricks, Apache Spark, or similar distributed data processing technologies
• Expertise with Microsoft Azure infrastructure and data resources, including Fabric, Azure Data Factory, Synapse Data Analytics, Power BI, Azure SQL, Azure Cosmos DB, and Azure Database for PostgreSQL
• Expertise with Databricks, specifically the ability to design enterprise-level strategy and architecture including Unity Catalog, data warehousing, data sharing, and Mosaic AI
• DevOps for data, GitHub, automated testing, and working with containers (AKS, Docker, registries, etc.)
• Excellent communication skills, ability to clearly explain concepts to teammates and customers, and quickly learn new concepts and technologies
• 6+ years of experience in data engineering, data platform development, or cloud data solutions
• 3+ years of hands-on experience with Azure Databricks, Apache Spark, or similar distributed data processing technologies
• Expertise with Microsoft Azure infrastructure and data resources, including Fabric, Azure Data Factory, Synapse Data Analytics, Power BI, Azure SQL, Azure Cosmos DB, and Azure Database for PostgreSQL
• Expertise with Databricks, specifically the ability to design enterprise-level strategy and architecture including Unity Catalog, data warehousing, data sharing, and Mosaic AI
• DevOps for data, GitHub, automated testing, and working with containers (AKS, Docker, registries, etc.)
• Excellent communication skills, ability to clearly explain concepts to teammates and customers, and quickly learn new concepts and technologies
Preferred Qualifications
• Experience working directly with clients, business stakeholders, or cross-functional teams in a consulting or professional services environment.
• Experience building data agents, including NLQ, Databricks Genie, and Fabric Data Agents
• Experience with data management, including data governance, data security, master data management, and familiarity with different industry security requirements
• Broad experience with data/reporting tools, architectures, cloud vendors, and data/AI concepts other than Microsoft
• Experience building data agents, including NLQ, Databricks Genie, and Fabric Data Agents
• Experience with data management, including data governance, data security, master data management, and familiarity with different industry security requirements
• Broad experience with data/reporting tools, architectures, cloud vendors, and data/AI concepts other than Microsoft
About Reply
Reply specializes in the design and implementation of solutions based on new communication channels and digital media. Reply is a network of highly specialized companies supporting global industrial groups operating in the telecom and media, industry and services, banking, insurance and public administration sectors in the definition and development of business models enabled for the new paradigms of AI, cloud computing, digital media and the Internet of Things. Reply services include Consulting, System Integration and Digital Services.
The base compensation range for this full-time position is between $130,000 - $150,000 plus benefits. Compensation decisions are supported through market data, where regional variances may exist based on cost of labor. We also take into consideration prior experience, relevant skills, education and/or training, certifications and, as applicable, other required qualifications. If you have questions regarding compensation, the talent acquisition team can provide relevant details during the interview process.
Reply is an equal opportunity employer. We are committed to provide equal opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or Veteran status. If you need assistance and reasonable accommodation due to a disability during the application or the recruiting process, email us at [email protected]. Visit our website at www.reply.com to learn more about our open roles.
Reply Burr Ridge, Illinois, USA Office
745 Mc Clintock dr. Suite 210, Burr Ridge, United States, 60527
Reply Chicago, Illinois, USA Office
330 N. Wabash, 23rd Floor, Suite 156, Chicago, United States, 60611
Similar Jobs
Artificial Intelligence • Cloud • Payments • Software • Business Intelligence • Generative AI • Automation
Leads enterprise-scale data architecture across batch, streaming, warehouse, lakehouse, transactional, AI, and vector-store use cases. Establishes data quality, governance, lineage, observability, access-control, and reliability standards. Defines AI-enabled data engineering patterns, mentors engineers, resolves complex architecture issues, and influences cross-functional roadmaps. Requires hands-on technical leadership and 15+ years of software, data engineering, or architecture experience.
Top Skills:
DbtGcp Bigquery
Fintech • Machine Learning • Payments • Software • Financial Services
Designs, builds, and operates scalable, resilient cloud data platforms and pipelines. Leads large-scale data initiatives, makes architectural decisions, evaluates technologies such as Snowflake and Databricks, and develops solutions using distributed data systems, relational and NoSQL databases, and cloud platforms. Collaborates with product and engineering teams, establishes reusable design patterns, communicates technical concepts, and mentors data engineers, analysts, and scientists.
Top Skills:
AirflowAWSCassandraDagsterDatabricksDynamoDBEmrGlueGCPJavaAzureMongoDBMonte CarloNosql DatabasesPythonRedshiftRelational DatabasesScalaSnowflakeSparkSplunkSQL
Fintech • Machine Learning • Payments • Software • Financial Services
Design, build, and support scalable cloud data platforms, pipelines, and applications. Develop distributed data solutions using Python, Spark, SQL, Databricks, Snowflake, and relational and NoSQL databases. Architect reusable engineering patterns, improve resilience and operational efficiency, enforce data security, and support real-time workloads. Collaborate with Agile teams, product managers, engineers, analysts, and data scientists while mentoring peers and communicating technical outcomes to stakeholders.
Top Skills:
AirflowAWSCassandraDagsterDatabricksDynamoDBEmrGlueGCPJavaAzureMongoDBMonte CarloPythonRedshiftScalaSnowflakeSparkSplunkSQL
What you need to know about the Chicago Tech Scene
With vibrant neighborhoods, great food and more affordable housing than either coast, Chicago might be the most liveable major tech hub. It is the birthplace of modern commodities and futures trading, a national hub for logistics and commerce, and home to the American Medical Association and the American Bar Association. This diverse blend of industry influences has helped Chicago emerge as a major player in verticals like fintech, biotechnology, legal tech, e-commerce and logistics technology. It’s also a major hiring center for tech companies on both coasts.
Key Facts About Chicago Tech
- Number of Tech Workers: 245,800; 5.2% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: McDonald’s, John Deere, Boeing, Morningstar
- Key Industries: Artificial intelligence, biotechnology, fintech, software, logistics technology
- Funding Landscape: $2.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Pritzker Group Venture Capital, Arch Venture Partners, MATH Venture Partners, Jump Capital, Hyde Park Venture Partners
- Research Centers and Universities: Northwestern University, University of Chicago, University of Illinois Urbana-Champaign, Illinois Institute of Technology, Argonne National Laboratory, Fermi National Accelerator Laboratory
