As a Data Engineer, you will design and optimize data platforms using Microsoft technologies, develop ingestion pipelines, and implement data architectures to support analytics needs.
Valorem Reply is an award-winning digital transformation firm focused on delivering solutions around data-driven enterprise, IT modernization, customer experience, product transformation and digital workplace by leveraging the power of Microsoft technologies. We provide hyper-scale and agile delivery of unique digital business services, strategic business models and design-led user experiences. Our innovative strategies and solutions securely and rapidly transform the way our clients do business
As a Data Engineer, you will design, build, and optimize modern data platforms using Microsoft Azure, Microsoft Fabric, Power BI, and Databricks. You combine deep technical expertise with strong consulting skills to engage clients, understand their business needs, and translate requirements into scalable solutions. You contribute to solution architecture and deliver high-quality data solutions that drive measurable business value. You are comfortable discussing technical details with engineers, facilitating design sessions with clients, and presenting recommendations to leadership.
Responsibilities
- Work directly with clients to understand business goals, data challenges, and technical requirements.
- Lead or support discovery sessions, requirements workshops, architecture discussions, and solution reviews.
- Develop and optimize batch and streaming data ingestion pipelines from enterprise applications, databases, APIs, and file-based sources.
- Implement medallion/Lakehouse architectures, dimensional models, and data transformation workflows to support analytics and reporting use cases.
- Engineer solutions using technologies such as PySpark, Spark SQL, SQL, Python, Delta Lake, and orchestration tools within Azure and Databricks.
- Recommend best practices for data modeling, governance, lineage, monitoring, DevOps, and security.
Minimum Requirements
- Bachelor’s degree in computer science or related field
- 4 years of experience in data engineering, data platform development, or cloud data solutions
- 2 years of hands-on experience with Azure Databricks, Apache Spark, or similar distributed data processing technologies
- Expertise with Microsoft Azure infrastructure and data resources, including Fabric, Azure Data Factory, Synapse Data Analytics ,Power BI, Azure SQL, Azure Cosmos DB
- Expertise with Databricks, specifically the ability to design enterprise-level strategy and architecture including Unity Catalog, data warehousing, data sharing
- DevOps for data, GitHub, automated testing, and working with containers (AKS, Docker, registries, etc.)
- Excellent communication skills, ability to clearly explain concepts to teammates and customers, and quickly learn new concepts and technologies
Preferred Qualifications
- Experience working directly with clients, business stakeholders, or cross-functional teams in a consulting or professional services environment
- Experience with data management, including data governance, data security, master data management, and familiarity with different industry security requirements
- Broad experience with data/reporting tools, architectures, cloud vendors, and data/AI concepts other than Microsoft
About Reply
Reply specializes in the design and implementation of solutions based on new communication channels and digital media. Reply is a network of highly specialized companies supporting global industrial groups operating in the telecom and media, industry and services, banking, insurance and public administration sectors in the definition and development of business models enabled for the new paradigms of AI, cloud computing, digital media and the Internet of Things. Reply services include Consulting, System Integration and Digital Services.
The base compensation range for this full-time position is between $120,000-$150,000 plus benefits. Compensation decisions are supported through market data, where regional variances may exist based on cost of labor. We also consider prior experience, relevant skills, education, training, certifications, and other job-related qualifications. If you have questions regarding compensation, the talent acquisition team can provide details during the interview process
Reply is an equal opportunity employer. We are committed to provide equal opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or Veteran status. If you need assistance and reasonable accommodation due to a disability during the application or the recruiting process, email us at [email protected]. Visit our website at www.reply.com to learn more about our open roles.
Similar Jobs
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
As a Principal Data Engineer, you will design and implement LLM, AI-powered security data platforms, mentor engineers, and drive the adoption of data solutions across teams.
Top Skills:
AirflowAWSBigQueryDaskDockerFlinkGCPKafkaKubeflowKubernetesLangchainLlamaindexMlflowMlops ToolsOciPulsarPythonSagemakerSnowflakeSparkVertex Ai
Big Data • Cloud • Productivity • Software • Database • Analytics • Automation
The Data Engineer will build and maintain data pipelines, optimize workflows, manage infrastructure, and enhance pipeline observability while collaborating with teams for effective data delivery.
Top Skills:
AirflowBigQueryDagsterDatabricksDatadogPrefectPythonRedisSnowflakeSQLTerraform
Cloud • Information Technology • Security • Software • Cybersecurity
The Principal GenAI Data Engineer will drive the design and implementation of scalable GenAI data platforms, focusing on robust data pipelines for structured and unstructured data. This role requires expertise in Python and AI data architecture, enhancing enterprise data capabilities.
Top Skills:
Ai WorkloadsGenerative AiGraph DatabasesMetadata Storage SystemsPythonVector Databases
What you need to know about the Chicago Tech Scene
With vibrant neighborhoods, great food and more affordable housing than either coast, Chicago might be the most liveable major tech hub. It is the birthplace of modern commodities and futures trading, a national hub for logistics and commerce, and home to the American Medical Association and the American Bar Association. This diverse blend of industry influences has helped Chicago emerge as a major player in verticals like fintech, biotechnology, legal tech, e-commerce and logistics technology. It’s also a major hiring center for tech companies on both coasts.
Key Facts About Chicago Tech
- Number of Tech Workers: 245,800; 5.2% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: McDonald’s, John Deere, Boeing, Morningstar
- Key Industries: Artificial intelligence, biotechnology, fintech, software, logistics technology
- Funding Landscape: $2.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Pritzker Group Venture Capital, Arch Venture Partners, MATH Venture Partners, Jump Capital, Hyde Park Venture Partners
- Research Centers and Universities: Northwestern University, University of Chicago, University of Illinois Urbana-Champaign, Illinois Institute of Technology, Argonne National Laboratory, Fermi National Accelerator Laboratory
