The Databricks Architect will design and implement data architecture solutions using Databricks, AWS, and Snowflake, focusing on MLOps and data governance.
Tiger Analytics is a fast-growing advanced analytics consulting firm. Our consultants bring deep expertise in Data Science, Machine Learning and AI. We are the trusted analytics partner for several Fortune 100 companies, enabling them to generate business value from data. Our business value and leadership has been recognized by various market research firms, including Forrester and Gartner. We are looking for top-notch talent as we continue to build the best analytics global consulting team in the world.
This role will be responsible for Databricks Architecture, Designing and implementing best data practices.
Requirements
- Strong Experience in Data Architecture, specifically with Databricks Architecture.
- Expert in Databricks Lakehouse (Delta Lake, Unity Catalog, MLflow), AWS, Snowflake, and Apache Iceberg.
- Strong MLOps & CI/CD Expertise
- Proficient in Python/Scala (Spark) for data governance, security, and enterprise data platform design.
- Databricks certifications and GenAI architecture experience preferred.
Key Responsibilities:
- Architect and strategize Databricks on AWS/Snowflake integration for secure, scalable data/AI platforms.
- Architect seamless Snowflake/Databricks data flow via Apache Iceberg (including ML output).
- Design cost-managed multi-region Databricks MLOps platform and data flows.
- Implement Unity Catalog for fine-grained access control and secure team coexistence with Workspaces.
- Develop Databricks-native MLOps (environment parity, Git-driven CI/CD, governed access, MLflow governance, standardized deployment, monitoring).
- Define enterprise-scalable AI governance for GenAI production deployment.
Benefits
This position offers an excellent opportunity for significant career development in a fast-growing and challenging entrepreneurial environment with a high degree of individual responsibility.
#LI-remote
Similar Jobs
Artificial Intelligence • Information Technology • Professional Services • Software • Analytics • Generative AI • Big Data Analytics
Lead design and implementation of an enterprise Databricks lakehouse, build scalable batch and streaming pipelines, enforce governance and CI/CD standards, optimize Spark workloads, operationalize ML with MLflow, manage cloud infrastructure and IaC, and mentor data engineering teams.
Top Skills:
AdlsAWSAzureDatabricksDatabricks Asset BundlesDatabricks WorkflowsDbxDelta LakeDelta Live TablesFeature StoreGCPGcsGitMlflowPhotonPysparkPythonS3ScalaSpark SqlSQLStructured StreamingTerraformUnity Catalog
Artificial Intelligence • Cloud • Information Technology • Professional Services
Lead customer engagements to architect, implement, and optimize large-scale Spark and Databricks workloads. Troubleshoot and tune distributed PySpark and DBSQL jobs, design PoCs/workshops, advocate technical solutions, mentor junior engineers, and collaborate cross-functionally to improve platform features and cost-efficiency.
Top Skills:
SparkDatabricksDatabricks SqlDelta LakeDelta Live TablesPysparkSpark InternalsSQLStructured StreamingUnity Catalog
Information Technology • Database • Consulting
Lead design and implementation of scalable Databricks data platforms and end-to-end data pipelines using Spark and Delta Lake. Drive migrations from legacy systems, enforce governance/security, optimize performance and costs, and collaborate with stakeholders and data science teams to enable analytics and AI/ML use cases.
Top Skills:
AlteryxSparkAWSAzureBi/Reporting PlatformsDatabricksDatabricks SqlDelta LakeGCPMl/AiMulesoftPythonScalaSQLUnity Catalog
What you need to know about the Chicago Tech Scene
With vibrant neighborhoods, great food and more affordable housing than either coast, Chicago might be the most liveable major tech hub. It is the birthplace of modern commodities and futures trading, a national hub for logistics and commerce, and home to the American Medical Association and the American Bar Association. This diverse blend of industry influences has helped Chicago emerge as a major player in verticals like fintech, biotechnology, legal tech, e-commerce and logistics technology. It’s also a major hiring center for tech companies on both coasts.
Key Facts About Chicago Tech
- Number of Tech Workers: 245,800; 5.2% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: McDonald’s, John Deere, Boeing, Morningstar
- Key Industries: Artificial intelligence, biotechnology, fintech, software, logistics technology
- Funding Landscape: $2.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Pritzker Group Venture Capital, Arch Venture Partners, MATH Venture Partners, Jump Capital, Hyde Park Venture Partners
- Research Centers and Universities: Northwestern University, University of Chicago, University of Illinois Urbana-Champaign, Illinois Institute of Technology, Argonne National Laboratory, Fermi National Accelerator Laboratory
