Virtasant Logo

Virtasant

Senior Databricks Engineer/Architect

Posted 9 Days Ago
In-Office or Remote
Hiring Remotely in Austin, TX
Senior level
In-Office or Remote
Hiring Remotely in Austin, TX
Senior level
Design and maintain scalable data pipelines, lead migrations to Databricks, optimize PySpark transformations, and build reliable ETL/ELT workflows. Ensure data quality, performance, and scalability while translating technical requirements into effective data solutions. Present architecture designs, migration roadmaps, and project outcomes to stakeholders, bridging technical teams and business leadership.
The summary above was generated by AI
Senior Databricks Engineer/Architect

Job Type: 1099 contract, long-term & ongoing

Location: Remote in US

About Virtasant

Virtasant is a global technology services company with a network of over 4,000 technology professionals across 130+ countries.

We help organizations modernize cloud platforms, improve engineering efficiency, and optimize cloud spend through architecture, automation, and FinOps best practices.

Our teams work directly with enterprise customers to identify inefficiencies, drive modernization efforts, and deliver measurable business outcomes.

What We're Looking For

Experienced Senior Data Engineer or Data Architect specializing in designing, developing, and optimizing scalable data pipelines using PySpark and Databricks.

Skilled in architecting and executing data migrations to Databricks, modernizing data platforms, and building robust ETL/ELT workflows that ensure data quality, performance, and reliability.

Adept at translating complex technical requirements into effective data solutions, collaborating with cross-functional teams, and presenting technical strategies, architecture designs, and project outcomes to business stakeholders and leadership.

What You'll Do
  • Design, develop, and maintain scalable, high-performance data pipelines.

  • Architect and lead data migration strategies to the Databricks platform.

  • Develop and optimize complex data transformations using PySpark.

  • Build and enhance ETL/ELT processes to support enterprise data initiatives.

  • Ensure data quality, integrity, scalability, and performance across data platforms.

  • Present technical solutions, migration roadmaps, and project progress to stakeholders.

  • Bridge the gap between technical teams and business stakeholders to align data solutions with organizational objectives.

Similar Jobs

An Hour Ago
Remote or Hybrid
United States
142K-195K Annually
Senior level
142K-195K Annually
Senior level
Cloud • Fintech • Software • Business Intelligence • Consulting • Financial Services
Lead CFO-level client advisory engagements, manage change initiatives, provide financial analysis, develop client budgets, and mentor staff.
Top Skills: Bill.ComIntaactNetSuiteQuickbooks Online
An Hour Ago
Remote or Hybrid
United States
142K-195K Annually
Senior level
142K-195K Annually
Senior level
Cloud • Fintech • Software • Business Intelligence • Consulting • Financial Services
The CFO will oversee month-end close, financial reporting, audit readiness, client relationship management, and mentoring staff for casino industry clients.
Top Skills: Accounting Software
An Hour Ago
Remote or Hybrid
United States
107K-144K Annually
Senior level
107K-144K Annually
Senior level
Cloud • Fintech • Software • Business Intelligence • Consulting • Financial Services
Manage complex tax returns and consulting for partnerships, mentor staff, and develop tax planning strategies while ensuring compliance with tax regulations.
Top Skills: Internal Revenue CodeIrs RegulationsTax-Related Software

What you need to know about the Chicago Tech Scene

With vibrant neighborhoods, great food and more affordable housing than either coast, Chicago might be the most liveable major tech hub. It is the birthplace of modern commodities and futures trading, a national hub for logistics and commerce, and home to the American Medical Association and the American Bar Association. This diverse blend of industry influences has helped Chicago emerge as a major player in verticals like fintech, biotechnology, legal tech, e-commerce and logistics technology. It’s also a major hiring center for tech companies on both coasts.

Key Facts About Chicago Tech

  • Number of Tech Workers: 245,800; 5.2% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: McDonald’s, John Deere, Boeing, Morningstar
  • Key Industries: Artificial intelligence, biotechnology, fintech, software, logistics technology
  • Funding Landscape: $2.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Pritzker Group Venture Capital, Arch Venture Partners, MATH Venture Partners, Jump Capital, Hyde Park Venture Partners
  • Research Centers and Universities: Northwestern University, University of Chicago, University of Illinois Urbana-Champaign, Illinois Institute of Technology, Argonne National Laboratory, Fermi National Accelerator Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account