Miratech Logo

Miratech

Middle Data Engineer (Azure Databricks)

Posted 11 Days Ago
Be an Early Applicant
In-Office or Remote
Hiring Remotely in Warsaw, Warszawa, Masovian
Mid level
In-Office or Remote
Hiring Remotely in Warsaw, Warszawa, Masovian
Mid level
Design, build, and maintain cloud data pipelines and Lakehouse architectures using Azure Databricks, PySpark, Delta Lake, and Azure Data Factory. Integrate multiple data sources, optimize large-scale data processing, support SQL Server/SSIS environments, and collaborate with BI teams (Power BI) to enable analytics and reporting.
The summary above was generated by AI
Company Description

Miratech helps visionaries change the world. We are a global IT services and consulting company that brings together enterprise and start-up innovation. Today, we support digital transformation for some of the world's largest enterprises. By partnering with both large and small players, we stay at the leading edge of technology, remain nimble even as a global leader, and create technology that helps our clients further enhance their business. We are a values-driven organization and our culture of Relentless Performance has enabled over 99% of Miratech's engagements to succeed by meeting or exceeding our scope, schedule, and/or budget objectives since our inception in 1989. 
Miratech has coverage across 5 continents and operates in over 25 countries around the world. Miratech retains nearly 1000 full-time professionals, and our annual growth rate exceeds 25%.

Job Description

We are looking for a Middle Data Engineer specialized in Azure Databricks to join our data platform team.

The candidate will design and develop modern data pipelines and Lakehouse architectures, leveraging Azure Databricks, Spark, and Azure Data Factory, while integrating with existing SQL Server-based data warehouse environments, also evolving our data platform towards scalable, cloud-based data architectures, enabling advanced analytics and business intelligence.

 Key responsibilities:

  • Design, develop, and maintain data pipelines using Azure Databricks
  • Build and optimize data transformations using PySpark and SQL in Databricks
  • Implement and maintain Lakehouse architectures using Delta Lake
  • Develop ETL/ELT pipelines orchestrated through Azure Data Factory
  • Integrate data from multiple sources into the data platform and analytical layers
  • Design and maintain data models and data warehouse structures for analytics
  • Ensure data quality, scalability, and performance of large-scale data processing pipelines
  • Collaborate with BI teams to support Power BI and reporting platforms
  • Support and evolve existing SQL Server data platforms and ETL solutions (SSIS) when required
  • Contribute to the design of modern cloud-based data architectures

Qualifications

  • 3+ years of experience in Data Engineering or Data Warehouse development
  • Experience with Azure Databricks
  • Experience developing data pipelines using PySpark and Spark SQL
  • Solid understanding of distributed data processing and big data concepts
  • Experience working with Delta Lake and Lakehouse architectures
  • Strong SQL skills and experience with SQL Server relational databases
  • Experience building data pipelines using Azure Data Factory
  • Experience handling large datasets and performance optimization

Nice to have 

  • Experience with Spark optimization techniques (partitioning, caching, cluster tuning)
  • Experience with structured streaming in Databricks
  • Knowledge of CI/CD pipelines for data platforms (Azure Devops)
  • Familiarity with Power BI
  • Experience in migrating from traditional ETL process to cloud architectures 

Soft Skills 

  • Strong analytical and problem-solving skills.
  • Ability to work in collaborative environments and to adapt
  • Committed to continuous learning and professional development, with a keen focus on advancing cloud computing expertise
  • Team player
  • Good communication skills with technical and non-technical roles
  • Is proactive rather than reactive, actively identifying improvements and proposing solutions
  • Is comfortable working in dynamic environments where priorities and technologies evolve

Additional Information

We offer:

  • Culture of Relentless Performance: join an unstoppable technology development team with a 99% project success rate and more than 30% year-over-year revenue growth.
  • Competitive Pay and Benefits: enjoy a comprehensive compensation and benefits package, including health insurance, and a relocation program.
  • Work From Anywhere Culture: make the most of the flexibility that comes with remote work.
  • Growth Mindset: reap the benefits of a range of professional development opportunities, including certification programs, mentorship and talent investment programs, internal mobility and internship opportunities.
  • Global Impact: collaborate on impactful projects for top global clients and shape the future of industries.
  • Welcoming Multicultural Environment: be a part of a dynamic, global team and thrive in an inclusive and supportive work environment with open communication and regular team-building company social events.
  • Social Sustainability Values: join our sustainable business practices focused on five pillars, including IT education, community empowerment, fair operating practices, environmental sustainability, and gender equality.

* Miratech is an equal opportunity employer and does not discriminate against any employee or applicant for employment on the basis of race, color, religion, sex, national origin, age, disability, veteran status, sexual orientation, gender identity, or any other protected status under applicable law.

Similar Jobs

4 Hours Ago
Easy Apply
Remote or Hybrid
Easy Apply
Senior level
Senior level
Enterprise Web • Hardware • Internet of Things • Software
Serve as the technical advisor for assigned manufacturing accounts, driving adoption of Tulip's no-code platform through architecture guidance, integrations, workshops, and cross-functional collaboration to ensure customer success and growth.
Top Skills: APIsDatabasesMesNo-Code/Low-Code PlatformsSystem IntegrationsTulip
4 Hours Ago
Remote
144K-201K Annually
Senior level
144K-201K Annually
Senior level
Artificial Intelligence • Fintech • Information Technology • Logistics • Payments • Business Intelligence • Generative AI
Administer and support core collaboration tools (Google Workspace, Slack, Microsoft 365), manage user accounts and access, maintain intranet and documentation, troubleshoot end-user issues, collaborate on IT infrastructure and projects, monitor performance, and implement system improvements.
Top Skills: Active DirectoryConfluenceDhcpDnsGeminiGmailGoogle DocsGoogle DriveGoogle SitesGoogle WorkspaceGroup PolicyMicrosoft 365MimecastOktaOnedriveProject Management ToolsSharepoint OnlineSimpplrSlackTeams
15 Hours Ago
Easy Apply
Remote
Easy Apply
308K-428K Annually
Senior level
308K-428K Annually
Senior level
Big Data • Fintech • Mobile • Payments • Financial Services
Lead backend engineer on the Repayment Scheduling team responsible for owning and delivering quarterly goals, designing and operating backend systems that automate and orchestrate payments at scale. Collaborate with product, design, and analytics; define technical plans; improve availability and observability; support on-call and operational efforts; set code and design standards; and mentor and develop engineering talent.
Top Skills: AWSKotlinKubernetesMySQLPython

What you need to know about the Chicago Tech Scene

With vibrant neighborhoods, great food and more affordable housing than either coast, Chicago might be the most liveable major tech hub. It is the birthplace of modern commodities and futures trading, a national hub for logistics and commerce, and home to the American Medical Association and the American Bar Association. This diverse blend of industry influences has helped Chicago emerge as a major player in verticals like fintech, biotechnology, legal tech, e-commerce and logistics technology. It’s also a major hiring center for tech companies on both coasts.

Key Facts About Chicago Tech

  • Number of Tech Workers: 245,800; 5.2% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: McDonald’s, John Deere, Boeing, Morningstar
  • Key Industries: Artificial intelligence, biotechnology, fintech, software, logistics technology
  • Funding Landscape: $2.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Pritzker Group Venture Capital, Arch Venture Partners, MATH Venture Partners, Jump Capital, Hyde Park Venture Partners
  • Research Centers and Universities: Northwestern University, University of Chicago, University of Illinois Urbana-Champaign, Illinois Institute of Technology, Argonne National Laboratory, Fermi National Accelerator Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account