The Senior Data Engineer will optimize data integrations for Retail, design ETL workflows, enhance BigQuery performance, and maintain data quality in a collaborative, growth-driven environment.
Softeta is an IT consulting and custom software development company that works with mid-sized and large businesses across Europe. We help clients modernize legacy systems, build tailored digital solutions, and prepare their data infrastructure for AI and automation.
We are looking for a skilled Data or Software Engineer to help improve, maintain, and optimize the data integrations used in reports for the Retail industry. Are you seeking a vibrant, open-minded space where your growth is nurtured and innovation thrives? Your opportunity could be just around the corner!
Responsibilities:
- Combine data from multiple sources such as APIs, databases, and third-party systems;
- Design and execute ETL/ELT workflows utilizing advanced data processing tools like Cloud Composer/Airflow, Dataflow;
- Develop robust and efficient data pipelines, implement processing logic, and perform data transformations;
- Enhance BigQuery queries and allocate resources effectively to minimize costs and boost performance;
- Maintain data quality, availability, and security by adhering to industry best practices.
Requirements
- Demonstrated experience as a Data or Software Engineer in Senior role;
- Prior experience with dbt and Python is advantageous;
- Familiarity with CI/CD systems like GitLab is required;
- Experience with any public Cloud service;
- Knowledge of Google Cloud and Cloud Data Warehousing is highly beneficial;
- Specifically, experience with BigQuery or Snowflake and their integration with dbt is preferred. Additionally, proficiency with Terraform is strongly desired.
Benefits
- Diverse and technically challenging projects;
- Flexible working hours and hybrid or remote workplace model;
- Flexible schedule and Agile/SCRUM environment;
- Technical equipment which you can choose.
Top Skills
Airflow
APIs
BigQuery
Cloud Composer
Cloud Data Warehousing
Databases
Dataflow
Dbt
Gitlab
GCP
Python
Snowflake
Terraform
Similar Jobs
Information Technology • Software
The Senior Data Engineer will design and implement batch and streaming data pipelines, evolve AWS data lake architecture, and mentor peers while ensuring optimal performance and cost efficiency.
Top Skills:
Amazon KinesisApache KafkaSparkAWSAws CdkAws CloudwatchCi/CdDelta LakeDockerSparkuiTerraform
Artificial Intelligence • Information Technology • Consulting
Design and maintain data pipelines and ML systems, implement MLOps practices, and collaborate with teams to address client challenges in AI and data projects.
Top Skills:
Apache AirflowSparkAWSBedrockClickhouseEcrGlueKafkaLambdaPythonRedshiftS3SagemakerSnowflakeSQL
Software
Develop and deliver data pipelines, manage deployments, ensure data quality, and support troubleshooting within the data delivery team.
Top Skills:
Azure Data FactoryCi/CdDbtGitSnowflakeSQL
What you need to know about the Chicago Tech Scene
With vibrant neighborhoods, great food and more affordable housing than either coast, Chicago might be the most liveable major tech hub. It is the birthplace of modern commodities and futures trading, a national hub for logistics and commerce, and home to the American Medical Association and the American Bar Association. This diverse blend of industry influences has helped Chicago emerge as a major player in verticals like fintech, biotechnology, legal tech, e-commerce and logistics technology. It’s also a major hiring center for tech companies on both coasts.
Key Facts About Chicago Tech
- Number of Tech Workers: 245,800; 5.2% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: McDonald’s, John Deere, Boeing, Morningstar
- Key Industries: Artificial intelligence, biotechnology, fintech, software, logistics technology
- Funding Landscape: $2.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Pritzker Group Venture Capital, Arch Venture Partners, MATH Venture Partners, Jump Capital, Hyde Park Venture Partners
- Research Centers and Universities: Northwestern University, University of Chicago, University of Illinois Urbana-Champaign, Illinois Institute of Technology, Argonne National Laboratory, Fermi National Accelerator Laboratory
