Design, build, deploy and maintain large-scale analytics and ETL solutions. Manage data ingestion, real-time streaming and batch processing across data stores, tune SQL and data flows, ensure quality, performance and maintainability, participate in QA/devops, cross-train team members, and contribute to community and best practices.
Ciklum is looking for a Senior Data Engineer to join our team full-time in the US .
We are a custom product engineering company that supports both multinational organizations and scaling startups to solve their most complex business challenges. With a global team of over 4,000 highly skilled developers, consultants, analysts and product owners, we engineer technology that redefines industries and shapes the way people live.
About the role:
As a Senior Data Engineer, become a part of a cross-functional development team engineering experiences of tomorrow.
Responsibilities:
- Responsible for the building, deployment, and maintenance of mission-critical analytics solutions that process terabytes of data quickly at big-data scales
- Contributes design, code, configurations, manage data ingestion, real-time streaming, batch processing, ETL across multiple data storages.
- Performs development, QA, and dev-ops roles as needed to ensure total end-to-end responsibility of solutions.
- Responsible for performance tuning of complicated SQL queries and Data flows
- Identify gaps and improve the platform’s quality, robustness, maintainability, and speed
- Cross-train other team members on technologies being developed, while also continuously learning new technologies from other team members.
- Contribute in the Unit’s activities and community building, participate in conferences, and provide excellence in exercise and best practices.
Requirements:
- 3+ years of experience coding in SQL, Java, Python, Scala, with solid CS fundamentals including data structure and algorithm design
- 2+ years contributing to production deployments of large backend data processing and analysis systems
- 1+ years of hands-on implementation experience working with a combination of the following technologies: Hadoop, Map Reduce, Pig, Hive, Impala, Spark, Kafka, Storm, SQL and NoSQL data warehouses such as Hbase and Cassandra.
- 2+ years of experience in cloud data platforms (AWS, Azure, GCP)
- Knowledge of professional software engineering best practices for the full software
- Knowledge of Data Warehousing, design, implementation and optimization
- Knowledge of Data Quality testing, automation and results visualization
- Knowledge of BI reports and dashboards design and implementation (PowerBI, Tableau)
- Knowledge of the development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations.
- Experience participating in an Agile software development team, e.g. SCRUM
- Experience designing, documenting, and defending designs for key components in large distributed computing systems
- A consistent track record of delivering exceptionally high-quality software on large, complex, cross-functional projects
- Demonstrated ability to learn new technologies quickly and independently
What’s in it for you?
- Strong community: Work alongside top professionals in a friendly, open-door environment
- Growth focus: Take on large-scale projects with a global impact and expand your expertise
- Tailored learning: Boost your skills with internal events (meetups, conferences, workshops), Udemy access, language courses, and company-paid certifications
- Endless opportunities: Explore diverse domains through internal mobility, finding the best fit to gain hands-on experience with cutting-edge technologies
- Care: Healthcare, Basic Life Insurance, Short and Long-term disability insurance according to the Company’s Benefit Plans
About us:
At Ciklum, we are always exploring innovations, empowering each other to achieve more, and engineering solutions that matter. With us, you’ll work with cutting-edge technologies, contribute to impactful projects, and be part of a One Team culture that values collaboration and progress. In the US, Ciklum is growing fast—inviting experienced professionals to lead digital transformation alongside Fortune 500 clients. Be part of a company where innovation and impact go hand in hand.
Explore, empower, engineer with Ciklum!
Interested already? We would love to get to know you! Submit your application. We can’t wait to see you at Ciklum.
#LI-HD1
Similar Jobs
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Design, build, and operate enterprise data pipelines and Lakehouse data products on Azure. Lead migrations, implement medallion architectures, optimize Spark and distributed SQL workloads, enforce CI/CD and observability, and support production incident response while partnering with architects, data scientists, and stakeholders.
Top Skills:
ArmAzure Ad / Entra IdAzure Data FactoryAzure Data Lake Storage Gen2Azure DatabricksAzure DevopsAzure Key VaultAzure MonitorAzure SqlAzure Synapse AnalyticsBashBicepDelta LakeKqlLog AnalyticsMicrosoft FabricPandasParquetPowershellPrivate EndpointsPysparkPytestPythonSpark SqlSsisSynapse Dedicated Sql PoolT-SqlTeradataTerraformUnity CatalogVnet
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Lead design and operation of large-scale data pipelines and data APIs. Build Spark/PySpark workflows on Databricks, optimize job performance, manage data quality and observability, and develop MCP servers and AI-agent integrations. Mentor engineers, define standards, support production incidents and on-call rotations, and collaborate with stakeholders to deliver scalable data platform products.
Top Skills:
Apache IcebergApi GatewayAWSAws LambdaAws Rds/AuroraAzureDatabricksDatadogDbtFastapiFivetranGCPGoogle BigqueryLlms/Ai AgentsMcp ServersMs Sql ServerMySQLOraclePostgresPysparkPythonS3SecretsmanagerSnowflakeSnsSparkSplunkSQLSqs
Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
Design and maintain data architecture and pipelines to support compliance and risk teams. Build and optimize data models, standardize metrics, and create data dictionaries. Implement data quality, lineage monitoring, AI-driven agents for false-positive reduction and automation, and participate in on-call rotations to ensure SLAs are met.
Top Skills:
AirflowDatabricksDbtGitOmniPrefectPythonSnowflakeSQLTerraform
What you need to know about the Chicago Tech Scene
With vibrant neighborhoods, great food and more affordable housing than either coast, Chicago might be the most liveable major tech hub. It is the birthplace of modern commodities and futures trading, a national hub for logistics and commerce, and home to the American Medical Association and the American Bar Association. This diverse blend of industry influences has helped Chicago emerge as a major player in verticals like fintech, biotechnology, legal tech, e-commerce and logistics technology. It’s also a major hiring center for tech companies on both coasts.
Key Facts About Chicago Tech
- Number of Tech Workers: 245,800; 5.2% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: McDonald’s, John Deere, Boeing, Morningstar
- Key Industries: Artificial intelligence, biotechnology, fintech, software, logistics technology
- Funding Landscape: $2.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Pritzker Group Venture Capital, Arch Venture Partners, MATH Venture Partners, Jump Capital, Hyde Park Venture Partners
- Research Centers and Universities: Northwestern University, University of Chicago, University of Illinois Urbana-Champaign, Illinois Institute of Technology, Argonne National Laboratory, Fermi National Accelerator Laboratory
