Design, develop, and manage data infrastructure for internal and client projects, focusing on large-scale data pipelines, APIs, and cloud deployments.
Object Computing, Inc. (OCI)
OCI is seeking experienced Data Engineers to design, develop, and manage data infrastructure for internal and client projects within our AI/ML & Data Insights team.
About OCI
We provide a collaborative environment focused on innovation, leveraging open-source software and strategic partnerships with Amazon and Google to build transformative technology solutions.
Job Responsibilities
- Design, build, and optimize large-scale data pipelines (Azure, AWS, GCP)
- Develop data ingestion and storage solutions.
- Implement scalable APIs and ensure system performance.
- Manage big data infrastructure and cloud deployments.
- Collaborate with developers, designers, and data scientists.
- Work in an Agile/DevOps environment.
Core Competencies
- ETL data engineering (Databricks, SQL Server, Snowflake, BigQuery, Apache Spark).
- Proficiency in Go, Java, Python, or Scala.
- Proficiency in CI/CD pipelines and Infrastructure as Code (IaC) (Terraform, CDK, Ansible).
- Hands-on experience with event-driven architectures (Kafka, Pulsar).
- Strong knowledge of data warehousing, SQL/NoSQL databases, and cloud platforms.
- Experience with distributed computing, DevOps tools, and data governance.
- Familiarity with Delta Lake, Unity Catalog, Delta Sharing, and DLT.
Preferred Qualifications
- Degree in Computer Science, Data Engineering, or a related field, or equivalent experience.
- Experience with AI/ML-driven data solutions and real-time data processing.
- Expertise in building scalable APIs and integrating with modern analytics tools (Power BI, Tableau, QuickSight).
- Cloud certifications (Databricks, AWS, Azure, GCP).
Similar Jobs
Aerospace • Hardware • Information Technology • Security • Software • Cybersecurity • Defense
Design, build, and maintain large-scale ETL pipelines and data warehouses (Redshift) with strong data modeling, governance, and quality controls. Optimize systems for performance and reliability, integrate and deploy AI/ML models, troubleshoot and support Redshift, collaborate with data scientists and stakeholders, and produce technical documentation and knowledge-base articles.
Top Skills:
Amazon RedshiftApache AirflowApache KafkaAWSAws GlueFivetranJavaNoSQLOraclePysparkPythonPyTorchScalaScikit-LearnSparkSQLSQL ServerTensorFlow
Financial Services
Designs, develops, tests, and maintains secure, scalable data pipelines and architectures. Ensures data quality, performance tuning, ETL processing, and storage. Uses SQL/NoSQL, Python/PySpark, AWS, and data serialization/storage formats. Produces design artifacts, visualizations, and reporting; applies SDLC tools, CI/CD, TDD/BDD, and enterprise AI-assisted coding tools while enforcing data controls and security.
Top Skills:
Ai-Assisted Development ToolsAvroAWSBddCi/CdETLIcebergJavaJSONNoSQLParquetProtobufPysparkPythonSQLTddUnix Scripting
.png)
Cloud • Insurance • Payments • Software • Business Intelligence • App development • Big Data Analytics
Build, model, and maintain scalable BigQuery-based data solutions on GCP. Implement performant data models, storage partitioning/clustering, ETL improvements, data validation, and documentation. Collaborate with architects, data scientists, and engineers to deliver governed, high-quality data for reporting and AI initiatives.
Top Skills:
Ansi SqlBigQueryBigquery SqlConfluenceGCPJIRAPythonSQL
What you need to know about the Chicago Tech Scene
With vibrant neighborhoods, great food and more affordable housing than either coast, Chicago might be the most liveable major tech hub. It is the birthplace of modern commodities and futures trading, a national hub for logistics and commerce, and home to the American Medical Association and the American Bar Association. This diverse blend of industry influences has helped Chicago emerge as a major player in verticals like fintech, biotechnology, legal tech, e-commerce and logistics technology. It’s also a major hiring center for tech companies on both coasts.
Key Facts About Chicago Tech
- Number of Tech Workers: 245,800; 5.2% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: McDonald’s, John Deere, Boeing, Morningstar
- Key Industries: Artificial intelligence, biotechnology, fintech, software, logistics technology
- Funding Landscape: $2.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Pritzker Group Venture Capital, Arch Venture Partners, MATH Venture Partners, Jump Capital, Hyde Park Venture Partners
- Research Centers and Universities: Northwestern University, University of Chicago, University of Illinois Urbana-Champaign, Illinois Institute of Technology, Argonne National Laboratory, Fermi National Accelerator Laboratory
