Design, build, and maintain large-scale data pipelines and ETL processes using PySpark/Apache Spark, SQL/NoSQL stores, Hadoop, and Kafka. Work with cloud platforms (AWS/Azure/GCP), data lakes and warehouses, and Python for data manipulation. Lead projects, perform systems analysis, ensure delivery under deadlines, and collaborate across teams. CI/CD and containerization experience is a plus.
Requirements and Qualifications:
- 8+ years of relevant experience in the Data Engineering, ApacheSpark
- Strong proficiency in PySpark and Apache Spark.
- Solid experience with SQL, NoSQL databases (e.g., Hive, HBase, Cassandra).
- Hands-on experience with big data frameworks (Hadoop, Kafka, etc.).
- Expertise in cloud platforms (AWS, Azure, or GCP).
- Proficiency in Python programming and data manipulation.
- Knowledge of ETL tools, data lakes, and data warehouses.
- Experience in CI/CD, containerization (Docker, Kubernetes) is a plus.
- Strong problem-solving and analytical skills.
- Excellent communication and teamwork skills.
- Experience in systems analysis and programming of software applications
- Experience in managing and implementing successful projects
- Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
Compensation, Benefits and Duration
Minimum Compensation: USD 46,000
Maximum Compensation: USD 161,000
Compensation is based on actual experience and qualifications of the candidate. The above is a reasonable and a good faith estimate for the role.
Medical, vision, and dental benefits, 401k retirement plan, variable pay/incentives, paid time off, and paid holidays are available for full time employees.
This position is not available for independent contractors
No applications will be considered if received more than 120 days after the date of this post
Photon Chicago, Illinois, USA Office
11 East Adams Street Suite 1100, Chicago, IL, United States, 60603
Similar Jobs
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Provide telephonic nursing case management including assessment, care planning, coordination of discharge and follow-up, high-risk patient monitoring, motivational interviewing, documentation in the EHR, and collaboration with physicians and care teams to reduce readmissions and optimize outcomes.
Top Skills:
Care Management DashboardsElectronic Health Record
3 Hours Ago
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Oversees daily clinical operations for Hematology/Oncology, Radiation Oncology, and Infusion Center services. Supervises staff, ensures competent compassionate patient care, supports accreditation, coordinates multidisciplinary teams, and may cross-cover centers or travel as needed.
Top Skills:
AriaBeaconEpicMS Office
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Customer-facing, hands-on AI builder who shapes strategic pursuits, designs end-to-end AI/GenAI architectures, prototypes demos and proofs-of-value, mentors solution leads, supports RFPs, and partners with engineering for implementation and delivery rotations.
Top Skills:
Ai AgentsAi FrameworksGenaiLlmsPythonRag
What you need to know about the Chicago Tech Scene
With vibrant neighborhoods, great food and more affordable housing than either coast, Chicago might be the most liveable major tech hub. It is the birthplace of modern commodities and futures trading, a national hub for logistics and commerce, and home to the American Medical Association and the American Bar Association. This diverse blend of industry influences has helped Chicago emerge as a major player in verticals like fintech, biotechnology, legal tech, e-commerce and logistics technology. It’s also a major hiring center for tech companies on both coasts.
Key Facts About Chicago Tech
- Number of Tech Workers: 245,800; 5.2% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: McDonald’s, John Deere, Boeing, Morningstar
- Key Industries: Artificial intelligence, biotechnology, fintech, software, logistics technology
- Funding Landscape: $2.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Pritzker Group Venture Capital, Arch Venture Partners, MATH Venture Partners, Jump Capital, Hyde Park Venture Partners
- Research Centers and Universities: Northwestern University, University of Chicago, University of Illinois Urbana-Champaign, Illinois Institute of Technology, Argonne National Laboratory, Fermi National Accelerator Laboratory
