Lead refactoring and optimization of scalable data pipelines, design next-generation distributed storage and processing systems, build clean interfaces for diverse data consumers, mentor engineers, and establish engineering standards and processes.
As a Staff Software Engineer, you will lead the evolution of our backend architecture, with a primary focus on refactoring and optimizing existing data pipelines. You will drive the development of next-generation distributed data storage and processing systems designed to scale indefinitely and surpass traditional query performance. Beyond modernization, you will design clean, expressive interfaces that abstract complexity for a wide range of data consumers—from core web applications to advanced business analytics and AI. Your expertise will be instrumental in transforming our infrastructure into a robust, high-performance foundation.
Primary Duties:
- Identify and develop scalable and performant solutions.
- Work across discipline to shape product strategy and execution.
- Develop the foundations of code architecture and quality.
- Mentor and coach engineers.
- Set and uphold the standard for engineering processes to support high-quality engineering.
Minimum Qualifications:
- BS/BTech (or higher) in Computer Science, Engineering or a related field required.
- 8+ years of production-level experience as an engineer building highly scalable systems.
- 4+ years of experience acting as a trusted technical decision-maker in a team setting, solving for short-term and long-term business value.
- 4+ years of experience working with SQL or other database querying languages on large multi-table data sets.
- Experience architecting, developing, and deploying large-scale distributed systems at scale.
- Experience with cloud technologies, e.g., AWS, Azure, GCP.
- Experience building continuous integration and continuous development (CI/CD) pipelines.
- Strong familiarity with server-side web technologies (eg: Java, Python, Scala, C#, C++, Go).
Preferred KSAs:
- 8+ years experience building highly scalable and reliable infrastructure.
- Expertise in designing, optimizing, and orchestrating robust data pipelines (ETL/ELT) and ingestion systems for large-scale, real-time, and batch processing.
- Experience managing data warehouses (e.g., Snowflake, Redshift) and leveraging analytics tools (e.g., Spark, SQL, Python, Databricks).
- Hands-on experience with containerization (Docker, Kubernetes), CI/CD pipelines, and distributed architectures (event-driven, in-memory computing).
- Deep proficiency with modern database systems, including replication, sharding, partitioning, indexing, and caching strategies for high-performance query optimization.
- Strong understanding of data security, governance, and compliance principles.
- Experience with infrastructure monitoring, performance optimization, and active participation in architecture reviews.
Physical Requirements:
Sitting for prolonged periods of time. Extensive use of computers and keyboard. Occasional walking and lifting may be required.
Similar Jobs
Cloud • Marketing Tech • Social Media • Software • Analytics
Leads technical roadmap and architecture while building scalable full-stack SaaS features hands-on. Owns the full development lifecycle, establishes engineering, testing, security, and AI-assisted development standards, and guides cloud-native system evolution. Collaborates across product and engineering, mentors engineers, mitigates technical risks, and drives quality, performance, observability, and continuous improvement.
Top Skills:
AlertingAWSCdkCi/CdClaude CodeCloudFormationGoInfrastructure As CodeJavaMetricsPythonReactStructured LoggingTerraformTypescript
Cloud • Fintech • Information Technology • Machine Learning • Software • App development • Generative AI
Early-career AI Engineer building customer-facing generative AI and agentic solutions. Rapidly prototype and convert prototypes to production MVPs, implement LLM-based reasoning, RAG pipelines, and multi-agent orchestration. Run experiments and benchmarks, contribute to MLOps standards, model lifecycle, monitoring, security, and governance while collaborating with cross-functional teams and cloud-native AI stacks.
Top Skills:
Agentic AiAWSFine-TuningGenerative AiGCPGoogle Cloud Vertex AiLarge Language Models (Llms)Llm TrainingMlops/AimlopsModel Evaluation And MonitoringMulti-Agent OrchestrationPrompt EngineeringRetrieval-Augmented Generation (Rag)
Artificial Intelligence • Fintech • Hardware • Information Technology • Sales • Software • Transportation
Lead and scale analyst relations strategy to drive analyst engagement and favorable placements. Build relationships with major analyst firms, prepare executive briefings, manage evaluations (e.g., Gartner, Forrester, IDC), turn analyst feedback into actionable messaging/product recommendations, enable sales with analyst insights, and measure program impact.
Top Skills:
AICold Chain TrackingFleet ManagementPredictive MaintenanceProject Management ToolsSaaSTelematicsTransportation Management
What you need to know about the Chicago Tech Scene
With vibrant neighborhoods, great food and more affordable housing than either coast, Chicago might be the most liveable major tech hub. It is the birthplace of modern commodities and futures trading, a national hub for logistics and commerce, and home to the American Medical Association and the American Bar Association. This diverse blend of industry influences has helped Chicago emerge as a major player in verticals like fintech, biotechnology, legal tech, e-commerce and logistics technology. It’s also a major hiring center for tech companies on both coasts.
Key Facts About Chicago Tech
- Number of Tech Workers: 245,800; 5.2% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: McDonald’s, John Deere, Boeing, Morningstar
- Key Industries: Artificial intelligence, biotechnology, fintech, software, logistics technology
- Funding Landscape: $2.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Pritzker Group Venture Capital, Arch Venture Partners, MATH Venture Partners, Jump Capital, Hyde Park Venture Partners
- Research Centers and Universities: Northwestern University, University of Chicago, University of Illinois Urbana-Champaign, Illinois Institute of Technology, Argonne National Laboratory, Fermi National Accelerator Laboratory
