Lead design and implement cloud-based data platforms and GenAI solutions using AWS/Azure/GCP, Databricks, and Snowflake. Build scalable ETL/ELT pipelines, deploy ML/LLM models, define data governance and compliance, advise clients, manage delivery, and mentor cross-functional teams.
Title: Data and AI Architect (Lead/Manager Level)
Location: New York
Overview:
We are seeking a Data and AI Architect with a proven track record in designing and implementing data platforms and AI solutions using cloud technologies (AWS, Azure, GCP), Databricks, and Snowflake. The ideal candidate will combine technical expertise, hands-on experience, and leadership capabilities to deliver impactful solutions for our clients, including the development and deployment of GenAI solutions for next-generation business applications.
Key Responsibilities:
Solution Design and Implementation
- Architect and implement modern data platforms using cloud technologies such as AWS, Azure, and GCP.
- Build scalable and efficient data pipelines leveraging Databricks and Snowflake to support diverse client needs.
- Design and deploy AI/GenAI solutions, including machine learning models, natural language processing tools, and predictive analytics, to address complex business challenges.
Data Governance and Quality
- Develop data governance frameworks to ensure data quality, security, and compliance with industry regulations.
- Implement best practices for data lineage, monitoring, and cataloging using tools like Databricks and Snowflake.
- Work with clients to establish policies for managing data assets and ensuring compliance with GDPR, CCPA, and other regulatory requirements.
Client Engagement and Delivery
- Act as a trusted technical advisor to clients, translating business challenges into actionable data and AI strategies.
- Lead workshops, provide guidance on architecture decisions, and ensure alignment with client objectives.
- Manage solution delivery, including resource planning, timeline tracking, and adherence to budget constraints.
Technology Expertise and Innovation
- Stay current on advancements in cloud platforms, Databricks, Snowflake, and AI technologies to recommend innovative solutions.
- Explore and implement GenAI technologies to create transformative solutions such as personalized customer experiences, generative content creation, and intelligent automation.
- Contribute to the development of reusable frameworks and accelerators to enhance delivery efficiency.
Team Leadership and Development
- Provide technical leadership to cross-functional teams, ensuring high-quality delivery of data and AI projects.
- Mentor team members on cloud technologies, data platforms, and AI frameworks.
- Foster a collaborative environment to encourage innovation and continuous learning.
Qualifications:
- Experience: 6–10 years of experience in data architecture, engineering, or analytics, including client-facing or consulting roles.
- Cloud Expertise: Hands-on experience with AWS, Azure, and GCP, including data storage, compute, and analytics services.
- Data Platforms: Strong knowledge of Databricks and Snowflake, including experience with ETL/ELT workflows, performance tuning, and scaling.
- AI/GenAI Knowledge: Experience designing and deploying AI/GenAI solutions using frameworks like TensorFlow, PyTorch, Hugging Face, and advanced large language models (LLMs) such as OpenAI's GPT and Google's Gemini.
- Technical Skills: Proficiency in SQL, Python, Spark, and other data engineering and analytics tools.
- Leadership: Ability to lead technical teams and manage client engagements effectively.
- Education: Bachelor’s degree in Computer Science, Data Science, or a related field; advanced degree preferred.
Preferred Skills:
- Certification in AWS, Azure, or GCP architecture.
- Familiarity with tools such as dbt, Apache Airflow, and Kafka.
- Knowledge of customer data platforms and data-driven marketing strategies.
Compensation, Benefits and Duration
Minimum Compensation: USD 100,000
Maximum Compensation: USD 300,000
Compensation is based on actual experience and qualifications of the candidate. The above is a reasonable and a good faith estimate for the role.
Medical, vision, and dental benefits, 401k retirement plan, variable pay/incentives, paid time off, and paid holidays are available for full time employees.
This position is not available for independent contractors
No applications will be considered if received more than 120 days after the date of this post
Photon Chicago, Illinois, USA Office
11 East Adams Street Suite 1100, Chicago, IL, United States, 60603
Similar Jobs
Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
Field-driven territory sales role responsible for full-cycle, self-sourced selling: prospecting, in-person demos, closing deals, building pipeline and partnerships, onboarding coordination, and maintaining Salesforce pipeline and forecasts. Spend most of the week in-market, hit weekly visit targets, and exceed quota across Square's product ecosystem.
Top Skills:
Salesforce
HR Tech • Information Technology • Professional Services • Sales • Software
The role involves supporting customers with benefits administration issues, troubleshooting complex problems, and collaborating with multiple teams to improve product functionality and customer experience. Candidates should have a strong background in US benefits administration and exceptional problem-solving skills.
Top Skills:
APIsAsanaJIRASaaSSalesforceZendesk
Security • Software • Cybersecurity • Automation
Lead and scale an enterprise Customer Success team for high-touch SaaS customers. Build CS processes, drive retention and expansion, manage escalations, collaborate cross-functionally, monitor performance metrics, and use data to improve outcomes for strategic accounts.
What you need to know about the Chicago Tech Scene
With vibrant neighborhoods, great food and more affordable housing than either coast, Chicago might be the most liveable major tech hub. It is the birthplace of modern commodities and futures trading, a national hub for logistics and commerce, and home to the American Medical Association and the American Bar Association. This diverse blend of industry influences has helped Chicago emerge as a major player in verticals like fintech, biotechnology, legal tech, e-commerce and logistics technology. It’s also a major hiring center for tech companies on both coasts.
Key Facts About Chicago Tech
- Number of Tech Workers: 245,800; 5.2% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: McDonald’s, John Deere, Boeing, Morningstar
- Key Industries: Artificial intelligence, biotechnology, fintech, software, logistics technology
- Funding Landscape: $2.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Pritzker Group Venture Capital, Arch Venture Partners, MATH Venture Partners, Jump Capital, Hyde Park Venture Partners
- Research Centers and Universities: Northwestern University, University of Chicago, University of Illinois Urbana-Champaign, Illinois Institute of Technology, Argonne National Laboratory, Fermi National Accelerator Laboratory
