Build and maintain scalable data pipelines and Python automations for ingesting, processing, and enriching data. Integrate SaaS sources via APIs, use Databricks/PySpark/Delta Lake and AI tools to power lead generation, enrichment, deduplication, and entity resolution. Collaborate cross-functionally to translate business needs into automated, production-ready solutions.
About the Role
RequirementsTechnical Skills
BenefitsWhat We Offer:
We're looking for an AI-Enabled Data & Automation Engineer who thrives on solving complex data challenges through software and automation.
You'll be responsible for building scalable data pipelines, integrating data from multiple SaaS platforms, developing automation that powers lead generation and enrichment, and leveraging AI to dramatically accelerate development. You'll work with modern technologies including Python, Databricks, and LLM-powered tools to build solutions that directly impact business growth.
This role is ideal for someone who enjoys building, experimenting with new technologies, and continuously finding better and faster ways to solve problems.
Responsibilities- Design, build, and maintain scalable data pipelines for ingesting, processing, and enriching large datasets.
- Develop Python-based automation for data collection, transformation, validation, and workflow orchestration.
- Build and optimize data processing workflows using Databricks, PySpark, SQL, and Delta Lake.
- Integrate and process data from multiple SaaS platforms through REST APIs and other integrations.
- Develop scalable workflows for lead generation, company and contact enrichment, and sales intelligence.
- Implement processes for data cleansing, deduplication, entity resolution, normalization, and contact/company matching.
- Process structured, semi-structured, and JSON data from a variety of internal and external sources.
- Collaborate with product, engineering, and go-to-market teams to translate business requirements into scalable technical solutions.
- Identify opportunities to automate repetitive processes and improve operational efficiency.
- Continuously evaluate and adopt new AI tools and technologies that improve development speed and data quality.
RequirementsTechnical Skills
- 3–7+ years of experience in Data Engineering, Marketing Operations, Sales Operations, or a related technical field.
- Strong Python programming skills with experience in data processing, automation, and API integrations.
- Experience with Databricks, PySpark, SQL, and Delta Lake.
- Experience integrating and processing data from multiple SaaS platforms via APIs.
- Strong understanding of lead enrichment, data quality, deduplication, entity resolution, and contact/company matching.
- Experience working with structured, semi-structured, and JSON data.
- Familiarity with Git and modern software development practices.
- Undergraduate Degree in Computer Science, Engineering, Physics or other relevant degree
- Heavy user of AI coding tools such as Cursor, Claude Code, GitHub Copilot, ChatGPT, or similar AI development assistants.
- Demonstrated ability to leverage AI to accelerate software development, automate workflows, improve data quality, and increase productivity.
- Comfortable rapidly prototyping, testing, and iterating using AI-assisted development.
- Hands-on experience with lead generation and sales intelligence platforms such as Apollo, Clay, LinkedIn Sales Navigator, ZoomInfo, or similar tools.
- Experience with CRM platforms such as Salesforce or HubSpot.
- Familiarity with LLM APIs and AI-powered applications.
- Experience working in fast-paced startup environments.
- Strong communication skills with the ability to work cross-functionally and take ownership from concept through delivery.
Plum AI, Inc looks forward to applicants from US based candidates. We are not working with outside recruiters. We appreciate individual, not AI generated, applications. We may disqualify applicants who use AI in any part of the interview process.
BenefitsWhat We Offer:
- A fast-paced, collaborative startup culture with high visibility.
- Autonomy, flexibility, and a flat corporate structure that gives you the opportunity for your direct input to be realized and put into action.
- Opportunity to make a meaningful impact in building a company and culture.
- Equity in a financial technology startup.
- Generous health, dental, and vision coverage for employees and family members + 401K.
- Eleven paid holidays and unlimited discretionary vacation days.
- Competitive compensation and bonus potential.
Similar Jobs
Artificial Intelligence • Big Data • Cloud • Machine Learning • Software • Business Intelligence • Data Privacy
The role involves designing cloud infrastructure, managing production Kubernetes clusters, optimizing CI/CD pipelines, enhancing developer experience, and ensuring reliable AI workloads. Candidates should have extensive experience in infrastructure and distributed systems engineering with strong coding skills and cloud expertise.
Top Skills:
AWSAzureDatadogDockerElkGCPGoGrafanaJavaKubernetesPrometheusPythonTerraform
Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Lead development and execution of internal communications and change management strategies to align employees with organizational goals. Manage channels, create content (copywriting, speech writing), use data to improve communications, build stakeholder relationships, embrace technology, oversee project planning/budgeting, and mentor team members while resolving conflicts and driving adoption of communication initiatives.
Artificial Intelligence • HR Tech • Information Technology • Software • Business Intelligence
The Enterprise Account Executive will drive enterprise sales of the Qualtrics Experience Management platform, engage with Fortune 100/500 clients, and consistently meet sales quotas while managing relationships.
Top Skills:
Salesforce
What you need to know about the Chicago Tech Scene
With vibrant neighborhoods, great food and more affordable housing than either coast, Chicago might be the most liveable major tech hub. It is the birthplace of modern commodities and futures trading, a national hub for logistics and commerce, and home to the American Medical Association and the American Bar Association. This diverse blend of industry influences has helped Chicago emerge as a major player in verticals like fintech, biotechnology, legal tech, e-commerce and logistics technology. It’s also a major hiring center for tech companies on both coasts.
Key Facts About Chicago Tech
- Number of Tech Workers: 245,800; 5.2% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: McDonald’s, John Deere, Boeing, Morningstar
- Key Industries: Artificial intelligence, biotechnology, fintech, software, logistics technology
- Funding Landscape: $2.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Pritzker Group Venture Capital, Arch Venture Partners, MATH Venture Partners, Jump Capital, Hyde Park Venture Partners
- Research Centers and Universities: Northwestern University, University of Chicago, University of Illinois Urbana-Champaign, Illinois Institute of Technology, Argonne National Laboratory, Fermi National Accelerator Laboratory
