Designs, builds, and maintains scalable AWS data pipelines, integrations, lakehouse infrastructure, and Airflow workflows. Processes commercial pharmaceutical data, supports pharma KPIs and analytics, and develops pipelines for AI, machine learning, generative AI, LLM, embeddings, and RAG applications. The role also includes legacy-system migration, pipeline monitoring and optimization, data quality assurance, and translating pharmaceutical business needs into reliable data solutions.
Tiger Analytics is a fast-growing advanced analytics consulting firm. Our consultants bring deep expertise in Data Science, Machine Learning and AI. We are the trusted analytics partner for several Fortune 100 companies, enabling them to generate business value from data. Our business value and leadership has been recognized by various market research firms, including Forrester and Gartner. We are looking for top-notch talent as we continue to build the best analytics global consulting team in the world.
We are seeking an experienced Data Engineer to join our data team. In this role, you will be responsible for designing, building, and maintaining scalable data pipelines, data integration processes, and data infrastructure on AWS cloud. You will collaborate closely with data scientists, analysts, and AI teams to support analytics, machine learning, and Generative AI initiatives across the organization.
Requirements
Key Responsibilities:
- Design, develop, and deploy end-to-end data pipelines on AWS using services such as Amazon S3, AWS Glue, AWS Lambda, Amazon Redshift, and related data platform technologies.
- Build and maintain scalable data processing and transformation workflows using Databricks, Apache Spark, and SQL.
- Develop and maintain Apache Airflow workflows for pipeline orchestration, scheduling, dependency management, monitoring, and automation.
- Integrate and process commercial pharmaceutical data sources such as Xponent, Veeva, MMIT, Plantrak, Specialty Pharmacy, LAAD, and similar sources.
- Build and optimize data pipelines supporting pharma KPIs, metrics, analytics, and reporting requirements.
- Design and implement data pipelines for AI/ML and Generative AI workloads, including structured and unstructured data preparation.
- Enable data pipelines supporting LLM-based applications, vector embeddings, and knowledge retrieval/RAG solutions.
- Support migration of legacy data systems and pipelines to modern AWS cloud and lakehouse architectures.
- Monitor, troubleshoot, and optimize data pipelines for performance, scalability, reliability, and cost-effectiveness.
- Ensure data pipelines meet required standards for data quality, accuracy, consistency, and operational reliability.
- Communicate effectively with technical and business stakeholders to understand requirements and translate pharmaceutical business needs into scalable data solutions.
Required Skills:
- 8+ years of experience in Data Engineering, preferably with experience supporting commercial pharmaceutical/healthcare data environments.
- Strong hands-on experience with AWS cloud, Databricks, Spark, and SQL
- Strong experience building ETL/ELT data pipelines and large-scale data processing workflows.
- Hands-on experience with Apache Airflow for workflow orchestration.
- Strong understanding of data modeling, data lake/lakehouse architecture, data ingestion, and transformation frameworks.
- Deep knowledge of commercial pharmaceutical data sources: Xponent, Veeva, MMIT, Plantrak, Specialty Pharmacy, LAAD, and other commercial pharma data sources
- Strong understanding of pharmaceutical commercial data processes, including: Alignment, Allocation, Split credits, Market basket, Customer universe
- Strong understanding of pharma KPIs, metrics, and commercial analytics.
- Strong analytical, problem-solving, and data troubleshooting skills.
Benefits
Significant career development opportunities exist as the company grows. The position offers a unique opportunity to be part of a small, challenging, and entrepreneurial environment, with a high degree of individual responsibility.
Tiger Analytics provides equal employment opportunities to applicants and employees without regard to race, color, religion, age, sex, sexual orientation, gender identity/expression, pregnancy, national origin, ancestry, marital status, protected veteran status, disability status, or any other basis as protected by federal, state, or local law.
Similar Jobs
AdTech • Artificial Intelligence • Marketing Tech • Software • Analytics
Build, deploy, and operate production-grade data pipelines and data products for healthcare audiences. Design transformations, data models, and governed views using Python, SQL, Airflow, S3, Snowflake, and EMR. Implement data-quality, monitoring, and privacy-by-design controls for PHI/PII. Partner with product, analytics, and platform teams to onboard sources, support audience discovery, segmentation, activation, measurement, and troubleshoot production issues.
Top Skills:
Amazon EmrAmazon S3Apache AirflowAthenaHivePythonSnowflakeSQL
eCommerce • Gaming • Mobile • Payments • Software
Leads data engineering strategy, architecture, delivery, support, and lifecycle management for secure, scalable cloud and hosted data solutions. Collaborates with technical and business stakeholders to deliver complex datasets, establish enterprise data standards, manage data engineering teams, and oversee maintenance, change management, capacity planning, business continuity, disaster recovery, and regulatory security requirements. The role also evaluates third-party tools and supports Azure DevOps, SDLC, CI/CD, and technical innovation.
Top Skills:
Azure DevopsCi/CdData LakesData WarehousesETLMicrosoft FabricMicrosoft Sql ServerMongoDBNoSQLPower BISdlcSnowflake
Healthtech
Design and own Ceresti’s end-to-end data architecture, including secure raw-data storage, validated file and API ingestion, Postgres pipelines, and curated analytics layers. Establish governance for HIPAA-protected data, data quality, lineage, observability, and access controls. Build ML feature tables and embedding capabilities, collaborate on data contracts, support Agile delivery, and mentor engineers on SQL and data-system design.
Top Skills:
AirflowAmazon S3AWSChange-Data-CaptureCi/CdClaudeCsvCursorDagsterData LakesData WarehousesDbtEmbeddingsGithub CopilotGreat ExpectationsHl7Infrastructure-As-CodeJSONJsonbLlmsLogical ReplicationPanderaPg_CronPg_PartmanPgvectorPostgresPrefectPythonRagRest ApisSftpSodaSQLVector SearchX12XML
What you need to know about the Chicago Tech Scene
With vibrant neighborhoods, great food and more affordable housing than either coast, Chicago might be the most liveable major tech hub. It is the birthplace of modern commodities and futures trading, a national hub for logistics and commerce, and home to the American Medical Association and the American Bar Association. This diverse blend of industry influences has helped Chicago emerge as a major player in verticals like fintech, biotechnology, legal tech, e-commerce and logistics technology. It’s also a major hiring center for tech companies on both coasts.
Key Facts About Chicago Tech
- Number of Tech Workers: 245,800; 5.2% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: McDonald’s, John Deere, Boeing, Morningstar
- Key Industries: Artificial intelligence, biotechnology, fintech, software, logistics technology
- Funding Landscape: $2.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Pritzker Group Venture Capital, Arch Venture Partners, MATH Venture Partners, Jump Capital, Hyde Park Venture Partners
- Research Centers and Universities: Northwestern University, University of Chicago, University of Illinois Urbana-Champaign, Illinois Institute of Technology, Argonne National Laboratory, Fermi National Accelerator Laboratory
