EXL Logo

EXL

Lead Data Engineer

Posted 6 Days Ago
Remote or Hybrid
Hiring Remotely in New Hampshire, USA
110K-140K Annually
Senior level
Remote or Hybrid
Hiring Remotely in New Hampshire, USA
110K-140K Annually
Senior level
Leads the design, development, and delivery of scalable cloud data solutions using Snowflake, AWS, Python, PySpark, SQL, and big data technologies. Oversees project delivery, requirements gathering, architecture, development, testing, deployment, performance tuning, risk management, and stakeholder communication. Provides technical guidance to teams and supports cloud migrations, Agile delivery, and adoption of modern data engineering practices.
The summary above was generated by AI

Lead Data Engineer with hands-on experience in designing and delivering scalable data solutions. The role requires expertise in cloud data platforms, AWS, Snowflake, data pipelines, ETL/ELT, data modernization, along with strong stakeholder management

Base Compensation Range: 110,000 - 140,000

The posted range is the hiring range for this role — a subset of the broader range available to employees over time — and reflects base salary across our national hiring scale. Final offers are based on several factors, including the candidate's skills and experience, internal pay equity, work location, market conditions for the role, and the specific scope and responsibilities of the position. The top of the range is reserved for candidates who notably exceed the requirements; the lower end applies to those with less experience or fewer preferred qualifications. For positions based in higher-cost zones (e.g., California, New York, New Jersey), actual compensation may exceed the posted range; your recruiter will share specifics during the process.

For more information on benefits and what we offer please visit us at https://www.exlservice.com/us-careers-and-benefits

Responsibilities
  • 7+ years of relevant experience in Data Engineering and project delivery.
  • Strong expertise in Big Data concepts and cloud implementation projects.
  • Proficient in Snowflake, SQL, and AWS services (Glue, EMR, S3, Aurora, RDS, AWS architecture).
  • Excellent hands-on experience with Python, PySpark, and AWS cloud microservices.
  • Capability to perform coding, debugging, performance tuning, and deploying applications to production environments.
  • Strong problem-solving abilities, analytical skills, and aptitude for ownership.
  • Skilled in Agile Methodology with experience in iterative project deliveries.
  • Quick learner with the ability to lead team members in adopting new technologies.
  • Exceptional communication and stakeholder management skills.

Good-to-Have Skills:

  • Familiarity with DevOps tools and practices (e.g., Jenkins, Git) and experience in CI/CD pipelines.
  • Knowledge of Spark, SQL (with Snowflake exposure), and advanced Big Data Concepts.
  • Experience with cloud migrations and development projects
  • Knowledge of US insurance and reinsurance domain
  • Knowledge of Data Vault 2.0

Role & Responsibilities:

  • Lead and oversee project delivery, ensuring timely completion with high quality.
  • Collaborate with clients and offshore leads to gather requirements and define high-level designs.
  • Direct development and unit testing activities while maintaining strong alignment with project goals.
  • Communicate effectively with stakeholders, providing regular updates on task and project statuses.
  • Identify, track, and address project risks or issues promptly.
  • Work closely with management to ensure seamless execution of tasks.
  • Provide technical guidance to the team, outlining design, implementation, and delivery strategies.

Qualifications

bachelors in engineering or related field 

Similar Jobs

3 Days Ago
Remote
United States
Senior level
Senior level
Artificial Intelligence • Information Technology • Machine Learning • Generative AI • Big Data Analytics
Lead customer-facing data engineering engagements from architecture through production handover. Build and optimize batch and streaming Lakehouse pipelines on Databricks using PySpark, SQL, and Delta Lake. Establish Medallion architecture conventions, implement data quality and automated testing, optimize Spark performance and platform costs, and mentor engineers. Partner with architects and explain technical trade-offs to customers.
Top Skills: AirflowSparkAWSAzureCi/CdDatabricksDatabricks Asset BundlesDbtDelta LakeGCPGitLakeflowPysparkPythonSQLUnity Catalog
3 Days Ago
Remote
US
Expert/Leader
Expert/Leader
Information Technology
Own the design and operation of Navanta’s data backbone, including secure bank-system ingestion, lakehouse architecture, semantic data modeling, reconciliation, quality, observability, and governance. Partner with AI/ML, security, and platform teams to deliver governed, queryable data products. Lead data contracts, lineage, PII classification, access controls, pipeline reliability, and onboarding of new bank environments.
Top Skills: AirflowApache IcebergDagsterDbtDebeziumDuckdbKafkaLakekeeperMinioNessiePgvectorPolarisPostgresPostgresql Logical ReplicationPrestoPythonRedpandaS3SQLSQL ServerSql Server CdcTrino
9 Days Ago
Remote
USA
110K-145K Annually
Entry level
110K-145K Annually
Entry level
Computer Vision • Software
Leads the migration of legacy data warehouses and pipelines to an Azure and Databricks lakehouse. Defines technical architecture, reusable Azure Data Factory and Databricks pipelines, reconciliation methods, quality gates, and performance solutions. Mentors data engineers, reviews technical work, and collaborates with product, QA, platform, and customers in a remote Agile environment.
Top Skills: AgileSparkAzureAzure Data FactoryDatabricksDelta LakePythonSQL

What you need to know about the Chicago Tech Scene

With vibrant neighborhoods, great food and more affordable housing than either coast, Chicago might be the most liveable major tech hub. It is the birthplace of modern commodities and futures trading, a national hub for logistics and commerce, and home to the American Medical Association and the American Bar Association. This diverse blend of industry influences has helped Chicago emerge as a major player in verticals like fintech, biotechnology, legal tech, e-commerce and logistics technology. It’s also a major hiring center for tech companies on both coasts.

Key Facts About Chicago Tech

  • Number of Tech Workers: 245,800; 5.2% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: McDonald’s, John Deere, Boeing, Morningstar
  • Key Industries: Artificial intelligence, biotechnology, fintech, software, logistics technology
  • Funding Landscape: $2.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Pritzker Group Venture Capital, Arch Venture Partners, MATH Venture Partners, Jump Capital, Hyde Park Venture Partners
  • Research Centers and Universities: Northwestern University, University of Chicago, University of Illinois Urbana-Champaign, Illinois Institute of Technology, Argonne National Laboratory, Fermi National Accelerator Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account