Oddball Logo

Oddball

Lead Data Engineer

Posted 15 Hours Ago
Remote
Hiring Remotely in USA
110K-145K Annually
Entry level
Remote
Hiring Remotely in USA
110K-145K Annually
Entry level
Leads the migration of legacy data warehouses and pipelines to an Azure and Databricks lakehouse. Defines technical architecture, reusable Azure Data Factory and Databricks pipelines, reconciliation methods, quality gates, and performance solutions. Mentors data engineers, reviews technical work, and collaborates with product, QA, platform, and customers in a remote Agile environment.
The summary above was generated by AI

Oddball believes that the best products are built when companies understand and value the things they are working on. We value learning and growth and the ability to make a big impact at a small company. We believe that we can make big changes happen and improve the daily lives of millions of people by bringing quality software to the federal space.

This position is contingent upon contract award.

We’re looking for a Lead Data Engineer to join our VA team, setting the technical approach for moving legacy data warehouse data and pipelines onto an Azure and Databricks lakehouse.

What you'll be doing:

  • Set the technical approach for migrating data and pipelines onto the lakehouse
  • Guide migration teams on patterns, reconciliation, and quality gates
  • Design reusable migration pipelines using Azure Data Factory and Azure Databricks
  • Define how source and target data are reconciled to confirm accuracy
  • Resolve the hardest pipeline and performance problems
  • Mentor data engineers and review their work
  • Partner with product, QA, and platform teams

What you’ll bring:

  • Data engineering leadership on large migration or modernization programs
  • Deep experience with Databricks or Spark and Azure Data Factory
  • Strong SQL and Python skills
  • Experience moving legacy ETL and data warehouse workloads to the cloud
  • Understanding of lakehouse and medallion architecture, including Delta
  • Experience in federal or regulated data environments is a plus
  • Thrives in a remote, collaborative Agile environment and genuinely enjoys leading and mentoring engineers
  • Communicates clearly and openly, whether setting technical direction or aligning with the customer
  • Perform other related duties as assigned

Requirements:

  • Applicants must be authorized to work in the United States. In alignment with federal contract requirements, certain roles may also require U.S. citizenship and the ability to obtain and maintain a federal background investigation and/or a security clearance.

Education:

  • Bachelor's Degree

Benefits:

  • Fully remote
  • Tech & Education Stipend
  • Comprehensive Benefits Package
  • Company Match 401(k) plan
  • Flexible PTO, Paid Holidays

Equal Opportunity Employer/Protected Veterans/Individuals with Disabilities:

Oddball is an Equal Opportunity Employer and does not discriminate against applicants based on race, religion, color, disability, medical condition, legally protected genetic information, national origin, gender, sexual orientation, marital status, gender identity or expression, sex (including pregnancy, childbirth or related medical conditions), age, veteran status or other legally protected characteristics. Any applicant with a mental or physical disability who requires an accommodation during the application process should contact an Oddball HR representative to request such an accommodation by emailing [email protected]

The contractor will not discharge or in any other manner discriminate against employees or applicants because they have inquired about, discussed, or disclosed their own pay or the pay of another employee or applicant. However, employees who have access to the compensation information of other employees or applicants as a part of their essential job functions cannot disclose the pay of other employees or applicants to individuals who do not otherwise have access to compensation information, unless the disclosure is (a) in response to a formal complaint or charge, (b) in furtherance of an investigation, proceeding, hearing, or action, including an investigation conducted by the employer, or (c) consistent with the contractor’s legal duty to furnish information. 41 CFR 60-1.35(c)

At Oddball, we may use AI-assisted tools as part of our recruitment process to help review applications, verify applicant information, and identify potentially fraudulent submissions. These tools support our recruiting team in maintaining a fair and secure hiring process. AI-generated findings are reviewed by our recruiting team and are not used as the sole basis for hiring decisions.

Compensation:

At Oddball, it’s important each employee is compensated competitively and fairly. In alignment with state legal requirements. A range for the included position is listed below. Be advised, actual offer details are determined by job category, job location, and candidate skill level.

United States Wage Range: $110,000 – $145,000

Similar Jobs

16 Hours Ago
Remote or Hybrid
GA, United States
120K-130K Annually
Senior level
120K-130K Annually
Senior level
Solar • Renewable Energy
Lead the rebuild and modernization of the company’s data platform by designing and implementing an Azure and Databricks lakehouse. Responsibilities include managing Azure Data Factory pipelines, developing Delta Lake architectures, creating data models and transformations with SQL and Python, establishing development standards, monitoring data quality, troubleshooting performance issues, leading technical projects, and mentoring or hiring data engineering staff.
Top Skills: AirbyteAzureAzure Data FactoryCi/CdDatabricksDelta LakeEstuaryFivetranGitInformaticaMicrosoft DynamicsNetSuiteOraclePower BIPythonSAPSQLSsisUnity Catalog
3 Days Ago
Remote
Minnesota, USA
188K-230K Annually
Senior level
188K-230K Annually
Senior level
Automotive • Hardware • Other • Energy • Industrial
Lead the architecture, development, and optimization of scalable data platforms and pipelines for AI/ML applications. Own ingestion, transformation, storage, quality, monitoring, governance, and compliance processes across batch and real-time environments. Collaborate with data scientists and ML engineers on features, training pipelines, and deployment; establish modeling, orchestration, versioning, and performance practices; contribute to technical roadmaps; and mentor junior engineers.
Top Skills: AirflowAzureAzure Data FactoryAzure Data LakeCi/CdCosmos DbDatabricksEmbeddingsEvent HubsInfrastructure As CodeKafkaLlmsMlopsPythonSparkSQLSynapseVector Databases
3 Days Ago
In-Office or Remote
40 Locations
105K-244K Annually
Senior level
105K-244K Annually
Senior level
Aerospace • Security • Cybersecurity • Industrial
Leads the design, development, governance, and productization of enterprise data models, pipelines, data products, and ontologies. Builds machine-learning-ready datasets, implements security and lineage controls, optimizes Databricks and Delta Lake environments, establishes data-product standards, collaborates with architects and data scientists, and mentors engineering talent. The role also defines product roadmaps, service levels, usage metrics, and continuous-improvement processes for enterprise data assets supporting AI agents, analytics, and applications.
Top Skills: Apache AirflowApache NifiSparkCloud IamDatabricksDelta LakeFeature StoresGenerative AiMachine Learning PipelinesPysparkPythonScalaSQLUnity Catalog

What you need to know about the Chicago Tech Scene

With vibrant neighborhoods, great food and more affordable housing than either coast, Chicago might be the most liveable major tech hub. It is the birthplace of modern commodities and futures trading, a national hub for logistics and commerce, and home to the American Medical Association and the American Bar Association. This diverse blend of industry influences has helped Chicago emerge as a major player in verticals like fintech, biotechnology, legal tech, e-commerce and logistics technology. It’s also a major hiring center for tech companies on both coasts.

Key Facts About Chicago Tech

  • Number of Tech Workers: 245,800; 5.2% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: McDonald’s, John Deere, Boeing, Morningstar
  • Key Industries: Artificial intelligence, biotechnology, fintech, software, logistics technology
  • Funding Landscape: $2.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Pritzker Group Venture Capital, Arch Venture Partners, MATH Venture Partners, Jump Capital, Hyde Park Venture Partners
  • Research Centers and Universities: Northwestern University, University of Chicago, University of Illinois Urbana-Champaign, Illinois Institute of Technology, Argonne National Laboratory, Fermi National Accelerator Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account