Alta Genetics Logo

Alta Genetics

Senior Data Engineer

Posted One Month Ago
Remote
Hiring Remotely in United States
Senior level
Remote
Hiring Remotely in United States
Senior level
Designs, develops, and maintains Databricks ETL pipelines, data lake architectures, datasets, and data integrations supporting reporting, analytics, and AI/ML workloads. Troubleshoots and optimizes Databricks and SSIS processes, maintains legacy systems, implements data quality controls, and supports data warehousing. Maintains SSRS reports and collaborates with business users, analysts, and IT teams to deliver reporting solutions. Documents work, communicates technical information, and contributes to AI-assisted development practices.
The summary above was generated by AI

This role is responsible for the design, development, and maintenance of data integration and reporting solutions. Working primarily in Databricks, you will build and maintain the pipelines and datasets that feed our reporting, analytics, and AI/ML workloads. The ideal candidate will possess expertise in Databricks and strong skills in SQL Server, SSIS and SSRS, and experience with other modern data engineering tools such as Azure Data Factory. This position requires a proactive and results-oriented individual with a passion for data and a strong understanding of data warehousing principles. A strong grasp of AI-assisted development tools as a regular part of the engineering workflow is expected.

 

Responsibilities

Data Integration

  • Design, develop, and maintain robust and efficient ETL pipelines and processes on Databricks.

  • Troubleshoot and resolve Databricks pipeline errors and performance issues.

  • Troubleshoot and resolve SSIS package errors and performance issues.

  • Optimize data flow performance and minimize data latency.

  • Implement data quality checks and validations within ETL processes.

  • Maintain legacy SSIS packages for ETL processes.

 

Databricks Development

  • Develop and maintain Databricks pipelines and datasets using Python, Spark and SQL.

  • Drive the design and implementation of batch and streaming data lake architectures supporting both analytics and AI/ML workloads.

  • Optimize Databricks jobs for performance and cost-effectiveness.

  • Integrate Databricks with other data sources and systems.

  • Migrate legacy systems (e.g. SSIS packages, SQL Server procs) to Databricks pipelines.

 

Data Warehousing

  • Participate in the design and implementation of data warehousing.

  • Support data quality initiatives and implement data cleansing procedures.

 

Reporting and Analytics

  • Collaborate with business users to understand data requirements for department driven reporting needs.

  • Maintain existing library of complex SSRS reports, dashboards, and visualizations.

  • Troubleshoot and resolve SSRS report issues, including performance bottlenecks and data inconsistencies.

 

Collaboration and Communication

  • Comfortable in entrepreneurial, self-starting, and fast-paced environment, working both independently and with our highly skilled teams.

  • Collaborate effectively with business users, data analysts, and other IT teams.

  • Communicate technical information clearly and concisely, both verbally and in writing.

  • Document all development work and procedures thoroughly.

 

Continuous Growth

  • Keep abreast of the latest advancements in data integration, reporting, data engineering.

  • Actively contribute to company’s AI-assisted tooling, strategies, and best practices.

  • Continuously improve skills and knowledge through training and self-learning.

 

Requirements

  • Bachelor's Degree in Computer Science, Information Systems, or a related field.

  • 7+ years of experience in data integration and reporting.

  • Extensive experience with Databricks, including Python, Spark, and Delta Lake

  • Experience with data warehousing concepts and best practices.

  • Strong proficiency with AI-assisted development tools.

  • Strong proficiency in SQL Server, including T-SQL, stored procedures, and functions.

  • Experience with SSIS (SQL Server Integration Services) development and maintenance.

  • Experience with SSRS (SQL Server Reporting Services) report design and development.

  • Experience with Microsoft Azure cloud platform and Microsoft Fabric desirable.

  • Strong analytical and problem-solving skills.

  • Excellent communication and interpersonal skills.

  • Ability to work independently and as part of a team.

  • Experience with Agile methodologies.

About Us

As a holding company with cooperative and private ownership, URUS is a family of businesses at the heart of the dairy and beef industry – Alta Genetics, GENEX, Genetics Australia, Leachman Cattle, Jetstream, PEAK, SCCL, Trans Ova Genetics and VAS.  Each organization has its unique identity, products, and services. These companies work globally to provide cutting-edge dairy and beef genetics, customized reproductive services to maximize conceptions, dairy management information to take producers to the frontline of progressive dairy farming, and an array of products and services to help bovines reach their full genetic potential. URUS has 9 brands in 17 retail countries and employs nearly 2,800 people globally.


Similar Jobs

13 Hours Ago
In-Office or Remote
CA, USA
168K-297K Annually
Senior level
168K-297K Annually
Senior level
Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
Lead product data engineering across architecture, data modeling, pipelines, monitoring, lineage, and data quality. Build reliable analytical datasets, support experimentation and machine learning use cases, and resolve business-critical pipeline issues. Partner with product and engineering stakeholders to translate business needs into automated data solutions. The role requires ownership of end-to-end data engineering projects, on-call participation, and development of AI-assisted monitoring and automation.
Top Skills: AirflowDatabricksDbtGitOmniPrefectPythonSnowflakeSQLTerraform
Yesterday
Remote or Hybrid
CA, USA
168K-297K Annually
Senior level
168K-297K Annually
Senior level
Blockchain • Fintech • Mobile • Payments • Software • Financial Services
Lead product data engineering initiatives by designing data models, owning critical pipelines, building data quality and lineage monitoring, and supporting experimentation and ML-ready datasets. Translate business needs into automated data solutions, maintain pipeline SLAs through on-call support, and develop AI-assisted tools for issue detection and resolution. Collaborate with Product, Engineering, Data Science, Machine Learning, and Applied AI teams across Block’s products.
Top Skills: AirflowDatabricksDbtGitOmniPrefectPythonSnowflakeSQLTerraform
Yesterday
In-Office or Remote
US
136K-220K Annually
Senior level
136K-220K Annually
Senior level
Consumer Web • eCommerce • Machine Learning • Software • Sports • Analytics
Build and own scalable data platforms and ingestion pipelines using BigQuery, dbt, and modern ingestion tools. Design batch and CDC workflows, improve reliability and observability, implement governance and access controls, and support analytics and AI agents. Develop Python services and internal tooling, contribute to architecture and lakehouse experiments, collaborate with stakeholders, and mentor engineers. The role requires strong SQL, Python, cloud infrastructure, testing, CI/CD, and AI-assisted development experience.
Top Skills: Ai Coding AgentsAmazon Web ServicesAPIsCdcCi/CdClaude CodeDbtEstuaryGitGoogle BigqueryGoogle Cloud PlatformHevoLakehouseMcpOpen Table FormatsPythonSQL

What you need to know about the Chicago Tech Scene

With vibrant neighborhoods, great food and more affordable housing than either coast, Chicago might be the most liveable major tech hub. It is the birthplace of modern commodities and futures trading, a national hub for logistics and commerce, and home to the American Medical Association and the American Bar Association. This diverse blend of industry influences has helped Chicago emerge as a major player in verticals like fintech, biotechnology, legal tech, e-commerce and logistics technology. It’s also a major hiring center for tech companies on both coasts.

Key Facts About Chicago Tech

  • Number of Tech Workers: 245,800; 5.2% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: McDonald’s, John Deere, Boeing, Morningstar
  • Key Industries: Artificial intelligence, biotechnology, fintech, software, logistics technology
  • Funding Landscape: $2.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Pritzker Group Venture Capital, Arch Venture Partners, MATH Venture Partners, Jump Capital, Hyde Park Venture Partners
  • Research Centers and Universities: Northwestern University, University of Chicago, University of Illinois Urbana-Champaign, Illinois Institute of Technology, Argonne National Laboratory, Fermi National Accelerator Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account