Design and implement scalable cloud data platforms and end-to-end ETL/ELT pipelines, migrate legacy infrastructure to Snowflake/AWS, optimize data warehouses, build transformations with dbt and Dagster orchestration, develop data processing with Python and SQL, implement IaC and CI/CD, and ensure data observability and governance while collaborating with stakeholders.
About Nerdery and Being a “Nerd.”
Nerdery is a digital product consultancy. Much more than consultants, we’re allies and guides on our clients’ digital journey – helping them to grow their business and delight their customers through intuitive, thoughtfully designed technology. As true partners, we prepare our clients for the opportunities in front of them, help them achieve their goals, and quickly deliver value for their customers. We do this by solving problems in creative ways across strategy, design, and technology.
At Nerdery, we’re not defined by our job titles but by the impact we make. You’ll work directly and closely with some of the world’s best brands to help create innovative digital products that serve everyone. As Nerds, our insight, innovation, and expertise are celebrated, and our growth is not only encouraged but expected. Being a Nerd means stepping up and pushing the boundaries of what’s possible.
We are looking for a Senior Data Engineer to join our team! We invite you to check out the details below and consider whether becoming a Nerd is the next step in your career journey.
The Senior Data Engineer role at Nerdery is responsible for designing and implementing the data architecture, storage solutions, and analytics platforms necessary to drive business insights. This role focuses on building scalable, well-governed data platforms on AWS and migrating legacy infrastructure to modern cloud environments.
Requirements:
- Bachelor's degree in Computer Science, Data Engineering, or a related field (or equivalent practical experience).
- 6+ years of professional experience in data engineering or a closely related discipline.
- In-depth knowledge of Snowflake, including warehouse design, role-based access control, performance tuning, and cost optimization.
- Advanced proficiency with dbt for modular, tested, and version-controlled data transformations.
- Hands-on experience with Dagster for pipeline orchestration, asset management, and data observability.
- Proven experience designing and implementing data pipelines, data storage solutions, and analytics platforms on modern cloud data stacks.
- Experience migrating data pipelines and infrastructure to Snowflake from other platforms (legacy warehouses, on-premise systems, or hybrid environments).
- Advanced proficiency in Python with hands-on experience in data-processing libraries such as Pandas, Polars, PySpark, or similar.
- Strong SQL skills across both analytical and transactional workloads.
- Experience with relational and/or columnar databases such as PostgreSQL, SQL Server, or Snowflake.
- Deep understanding of data modeling, ETL/ELT processes, and data warehousing principles.
- Experience implementing data architecture patterns (e.g., medallion/multi-hop, data mesh, lakehouse) to support scalable, well-governed data platforms.
- Familiarity with Infrastructure-as-Code tools such as Pulumi or Terraform.
- Familiarity with event-driven architectures and integrating orchestration platforms with cloud services.
- Strong version-control practices (Git) with experience building CI/CD workflows for data workloads (e.g., GitHub Actions).
- Proven ability to translate business and technical requirements into production-grade, maintainable data pipelines.
- Excellent problem-solving and analytical skills.
- Ability to communicate clearly with both technical and non-technical stakeholders.
- Proactive collaborator who mentors colleagues and raises the technical bar across the team.
- Experience building and consuming RESTful APIs. Exposure to containerisation (Docker) is a plus.
- Familiarity with data quality and observability tooling (e.g., dbt tests, Great Expectations, Monte Carlo) is desirable.
What You'll Do:
- Design and implement end-to-end data pipelines and ETL/ELT processes
- Architect scalable data platforms using patterns such as medallion/multi-hop, data mesh, or lakehouse
- Migrate data infrastructure from on-premise or hybrid environments to AWS
- Manage and optimize AWS data services including Redshift, Glue, EMR, and Kinesis
- Develop data-processing logic using Python (Pandas, PySpark, Polars) and advanced SQL
- Automate data workflows using orchestration tools like Airflow/MWAA and Step Functions
- Implement Infrastructure-as-Code (Terraform/CloudFormation) and CI/CD for data workloads
Pay Range:
- 130,000-170,000 per year
The pay range provided reflects the target compensation for this position, and individual pay within this range is determined by a variety of factors including, but not limited to, the candidate's relevant experience, specific skills, education, certifications, internal equity with comparable roles at our company, market conditions, and the geographic location of the role. We are committed to fair and equitable compensation practices, and we regularly review our pay structures to ensure competitiveness and alignment with industry standards.
Our Benefits & Perks:
We believe in supporting our Nerds with a truly comprehensive and competitive benefits package designed for flexibility and financial security.
- Health & Wellness: Choose from two comprehensive medical plans (including an HSA-eligible option), plus high-quality dental and vision insurance.
- Financial Security (Company-Paid): We provide peace of mind by fully covering the cost of several essential plans: Basic Life and AD&D Insurance, Short-Term Disability (STD), and Long-Term Disability (LTD) coverage.
- Comprehensive Support: Take advantage of discounted, employee-paid options to protect your family, pets, and assets, including Voluntary Life and AD&D, Accident, Critical Illness, and Hospital Indemnity insurance, Pet Insurance, and plans offering Legal Support and Identity Theft Protection.
- Retirement: We offer a 401(k) plan with a company match of up to 3.5% with immediate vesting.
- Time Off: Nerds enjoy flexible time off with Flex PTO that can be used for vacation, personal time, personal illness, or time off to care for dependents.
- Remote Work: Nerdery is a remote-friendly workplace. Our Minnesota office space is available for Nerds who prefer an in-office environment or collaborative setting.
- Professional Growth: All Nerds have dedicated resources and access to funds to pursue professional development, attend industry conferences, and obtain certifications.
What Skills Will Help You Be A Successful Nerd?
- Customer-Focused Execution and Communication: Excels at translating deep customer understanding into impactful work, ensuring that every project and decision delivers exceptional user value. Able to effectively explain technical decisions to non-technical stakeholders.
- Tenacious Problem-Solving: Relentlessly unravels complex problems, developing innovative solutions to overcome any challenge that stands in the way of progress.
- Integrity-Driven Work: Builds trust by consistently upholding high standards in all work and advocating for the right approach, ensuring quality and transparency.
- Collaborative Impact: Actively elevates the team's capabilities by fostering a collaborative environment, sharing knowledge, and prioritizing collective success over individual credit.
- End-to-End Ownership: Takes full accountability for an initiative's entire lifecycle, from concept to completion, ensuring the final result successfully achieves its intended goals.
- Dedication to Craftsmanship: Driven by a passion for their craft to continuously learn, deepen their expertise, and strive for excellence in their chosen field.
Physical Demands and Work Environment
The physical demands described here are representative of those that must be met by an employee to successfully perform the essential functions of this position. Reasonable Accommodations may be made to enable individuals with disabilities to perform the functions
- Sitting for extended periods: will spend significant time in meetings, presentations, and computer use.
- Occasional standing and walking: will need to move around during presentations and client interactions.
- Computer Use: Extensive use of a keyboard, mouse, and computer screen for extended periods. Ability to adjust focus between screen and documents.
- Public Speaking: requires public speaking, including presenting to clients.
- Reaching: Reaching for items on a desk, retrieving documents, or working with equipment is required.
- Lifting: Occasional lifting of light objects (e.g., laptops, peripherals) may be necessary.
- Office Environment: The work environment is primarily an office setting, with typical office equipment and noise levels.
- On-site client work: some work might involve on-site client visits and demonstrations, possibly requiring some walking and standing for extended periods.
Are We the Right Fit For You?
The best way to get the scoop on whether Nerdery is the right place for you is to chat with current Nerds. We would be delighted to have a conversation with you and share insight into what it’s really like to work at our organization and if it’s a place where you can thrive. Our interview process will provide you ample opportunity to talk with other team members and assess whether the role is a good fit for your next chapter. Take the first step and apply today – our Talent Advocates will then reach out to you to get the ball rolling!
Disclaimer:
Must be legally authorized to work within the country of employment without sponsorship for employment visa status.
Nerdery is an equal opportunity employer and complies with all applicable federal, state and local fair employment practice laws. Nerdery strictly prohibits and does not tolerate discrimination against employees, applicants or any other covered persons because of race, color, religion, creed, national origin or ancestry, ethnicity, sex, sexual orientation, gender (including gender nonconformity and status as a transgender or transsexual individual), pregnancy, marital status, familial status, age, physical or mental disability, citizenship, past, current or prospective service in the uniformed services, genetic information, membership or activity in a local human rights commission, status with regard to public assistance or any other characteristic protected under applicable federal, state or local law. All employees, other workers and representatives of Nerdery are prohibited from engaging in unlawful discrimination. Nerdery will ensure that all employment practices are free of such discrimination. Such employment practices include, but are not limited to: hiring, promotion, demotion, transfer, recruitment or recruitment advertising, selection, layoff, disciplinary action, termination, compensation, benefits, selection for training, including apprenticeship and other terms and conditions of employment. Nerdery will also provide reasonable accommodation to applicants and employees with disabilities pursuant to all applicable laws.
Nerdery will never request a chat interview. All interviews are conducted either in person or through Google Meets. Additionally, Nerdery exclusively uses email addresses ending with @Nerdery.com
If you have questions about any correspondence you receive regarding an opportunity at Nerdery, please reach out to [email protected].
CompensationThe base pay range for this role is $130,000 – $170,000 per year.
Nerdery Chicago, Illinois, USA Office
1033 W. Van Buren St., Chicago, IL, United States, 60607
Similar Jobs
Security • Cybersecurity
Design and maintain data pipelines, models, and transformation layers for analytics. Build data contracts, observability and lineage tooling, collaborate with product engineering, and optimize data structures for performance and scalability.
Top Skills:
Cloud-Native ArchitecturesData ContractsData Observability FrameworksDimensional ModelingDockerGoIncremental Data ModelsJvm (Java/Scala/Kotlin)KubernetesLineage TrackingMessage QueuingNode.jsPythonStream Processing
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Design, build, and operate enterprise data pipelines and Lakehouse data products on Azure. Lead migrations, implement medallion architectures, optimize Spark and distributed SQL workloads, enforce CI/CD and observability, and support production incident response while partnering with architects, data scientists, and stakeholders.
Top Skills:
ArmAzure Ad / Entra IdAzure Data FactoryAzure Data Lake Storage Gen2Azure DatabricksAzure DevopsAzure Key VaultAzure MonitorAzure SqlAzure Synapse AnalyticsBashBicepDelta LakeKqlLog AnalyticsMicrosoft FabricPandasParquetPowershellPrivate EndpointsPysparkPytestPythonSpark SqlSsisSynapse Dedicated Sql PoolT-SqlTeradataTerraformUnity CatalogVnet
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Lead design and operation of large-scale data pipelines and data APIs. Build Spark/PySpark workflows on Databricks, optimize job performance, manage data quality and observability, and develop MCP servers and AI-agent integrations. Mentor engineers, define standards, support production incidents and on-call rotations, and collaborate with stakeholders to deliver scalable data platform products.
Top Skills:
Apache IcebergApi GatewayAWSAws LambdaAws Rds/AuroraAzureDatabricksDatadogDbtFastapiFivetranGCPGoogle BigqueryLlms/Ai AgentsMcp ServersMs Sql ServerMySQLOraclePostgresPysparkPythonS3SecretsmanagerSnowflakeSnsSparkSplunkSQLSqs
What you need to know about the Chicago Tech Scene
With vibrant neighborhoods, great food and more affordable housing than either coast, Chicago might be the most liveable major tech hub. It is the birthplace of modern commodities and futures trading, a national hub for logistics and commerce, and home to the American Medical Association and the American Bar Association. This diverse blend of industry influences has helped Chicago emerge as a major player in verticals like fintech, biotechnology, legal tech, e-commerce and logistics technology. It’s also a major hiring center for tech companies on both coasts.
Key Facts About Chicago Tech
- Number of Tech Workers: 245,800; 5.2% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: McDonald’s, John Deere, Boeing, Morningstar
- Key Industries: Artificial intelligence, biotechnology, fintech, software, logistics technology
- Funding Landscape: $2.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Pritzker Group Venture Capital, Arch Venture Partners, MATH Venture Partners, Jump Capital, Hyde Park Venture Partners
- Research Centers and Universities: Northwestern University, University of Chicago, University of Illinois Urbana-Champaign, Illinois Institute of Technology, Argonne National Laboratory, Fermi National Accelerator Laboratory
