The role involves designing and optimizing data pipelines in Snowflake, developing ETL workflows, collaborating on data integration, ensuring data security, and performance monitoring.
This is a remote position.
-
Snowflake Data Engineer & Developer
Position: Snowflake Data Engineer & Developer
Location: VA, MD, DC - Hybrid or Remote
Type: Full-time
Experience Level: Mid-Senior Level
Department: Data Engineering / Development
About the Role:
As a Snowflake Data Engineer & Developer working on the DoD’s Analytics Platform, you will design, develop, and optimize data pipelines, ensuring seamless data ingestion, transformation, and processing in Snowflake. You will collaborate with teams to integrate data from various sources, maintain data integrity, and ensure the platform supports DoD's mission-critical analytics.
Key Responsibilities:
- Data Pipeline Development: Build and manage efficient data pipelines for ingesting, transforming, and loading data into Snowflake.
- ETL/ELT Workflows: Develop and automate ETL/ELT processes using Snowflake, Snowpipe, and Streams & Tasks.
- Database Optimization: Design Snowflake database structures and optimize queries, ensuring high performance and scalability.
- Integration: Collaborate with other teams to integrate data from various sources (cloud, databases, APIs) into Snowflake.
- Data Security: Implement data encryption, role-based access controls (RBAC), and compliance with DoD IL5/IL6 standards.
- Data Transformation: Apply transformation logic and create reusable components for scalable data processing across the platform.
- Performance Monitoring: Monitor and tune performance, proactively identifying bottlenecks and optimization opportunities.
Required Qualifications:
- Experience:
- 3+ years of experience in data engineering, with at least 1 year of experience working with Snowflake.
- Proven experience in designing and implementing ETL/ELT workflows.
- Technical Skills:
- Proficient in SQL and Snowflake-specific capabilities (e.g., Time Travel, Snowpipe, Streams).
- Experience with cloud platforms (AWS, Azure), particularly data-related services.
- Knowledge of Python or Java for scripting and data automation.
- Security Clearance: Active U.S. DoD Secret Clearance (Top Secret/SCI preferred).
- Data Management: Experience in handling large-scale datasets, performing data integration, and ensuring data quality in a DoD or similar secure environment.
Preferred Qualifications:
- Certifications:
- Snowflake SnowPro Certification or equivalent.
- Cloud certifications (AWS or Azure) focusing on data.
- Data Tools: Experience with big data tools (e.g., Spark, Kafka, Hadoop).
- Automation: Familiarity with automation tools like Airflow and CI/CD pipelines for data workflows.
Why Join Us?:
- Directly support national defense and warfighter missions.
- Work on cutting-edge technology in the high-stakes environment of combat command analytics.
- Competitive compensation and benefits, along with growth opportunities in the DoD sector.
Similar Jobs
eCommerce • Retail • Software • Analytics • Consulting
The role involves managing Snowflake operations, ensuring database performance, security, and cost-efficiency while collaborating with other teams to implement best practices and support governance.
Top Skills:
AirflowBigQueryGCPSnowflakeSQLTerraform
Artificial Intelligence • Information Technology • Consulting • Big Data Analytics
The Snowflake Data Engineer and Product Owner will manage the Snowflake data analytics project, collaborating with stakeholders, leading Agile practices, and ensuring quality deliverables through effective team coordination and backlog management.
Top Skills:
AgileEltETLScrumSnowflake
Artificial Intelligence • Information Technology • Consulting • Big Data Analytics
The Senior Snowflake Data Engineer will lead the creation of a data vault and warehouse on Snowflake, develop automated data pipelines, and work closely with architects to deliver insights for business operations.
Top Skills:
Data Vault 2.0Kimball MethodologyPythonSap BodsSap Landscape Transformation Replication ServerSnowflakeSQL
What you need to know about the Chicago Tech Scene
With vibrant neighborhoods, great food and more affordable housing than either coast, Chicago might be the most liveable major tech hub. It is the birthplace of modern commodities and futures trading, a national hub for logistics and commerce, and home to the American Medical Association and the American Bar Association. This diverse blend of industry influences has helped Chicago emerge as a major player in verticals like fintech, biotechnology, legal tech, e-commerce and logistics technology. It’s also a major hiring center for tech companies on both coasts.
Key Facts About Chicago Tech
- Number of Tech Workers: 245,800; 5.2% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: McDonald’s, John Deere, Boeing, Morningstar
- Key Industries: Artificial intelligence, biotechnology, fintech, software, logistics technology
- Funding Landscape: $2.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Pritzker Group Venture Capital, Arch Venture Partners, MATH Venture Partners, Jump Capital, Hyde Park Venture Partners
- Research Centers and Universities: Northwestern University, University of Chicago, University of Illinois Urbana-Champaign, Illinois Institute of Technology, Argonne National Laboratory, Fermi National Accelerator Laboratory
