Designs, develops, and maintains large-scale data processing systems, including ETL processes, data models, scalable pipelines, databases, data warehouses, and cloud-based big data solutions. Uses Snowflake, Fivetran, dbt, and Airflow while applying DevOps and security practices. Optimizes distributed processing and storage systems, collaborates with data scientists and analysts, and mentors junior engineers.
This is a remote role that begins with an in-person onboarding experience at our corporate office in Providence, RI to establish strong connections and set the foundation for success. During this time, new team members will learn our systems and processes while building relationships with colleagues. We also expect team members to be onsite a few times per year for team building and key project kickoffs. Travel expenses are fully covered by AAA Northeast.
At AAA Northeast, how we work together matters. We are a highly collaborative organization that values connection, transparency, and trust. Our “cameras on” approach during virtual meetings reflects our expectation that team members are present, engaged, and actively participating, helping to build strong working relationships and a sense of shared accountability, no matter where we’re located.
Big Data Engineer III is responsible for designing, developing, and maintaining large-scale data processing systems. This role includes building and optimizing data pipelines and ETL processes, designing and maintaining data models and architectures, and conducting performance tuning and optimization of data processing systems. Collaboration with data scientists and analysts is essential to deliver actionable insights.
What you will do:
- Data Engineering: Architect and optimize ETL processes for complex data requirements. Design advanced data models to support sophisticated data processing needs. Design and manage robust, scalable data pipelines.
- Database Management: Oversee the management and optimization of databases. Utilize advanced SQL techniques for complex data operations. Oversee the implementation and management of NoSQL databases. Architect and manage data warehousing solutions.
- Big Data and Cloud Technologies: Lead the implementation and optimization of big data technologies. Manage and optimize distributed computing resources for large-scale data processing. Build, maintain, and manage data pipelines using cloud technologies, Snowflake, Fivetran, DBT, Airflow. Utilize cloud platforms for scalable data processing and storage.
- DevOps and Security: Apply DevOps practices to automate and streamline data engineering workflows. Implement containerization solutions for data processing jobs. Implement data security measures to protect sensitive information. Optimize the performance of data processing and storage systems.
- Leadership: Mentor and guide junior engineers, fostering a collaborative and innovative work environment.
Education
- Bachelor's Degree Computer science, Information Technology, Engineering, or a related field. required or
- 6-8 years of additional relevant experience required
- Master's Degree Computer science, Information Technology, Engineering, or a related field or 5+ YOE of direct experience. preferred
Experience
- 5+ years Experience in data engineering or a related field required
Licenses and Certifications
- While not required, there are a variety of certifications that prove skillset (Big data certs, Azure cloud certs, Snowflake certs)
AAA Northeast is proud of our diverse culture, fostered by the many talents, skills, passions, and expertise of our employees. We are an equal opportunity employer. We do not discriminate in recruiting, hiring, or promotion based on race, color, creed or religion, national origin, sex, age, sexual orientation, veteran’s status, gender identity or expression, disability, genetic information, marital status, pregnancy, or membership in any other protected class. We thrive when our team members bring their whole selves to work.
Similar Jobs
Cloud • Security • Software • Cybersecurity • Automation
Provides advanced technical support for GitLab deployments serving U.S. government customers in secure, air-gapped, and regulated environments. Investigates Linux, application, infrastructure, and code issues; analyzes logs and performance; develops troubleshooting tools and documentation; partners with Engineering and Product; participates in on-call rotations, customer support, hiring, and process improvement.
Top Skills:
Ai/Llm GatewaysBashCi/CdDisa StigGitGitlab DuoKubernetesLinuxOpenshiftRubyRuby On RailsSelinux
Information Technology • Cybersecurity
Provides technical product expertise and presentations to prospective customers, helping improve their security posture and positioning Huntress solutions. Partners with Sales, Marketing, Support, and Engineering to identify customer needs and product improvements. Reviews security issues with technical teams, supports MSP and VAR customers, and travels approximately 25% to meet customers.
Top Skills:
AWSAzureCybersecurity FrameworksElasticGCPMalware AnalysisPsasRmmsSandbox AnalysisSIEMSplunkThreat Intelligence
Fintech • Legal Tech • Software • Financial Services • Cybersecurity • Data Privacy
Leads a Citizen IT team supporting Salesforce and PEGA applications through configuration, administration, troubleshooting, reporting, workflow management, training, and change management. Oversees Salesforce business analysts, partners with development and service leadership, improves data quality and processes, monitors performance, establishes KPIs, manages stakeholders, and drives platform adoption, productivity, and client satisfaction.
Top Skills:
Microsoft Power AutomateMicrosoft Power BiPegaPythonSalesforceSalesforce Service Cloud
What you need to know about the Chicago Tech Scene
With vibrant neighborhoods, great food and more affordable housing than either coast, Chicago might be the most liveable major tech hub. It is the birthplace of modern commodities and futures trading, a national hub for logistics and commerce, and home to the American Medical Association and the American Bar Association. This diverse blend of industry influences has helped Chicago emerge as a major player in verticals like fintech, biotechnology, legal tech, e-commerce and logistics technology. It’s also a major hiring center for tech companies on both coasts.
Key Facts About Chicago Tech
- Number of Tech Workers: 245,800; 5.2% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: McDonald’s, John Deere, Boeing, Morningstar
- Key Industries: Artificial intelligence, biotechnology, fintech, software, logistics technology
- Funding Landscape: $2.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Pritzker Group Venture Capital, Arch Venture Partners, MATH Venture Partners, Jump Capital, Hyde Park Venture Partners
- Research Centers and Universities: Northwestern University, University of Chicago, University of Illinois Urbana-Champaign, Illinois Institute of Technology, Argonne National Laboratory, Fermi National Accelerator Laboratory
