Data Pipeline Engineer
2 months ago
Stay current with the latest development best practices and apply your findings with the team.
Handle data/API's from client-side and server-side communication to back-end collection, manipulation, and analyzation.
Work with diverse array of existing products as well as engineer future data products.
Collaborate with front-end engineering teams to implement new features into the platform.
Have ownership of the data pipeline stack and availability to support in the event of systems failure.
Write clean, modular code that is scalable and secure.
Ensure optimal database architecture design, table schema design, and query design.
Meet certain performance goals including but not limited to data discrepancies, data availability, data granularity, data latency, data security, pipeline errors, and issue response times.
Work with a technology stack that includes AWS services, Python, Bash, SQL, GitHub, and more!