Spark Developer / Engineer
Sorry, this job was removed at 12:49 a.m. (CST) on Wednesday, March 1, 2017
By clicking Apply Now you agree to share your profile information with the hiring company.
We know you have many choices and we’re ready to compete for your commitment to us.
Aginity “Amp” is an analytic environment that consolidates analytic activity under a powerful analytic management platform. We are active supporters of data analytics in Hadoop and MPP environments.
We need a creative and dependable Spark Developer that can help us migrate our platform.
You must have solid software development and clear communication skillls. You must show compelling evidence that you have designed pragmatic solutions using Spark.
This job requires regular presence at our Evanston, Il headquarters but we have a flexible environment. Need to be home while the washing machine is fixed? No problem.
We are open to providing funding to help you relocate to the metro Chicago area.
Must Have Skills and Knowledge
- Hands on experience implementing at least one Apache Spark or Spark Streaming project, preferably using Java or Scala, and Spark SQL. We will consider candidates with Spark experience using R or Python.
- A solid understanding of the Spark API's, best practices, performance optimizations, deployment options and operations, as well as cluster tuning when working with large data sets.
- Prior engineering and/or software development experience.
- Firm understanding of data structures and algorithms.
- Able to debug code as well as perform code reviews to suggest areas for improvement.
- Expertise in Git
Nice to Have Skills and Knowledge
- The more experience you have in these, in any combination, the more interesting and valuable you’ll be to Aginity.
- Hadoop (MapReduce and YARN) and companion technologies such as Hive, Kafka, Atlas, Storm
- Mesos
- Cassandra
- Docker
- Experience working in notebook UIs like Jupyter, Zeppelin, or Hue but especially valuable is experience customizing or extending notebook UIs
Read Full Job Description