Web Crawling and BOT Operations Team Lead

| Chicago
Sorry, this job was removed at 11:19 a.m. (CST) on Wednesday, November 21, 2018
Find out who's hiring in Chicago.
See all Developer + Engineer jobs in Chicago
Apply
By clicking Apply Now you agree to share your profile information with the hiring company.

We are looking for a Web Crawling and BOT Operations Team Lead to lead a worldwide team of junior developers focused on web extraction. These entry level developers create the logic for extracting information in our large-scale web crawling operation. Billions of pages are crawled every month to feed our Big Data platforms and we need someone to lead the team of extraction engineers. This position works closely with the R&D and Operations team.

Responsibilities

  • Work with all business units to understand current issues and new requirements.
  • Exercise independent judgment and discretion in project management by prioritizing, planning and tracking progress.
  • Design, develop and modify programs and processes for optimal productivity.
  • Research product development options and provides analysis.
  • Consult with internal departments to identify customer needs to include into project objectives.
  • Provides support regarding crawler development to internal business units.
  • Manage and direct 25+ entry level developers, both local and off-shore.
  • Evaluate employee performance, set expectations and goals for department and individual staff members, recruit, discipline and mentor staff. 
  • Create and maintain documentation for your team.
  • Minimum of 3 years of experience in leading a team
  • Experience with project management
  • Experience with the Agile development methodology
  • Experience with Jira or other issue tracking software
  • Experience with Python, C#, Java or another object-oriented language
  • Experience with databases, SQL or NoSQL
  • Experience with REST services and API design
  • Good understanding or the HTTP protocol
  • Experience with version control systems (Git, Subversion etc)
  • Degree required

Having experience in any the following would be a valuable asset:

  • Programming experience on Unix based infrastructure
  • Knowledge of cloud based systems (e.g. EC2, Rackspace, Google Cloud, etc)
  • Knowledge of client side programming languages (e.g. javascript) and frameworks (e.g. React, Ember)

We are an equal opportunity employer and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability status, protected veteran status, or any other characteristic protected by law.

Read Full Job Description
Apply Now
By clicking Apply Now you agree to share your profile information with the hiring company.

Location

Our office is centrally located in the Willis Tower! It is easily accessible to all forms of public transit & many great lunch options.

Similar Jobs

Apply Now
By clicking Apply Now you agree to share your profile information with the hiring company.
Learn more about NumeratorFind similar jobs