Browse Jobs
For Employers
Post JobLog inGet Started

Senior Python Developer (Scrapy)

UnitLabs
Mohandessin, Giza
Posted 4 years ago
21Applicants for2 open positions
  • 21Viewed
  • 3In Consideration
  • 2Not Selected
Search other opportunities

Job Details

Experience Needed:
Career Level:
Education Level:
Salary:
Job Categories:

Skills And Tools:

Job Description

Main Job Duties:

  • Scrape, retrieve and clean data from a variety of unstructured sources (web, text)
  • Help build data processing pipelines.
  • Develop and improve our APIs and document them properly
  • Own the creation process of these tools, services, and workflows.
  • Improve crawl/ scrape analysis, reports and data management.
  • Test the data and the scrape to insure accuracy and quality.
  • Identify and rectify any issues with breaks as well as scale scrapes as needed.

Job Requirements

  • Bachelor's Degree in Computer Science or a related field or the equivalent demonstrated experience.
  • Strong Experience with techniques and tools for crawling, extracting and processing data (e.g. Scrapy, pandas, mapreduce, SQL, BeautifulSoup, etc).
  • Experience running large scale web scrapes is a plus.
  • Solid Python knowledge.
  • Familiarity with Linux/UNIX, HTTP, HTML, Javascript and Networking.
  • Experience with system monitoring/administration tools.
  • Experience with version control, open source practices, and code review.
  • Experience with applications designed to display archived web content.

Featured Jobs

Similar Jobs

Search other opportunities
JobsIT/Software DevelopmentSenior Python Developer (Scrapy)