Browse Jobs
For Employers
Post JobLog inGet Started

Python Developer (Web Scraping)

UnitLabs
Mohandessin, Giza
Posted 5 years ago
28Applicants for1 open position
  • 20Viewed
  • 1In Consideration
  • 6Not Selected
Search other opportunities

Job Details

Experience Needed:
Career Level:
Education Level:
Salary:
Job Categories:

Skills And Tools:

Job Description

Main Job Duties:

  • Scrape, retrieve and clean data from a variety of unstructured sources (web, text)
  • Help build data processing pipelines.
  • Develop and improve our APIs and document them properly
  • Own the creation process of these tools, services, and workflows.
  • Improve crawl/ scrape analysis, reports and data management.
  • Test the data and the scrape to insure accuracy and quality.
  • Identify and rectify any issues with breaks as well as scale scrapes as needed.

Job Requirements

  • Bachelor's Degree in Computer Science or a related field or the equivalent demonstrated experience.
  • Strong Experience with techniques and tools for crawling, extracting and processing data (e.g. Scrapy, pandas, mapreduce, SQL, BeautifulSoup, etc).
  • Experience running large scale web scrapes is a plus.
  • Solid Python knowledge.
  • Familiarity with Linux/UNIX, HTTP, HTML, Javascript and Networking.
  • Experience with system monitoring/administration tools.
  • Experience with version control, open source practices, and code review.
  • Experience with applications designed to display archived web content.

Featured Jobs

Similar Jobs

Search other opportunities
JobsIT/Software DevelopmentPython Developer (Web Scraping)