Senior Python Developer (Scrapy)
UnitLabs -
Mohandessin, GizaPosted 4 years ago21Applicants for2 open positions
- 21Viewed
- 3In Consideration
- 2Not Selected
Job Details
Experience Needed:
Career Level:
Education Level:
Salary:
Job Categories:
Skills And Tools:
Job Description
Main Job Duties:
- Scrape, retrieve and clean data from a variety of unstructured sources (web, text)
- Help build data processing pipelines.
- Develop and improve our APIs and document them properly
- Own the creation process of these tools, services, and workflows.
- Improve crawl/ scrape analysis, reports and data management.
- Test the data and the scrape to insure accuracy and quality.
- Identify and rectify any issues with breaks as well as scale scrapes as needed.
Job Requirements
- Bachelor's Degree in Computer Science or a related field or the equivalent demonstrated experience.
- Strong Experience with techniques and tools for crawling, extracting and processing data (e.g. Scrapy, pandas, mapreduce, SQL, BeautifulSoup, etc).
- Experience running large scale web scrapes is a plus.
- Solid Python knowledge.
- Familiarity with Linux/UNIX, HTTP, HTML, Javascript and Networking.
- Experience with system monitoring/administration tools.
- Experience with version control, open source practices, and code review.
- Experience with applications designed to display archived web content.
Featured Jobs
Similar Jobs
- Senior ODDO/Python DeveloperThe Address Investments for Real Estate Consultancy - New Cairo, Cairo18 days ago