Social Media Scraping Software

Estado: Closed
Premio: $250
Propuestas recibidas: 2
Ganador: ThisIsSimple

Winner

Resumen del concurso

This is a RESEARCH content and the winner will be given extra milestones to code an application.

The most likely research location is Github. There might be others.

To win the contest:-
-Find an existing software library that can crawl Facebook. It should work iteratively through friend lists and recursively browse.
-It should return as a minimum, the name, date-of-last post, profile URL, information from 'About', and friendlist of each person. And have some many-many relationship table to match people.
-It can store it in any format.
-It should have some re-entry logic so that subsequent runds do not create overlap in data.

Remember - thiis contest is just to research what is currently available.

This MUST use Selenium or equivalent browser-automation. It cannot run using Facebook API.

In the event that multple answers are submitted:-
Preference will be given to the person whom has found a library that is either easier to use, or has advanced features.

Examples of advanced
-Crawling groups
-Distributed runs (from many web cllients)
-Performance reporting

Best of luck. Please no time-wasters.

If you can't find a software library, you can also put forward ready to use commercial software.

Habilidades recomendadas

Winner

Publica un concurso similar

Principales propuestas de este concurso

ThisIsSimple India

0
omaralieissa Egypt

0

Tablero de aclaración pública

visweswaran1998
- 5 años atrás
#extended please
- 5 años atrás
visweswaran1998
- 5 años atrás
Only one day, I am In
- 5 años atrás
joseaviles0
- 5 años atrás
I've seen your project, I think that I'm ideal for this, but I'm not pretty sure if I could develop it with 2 days only.
- 5 años atrás
MODD-Serbia
- 5 años atrás
P.S. I would use Scrapy, it's powerful scraping/crawling framework for python. It can scrap multiple pages at once. Also can be use with selenium if necessary, but it can also be used with light weight browser Splash. This makes Scrapy far superior scraping tool than selenium alone, or beautiful soup.
- 5 años atrás
MODD-Serbia
- 5 años atrás
I want to submit an entry but i dont have submit button. I have already facebook page and posts crawler , if you want to discuss it, contact me.

sincerely Mladen
- 5 años atrás
HamishWHC
- 5 años atrás
Most I've found dont do anything really what you're looking for, especially to checking to see whether or not that person has been found previously. Is it okay if I just write it for you (same price)?
- 5 años atrás
1. Organizador del concurso
  - 5 años atrás
  I can pay more if you want to write it from scratch. But it must be roboust and work well with extreme conditions. Please submit an entry so that we can communicate.
  - 5 años atrás
2. HamishWHC
  - 5 años atrás
  I've just found out that this site wants my CREDIT CARD DETAILS in order TO PAY ME. Sorry but not going to help on a site like this.
  - 5 años atrás