I need the following
1. Scrape 40 URLS - Each has 50K links
2. Generate XML sitemap
3. Each Sitemaps must have no more than 8K links
4. It will automatically scrape at midnight UK time each day
5. In the root folder I have a folder called sitemaps, it will delete all the xml files and add the new ones that have been scrapped
6. There will be one master called [login to view URL] inside this will be links to
[login to view URL]
[login to view URL]
[login to view URL]
[login to view URL]
etc....
[login to view URL] will be the one thats added to google webmaster
New URLs will be added and some may even be dropped so the structure must look like this:
var urlList={
"urls":[
"[login to view URL]",
"[login to view URL]",
"[login to view URL]"
]
};
urlList["urls"][0]+"/[login to view URL]"; // 0 > 7999
urlList["urls"][0]+"/[login to view URL]"; // 8000 > 17999
urlList["urls"][0]+"/[login to view URL]"; // .......
urlList["urls"][0]+"/[login to view URL]"; // .......
urlList["urls"][0]+"/[login to view URL]"; // .......
urlList["urls"][1]+"/[login to view URL]"; // 0 > 7999
urlList["urls"][1]+"/[login to view URL]"; // 8000 > 17999
urlList["urls"][1]+"/[login to view URL]"; // .......
urlList["urls"][1]+"/[login to view URL]"; // .......
urlList["urls"][1]+"/[login to view URL]"; // .......
Hi there I'm happy to work with you again! We can create a script on the root that would web scrape your current area page and generate the sitemap xml.
£33 GBP en 1 día
5,0 (2 comentarios)
1,3
1,3
2 freelancers están ofertando un promedio de £72 GBP por este trabajo