Developing a crawler

**********************.. YOUR SEARCH ENDS HERE .. ********************** GET IT DONE RIGHT THE FIRST TIME! Hello Sir/Ma'am, I look forward to talking to you further and getting started. I've been working in simple and extensive Website Coding (PHP, MYSQL, .NET, C#, ASP, DRUPAL, JOOMLA, DOTNETNUKE, PERL JAVASCRIPT, CSS, HTML & A LOT MORE!), Website Designing and Graphic Design for ***over 10 years now. After working as a ***top sales and marketing representative for Sears, I began to independently pursue my career. I have experience in do-it-yourself CMS, Logos with flare and flash design to name a few. I went to college for business and marketing so ***I know what it takes to sell. Get it done professionally and get it done right! Thank you, Timothy

Greetings, I would like to make a Coldfusion baesd web crawler for you that will do exactly what you said in your description. If you have any questions, please message me! Thanks for your time and consideration. Sincerely, Travis Walters

Hi , I have read your requirements. I had previously worked as a project on this issue. Im sure,i will make you are satisfied. thank !

Hello, I can get you a Java code or an Excel file that will read all the domains specified in a file and get back the result in a report format of y our choice. Let me know if you are interested

Ainda não foi fornecida uma proposta

Will provide you quality work and do this in PHP .............................................................................................

Hello cowarrior361, I'm a PHP Developer. Please check my profile for previous work on scrapers, they are my speciality ! I wanted to ask you what does "Crawls every page" means for you ? Do you mean each of the 50 domains provided? Or every page on every domain ?

A proposal has not yet been provided

Hi cowarrior361, i already developed several crawler. e.g. a crawler which fetches events from several local websites to provide the data for a event search website. Your project sounds very simple and will be done quickly. To give you a meaningful description of the solution i will offer you, i need to know more details: -What kind shall the output look like (database entries, csv-list etc.)? -in which way will the 50 domains be given to the script? -Which types shall be taken care of (only HTML, CSS, JS or many more)? I'm looking forward to support your project.

A proposal has not yet been provided

The application you're looking for is one I've built already :) I have actually implemented several different applications, among which an app that can crawl websites very efficiently for trending terms to find interesting unregistered domain names. Another to identify news topics and create an automated news bulletin from youtube video's (played back to back) on the currently most important news.

I am working with html, php, css and javascript since long time. As i already know how crawler works and the complete implementation of crawler in php. I have already designed a crawler prototype for data extraction from other website using curl , php and simple html dom library. The crawler is able to fetch unique pages from crawled page, depth of page crawled can also be assigned into it. It uses mysql database to store the fetched url from webpages, it can identify the media urls, other domain urls, sub domain urls and store in specified table. It can also extract all important information within html tags such as meta data information of webpage, heading, title body text. I will use php, curl, mysql , simple html dom library and javascript to design webcrawler. if you finds me useful contact me thank you