Crawler for Website Markup Validation

Prototype required as proof of concept. Crawler to validate the presence of markup fragments. Main deliverables: 1 - CLI script (cronjob) to recursively scan website for markup, updates results to db. 2 - SQL script to create database and tables for 1. Secondary deliverables: Simple 3 page website to demonstrate the functionality of the main deliverables and allows for acceptance testing. 1 - Website listing 2 - Website detail (name, toplevel URL, markup to find) 3 - display scan results from db Cosmetics unimportant. Functionality is main focus. Site will be reengineered and made pretty in a separate project. Refer to the attachment [login to view URL] for details of the requirement. I look forward to hearing from you! ## Deliverables 1) Complete and fully-functional working program(s) in executable form as well as complete source code of all work done. 2) Deliverables must be in ready-to-run condition, as follows (depending on the nature of the deliverables): a) For web sites or other server-side deliverables intended to only ever exist in one place in the Buyer's environment--Deliverables must be installed by the Seller in ready-to-run condition in the Buyer's environment. b) For all others including desktop software or software the buyer intends to distribute: A software installation package that will install the software in ready-to-run condition on the platform(s) specified in this bid request. 3) All deliverables will be considered "work made for hire" under U.S. Copyright law. ## Platform LAMP project using PHP5, MySQL5, Linux No problems with using OSS. Expect the use of LIBcurl.