Write Web spiders/robots/crawlers to collect information

I have a list of websites that i need to crawl and collect some information. Websites allows searching by entering the First Name and Last Name and returns results grid in results page. These results need to be captured into [login to view URL] Excel file. Then the search results have one hyper LINK FIELD that opens more detailed results grid. These results also need to be captured in to another [login to view URL] Excel file. I already have website details that you need to crawl It has two pages... Page 1) Search Page - that takes First name and Last name (I have Fname and LNames) already - This page... gives results.... - You need to collect results into "[login to view URL]" excel file Page 2) Search Results Page - This page opens multiple people's results - Also have a link for each person's result line - You need to open the link of each person that opens a detailed view for each person - Now Collect the details form the Detailed View and save it into another "[login to view URL]" 3) Each detailed view may also have some pdf file attachments..... -- Down load pdf files if we have... and -- put person profileID, CaseNumbers, DocumentType file name into another file called "[login to view URL]" excelfile 4) Each DocumentType associated with Case Number will have a Hyper link which opens a PDF file. -- Need to read the Section that contains words like "VIOLATIONS", "ALLEGATIONS" etc.., -- Need to copy text for this entire section and put it into another excel file. -- Create another excel file "[login to view URL]" with details extracted (ProfileID, CASEID, pdf text extracted, pdf file name) into another file. 5) Each DocumentType associated with Case Number will have a Hyper link which opens a PDF file. -- Download all documents and save them. Make sure the document file name match with what is stored in step 4.