I wish to record the weather forecast from TheWeatherNetwork and from the WeatherOffice to compare the accuracy of the weather models.
I wish to record the datea for several locations (each with a unique URL) each hour, indefinately, from either a Linux web server or from a desktop computer running XP Pro.
For example, Edmonton weather is reported at
[login to view URL]
[login to view URL]
Victoria weather is reported at
[login to view URL]
[login to view URL]
There will be about ten cities in total.
The program needs to visit a user-defined URL and extract the desired information into a tab delimited text file.
1. The date and time the data was collected (from the computer)
2. Desired information from [login to view URL]
- all the text data under 'Current Weather'
- all the text data under 'Short Term Forecast', including when it was updated
- all the text data under 'Long Term Forecast', including when it was updated
3. Desired information from WeatherOffice
- all the text data under 'Current Conditions'
- all the text data under 'Forecast'
- all the text data under 'Historical Data'
Some fields will change (for example, 'wind chill' won't be there in the summer), so the program should record everything with unique header, not look for keywords.
Please advise if you jave any questions!
Thanks