Hi, I am 7 years experience Linux admin. I've worked with apache, mysql, php, mail, dns, ... in deploying, tuning and debuging field.
Your requirement can be done by keepalived, monitor software (zabbix), iptables, rsync,... I've created some system like this before. So I think I can complete yours