Do the following
1. Do RDP to server check performance
2. Access site from internet and check performance
If #1 and #2 both yield same results then code has problem
Otherwise it can be following
1. Heavy images
2. Low bandwidth from server
3. Slow internet