Thanks Till. I actually think I was having a problem with Heartbeat and HAProxy. When I restarted both of them, I was able to access through the public IP.
I don't like people being to see the /var/www/apache2-default directory files, so I added a blank index.html to it. I don't think that will hurt anything.