It's normal, when you visit a page on the main site a cached version of the page is created. So when you make a comment and refresh, you're still getting the same page. After about 5-10 minutes the cached is expired and next time you visit the page your comment will show up.
We're looking into manually refreshing the cache whenever a comment is posted. That would fix the problem.