There are both open source and commercial forum CMS Systems available for your website. I've played with and used several such as phpBB, SMF, vBulletin, Invision Board and yabb.
Depending on your style preferences and size of website could determine which is more appropriate for you. Here are some links to the popular forums.
Web Design 
Show/Hide comment form