One of the things I hear people desiring from WordPress is some kind of system for customized installations. So when you go to install a fresh copy, all the settings are how you like them (among other things).
Thomas Scholz has a sweet solution here to get us nearly there. It's a plugin that you install, activate, and delete. All it does is reset your settings how you like them (you customize it), and delete the "dummy" post and comment.