Milliseconds contents indexing due to Robots.txt setup might sound absurd, but what do you know? Indexing and Ranking factors has plenty of myths, but this I assure you is no myth, and I’m unveiling my personal mystery today.
Better Robots.txt (Free or Premium)
With northing to do programmatically, Better Robots.txt helps in building the most outstanding Robots.txt file for WP Blogs.
From your WP Dashboard, head to the plugin page, install and activate Better Robots.txt, goto its setup page and activate all modules there, and rock!