Reduce XHR calls of robots.txt to 1

HTTP requests will slow down app loading when 70-100 users simultaneously navigate to the site.