# All web crawlers allowed # User-agent: gooblebot # User-agent: webcrawler User-agent: * Disallow: /for_john.html Allow: /