User-agent: * Crawl-delay: 20 Disallow: /mailman/private/ Disallow: /pipermail/