# robots.txt zu http://www.scout24.com/ User-agent: * Disallow: /portaldata/2/resources/ir/ # Block the /pdfs/directory.