User-agent: *
Disallow: /search
Disallow: /files/assets/
Disallow: /au/assets/
Disallow: /*.page$
Disallow: /*.asp$