# robots.txt file for https://www.paygateway.com. Add a Disallow for each directory or file you don't want spidered. User-agent: * Disallow: /resellers_MIK/