User-agent: twiceler Disallow: / User-agent: MLBot Disallow: / User-agent: socbot Disallow: / User-agent: Yandex Disallow: / User-agent: * Disallow: /vscp/ User-agent: Gigabot/3.0 Disallow: /