搜索引擎蜘蛛爬行记录—WordPress

搜索引擎蜘蛛匍匐记载—WordPress

[Gbuy id=’1686′]

网站录入有问题时，就会或许需求接连的搜索引擎蜘蛛的抓取环境。网站文章不录入时，第一时间便是要看看网站蜘蛛7 , 3 j q抓取的日志，但经过拜J R C 3 B * $ D访D P |服务器的方法查看蜘蛛日志有; E $ 7 ? 9 H p点费事，咱们可以用代S P 6码来完结给WordPress网站增加记载蜘蛛抓取日志的功用！X { ; $ } %

将下放代码放入主题的functions.php文件中：

function get_naps_bot()
{
    $useragent = strtolower($_SERVER['HTTP_USER_AGENT']);
    if (strpos($useragent, 'googlebot') !== false) {
        return 'Googlebot';
    }
    if (strpos($useragent, 'msnbot') !== false) {
        return 'MSNbot';
    }
    if (strpos($useragent, 'slurp') !== false) {
        return 'Yahoobot';
    }
    if (strpos($useragent, 'baiduspider') !== false) {
        return 'Baiduspider';
    }
    if (strpos($useragent, 'sohu-search') !== false) {
        return 'Sohubot';
    }
    if (strpos($useragent, 'lycos') !== false) {
        return 'Lycos';
    }
    if (strpos($useragent, 'robozilla') !== false) {
        return 'Robozilla';
    }
    return false;
}
function nowtime()
{
    date_default_timezone_set('Asia/Shanghai');
    $date = date("Y-m-d.G:i:s");
    return $date;
}
$searchbot = get_naps_bot();
if ($searchbot) {
    $tlc_thispage = addslashes($_SERVER['HTTP_USER_AGENT']);
    $url = $_SERVER['HTTP_REFERER'];
    $file = "robotslogs.txt";
    $time = nowtime();
    $data = fopen($file, "a");
    $PR = "$_SERVER[REQUEST_URI]";
    fwrite($data, "Time:$time robot:$searchbot URL:$tlc_thispage\n page:$PR\r\n");
    fclose($data);
}