落伍者站长论坛's Archiver

happygod 发表于 2008-5-9 11:13

找找哪个是百度蜘蛛？

#Date: 2008-05-08 23:21:02
#Fields: LogFilename RecordNumber ComputerName SiteID DateTime ClientIpAddress ServerIpAddress ServerPort Method ProtocolVersion ProtocolStatus SubStatus TimeTaken BytesSent BytesReceived Win32Status UriStem UriQuery UserName
d:\iislog\W3SVC\ra080508.ibl 4500 FXKJ-UMBTKHGLNS 811 2008-05-08 00:03:17 221.1.120.137 58.218.209.130 80 GET HTTP/1.1 304 0 140 213 446 0 /template/css/style.css - -
d:\iislog\W3SVC\ra080508.ibl 4505 FXKJ-UMBTKHGLNS 811 2008-05-08 00:03:18 221.1.120.137 58.218.209.130 80 GET HTTP/1.1 304 0 171 212 442 0 /template/js/func.js - -
d:\iislog\W3SVC\ra080508.ibl 4509 FXKJ-UMBTKHGLNS 811 2008-05-08 00:03:18 221.1.120.137 58.218.209.130 80 GET HTTP/1.1 200 0 578 27252 560 0 /index.html - -
d:\iislog\W3SVC\ra080508.ibl 4511 FXKJ-UMBTKHGLNS 811 2008-05-08 00:03:18 221.1.120.137 58.218.209.130 80 GET HTTP/1.1 304 0 265 213 448 0 /template/images/logo.gif - -
d:\iislog\W3SVC\ra080508.ibl 4519 FXKJ-UMBTKHGLNS 811 2008-05-08 00:03:18 221.1.120.137 58.218.209.130 80 GET HTTP/1.1 304 0 156 211 445 0 /uploadfile/small/20080571f14199899.gif/90x78.jpg - -
d:\iislog\W3SVC\ra080508.ibl 4520 FXKJ-UMBTKHGLNS 811 2008-05-08 00:03:18 221.1.120.137 58.218.209.130 80 GET HTTP/1.1 304 0 203 212 476 0 /template/images/focus.swf - -
d:\iislog\W3SVC\ra080508.ibl 4521 FXKJ-UMBTKHGLNS 811 2008-05-08 00:03:18 119.42.230.121 58.218.209.130 80 GET HTTP/1.1 200 0 78 27252 183 0 /index.html - -
d:\iislog\W3SVC\ra080508.ibl 4523 FXKJ-UMBTKHGLNS 811 2008-05-08 00:03:18 221.1.120.137 58.218.209.130 80 GET HTTP/1.1 304 0 203 212 443 0 /uploadfile/small/200805740142639104/90x78.jpg - -
d:\iislog\W3SVC\ra080508.ibl 4524 FXKJ-UMBTKHGLNS 811 2008-05-08 00:03:18 221.1.120.137 58.218.209.130 80 GET HTTP/1.1 304 0 250 211 444 0 /template/images/li.gif - -
d:\iislog\W3SVC\ra080508.ibl 4527 FXKJ-UMBTKHGLNS 811 2008-05-08 00:03:18 221.1.120.137 58.218.209.130 80 GET HTTP/1.1 200 0 296 3302 356 0 /uploadfile/small/2008053cd215024409/90x78.jpg - -
d:\iislog\W3SVC\ra080508.ibl 4528 FXKJ-UMBTKHGLNS 811 2008-05-08 00:03:18 221.1.120.137 58.218.209.130 80 GET HTTP/1.1 200 0 296 3955 356 0 /uploadfile/small/200805682135240216/90x78.jpg - -
d:\iislog\W3SVC\ra080508.ibl 4529 FXKJ-UMBTKHGLNS 811 2008-05-08 00:03:18 221.1.120.137 58.218.209.130 80 GET HTTP/1.1 304 0 250 213 444 0 /uploadfile/small/200805369215016942/90x78.jpg - -
d:\iislog\W3SVC\ra080508.ibl 4530 FXKJ-UMBTKHGLNS 811 2008-05-08 00:03:18 221.1.120.137 58.218.209.130 80 GET HTTP/1.1 304 0 265 213 443 0 /uploadfile/small/20080538721584273/90x78.jpg - -
d:\iislog\W3SVC\ra080508.ibl 4534 FXKJ-UMBTKHGLNS 811 2008-05-08 00:03:19 221.1.120.137 58.218.209.130 80 GET HTTP/1.1 304 0 265 213 468 0 /Plus/wangzhai/wangzhai.js - -
d:\iislog\W3SVC\ra080508.ibl 4536 FXKJ-UMBTKHGLNS 811 2008-05-08 00:03:19 221.1.120.137 58.218.209.130 80 GET HTTP/1.1 304 0 218 211 537 0 /uploadfile/200805/7/5A142641405.jpg - -
d:\iislog\W3SVC\ra080508.ibl 4546 FXKJ-UMBTKHGLNS 811 2008-05-08 00:03:19 221.1.120.137 58.218.209.130 80 GET HTTP/1.1 304 0 78 211 461 0 /Plus/wangzhai/qq.gif - -
d:\iislog\W3SVC\ra080508.ibl 4548 FXKJ-UMBTKHGLNS 811 2008-05-08 00:03:19 221.1.120.137 58.218.209.130 80 GET HTTP/1.1 304 0 187 212 473 0 /Plus/wangzhai/yahoomyweb-cn.png - -
d:\iislog\W3SVC\ra080508.ibl 4549 FXKJ-UMBTKHGLNS 811 2008-05-08 00:03:19 221.1.120.137 58.218.209.130 80 GET HTTP/1.1 304 0 156 211 463 0 /Plus/wangzhai/poco.gif - -
d:\iislog\W3SVC\ra080508.ibl 4555 FXKJ-UMBTKHGLNS 811 2008-05-08 00:03:19 221.1.120.137 58.218.209.130 80 GET HTTP/1.1 304 0 140 211 464 0 /Plus/wangzhai/baidu.gif - -
d:\iislog\W3SVC\ra080508.ibl 4556 FXKJ-UMBTKHGLNS 811 2008-05-08 00:03:19 221.1.120.137 58.218.209.130 80 GET HTTP/1.1 304 0 265 212 538 0 /uploadfile/200805/7/40142639104.jpg - -
d:\iislog\W3SVC\ra080508.ibl 4557 FXKJ-UMBTKHGLNS 811 2008-05-08 00:03:20 221.1.120.137 58.218.209.130 80 GET HTTP/1.1 404 0 328 241 291 2 /favicon.ico - -
d:\iislog\W3SVC\ra080508.ibl 4558 FXKJ-UMBTKHGLNS 811 2008-05-08 00:03:20 221.1.120.137 58.218.209.130 80 GET HTTP/1.1 304 0 140 212 466 0 /Plus/wangzhai/google.gif - -
d:\iislog\W3SVC\ra080508.ibl 4559 FXKJ-UMBTKHGLNS 811 2008-05-08 00:03:20 221.1.120.137 58.218.209.130 80 GET HTTP/1.1 304 0 140 212 465 0 /Plus/wangzhai/dgpla.gif - -
d:\iislog\W3SVC\ra080508.ibl 4561 FXKJ-UMBTKHGLNS 811 2008-05-08 00:03:20 221.1.120.137 58.218.209.130 80 GET HTTP/1.1 304 0 218 212 465 0 /Plus/wangzhai/yahoo.gif - -
d:\iislog\W3SVC\ra080508.ibl 4562 FXKJ-UMBTKHGLNS 811 2008-05-08 00:03:20 221.1.120.137 58.218.209.130 80 GET HTTP/1.1 304 0 234 212 464 0 /Plus/wangzhai/vivi.gif - -
d:\iislog\W3SVC\ra080508.ibl 4564 FXKJ-UMBTKHGLNS 811 2008-05-08 00:03:20 221.1.120.137 58.218.209.130 80 GET HTTP/1.1 304 0 218 211 464 0 /Plus/wangzhai/cnmmm.gif - -
d:\iislog\W3SVC\ra080508.ibl 4565 FXKJ-UMBTKHGLNS 811 2008-05-08 00:03:20 221.1.120.137 58.218.209.130 80 GET HTTP/1.1 304 0 203 211 465 0 /Plus/wangzhai/365key.gif - -
d:\iislog\W3SVC\ra080508.ibl 4566 FXKJ-UMBTKHGLNS 811 2008-05-08 00:03:20 221.1.120.137 58.218.209.130 80 GET HTTP/1.1 304 0 203 212 465 0 /Plus/wangzhai/yesky.gif - -
d:\iislog\W3SVC\ra080508.ibl 4567 FXKJ-UMBTKHGLNS 811 2008-05-08 00:03:20 221.1.120.137 58.218.209.130 80 GET HTTP/1.1 304 0 187 212 466 0 /Plus/wangzhai/diglog.png - -
d:\iislog\W3SVC\ra080508.ibl 4568 FXKJ-UMBTKHGLNS 811 2008-05-08 00:03:20 221.1.120.137 58.218.209.130 80 GET HTTP/1.1 304 0 171 212 467 0 /Plus/wangzhai/younote.gif - -
d:\iislog\W3SVC\ra080508.ibl 4570 FXKJ-UMBTKHGLNS 811 2008-05-08 00:03:20 221.1.120.137 58.218.209.130 80 GET HTTP/1.1 304 0 187 211 464 0 /Plus/wangzhai/bolaa.gif - -
d:\iislog\W3SVC\ra080508.ibl 4571 FXKJ-UMBTKHGLNS 811 2008-05-08 00:03:20 221.1.120.137 58.218.209.130 80 GET HTTP/1.1 304 0 187 211 462 0 /Plus/wangzhai/cn3.gif - -
d:\iislog\W3SVC\ra080508.ibl 4572 FXKJ-UMBTKHGLNS 811 2008-05-08 00:03:20 221.1.120.137 58.218.209.130 80 GET HTTP/1.1 304 0 203 211 468 0 /Plus/wangzhai/blogmarks.png - -
d:\iislog\W3SVC\ra080508.ibl 4573 FXKJ-UMBTKHGLNS 811 2008-05-08 00:03:20 221.1.120.137 58.218.209.130 80 GET HTTP/1.1 304 0 218 211 468 0 /Plus/wangzhai/blinklist.gif - -
d:\iislog\W3SVC\ra080508.ibl 4574 FXKJ-UMBTKHGLNS 811 2008-05-08 00:03:20 221.1.120.137 58.218.209.130 80 GET HTTP/1.1 304 0 234 212 465 0 /Plus/wangzhai/spurl.png - -
d:\iislog\W3SVC\ra080508.ibl 4575 FXKJ-UMBTKHGLNS 811 2008-05-08 00:03:20 221.1.120.137 58.218.209.130 80 GET HTTP/1.1 304 0 234 212 466 0 /Plus/wangzhai/reddit.png - -
d:\iislog\W3SVC\ra080508.ibl 4576 FXKJ-UMBTKHGLNS 811 2008-05-08 00:03:20 221.1.120.137 58.218.209.130 80 GET HTTP/1.1 304 0 187 211 468 0 /Plus/wangzhai/delicious.gif - -
d:\iislog\W3SVC\ra080508.ibl 4577 FXKJ-UMBTKHGLNS 811 2008-05-08 00:03:20 221.1.120.137 58.218.209.130 80 GET HTTP/1.1 304 0 265 211 464 0 /Plus/wangzhai/hexun.gif - -
d:\iislog\W3SVC\ra080508.ibl 4590 FXKJ-UMBTKHGLNS 811 2008-05-08 00:03:20 221.1.120.137 58.218.209.130 80 GET HTTP/1.1 304 0 250 211 463 0 /Plus/wangzhai/digg.png - -
d:\iislog\W3SVC\ra080508.ibl 4594 FXKJ-UMBTKHGLNS 811 2008-05-08 00:03:20 221.1.120.137 58.218.209.130 80 GET HTTP/1.1 304 0 234 212 538 0 /uploadfile/200805/7/15142637929.jpg - -
d:\iislog\W3SVC\ra080508.ibl 37831 FXKJ-UMBTKHGLNS 811 2008-05-08 00:25:02 221.1.120.137 58.218.209.130 80 GET HTTP/1.1 304 0 187 258 580 0 /index.html - -
d:\iislog\W3SVC\ra080508.ibl 37842 FXKJ-UMBTKHGLNS 811 2008-05-08 00:25:02 221.1.120.137 58.218.209.130 80 GET HTTP/1.1 304 0 93 213 465 0 /template/css/style.css - -
d:\iislog\W3SVC\ra080508.ibl 37847 FXKJ-UMBTKHGLNS 811 2008-05-08 00:25:02 221.1.120.137 58.218.209.130 80 GET HTTP/1.1 304 0 171 212 461 0 /template/js/func.js - -
d:\iislog\W3SVC\ra080508.ibl 37848 FXKJ-UMBTKHGLNS 811 2008-05-08 00:25:02 221.1.120.137 58.218.209.130 80 GET HTTP/1.1 304 0 109 213 467 0 /template/images/logo.gif - -
d:\iislog\W3SVC\ra080508.ibl 37852 FXKJ-UMBTKHGLNS 811 2008-05-08 00:25:03 221.1.120.137 58.218.209.130 80 GET HTTP/1.1 304 0 156 212 462 0 /uploadfile/small/2008053cd215024409/90x78.jpg - -
d:\iislog\W3SVC\ra080508.ibl 37853 FXKJ-UMBTKHGLNS 811 2008-05-08 00:25:03 221.1.120.137 58.218.209.130 80 GET HTTP/1.1 304 0 234 211 463 0 /template/images/li.gif - -
d:\iislog\W3SVC\ra080508.ibl 37854 FXKJ-UMBTKHGLNS 811 2008-05-08 00:25:03 221.1.120.137 58.218.209.130 80 GET HTTP/1.1 304 0 171 212 462 0 /uploadfile/small/200805740142639104/90x78.jpg - -
d:\iislog\W3SVC\ra080508.ibl 37855 FXKJ-UMBTKHGLNS 811 2008-05-08 00:25:03 221.1.120.137 58.218.209.130 80 GET HTTP/1.1 304 0 265 211 464 0 /uploadfile/small/20080571f14199899.gif/90x78.jpg - -
d:\iislog\W3SVC\ra080508.ibl 37856 FXKJ-UMBTKHGLNS 811 2008-05-08 00:25:03 221.1.120.137 58.218.209.130 80 GET HTTP/1.1 304 0 265 212 495 0 /template/images/focus.swf - -
d:\iislog\W3SVC\ra080508.ibl 37860 FXKJ-UMBTKHGLNS 811 2008-05-08 00:25:03 221.1.120.137 58.218.209.130 80 GET HTTP/1.1 304 0 265 213 463 0 /uploadfile/small/200805682135240216/90x78.jpg - -
d:\iislog\W3SVC\ra080508.ibl 37861 FXKJ-UMBTKHGLNS 811 2008-05-08 00:25:03 221.1.120.137 58.218.209.130 80 GET HTTP/1.1 304 0 250 213 462 0 /uploadfile/small/20080538721584273/90x78.jpg - -
d:\iislog\W3SVC\ra080508.ibl 37862 FXKJ-UMBTKHGLNS 811 2008-05-08 00:25:03 221.1.120.137 58.218.209.130 80 GET HTTP/1.1 304 0 234 213 463 0 /uploadfile/small/200805369215016942/90x78.jpg - -
d:\iislog\W3SVC\ra080508.ibl 37867 FXKJ-UMBTKHGLNS 811 2008-05-08 00:25:03 221.1.120.137 58.218.209.130 80 GET HTTP/1.1 304 0 250 213 468 0 /Plus/wangzhai/wangzhai.js - -
d:\iislog\W3SVC\ra080508.ibl 37870 FXKJ-UMBTKHGLNS 811 2008-05-08 00:25:03 221.1.120.137 58.218.209.130 80 GET HTTP/1.1 304 0 234 211 537 0 /uploadfile/200805/7/5A142641405.jpg - -
d:\iislog\W3SVC\ra080508.ibl 37871 FXKJ-UMBTKHGLNS 811 2008-05-08 00:25:03 221.1.120.137 58.218.209.130 80 GET HTTP/1.1 304 0 78 211 461 0 /Plus/wangzhai/qq.gif - -
d:\iislog\W3SVC\ra080508.ibl 37872 FXKJ-UMBTKHGLNS 811 2008-05-08 00:25:03 221.1.120.137 58.218.209.130 80 GET HTTP/1.1 304 0 109 212 473 0 /Plus/wangzhai/yahoomyweb-cn.png - -
d:\iislog\W3SVC\ra080508.ibl 37877 FXKJ-UMBTKHGLNS 811 2008-05-08 00:25:03 221.1.120.137 58.218.209.130 80 GET HTTP/1.1 304 0 187 211 468 0 /Plus/wangzhai/delicious.gif - -
d:\iislog\W3SVC\ra080508.ibl 37879 FXKJ-UMBTKHGLNS 811 2008-05-08 00:25:03 221.1.120.137 58.218.209.130 80 GET HTTP/1.1 304 0 187 211 464 0 /Plus/wangzhai/baidu.gif - -
d:\iislog\W3SVC\ra080508.ibl 37880 FXKJ-UMBTKHGLNS 811 2008-05-08 00:25:03 221.1.120.137 58.218.209.130 80 GET HTTP/1.1 304 0 187 212 466 0 /Plus/wangzhai/google.gif - -
d:\iislog\W3SVC\ra080508.ibl 37881 FXKJ-UMBTKHGLNS 811 2008-05-08 00:25:03 221.1.120.137 58.218.209.130 80 GET HTTP/1.1 404 0 296 241 291 2 /favicon.ico - -
d:\iislog\W3SVC\ra080508.ibl 37882 FXKJ-UMBTKHGLNS 811 2008-05-08 00:25:03 221.1.120.137 58.218.209.130 80 GET HTTP/1.1 304 0 328 212 538 0 /uploadfile/200805/7/40142639104.jpg - -
d:\iislog\W3SVC\ra080508.ibl 37884 FXKJ-UMBTKHGLNS 811 2008-05-08 00:25:03 221.1.120.137 58.218.209.130 80 GET HTTP/1.1 304 0 187 212 465 0 /Plus/wangzhai/dgpla.gif - -
d:\iislog\W3SVC\ra080508.ibl 37885 FXKJ-UMBTKHGLNS 811 2008-05-08 00:25:03 221.1.120.137 58.218.209.130 80 GET HTTP/1.1 304 0 187 212 465 0 /Plus/wangzhai/yahoo.gif - -
d:\iislog\W3SVC\ra080508.ibl 37886 FXKJ-UMBTKHGLNS 811 2008-05-08 00:25:03 221.1.120.137 58.218.209.130 80 GET HTTP/1.1 304 0 171 212 464 0 /Plus/wangzhai/vivi.gif - -
d:\iislog\W3SVC\ra080508.ibl 37887 FXKJ-UMBTKHGLNS 811 2008-05-08 00:25:03 221.1.120.137 58.218.209.130 80 GET HTTP/1.1 304 0 187 211 463 0 /Plus/wangzhai/digg.png - -
d:\iislog\W3SVC\ra080508.ibl 37891 FXKJ-UMBTKHGLNS 811 2008-05-08 00:25:04 221.1.120.137 58.218.209.130 80 GET HTTP/1.1 304 0 156 211 462 0 /Plus/wangzhai/cn3.gif - -
d:\iislog\W3SVC\ra080508.ibl 37892 FXKJ-UMBTKHGLNS 811 2008-05-08 00:25:04 221.1.120.137 58.218.209.130 80 GET HTTP/1.1 304 0 171 211 464 0 /Plus/wangzhai/bolaa.gif - -
d:\iislog\W3SVC\ra080508.ibl 37893 FXKJ-UMBTKHGLNS 811 2008-05-08 00:25:04 221.1.120.137 58.218.209.130 80 GET HTTP/1.1 304 0 187 212 467 0 /Plus/wangzhai/younote.gif - -
d:\iislog\W3SVC\ra080508.ibl 37894 FXKJ-UMBTKHGLNS 811 2008-05-08 00:25:04 221.1.120.137 58.218.209.130 80 GET HTTP/1.1 304 0 187 211 463 0 /Plus/wangzhai/poco.gif - -
d:\iislog\W3SVC\ra080508.ibl 37895 FXKJ-UMBTKHGLNS 811 2008-05-08 00:25:04 221.1.120.137 58.218.209.130 80 GET HTTP/1.1 304 0 218 211 464 0 /Plus/wangzhai/hexun.gif - -

[[i] 本帖最后由 happygod 于 2008-5-10 00:44 编辑 [/i]]

大丰港 发表于 2008-5-9 11:34

这个可以看ip  就知道哪个是不是百度的蜘蛛

15        220.181.19.*        百度蜘蛛
16        159.226.50.*        百度蜘蛛
17        202.108.11.*        百度蜘蛛
18        202.108.22.*        百度蜘蛛
19        202.108.23.*        百度蜘蛛
20        202.108.249.*        百度蜘蛛
21        202.108.250.*        百度蜘蛛
22        61.135.145.*        百度蜘蛛
23        61.135.146.*        百度蜘蛛

这些ip段  多数都是百度的蜘蛛

deed 发表于 2008-5-9 11:55

这个哪里找的

年少无知 发表于 2008-5-9 12:04

搜索baiduIP

54xiaohou 发表于 2008-5-9 13:43

IIS访问记录里面有的

南京 发表于 2008-5-9 15:31

*** 作者被禁止或删除 内容自动屏蔽 ***

happygod 发表于 2008-5-9 15:44

[quote]原帖由 [i]大丰港[/i] 于 2008-5-9 11:34 发表 [url=http://www.im286.com/redirect.php?goto=findpost&pid=26032427&ptid=2569162][img]http://www.im286.com/images/common/back.gif[/img][/url]
这个可以看ip  就知道哪个是不是百度的蜘蛛

15        220.181.19.*        百度蜘蛛
16        159.226.50.*        百度蜘蛛
17        202.108.11.*        百度蜘蛛
18        202.108.22.*        百度蜘 ... [/quote]
貌似没有这些。。。。。。。。。。

[[i] 本帖最后由 happygod 于 2008-5-9 19:59 编辑 [/i]]

happygod 发表于 2008-5-9 15:44

[quote]原帖由 [i]deed[/i] 于 2008-5-9 11:55 发表 [url=http://www.im286.com/redirect.php?goto=findpost&pid=26032913&ptid=2569162][img]http://www.im286.com/images/common/back.gif[/img][/url]
这个哪里找的 [/quote]
这是iis日志，虚拟主机跟空间商要，自己的服务器自己设置。。。

happygod 发表于 2008-5-9 15:45

[quote]原帖由 [i]南京[/i] 于 2008-5-9 15:31 发表 [url=http://www.im286.com/redirect.php?goto=findpost&pid=26039408&ptid=2569162][img]http://www.im286.com/images/common/back.gif[/img][/url]
查找“baiduspider” [/quote]
貌似我的空间商提供的日志形式跟这位朋友说的不是一种格式。。。

zhylyk 发表于 2008-5-9 16:25

刚在落伍里发过一个帖子，统计了各大搜索引擎的蜘蛛的ip段，有时候你找baiduspider 如果找不到的话就找下他们的ip
[url]http://www.im286.com/thread-2569821-1-1.html[/url]

7155006 发表于 2008-5-10 04:18

看看IP段把。虚拟主机就是不方便。

页: [1]

Powered by Discuz! Archiver 6.1.0  © 2001-2007 Comsenz Inc.