パスワードを忘れた? アカウント作成
477715 journal

MKの日記: Mixi RSS Fetcher -> mixi-crawler 2

日記 by MK

mixi の外部サイトrss 取得最近は1日1回あればいい方だったのですが,なんか今日早いのに気づきました.
これまでのクローラは,

Mixi RSS Fetcher - Version 0.1

というやつ.
ログをgrep してみるとやっぱり1,2日に1回程度しか来ていません.
grep -i mixi としてみると,

mixi-crawler/1.99 (http://mixi.jp/)
mixi-crawler/2.00 (http://mixi.jp/)

というのを発見.
ログからすると,10日から稼働し始めて2時間おきくらいになめてくれてるみたい.
Mixi RSS Fetcher も平行して動いてるのかな?

% grep -i mixi /usr/local/apache2/logs/access-hpv_20071206.log |grep recent_entry.rdf
n3.59-106-61-92.mixi.jp - - [06/Dec/2007:15:07:20 +0900] "GET /~maty/rna/rss/recent_entry.rdf HTTP/1.1" 200 90044 "-" "Mixi RSS Fetcher - Version 0.1"
n3.59-106-61-92.mixi.jp - - [08/Dec/2007:04:24:35 +0900] "GET /~maty/rna/rss/recent_entry.rdf HTTP/1.1" 200 97597 "-" "Mixi RSS Fetcher - Version 0.1"
n3.59-106-61-92.mixi.jp - - [09/Dec/2007:17:52:36 +0900] "GET /~maty/rna/rss/recent_entry.rdf HTTP/1.1" 200 92399 "-" "Mixi RSS Fetcher - Version 0.1"
m4-219-112-245-005.mixi.jp - - [10/Dec/2007:11:47:18 +0900] "GET /~maty/rna/rss/recent_entry.rdf HTTP/1.1" 206 90610 "-" "mixi-crawler/1.99 (http://mixi.jp/)"
m4-219-112-245-005.mixi.jp - - [10/Dec/2007:14:02:23 +0900] "GET /~maty/rna/rss/recent_entry.rdf HTTP/1.1" 206 90610 "-" "mixi-crawler/1.99 (http://mixi.jp/)"
m4-219-112-245-005.mixi.jp - - [10/Dec/2007:16:04:11 +0900] "GET /~maty/rna/rss/recent_entry.rdf HTTP/1.1" 206 90610 "-" "mixi-crawler/1.99 (http://mixi.jp/)"
m4-219-112-245-005.mixi.jp - - [10/Dec/2007:18:04:54 +0900] "GET /~maty/rna/rss/recent_entry.rdf HTTP/1.1" 206 89717 "-" "mixi-crawler/1.99 (http://mixi.jp/)"
m4-219-112-245-005.mixi.jp - - [10/Dec/2007:20:05:44 +0900] "GET /~maty/rna/rss/recent_entry.rdf HTTP/1.1" 206 89717 "-" "mixi-crawler/1.99 (http://mixi.jp/)"
m4-219-112-245-005.mixi.jp - - [10/Dec/2007:22:07:16 +0900] "GET /~maty/rna/rss/recent_entry.rdf HTTP/1.1" 206 89717 "-" "mixi-crawler/1.99 (http://mixi.jp/)"
m4-219-112-245-005.mixi.jp - - [11/Dec/2007:00:07:57 +0900] "GET /~maty/rna/rss/recent_entry.rdf HTTP/1.1" 206 89717 "-" "mixi-crawler/1.99 (http://mixi.jp/)"
m4-219-112-245-005.mixi.jp - - [11/Dec/2007:02:08:29 +0900] "GET /~maty/rna/rss/recent_entry.rdf HTTP/1.1" 206 89717 "-" "mixi-crawler/1.99 (http://mixi.jp/)"
m4-219-112-245-005.mixi.jp - - [11/Dec/2007:04:09:56 +0900] "GET /~maty/rna/rss/recent_entry.rdf HTTP/1.1" 206 89717 "-" "mixi-crawler/1.99 (http://mixi.jp/)"
m4-219-112-245-005.mixi.jp - - [11/Dec/2007:06:10:14 +0900] "GET /~maty/rna/rss/recent_entry.rdf HTTP/1.1" 206 89717 "-" "mixi-crawler/1.99 (http://mixi.jp/)"
n3.59-106-61-92.mixi.jp - - [11/Dec/2007:07:06:12 +0900] "GET /~maty/rna/rss/recent_entry.rdf HTTP/1.1" 200 89717 "-" "Mixi RSS Fetcher - Version 0.1"
m4-219-112-245-005.mixi.jp - - [11/Dec/2007:08:10:47 +0900] "GET /~maty/rna/rss/recent_entry.rdf HTTP/1.1" 206 89717 "-" "mixi-crawler/1.99 (http://mixi.jp/)"
m4-219-112-245-005.mixi.jp - - [11/Dec/2007:10:12:25 +0900] "GET /~maty/rna/rss/recent_entry.rdf HTTP/1.1" 206 89717 "-" "mixi-crawler/1.99 (http://mixi.jp/)"
m4-219-112-245-005.mixi.jp - - [11/Dec/2007:12:12:39 +0900] "GET /~maty/rna/rss/recent_entry.rdf HTTP/1.1" 206 89717 "-" "mixi-crawler/1.99 (http://mixi.jp/)"
m4-219-112-245-005.mixi.jp - - [11/Dec/2007:14:12:48 +0900] "GET /~maty/rna/rss/recent_entry.rdf HTTP/1.1" 206 89717 "-" "mixi-crawler/1.99 (http://mixi.jp/)"
m4-219-112-245-005.mixi.jp - - [11/Dec/2007:16:13:10 +0900] "GET /~maty/rna/rss/recent_entry.rdf HTTP/1.1" 206 90631 "-" "mixi-crawler/1.99 (http://mixi.jp/)"
m4-219-112-245-005.mixi.jp - - [11/Dec/2007:18:13:29 +0900] "GET /~maty/rna/rss/recent_entry.rdf HTTP/1.1" 206 91138 "-" "mixi-crawler/1.99 (http://mixi.jp/)"
m4-219-112-245-005.mixi.jp - - [11/Dec/2007:20:14:08 +0900] "GET /~maty/rna/rss/recent_entry.rdf HTTP/1.1" 206 92536 "-" "mixi-crawler/1.99 (http://mixi.jp/)"
m4-219-112-245-005.mixi.jp - - [11/Dec/2007:22:14:48 +0900] "GET /~maty/rna/rss/recent_entry.rdf HTTP/1.1" 206 92823 "-" "mixi-crawler/1.99 (http://mixi.jp/)"
m4-219-112-245-005.mixi.jp - - [12/Dec/2007:00:17:39 +0900] "GET /~maty/rna/rss/recent_entry.rdf HTTP/1.1" 206 92823 "-" "mixi-crawler/1.99 (http://mixi.jp/)"
m4-219-112-245-005.mixi.jp - - [12/Dec/2007:02:18:00 +0900] "GET /~maty/rna/rss/recent_entry.rdf HTTP/1.1" 206 92823 "-" "mixi-crawler/1.99 (http://mixi.jp/)"
m4-219-112-245-005.mixi.jp - - [12/Dec/2007:04:18:31 +0900] "GET /~maty/rna/rss/recent_entry.rdf HTTP/1.1" 206 92823 "-" "mixi-crawler/1.99 (http://mixi.jp/)"
m4-219-112-245-005.mixi.jp - - [12/Dec/2007:06:19:27 +0900] "GET /~maty/rna/rss/recent_entry.rdf HTTP/1.1" 206 92823 "-" "mixi-crawler/1.99 (http://mixi.jp/)"
m4-219-112-245-005.mixi.jp - - [12/Dec/2007:08:19:47 +0900] "GET /~maty/rna/rss/recent_entry.rdf HTTP/1.1" 206 92823 "-" "mixi-crawler/1.99 (http://mixi.jp/)"
m4-219-112-245-005.mixi.jp - - [12/Dec/2007:10:20:17 +0900] "GET /~maty/rna/rss/recent_entry.rdf HTTP/1.1" 206 92823 "-" "mixi-crawler/1.99 (http://mixi.jp/)"
m4-219-112-245-005.mixi.jp - - [12/Dec/2007:12:20:59 +0900] "GET /~maty/rna/rss/recent_entry.rdf HTTP/1.1" 206 92823 "-" "mixi-crawler/1.99 (http://mixi.jp/)"
m4-219-112-245-005.mixi.jp - - [12/Dec/2007:14:21:25 +0900] "GET /~maty/rna/rss/recent_entry.rdf HTTP/1.1" 206 92332 "-" "mixi-crawler/1.99 (http://mixi.jp/)"
m4-219-112-245-005.mixi.jp - - [12/Dec/2007:16:21:34 +0900] "GET /~maty/rna/rss/recent_entry.rdf HTTP/1.1" 206 91326 "-" "mixi-crawler/2.00 (http://mixi.jp/)"
m4-219-112-245-005.mixi.jp - - [12/Dec/2007:18:24:55 +0900] "GET /~maty/rna/rss/recent_entry.rdf HTTP/1.1" 206 92233 "-" "mixi-crawler/2.00 (http://mixi.jp/)"
m4-219-112-245-005.mixi.jp - - [12/Dec/2007:20:26:52 +0900] "GET /~maty/rna/rss/recent_entry.rdf HTTP/1.1" 206 91969 "-" "mixi-crawler/2.00 (http://mixi.jp/)"

追記)
去年の今頃のメモ.
- Matoken's meme | Mixi RSS Fetcher
http://maty.jugem.cc/?eid=501

この議論は賞味期限が切れたので、アーカイブ化されています。 新たにコメントを付けることはできません。
typodupeerror

アレゲは一日にしてならず -- アレゲ見習い

読み込み中...