squid + rejik win32 - странная загрузка процессора

Обсуждение программы редиректора
alk
Сообщения: 12
Зарегистрирован: Вт май 10, 2005 18:35

squid + rejik win32 - странная загрузка процессора

Сообщение alk »

Использую squidNT (squid-2.7.STABLE8) и rejik 3.2.8 - все работает, но вот какая обнаруживается странность.
При запуске компьютера, на котором стартует squid как Windows serviсe и двадцатью процессорами редиректора
url_rewrite_children 20
в Task Manager'е хорошо видно, как процессы Redirector.exe кушают от 2 до 7 процентов процессора каждый, что в целом создает довольно высокую нагрузку на компьютер. Но вот, что удивительно. Стоит squid'у по какой-то причине аварийно завершится и перезапуститься, как те же 20 процессов ведут себя совершенно иначе - никакой нагрузки не создают, ну о силы проскочит 1%, а так всё на нулях. При этом прокси-сервер работает точно также, как и раньше. Запросы пользователей обслуживает, баннеры режет и т.д. Компьютер оказывается практически не нагружен.
Почему же при первом старте так много начинают отбирать редиректоры? А потом перестают.
В журнале сквида и режика я ничего криминального не обнаружил. Возможно, не нашел, потому что не знаю, где искать?

Slava
Site Admin
Сообщения: 2251
Зарегистрирован: Пт апр 02, 2004 12:34
Контактная информация:

Re: squid + rejik win32 - странная загрузка процессора

Сообщение Slava »

Если бан листы изменились, то режик, при запуске, ставит первым процессом лок и запускает make-cache.
Остальные процессы ждут, когда снимут лок.
make-cache завершается, запустивший его процесс снимает лок и загружает кеш.
Остальные процессы по снятию лока загружают кеш.

Описанное Вами наводит на мысль, что что-то не так с локами.

1. Удалите redirector.err
2. Добавьте произвольное правило в любой лист
3. Остановите сквид.
4. Запустите сквид.
5. Проблема повторилась?
6. Покажите redirector.err

alk
Сообщения: 12
Зарегистрирован: Вт май 10, 2005 18:35

Re: squid + rejik win32 - странная загрузка процессора

Сообщение alk »

спасибо за быстрый ответ.
Хочу уточнить, что правила и бан-листы у меня не менялись очень давно.
В папке rejik\banners у меня есть файл lock.file нулевого размера, созданный очень давно, 23-05-2011, тогда, когда я установил это хозяйство на данную машину.
Больше ни в каких подпапках lock-файлов нет.

По поводу выданных инструкций:
1. redirector.err можно прямо на ходу удалять, без остановки сквида?
2. например, правило в banners\urls?
3-4-5. то есть проблема с высокой загрузкой redirector.exe?

Slava
Site Admin
Сообщения: 2251
Зарегистрирован: Пт апр 02, 2004 12:34
Контактная информация:

Re: squid + rejik win32 - странная загрузка процессора

Сообщение Slava »

1. Да
2. Да
3-5. Не известно

alk
Сообщения: 12
Зарегистрирован: Вт май 10, 2005 18:35

Re: squid + rejik win32 - странная загрузка процессора

Сообщение alk »

Все сделал, после перезапуска squid'а нагрузки нет, вот redirector.err
2011-09-08 17:07:29 [3848] MAKE-CACHE: ERROR: fcntl return error: Resource deadlock avoided
2011-09-08 17:07:29 [3896] MAKE-CACHE: ERROR: fcntl return error: Resource deadlock avoided
2011-09-08 17:07:29 [264] MAKE-CACHE: ERROR: fcntl return error: Resource deadlock avoided
2011-09-08 17:07:29 [496] MAKE-CACHE: ERROR: fcntl return error: Resource deadlock avoided
2011-09-08 17:07:29 [3768] MAKE-CACHE: ERROR: fcntl return error: Resource deadlock avoided
2011-09-08 17:07:29 [3816] MAKE-CACHE: ERROR: fcntl return error: Resource deadlock avoided
2011-09-08 17:07:30 [592] MAKE-CACHE: ERROR: fcntl return error: Resource deadlock avoided
2011-09-08 17:07:30 [4020] MAKE-CACHE: ERROR: fcntl return error: Resource deadlock avoided
2011-09-08 17:07:30 [4036] MAKE-CACHE: ERROR: fcntl return error: Resource deadlock avoided
2011-09-08 17:07:30 [3784] MAKE-CACHE: ERROR: fcntl return error: Resource deadlock avoided
2011-09-08 17:07:30 [3504] MAKE-CACHE: ERROR: fcntl return error: Resource deadlock avoided
2011-09-08 17:07:30 [524] MAKE-CACHE: ERROR: fcntl return error: Resource deadlock avoided
2011-09-08 17:07:30 [3832] MAKE-CACHE: ERROR: fcntl return error: Resource deadlock avoided
2011-09-08 17:07:30 [3880] MAKE-CACHE: ERROR: fcntl return error: Resource deadlock avoided
2011-09-08 17:07:30 [248] MAKE-CACHE: ERROR: fcntl return error: Resource deadlock avoided
2011-09-08 17:07:30 [3800] MAKE-CACHE: ERROR: fcntl return error: Resource deadlock avoided
2011-09-08 17:07:30 [572] MAKE-CACHE: ERROR: fcntl return error: Resource deadlock avoided
2011-09-08 17:07:30 [3864] MAKE-CACHE: ERROR: fcntl return error: Resource deadlock avoided
2011-09-08 17:07:30 [396] Make-cache finished detected, continue
2011-09-08 17:07:30 [396] Load 2178 rules from /cygdrive/c/squid/etc/rejik/banners/urls.cache
2011-09-08 17:07:30 [396] Load 8 pattern from BANNER pcre
2011-09-08 17:07:30 [396] Load 22283 rules from /cygdrive/c/squid/etc/rejik/porno/urls.cache
2011-09-08 17:07:30 [396] Load 5 pattern from MP3 pcre
2011-09-08 17:07:30 [396] Load 1 rules from /cygdrive/c/squid/etc/rejik/js/urls.cache
2011-09-08 17:07:30 [396] Redirector start and working (3.2.8)
2011-09-08 17:07:36 [3320] Run make-cache (3.2.8)
2011-09-08 17:07:36 [1060] MAKE-CACHE: MAKE /cygdrive/c/squid/etc/rejik/banners/urls.cache
2011-09-08 17:07:36 [1060] MAKE-CACHE: WARNING: Can't parse rule: adserver.dooyoo.co.uk:80/cgi-bin/v20.cgi?configID=${ptid}&URL=http://www.dooyoo.co.uk/fashion-accesso ... 20Business!. Skipping.
2011-09-08 17:07:36 [1060] MAKE-CACHE: WARNING: Can't parse rule: banners.zenon.net:8080/-f/rotate?id=ayb@go.ru&to=http://ad.adriver.ru/cgi-bin/rle.cgi?si ... =121055502. Skipping.
2011-09-08 17:07:36 [1060] MAKE-CACHE: WARNING: Can't parse rule: clck.yandex.ru:80/click/dtype=web/*http://bbs.trifle.net/cgi/adve_get.cgi? ... 00&&607674. Skipping.
2011-09-08 17:07:36 [1060] MAKE-CACHE: WARNING: Can't parse rule: count.rbc.ru/p12.gif?r=http://www.pochta.ru/help.php&rf=http:/ ... 6247379495. Skipping.
2011-09-08 17:07:36 [1060] MAKE-CACHE: WARNING: Can't parse rule: counter.glc.ru/default.asp?url=http://www.xakep.ru/magazine/xs/041/102 ... =&qstring=. Skipping.
2011-09-08 17:07:36 [1060] MAKE-CACHE: WARNING: Can't parse rule: program.ru:80/ffcounter.php?http://ar.sky.ru/. Skipping.
2011-09-08 17:07:36 [1060] MAKE-CACHE: WARNING: Can't parse rule: rose.ixbt.com/banner/12/409.swf?banner_href=http://rose.ixbt.com/cgi-bin/click_i.cg ... 5%26pg=447. Skipping.
2011-09-08 17:07:36 [1060] MAKE-CACHE: WARNING: Can't parse rule: static.exaccess.ru:80/banners/Img_30154.swf?ealink=http://static.exaccess.ru/asp/redirect. ... get=_blank. Skipping.
2011-09-08 17:07:36 [1060] MAKE-CACHE: WARNING: Can't parse rule: http://www.a-banner.kiev.ua/cgi-bin/adc ... /text/4744. Skipping.
2011-09-08 17:07:36 [1060] MAKE-CACHE: WARNING: Can't parse rule: http://www.automobilgoda.ru:80/i/auto20 ... health.ru/. Skipping.
2011-09-08 17:07:36 [1060] MAKE-CACHE: WARNING: Can't parse rule: http://www.avinfo.ru/banners/kerio_mail ... ick10.html. Skipping.
2011-09-08 17:07:36 [1060] MAKE-CACHE: WARNING: Can't parse rule: http://www.epanorama.net/counter.php?ur ... cable.html. Skipping.
2011-09-08 17:07:36 [1060] MAKE-CACHE: WARNING: Can't parse rule: http://www.ets.ru:80/pg/count.php?me=ht ... 20Business!. Skipping.
2011-09-08 17:07:36 [1060] MAKE-CACHE: WARNING: Can't parse rule: http://www.gcl.ru/main/banners/type_1/1 ... /1356.html. Skipping.
2011-09-08 17:07:36 [1060] MAKE-CACHE: WARNING: Can't parse rule: http://www.googleadservices.com/pagead/ ... Y2ZWJjEObB. Skipping.
2011-09-08 17:07:36 [1060] MAKE-CACHE: WARNING: Can't parse rule: http://www.googleadservices.com:80/page ... BAAA&num=1. Skipping.
2011-09-08 17:07:36 [1060] MAKE-CACHE: WARNING: Can't parse rule: http://www.kolej.mff.cuni.cz:80/~lmotm2 ... slavsk.com. Skipping.
2011-09-08 17:07:36 [1060] MAKE-CACHE: WARNING: Can't parse rule: http://www.omar.ru:80/img/banners/m3x_o ... cgi?id=127. Skipping.
2011-09-08 17:07:36 [1060] MAKE-CACHE: WARNING: Can't parse rule: http://www.qksrv.net:80/click-1446521-9 ... dictionary. Skipping.
2011-09-08 17:07:36 [1060] MAKE-CACHE: WARNING: Can't parse rule: http://www.tybet.ru:80/banners/tro/gree ... 22%26typ=3. Skipping.
2011-09-08 17:07:36 [1060] MAKE-CACHE: Load 3488 rules from /cygdrive/c/squid/etc/rejik/banners/urls
2011-09-08 17:07:36 [1060] MAKE-CACHE: WARNING: Bad symbol(&) in domen name "3590250&size=entryinterstitial" in BANNER section, skip
2011-09-08 17:07:36 [1060] MAKE-CACHE: WARNING: Bad symbol(&) in domen name "rs&vbn=587&num=1&w=468&h=60&&ref=Not%20Your%20Business%21&loc=&nocache=112925" in BANNER section, skip
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete dublicate rule: 095.ru:80/GlobalIncludes/Banners/woodlan_100.asp in BANNER section
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete dublicate rule: 212.83.16.11:80/banner/banner_img_0121.jpg in BANNER section
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete dublicate rule: 212.83.16.11:80/banner/banner_img_0121.jpg in BANNER section
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete dublicate rule: 212.83.16.11:80/banner/banner_img_0121.jpg in BANNER section
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete dublicate rule: 212.83.16.11:80/banner/banner_img_0124.jpg in BANNER section
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete dublicate rule: 212.83.16.11:80/banner/banner_img_0124.jpg in BANNER section
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete dublicate rule: 212.83.16.11:80/banner/banner_img_0124.jpg in BANNER section
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete dublicate rule: www.blogwise.com/buttons/banner_blogwise.gif in BANNER section
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete dublicate rule: counter36.bravenet.com/counter.php?count=270772&type=1&cpv=2&key=bbc2cd5c501224232b7c339213e63c46 in BANNER section
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete dublicate rule: www-banner.chat.ru/allshops.js in BANNER section
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete dublicate rule: rotabanner.dni.ru/cgi-bin/iframe/km_ushi?428876 in BANNER section
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete dublicate rule: e-shop.ru/code/common/ads in BANNER section
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete dublicate rule: www.europetro.com:80/epc/banner.html in BANNER section
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete dublicate rule: www.europetro.com:80/epc/banner.html in BANNER section
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete dublicate rule: fair.ru/php/i.php in BANNER section
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete dublicate rule: www.full-albums.net/full_albums_soundtrack.asp in BANNER section
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete dublicate rule: www.gazeta.ru:80/files/174644/banner_def_travel.js in BANNER section
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete dublicate rule: gids.ru/top/hit.php in BANNER section
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete dublicate rule: gramota.ru/img/banner in BANNER section
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete dublicate rule: http://www.interactive-pr.ru:80/swf/ban ... 8x60_1.swf in BANNER section
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete dublicate rule: http://www.juegosmix.com:80/publicidad/ ... tbull2.swf in BANNER section
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete dublicate rule: http://www.lin.ru:80/emitent.nsf/Pictur ... banner.gif in BANNER section
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete dublicate rule: megasklad.ru:80/data/banners/1074944854.swf in BANNER section
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete dublicate rule: www.mesa3d.org:80/banner.html in BANNER section
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete dublicate rule: catalog.metka.ru:80/counter/counter.php?id=1007453152&im=6&tp=3 in BANNER section
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete dublicate rule: m1.nedstatbasic.net/basic.js in BANNER section
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete dublicate rule: product.ru/images/b in BANNER section
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete dublicate rule: www.ranker.ru/scripts/rcounter.dll?ID=14823&image=716 in BANNER section
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete dublicate rule: www.recatalys.ru:80/images/banner1.jpg in BANNER section
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete dublicate rule: http://www.registrarads.com:80/adpopup. ... 00&top=250 in BANNER section
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete dublicate rule: sm6.sitemeter.com/js/counter.asp?site=sm6lunarcal in BANNER section
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete dublicate rule: sm6.sitemeter.com:80/js/counter.asp?site=sm6vfdown in BANNER section
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete dublicate rule: sm6.sitemeter.com:80/js/counter.asp?site=sm6vfdown in BANNER section
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete dublicate rule: sm6.sitemeter.com:80/js/counter.asp?site=sm6vfdown in BANNER section
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete dublicate rule: sm7.sitemeter.com:80/js/counter.asp?site=sm7EasyHelp in BANNER section
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete dublicate rule: sm7.sitemeter.com:80/js/counter.asp?site=sm7EasyHelp in BANNER section
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete dublicate rule: sm7.sitemeter.com:80/js/counter.asp?site=sm7samaratour in BANNER section
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete dublicate rule: www.smart-quotes.com:80/js/banner.2.js in BANNER section
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete dublicate rule: smi.ru/cgi-bin/banner in BANNER section
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete dublicate rule: u024.44.spylog.com:80/java/400/jspylog/informer/Informer.class in BANNER section
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete dublicate rule: u071.76.spylog.com:80/js/c2.js in BANNER section
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete dublicate rule: u071.76.spylog.com:80/js/c2.js in BANNER section
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete dublicate rule: u071.76.spylog.com:80/js/c2.js in BANNER section
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete dublicate rule: u102.53.spylog.com:80/js/c2s.js in BANNER section
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete dublicate rule: u103.98.spylog.com:80/js/c2.js in BANNER section
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete dublicate rule: u103.98.spylog.com:80/js/c2.js in BANNER section
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete dublicate rule: log.ya1.ru:80/counter.php?uid=293&referer=Not%20Your%20Business%21&type=4 in BANNER section
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete rule: ad.adriver.ru/cgi-bin/erle.cgi?ad=58536&sid=1&bt=17&pid=80989&rnd=1191649977 because exist rule: adriver.ru
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete rule: bannerbank.ru:8080 because exist rule: bannerbank.ru
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete rule: ad4.bannerbank.ru/bb.cgi?cmd=ad&hreftarget=_blank&pubid=142002&pg=1&r=js&ssi=nofillers&vbn=133&num=1&w=468&h=60&&ref=Not%20Your%20Business%21&loc=&nocache=473680 because exist rule: bannerbank.ru
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete rule: ad.bb.ru/bb.cgi?cmd=ad&pubid=172737&pg=1&vbn=197&num=1&w=468&h=60&nocache=2913751 because exist rule: bb.ru
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete rule: count.ru:80/cnt?id=28673&j=n&ref= because exist rule: count.ru
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete rule: ehg.hitbox.com:443/ because exist rule: hitbox.com
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete rule: hg1.hitbox.com:80/HG?hc=wf131&l=y&hb=WQ510522KHVB89RU0&cd=1&n=jewish+ru+page because exist rule: hitbox.com
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete rule: js1.hitbox.com:80/js?acct=WQ50041172VM42EN0&m=w147&n=PUT+PAGE+NAME+HERE because exist rule: hitbox.com
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete rule: stats.hitbox.com/js/hbp.js because exist rule: hitbox.com
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete rule: stats.hitbox.com:80/js/hbf.js because exist rule: hitbox.com
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete rule: counter.hotlog.ru/cgi-bin/hotlog/count.js because exist rule: hotlog.ru
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete rule: img.hotlog.ru/cgi-bin/hotlog/count?im=2030 because exist rule: hotlog.ru
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete rule: img.hotlog.ru:80/cgi-bin/hotlog/count?im=2001 because exist rule: hotlog.ru
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete rule: adm.imho.ru:80/banners/dot.gif because exist rule: imho.ru
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete rule: head.imho.ru/banners/microsoft/Microsoft_Security_ADV_april-june2005/lighthouse_120x300.gif because exist rule: imho.ru
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete rule: ad.krutilka.ru/f3604x1 because exist rule: krutilka.ru
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete rule: direct.lbe.ru/cgi-bin/banner/listmailru.468_60?827706 because exist rule: lbe.ru
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete rule: ad4.lbn.ru:80/cgi-bin/banner/672?606470&login=old-max&referer=http%3A%2F%2Fwww.business.lbn.ru%3A80%2F because exist rule: lbn.ru
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete rule: http://www.business.lbn.ru:80//cgi-bin/ ... ru%3A80%2F because exist rule: lbn.ru
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete rule: ad.linkexchange.com/X385809/logoshowad?free because exist rule: linkexchange.com
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete rule: mbe.ru/adrevolver/banner?js&place=338&cpy=133179 because exist rule: mbe.ru
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete rule: m1.nedstatbasic.net/basic.js because exist rule: nedstatbasic.net
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete rule: m1.nedstatbasic.net/n?id=ABGzyQW7fSkaA8FSFCB8c5FXCfEA because exist rule: nedstatbasic.net
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete rule: aval.rotabanner.com:80/cgi-bin/banner/123?65912&login=eng_uho because exist rule: rotabanner.com
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete rule: imb.rotabanner.com:80/cgi-bin/banner/1?399271&login=uho because exist rule: rotabanner.com
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete rule: mdm.rotabanner.com:80/cgi-bin/banner/12?2358394&login=uho-big because exist rule: rotabanner.com
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete rule: media.rotabanner.com:80/cgi-bin/banner/1670?364684&login=cifrovik&referer=http%3A%2F%2Fmedia.rotabanner.com%3A80%2F because exist rule: rotabanner.com
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete rule: s11.sitemeter.com:80/js/counter.asp?site=s11oknovmir because exist rule: sitemeter.com
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete rule: s13.sitemeter.com/js/counter.asp?site=s13space1234 because exist rule: sitemeter.com
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete rule: sm1.sitemeter.com:80/meter.asp?site=sm1tourism because exist rule: sitemeter.com
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete rule: sm3.sitemeter.com:80/js/counter.asp?site=sm3evrey because exist rule: sitemeter.com
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete rule: sm3.sitemeter.com:80/js/counter.asp?site=sm3michnews because exist rule: sitemeter.com
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete rule: sm3.sitemeter.com:80/meter.asp?site=sm3mitchandre because exist rule: sitemeter.com
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete rule: sm3.sitemeter.com:80/meter.asp?site=sm3worldclimate because exist rule: sitemeter.com
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete rule: sm4.sitemeter.com:80/meter.asp?site=sm4kadaitcha because exist rule: sitemeter.com
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete rule: sm5.sitemeter.com:80/js/counter.asp?site=sm5toyboxusa because exist rule: sitemeter.com
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete rule: sm6.sitemeter.com/js/counter.asp?site=sm6lunarcal because exist rule: sitemeter.com
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete rule: sm6.sitemeter.com:80/js/counter.asp?site=sm6mepswww because exist rule: sitemeter.com
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete rule: sm6.sitemeter.com:80/js/counter.asp?site=sm6vfdown because exist rule: sitemeter.com
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete rule: sm7.sitemeter.com:80/js/counter.asp?site=sm7EasyHelp because exist rule: sitemeter.com
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete rule: sm7.sitemeter.com:80/js/counter.asp?site=sm7samaratour because exist rule: sitemeter.com
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete rule: sm8.sitemeter.com:80/js/counter.asp?site=sm8fpweb because exist rule: sitemeter.com
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete rule: sm9.sitemeter.com:80/js/counter.asp?site=sm9Ehw-Co because exist rule: sitemeter.com
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete rule: sj1.ru/cgi-bin/banner/grani140?321 because exist rule: sj1.ru
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete rule: ad.agava.tbn.ru/bb.cgi?cmd=ad&pubid=2838877&pg=1&r=js&ssi=nofillers&vbn=161&num=1&w=0&h=0&p=<center because exist rule: tbn.ru
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete rule: ad.text.tbn.ru/bb.cgi?cmd=ad&pubid=2826662&pg=2&vbn=350&num=1&w=468&h=15&nocache=3497 because exist rule: tbn.ru
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete rule: ad.yadro.ru/cgi-bin/iframe?60,7,10111 because exist rule: yadro.ru
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete rule: ad.yadro.ru:80/cgi-bin/iframe?60,7,40884 because exist rule: yadro.ru
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete rule: counter.yadro.ru because exist rule: yadro.ru
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete rule: counter.yadro.ru/logo?23.10 because exist rule: yadro.ru
2011-09-08 17:07:36 [1060] MAKE-CACHE: delete rule: counter.yadro.ru:80/hit;plus7?t26.6;rNot%20Your%20Business%21;s1024*768*32;0.00029461771386651847 because exist rule: yadro.ru
2011-09-08 17:07:36 [3320] Make-cache finished
2011-09-08 17:07:36 [3320] Load 2179 rules from /cygdrive/c/squid/etc/rejik/banners/urls.cache
2011-09-08 17:07:36 [3320] Load 8 pattern from BANNER pcre
2011-09-08 17:07:36 [3320] Load 22283 rules from /cygdrive/c/squid/etc/rejik/porno/urls.cache
2011-09-08 17:07:37 [3320] Load 5 pattern from MP3 pcre
2011-09-08 17:07:37 [3320] Load 1 rules from /cygdrive/c/squid/etc/rejik/js/urls.cache
2011-09-08 17:07:37 [3320] Redirector start and working (3.2.8)
2011-09-08 17:07:37 [3228] Run make-cache (3.2.8)
2011-09-08 17:07:37 [3228] Make-cache finished
2011-09-08 17:07:37 [3228] Load 2179 rules from /cygdrive/c/squid/etc/rejik/banners/urls.cache
2011-09-08 17:07:37 [3228] Load 8 pattern from BANNER pcre
2011-09-08 17:07:37 [3228] Load 22283 rules from /cygdrive/c/squid/etc/rejik/porno/urls.cache
2011-09-08 17:07:37 [3228] Load 5 pattern from MP3 pcre
2011-09-08 17:07:37 [3228] Load 1 rules from /cygdrive/c/squid/etc/rejik/js/urls.cache
2011-09-08 17:07:37 [3228] Redirector start and working (3.2.8)
2011-09-08 17:07:37 [2888] Run make-cache (3.2.8)
2011-09-08 17:07:37 [2888] Make-cache finished
2011-09-08 17:07:37 [2888] Load 2179 rules from /cygdrive/c/squid/etc/rejik/banners/urls.cache
2011-09-08 17:07:37 [2888] Load 8 pattern from BANNER pcre
2011-09-08 17:07:37 [2888] Load 22283 rules from /cygdrive/c/squid/etc/rejik/porno/urls.cache
2011-09-08 17:07:37 [2888] Load 5 pattern from MP3 pcre
2011-09-08 17:07:37 [2888] Load 1 rules from /cygdrive/c/squid/etc/rejik/js/urls.cache
2011-09-08 17:07:37 [2888] Redirector start and working (3.2.8)
2011-09-08 17:07:37 [2672] Run make-cache (3.2.8)
2011-09-08 17:07:37 [2672] Make-cache finished
2011-09-08 17:07:37 [2672] Load 2179 rules from /cygdrive/c/squid/etc/rejik/banners/urls.cache
2011-09-08 17:07:37 [2672] Load 8 pattern from BANNER pcre
2011-09-08 17:07:37 [2672] Load 22283 rules from /cygdrive/c/squid/etc/rejik/porno/urls.cache
2011-09-08 17:07:37 [2672] Load 5 pattern from MP3 pcre
2011-09-08 17:07:37 [2672] Load 1 rules from /cygdrive/c/squid/etc/rejik/js/urls.cache
2011-09-08 17:07:37 [2672] Redirector start and working (3.2.8)
2011-09-08 17:07:37 [2344] Run make-cache (3.2.8)
2011-09-08 17:07:37 [1264] Waiting for make-cache finished
2011-09-08 17:07:37 [2344] Make-cache finished
2011-09-08 17:07:37 [2344] Load 2179 rules from /cygdrive/c/squid/etc/rejik/banners/urls.cache
2011-09-08 17:07:37 [2344] Load 8 pattern from BANNER pcre
2011-09-08 17:07:37 [2344] Load 22283 rules from /cygdrive/c/squid/etc/rejik/porno/urls.cache
2011-09-08 17:07:37 [2344] Load 5 pattern from MP3 pcre
2011-09-08 17:07:37 [2344] Load 1 rules from /cygdrive/c/squid/etc/rejik/js/urls.cache
2011-09-08 17:07:37 [2344] Redirector start and working (3.2.8)
2011-09-08 17:07:37 [1264] Make-cache finished detected, continue
2011-09-08 17:07:37 [1264] Load 2179 rules from /cygdrive/c/squid/etc/rejik/banners/urls.cache
2011-09-08 17:07:37 [1264] Load 8 pattern from BANNER pcre
2011-09-08 17:07:37 [1264] Load 22283 rules from /cygdrive/c/squid/etc/rejik/porno/urls.cache
2011-09-08 17:07:37 [1264] Load 5 pattern from MP3 pcre
2011-09-08 17:07:37 [1264] Load 1 rules from /cygdrive/c/squid/etc/rejik/js/urls.cache
2011-09-08 17:07:37 [1264] Redirector start and working (3.2.8)
2011-09-08 17:07:37 [2588] Waiting for make-cache finished
2011-09-08 17:07:37 [2588] Make-cache finished detected, continue
2011-09-08 17:07:37 [2588] Load 2179 rules from /cygdrive/c/squid/etc/rejik/banners/urls.cache
2011-09-08 17:07:37 [2588] Load 8 pattern from BANNER pcre
2011-09-08 17:07:37 [2588] Load 22283 rules from /cygdrive/c/squid/etc/rejik/porno/urls.cache
2011-09-08 17:07:37 [2588] Load 5 pattern from MP3 pcre
2011-09-08 17:07:37 [2588] Load 1 rules from /cygdrive/c/squid/etc/rejik/js/urls.cache
2011-09-08 17:07:37 [2588] Redirector start and working (3.2.8)
2011-09-08 17:07:37 [2660] Waiting for make-cache finished
2011-09-08 17:07:37 [2660] Make-cache finished detected, continue
2011-09-08 17:07:37 [2660] Load 2179 rules from /cygdrive/c/squid/etc/rejik/banners/urls.cache
2011-09-08 17:07:37 [3424] Waiting for make-cache finished
2011-09-08 17:07:37 [3424] Make-cache finished detected, continue
2011-09-08 17:07:37 [3424] Load 2179 rules from /cygdrive/c/squid/etc/rejik/banners/urls.cache
2011-09-08 17:07:37 [3424] Load 8 pattern from BANNER pcre
2011-09-08 17:07:37 [3424] Load 22283 rules from /cygdrive/c/squid/etc/rejik/porno/urls.cache
2011-09-08 17:07:37 [3424] Load 5 pattern from MP3 pcre
2011-09-08 17:07:37 [3424] Load 1 rules from /cygdrive/c/squid/etc/rejik/js/urls.cache
2011-09-08 17:07:37 [3424] Redirector start and working (3.2.8)
2011-09-08 17:07:37 [2660] Load 8 pattern from BANNER pcre
2011-09-08 17:07:37 [2660] Load 22283 rules from /cygdrive/c/squid/etc/rejik/porno/urls.cache
2011-09-08 17:07:37 [1476] Waiting for make-cache finished
2011-09-08 17:07:37 [1476] Make-cache finished detected, continue
2011-09-08 17:07:37 [1476] Load 2179 rules from /cygdrive/c/squid/etc/rejik/banners/urls.cache
2011-09-08 17:07:37 [1476] Load 8 pattern from BANNER pcre
2011-09-08 17:07:37 [1476] Load 22283 rules from /cygdrive/c/squid/etc/rejik/porno/urls.cache
2011-09-08 17:07:37 [1476] Load 5 pattern from MP3 pcre
2011-09-08 17:07:37 [1476] Load 1 rules from /cygdrive/c/squid/etc/rejik/js/urls.cache
2011-09-08 17:07:37 [1476] Redirector start and working (3.2.8)
2011-09-08 17:07:37 [2660] Load 5 pattern from MP3 pcre
2011-09-08 17:07:37 [2660] Load 1 rules from /cygdrive/c/squid/etc/rejik/js/urls.cache
2011-09-08 17:07:37 [2660] Redirector start and working (3.2.8)
2011-09-08 17:07:37 [2500] Waiting for make-cache finished
2011-09-08 17:07:37 [2500] Make-cache finished detected, continue
2011-09-08 17:07:37 [2500] Load 2179 rules from /cygdrive/c/squid/etc/rejik/banners/urls.cache
2011-09-08 17:07:37 [2500] Load 8 pattern from BANNER pcre
2011-09-08 17:07:37 [2500] Load 22283 rules from /cygdrive/c/squid/etc/rejik/porno/urls.cache
2011-09-08 17:07:37 [2500] Load 5 pattern from MP3 pcre
2011-09-08 17:07:37 [2500] Load 1 rules from /cygdrive/c/squid/etc/rejik/js/urls.cache
2011-09-08 17:07:37 [2500] Redirector start and working (3.2.8)
2011-09-08 17:07:37 [1532] Waiting for make-cache finished
2011-09-08 17:07:37 [3176] Waiting for make-cache finished
2011-09-08 17:07:37 [1532] Make-cache finished detected, continue
2011-09-08 17:07:37 [3176] Make-cache finished detected, continue
2011-09-08 17:07:37 [1532] Load 2179 rules from /cygdrive/c/squid/etc/rejik/banners/urls.cache
2011-09-08 17:07:37 [3176] Load 2179 rules from /cygdrive/c/squid/etc/rejik/banners/urls.cache
2011-09-08 17:07:37 [1532] Load 8 pattern from BANNER pcre
2011-09-08 17:07:37 [3176] Load 8 pattern from BANNER pcre
2011-09-08 17:07:37 [1532] Load 22283 rules from /cygdrive/c/squid/etc/rejik/porno/urls.cache
2011-09-08 17:07:37 [3176] Load 22283 rules from /cygdrive/c/squid/etc/rejik/porno/urls.cache
2011-09-08 17:07:37 [1532] Load 5 pattern from MP3 pcre
2011-09-08 17:07:37 [3176] Load 5 pattern from MP3 pcre
2011-09-08 17:07:37 [1532] Load 1 rules from /cygdrive/c/squid/etc/rejik/js/urls.cache
2011-09-08 17:07:37 [3176] Load 1 rules from /cygdrive/c/squid/etc/rejik/js/urls.cache
2011-09-08 17:07:37 [1532] Redirector start and working (3.2.8)
2011-09-08 17:07:37 [3176] Redirector start and working (3.2.8)
2011-09-08 17:07:37 [3204] Waiting for make-cache finished
2011-09-08 17:07:37 [3204] Make-cache finished detected, continue
2011-09-08 17:07:37 [3204] Load 2179 rules from /cygdrive/c/squid/etc/rejik/banners/urls.cache
2011-09-08 17:07:37 [3204] Load 8 pattern from BANNER pcre
2011-09-08 17:07:37 [3204] Load 22283 rules from /cygdrive/c/squid/etc/rejik/porno/urls.cache
2011-09-08 17:07:37 [3204] Load 5 pattern from MP3 pcre
2011-09-08 17:07:37 [3204] Load 1 rules from /cygdrive/c/squid/etc/rejik/js/urls.cache
2011-09-08 17:07:37 [3204] Redirector start and working (3.2.8)
2011-09-08 17:07:37 [696] Waiting for make-cache finished
2011-09-08 17:07:37 [696] Make-cache finished detected, continue
2011-09-08 17:07:37 [696] Load 2179 rules from /cygdrive/c/squid/etc/rejik/banners/urls.cache
2011-09-08 17:07:37 [696] Load 8 pattern from BANNER pcre
2011-09-08 17:07:37 [696] Load 22283 rules from /cygdrive/c/squid/etc/rejik/porno/urls.cache
2011-09-08 17:07:37 [696] Load 5 pattern from MP3 pcre
2011-09-08 17:07:37 [696] Load 1 rules from /cygdrive/c/squid/etc/rejik/js/urls.cache
2011-09-08 17:07:37 [696] Redirector start and working (3.2.8)
2011-09-08 17:07:38 [3268] Waiting for make-cache finished
2011-09-08 17:07:38 [3268] Make-cache finished detected, continue
2011-09-08 17:07:38 [3268] Load 2179 rules from /cygdrive/c/squid/etc/rejik/banners/urls.cache
2011-09-08 17:07:38 [3268] Load 8 pattern from BANNER pcre
2011-09-08 17:07:38 [3268] Load 22283 rules from /cygdrive/c/squid/etc/rejik/porno/urls.cache
2011-09-08 17:07:38 [3268] Load 5 pattern from MP3 pcre
2011-09-08 17:07:38 [3268] Load 1 rules from /cygdrive/c/squid/etc/rejik/js/urls.cache
2011-09-08 17:07:38 [3268] Redirector start and working (3.2.8)
2011-09-08 17:07:38 [2924] Waiting for make-cache finished
2011-09-08 17:07:38 [2924] Make-cache finished detected, continue
2011-09-08 17:07:38 [2924] Load 2179 rules from /cygdrive/c/squid/etc/rejik/banners/urls.cache
2011-09-08 17:07:38 [2924] Load 8 pattern from BANNER pcre
2011-09-08 17:07:38 [2924] Load 22283 rules from /cygdrive/c/squid/etc/rejik/porno/urls.cache
2011-09-08 17:07:38 [2924] Load 5 pattern from MP3 pcre
2011-09-08 17:07:38 [2924] Load 1 rules from /cygdrive/c/squid/etc/rejik/js/urls.cache
2011-09-08 17:07:38 [2924] Redirector start and working (3.2.8)
2011-09-08 17:07:38 [3152] Waiting for make-cache finished
2011-09-08 17:07:38 [3152] Make-cache finished detected, continue
2011-09-08 17:07:38 [3152] Load 2179 rules from /cygdrive/c/squid/etc/rejik/banners/urls.cache
2011-09-08 17:07:38 [3152] Load 8 pattern from BANNER pcre
2011-09-08 17:07:38 [3152] Load 22283 rules from /cygdrive/c/squid/etc/rejik/porno/urls.cache
2011-09-08 17:07:38 [3152] Load 5 pattern from MP3 pcre
2011-09-08 17:07:38 [3152] Load 1 rules from /cygdrive/c/squid/etc/rejik/js/urls.cache
2011-09-08 17:07:38 [3152] Redirector start and working (3.2.8)
2011-09-08 17:07:38 [648] Waiting for make-cache finished
2011-09-08 17:07:38 [648] Make-cache finished detected, continue
2011-09-08 17:07:38 [648] Load 2179 rules from /cygdrive/c/squid/etc/rejik/banners/urls.cache
2011-09-08 17:07:38 [648] Load 8 pattern from BANNER pcre
2011-09-08 17:07:38 [648] Load 22283 rules from /cygdrive/c/squid/etc/rejik/porno/urls.cache
2011-09-08 17:07:38 [648] Load 5 pattern from MP3 pcre
2011-09-08 17:07:38 [648] Load 1 rules from /cygdrive/c/squid/etc/rejik/js/urls.cache
2011-09-08 17:07:38 [648] Redirector start and working (3.2.8)
2011-09-08 17:07:38 [2408] Waiting for make-cache finished
2011-09-08 17:07:38 [2408] Make-cache finished detected, continue
2011-09-08 17:07:38 [2408] Load 2179 rules from /cygdrive/c/squid/etc/rejik/banners/urls.cache
2011-09-08 17:07:38 [2408] Load 8 pattern from BANNER pcre
2011-09-08 17:07:38 [2408] Load 22283 rules from /cygdrive/c/squid/etc/rejik/porno/urls.cache
2011-09-08 17:07:38 [2408] Load 5 pattern from MP3 pcre
2011-09-08 17:07:38 [2408] Load 1 rules from /cygdrive/c/squid/etc/rejik/js/urls.cache
2011-09-08 17:07:38 [2408] Redirector start and working (3.2.8)

Slava
Site Admin
Сообщения: 2251
Зарегистрирован: Пт апр 02, 2004 12:34
Контактная информация:

Re: squid + rejik win32 - странная загрузка процессора

Сообщение Slava »

Проблема с локами на сервере: MAKE-CACHE: ERROR: fcntl return error: Resource deadlock avoided
Можно попробовать:
1. Остановить сквид и убедиться, что все редиректоры завершились.
2. Удалить lock файл из папки первой секции.
3. Запустить
4. Проверить, наличии ошибки в логе

Если не поможет, то тоже самое с перезагрузкой сервера.

Может быть каких-то прав не хватает?
Если запустить режик вручную, пишет ту-же ошибку?
Запустить от администратора?

alk
Сообщения: 12
Зарегистрирован: Вт май 10, 2005 18:35

Re: squid + rejik win32 - странная загрузка процессора

Сообщение alk »

Да, удаление lock.file кажется решило все проблемы. Журнал выглядит теперь красиво, нагрузки нет.
Спасибо большое за оперативную помощь.
Еще один микро-вопрос заодно. Строки в redirector.err типа
2011-09-09 08:21:40 [2588] REDIRECTOR: WARNING: Can't parse url: http://s.youtube.com/s?md=1&cid=319133&csipt=watch5...
2011-09-09 10:16:34 [2588] REDIRECTOR: WARNING: Can't parse url: http://www.facebook.com/extern/login_st ... p?api_key=....
(очень длинная строка URL, более 1000 символов)
появляются оттого, что у rejik есть ограничение на длину обрабатываемой строки?

Slava
Site Admin
Сообщения: 2251
Зарегистрирован: Пт апр 02, 2004 12:34
Контактная информация:

Re: squid + rejik win32 - странная загрузка процессора

Сообщение Slava »

Вероятно да, но ограничение на длину не единственная возможность.

alk
Сообщения: 12
Зарегистрирован: Вт май 10, 2005 18:35

Re: squid + rejik win32 - странная загрузка процессора

Сообщение alk »

Вы хотите сказать - не единственная причина?
Я не ставил никаких ограничений для доступа пользователей, строки редиректором не обрабатываются, судя по журналу.
Означают ли эти сообщения в журнале, что редиректор их пропускает сквозь себя нетронутыми или наоборот, пользователям не отдает?

Slava
Site Admin
Сообщения: 2251
Зарегистрирован: Пт апр 02, 2004 12:34
Контактная информация:

Re: squid + rejik win32 - странная загрузка процессора

Сообщение Slava »

Да, не единственная причина.
Если урл не попадет под шаблон, то он также признается не распрсенным.
Если режик не может распарсить урл, то он его пропускает, не блокирует.

alk
Сообщения: 12
Зарегистрирован: Вт май 10, 2005 18:35

Re: squid + rejik win32 - странная загрузка процессора

Сообщение alk »

спасибо, ясно.

alk
Сообщения: 12
Зарегистрирован: Вт май 10, 2005 18:35

Re: squid + rejik win32 - странная загрузка процессора

Сообщение alk »

К сожалению, проблема продолжает беспокоить. При каждой перезагрузке сервера, штатной, не аварийной, всё возобновляется. Я заметил, что остановка сквида или перезагрузка компьютера не приводит к удалению файла lock.file в папке banners. При запуске сквида этот файл также никем не удаляется и, видимо, создает вышеописанную проблему.
В redirector.err висят строки
2012-01-16 12:24:36 [3088] Waiting for make-cache finished
суммарная нагрузка от redirector.exe высокая.

Slava
Site Admin
Сообщения: 2251
Зарегистрирован: Пт апр 02, 2004 12:34
Контактная информация:

Re: squid + rejik win32 - странная загрузка процессора

Сообщение Slava »

Права на лоск разрешают удалить его пользователю сквида?
Попробуйте удалить файл вручную.
Остановить сквид и удалить файл.
При остановке сквида, все процессы редиректора завершаются?

alk
Сообщения: 12
Зарегистрирован: Вт май 10, 2005 18:35

Re: squid + rejik win32 - странная загрузка процессора

Сообщение alk »

У меня обычный Windows XP, сквид это служба, запускающаяся от имени системы. Конечно, ей всё можно.
Я пробовал удалять файл вручную, делал всё, что Вы мне перечисляли. До недавних пор этого было достаточно, хотя, честно говоря, утомительно, хорошо хоть перезагружаю я сервер не часто. Сегодня это не помогло, правда, я сервер не перезагружал, но до сегодняшнего дня это и не требовалось. Сейчас перезагрузить не могу, где-то через час получится. В любом случае, непонятно, почему остается lock.file в папке banners. Как добиться того,чтобы сквид в связке с режиком работал более стабильно и это не зависело от любой перезагрузки или возможного падения и последующего перезапуска сквида?

Slava
Site Admin
Сообщения: 2251
Зарегистрирован: Пт апр 02, 2004 12:34
Контактная информация:

Re: squid + rejik win32 - странная загрузка процессора

Сообщение Slava »

Файл lock.file не должен исчезать.
На него вешается системный лок, по которому редиректоры определяют, создает ли какой-то процесс кеш фалы или нет.

Видимо что-то не так системе локов...
Можно попробовать избежать такого поведения, не запуская редиректор, без создания кеша.
Потестируйте следующее:
1. Остановите сквид, прибейте все остаточные процессы редиректора и make-cache, если они есть.
2. Удалите все make-cache файлы.
3. Запустите make-cache и дождитесь его завершения.
4. Запустите сквид.

Если нагрузки не будет, значит получилось.
В этом случае, после модификации бан листов, сначала запускайте make-cache, и только после этого, перезапускайте сквид.

Ответить