|
|
|
|
|
|
| Author |
Message |
Stéphane Ascoët
*nix forums beginner
Joined: 01 Jan 2002
Posts: 1
|
 Posted: Tue Jan 01, 2002 1:15 am Post subject:
Re: making squid not cache specific web sites
|
|
|
|But I dont think that is what I am looking for. I want squid to not cache
|www.unitedstreaming.com/www5.unitedstreaming.com/admin.unitedstreaming.com. It
|looks like that faq is for setting up extra servers for caching. How could I
|make this work? Remember I am new to Squid so be gentle:-}
We are gentle but tired of answering such questions. If you had read down in the FAQ, you would have find "4.20 Can I make Squid proxy only, without caching anything? " |
|
| Back to top |
|
 |
Elsen Marc
*nix forums Guru Wannabe
Joined: 01 Feb 2005
Posts: 202
|
| Posted: Tue Feb 01, 2005 6:33 am Post subject:
RE: squid child process extended
|
|
|
| Quote: | hi list today i get this in /var/log/messages
Feb 1 11:40:04 Mcache squid[1318]: Squid Parent: child process 9501
exited with status 1
Feb 1 11:40:07 Mcache squid[1318]: Squid Parent: child
process 9503 started
Feb 1 11:40:07 Mcache squid[1318]: Squid Parent: child process 9503
exited with status 1
Feb 1 11:40:10 Mcache squid[1318]: Squid Parent: child
process 9505 started
Feb 1 11:40:10 Mcache squid[1318]: Squid Parent: child process 9505
exited with status 1
Feb 1 11:40:13 Mcache squid[1318]: Squid Parent: child
process 9507 started
Feb 1 11:40:13 Mcache squid[1318]: Squid Parent: child process 9507
exited with status 1
Feb 1 11:40:13 Mcache squid[1318]: Exiting due to repeated, frequent
failures
|
Check cache.log for more info.
| Quote: |
i google for it but didn't find anything can someone tell me why this
happen and how to stop squid using all the partition , coz df -lh
showing that squid is using one of cache directory 99%.
how to delete objects from cache dir ? (safe way)
is it simple like rm * ?
|
Specify appropriate size(s), for the cache dir(s), taking into
account available disk (partition) space.
Squid will maintain those sizes automatically and no user
intervention is needed.
'rm *' is evil , and will lead to swap failures as then there will
be a mismatch with what squid thinks is in the cache and which objects
are effectively still there,
(info which is maintained in the swap.state file(s))
M. |
|
| Back to top |
|
|
Elsen Marc
*nix forums Guru Wannabe
Joined: 01 Feb 2005
Posts: 202
|
| Posted: Tue Feb 01, 2005 6:42 am Post subject:
RE: NNTP protocol port 119 throuh squid
|
|
|
| Quote: |
Hello,
i won't to use NNTP news protocol port 119.
How can i get NNTP through Squid.
|
http://www.squid-cache.org/Doc/FAQ/FAQ-1.html#ss1.1
Squid deals with http proxy-ing (only).
M. |
|
| Back to top |
|
|
Askar
*nix forums addict
Joined: 01 Feb 2005
Posts: 72
|
| Posted: Tue Feb 01, 2005 7:17 am Post subject:
Re: squid child process extended
|
|
|
Elsen Marc wrote:
| Quote: |
hi list today i get this in /var/log/messages
Feb 1 11:40:04 Mcache squid[1318]: Squid Parent: child process 9501
exited with status 1
Feb 1 11:40:07 Mcache squid[1318]: Squid Parent: child
process 9503 started
Feb 1 11:40:07 Mcache squid[1318]: Squid Parent: child process 9503
exited with status 1
Feb 1 11:40:10 Mcache squid[1318]: Squid Parent: child
process 9505 started
Feb 1 11:40:10 Mcache squid[1318]: Squid Parent: child process 9505
exited with status 1
Feb 1 11:40:13 Mcache squid[1318]: Squid Parent: child
process 9507 started
Feb 1 11:40:13 Mcache squid[1318]: Squid Parent: child process 9507
exited with status 1
Feb 1 11:40:13 Mcache squid[1318]: Exiting due to repeated, frequent
failures
Check cache.log for more info.
i google for it but didn't find anything can someone tell me why this
happen and how to stop squid using all the partition , coz df -lh
showing that squid is using one of cache directory 99%.
how to delete objects from cache dir ? (safe way)
is it simple like rm * ?
Specify appropriate size(s), for the cache dir(s), taking into
account available disk (partition) space.
Squid will maintain those sizes automatically and no user
intervention is needed.
'rm *' is evil , and will lead to swap failures as then there will
be a mismatch with what squid thinks is in the cache and which objects
are effectively still there,
(info which is maintained in the swap.state file(s))
M.
right, cache partition size is 15gb and we have created .... |
cache_dir diskd /cache2/cache1 7500
cache_dir diskd /cache2/cache2 7500
Is this fine? or we have to leave some space on cache2 partition ,
currently 7500 + 7500 = 15000 all the partition space
what is the good partice?
thanks and regards |
|
| Back to top |
|
|
Elsen Marc
*nix forums Guru Wannabe
Joined: 01 Feb 2005
Posts: 202
|
| Posted: Tue Feb 01, 2005 7:19 am Post subject:
RE: squid child process extended
|
|
|
| Quote: | right, cache partition size is 15gb and we have created ....
cache_dir diskd /cache2/cache1 7500
cache_dir diskd /cache2/cache2 7500
Is this fine? or we have to leave some space on cache2 partition ,
currently 7500 + 7500 = 15000 all the partition space
what is the good partice?
|
I would advise to only specify one cachedir per partition, it does not make
much sense to define two, in performance terms (e.g).
Then make it somewhat smaller as the available partition size
and you will be fine as in :
cache_dir diskd /cache2/total_cache 13000
Note that squid by itself will keep some free space
within the specified cache dir.
These values are controlled by :
cache_swap_low
and
cache_swap_high
settings; check squid.conf.default (comments), for further explanations.
M. |
|
| Back to top |
|
|
forgetful tan
*nix forums beginner
Joined: 01 Feb 2005
Posts: 6
|
| Posted: Tue Feb 01, 2005 7:26 am Post subject:
Re: squid child process extended
|
|
|
Askar wrote:
| Quote: | Elsen Marc wrote:
hi list today i get this in /var/log/messages
Feb 1 11:40:04 Mcache squid[1318]: Squid Parent: child process 9501
exited with status 1
Feb 1 11:40:07 Mcache squid[1318]: Squid Parent: child process 9503
started
Feb 1 11:40:07 Mcache squid[1318]: Squid Parent: child process 9503
exited with status 1
Feb 1 11:40:10 Mcache squid[1318]: Squid Parent: child process 9505
started
Feb 1 11:40:10 Mcache squid[1318]: Squid Parent: child process 9505
exited with status 1
Feb 1 11:40:13 Mcache squid[1318]: Squid Parent: child process 9507
started
Feb 1 11:40:13 Mcache squid[1318]: Squid Parent: child process 9507
exited with status 1
Feb 1 11:40:13 Mcache squid[1318]: Exiting due to repeated,
frequent failures
Check cache.log for more info.
i google for it but didn't find anything can someone tell me why
this happen and how to stop squid using all the partition , coz df
-lh showing that squid is using one of cache directory 99%.
how to delete objects from cache dir ? (safe way)
is it simple like rm * ?
Specify appropriate size(s), for the cache dir(s), taking into
account available disk (partition) space.
Squid will maintain those sizes automatically and no user
intervention is needed.
'rm *' is evil , and will lead to swap failures as then there will
be a mismatch with what squid thinks is in the cache and which objects
are effectively still there,
(info which is maintained in the swap.state file(s))
M.
right, cache partition size is 15gb and we have created ....
cache_dir diskd /cache2/cache1 7500
cache_dir diskd /cache2/cache2 7500
Is this fine? or we have to leave some space on cache2 partition ,
currently 7500 + 7500 = 15000 all the partition space
|
there are other disk space usage in the cache_dir, for example the
swap.state and it's backup files. In my exprience, 90% is a good value.
and you don't have to set 2 diskd in the same physical disk. Try to use
two small disk instead of a large one. That would give you better disk
throughput.
| Quote: | what is the good partice?
thanks and regards
|
|
|
| Back to top |
|
|
K. Yntema
*nix forums beginner
Joined: 01 Feb 2005
Posts: 2
|
| Posted: Tue Feb 01, 2005 7:51 am Post subject:
RE: NNTP protocol port 119 throuh squid
|
|
|
| Quote: |
I've already read the FAQ. I know that, but squid doesn't let the
NNTP
protocol through.
So i can't use any news server any more. I want squid to stay
off NNTP.
Squid doesn't need to proxy NNTP. Just let it through.
Can't i do it with always_direct?
Squid isn't a firewall product.
As stated, it does not understand nntp, and deals with
http proxying only.
M.
|
When i shutdown Squid i can use NNTP and have no problems, but when
squid is started I can't make a NNTP connection So squid blocks the
NNTP protocol.
Klaas |
|
| Back to top |
|
|
Norio Korekawa
*nix forums beginner
Joined: 01 Feb 2005
Posts: 2
|
| Posted: Tue Feb 01, 2005 8:14 am Post subject:
Re: question on external_acl_type
|
|
|
Hello again Henrik,
To be exact, I also have to remove %DST to realize what I expect.
If %DST remains, the helper is still called every time the user
accesses different hosts...
Thanks again.
Regards,
Norio
| Quote: | Henrik,
Thank you so much! Your answer did help me a lot and I could
understand what the problem was! As you advised, I could solve
the problem by removing %{Referer} from the external_acl_type
statement below.
In fact, I just added %{Referer} and some other arguments to
leave them as logs of the helper...
Thanks again.
Regards,
Norio
On Mon, 31 Jan 2005, Norio Korekawa wrote:
external_acl_type myacltype %LOGIN %SRC %DST %{Referer} %{User-Agent} /usr/lib/squid/myaclhelper.pl
acl myacl external myacltype
It seems that myaclhelper.pl is called by squid, every time new URL
is accessed, but is this correct action?
To be precise the helper is called for every new unique combination of the
arguments
%LOGIN %SRC %DST %{Referer} %{User-Agent}
As you include Referer this means that the helper will be called pretty
much for every unique link your users click on or otherwise implicitly
accesses (including each inlined objects) during the ttl.
The helper is called for every unique combination of the arguments sent to
it.
so it's not exacly each link.. but I think you get the picture if you look
at the arguments
If you limit yourself to not sent %{Referer} then the helper will be
called for every unique site each user visits, or twice if the user uses
two different web browsers.
I think my squid.conf has some problems, but I don't know what they are...
More likely a slight misunderstanding on how the external_acl helpers
work, or what is included in the Referer and/or User-Agent HTTP headers.
Regards
Henrik |
|
|
| Back to top |
|
|
Kinkie
*nix forums Guru Wannabe
Joined: 01 Feb 2005
Posts: 106
|
| Posted: Tue Feb 01, 2005 8:43 am Post subject:
Re: cache direcotry full
|
|
|
On Tue, 2005-02-01 at 12:39 +0500, Askar wrote:
| Quote: | hi list df -lh showing 100% for one of /cache directory , how to manage
this ?
|
Decrease the cache_dir size by about 20% (to allow for overhead) and
restart squid. |
|
| Back to top |
|
|
Elsen Marc
*nix forums Guru Wannabe
Joined: 01 Feb 2005
Posts: 202
|
| Posted: Tue Feb 01, 2005 8:54 am Post subject:
RE: Re: Squid Sizing and other things
|
|
|
| Quote: | ...
...
I have read some of the discussions about RAID and Squid, and
I think that this
is a good setup for two reasons:
The System itself is running over the stripe set and also the
Virusscan Proxy
will benefit from the StripeSet Performance gain.
|
http://www.squid-cache.org/Doc/FAQ/FAQ-3.html#ss3.11
M. |
|
| Back to top |
|
|
Matus UHLAR - fantomas
*nix forums Guru
Joined: 21 Feb 2005
Posts: 430
|
| Posted: Tue Feb 01, 2005 9:11 am Post subject:
Re: NNTP protocol port 119 throuh squid
|
|
|
On 01.02 08:32, K. Yntema wrote:
| Quote: | i won't to use NNTP news protocol port 119.
How can i get NNTP through Squid.
|
Iff your NNTP readers can use HTTPS proxy, you just have to allow
method CONNECT to port 119.
Can't you just allow port 119 on firewall? You will get the same result,
but it will be more effective.
--
Matus UHLAR - fantomas, uhlar@fantomas.sk ; http://www.fantomas.sk/
Warning: I wish NOT to receive e-mail advertising to this address.
Varovanie: na tuto adresu chcem NEDOSTAVAT akukolvek reklamnu postu.
"Where do you want to go to die?" [Microsoft] |
|
| Back to top |
|
|
Maik Ihde
*nix forums beginner
Joined: 01 Feb 2005
Posts: 8
|
| Posted: Tue Feb 01, 2005 9:38 am Post subject:
Re: Squid Sizing and other things
|
|
|
Matus UHLAR - fantomas <uhlar <at> fantomas.sk> writes:
| Quote: | Do not use stripping for squid caches. squid has its own way for using
multiple drives, which is safer and more effective.
|
I have read some of the discussions about RAID and Squid, and I think that this
is a good setup for two reasons:
The System itself is running over the stripe set and also the Virusscan Proxy
will benefit from the StripeSet Performance gain.
| Quote: | Use sepatate drives, filesystems and cache dirs.
Kernel and system may be on separate drived or raid1 (mirror) for safety
|
There are only 2 drives in these 1U Pizzaboxes we use. So Raid 1 would have been
an option if we wanted to go for availability. We are using Kickstart and a
homemade perl script to set these machines up, so if one of the drives fails we
loose the cache, but we can do a reinstall in about 15 Minutes.
| Quote: | have the other configured as neighbour cache and on both the parent is
the VirusWall (3.81), which is also installed on the Squid Boxes.
You should use aufs on linux, it behaves better than diskd.
|
Aha. Interesting, can you point me somewhere to find more information about
this? I think I read something that diskd was more stable than aufs or so?
Kind Regards and thanks for your ideas!
Maik |
|
| Back to top |
|
|
Askar
*nix forums addict
Joined: 01 Feb 2005
Posts: 72
|
| Posted: Tue Feb 01, 2005 9:51 am Post subject:
Re: squid child process extended
|
|
|
Elsen Marc wrote:
| Quote: |
right, cache partition size is 15gb and we have created ....
cache_dir diskd /cache2/cache1 7500
cache_dir diskd /cache2/cache2 7500
Is this fine? or we have to leave some space on cache2 partition ,
currently 7500 + 7500 = 15000 all the partition space
what is the good partice?
I would advise to only specify one cachedir per partition, it does not make
much sense to define two, in performance terms (e.g).
Then make it somewhat smaller as the available partition size
and you will be fine as in :
cache_dir diskd /cache2/total_cache 13000
Note that squid by itself will keep some free space
within the specified cache dir.
These values are controlled by :
cache_swap_low
and
cache_swap_high
settings; check squid.conf.default (comments), for further explanations.
M.
alright I got the point atm what i did is to decrease the cache_dir size |
and restart the squid. However now im thinking about to create a single
cache directory on a single partition but duno howto do this, im pasting
the output of df and cache_dir lines from squid.conf hopes someone from
list suggest a smooth way out to single cache directory per partition.
#df -lh
/dev/sda2 16G 15G 991M 94% /cache1
/dev/sda6 15G 14G 1015M 94% /cache2
/dev/sdb1 16G 15G 1.5G 91% /cache3
/dev/sdb3 16G 15G 1.8G 89% /cache4
#vi /usr/local/squid/etc/squid.conf
cache_dir diskd /cache1/cache1 7500 32 512 Q1=72 Q2=66 Q1=72 Q2=64
cache_dir diskd /cache1/cache2 7500 32 512 Q1=72 Q2=66 Q1=72 Q2=64
cache_dir diskd /cache2/cache1 7000 32 512 Q1=72 Q2=66 Q1=72 Q2=64
cache_dir diskd /cache2/cache2 7000 32 512 Q1=72 Q2=66 Q1=72 Q2=64
cache_dir diskd /cache3/cache1 7500 32 512 Q1=72 Q2=66 Q1=72 Q2=64
cache_dir diskd /cache3/cache2 7500 32 512 Q1=72 Q2=66 Q1=72 Q2=64
cache_dir diskd /cache4/cache1 7500 32 512 Q1=72 Q2=66 Q1=72 Q2=64
cache_dir diskd /cache4/cache2 7500 32 512 Q1=72 Q2=66 Q1=72 Q2=64
store_dir_select_algorithm round-robin
1) To create a single cache direcotry / partition (as you suggested)
3) would i have to loose my stored cache?
2) Is this beneficial to use "Q1=72 Q2=66 Q1=72 Q2=64" things with diskd ?
Thanks and regards |
|
| Back to top |
|
|
Elsen Marc
*nix forums Guru Wannabe
Joined: 01 Feb 2005
Posts: 202
|
| Posted: Tue Feb 01, 2005 11:08 am Post subject:
RE: squid child process extended
|
|
|
| Quote: | alright I got the point atm what i did is to decrease the
cache_dir size
and restart the squid. However now im thinking about to
create a single
cache directory on a single partition but duno howto do this,
im pasting
the output of df and cache_dir lines from squid.conf hopes
someone from
list suggest a smooth way out to single cache directory per partition.
#df -lh
/dev/sda2 16G 15G 991M 94% /cache1
/dev/sda6 15G 14G 1015M 94% /cache2
/dev/sdb1 16G 15G 1.5G 91% /cache3
/dev/sdb3 16G 15G 1.8G 89% /cache4
#vi /usr/local/squid/etc/squid.conf
cache_dir diskd /cache1/cache1 7500 32 512 Q1=72 Q2=66 Q1=72 Q2=64
cache_dir diskd /cache1/cache2 7500 32 512 Q1=72 Q2=66 Q1=72 Q2=64
cache_dir diskd /cache2/cache1 7000 32 512 Q1=72 Q2=66 Q1=72 Q2=64
cache_dir diskd /cache2/cache2 7000 32 512 Q1=72 Q2=66 Q1=72 Q2=64
cache_dir diskd /cache3/cache1 7500 32 512 Q1=72 Q2=66 Q1=72 Q2=64
cache_dir diskd /cache3/cache2 7500 32 512 Q1=72 Q2=66 Q1=72 Q2=64
cache_dir diskd /cache4/cache1 7500 32 512 Q1=72 Q2=66 Q1=72 Q2=64
cache_dir diskd /cache4/cache2 7500 32 512 Q1=72 Q2=66 Q1=72 Q2=64
store_dir_select_algorithm round-robin
|
Try to have a look, at your cache dir sizing requirements too.
Don't just configure cache dirs.
The rule of thumb is to take a total cache dir value which
roughly corresponds to one week of traffic generated by your users.
Excessive oversized configuration(s) in terms of cache dir size(s),
will give :
- no additional benefit in terms of squid efficiency.
- put demand on needed system RAM (check the FAQ)
| Quote: |
1) To create a single cache direcotry / partition (as you suggested)
|
I guess remove the double entry for each partition and choose
a relevant size relative to the partition size. Keep some spare
for overhead as already suggested.
| Quote: | 3) would i have to loose my stored cache?
|
In this case, I guess so. But the long term impact is very low.
| Quote: | 2) Is this beneficial to use "Q1=72 Q2=66 Q1=72 Q2=64" things
with diskd ?
|
Hm, not sure. There is a FAQ entry for diskd , check further over there.
M. |
|
| Back to top |
|
|
Pablo Romero
*nix forums beginner
Joined: 01 Feb 2005
Posts: 1
|
| Posted: Tue Feb 01, 2005 11:10 am Post subject:
Squid 2.5 Stable6 doesn't match subdomains
|
|
|
Hello
I am running Squid 2.5Stable6, created an acl like this:
====================================
acl deniedsites dstdomain "/usr/local/squid/blacklists/porn"
http_access deny deniedsites
====================================
The porn file contains entries like:
playboy.com
penthouse.com
When I test the ACL trying to browse http://www.playboy.com, squid doesn't
block the site, but when I go to http://playboy.com, then the site gets
blocked. This means Squid is not matching subdomains.
I installed Squid 2.2 Stable 5, created the same acl, used the same porn
file and the ACL worked. My Question: Is there and option I have to set for
squid 2.5Stable6 match the subdomains?
Hope you can help guys
Regards
Pablo Romero
_________________________________________________________________
Express yourself instantly with MSN Messenger! Download today it's FREE!
http://messenger.msn.click-url.com/go/onm00200471ave/direct/01/ |
|
| Back to top |
|
|
Google
|
|
| Back to top |
|
|
|
|
The time now is Tue Dec 02, 2008 6:27 am | All times are GMT
|
|
Loan Consolidation | Mortgage Calculator | Advertising | Mortgages | Landscape Photos
|
|
Copyright © 2004-2005 DeniX Solutions SRL
|
|
|
|
Other DeniX Solutions sites:
Unix/Linux blog |
electronics forum |
medicine forum |
science forum |
|
|
Privacy Policy
|
Powered by phpBB © 2001, 2005 phpBB Group
|
|
FAQ
Search
Memberlist
Usergroups
Register
Profile
Log in to check your private messages
Log in
Forum index
»
Apps
»
Squid
