Netgate m1n1wall

Author Topic: squid 2.7.4 with aufs support?  (Read 2478 times)

0 Members and 1 Guest are viewing this topic.

Offline Netview

  • Jr. Member
  • **
  • Posts: 30
    • View Profile
squid 2.7.4 with aufs support?
« on: August 21, 2008, 02:28:42 pm »
Hi!

I would like to test the actual squid-2.7.4 with aufs support. Has Anybody compiled this version for pfsense 1.2.1-Beta (I need only the binaries)?

regards
Netview

I know, that somebody is working hard on squid-3.0.8, but I think that 2.7.x is more stabil.

Offline Tikimotel

  • Full Member
  • ***
  • Posts: 157
    • View Profile
Re: squid 2.7.4 with aufs support?
« Reply #1 on: August 23, 2008, 04:09:44 am »
Isn't squid a package? try the package topic in the main forum.

Offline Netview

  • Jr. Member
  • **
  • Posts: 30
    • View Profile
Re: squid 2.7.4 with aufs support?
« Reply #2 on: August 23, 2008, 09:30:12 am »
Okay!

If somebody is interested - I have build a package for pfsense 1.2 with squid 2.7.4:

Quote
# squid -v
Squid Cache: Version 2.7.STABLE4
configure options:  '--bindir=/usr/local/sbin' '--sbindir=/usr/local/sbin' '--datadir=/usr/local/etc/squid' '--libexecdir=/usr/local/libexec/squid' '--localstatedir=/usr/local/squid' '--sysconfdir=/usr/local/etc/squid' '--enable-removal-policies=lru heap' '--disable-linux-netfilter' '--disable-linux-tproxy' '--disable-epoll' '--enable-auth=basic ntlm digest' '--enable-basic-auth-helpers=DB NCSA PAM MSNT SMB LDAP YP' '--enable-digest-auth-helpers=password ldap' '--enable-external-acl-helpers=ip_user session unix_group wbinfo_group ldap_group' '--enable-ntlm-auth-helpers=SMB' '--enable-negotiate-auth-helpers=squid_kerb_auth' '--with-pthreads' '--enable-storeio=ufs diskd null aufs coss' '--enable-delay-pools' '--enable-snmp' '--enable-ssl' '--with-openssl=/usr' '--enable-icmp' '--disable-internal-dns' '--enable-htcp' '--enable-forw-via-db' '--enable-cache-digests' '--enable-wccpv2' '--enable-referer-log' '--enable-useragent-log' '--enable-arp-acl' '--enable-pf-transparent' '--enable-follow-x-forwarded-for' '--with-large-files' '--enable-large-cache-files' '--enable-err-languages=Armenian Azerbaijani Bulgarian Catalan Czech Danish  Dutch English Estonian Finnish French German Greek  Hebrew Hungarian Italian Japanese Korean Lithuanian  Polish Portuguese Romanian Russian-1251 Russian-koi8-r  Serbian Simplify_Chinese Slovak Spanish Swedish  Traditional_Chinese Turkish' '--enable-default-err-language=English' '--prefix=/usr/local' '--mandir=/usr/local/man' '--infodir=/usr/local/info/' 'i386-portbld-freebsd6.2' 'build_alias=i386-portbld-freebsd6.2' 'host_alias=i386-portbld-freebsd6.2' 'target_alias=i386-portbld-freebsd6.2' 'CC=cc' 'CFLAGS=-O2 -fno-strict-aliasing -pipe  -I/usr/local/include  -I/usr/include' 'LDFLAGS= -L/usr/local/lib -rpath=/usr/lib:/usr/local/lib -L/usr/lib' 'CPPFLAGS='

cache.log:
2008/08/23 16:16:48| Starting Squid Cache version 2.7.STABLE4 for i386-portbld-freebsd6.2...
2008/08/23 16:16:48| Process ID 6013
2008/08/23 16:16:48| With 3578 file descriptors available
2008/08/23 16:16:48| Using kqueue for the IO loop
2008/08/23 16:16:48| Unlinkd pipe opened on FD 18
2008/08/23 16:16:48| Swap maxSize 10485760 + 16384 KB, estimated 0 objects
2008/08/23 16:16:48| Target number of buckets: 40392
2008/08/23 16:16:48| Using 65536 Store buckets
2008/08/23 16:16:48| Max Mem  size: 16384 KB
2008/08/23 16:16:48| Max Swap size: 10485760 KB
2008/08/23 16:16:48| Local cache digest enabled; rebuild/rewrite every 3600/3600 sec
2008/08/23 16:16:48| Store logging disabled
2008/08/23 16:16:48| Rebuilding storage in /opt/squid/cache (CLEAN)
2008/08/23 16:16:48| Using Least Load store dir selection
2008/08/23 16:16:48| Current Directory is /opt/squid/log
2008/08/23 16:16:48| Loaded Icons.
2008/08/23 16:16:48| Accepting proxy HTTP connections at 10.0.0.1, port 3128, FD 21.
2008/08/23 16:16:48| Accepting HTCP messages on port 4827, FD 22.
2008/08/23 16:16:48| Accepting SNMP messages on port 3401, FD 23.
2008/08/23 16:16:48| WCCP Disabled.
2008/08/23 16:16:48| Pinger socket opened on FD 25
2008/08/23 16:16:48| Ready to serve requests.
2008/08/23 16:16:48| Store rebuilding is 24.7% complete
2008/08/23 16:16:49| Done reading /opt/squid/cache swaplog (16551 entries)
2008/08/23 16:16:49| Finished rebuilding storage from disk.
2008/08/23 16:16:49|     16551 Entries scanned
2008/08/23 16:16:49|         0 Invalid entries.
2008/08/23 16:16:49|         0 With invalid flags.
2008/08/23 16:16:49|     16551 Objects loaded.
2008/08/23 16:16:49|         0 Objects expired.
2008/08/23 16:16:49|         0 Objects cancelled.
2008/08/23 16:16:49|         0 Duplicate URLs purged.
2008/08/23 16:16:49|         0 Swapfile clashes avoided.
2008/08/23 16:16:49|   Took 1.2 seconds (13436.5 objects/sec).
2008/08/23 16:16:49| Beginning Validation Procedure
2008/08/23 16:16:49|   Completed Validation Procedure
2008/08/23 16:16:49|   Validated 16551 Entries
2008/08/23 16:16:49|   store_swap_size = 178424k
2008/08/23 16:16:50| storeLateRelease: released 0 objects

The package Manager shows:

squid      Network     Current: 2.6.18.1_03 Installed: 2.7.4    High performance web proxy cache.

Offline atamido

  • Jr. Member
  • **
  • Posts: 58
    • View Profile
Re: squid 2.7.4 with aufs support?
« Reply #3 on: September 17, 2008, 09:09:18 am »
I am very interested in this. Squid 2.7 offers significant performance advantages over Squid 2.6.  It also offers the new StoreUrlRewrite feature, which I am very interested in to improve the cachability of some sites.

Primarily I would like the package updated to 2.7.4 as the configuration changes are minimal.  However, for immediate testing I would like to know how to build Squid 2.7.4 for pfsense so that I can start testing it myself.  If anyone has suggestions for how to get 2.7.4 to run on pfsense, I am all ears.

Offline Netview

  • Jr. Member
  • **
  • Posts: 30
    • View Profile
Re: squid 2.7.4 with aufs support?
« Reply #4 on: September 17, 2008, 12:36:49 pm »
Here you'll find the package:

http://rz-home.de/~hhornung/squid-2.7.4.tbz

But maybe you have to copy the libs manually. I'm not shure this will work automatically (but the package is complete - all necessary modules are included!)

Offline atamido

  • Jr. Member
  • **
  • Posts: 58
    • View Profile
Re: squid 2.7.4 with aufs support?
« Reply #5 on: September 17, 2008, 08:04:19 pm »
I can't get the install script to work.  I type "./+INSTALL" and it just goes to the next line without apparently doing anything.  Is there something I need to enable/disable first?

Offline Netview

  • Jr. Member
  • **
  • Posts: 30
    • View Profile
Re: squid 2.7.4 with aufs support?
« Reply #6 on: September 18, 2008, 02:37:10 am »
You can install it manually:

Go to the package-folders /lib, /sbin, and /libexec and set 'chmod 555 *'.

Stop squid and squidgard. Copy the modules from the package .../lib to /lib, .../sbin to /usr/local/sbin , ../libexec to /usr/local/libexec/squid.

start squid and squidguard.
Control cache.log
« Last Edit: September 18, 2008, 02:40:03 am by Netview »

Offline atamido

  • Jr. Member
  • **
  • Posts: 58
    • View Profile
Re: squid 2.7.4 with aufs support?
« Reply #7 on: September 18, 2008, 01:30:12 pm »
I copied the /lib from the downloaded file to /lib in the file system, and it killed my system.   :(  I need to remember to make backups of files before copying over them.

Offline Netview

  • Jr. Member
  • **
  • Posts: 30
    • View Profile
Re: squid 2.7.4 with aufs support?
« Reply #8 on: September 19, 2008, 01:50:56 am »
Sorry for that - but normally the package will not break your system!
The libs are new and will not override any existing versions (under /lib).

Before you reboot the whole system, you should start squid manually to look for errors.
If something goes wrong then you are able to reinstall squid-2.6.21-4 (or restore the modules you have replaced before).

The squid-package-2.7.4 is only for pfsense 1.2 based on freebsd 6.2/6.3!!!

squid is working on my alix 2C2-board:

Code: [Select]
# ps -aux|grep squid
root     1177  0.0  1.0  5444  2568  ??  Is   Tue09AM   0:00.00 /usr/local/sbin/squid -D
proxy    1179  0.0 23.9 65276 60692  ??  S    Tue09AM   6:32.04 (squid) -D (squid)
proxy   37959  0.0  1.6 34904  4136  ??  Is   12:00AM   0:00.34 (squidGuard) -c /usr/local/etc/squidGuard/squidGuard.conf (sq
proxy   37960  0.0  1.6 34904  4064  ??  Is   12:00AM   0:00.17 (squidGuard) -c /usr/local/etc/squidGuard/squidGuard.conf (sq
proxy   37961  0.0  1.6 34904  4004  ??  Is   12:00AM   0:00.15 (squidGuard) -c /usr/local/etc/squidGuard/squidGuard.conf (sq
# squid -v
Squid Cache: Version 2.7.STABLE4
configure options:  '--with-aufs-threads=10' '--bindir=/usr/local/sbin' '--sbindir=/usr/local/sbin' '--datadir=/usr/local/etc/squid' '--libexecdir=/usr/local/libexec/squid' '--localstatedir=/usr/local/squid' '--sysconfdir=/usr/local/etc/squid' '--enable-removal-policies=lru heap' '--disable-linux-netfilter' '--disable-linux-tproxy' '--disable-epoll' '--enable-auth=basic ntlm digest' '--enable-basic-auth-helpers=DB NCSA PAM MSNT SMB LDAP YP' '--enable-digest-auth-helpers=password ldap' '--enable-external-acl-helpers=ip_user session unix_group wbinfo_group ldap_group' '--enable-ntlm-auth-helpers=SMB' '--enable-negotiate-auth-helpers=squid_kerb_auth' '--with-pthreads' '--enable-storeio=ufs diskd null aufs coss' '--enable-delay-pools' '--enable-snmp' '--enable-ssl' '--with-openssl=/usr' '--enable-htcp' '--enable-forw-via-db' '--enable-cache-digests' '--enable-wccpv2' '--enable-referer-log' '--enable-useragent-log' '--enable-arp-acl' '--enable-pf-transparent' '--enable-follow-x-forwarded-for' '--with-large-files' '--enable-large-cache-files' '--enable-err-languages=Armenian Azerbaijani Bulgarian Catalan Czech Danish  Dutch English Estonian Finnish French German Greek  Hebrew Hungarian Italian Japanese Korean Lithuanian  Polish Portuguese Romanian Russian-1251 Russian-koi8-r  Serbian Simplify_Chinese Slovak Spanish Swedish  Traditional_Chinese Turkish' '--enable-default-err-language=English' '--prefix=/usr/local' '--mandir=/usr/local/man' '--infodir=/usr/local/info/' 'i386-portbld-freebsd6.2' 'build_alias=i386-portbld-freebsd6.2' 'host_alias=i386-portbld-freebsd6.2' 'target_alias=i386-portbld-freebsd6.2' 'CC=cc' 'CFLAGS=-O2 -fno-strict-aliasing -pipe  -I/usr/local/include  -I/usr/include' 'LDFLAGS= -L/usr/local/lib -rpath=/usr/lib:/usr/local/lib -L/usr/lib' 'CPPFLAGS='
# uname -a
FreeBSD pfsense.netview.de 6.2-RELEASE-p11 FreeBSD 6.2-RELEASE-p11 #0: Sun Feb 24 16:38:29 EST 2008     sullrich@builder6.pfsense.com:/usr/obj.pfSense/usr/src/sys/pfSense_wrap.6  i386




Offline Netview

  • Jr. Member
  • **
  • Posts: 30
    • View Profile
Re: squid 2.7.4 with aufs support?
« Reply #9 on: September 21, 2008, 08:02:23 am »
Does anybody else has successfully runing squid 2.7.4 under pfsense 1.2?