Netgate SG-1000 microFirewall

Author Topic: Fix the squid package {completed}  (Read 48317 times)

0 Members and 1 Guest are viewing this topic.

Offline mhab12

  • Hero Member
  • *****
  • Posts: 694
  • Karma: +7/-0
    • View Profile
Fix the squid package {completed}
« on: February 15, 2008, 06:09:48 pm »
This discussion has been ongoing in the packages forum.  The squid package is now very slow for some reason.  It is also based on an outdated release.  To be awarded the bounty, update the squid package to the latest stable release (2.6.18), provide transparent proxy throughput at or very near non-proxy throughput, and make sure that sites like auctionsniper.com and evga.com (maybe others too?) display properly when opened through the proxy.  All of this must work on 1.2rc5 or 1.2_STABLE when it happens.  I am willing to contribute $250 to the bounty, and heiko $200 per one of the related posts below as long as he gets an invoice.  To get up to speed I've listed most (I think) of the other related posts below.

http://forum.pfsense.org/index.php/topic,7887.0.html

http://forum.pfsense.org/index.php/topic,7281.0.html

http://forum.pfsense.org/index.php/topic,7538.0.html

http://forum.pfsense.org/index.php/topic,6835.0.html


http://forum.pfsense.org/index.php/topic,7652.0.html

http://forum.pfsense.org/index.php/topic,6808.0.html

http://cvstrac.pfsense.com/tktview?tn=1557
« Last Edit: July 28, 2008, 11:16:31 am by mhab12 »

Offline ermal

  • Hero Member
  • *****
  • Posts: 3832
  • Karma: +85/-5
    • View Profile
Re: Fix the squid package - $450
« Reply #1 on: February 16, 2008, 02:17:47 pm »
Quote
  To be awarded the bounty, update the squid package to the latest stable release (2.6.18), provide transparent proxy throughput at or very near non-proxy throughput,
Can you tell me what this is?!

Offline inferno222

  • Newbie
  • *
  • Posts: 12
  • Karma: +0/-0
    • View Profile
Re: Fix the squid package - $450
« Reply #2 on: February 16, 2008, 06:04:39 pm »
I will contribute $50 if this can fix my issue here:

http://forum.pfsense.org/index.php/topic,7919.0.html

Offline heiko

  • Hero Member
  • *****
  • Posts: 663
  • Karma: +0/-0
  • Get a load of that!
    • View Profile
Re: Fix the squid package - $450
« Reply #3 on: February 17, 2008, 04:47:02 am »
As i saw, sullrich have updated the squid package to the latest 2.6.18 version!

Offline mhab12

  • Hero Member
  • *****
  • Posts: 694
  • Karma: +7/-0
    • View Profile
Re: Fix the squid package - now $500
« Reply #4 on: February 18, 2008, 01:43:25 am »
Sullrich, thanks for being so amazingly prompt in getting the package updated, especially in light of 1.2 approaching release. 

The 'broken' sites appear to be working under the latest version.  The speeds look improved, but not fixed.  Under 2.6.18/1.2RC5 I can get 600kbps where I used to see about 250-300 kbps before the package bump.  This is on a bonded T-1 WAN 3mbps where I can see 2700kbps on squid 2.6.5/1.2RC2.

Getting the package updated is a huge step, thanks...now where is all the bandwidth going?

Offline jahonix

  • Hero Member
  • *****
  • Posts: 2444
  • Karma: +146/-14
  • volunteer since 2006
    • View Profile
Re: Fix the squid package - now $500
« Reply #5 on: February 18, 2008, 02:22:06 am »
Can you monitor your processor utilization? Does it max out when D/L-ing?

Attached I have a screenshot when pulling this service pack (~370MB): http://www.microsoft.com/downloads/details.aspx?FamilyID=95ac1610-c232-4644-b828-c55eec605d55&DisplayLang=en

I have squid (2.6.18) running in transparent mode. But notice the increase of CPU utilization (is that normal?). Anyway, I still get close to my theoretical max. of 16MB down
Chris

The issue with IPv6 jokes is that almost no one understands them and no one is using them yet.

Offline mhab12

  • Hero Member
  • *****
  • Posts: 694
  • Karma: +7/-0
    • View Profile
Re: Fix the squid package - now $500
« Reply #6 on: February 18, 2008, 10:04:31 am »
I'm not seeing CPU spikes like that, but my bandwidth is all over the place.
« Last Edit: February 18, 2008, 11:26:59 am by mhab12 »

Offline jahonix

  • Hero Member
  • *****
  • Posts: 2444
  • Karma: +146/-14
  • volunteer since 2006
    • View Profile
Re: Fix the squid package - now $500
« Reply #7 on: February 18, 2008, 11:10:36 am »
Can you easily switch off squid and test without it?
Just to make sure the hardware, cables and stuff work as expected.
Chris

The issue with IPv6 jokes is that almost no one understands them and no one is using them yet.

Offline mhab12

  • Hero Member
  • *****
  • Posts: 694
  • Karma: +7/-0
    • View Profile
Re: Fix the squid package - now $500
« Reply #8 on: February 18, 2008, 11:28:36 am »
Same file download, without using the proxy.

Offline jahonix

  • Hero Member
  • *****
  • Posts: 2444
  • Karma: +146/-14
  • volunteer since 2006
    • View Profile
Re: Fix the squid package - now $500
« Reply #9 on: February 18, 2008, 11:35:08 am »
This is a full install and you're using single or MP kernel?
Chris

The issue with IPv6 jokes is that almost no one understands them and no one is using them yet.

Offline mhab12

  • Hero Member
  • *****
  • Posts: 694
  • Karma: +7/-0
    • View Profile
Re: Fix the squid package - now $500
« Reply #10 on: February 18, 2008, 11:47:00 am »
MP kernel AFAIK, it's a dual processor machine.  I have had the same results on a single processor box as well.  Is there a shell command I can run to tell me which kernel I am running?

Offline jahonix

  • Hero Member
  • *****
  • Posts: 2444
  • Karma: +146/-14
  • volunteer since 2006
    • View Profile
Re: Fix the squid package - now $500
« Reply #11 on: February 18, 2008, 11:56:45 am »
For sure it's somewhere here:  https://<your-pfsense-ip>/status.php
Chris

The issue with IPv6 jokes is that almost no one understands them and no one is using them yet.

Offline mhab12

  • Hero Member
  • *****
  • Posts: 694
  • Karma: +7/-0
    • View Profile
Re: Fix the squid package - now $500
« Reply #12 on: February 18, 2008, 12:10:46 pm »
Just a sampling...
FreeBSD 6.2-RELEASE-p11 #0: Mon Feb 18 01:25:40 EST 2008
    sullrich@builder6.pfsense.com:/usr/obj.pfSense/usr/src/sys/pfSense_SMP.6

FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs

Offline ermal

  • Hero Member
  • *****
  • Posts: 3832
  • Karma: +85/-5
    • View Profile
Re: Fix the squid package - now $500
« Reply #13 on: February 18, 2008, 03:11:52 pm »
Are you by any case heeting swap?!

Offline mhab12

  • Hero Member
  • *****
  • Posts: 694
  • Karma: +7/-0
    • View Profile
Re: Fix the squid package - now $500
« Reply #14 on: February 18, 2008, 03:25:38 pm »
Heeting swap?  I don't understand what that means.