The pfSense Store

Author Topic: Traffic Shaper Drops qOthersDownH  (Read 7576 times)

0 Members and 1 Guest are viewing this topic.

Offline jlepthien

  • Hero Member
  • *****
  • Posts: 657
  • Karma: +0/-0
    • View Profile
Re: Traffic Shaper Drops qOthersDownH
« Reply #15 on: December 18, 2009, 12:11:45 pm »
Hmm. I will check this out again. I have p2p catch-all activated, but otherwise nothing special. I will re-run the wizard with all set to standard and see what happens.
| apple fanboy | music lover | network and security specialist | in love with cisco systems |

Offline jlepthien

  • Hero Member
  • *****
  • Posts: 657
  • Karma: +0/-0
    • View Profile
Re: Traffic Shaper Drops qOthersDownH
« Reply #16 on: December 21, 2009, 04:22:28 am »
I re-run the wizard again but it does not seem to be any better....

The only things I changed in the wizard is that I use p2p-catchall and I put http(s) and IPSec traffic on higher priority. Now have a look at my queues, I still have the others queues so that seems to be right.

Anything else I can do? I do not get it. Why all the drops? There is no other traffic at the moment, just a big iTunes download, so there shouldn't be any of these...
| apple fanboy | music lover | network and security specialist | in love with cisco systems |

Offline jlepthien

  • Hero Member
  • *****
  • Posts: 657
  • Karma: +0/-0
    • View Profile
Re: Traffic Shaper Drops qOthersDownH
« Reply #17 on: December 21, 2009, 04:22:56 am »
And here is a screenshot of my queues...
| apple fanboy | music lover | network and security specialist | in love with cisco systems |

Offline danswartz

  • Hero Member
  • *****
  • Posts: 1167
  • Karma: +0/-0
    • View Profile
Re: Traffic Shaper Drops qOthersDownH
« Reply #18 on: December 21, 2009, 07:11:37 am »
Curious about something.  Is there actually a problem, or you just want to know why the drops happen?  By "problem", I mean slow/stalled downloads?  The only way pfsense can shape inbound traffic is to drop packets when the speed gets too high, which will slow down the sender.

Offline jlepthien

  • Hero Member
  • *****
  • Posts: 657
  • Karma: +0/-0
    • View Profile
Re: Traffic Shaper Drops qOthersDownH
« Reply #19 on: December 21, 2009, 07:22:31 am »
Well, the "problem" is, that the speed is slower, when traffic shaping is enabled and I download via http. This should not happen. I want all speed for http traffic when it arrives. I do not do anything besides downloading via http when the drops happen...
| apple fanboy | music lover | network and security specialist | in love with cisco systems |

Offline danswartz

  • Hero Member
  • *****
  • Posts: 1167
  • Karma: +0/-0
    • View Profile
Re: Traffic Shaper Drops qOthersDownH
« Reply #20 on: December 21, 2009, 07:24:43 am »
But this makes no sense - you have no control over what gets put into the pipe at the ISP's end, only when you are uploading data.  The only thing you can really control download-wise is the total bandwidth. 

Offline jlepthien

  • Hero Member
  • *****
  • Posts: 657
  • Karma: +0/-0
    • View Profile
Re: Traffic Shaper Drops qOthersDownH
« Reply #21 on: December 21, 2009, 07:40:46 am »
Okay. Then maybe I entered to small Mbit/s in my shaper config? How do you test your actual download speed and what are the numbers you enter in the wizard? 10% less of your real bandwidth?
| apple fanboy | music lover | network and security specialist | in love with cisco systems |

Offline danswartz

  • Hero Member
  • *****
  • Posts: 1167
  • Karma: +0/-0
    • View Profile
Re: Traffic Shaper Drops qOthersDownH
« Reply #22 on: December 21, 2009, 07:41:48 am »
I usually just put the supposed download speed, since it doesn't really matter that much (to me at least).  90% of usable speed seems reasonable.

Offline jlepthien

  • Hero Member
  • *****
  • Posts: 657
  • Karma: +0/-0
    • View Profile
Re: Traffic Shaper Drops qOthersDownH
« Reply #23 on: December 21, 2009, 02:17:15 pm »
No I tested again. I put in the supposed speed and raised qwanacks to 65% and qothersdownh to 70% started a torrent and a http download. Now the queues look like on the new screenshot. I get only some drops in my http traffic which is good, but still a lot in my p2p queue. Isn't this bad? But as you told me this is the only method to throttle the download speed?

Thanks guys...
| apple fanboy | music lover | network and security specialist | in love with cisco systems |

Offline danswartz

  • Hero Member
  • *****
  • Posts: 1167
  • Karma: +0/-0
    • View Profile
Re: Traffic Shaper Drops qOthersDownH
« Reply #24 on: December 21, 2009, 02:20:08 pm »
dropping packets is one of the two ways a shaper can slow down inbound traffic.  dropped packets are not inherently bad for TCP traffic.  unless you have an actual performance issue here, you are (IMO) spending a lot of time to try (futilely) to solve an intractable problem.

Offline SlickNetAaron

  • Jr. Member
  • **
  • Posts: 43
  • Karma: +0/-0
    • View Profile
Re: Traffic Shaper Drops qOthersDownH
« Reply #25 on: December 21, 2009, 11:02:01 pm »
dropping packets is one of the two ways a shaper can slow down inbound traffic.  dropped packets are not inherently bad for TCP traffic.  unless you have an actual performance issue here, you are (IMO) spending a lot of time to try (futilely) to solve an intractable problem.

He's having the same problem I'm having.  It's dropping packets when there is no congestion and well below the max pipe bandwidth.  In order for my ~30mb connection to be fully utilized I have to tell the shaper I have a 40mb connection.  If I set it to 35mb it drops packets and maxes me out at 25mb.  If I set to 30mb I max out at about 17/18mb. 

It's dropping packets when I'm using a paltry 64kb bandwidth on the "high priority" queue, but if traffic gets routed to the "others" low priority queue no packets get dropped.  It's functioning in reverse, and shaping (dropping) far too early.

Also, if I try to set the upper limit on the root queue, it is 100% ineffective.  I could set upper limit to be 1mb and it will still allow 30mb to cross on the wire.  (yes, I've tested for both directions.)  The shaper is pretty much not functioning correctly.

lastly, there are other ways to shape download - by delaying packet delivery which will cause the app to back off.  see http://www.netequalizer.com/tsfaq.htm

Offline jlepthien

  • Hero Member
  • *****
  • Posts: 657
  • Karma: +0/-0
    • View Profile
Re: Traffic Shaper Drops qOthersDownH
« Reply #26 on: December 22, 2009, 12:31:02 am »
Probably the shaper will be better in 2.0 which will hopefully be released next year...
| apple fanboy | music lover | network and security specialist | in love with cisco systems |

Offline jlepthien

  • Hero Member
  • *****
  • Posts: 657
  • Karma: +0/-0
    • View Profile
Re: Traffic Shaper Drops qOthersDownH
« Reply #27 on: December 22, 2009, 04:22:03 am »
I have got another question concerning the rules of the shaper. The wizards creates rules based on LAN net. Can I simply change LAN net to a single IP? I want some rules to apply only for one IP...
| apple fanboy | music lover | network and security specialist | in love with cisco systems |

Offline danswartz

  • Hero Member
  • *****
  • Posts: 1167
  • Karma: +0/-0
    • View Profile
Re: Traffic Shaper Drops qOthersDownH
« Reply #28 on: December 22, 2009, 06:45:54 am »
dropping packets is one of the two ways a shaper can slow down inbound traffic.  dropped packets are not inherently bad for TCP traffic.  unless you have an actual performance issue here, you are (IMO) spending a lot of time to try (futilely) to solve an intractable problem.

He's having the same problem I'm having.  It's dropping packets when there is no congestion and well below the max pipe bandwidth.  In order for my ~30mb connection to be fully utilized I have to tell the shaper I have a 40mb connection.  If I set it to 35mb it drops packets and maxes me out at 25mb.  If I set to 30mb I max out at about 17/18mb. 

It's dropping packets when I'm using a paltry 64kb bandwidth on the "high priority" queue, but if traffic gets routed to the "others" low priority queue no packets get dropped.  It's functioning in reverse, and shaping (dropping) far too early.

Also, if I try to set the upper limit on the root queue, it is 100% ineffective.  I could set upper limit to be 1mb and it will still allow 30mb to cross on the wire.  (yes, I've tested for both directions.)  The shaper is pretty much not functioning correctly.

lastly, there are other ways to shape download - by delaying packet delivery which will cause the app to back off.  see http://www.netequalizer.com/tsfaq.htm

Yeah, I'm aware of that technique.  You have provided a better (more convincing) description of what is wrong.  I would open a ticket on redmine.pfsense.org.

Offline Rick164

  • Newbie
  • *
  • Posts: 2
  • Karma: +0/-0
    • View Profile
Re: Traffic Shaper Drops qOthersDownH
« Reply #29 on: January 02, 2010, 08:47:27 am »
Having the same problem, the strange part is that it works fine for about a day or so but after that it starts dropping qOthersdownH and thus giving qP2p higher priority(internet pages either timeout or load slow).
The only thing that helps is restarting pfsense or the traffic shaper, can't find the problem as there are no errors in the logs and nothing has changed in the configs in the meantime.
This is with pfsense 1.2.3 final(4GB nanobsd) and it worked ok in 1.2.2 and in some of the early 1.2.3 builds, tried alot of different traffic shaper settings(lowering/raising bandwith for instance) but with no luck so far.