Netgate SG-1000 microFirewall

Author Topic: Trafic shaping for Streaming to twitch as well as streaming Netflix/YouTube  (Read 1323 times)

0 Members and 1 Guest are viewing this topic.

Offline Chrismallia

  • Full Member
  • ***
  • Posts: 266
  • Karma: +20/-4
    • View Profile
Re: Trafic shaping for Streaming to twitch as well as streaming Netflix/YouTube
« Reply #15 on: September 26, 2017, 01:26:33 am »
"It is officially in pfSense.... You don't install it from the CLI, you just select it."

You are spreading  miss information. FQ_codel is officially in BSD  not officially implanted in  pfsense, it wil be officially implanted in pfsense when the pf team enable it and you can select it from the gui not playing around in cli. 

Offline belt9

  • Full Member
  • ***
  • Posts: 233
  • Karma: +24/-6
    • View Profile
Re: Trafic shaping for Streaming to twitch as well as streaming Netflix/YouTube
« Reply #16 on: September 26, 2017, 06:32:38 am »
Right, well it officially works. But sure, if nothing's official to you unless there's a box to check in a gui then by all means it isn't official.  ::)

Offline Chrismallia

  • Full Member
  • ***
  • Posts: 266
  • Karma: +20/-4
    • View Profile
Re: Trafic shaping for Streaming to twitch as well as streaming Netflix/YouTube
« Reply #17 on: September 26, 2017, 07:31:10 am »
"if nothing's official to you unless there's a box to check in a gui then by all means it isn't official.  ::)"

Exactly. if it was fully official pfsense devs would have put in the checkbox. hekk 2.4 is not even  official release yet.    Oh and keep hitting the smite as much as you like two can play that game lol if you cant have a simple conversation you should get a real smite   lol
« Last Edit: September 26, 2017, 07:34:52 am by Chrismallia »

Offline belt9

  • Full Member
  • ***
  • Posts: 233
  • Karma: +24/-6
    • View Profile
Re: Trafic shaping for Streaming to twitch as well as streaming Netflix/YouTube
« Reply #18 on: September 26, 2017, 07:51:56 am »
You keep on ignoring features unless someone builds a GUI box for you.

fq_codel is still the solution to this problem, and it is part of pfSense 2.4 - and it works, and it's easier to setup than ALTQ for this problem, and it's more effective.


Offline Chrismallia

  • Full Member
  • ***
  • Posts: 266
  • Karma: +20/-4
    • View Profile
Re: Trafic shaping for Streaming to twitch as well as streaming Netflix/YouTube
« Reply #19 on: September 26, 2017, 08:08:22 am »
You keep on ignoring features unless someone builds a GUI box for you.

fq_codel is still the solution to this problem, and it is part of pfSense 2.4 - and it works, and it's easier to setup than ALTQ for this problem, and it's more effective.

Thats not what I was saying, infect I used the cli also, all i said is that we know what fq_codel is and we know what  it can do and it solves most of the problems and yes  if the OP uses fq_codel his problems might be over, all I said is thet till 2.4 is fully released and fq_ is implemented I do not think it is a good Idea to suggest playing around in the cli to maybe newer people to pfsense or traffic shaping. Oh and looks like we are going to start having some fun with the smite game if you want it will do it :)

Offline belt9

  • Full Member
  • ***
  • Posts: 233
  • Karma: +24/-6
    • View Profile
Re: Trafic shaping for Streaming to twitch as well as streaming Netflix/YouTube
« Reply #20 on: September 26, 2017, 08:28:31 am »
it's just copy paste into shellcmd - that has a GUI! not "playing around with cli".

I would argue that it's a much better idea to simply pass along very simple instructions on how to solve a maybe newer users problem with the appropriate tool, rather than suggesting they do a complicated workaround with ALTQ / HFSC which few people really understand to begin with - just because it has a GUI.

Anyways, if OP would like any help either method just ask.

Offline Chrismallia

  • Full Member
  • ***
  • Posts: 266
  • Karma: +20/-4
    • View Profile
Re: Trafic shaping for Streaming to twitch as well as streaming Netflix/YouTube
« Reply #21 on: September 26, 2017, 08:40:51 am »
"I would argue that it's a much better idea to simply pass along very simple instructions on how to solve a maybe newer users problem with the appropriate tool, rather than suggesting they do a complicated workaround with ALTQ / HFSC which few people really understand to begin with - just because it has a GUI. "

Well everyone has his/her  opinion , but next time do not forget to tell them that  they have to install 2.4 RC  as you failed doing that

Offline belt9

  • Full Member
  • ***
  • Posts: 233
  • Karma: +24/-6
    • View Profile
Re: Trafic shaping for Streaming to twitch as well as streaming Netflix/YouTube
« Reply #22 on: September 26, 2017, 08:57:13 am »
You're right, that was my bad. I'll modify that post.

Offline Harvy66

  • Hero Member
  • *****
  • Posts: 2218
  • Karma: +204/-12
    • View Profile
Re: Trafic shaping for Streaming to twitch as well as streaming Netflix/YouTube
« Reply #23 on: September 26, 2017, 06:07:14 pm »
I can pin a string in C# and modify the structure such that it thinks the size of the string is anything I want and can change the value of the string. I can "officially" change the value and length of strings.

Just because you can't doesn't mean you should. fq_Codel technically working is an undefined implementation detail.

Offline bingo600

  • Full Member
  • ***
  • Posts: 136
  • Karma: +12/-0
    • View Profile
Re: Trafic shaping for Streaming to twitch as well as streaming Netflix/YouTube
« Reply #24 on: September 27, 2017, 11:15:00 am »
Just because you can't doesn't mean you should. fq_Codel technically working is an undefined implementation detail.

Would you care to elaborate on that please  ;)
Are you saying that native FreeBSD queuing are undefined ?
Or just not tested with pfSense ?

I have installed the sudo package from the "BSD repos", because i saw a need for it.
And still think it's ok to use the "right tool" for the job.

But "fiddling under the hood" will of course VOID the warranty like everywhere else.

/Bingo
pfSense 2.4.2-p1

QOTOM-Q355G4 Quad Lan.
CPU  : Core i5 5250U
Ram : 8GB Kingston DDR3LV 1600
LAN  : 4 x Intel 211
Disk  : 240G Toshiba Sata SSD

Offline Harvy66

  • Hero Member
  • *****
  • Posts: 2218
  • Karma: +204/-12
    • View Profile
Re: Trafic shaping for Streaming to twitch as well as streaming Netflix/YouTube
« Reply #25 on: September 28, 2017, 09:24:31 pm »
I'm just saying, if my car lets me drive off a bridge, it doesn't mean that's an officially supported use of the vehicle. You take full responsibility for undocumented "features".

Offline PCbuilder1997

  • Jr. Member
  • **
  • Posts: 29
  • Karma: +0/-0
    • View Profile
Ok. I stated before that I am a noob.
 I also think that some are misunderstanding what I am meaning by streaming. Yes Netflix is a streaming service, but I am talking about streaming content from my computer to a website upstream ( to twitch.tv) as well as allowing streaming downstream (from netflix.com) at the same time. I am lost with the what you guys are calling dummynet and I do not fully understand what some of the names and acronyms stand for such as these:
qInternet
qACK
qDefault
                  I understand what the words default and internet mean, i just do not know what their purposes are if that makes sense.

If I understand this correctly, "q" stands for queue followed by what is in the queue for being shaped? What is qACK?
I also have found that the higher the number in the priority list = the higher priority i.e. 7= highest priority, correct?

I have the bandwidth percentages set kind of odd to me in the sense that it doesn't add up. If I have the bandwidth percentages adding up to 100% across all queues NOTHING works. So currently, most queues sit at about 5%-15% qGames is the highest at 30%.

I really would like to figure this out and I am sorry that i cannot figure it out on my own. You guys have been very helpful so far. I just am having difficulty making sense of the language.
Thank you in advance.
« Last Edit: October 01, 2017, 10:07:18 am by PCbuilder1997 »

Offline PCbuilder1997

  • Jr. Member
  • **
  • Posts: 29
  • Karma: +0/-0
    • View Profile
If it still doesn't work, use FairQ as your shaper, set your interface to 90% of your actual speed, have one queue on your interface, make sure it's the default and enable Codel on it.

Where would I find FairQ in the wizard? I only get three options; HSFC CBQ and PRIQ

Offline belt9

  • Full Member
  • ***
  • Posts: 233
  • Karma: +24/-6
    • View Profile
Correct those are different queues within the ALTQ shaper.

pfSense uses two basic types of traffic shaping, ALTQ & Dummynet (dummynet is under the "Limiters" tab).


ALTQ is what your screenshot is of. It is very effective, but you need to know what you are doing and even then it takes time to enter all of your queues.

Dummynet is very simple, you just make two limiters. One for Download, the other for Upload.
Set a queue within each limiter, set your subnet mask (probably /24) - ask if oyu need help with any of the other settings, there aren't many).
You would limit both of these streams to some value slightly less than the slowest your internet ever gets.
This is the step that most people mess up with traffic shaping - because no one wants to do it.

But, put simply - your internet bandwidth is a series of funnels. For simplicity we'll just say there are two funnels - you and your ISP (there are more). If your funnel is larger than your ISP's, then your ISP funnel will limit your traffic - probably not in the way that it best for you.
If you want control over how your traffic is limited then you MUST make your funnel smaller than your ISP's - therefore you MUST limit your bandwidth to less than the slowest it EVER gets.
What this means is - if you pay for a 50Mbps down / 10 Mbps up line, but during peak traffic you are actually only getting 40/8, then you would set your limiters to 38,000Kbps / 7,600Kbps. If you decided to just set it to something like 49,000Kbps/9,000Kbps, then the limiters would do nothing for you during peak hours (when it matters most).

Once the dummynet limiters are created, you just apply them to your firewall rules in the advanced section of each rule and you are done.

You can use dummynet in pre 2.4.x, but you can't use fq_codel. I recommend using 2.4.0 (the Release version comes out tomorrow). Because you can set your dummynet to use fq_codel with the CLI and shellcmd package.

fq_codel is just a very good algorithm that is exceptional at fairly sharing your bandwidth and greatly reducing latency at the same time. So it will generally solve all of your problems without a whole bunch of config.


If you don't want to go that way, I recommend you watch this video on traffic shaping. It will show you how it works so you know what you are doing. After watching that you'll at least know what questions to ask. After watching that you'll probably also see why I recommend you just use dummynet for a home network that is simply trying to upload and download video content without bufferbloat.

https://www.youtube.com/watch?v=rF46PNid1Mo
« Last Edit: October 01, 2017, 10:24:53 am by belt9 »

Offline PCbuilder1997

  • Jr. Member
  • **
  • Posts: 29
  • Karma: +0/-0
    • View Profile
Thank you sir! Story of my life. Here i am doing the advanced S*** where the next tab over is the thing I need that will work and be ok. LOL
Thanks man.
I will try this and I will also putts around learning with AltQ.