pfSense Gold Subscription

Author Topic: Best Package for Bandwidth Usage per IP  (Read 10666 times)

0 Members and 1 Guest are viewing this topic.

Offline Sambo

  • Newbie
  • *
  • Posts: 6
    • View Profile
Best Package for Bandwidth Usage per IP
« on: May 15, 2010, 02:42:44 am »
Hi pfSensers,

I'm an IT Pro with 15 year's experience, but a newbie to pfSense & *nix in general and I'm after some advice regarding which package is going to be the bet to meet my bandwidth monitoring needs.

Basically my situation is that I am setting up pfSense as my new home firewall solution and I'd like to use it to monitor Internet usage for my home PCs etc.  The ISP usage plan is metered and has different costs per GB depending on the time of day (off or on peak).  Based on this I'd like to end up with the following:

- Persistent Bandwidth Usage Monitoring (ie; total usage (incl up and downloads) per hour, per IP / host & possibly per port, but this is not a requirement)
- Graphical reporting with drill-down links for further breakdown / detail per month, day, hour, IP etc
- Switchable contexts (IP / host or time)

In other words, ideally I'd like to start with a graph of usage over a period (say the last month), spot a high usage period (say one day) & be able to 'drill down' to discover which hour(s) & which IP(s) are the cause of the spike.  Similarly I'd like to be able to start with the totals per IP for any given period and drill down see more detail about time sub-periods.  (I hope that makes sense! :))

I've installed nTop and have had a good look in it, but it seems to be mostly about instantaneous bandwidth utilisation rather than about accumulated usage.  Perhaps there is a way to configure nTop to give me what I'm after?  I've also had a brief look at vnStat, but this doesn't appear to have per-ip stats.  I understand that the best option for me may be to use NetFlow or the like with an external logging server, however I'd like to keep the entire bandwidth monitoring system self-contained on the pfSense firewall if at all possible.

Any advice would be much appreciated.  Cheers :)
« Last Edit: May 15, 2010, 04:48:35 pm by Sambo »

Offline jimp

  • Administrator
  • Hero Member
  • *****
  • Posts: 14932
    • View Profile
Re: Best Package for Bandwidth Usage per IP
« Reply #1 on: May 17, 2010, 08:11:18 am »
I don't think any of the packages have such drill-down capabilities.

BandwidthD does keep per-IP historical graphs, but I'm not sure of the other features you're asking about.

You are right though the only way you will probably get that data in the format you want is by exporting to a netflow collector with software to store/analyze the data.
Need help fast? Commercial Support!

Co-Author of pfSense: The Definitive Guide. - Check the Doc Wiki for FAQs.

Do not PM for help!

Offline g4m3c4ck

  • Full Member
  • ***
  • Posts: 126
  • He got a real pretty mouth ain't he?
    • View Profile
Re: Best Package for Bandwidth Usage per IP
« Reply #2 on: May 17, 2010, 12:55:34 pm »
You can use the Traffic shaping feature to have some control of your throughput. You "might" be able to have a bandwidth cap using it but I am not willing to reset my traffic shaper just to see if you can. I use squid in combination with lightsquid and squidguard to control/monitor HTTP based traffic since most traffic is that it works well. Lightsquid does a good job of report which IPs use the most traffic with a timeline.

Offline rhy7s

  • Jr. Member
  • **
  • Posts: 85
    • View Profile
Re: Best Package for Bandwidth Usage per IP
« Reply #3 on: May 18, 2010, 12:42:47 am »
I use bandwidthd but the built in html reports are not very configurable and I haven't got round to figuring out how to analyze the cdf files to generate more useful reports. It also reads about 50% higher usage than my ISP reports. I would also love a self-contained package that met your requirements but haven't come across a solution as yet.

Offline Sambo

  • Newbie
  • *
  • Posts: 6
    • View Profile
Re: Best Package for Bandwidth Usage per IP
« Reply #4 on: May 18, 2010, 04:30:54 am »
Thanks guys I appreciate the info.  I'll try some of your suggestions :)

Offline Sambo

  • Newbie
  • *
  • Posts: 6
    • View Profile
Re: Best Package for Bandwidth Usage per IP
« Reply #5 on: May 18, 2010, 03:38:34 pm »
Ok, I've looked at pretty much every traffic stat package for pfSense but unfortunately none do exactly what I want, so I'm now looking at NetFlow Analyzer apps.  However, while there are quite a few which have all the features I'm looking for, most are trials which are crippled in some way >:( and subsequently don't fit the bill!  'ManageEngine NetFlow Analyzer' seems to be fully functional, however it uses a GIG :o of RAM!!

Does anyone have any suggestions for a good, moderately lightweight NetFlow Analyser app which isn't crippled to the point of non-functionality?
« Last Edit: May 18, 2010, 03:41:06 pm by Sambo »

Offline tacfit

  • Full Member
  • ***
  • Posts: 206
    • View Profile
Re: Best Package for Bandwidth Usage per IP
« Reply #6 on: November 28, 2010, 10:55:27 pm »
I have a similar need, and currently no ideas. We've got a shared connection for some people with a monthly cap, and each user is intended to pay their own monthly share. But it's not easy to tell who used what, each month.

Offline Sambo

  • Newbie
  • *
  • Posts: 6
    • View Profile
Re: Best Package for Bandwidth Usage per IP
« Reply #7 on: November 29, 2010, 12:16:59 am »
This might be blasphemy when said here, but I have now actually defected to an Astaro firewall which has built-in traffic accounting, although to be honest there are a couple of outstanding bugs which make this not completely functional at the moment (incomplete capture of total volumes & a 12 hour time offset).

Astaro is a really great free firewall which has all the features of pfSense and most of it's plugins in one complete package!

Offline tacfit

  • Full Member
  • ***
  • Posts: 206
    • View Profile
Re: Best Package for Bandwidth Usage per IP
« Reply #8 on: November 29, 2010, 12:02:34 pm »
Thanks for the tip, Sambo.