The pfSense Store

Author Topic: monitoring proxy server squid pfsense 2.0.1 ? how to  (Read 15257 times)

0 Members and 1 Guest are viewing this topic.

Offline bmironb

  • Full Member
  • ***
  • Posts: 129
  • Karma: +0/-0
    • View Profile
monitoring proxy server squid pfsense 2.0.1 ? how to
« on: May 05, 2012, 12:28:29 pm »
Hi,

  Is there any way to monitor traffic that is coming on wan interface when proxy is used ?
  I have a proxy server on wan working on a port(squid package), when somewhere is used my ext ip or dyn dns as a proxy on a specified port , can these traffic be monitorized from dashboard where squid is installed on pfsense 2.0.1 pc platform ? and if so how is there some package or something ? i also whant to see ips from pages that are accessed from where proxy is used(sorry for these expression i'm not sure if acessed pages are called 'states') ...can these be done somehow ?

Thanks !
« Last Edit: May 05, 2012, 12:45:49 pm by bmironb »

Online marcelloc

  • Hero Member
  • *****
  • Posts: 9996
  • Karma: +4/-0
    • View Profile
Re: monitoring proxy server squid pfsense 2.0.1 ? how to
« Reply #1 on: May 07, 2012, 02:49:03 am »
Sarg package has a real-time report viewer for squid.
squid built in cachemanager.cgi could be an option too.

Offline bmironb

  • Full Member
  • ***
  • Posts: 129
  • Karma: +0/-0
    • View Profile
Re: monitoring proxy server squid pfsense 2.0.1 ? how to
« Reply #2 on: May 07, 2012, 07:14:26 am »
Hi,
Thanks for your reply.
I installed package...but it's not working right now i get this:

Error: Could not find report index file.
Check sarg settings and try to force sarg schedule.

I have to create in /var/squid/logs/access.log but i don't know how

Online marcelloc

  • Hero Member
  • *****
  • Posts: 9996
  • Karma: +4/-0
    • View Profile
Re: monitoring proxy server squid pfsense 2.0.1 ? how to
« Reply #3 on: May 07, 2012, 07:24:48 am »
Enable squid logs on gui first.

Offline bmironb

  • Full Member
  • ***
  • Posts: 129
  • Karma: +0/-0
    • View Profile
Re: monitoring proxy server squid pfsense 2.0.1 ? how to
« Reply #4 on: May 07, 2012, 07:48:01 am »
Done, it' enable.
But i still get this Error: Could not find report index file.
                                Check sarg settings and try to force sarg schedule.
I add a schedule for one hour i also tryed a real time report...
I mention that right now proxy is not in use ! service is started but it's not use...(it's a proxy on wan)

Thanks

Online marcelloc

  • Hero Member
  • *****
  • Posts: 9996
  • Karma: +4/-0
    • View Profile
Re: monitoring proxy server squid pfsense 2.0.1 ? how to
« Reply #5 on: May 07, 2012, 08:12:16 am »
what you got on realtime tab?

Offline bmironb

  • Full Member
  • ***
  • Posts: 129
  • Karma: +0/-0
    • View Profile
Re: monitoring proxy server squid pfsense 2.0.1 ? how to
« Reply #6 on: May 07, 2012, 08:25:29 am »
See picture i pusshed show log
I think is not working because proxy is not use what should be in report if is not use....
But i don't know why i m getting index eror from above:( still after enable like you said ?

/var/squid/logs/access.log is there empty now but still...index error

Thanks ! I just saw that package is created by you and how is working in some posts....i didn't thought that will be so detailed
« Last Edit: May 07, 2012, 08:40:57 am by bmironb »

Offline bmironb

  • Full Member
  • ***
  • Posts: 129
  • Karma: +0/-0
    • View Profile
Re: monitoring proxy server squid pfsense 2.0.1 ? how to
« Reply #7 on: May 07, 2012, 11:27:27 am »
From other posts sarg is not using the right path...wich one is the good one /var/squid/log/access.log or /var/squid/logs/access.log ? i copied from /var/squid/logs/access.log in /var/squid/logs/access.log but still nothing...the same error with index

Online marcelloc

  • Hero Member
  • *****
  • Posts: 9996
  • Karma: +4/-0
    • View Profile
Re: monitoring proxy server squid pfsense 2.0.1 ? how to
« Reply #8 on: May 07, 2012, 01:26:55 pm »
The path on squid.conf by default is /var/squid/logs/access.log.

Offline bmironb

  • Full Member
  • ***
  • Posts: 129
  • Karma: +0/-0
    • View Profile
Re: monitoring proxy server squid pfsense 2.0.1 ? how to
« Reply #9 on: May 07, 2012, 01:39:57 pm »
realtime report is working :D i test it when proxy is in use is working fine :D but in view report i still get index error

Online marcelloc

  • Hero Member
  • *****
  • Posts: 9996
  • Karma: +4/-0
    • View Profile
Re: monitoring proxy server squid pfsense 2.0.1 ? how to
« Reply #10 on: May 07, 2012, 01:47:32 pm »
realtime report is working :D i test it when proxy is in use is working fine :D but in view report i still get index error

good news!

now, try to run sarg on console/ssh to see if it return erros.

Offline bmironb

  • Full Member
  • ***
  • Posts: 129
  • Karma: +0/-0
    • View Profile
Re: monitoring proxy server squid pfsense 2.0.1 ? how to
« Reply #11 on: May 07, 2012, 01:52:54 pm »
Result :

SARG: Records in file: 102, reading: 100.00%
SARG: Successful report generated on /usr/local/www/sarg-reports/2012/05/07

I checked and sites are there in report :D checked manually ...with edit file/browse

In system logs :

May 7 22:00:01   php: : Sarg: force refresh now with '' args and none action after sarg finish.
May 7 22:00:01   php: : The command '/usr/local/bin/sarg ' returned exit code '1', the output was 'SARG: Records in file: 103, reading: 0.00%^MSARG: cannot open /usr/local/www/sarg-reports/2012/05/07/sarg-date for writing SARG:: No such file or directory SARG: Records in file: 103, reading: 100.00%'
« Last Edit: May 07, 2012, 02:02:44 pm by bmironb »

Offline linuxmaniac

  • Newbie
  • *
  • Posts: 2
  • Karma: +0/-0
    • View Profile
Re: monitoring proxy server squid pfsense 2.0.1 ? how to
« Reply #12 on: May 17, 2012, 05:11:42 am »
Hai Guys,
I found why this error is happening. the sarg_reports.php is looking for the index.html file in sarg-reports/index.html, which is not there. Basically the default installation of sarg in Fedora and Centos is giving us a "report" directory format like the following. /var/www/html/reports/index.html.  This index.html is generated when using  "sarg -x " command ,which contains all the report details.

But in PfSense Sarg ,the  directory structure is little-bit different. I dont know why and how to solve this.If you are placing one index.html file in "/usr/local/www/sarg-reports/" ,the webconfigurator will show that "index.html" while taking "Status->sarg Reports-> View Reports".

The directory structure of Sarg in Pfsense is as this "sarg-reports/"year"/"month"/"date"/index.html"( Actual Sarg directory structure "sarg-reports/index.html" + lot of directory in "yyyy-mm-dd"). The configuration of this sarg_reports.php is given in sarg_frame.php,where the path of report file is given.

I am struck with this error ..Can any one give further tips in the topic............!!!

Thanks
Pramod

Offline Cino

  • Hero Member
  • *****
  • Posts: 1051
  • Karma: +0/-0
    • View Profile
Re: monitoring proxy server squid pfsense 2.0.1 ? how to
« Reply #13 on: May 17, 2012, 09:51:00 am »
fyi the lightsquid package also has realtime monitoring now

Online marcelloc

  • Hero Member
  • *****
  • Posts: 9996
  • Karma: +4/-0
    • View Profile
Re: monitoring proxy server squid pfsense 2.0.1 ? how to
« Reply #14 on: May 17, 2012, 01:59:37 pm »
linuxmaniac,

What options did you selected on sarg config page? did you created the schedules to run sarg?

I have reports working with these report options selected:

user graphics
remove temporary files
generate the main index
generate the index tree
overwrite report
use comma instead pint in reports
show de downloaded volume ond date/time reports


and all report to generate selected