Netgate SG-1000 microFirewall

Author Topic: Guide to filtering web content (http and https) with pfsense 2.3  (Read 91443 times)

0 Members and 2 Guests are viewing this topic.

Offline vielfede

  • Jr. Member
  • **
  • Posts: 94
  • Karma: +2/-0
    • View Profile
Re: Guide to filtering web content (http and https) with pfsense 2.3
« Reply #135 on: December 05, 2017, 11:20:42 am »
sometimes splice all can show SSL errors when web browsing.
I'd say "often" a  lot of SSL errors!  ;)
In my opinion Splice All is not usable in the way it is now (without WPAD).

« Last Edit: December 15, 2017, 02:34:12 am by vielfede »

Offline originalsin

  • Newbie
  • *
  • Posts: 1
  • Karma: +0/-0
    • View Profile
Re: Guide to filtering web content (http and https) with pfsense 2.3
« Reply #136 on: December 20, 2017, 08:34:29 pm »
guess it is way too late for asking abbration.

But what does "Tic" stands for?

I can not find out the Tic in Pfsense and can not figure it out.

Plz somebody help me!!!

Offline aGeekHere

  • Sr. Member
  • ****
  • Posts: 535
  • Karma: +46/-1
    • View Profile
Re: Guide to filtering web content (http and https) with pfsense 2.3
« Reply #137 on: December 21, 2017, 05:12:04 pm »
Tick, select.
Never Fear, A Geek is Here!

Offline yaska

  • Newbie
  • *
  • Posts: 1
  • Karma: +0/-0
    • View Profile
Re: Guide to filtering web content (http and https) with pfsense 2.3
« Reply #138 on: December 21, 2017, 11:51:37 pm »
I have multiple vlans with different IP addresses 

VLAN_50 = 192.168.50.0
VLAN_60 = 192.168.60.0

How do I add all the IPs to the below section

function FindProxyForURL(url, host)
{
    if (isPlainHostName(host) ||
        shExpMatch(host, "*.local") ||
        isInNet(dnsResolve(host), "192.168.60.0",  "255.255.255.0"))
        return "DIRECT";
 
    return "PROXY 192.168.60.1:3128";
}

Offline shan52

  • Newbie
  • *
  • Posts: 6
  • Karma: +0/-0
    • View Profile
Re: Guide to filtering web content (http and https) with pfsense 2.3
« Reply #139 on: January 05, 2018, 01:43:22 pm »
Why is the difference between Squiguard and OpenDNS?

Offline vielfede

  • Jr. Member
  • **
  • Posts: 94
  • Karma: +2/-0
    • View Profile
Re: Guide to filtering web content (http and https) with pfsense 2.3
« Reply #140 on: January 08, 2018, 11:09:50 am »
Just one thing I can not get working:

Windows 7 updates, W7 detects them, but it's not able to download. I read something about here, but I do not know how to manage it.
https://wiki.squid-cache.org/SquidFaq/WindowsUpdate#Squid_with_SSL-Bump_and_Windows_Updates

Anyone with the same problem?
Solutions? Workarounds?
Thanks in advance

Offline shan52

  • Newbie
  • *
  • Posts: 6
  • Karma: +0/-0
    • View Profile
Re: Guide to filtering web content (http and https) with pfsense 2.3
« Reply #141 on: January 08, 2018, 02:13:53 pm »
We have lots of laptop and pc, is there an easier way to install the cert for all the devices?

Offline aGeekHere

  • Sr. Member
  • ****
  • Posts: 535
  • Karma: +46/-1
    • View Profile
Re: Guide to filtering web content (http and https) with pfsense 2.3
« Reply #142 on: January 08, 2018, 04:28:01 pm »
Quote
I have multiple vlans with different IP addresses 
I do not use vlans so I do not know, sorry

Quote
Why is the difference between Squiguard and OpenDNS?
Squiguard block content on rules you set on your router (totally private).
OpenDNS block content on rules you set on their servers (they see all traffic, also can be slower)

Quote
Just one thing I can not get working
Windows updates (as well as Mac and linux) should all be working, if it is not that you may have missed a step. Check that the WPAD is working and your pc is set to auto configure.
If it is still not working read though the guide again, it should work.

Quote
We have lots of laptop and pc, is there an easier way to install the cert for all the devices?
You only have to create a cert of squid when using splice all not for all devices

Hope this helps
Never Fear, A Geek is Here!

Offline DerHeldvomErdbeerfeld

  • Newbie
  • *
  • Posts: 1
  • Karma: +0/-0
    • View Profile
Re: Guide to filtering web content (http and https) with pfsense 2.3
« Reply #143 on: January 23, 2018, 04:24:53 am »
Hi there,

I just read this guide and also tried a little bit an the most I tried worked. Now I just have some
questions for better understanding.

1)
Guide to filtering web content (http and https) with pfsense 2.3 updated 09 June 2017

To stop users from bypassing your proxy setup a new firewall lan rule and block port 80 and 443
IPv4 TCP * * * 80 - 443 * none.
Save

If I set it up like this FROM 80 TO 443 (this is what it mean to me 80-443) didnt I block also all ports
between 80 and 443? Wouldnt it be better to set up two rules or an alias (Firewall/Aliases/Ports)
for the pot 80 and 443 or did I understood it wrong?

2)
I also want to use a dual wan configuration, is there something to take care of?



---
greets from Germany

DerHeldvomErdbeerfeld

Offline aGeekHere

  • Sr. Member
  • ****
  • Posts: 535
  • Karma: +46/-1
    • View Profile
Re: Guide to filtering web content (http and https) with pfsense 2.3
« Reply #144 on: January 24, 2018, 12:16:22 am »
hi
1. I created two rules, one for port 80 and one for 443 (I will update this part of the guide)

2. I do not think squid works on dual wan
Never Fear, A Geek is Here!

Offline Hermosillo

  • Newbie
  • *
  • Posts: 20
  • Karma: +3/-0
    • View Profile
Re: Guide to filtering web content (http and https) with pfsense 2.3
« Reply #145 on: January 25, 2018, 06:37:36 pm »
Hi, thanks for this guide it has helped me a lot, bear with me pls no bully, I just installed pfsense

"the wpad will be setup to use port 80 and 443. The transperrent proxy is going to catch every thing that the wpad misses, enable transperrent proxy in squid once you have the wpad setup."

shouldn't be "the proxy will be setup..."?

Guide is missing configuration of mime type, I don't know which file to edit. I've read other guides and most of them say something about adding mime types for .da, .dat and .pac (if it's not there already)

Anyways, my problem is that I cannot download the files so no HTTPS filtering for me. I've made a folder inside www called wpad "www/wpad"
I cannot reach wpad.mydomain.local/wpad/wpad.da nor any other. Ping to wpad.mydomain.local responds to firewall IP

It's probably something dumb like a firewall rule but I can't see it.

-I have changed access to GUI to port 9999 and HTTP
-squid and squidguard services up
-with MiTM enabled I can't access HTTPS sites (because no downloading of proxy files I guess)
-Im running pfblocker too
-pfsense is my DHCP and DNS server
-have two WAN (I've read it squid proxy doesn't work with dual wan but it is blocking http OK like this)

Can you help me to realize whats wrong with the downloading of files for wpad?

thanks.

Offline Hermosillo

  • Newbie
  • *
  • Posts: 20
  • Karma: +3/-0
    • View Profile
Re: Guide to filtering web content (http and https) with pfsense 2.3
« Reply #146 on: January 31, 2018, 12:00:35 pm »
Hi,

I managed to make it work by implementing another recurrent instance of nginx following another guide I found on the internet (I don't know if I'm allowed to post external links so I won't).

it seems to be working so far with 2 WAN's in load balance mode and it is filtering both http and https it seems with out MitM.

Thanks!

Offline J7529

  • Newbie
  • *
  • Posts: 3
  • Karma: +0/-0
    • View Profile
Re: Guide to filtering web content (http and https) with pfsense 2.3
« Reply #147 on: February 19, 2018, 04:42:48 am »
Hello,

Just following the Guide, I am getting a issue where when searching on https i get "This site can't be reached" and when browsing on http I get "The requested URL could not be retrieved" I am only trying to get to Google which is let through!

How I am currently setting up is behind a Router/Firewall and we already have a DNS server so I haven't enabled DNS Resolver, would this cause issues?

Thanks!

Offline MartinN

  • Newbie
  • *
  • Posts: 1
  • Karma: +0/-0
    • View Profile
Re: Guide to filtering web content (http and https) with pfsense 2.3
« Reply #148 on: March 10, 2018, 12:45:21 am »
Go to Services/DNS/Resolver/General Settings
in custom option enter

Code: [Select]
server:
include: /var/unbound/forecegoogle.conf

You have mis-spelled the filename here, which prevents it from being saved by pfSense. Please fix it  8)

Thanks for the guide, excellent stuff!

Offline aGeekHere

  • Sr. Member
  • ****
  • Posts: 535
  • Karma: +46/-1
    • View Profile
Re: Guide to filtering web content (http and https) with pfsense 2.3
« Reply #149 on: March 10, 2018, 04:36:57 am »
Fixed spelling
Never Fear, A Geek is Here!