Contexte
The Université Toulouse 1 Capitole propose a blacklist managed by
Fabrice Prigent from many years, to help
administrator to regulate Internet use.
This database, often used in school, can be used with many commercial or free software.
Be careful : this list should not be seen as a "to be block". It must be seen as a "web categorization" : some categories can be blocked or allowed, depending on your environnement..
Licenses
This creation is available under un Creative Commons Contract.
Description
Many categories are defined, but it's the main one is "pornography".
We are actively working on the adult database, but you can help me with the others one.
I add between 50 and 300 urls per day.
A archive file contain all category :
blacklists.tar.gz
| Category | Number | Description |
|---|---|---|
| adult | 4642992 | Some adult site from erotic to hard pornography. |
| agressif | 394 | Some aggressive sites. |
| arjel | 69 | ARJEL which is a french certification authority for gambling sites |
| associations_religieuses | 1 | religious_association |
| astrology | 29 | Astrology |
| audio-video | 3866 | Some audio and video sites. |
| bank | 1896 | Online bank |
| bitcoin | 337 | Sites for bitcoin mining |
| blog | 1485 | Some blogs sites. |
| celebrity | 673 | Famous people, actors, and magazine which talk about them |
| chat | 264 | Chat site |
| child | 75 | Any website allowed to child (less than 10 years old) |
| cleaning | 177 | Sites to disinfect, update and protect computers. |
| cooking | 28 | Sites for cooking |
| cryptojacking | 16281 | Mining site by hijacking |
| dangerous_material | 50 | Sites which describe how to make bomb and some dangerous material. |
| dating | 4262 | Dating, matching site for single person |
| ddos | 421 | DDoS or Stresser Sites |
| dialer | 4 | Dialer Sites |
| doh | 3016 | Site which provides DNS over HTTP service |
| download | 4033 | Sites which propose to download software |
| drogue | 1066 | Sites relative to drugs. |
| dynamic-dns | 2076 | Site which provides dynamic-dns |
| educational_games | 11 | educational games sites (flash and online games ) |
| examen_pix | 347 | A list reserved exclusively for French students taking the PIX exam. DO NOT USE in other circumstances |
| fakenews | 1085 | Site which provides fakenews |
| filehosting | 939 | Websites which host files (pictures, video, ...) |
| financial | 472 | Sites relative financial information. |
| forums | 225 | Forums site. |
| gambling | 5661 | Gambling and games sites, casino, etc. |
| games | 35279 | games sites (flash and online games ) |
| hacking | 304 | Hacking sites. |
| jobsearch | 421 | Site to looking for job |
| lingerie | 138 | Sites for lingerie |
| liste_bu | 2904 | A french list for educational sites. VERY locally oriented. may help libraries. |
| malware | 130524 | Any website which deliver malware |
| manga | 838 | Any website related to manga, and cartoons |
| marketingware | 47 | Very special marketing sites |
| mixed_adult | 157 | Websites which contains adult sections unstructured |
| mobile-phone | 51 | Sites for mobile phone (rings, etc). |
| phishing | 130817 | Phishing sites (same as malware category) |
| press | 4574 | Any press (informational) site |
| publicite | 4644 | Advertisement. |
| radio | 540 | Internet radio sites |
| reaffected | 8 | Websites which have been reaffected |
| redirector | 132325 | Some redirector sites, which are used to circumvent filtering. |
| remote-control | 67 | site which allow remote control of user s dekstop |
| residential_proxies | Site which provides residential_proxies | |
| sect | 145 | Sect |
| sexual_education | 20 | Website which talk about sexual education, and can be misdetected as porn |
| shopping | 36880 | Any shopping, selling center |
| shortener | 474 | URLs shortening sites |
| social_networks | 704 | All social networks sites |
| sports | 2332 | Sports |
| stalkerware | 30 | Site which sells spying software for everybody |
| strict_redirector | 132053 | Same as redirector, but with google, yahoo, and other cache/images search robots. |
| strong_redirector | 132053 | Same as strict_redirector, but, for google, yahoo, we are only blocking some terms. |
| translation | 179 | Sites for translation |
| tricheur | 73 | Sites which are designed to explains cheating on exams. |
| tricheur_pix | 85 | DO NOT USE. It s a specific blacklist for french exam. |
| update | 33 | Update sites for software or OS |
| vpn | 5672 | VPN site |
| warez | 1507 | Warez sites. |
| webhosting | 14 | Site which provides webhosting |
| webmail | 413 | Webmail sites (hotmail like...) |
These lists contain certainly some mistakes. If you find some, send me a mail :
fabrice.prigent@ut-capitole.fr or you can use
this interface
https://dsi.ut-capitole.fr/cgi-bin/squidguard_modify.cgi.
How are these lists constituted
2 ways :
- Contributors (See below), send modifications
- Un spider crawl on Internet to find adult urls.
Contributors
This database exists because many contributors help :
- Alban Caporossi
- Alexandre Chevrier CSVT (for its contribution in games jeux)
- www.app3l.org Association...
- Barbagelata Pierre (MATICE - rectorat de Nice)
- Benjamin E. Nichols http://www.squidblacklist.org
- Benjamin Bellec
- Cedric Foll (Now with much more responsability)
- Charles COLLET
- Christian ORNAGHI
- Christophe Laverdure des "Apprentis d'Auteuil" for a tremendous works on nearly every category.
- David Garroux (CARIP de l'académie de Lyon)
- Deckert Florian
- Dilain Laurent
- Eric Jansen (hosting sites)
- Federico Ballarini (multiple category with italian sites)
- Francesco Mascaro
- Gotzon Astondoa, from http://www.wesify.com parental control app
- Hervé Bienvenu
- Hans Musil (German sites)
- Henrique Araujo (Many spanish adult sites)
- IAE pconline
- Jago27
- Jozef Skarba
- Kris Carlier
- Laura Corsaca
- Marc Kool (7% came from him)
- Marcos Manoni (Many spanish sites for adult, games and filehosting)
- Mark Bizzell
- Maxime Brunier(NITD)
- Michel Roiron
- Nicolas DELAMARRE NSI-ADMR (ADMR's information system dedicated enterprise)
- Philippe Ferreira
- Pierre Bardou du MiPih
- Rick Matthews
- Rogério Pinheiro da Silva
- Sean Riley
- Sylvain Vincent
- Sylvain Poidras
- Symon Aked
- Stéphanie Chevtchenko
- Société SOFIA Informatique
- Todd Sieland-Peterson
- Centre des Systèmes et Réseaux(Université Hassiba Benbouali CHLEF (Algeria))
- Yann Cézard (CRI - Université de Pau et des Pays de l'Adour) (games)
- Yann Guillemot
- And many anonymous one
malware and marketingware
These bases are based on the work of :- the great https://www.abuse.ch/
- malwarehunterteam http://cybertracker.malwarehunterteam.com
- cybercrime-tracker team http://cybercrime-tracker.net
- SAGA D.C. http://dns-bh.sagadc.org/
- Malekal http://www.malekal.com/
- the compilation of malware-domains : http://www.malware-domains.com
- ANSSI http://www.ssi.gouv.fr
- Local additions (mostly detected on honeypot, mail, virus, and so on);
Other database
Some database exist in other countries, but most of them have disappeared. Last ones :
- http://www.squidblacklist.org/,
- http://squidguard.mesd.k12.or.us/blacklists.tgz (mixed of bn-paf, our database and some local additions)
- http://www.shallalist.de/ squidguard maintainers,
- http://urlblacklist.com a commercial one.
How to download
- by http : http://dsi.ut-capitole.fr/blacklists/download
- by ftp : ftp://ftp.ut-capitole.fr/blacklist/
- by rsync : rsync://ftp.ut-capitole.fr/blacklist/ i.e.
cd /tmp mkdir tempo cd tempo rsync -arpogvt rsync://ftp.ut-capitole.fr/blacklist .
Other informations
- A more complete information on squidguard is available here.
- Squidguard in Pfsense has a problem with the size of the database. pfblockerNG (a specific package or pfsense) might be the solution: an explanation
