| | |
| Stránka: 1 z 1
| [ Príspevkov: 6 ] | |
Autor | Správa |
---|
Registrovaný: 01.05.05 Príspevky: 13349 Témy: 1496 Bydlisko: Bratislava | Napísal JanoF: 14.10.2006 15:10 | |
|
Kód: ######################################################## ## Mod Title: Block Bad Bots ## Mod Author: FuNEnD3R < admin@funender.com > www.funender.com ## ## ## Mod Description: This simple robots.txt file will help deter some of the unwanted bots that spider your site for email ## addresses and things of that nature that result in spam. This works for all websites and it is not just limited to phpBB. ## This has also been configured to allow google adsense bots to spider your site if you use google ads. ## ## Mod Version: 1.00 released on June 14, 2004 ## Please visit the www.funender.com forums to view the demonstration ## ## ## Installation Level: simple ## Installation Time: 1 minute (few seconds actually) ## Files To Edit: N/A ## ## ## Included files: robots.txt ## ############################################################## ## For Security Purposes, Please Check: http://www.phpbb.com/mods/ for the ## latest version of this MOD. Downloading this MOD from other sites could cause malicious code ## to enter into your phpBB Forum. As such, phpBB will not offer support for MOD's not offered ## in our MOD-Database, located at: http://www.phpbb.com/mods/ ## ############################################################## ## Author Notes: It is important that you make sure to upload the robots.txt file into your website's root directory. ## Usually the root of your website is labeled as "public_html" or "www" If you are unsure I suggest for you to contact ## your host to find out which directory is your website's root. If you need help feel free to view this topic: ## ## http://www.funender.com/phpBB2/viewtopic.php?t=18577 ## For more information about bots visit http://www.robotstxt.org/ ## ## This may also be configured to block "good bots" from having access to certain pages as well. ## ## Even if you are already familar with robots.txt and are using this file on your site, you may want to copy a few of the ## known bots that are listed in the provided robots.txt file ## ############################################################## ## MOD History: ## ## 2004-14-04 - Version 1.00 ## - First release ## ############################################################## # #-----[ COPY ]------------------------------------------ #
robots.txt to your website's root directory.
# #-----[ UPLOAD FILE ]------------------------- # # EoM ROBOTS.TXTKód: User-agent: Mediapartners-Google* Disallow:
User-agent: BotRightHere Disallow: /
User-agent: WebZip Disallow: /
User-agent: larbin Disallow: /
User-agent: b2w/0.1 Disallow: /
User-agent: Copernic Disallow: /
User-agent: psbot Disallow: /
User-agent: Python-urllib Disallow: /
User-agent: NetMechanic Disallow: /
User-agent: URL_Spider_Pro Disallow: /
User-agent: CherryPicker Disallow: /
User-agent: EmailCollector Disallow: /
User-agent: EmailSiphon Disallow: /
User-agent: WebBandit Disallow: /
User-agent: EmailWolf Disallow: /
User-agent: ExtractorPro Disallow: /
User-agent: CopyRightCheck Disallow: /
User-agent: Crescent Disallow: /
User-agent: SiteSnagger Disallow: /
User-agent: ProWebWalker Disallow: /
User-agent: CheeseBot Disallow: /
User-agent: LNSpiderguy Disallow: /
User-agent: Alexibot Disallow: /
User-agent: Teleport Disallow: /
User-agent: TeleportPro Disallow: /
User-agent: MIIxpc Disallow: /
User-agent: Telesoft Disallow: /
User-agent: Website Quester Disallow: /
User-agent: WebZip Disallow: /
User-agent: moget/2.1 Disallow: /
User-agent: WebZip/4.0 Disallow: /
User-agent: WebStripper Disallow: /
User-agent: WebSauger Disallow: /
User-agent: WebCopier Disallow: /
User-agent: NetAnts Disallow: /
User-agent: Mister PiX Disallow: /
User-agent: WebAuto Disallow: /
User-agent: TheNomad Disallow: /
User-agent: WWW-Collector-E Disallow: /
User-agent: RMA Disallow: /
User-agent: libWeb/clsHTTP Disallow: /
User-agent: asterias Disallow: /
User-agent: httplib Disallow: /
User-agent: turingos Disallow: /
User-agent: spanner Disallow: /
User-agent: InfoNaviRobot Disallow: /
User-agent: Harvest/1.5 Disallow: /
User-agent: Bullseye/1.0 Disallow: /
User-agent: Mozilla/4.0 (compatible; BullsEye; Windows 95) Disallow: /
User-agent: Crescent Internet ToolPak HTTP OLE Control v.1.0 Disallow: /
User-agent: CherryPickerSE/1.0 Disallow: /
User-agent: CherryPickerElite/1.0 Disallow: /
User-agent: WebBandit/3.50 Disallow: /
User-agent: NICErsPRO Disallow: /
User-agent: Microsoft URL Control - 5.01.4511 Disallow: /
User-agent: DittoSpyder Disallow: /
User-agent: Foobot Disallow: /
User-agent: SpankBot Disallow: /
User-agent: BotALot Disallow: /
User-agent: lwp-trivial/1.34 Disallow: /
User-agent: lwp-trivial Disallow: /
User-agent: BunnySlippers Disallow: /
User-agent: Microsoft URL Control - 6.00.8169 Disallow: /
User-agent: URLy Warning Disallow: /
User-agent: Wget/1.6 Disallow: /
User-agent: Wget/1.5.3 Disallow: /
User-agent: Wget Disallow: /
User-agent: LinkWalker Disallow: /
User-agent: cosmos Disallow: /
User-agent: moget Disallow: /
User-agent: hloader Disallow: /
User-agent: humanlinks Disallow: /
User-agent: LinkextractorPro Disallow: /
User-agent: Offline Explorer Disallow: /
User-agent: Mata Hari Disallow: /
User-agent: LexiBot Disallow: /
User-agent: Web Image Collector Disallow: /
User-agent: The Intraformant Disallow: /
User-agent: True_Robot/1.0 Disallow: /
User-agent: True_Robot Disallow: /
User-agent: BlowFish/1.0 Disallow: /
User-agent: JennyBot Disallow: /
User-agent: MIIxpc/4.2 Disallow: /
User-agent: BuiltBotTough Disallow: /
User-agent: ProPowerBot/2.14 Disallow: /
User-agent: BackDoorBot/1.0 Disallow: /
User-agent: toCrawl/UrlDispatcher Disallow: /
User-agent: suzuran Disallow: /
User-agent: TightTwatBot Disallow: /
User-agent: VCI WebViewer VCI WebViewer Win32 Disallow: /
User-agent: VCI Disallow: /
User-agent: Szukacz/1.4 Disallow: /
User-agent: Openfind data gatherer Disallow: /
User-agent: Openfind Disallow: /
User-agent: Xenu's Link Sleuth 1.1c Disallow: /
User-agent: Xenu's Disallow: /
User-agent: Zeus Disallow: /
User-agent: RepoMonkey Bait & Tackle/v1.01 Disallow: /
User-agent: RepoMonkey Disallow: /
User-agent: Microsoft URL Control Disallow: /
User-agent: Openbot Disallow: /
User-agent: URL Control Disallow: /
User-agent: Zeus Link Scout Disallow: /
User-agent: Zeus 32297 Webster Pro V2.9 Win32 Disallow: /
User-agent: Webster Pro Disallow: /
User-agent: EroCrawler Disallow: /
User-agent: LinkScan/8.1a Unix Disallow: /
User-agent: Keyword Density/0.9 Disallow: /
User-agent: Kenjin Spider Disallow: /
User-agent: Iron33/1.0.2 Disallow: /
User-agent: Bookmark search tool Disallow: /
User-agent: GetRight/4.2 Disallow: /
User-agent: FairAd Client Disallow: /
User-agent: Gaisbot Disallow: /
User-agent: Aqua_Products Disallow: /
User-agent: Radiation Retriever 1.1 Disallow: /
User-agent: Flaming AttackBot Disallow: /
_________________ Streacom DA2 | SilverStone Titanium SX800-LTI 800W | ASRock X299E-ITX/ac | Intel Core i9-9980XE & be quiet! Dark Rock TF | Kingston HyperX Impact 64 GB DDR4 2666 MHz | NVIDIA Titan RTX 24 GB | Intel SSD Optane 905P 480 GB NVMe U.2 & Intel SSD 750 1,2 TB NVMe U.2 & Intel SSD 660p 2 TB NVMe M.2 & Seagate BackUp Plus Portable 56 TB USB | 55" 4K OLED Dell Alienware AW5520QF & 24" LCD EIZO FlexScan EV2451 | Ergotron LX Wall Mount Keyboard Arm | Logitech Craft | Logitech G603 | Logitech F710 | Harman Kardon Sabre SB 35 & Sennheiser RS 175 | Microsoft Windows 7 Ultimate | APC Back-UPS ES 700 | Lenovo ThinkPad X250 | iPhone X 256 GB & Pitaka Aramid | SilverStone ML05B Milo | Corsair SF600 SFX 600W | ASRock X99E-ITX/ac | Intel Xeon E5-2683 v4 & NOCTUA NH-L12S | Kingston HyperX Savage 32 GB DDR4 2400 MHz | NVIDIA GeForce GT 710 1 GB | Intel SSD Optane Memory 32 GB NVMe M.2 & Intel SSD 730 240 GB SATA | Ubuntu Server |
|
Registrovaný: 13.02.07 Prihlásený: 11.03.07 Príspevky: 2 Témy: 0 |
ahoj janof a ako to funguje aj na google robota ?
|
|
Registrovaný: 14.07.06 Prihlásený: 04.09.07 Príspevky: 959 Témy: 43 | Napísal Tom@S: 11.03.2007 21:09 | |
|
nie iba ny spyware robotov si pozri opis modu iba na tych co kradnu maile
|
|
Registrovaný: 13.02.07 Prihlásený: 11.03.07 Príspevky: 2 Témy: 0 |
Tom@S píše: nie iba ny spyware robotov si pozri opis modu iba na tych co kradnu maile no nevedel som sorky moja anglictina je slabsia a co by si mi odporucil na google robota ? lebo sa cezomna dostane aj tam kde by sa nemal dostat je ako nalepeny na mne
|
|
Registrovaný: 14.07.06 Prihlásený: 04.09.07 Príspevky: 959 Témy: 43 | Napísal Tom@S: 11.03.2007 23:29 | |
|
no to neviem ja som mu vdacny
|
|
Registrovaný: 01.05.05 Príspevky: 13349 Témy: 1496 Bydlisko: Bratislava | Napísal autor témy JanoF: 12.03.2007 0:34 | |
|
driver81 píše: no nevedel som sorky moja anglictina je slabsia a co by si mi odporucil na google robota ? lebo sa cezomna dostane aj tam kde by sa nemal dostat je ako nalepeny na mne ak mu chces zakazat nieco tak pomocou tohto mu das najavo ze nech tam nelozi
vytvor si robots.txt ktory bude obsahovat
Kód: User-agent: * Disallow: /zlozka/ Disallow: /nejakysubor.html
a nhraj do / adresara cize priamo do korenoveho adresara
//takto zakazes kazdemu fulltextu ktory bere ohlad na robots.txt aby liezol do niecoho kde nechces aby siel....
_________________ Streacom DA2 | SilverStone Titanium SX800-LTI 800W | ASRock X299E-ITX/ac | Intel Core i9-9980XE & be quiet! Dark Rock TF | Kingston HyperX Impact 64 GB DDR4 2666 MHz | NVIDIA Titan RTX 24 GB | Intel SSD Optane 905P 480 GB NVMe U.2 & Intel SSD 750 1,2 TB NVMe U.2 & Intel SSD 660p 2 TB NVMe M.2 & Seagate BackUp Plus Portable 56 TB USB | 55" 4K OLED Dell Alienware AW5520QF & 24" LCD EIZO FlexScan EV2451 | Ergotron LX Wall Mount Keyboard Arm | Logitech Craft | Logitech G603 | Logitech F710 | Harman Kardon Sabre SB 35 & Sennheiser RS 175 | Microsoft Windows 7 Ultimate | APC Back-UPS ES 700 | Lenovo ThinkPad X250 | iPhone X 256 GB & Pitaka Aramid | SilverStone ML05B Milo | Corsair SF600 SFX 600W | ASRock X99E-ITX/ac | Intel Xeon E5-2683 v4 & NOCTUA NH-L12S | Kingston HyperX Savage 32 GB DDR4 2400 MHz | NVIDIA GeForce GT 710 1 GB | Intel SSD Optane Memory 32 GB NVMe M.2 & Intel SSD 730 240 GB SATA | Ubuntu Server |
|
| Stránka: 1 z 1
| [ Príspevkov: 6 ] | |
| Nemôžete zakladať nové témy v tomto fóre Nemôžete odpovedať na témy v tomto fóre Nemôžete upravovať svoje príspevky v tomto fóre Nemôžete mazať svoje príspevky v tomto fóre
|
|