collapse

Author Topic: Spiders / Bots  (Read 1986 times)

0 Members and 1 Guest are viewing this topic.

Offline limitzero

  • DS User
  • Not So New
  • *
  • Posts: 7
  • Attack: 77
    Defense: 83
    Attack Member
Spiders / Bots
« on: September 12, 2012, 08:33:00 PM »
Hey

So I was wondering if it is a built in feature or additional mod we have to install to show the Spiders / Bots who are 'online'  I have noticed on some forums like Logooff that it would say 'Google Adsense' or 'Baidu' on the Users Online list. Any info regarding this will be helpful.

Thanks

Offline Skhilled

  • Administrator
  • Hero Member
  • *
  • Posts: 2586
  • Attack: 3025
    Defense: 2963
    Attack Member
  • Gender: Male
  • Retro Gamer!
    • Doc Skillz!
Re: Spiders / Bots
« Reply #1 on: September 13, 2012, 07:58:03 AM »
It's easy. Go to Admin -> Core Features and enable "Search Engine Tracking". Then go to Admin -> Members -> Search Engines -> Settings. There you can set how you want to see and log the them. You will only see the Search Engine menu if you enable it first.

The other menu items will give you stats and logs on what you have chosen. This is what I have here and what Rock has at logooff. You can also have it show to admin only like I have it here.


Offline limitzero

  • DS User
  • Not So New
  • *
  • Posts: 7
  • Attack: 77
    Defense: 83
    Attack Member
Re: Spiders / Bots
« Reply #2 on: September 13, 2012, 03:49:28 PM »
Thanks! I couldn't find this on SMF 1.1.x , but have found it on a dummy 2.x I have installed, great feature.

Offline Skhilled

  • Administrator
  • Hero Member
  • *
  • Posts: 2586
  • Attack: 3025
    Defense: 2963
    Attack Member
  • Gender: Male
  • Retro Gamer!
    • Doc Skillz!
Re: Spiders / Bots
« Reply #3 on: September 13, 2012, 08:53:47 PM »
Ah! I forget that you have SMF 1.1.x. That is only on SMF 2.x versions.


Offline beast

  • Vietnam Veteran
  • DS VIP
  • Sr. Member
  • *
  • Posts: 348
  • Attack: 0
    Defense: 0
    Attack Member
  • Gender: Male
  • So What
    • stumpburner
Re: Spiders / Bots
« Reply #4 on: September 14, 2012, 08:23:25 AM »


  Is there any speacil reason for wanting to see them?

 :dontknow:
thank [you] for reading my post





Offline Skhilled

  • Administrator
  • Hero Member
  • *
  • Posts: 2586
  • Attack: 3025
    Defense: 2963
    Attack Member
  • Gender: Male
  • Retro Gamer!
    • Doc Skillz!
Re: Spiders / Bots
« Reply #5 on: September 14, 2012, 08:34:51 AM »
to learn how they are crawling your site. You will want them to see the important things about your site. But there may be things that you do not want them to see and you can block it or allow it via a robots.txt file or a .htaccess file.

This way when you look up your site in a search engine the things you want people to see will be seen and the things you don't will not.


 

ordinary
ordinary
ordinary
ordinary