| |
By Michael Bloch
Before you submit your site to a search engine, you may want to consider what you want the search engine "bot" (the program that indexes your site) to "spider" (follow). You may have pages with sensitive information, or a scrap directory full of pages in progress that you would not like to see listed.
This can be achieved 2 ways. The first way is with a robots.txt file placed in the root directory of your web, but you must have full domain privileges in order for this to work. For further information, read our article on search engine spiders and robots.
- A quick note on the robots.txt file - do not leave it empty. This will indicate to some search engines that you do not want any part of the site indexed.
The other way to stop a number of bots from searching a page is to use META exclusion tags.
The following META tags can be used:
<META NAME="ROBOTS" CONTENT="NOINDEX">
Putting this line between the <head> and </head> tags in your HTML will prevent the bot from indexing that page.
An alternative is:
<META NAME="ROBOTS" CONTENT="NOFOLLOW">
The page will be indexed, but any hyperlinks in that page will not be spidered by the bot.
Or a combination of the two:
<META NAME="ROBOTS" CONTENT="NOINDEX,NOFOLLOW">
Page will not be indexed, and other links will not be followed by the bot. This tag may also prevent some web-stripper (mirroring) software programs from downloading the page.
Further learning resources:
Optimization and Search engines
Search engine optimization tutorials. Increase your web site traffic by gaining better page rankings.
Meta Tags and Zen (revised)
Easy to understand tutorial on the use of Meta Tags for boosting search engine rankings. An optimized set of meta-tags is an important component of any overall search engine strategy. ____________________________
Copyright information.... This article is free for reproduction but must be reproduced in its entirety with live links & this copyright statement must be included. Visit http://www.tamingthebeast.net for free Internet marketing and web development articles, tutorials and tools! Subscribe for free to our popular ecommerce/web design ezine!
About
the author
Michael Bloch
Taming the Beast
http://www.tamingthebeast.net
Tutorials, web content, tools and software.
Web Marketing, Internet Development & Ecommerce Resources
About
Top Traffic Wholesaler
website
Welcome to Top Traffic Wholesaler, Your No.1 Choice For the Best Web Targeted Traffic. Our targeted guaranteed traffic can provide you with instant customers interested in what you are offering. Increase sales, generate leads, establish new customers, and creating brand awareness.
Let us Advertise your Website!
Other Useful Articles
| |
Getting Lots of Online Traffic Is The Holy Grail Of Internet Marketing
Loads of internet traffic is the goal of every internet marketer but unfortunately it's easier said than achieved. The question at hand then (especially if you are new to internet marketing) is how do you increase internet traffic to your site?
There are three fundamental ways to get internet traffic to your site. Some of these methods have fairly rapid results, some are more long term and some are free while others will require you dipping into your pocket. Okay here goes...the following are the three main methods to increase internet traffic to your site:...
Read
this article
If you are aiming to increase your sales, expose your business and increase traffic to your website, a well-written press release can help you achieve that.
What is a press release? A press release is a condensed article that is written in a journalistic style. It is not a sales document or an advertisement....
Read
this article
Mr SEO's suggestions for getting out of the sandbox faster.
What is the Google sandbox? Some people may disagree that there is such a thing, but the Google sandbox does exist.. Here I will talk about what the Google sandbox is and ways to help avoid it, or, at the very least, shorten your time in it.
What is the Google Sand box?
...
Read
this article
|
TopTrafficWholeSaler.com
Greatest Place To Choose - Lowest Price To Get
Contact
us
Online Web Site Advertising
Website Targeted Traffic Service
Search
Engine Submission Service
|
