Main Menu

Link Options

SEO Tool Box

Chili Stuff

Online Now

We have 162 guests online
JoomlaWatch Stats 1.2.7 by Matej Koval

Countries

24.3%UNITED STATES UNITED STATES
20.4%AUSTRALIA AUSTRALIA
17%CHINA CHINA

RSS Feed

Subscribe to ...
feed image

The SEO Vault is a repository for SEO Articles and information supplied by RSS Feeds from the top SEO Sites and Blogs in one easy to use location.
Registration Closed
Close



Sneek Peek @ Members Area

SEO Software & Tools

Recommended Free & Trial Software

Do you find LinkChili SEO Info Helpfull ?

Yes - 93.8%
No - 6.3%

Total votes: 16
The voting for this poll has ended on: 30 Dec 2011 - 00:00
Home SEO Article Vault Search Engine Guide Articles How do you get a specific Web page indexed?
How do you get a specific Web page indexed?
(0 votes, average 0 out of 5)
SEO Vault - Search Engine Guide Articles
Thursday, 26 February 2009 22:10

I've often been asked why particular pages are not indexed. Honestly, you can never be sure until you fix the problem. If you think that you've isolated the problem, you never know if you've only corrected one of multiple problems. So, it's best to take it step-by-step.

The first step is be sure that your page really is missing from the search index. (Throughout, I'll be talking about the search "index" but each engine has its own index, so you must check every blessed one individually.)

Most search engines allow the use of a special operator to reveal if a page is in the search index. As an example, if I wanted to know if a page from my Web site was indexed, I could search for "site:www.mikemoran.com/aboutmike/index.htm"--the search engine would show the page in its results if it is in the index.

Assuming that your page is not found using this method, the next step is to try to figure out why. One possibility is that most of your site is missing, which you can determine by a similar search, such as "site:www.mikemoran.com"--you can see how many pages are indexed. If it's very few, your problem is bigger than that single page.

Major site problems include:

  • Spam penalties. If you've been caught violating the search engines' terms of service (spamming), they'll drastically scale back the pages in the index until you beg for reinclusion.
  • Hidden links.If the navigation to your site is hidden within JavaScript, Flash, or other non-HTML methods, the search engine spiders are unlikely to be able to follow them.
  • Dynamic URLs. If your URLs are excessively long, or have many parameters, or contain ID or session parameters, the search engines might elect not to index them.
  • Incorrect robots.txt file. Your robots.txt file tells the search spider which pages to include and exclude from the crawling--if you've coded the file incorrectly, you might be excluding lots of pages you meant to include.

 

But what if it really is just this one pesky page that isn't being indexed? Some problems are likely to be confined to a single page:

  • Incorrect robots tagging. Just like the robots.txt file, a robots metatag tells the spider to include or exclude an individual page--you might be telling the spider to exclude the page by mistake.
  • User interaction required. If your page launches a pop-up window, or demands that a form be filled out, spiders won't be able to comply.
  • Improper redirects. If your page uses a meta refresh or JavaScript redirect, spiders ignore them and don't index the page.
  • Poor quality pages. If your page is excessively long, contains HTML coding errors, or uses frames, it's unlikely to be indexed correctly.

 

Once you've identified what's wrong, you can correct the problem and wait for the spiders to come back. Good luck getting all your pages indexed. Remember, if your page isn't in the index, it can never be found.

Author: Search Engine Guide


< Prev   Next >
 
LinkChili Blank