Momma Always Said Spiders Are Our Friends

Thu, Apr 17, 2008 at 12:05PM

We often hear the words spider crawl when we talk about search engines visiting our websites. Spiders periodically crawl your website at frequent intervals to index your website pages. They look at titles, Meta tags, and the keywords in them, and then follow your keywords throughout your website page. If you have no title or Meta tags, your site will not get index and the spiders will leave your website. 
After reading your title and Meta tag, they proceed to the content, searching for your keywords or bolded areas.  If your content does not match your keywords, they will move on, not index, and find the site spammy. They should be able to follow clear links to your other pages and continue crawling and looking for your keywords. When you add these links, it shows spiders that you have multiple pages of content on the subject. Making sure to have the links and keywords in the footer will encourage spiders to continue to the next page.
A spider crawl starts at top left of the page. So avoiding Javascript in that area will make sure they do not access the site and leave before they search for the title or Meta tags. Just as important is text content on each page, as they do not read photographs and graphics. It is also a problem having too much content on one page; the spider may skip most of it and move on. Being careful where and how you place your keywords is good SEO. Do not place keywords next to each other and consider spacing them throughout the page.
You want your website to be crawled by spiders from search engines. When spiders index your pages, this will allow your website to be reached by more users. When users search using your keywords, your website will appear higher on the list. This will increase traffic and page rank positioning of your website.

Bookmark & Share