Search Engine Spiders
There are instances when a website purposefully doesn't want a specific page(s) within a site to be indexed. Using the website you have used for previous assignments (starting with LP-04), discuss the following:
a) Identify the site you are studying/using since LP-04
b) Identify at least 1 page on your site that would purposefully not be indexed. If the site does not yet exist, document the scenario that could occur that would require a page not be indexed.
c) Describe the steps you would take to keep this page from being indexed by search engines.
d) Respond to at least 1 other student's site identifying additional page(s) or circumstances that may warrant a page purposefully not being indexed -OR- describe another technique than previously stated from step c) that could be used to keep this page from being indexed.