Adding / Removing Your URL
Adding Your URL
Warning! Before submitting any Web page to a search engine, you should make sure it is "search engine friendly". You can do this with our Free Meta Tag Analyzer.
Submitting your Web page to Scrub The Web is free. However no URL submission is guaranteed to be included in our index.
Use our Submit URL link, found on most every page. Simply fill out the form using your MAIN URL for your site. You may submit ONLY one URL per day. Submitting more often than this will result in your pages being rejected.
Scrub The Web is an index, NOT a promotional tool. Attempts to fill it with promotional material lowers the value of the index for everyone. We will remove all URL submissions from those who spam the index without notice and in extreme cases, we will ban them from future submissions.
How do I submit to Scrub The Web?
You can do this easily with our free on-line Easy Submit program or you can click on the Submit URL link found at the top of this page.
Why do you require an email address when submitting?
There are a couple of reasons why we require this. One reason we ask for this information is so we can send a verification email. The other reason is to help us combat automated/spam type submissions and softwares. Your email address is ONLY used in-house and we will NOT use your email address for any other promotional purpose. We do NOT sell or used your email address for any other reason!
If you have your "own" domain name (ie, your-own-domain-name.com), you have a better chance of being listed in the results pages at Scrub The Web than those site owners that do not.
Scrub The Web is NOT obligated to list your Web page(s) and we have every right to deny your submissions for any reason.
How long does it take to get my URL in Scrub The Web?
We are continually crawling our existing index as well as crawling new submissions around the clock. However, you should allow up to six weeks for inclusion in the index. Scrub The Web not only needs to index new submissions, but the existing database needs to be reviewed and updated as well and this all takes time.
I keep submitting, but I never find my site. Why not?
ScrubTheWeb.com is not obligated to index your submitted pages. Scrubby often randomly selects URLs to be included in the index. Do not email us asking Scrubby to index your site as these emails will be ignored.
How do I update my listing once it is in Scrub The Web?
Scrub The Web will refresh the database automatically over time. There is no need for you to do anything. If the content changes, the URL has moved or the URL is no longer available, it will be updated when Scrubby next visits the Web page.
I have moved and my URL is no longer available. How do I delete the old listing?
Scrub The Web will refresh the database automatically over time. There is no need for you to do anything. If the content changes, the URL has moved or the URL is no longer available, it will be updated when Scrubby next visits the Web page.
How does Scrub The Web determine which sites come up first when I do a search?
Each record gets a grade based on the relevancy of the search terms it contains when a searcher searches. For more information on our search technology click here.
How do I get my page to come up higher when someone is doing a search?
Simply make your submission a better match for likely queries. Use common keywords that describe what you are about. Then arrange these keywords and keyword phrases to help Searchers pinpoint their search to you. Choose your keywords carefully because the Web is growing and your chance of being ranked high as the result of a very vague keyword (say 'computer') are getting slimmer and slimmer.
How can I remove a page from Scrubby's index?
If you wish to exclude your entire website or a specific section (directory) of your server from Scrubby's index, you can place a file at the root of your server called robots.txt.
To prevent Scrubby and other search engines from crawling your site, place the following robots.txt file in your server root:
User-agent: *
Disallow: /
If you wish to only exclude Scrubby from indexing your site, place the following robots.txt file in your server root:
User-agent: Scrubby
Disallow: /
You can also remove individual pages using this same method. This is the standard protocol that most web crawlers observe for excluding a web server or directory from an index. More information on robots.txt is available at 
http://www.robotstxt.org/wc/norobots.html.
There is another standard for telling robots not to index a particular web page or follow links on it, which may be more helpful for some users, since it can be used on a page-by-page basis. This method involves placing a "Meta" element into a page of HTML.
Remember, changing your server's robots.txt file or changing the "Meta" elements on its pages will not cause an immediate change in what results Scrubby returns. It is likely that it will take a while for any changes you make to propagate to Scrubby's next index of the web.
For tips on how to improve your position on all major search engines including ScrubTheWeb.com, see our Members page for details.
How To Not Get Listed
- Typographical errors. Make sure you enter the Web address correctly. Double-check the spelling of the Web address before you submit. Enter it in your browser to make sure it works. Spaces are NOT allowed in a valid URL.
- The Website was inaccessible. Scrubby could not access the Website after several attempts. The Web server may be down or the site may have disappeared since you submitted it. Some host providers do a restart of servers and if this happens during the time Scrubby tries contacting your Website, you will not be indexed.
- You submit too often. Submitting the same URL more than once a week can and will prevent the site from being accepted. It is suggested you wait six weeks before submitting the same URL again and ONLY if the URL is not already in our index.
- Websites that employ practices such as trapping or serving unsolicited files/emails to user systems may be excluded from the index without notice.
Important: Remember that Scrub The Web is under no obligation to accept Websites you recommend for inclusion in the index. We reserve the right to remove or exclude pages from the index at any time, for any reason, or for no reason at all.