How to authenticate your site with Yahoo!

If you followed the instructions on how to get indexed by Yahoo!, and checked if the site was listed, then you successfully submitted your site. But it does not stop there, you still need to authenticate your site with Yahoo to see what pages got indexed by Yahoo. If your site was not yet indexed by Yahoo!, you just wait, eventually Yahoo! will crawl and index your site.

Anyway, when I wrote the blog entry, How to Get Indexed by Yahoo!, last Tuesday, after submitting the site, you were supposed to be redirected to the page like the one in number 4.

But today, when I tested it, instead of that thank you page you will be redirected to another page, to the Authentication page right away. Yahoo! probably changed it so that you will not forget to authenticate the site. Perhaps, some really just submit the site and do not authenticate it.

Let me start again from the very beginning.

1. Login to your Yahoo! account.
URL: https://login.yahoo.com/

2. Then go to Site Explorer – My Sites page.
URL: https://siteexplorer.search.yahoo.com/mysites

How to authenticate your site with Yahoo!

3. Submit your site for free by typing the domain name at the one line form.

How to authenticate your site with Yahoo!

4. Then click “Add My Site” button.

5. Once you submitted the site, you will be redirected to the page like the one below:

How to authenticate your site with Yahoo!

It says:

To authenticate your site ownership, you can either add a META tag to your home page, or upload a verification file to your site, please follow the instructions below.

How would you like to authenticate your site?
– By uploading a verification file to my site.
– By adding a META tag to my home page.

6. Click the link to see the instructions and you will see the illustration below.

How to authenticate your site with Yahoo!

– If you click “By uploading a verification file to my site”. You will see the illustration below.

How to authenticate your site with Yahoo!

It says:

. Download (button) an authentication key (DO NOT change the file name or content):

If you have a problem with downloading the authentication key, please create a text file named y_key_ea2a9d1c73744911.html, and put the string 29f4d5e87a118513 into the file.

. Upload the verification file to your site.

Please upload the key file that you downloaded, or created yourself, at the root level of your site directory. The expected file path is
https://www.sehdi.com/y_key_ea2a9d1c73744911.html.

. When the file is uploaded, please click the button below to let us know that the authentication key is in place. We will authenticate your site within 24 hours.

Ready to Authenticate (button)

– If you click “By adding a META tag to my home page”. You will see the illustration below.

How to authenticate your site with Yahoo!

It says:

Copy the META tag listed below and paste it in your site’s home page:

<META name=”y_key” content=”29f4d5e87a118513″>

. The META tag must be within and near the beginning of the first <HEAD> section of the page, and before the first <BODY> section.

. When the META tag is added, please click the button below to let us know that the META tag is in place. We will authenticate your site within 24 hours.

Ready to Authenticate (button)

7. You have two choices either to upload a verification file via FTP or add a META tag to your home page.

– If you would like to upload a verification file, follow the instructions like at the one below. See number 6 for text.

How to authenticate your site with Yahoo!

Once you downloaded the file, open and check the content of the file.

Click the file and it will open in your browser.

Check the content of the file using “View Source” by clicking File menu, then look for “View Source”.

It should look like the one below:
<!DOCTYPE HTML PUBLIC “-//IETF//DTD HTML//EN”>
<HTML>
<!– 29f4d5e87a118513 –>
<HEAD>
<TITLE>
</TITLE>
</HEAD>
<BODY>
</BODY>
</HTML>

Do not change anything.

Open an FTP software and upload the file.

– If you would like to add a META tag to your home page, follow the instructions like at the one below. See number 6 for text.

How to authenticate your site with Yahoo!

Go to the header of your file and look for <head> and </head> before the </body>.

Put this key <META name=”y_key” content=”29f4d5e87a118513″> inside or in between the <head> and </head>.

It should look like the one below.

<head>
<META name=”y_key” content=”29f4d5e87a118513″>
</head>

If you are using XHTML instead of HTML, it is advisable to change the word META into small letters and put a closing tag before the greater than symbol. Put a space after the last quotation mark then forward slash.

It should look like the one below.

<head>
<meta name=”y_key” content=”29f4d5e87a118513″ />
</head>

8. Once you have done either of the two, go back to Yahoo! Site Explorer.

9. Click “Ready to Authenticate” button. The page will look like the one below while it is processing.

How to authenticate your site with Yahoo!

10. Once it is finished, you will be redirected to a page. You will see the illustration below.

How to authenticate your site with Yahoo!

It says:

Your site is pending authentication.

If you have added the META tag, please keep the tag <META name=\”y_key\” content=\”29f4d5e87a118513\” > in your site’s home page. We will revalidate your site ownership by checking this META tag regularly.

If you have uploaded the verification file, please keep the file y_key_ea2a9d1c73744911.html on your site root https://www.sehdi.com and do not change the content (29f4d5e87a118513).We will authenticate your site ownership by checking this file within 24 hours.

Download (button) an authentication key (DO NOT change the file name or content):

11. Give it a few hours. Yahoo! will authenticate your site ownership within 24 hours.

12. The next time you login at the Yahoo! Site Explorer, and you see the “green round with check symbol” under Status on the right side corresponding to the domain name, then your site has been authenticated.

13. Click the “green round with check symbol” and you will see the illustration below.

How to authenticate your site with Yahoo!

It says:

Your site has been authenticated.

If you have added the META tag, please keep the tag <META name=\”y_key\” content=\”29f4d5e87a118513\” > in your site’s home page. We will revalidate your site ownership by checking this META tag regularly.

If you have uploaded the verification file, please keep the file y_key_ea2a9d1c73744911.html on your site root https://www.sehdi.com and do not change the content (29f4d5e87a118513).We will authenticate your site ownership by checking this file within 24 hours.

Ready to Authenticate (button)

14. Click the domain name and you will see the illustration below.

How to authenticate your site with Yahoo!

It says:

Authentication Status: Verified

If you the see the illustrations like the ones in number 13 and 14, that’s it.

It is finished. Your site has been authenticated.

Well then, good luck!

Note:
The domain name sehdi.com should be the domain name that you submitted.
The text file and the meta key will be different. Yahoo! will automatically create those for you.

How to Get Indexed by Yahoo!

I already wrote about how to get indexed by Yahoo! on another blog. I just thought that since this site and its blog is about web design and web designing extends to search engine optimization, to getting a site or blog crawled and indexed by the search engines, I decided to write about how to get indexed by Yahoo! on this blog.

I also have written about how to get indexed by Google and how to get indexed by Bing at ProBlogit.com. I will write again regarding those two topics later on here at Sehdi.com after I finished writing about how to get indexed by Yahoo!.

So, how are we going to get Yahoo! indexed our blog or site?

Simple, by submitting the blog or site to Yahoo! search.

First of all, submitting a site or blog to Yahoo! requires registration. Make sure that you already have an account with Yahoo!

If you do not have an account with Yahoo!, sign up for a Yahoo! account first at
https://na.edit.yahoo.com/registration.

If you already have an account with Yahoo!, login to your account first so the submission will be easier than what I posted at ProBlogit.com on how to get indexed by Yahoo!.

I wrote there that you can submit a site to Yahoo! even if you are not logged in. But then you will still be redirected to sign in to Yahoo after you submitted a site for inclusion in Yahoo! search.

If you already have an account with Yahoo!, let us proceed:

1. Login to your Yahoo! account.
URL: https://login.yahoo.com/

2. Then go to Site Explorer – My Sites page.
URL: https://siteexplorer.search.yahoo.com/mysites

How to Get Indexed by Yahoo!

3. Submit your site for free.

Fill out the one line form provided near the button “Add My Site” situated on the right side.

How to Get Indexed by Yahoo!

4. Then click “Add My Site” button.

After you submitted the site, you will be redirected to the page shown below.

How to Get Indexed by Yahoo!

It says:

Thank you! Your URL has been added to our list of URLs to crawl. Please expect a delay of several weeks before your URL is crawled.

Note that in the effort to maximize the quality of search results that appear on Yahoo! and our other distribution partners, we do not add every submitted URL to our search index. Therefore we cannot make predictions or guarantees about whether your URL will appear as a search result.

That’s it. That is how simple it is to submit your site for inclusion in Yahoo! search.

To make sure that your site was really added, click “My Sites” at the sidebar on the left.

If the site is listed, then everything is fine.

If you do not see the site, fill out the one line form provided like in #3, then click “Add My Site” button.

That’s it.

Your site may need to be authenticated, so follow the instructions to authenticate your site.

On the other hand, my next topic on this blog will be on how to authenticate your site with Yahoo!.

If you cannot wait, then proceed and authenticate your site with Yahoo!.

Bear in mind though that Yahoo! will crawl and index your site whenever it wants. So there is no guarantee that your site or blog will be crawled and indexed or be included soon enough in Yahoo! search. But this is the process or method on how to get indexed by Yahoo! fast.

Before I end this, let me show you another way of submitting a site to Yahoo!.

1. Login to your Yahoo! account.
URL: https://login.yahoo.com/

2. Then go to Site Explorer – Submit.
URL: http://siteexplorer.search.yahoo.com/submit

How to Get Indexed by Yahoo!

3. You have two options:

Submit a Website or Webpage
Submit Site Feed

To submit a Website or Webpage, click the link and the page will be like the image below.

How to Get Indexed by Yahoo!

To submit a Site Feed, click the link and the page will be like the image below.

How to Get Indexed by Yahoo!

4. Submit your site for free.

Fill out the one line form provided near the button “Submit URL” or “Submit Feed” situated on the right side.

5. Then click “Submit URL” or “Submit Feed” button.

That’s it.

Fore more information on how to submit your site to Yahoo! search, read the details at the Yahoo! Search Submission.
URL: http://search.yahoo.com/info/submit.html

Get Indexed by Google and Bing Search Engines

You have a blog or site and you would like to promote it, but it has not been indexed by the search engines yet. What would you do then? Well, the simplest way to get your blog or site get promoted is to submit it to several search engines like Google and Bing, formerly MSN Live Search. The question now is how are you going to get Google and Bing index your blog or site.

I wrote about this topic, on how to get indexed by Google and Bing search engines at ProBlogit.com but I will discuss other sites too. Basically the method is the same for the blog to get indexed by both Google and Bing. I discussed at ProBlogit.com how ProBlogit.com got indexed by Google and how SofieHofmann.com got indexed by Bing.

How to get indexed by Google? Submit your site to Google. Join Google Webmaster Tools and add your blog or site. Write content often and link the blog entry from another blog internally and externally.

How to get indexed by Bing? Submit your site to Bing. Join Bing Webmaster Center and add your blog or site. Write content often and link the blog entry from another blog internally and externally.

Another site that got indexed by Bing is this site Sehdi.com which was considered by Bing not valid when I added the site at Bing Webmaster Center. I have the impression that because Sehdi.com is being hosted in Switzerland, it was considered invalid at the time when I added it on June 24, 2009. Other sites are being hosted in the United States, so there was no problem adding it to Bing Webmaster Center.

Despite not being able to add the site at the Bing Webmaster Center, Sehdi.com was still indexed by Bing. It was already crawled and indexed before but this time more pages appeared at the search results just like SofieHofmann.com. All I did was, I just submitted the site to Bing. I wrote content for Sehdi.com but not so often. Despite the irregularity, Bing and Google have indexed the site and blog regularly.

Another site especially its two recent blog entries that I wrote the other day and yesterday that got indexed by Google fast was Pandan.ph. Considering that I did not even link the two blog entries from any other blog. The two blog entries appeared on the sidebar though of SofieHofmann.com and that was it. Other than that, I did not do anything.

When I checked Google today with keywords “pandan police”, the blog entry Pandan police arrested former policemen suspected of robbery in Buruanga, Aklan appeared first on the first page of the Google search results. I also used other keywords such as “pandan cops”, “aklan robbery”, “buruanga robbery” and the blog entry appeared on the first page of the search results.

Get Indexed by Google and Bing Search Engines

Then I checked Google with keywords “pandan drag race” and the blog entry 2nd Invitational Calixto Zaldivar III Motorcycle Drag Race Cup 2008 in Pandan, Antique appeared also first on the first page of the Google search results. I also used keywords such as “calixto zaldivar”, “pandan invitational”, “pandan motorcycle race” and the blog entry appeared on the first page of the search results.

Get Indexed by Google and Bing Search Engines

Pandan.ph was already added a long time ago at the Google Webmaster Tools. It just goes to show that even if you do not submit your blog entry to Google again as long as Google already made a habit of crawling and indexing your blog, then your blog will appear in Google any time and in this case the latest blog entry was indexed by Google within 12 hours.

I just did not check it right away yesterday after I wrote the latest blog entry at Pandan.ph, so I really have no idea when did really Google index that particular latest blog entry. I just learned about it after 12 hours when I checked Google today.

Search Engine Bots Crawling Problem, Website Not Accessible

SofieHofmann.com was down for more than six (6) hours today. I was not sure what was happening as the other sites being hosted with the same server were and are fine, online and can be viewed unlike SofieHofmann.com. So I contacted Dreamhost support team. I guess people were still sleeping in the United States when I wrote so I got a reply a little bit late. Nevertheless, thanks to the support team of Dreamhost, I was able to fix the problem.

What happened? Well, it so happen that both Yahoo and Google were crawling SofieHofmann.com at the same time as what Patrick, the support guy from the support team pointed out and I never realized it. It was true because I also checked the raw.log file. He asked me to check “Goodies” and try to block or limit some search engine bots accessing the site.

Well, I already have a robots.txt file but have not updated it for quite some time now. When I checked my robots.txt, the list of folders inside that file were actually outdated. It never occurred to me that my robots.txt file was already outdated. I forgot to update it when I revised SofieHofmann.com.

So I uploaded the newly updated robots.txt file and used the Goodies as well. Just when I finished uploading the robots.txt file and filled out some stuff at the “Goodies” where “Block Spiders” is located, SofieHofmann.com was fine again.

What did I do? I just disallowed search engine bots to access the images and other folders by writing the name of the folders at the robots.txt file. Then, at the Control Panel of Dreamhost, at “Goodies > Block Spiders” section, I did not check what search engines to block but specified which directories to block from every spider. I also specified the file extensions to block from every spider. Yes, from every spider.

I do not really mind if the images at the site will not be crawled or indexed by the search engine bots. It is enough for me for the search engine bots to crawl the pages, the articles, and the blog entries.

How to disallow the search engines bots accessing some of the folders?

I just created, actually updated the text file called robots.txt and wrote the following:

User-agent: *
Disallow: /faq/
Disallow: /cgi-bin/
Disallow: /images/

In your case, if you would like to add more folders, just add them. I specified some more folders too. I just did not write everything at the example above.

Then I uploaded the file at the root folder. The asterisk (*) for the User-agent here means any spider, regardless if it is Yahoo, MSN, Google or whatever. I would like to limit all the search engine bots crawling the images folders and the other folders at the site, no exception.

When two big search engines are crawling a site at the same time, this is using up all the site’s connections and driving up the memory usage. For me, not allowing the search engine bots to crawl the images folders as I really have a lot of pictures at the site is not at all a problem.

The problem was so simple and it was such a discomfort not to be able to access the site. And I did not even realize that the solution was that simple too. If you have the same problem, well, check your robots.txt file.