Webmasters, tell us what we donít know
Having been to a couple of Search Engine Strategies conferences, I realized how much you look to search engines for information on how your content is indexed by them. Iíve heard stories of elaborate scripts that scrape search engines, using Ďsite:í, Ďlink:í and Ďlinkdomain:í queries to understand your contentís relationship to other pages on the web. Through these queries, Yahoo! provides unique information, but often there is more that you are looking for.
Today we are launching Site Explorer from Yahoo! Search, a webmaster tool we talked about at SES San Jose. WebmasterWorld and Search Engine Roundtable have been tracking it, and so have some folks on My Web. Currently, you can use Site Explorer to:
- Show all subpages within a URL indexed by Yahoo!, which you can see for stanford.edu, here. You can also see subpages under a path, such as for Professor Knuthís pages.
- Show inlinks indexed by Yahoo! to a URL, such as for Professor Knuthís pages, or for an entire site like stanford.edu.
- Submit missing URLs to Yahoo!
Site Explorer is geared towards your needs, providing 50 results by default, web services APIs, the ability to export the data to a TSV file for further analysis, as well as free submission for missing URLs.
Tell us what we donít know. If you donít find a URL that you expect to be in the index, use free submit. In case you hadnít heard, we are also accepting lists of URLs, so you donít have to provide us one URL at a time.
This is a starting set of features of what we hope becomes a truly valuable tool for you to interact with us. So please send us feedback, tell us how the product works for you, and let us know what else youíd like to see. Enjoy exploring, and tell us what you donít find!
Product Manager, Yahoo! Search