Be Dynamic, Be Confident — Yahoo! Search Supports You
Please excuse the dramatic start to this post. Between the anticipation of rolling this out and my incessant Harry Potter reading, I couldn’t resist.
Once upon a time, on the World Wide Web, all URLs were fixed strings — static in form. The idea of URL parameters then came along, allowing for database driven sites and session ids in URLs to create personalized experiences for users. At that time, the Web was alive with rich data and experiences. Then came the crawlers, which made it easier for users to navigate through the Web; however, they inevitably battled with dynamic URL parameters and every webmaster had to choose between a dynamic site and search traffic.
Today comes a new wave for search engines with the first-ever Beta launch of ‘Dynamic URL Rewriting’ in Site Explorer. The new feature provides the ability for site owners to alert Yahoo! of the dynamic parameters in URLs that they’d like Yahoo! to ignore, which we’ll then automatically rewrite accordingly. Try this out for all the cases where you’d want to use parameters in your URLs that don’t affect the content of your page, but that have other important uses.
How to get there?
- Login to Site Explorer from Yahoo! Search.
- Add to My Sites and then authenticate any sites that you own or manage.
- For any sites that you have authenticated, you’ll see a ‘Dynamic URLs’ tab.
- On this tab you can enter parameters you want us to either remove from URLs or always crawl with a specific value.
- Once you enter the parameter, we’ll show you the # of URLs we estimate will be affected.
- After you confirm the action, we’ll modify our crawler such that every time we see a URL from your site with that parameter, we’ll automatically rewrite it within our system as per your instruction.
So you might wonder what the feature really gives you. Utilizing the ‘Dynamic URL Rewriting’ feature enables:
- A more efficient crawl of your site, with fewer duplicate URLs being crawled.
- Better and deeper site coverage, as we’ll be able to use our crawler capacity to find and index more new content on your site.
- More unique content discovered, as we’ll handle more dynamic parameters in your URLs (if you remove the content-neutral dynamic parameters).
- Fewer chances of crawler traps, or web page sets that can cause an infinite number of requests or a poorly constructed crawler to crash.
- Cleaner and easier-to-read URLs displayed in the search results.
- Better site ranking due to reduced fragmentation of links and anchor text to your site’s pages.
Looking for more details on when to use URL parameters? Visit the Site Explorer Help page for additional background on the Beta feature to help define and omit what dynamic URLs Yahoo! should ignore.
We’re here to address any questions/ needs that you have, so let us know how it works for you.
Priyank Garg
for Lakis, Amit B., Amit S., Jay, Judy, Srikanth, Zheng
Yahoo! Search
Excellent! You guys keep catering to the people that write most of the content on the internet and you may just see a ground swell of endorsements and increase in market share.
Take that 100 million dollars that Ask wasted on advertising and put it into development into tools and interfaces for webmasters and you will have a huge machine pushing your services.
Google has a giant chink in their armor, complete lack of communication with the community that creates its content, you take advantage of that and in the long term you’ll win.
So, would that essentially perform the same function as doing a server-side 301 redirect?
Or is this better than a 301?
If you use 301 redirects on the server side targeted at our crawler, you will have avoided the duplicate crawling and indexing of content.
However, the web references to pages on your site can still be fragmented due to such parameters being present on them. This feature addresses that as well by making all those links refer to the real pages after rewrites (instead of different URLs for the same page).
We have seen from our research that users do read URLs to establish context of which site they are going to. There is other 3rd party research that supports that. Clean simple to read URLs can make a difference to the visibility of your search results
This is really a cool feature. I didn’t think we’d have any stray variables lying around but sure enough, there’s a referral id that was being found! It’s great that you give out the info on which parameters you suggest as well as the info on how many pages it will roughly effect if you type in your own parameter. This offers some very interesting data for analysis as well :)
I’m impressed and that’s not just to do with this. Your search results have less spam than G’s 8 out of 10 times…
This is really excellent, I have had some clients that have been wanting support for this.
Forgive me for being dense, but I’m logged in and I’m seeing my authenticated sites, but no where can I find the “Dynamic URLs” tab.
wow……this is a great new. I wonder if Google is going to follow you guys on this. Excellent job!
@Ben P: you need to click the [Manage] button for one of your authenticated sites and then you’ll get to the page where you can see the [Dynamic URLs Beta] tab.
What most people are asking now is why their website do not appear in Yahoo,when they rank top 10 in google. What’ so different in yahoo to do that. I can see those post “why I am not in yahoo” on every forum.
this tool is really cool! is there also a way to do this at googles?!?
Priyank Garg - are you saying that a 301 redirect would not pass on all the ‘link juice’ then?
A 301 redirect would pass all the link juice if the original URL form is crawled and as a result the new URL form is 301 redirected to. However, if you have the same page but different URLs with different session ids referred to across the web, the link juice of each of those URL references would not transfer to the final form till we finished crawling each of the original references.
With this tool, we would transfer the link juice the moment we see the form with session ids that are rewritten show up on the web without waiting for those URLs to be crawled. In some cases, we may choose not to crawl some of the URLs anyways due to crawl load and scheduling and this prevents that link juice being lost.
Great!
You really need to catch Google…
Keep up the good work
status: Invalid … Parameter too rare to validate the effect of this action !?!
this shows up in all my remove from url actions!
what does that mean? the site is authenticated …
THANK YOU, this is VERY helpful! The interface to manage the parameters is easy and FAST too–nice work!
MC
We offer thousands of products at below wholesale prices. Check us out today and save! Look at some of the things we have. Apple Ipods New And Refurb,Car Audio, Cd Players,Cellular Phones,Computers & Peripherals, Digital Cameras, Dj Equipment, Dvd Players, Fax Machines, Gps/cb Radio, Home Stereo Systems, Home Theaters, Televisions, Kids Electronics and alot more. Check us out at http://www.kforcestores.com and Save! We can set you up with your own online store like this. Anyone can make a sale on eBay, but not everyone can make a business out of it. Attention eBay Power Sellers! We can help you seek the perfect products at the lowest prices possible, for the greatest potential profits.
http://www.kforcestores.com
Hey yahoo,
It’s an excellent news. Now we don’t have to be worried about the way the dynamic URL is shown over the search engine. we can be sure that you will remove the dynamic characters…
Thanks Pal!
Is this just for newly added sites? I don’t see the tab for sites I currently have authenticated with Site Explorer.
I dont know how to proceed in the following matter, can you help
me?
I have my website authenticated in two diferent accounts, and in the first one, I already submit our sitemap. Right now, I am looking to move
it from the first account to this one (diretoriazura), How do I proceed?
Can I submit two diferent sources for the sitemap? Or I just have to move the feed to this one?
Best,
Marcelo
Does the yahoo links badge work? I just installed it & the badge is there but it doesn’t show the number of links to my site. Does it take some time before it does show? Help.
Here’s where I installed it;
http://olympicblogger.blogspot.com
Great idea. Am away to go and get all those horrid session ids etc off of some sites today - I’m useless in dot net so this should make this a bit simpler - if only everything could be on linus servers.
Thanks for this great and useful new feature. I definately looking forward to use it.
Hi..I don’t see the dynamic URLs tab. Should I be trying something else?
Site Explorer is awesome! It’s great to see you are trying to make this tool even better. What other cool things do you have planned?
Wow! No doubt that you’re on No.2 position after Google in online terms. Hoping for more new updates.
We are finally starting to realize how crucial yahoo is to our business.
Seems like a nice bone to toss. Although companies should be addressing this at their end, ideally (by doing their own rewriting). Actually, the point of my post was to promote decorative throw pillows, as well as to say nice job!
I think that a well structured web site with the right code (asp.net or php or everything you want) could certainly avoid the problems of the URL rewriting doing it internally and avoiding the necessity to use external resource like yours.
You have done probably a great job, but can a single search engine be the specific recipe to cure all the worst? I think no, and this is the reason IMHO for which a lot of webmaster won’t use this.
Bye
Yahoo Dynamic Url Rewriting and yahoo pipes are the most original services powered by Yahoo!
Innovate and dominate !!!
Its really nice…
I want to know, is this for yahoo only or for all search engines…
Yahoo Rocks! We love the new search and the site explorer. Keep up the good work.
I appreciate that you keep your site going and allow comments. To me feedback is an interesting part of a website.
I want to know, is this for yahoo only or for all search engines…
appreciate that you keep your site going and allow comments. To me feedback is an interesting part of a website
I appreciate that you keep your site going and allow comments. To me feedback is an interesting part of a website.
Yahoo rocks. I get most of my web services from yahoo.com
Thanks. This is a great feature that I’ve been looking for a mainly database website, hosted in a Windows environment.
Yahoo Dynamic Url Rewriting and yahoo pipes are the most original services powered by Yahoo! thanks yahoo :)
i havnt see the aboive mentioned “dynamic url”..in my siteexplorere page.?
How i got it?
A little off topic, but I have always avoided Flash graphics as search engines including Yahoo aren’t very good at reading them. Is there any way in the future that Yahoo could read Flash as they could normal test and include this in their crawling?
This is definitely a move in the right direction.
Dynamic URL rewriting is a good thing, and so is Harry Potter!
i havnt see the aboive mentioned “dynamic url”..in my siteexplorere page.?
I still don’t understand why are Dynamic URL’s are so beneficial.