<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
		>
<channel>
	<title>Comments on: Crawling Jobs</title>
	<atom:link href="http://www.ysearchblog.com/2005/07/06/crawling-jobs/feed/" rel="self" type="application/rss+xml" />
	<link>http://www.ysearchblog.com/2005/07/06/crawling-jobs/</link>
	<description></description>
	<lastBuildDate>Fri, 20 Nov 2009 18:49:51 +0000</lastBuildDate>
	<generator>http://wordpress.org/?v=2.8.4</generator>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
		<item>
		<title>By: George Rogers</title>
		<link>http://www.ysearchblog.com/2005/07/06/crawling-jobs/comment-page-1/#comment-1493</link>
		<dc:creator>George Rogers</dc:creator>
		<pubDate>Tue, 26 Sep 2006 16:11:10 +0000</pubDate>
		<guid isPermaLink="false">http://ysearchblog.com/blog/2005/07/06/crawling-jobs/#comment-1493</guid>
		<description>What format is required for Yahoo to scrape jobs off of a corporate site?
</description>
		<content:encoded><![CDATA[<p>What format is required for Yahoo to scrape jobs off of a corporate site?</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Matthew Walden</title>
		<link>http://www.ysearchblog.com/2005/07/06/crawling-jobs/comment-page-1/#comment-1492</link>
		<dc:creator>Matthew Walden</dc:creator>
		<pubDate>Fri, 16 Dec 2005 18:16:04 +0000</pubDate>
		<guid isPermaLink="false">http://ysearchblog.com/blog/2005/07/06/crawling-jobs/#comment-1492</guid>
		<description>So Far I think its great!
Not only does it change the way people look for jobs but the niche boards are getting much greater exposure. We started TemporarEase.com a few months ago and the vertical search engines allow us to offer  greater exposure to our clients and compete with the bigger boards. It also helps our clients to limit their advertising costs substantially.

I do not think it is a Business killer though.

It will change the Job Search market and new  companies will grow and prosper. We have been signing up new companies daily that are willing to grow with us and accept a little less on the features side if they can save money especially on temporaries and contractors.

Change is Good!
</description>
		<content:encoded><![CDATA[<p>So Far I think its great!<br />
Not only does it change the way people look for jobs but the niche boards are getting much greater exposure. We started TemporarEase.com a few months ago and the vertical search engines allow us to offer  greater exposure to our clients and compete with the bigger boards. It also helps our clients to limit their advertising costs substantially.</p>
<p>I do not think it is a Business killer though.</p>
<p>It will change the Job Search market and new  companies will grow and prosper. We have been signing up new companies daily that are willing to grow with us and accept a little less on the features side if they can save money especially on temporaries and contractors.</p>
<p>Change is Good!</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Jobboardguy</title>
		<link>http://www.ysearchblog.com/2005/07/06/crawling-jobs/comment-page-1/#comment-1491</link>
		<dc:creator>Jobboardguy</dc:creator>
		<pubDate>Fri, 26 Aug 2005 19:30:17 +0000</pubDate>
		<guid isPermaLink="false">http://ysearchblog.com/blog/2005/07/06/crawling-jobs/#comment-1491</guid>
		<description>This is an idiotic move on Yahoo&#039;s part.

#1.  we caught them grabbing over 5 gigs of data.  guess what - now they&#039;re not welcome anymore.

Here&#039;s the relevant command for others who may feel abused:

/sbin/iptables -A INPUT -s 209.73.161.21 -j DROP

#2.  nobody ever developed a viable job board by stealing (&quot;aggregating&quot;) jobs from others.  - the jobs by the time you get them are old and out of data, and they&#039;re copyrighted anyway.

as if they couldn&#039;t learn from their, and others, past mistakes.
</description>
		<content:encoded><![CDATA[<p>This is an idiotic move on Yahoo&#8217;s part.</p>
<p>#1.  we caught them grabbing over 5 gigs of data.  guess what &#8211; now they&#8217;re not welcome anymore.</p>
<p>Here&#8217;s the relevant command for others who may feel abused:</p>
<p>/sbin/iptables -A INPUT -s 209.73.161.21 -j DROP</p>
<p>#2.  nobody ever developed a viable job board by stealing (&#8221;aggregating&#8221;) jobs from others.  &#8211; the jobs by the time you get them are old and out of data, and they&#8217;re copyrighted anyway.</p>
<p>as if they couldn&#8217;t learn from their, and others, past mistakes.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: jobs expert</title>
		<link>http://www.ysearchblog.com/2005/07/06/crawling-jobs/comment-page-1/#comment-1490</link>
		<dc:creator>jobs expert</dc:creator>
		<pubDate>Fri, 15 Jul 2005 21:43:18 +0000</pubDate>
		<guid isPermaLink="false">http://ysearchblog.com/blog/2005/07/06/crawling-jobs/#comment-1490</guid>
		<description>you have so little number of sites that you crawl, please do not tell me you maintain bots?

Last year were guys at yahoo who demonstrated you automatic metadata extraction from any html page in the same class and you blow them away... well now I think they will blow you back.
</description>
		<content:encoded><![CDATA[<p>you have so little number of sites that you crawl, please do not tell me you maintain bots?</p>
<p>Last year were guys at yahoo who demonstrated you automatic metadata extraction from any html page in the same class and you blow them away&#8230; well now I think they will blow you back.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Panayotis Vryonis</title>
		<link>http://www.ysearchblog.com/2005/07/06/crawling-jobs/comment-page-1/#comment-1489</link>
		<dc:creator>Panayotis Vryonis</dc:creator>
		<pubDate>Tue, 12 Jul 2005 07:25:30 +0000</pubDate>
		<guid isPermaLink="false">http://ysearchblog.com/blog/2005/07/06/crawling-jobs/#comment-1489</guid>
		<description>How about going the other way round? What if we had a microformat for CVs and Yahoo! crawled the net, gathered this info and presented it iin search results? &quot;I&#039;m looking for a web developer with 5+ experience, good knowledge of...&quot;

(from &lt;a href=&quot;http://vrypan.net/log/archives/2005/07/11/yahoo-hotjobs-crawling/&quot; rel=&quot;nofollow&quot;&gt;http://vrypan.net/log/archives/2005/07/11/yahoo-hotjobs-crawling/&lt;/a&gt; )
</description>
		<content:encoded><![CDATA[<p>How about going the other way round? What if we had a microformat for CVs and Yahoo! crawled the net, gathered this info and presented it iin search results? &#8220;I&#8217;m looking for a web developer with 5+ experience, good knowledge of&#8230;&#8221;</p>
<p>(from <a href="http://vrypan.net/log/archives/2005/07/11/yahoo-hotjobs-crawling/" rel="nofollow">http://vrypan.net/log/archives/2005/07/11/yahoo-hotjobs-crawling/</a> )</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: DeWitt Clinton</title>
		<link>http://www.ysearchblog.com/2005/07/06/crawling-jobs/comment-page-1/#comment-1488</link>
		<dc:creator>DeWitt Clinton</dc:creator>
		<pubDate>Fri, 08 Jul 2005 12:27:32 +0000</pubDate>
		<guid isPermaLink="false">http://ysearchblog.com/blog/2005/07/06/crawling-jobs/#comment-1488</guid>
		<description>Marc -- I think you make a good point about cannibalizing one&#039;s own market and this making it difficult for the HotJob&#039;s sales force.

However there is a bit of an ostrich-like approach in hoping that that sales force is ever going to be maximally effective.  In fact, if that sales force is less and less effective over time as more jobs are posted exclusively on company websites or on Craigslist, then HotJobs is just going to lose market share as *users* figure out what is going on and look elsewhere.  And a smaller market share will lead to fewer sales, right?

We&#039;ve seen the same thing time and time again -- services that once cost money are now being done for free.  (Craigslist is only one example, of course.)  And the successful companies are those that realize that things change over time and roll with those punches.  Because, on the Internet, if you don&#039;t do it then someone else will, whether you like it or not.

That said -- Yahoo can win big here (as can Indeed or Simply Hired, etc.) by adjusting faster and doing exactly what you say -- getting the &quot;right&quot; response out of all the garbage.  (Do I think that is easy?  No, of course not.  If it was, I wouldn&#039;t have a job.  Where, by the way, we are hiring...)

Cheers,

-DeWitt
</description>
		<content:encoded><![CDATA[<p>Marc &#8212; I think you make a good point about cannibalizing one&#8217;s own market and this making it difficult for the HotJob&#8217;s sales force.</p>
<p>However there is a bit of an ostrich-like approach in hoping that that sales force is ever going to be maximally effective.  In fact, if that sales force is less and less effective over time as more jobs are posted exclusively on company websites or on Craigslist, then HotJobs is just going to lose market share as *users* figure out what is going on and look elsewhere.  And a smaller market share will lead to fewer sales, right?</p>
<p>We&#8217;ve seen the same thing time and time again &#8212; services that once cost money are now being done for free.  (Craigslist is only one example, of course.)  And the successful companies are those that realize that things change over time and roll with those punches.  Because, on the Internet, if you don&#8217;t do it then someone else will, whether you like it or not.</p>
<p>That said &#8212; Yahoo can win big here (as can Indeed or Simply Hired, etc.) by adjusting faster and doing exactly what you say &#8212; getting the &#8220;right&#8221; response out of all the garbage.  (Do I think that is easy?  No, of course not.  If it was, I wouldn&#8217;t have a job.  Where, by the way, we are hiring&#8230;)</p>
<p>Cheers,</p>
<p>-DeWitt</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Tron</title>
		<link>http://www.ysearchblog.com/2005/07/06/crawling-jobs/comment-page-1/#comment-1487</link>
		<dc:creator>Tron</dc:creator>
		<pubDate>Fri, 08 Jul 2005 05:15:53 +0000</pubDate>
		<guid isPermaLink="false">http://ysearchblog.com/blog/2005/07/06/crawling-jobs/#comment-1487</guid>
		<description>indeed.com -- one search, ALL jobs ;)
</description>
		<content:encoded><![CDATA[<p>indeed.com &#8212; one search, ALL jobs ;)</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: David Lim</title>
		<link>http://www.ysearchblog.com/2005/07/06/crawling-jobs/comment-page-1/#comment-1486</link>
		<dc:creator>David Lim</dc:creator>
		<pubDate>Fri, 08 Jul 2005 01:19:25 +0000</pubDate>
		<guid isPermaLink="false">http://ysearchblog.com/blog/2005/07/06/crawling-jobs/#comment-1486</guid>
		<description>Sounds like a wonderful idea. Job hunting can probably be alot easier. Instead of going from search engine to search engine to look for jobs, job hunting can be much easier and stress free. I look forward to it.

-David Lim
</description>
		<content:encoded><![CDATA[<p>Sounds like a wonderful idea. Job hunting can probably be alot easier. Instead of going from search engine to search engine to look for jobs, job hunting can be much easier and stress free. I look forward to it.</p>
<p>-David Lim</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Marc Cenedella</title>
		<link>http://www.ysearchblog.com/2005/07/06/crawling-jobs/comment-page-1/#comment-1485</link>
		<dc:creator>Marc Cenedella</dc:creator>
		<pubDate>Fri, 08 Jul 2005 00:48:26 +0000</pubDate>
		<guid isPermaLink="false">http://ysearchblog.com/blog/2005/07/06/crawling-jobs/#comment-1485</guid>
		<description>Wow! What goes around comes around!

I was the head of BizDev and Corp. Development at HotJobs in 2000 - 2002.

Yahoo had a free job listings product that aggregated jobs from all over the web. Elizabeth Blair was running it.

Those of us from HotJobs tried to point out, over and over again, that what recruiters are looking for is not MORE and UNFILTERED response, it&#039;s the *right* response. And free listings just dont get you there. (The exception being jobs that are in the bottom half of pay, status, and advancement; the low quality of those jobs will naturally tend to discourage over-eager applicants).

Yahoo! was selling us on the idea of being the featured listing provider and have our listings appear, for a hefty annual fee, at the top of the rankings. We demurred, but Headhunter didnt and it drove them into a rush sale job (to CareerBuilder!) here&#039;s the wayback URL: &lt;a href=&quot;http://web.archive.org/web/20010604072348/http://careers.yahoo.com/&quot; rel=&quot;nofollow&quot;&gt;http://web.archive.org/web/20010604072348/http://careers.yahoo.com/&lt;/a&gt;

The new configuration is the old configuration.

It didn&#039;t work for Yahoo! then (psssst, that&#039;s why you guys bought us for $436 mm, remember?). And it&#039;s not going to work now.

I feel bad for the HotJobs salesforce because it won&#039;t take long for recruiters to wonder &quot;why the heck am I paying for listings when I can them for free?&quot;

This is a tremendous step back for the organization, I wish they&#039;d sought the input of us old HotJobs partisans! We hate seeing our beloved HOTJ in a weak, and declining, #3 position!
</description>
		<content:encoded><![CDATA[<p>Wow! What goes around comes around!</p>
<p>I was the head of BizDev and Corp. Development at HotJobs in 2000 &#8211; 2002.</p>
<p>Yahoo had a free job listings product that aggregated jobs from all over the web. Elizabeth Blair was running it.</p>
<p>Those of us from HotJobs tried to point out, over and over again, that what recruiters are looking for is not MORE and UNFILTERED response, it&#8217;s the *right* response. And free listings just dont get you there. (The exception being jobs that are in the bottom half of pay, status, and advancement; the low quality of those jobs will naturally tend to discourage over-eager applicants).</p>
<p>Yahoo! was selling us on the idea of being the featured listing provider and have our listings appear, for a hefty annual fee, at the top of the rankings. We demurred, but Headhunter didnt and it drove them into a rush sale job (to CareerBuilder!) here&#8217;s the wayback URL: <a href="http://web.archive.org/web/20010604072348/http://careers.yahoo.com/" rel="nofollow">http://web.archive.org/web/20010604072348/http://careers.yahoo.com/</a></p>
<p>The new configuration is the old configuration.</p>
<p>It didn&#8217;t work for Yahoo! then (psssst, that&#8217;s why you guys bought us for $436 mm, remember?). And it&#8217;s not going to work now.</p>
<p>I feel bad for the HotJobs salesforce because it won&#8217;t take long for recruiters to wonder &#8220;why the heck am I paying for listings when I can them for free?&#8221;</p>
<p>This is a tremendous step back for the organization, I wish they&#8217;d sought the input of us old HotJobs partisans! We hate seeing our beloved HOTJ in a weak, and declining, #3 position!</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: aaron wall</title>
		<link>http://www.ysearchblog.com/2005/07/06/crawling-jobs/comment-page-1/#comment-1484</link>
		<dc:creator>aaron wall</dc:creator>
		<pubDate>Thu, 07 Jul 2005 05:28:00 +0000</pubDate>
		<guid isPermaLink="false">http://ysearchblog.com/blog/2005/07/06/crawling-jobs/#comment-1484</guid>
		<description>that has got to be an eventual biz model killer

what happens when another well known company (say Google for example) comes along and creates the exact same service without all the internal infrastructure and internal listings?
</description>
		<content:encoded><![CDATA[<p>that has got to be an eventual biz model killer</p>
<p>what happens when another well known company (say Google for example) comes along and creates the exact same service without all the internal infrastructure and internal listings?</p>
]]></content:encoded>
	</item>
</channel>
</rss>
