<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
		>
<channel>
	<title>Comments on: Twiceler</title>
	<atom:link href="http://www.internetofficer.com/web-robot/twiceler/feed/" rel="self" type="application/rss+xml" />
	<link>http://www.internetofficer.com/web-robot/twiceler/</link>
	<description>Tools and Articles for Webmasters and SEO's</description>
	<lastBuildDate>Thu, 22 Jul 2010 17:36:36 +0000</lastBuildDate>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
	<generator>http://wordpress.org/?v=3.2.1</generator>
	<item>
		<title>By: Bytetips</title>
		<link>http://www.internetofficer.com/web-robot/twiceler/comment-page-1/#comment-1518</link>
		<dc:creator>Bytetips</dc:creator>
		<pubDate>Thu, 18 Sep 2008 16:26:27 +0000</pubDate>
		<guid isPermaLink="false">http://www.internetofficer.com/web-robot/twiceler/#comment-1518</guid>
		<description>Is been two days Twiceler crawling my site constantly.. I decided to block this Bot. Now i know  how to block this Bot.I hope i can stop it.</description>
		<content:encoded><![CDATA[<p>Is been two days Twiceler crawling my site constantly.. I decided to block this Bot. Now i know  how to block this Bot.I hope i can stop it.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Quietust</title>
		<link>http://www.internetofficer.com/web-robot/twiceler/comment-page-1/#comment-1494</link>
		<dc:creator>Quietust</dc:creator>
		<pubDate>Thu, 28 Aug 2008 19:29:16 +0000</pubDate>
		<guid isPermaLink="false">http://www.internetofficer.com/web-robot/twiceler/#comment-1494</guid>
		<description>Interestingly, Twiceler does not seem to know how to follow HTTP &quot;301 Moved Permanently&quot; redirects.

My site currently gets very few hits from it (about 40 per week), but all of those hits are directed to a retired hostname which automatically supplies known bots with 301 redirects to equivalent URLs on its new hostname (other clients get a &quot;300 Multiple Choices&quot; so they read the page, followed by a 5 second Refresh if they don&#039;t click the link). Googlebot and Yahoo! Slurp understand them properly (they immediately rerequest it from the new URL and update their index), but when Twiceler receives a 301 response, it simply gives up and goes to the next page in its list without ever following the redirect.

I don&#039;t know if it&#039;s smart enough to follow temporary redirects (302 and 303), since I don&#039;t use them anywhere on my site (except for login forms and such, which bots aren&#039;t going to follow).</description>
		<content:encoded><![CDATA[<p>Interestingly, Twiceler does not seem to know how to follow HTTP &#8220;301 Moved Permanently&#8221; redirects.</p>
<p>My site currently gets very few hits from it (about 40 per week), but all of those hits are directed to a retired hostname which automatically supplies known bots with 301 redirects to equivalent URLs on its new hostname (other clients get a &#8220;300 Multiple Choices&#8221; so they read the page, followed by a 5 second Refresh if they don&#8217;t click the link). Googlebot and Yahoo! Slurp understand them properly (they immediately rerequest it from the new URL and update their index), but when Twiceler receives a 301 response, it simply gives up and goes to the next page in its list without ever following the redirect.</p>
<p>I don&#8217;t know if it&#8217;s smart enough to follow temporary redirects (302 and 303), since I don&#8217;t use them anywhere on my site (except for login forms and such, which bots aren&#8217;t going to follow).</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Alex Higgins</title>
		<link>http://www.internetofficer.com/web-robot/twiceler/comment-page-1/#comment-1460</link>
		<dc:creator>Alex Higgins</dc:creator>
		<pubDate>Wed, 30 Jul 2008 06:22:31 +0000</pubDate>
		<guid isPermaLink="false">http://www.internetofficer.com/web-robot/twiceler/#comment-1460</guid>
		<description>Twiceler&#039;s such engine just launched at cuil.com and are being touted as the new Google.  What a joke, what until all these buried posts about how the the twiceler bot has been abusing webmasters over the last year start to surface.</description>
		<content:encoded><![CDATA[<p>Twiceler&#8217;s such engine just launched at cuil.com and are being touted as the new Google.  What a joke, what until all these buried posts about how the the twiceler bot has been abusing webmasters over the last year start to surface.</p>
]]></content:encoded>
	</item>
</channel>
</rss>

