http://blog.v7n.com/2007/04/11/auto-detection-of-sitemaps-via-robotstxt/ Mon, 28 Sep 2009 22:23:47 -0700 http://wordpress.org/?v=2.8.5 hourly 1 http://blog.v7n.com/2007/04/11/auto-detection-of-sitemaps-via-robotstxt/comment-page-1/#comment-34238 Peter Da Vanzo Thu, 12 Apr 2007 23:14:56 +0000 http://blog.v7n.com/2007/04/11/auto-detection-of-sitemaps-via-robotstxt/#comment-34238 They could, but I guess they have the means already, if they're determined enough. They could, but I guess they have the means already, if they’re determined enough.

]]> http://blog.v7n.com/2007/04/11/auto-detection-of-sitemaps-via-robotstxt/comment-page-1/#comment-34200 ben Thu, 12 Apr 2007 03:27:42 +0000 http://blog.v7n.com/2007/04/11/auto-detection-of-sitemaps-via-robotstxt/#comment-34200 This is definitely a better idea than having to register at each service separately. I still wonder what the verdict is on sitemaps. There is one downside to this though, it allows anyone to see every url from a site (theoretically but not likely) and thus might find a previously hidden attack vector in a page vulnerable to an application vulnerability. This isn't that big of a drawback though, because you can probably safely assume that if a site has a vulnerable page it is in the google index. This is definitely a better idea than having to register at each service separately. I still wonder what the verdict is on sitemaps. There is one downside to this though, it allows anyone to see every url from a site (theoretically but not likely) and thus might find a previously hidden attack vector in a page vulnerable to an application vulnerability. This isn’t that big of a drawback though, because you can probably safely assume that if a site has a vulnerable page it is in the google index.

]]>