Why so many hits on /
I checked my logs and there several thousand requests for / vs. only a few hundred requests on my files. This seems like something the S3stat system is doing. In theory this is adding additional costs albeit not much. I'm just curious where those requests are coming from.
RickZaki
Thursday, March 20, 2008
I've seen this too on several accounts. My assumption would be that it has something to do with a file manager tool such as S3 Organizer, that is repeatedly asking for lists of files. Alternatively, it could be due to spiders crawling S3 buckets in the hopes of finding readable content.S3stat is responsible for several hundred hits a day against every bucket that it logs. However, since those hits are coming from an EC2 instance, Amazon does not charge for those hits or any associated bandwidth. We have the Webalizer reports configured to ignore this traffic (which can be a substantial fraction of daily traffic for smaller sites).In short, it's a bit of a mystery why traffic to "/" is so high for some buckets. I guess you could think of that key being your site's homepage, and assume that it will be hit randomly by spiders just because it is on the public facing internet.
Jason
Monday, March 24, 2008
[ reply to this topic ]
[ return to topic list ]
|