lifecycle rules for logs

We process logfiles the next day, so we're theoretically done with them after 24-48 hours.

In practice though, we occasionally miss a day for technical reasons and need to reprocess at a later date. And, of course, if in the future we introduce a new report format that requires different data to be pulled from the raw logs, we'd need to go back and process them again. That in fact happened with customers who wanted to update all of their reports from our old Webalizer style onto the new Detailed reports that we rolled out at the end of 2013.

So the short answer, I guess, is that it's probably best to leave those logs in place unless you see enough traffic that they'll start to become a significant cost from a storage standpoint. A good intermediate solution might be to put a lifecycle rule in place to move them over to Glacier after a month. That way they'll be cheap to store, but recoverable in case we do ever need them again.