It's great to see that I'm not the only person having problem with CouchDB's compaction failing when dealing with larger datasets.

I had the same exact experience during my master's thesis (hn: http://news.ycombinator.com/item?id=2022192 ) and this was one of the reasons why CouchDB didn't seem a good solution for a dataset that has a high number of updates.