I've had a few spots like that. Every time I opened it up, I found a worm.

Damage I've seen from worms looks a lot like bud rot.

And, yeah, not sure I'm diggin this outdoor stuff. Too much left to Nature. We all know what a fickle bitch she can be.