The smartmontools emails can be missed when they're sent only once and the disk gets kicked off its array.
We should add some more sticky notifications to icinga for failed/pre-failed disks.
https://github.com/thomas-krenn/check_smart_attributes looks like a decent candidate for such a check. The main sticking point will be generating the list of devices for which we want to add the check on each machine.