Group alertmanager mails
It's annoying when alertmanager is spamming you with alert mails. If everything works it's great for infrequent alerts, but @janek also reported that he had over 200 mails in his inbox over the weekend. Currently we just have an option to enable smtp for all apps which use it.