In /etc/fail2ban/jail.local Change the default action line to:
action = %(action_)s
It is probably set to action = %(action_mwl)s which tells fail2ban to ban & send mail with whois report and relevant log lines to the destination email.
While action = %(action_)s will only ban, no notifications will be sent.