Otherwise only pop and imap (un-secured) are blocked.
Which we don't use.

Don't mail them individually to the destemail. The destemail setting is thus no
longer used, but let's set it anyway to be clear where it will mail if you
change the action back.

Added friendly_networks variable to denote whitelisted networks

ignoreip field inside /etc/fail2ban/jail.local is populated with
server_ip_address variable

Removed your hardcoded server IP