Fail2ban
From MyWiki
fail2ban-client get postfix-spamers550 actionunban 111.222.333.444
I know I can work with IPTables directly: iptables -D fail2ban-ssh <number>
Use iptables -L -n to find the rule name then use fail2ban-client status to get the actual jail names. The rule name and jail name may not be the same but it should be clear which one is related to which.