Fail2ban needs to be enabled explicitly on Ubuntu 22.04
https://forum.howtoforge.com/threads/fail2ban-not-autostart-on-ispconfig-3-2-9p1.90980/#post-448968
But I guess we can just run "systemctl enable fail2ban" on all distributions and versions as it does not harm even if its already enabled by default.