Removing the Webmin module would simply make it so it can no longer be managed from within Webmin.
Either you’d want to go into Services -> Bootup and Shutdown, and stop the service there – or, you’d want to remove the two packages relating to Fail2ban that we can see in your Comment #5 above.