Hi Brashell;
That indeed must be very frustrating, sorry Autoptimize is giving you that much trouble!
That being said, if you deleted the plugin (i.e. wp-content/plugins/autoptimiz) there's nothing much it can do to your site; there's no rewrite-rules or changes to other files. The only other thing left to do is removing the files in wp-content/cache/autoptimize/* (if any).
Hope this helps,
frank