...
Deleting an attachment looks like this. You click on the document you wish to delete and the blue hook disappears. This attachment will not be uploaded in your Jira issue.
In your Jira for Outlook settings you can change the automatic upload of your attachments. For example, you you can set that all attachments are not automatically uploaded. Then, you then need to select each required every single attachment individually if required for the issue.