...
This will bring up a new dialog, where you can configure every detail of the ribbon. If you have both add-ins installed, you will notice that “Jira” appears twice.
...
To remove the Office add-in ribbons from Outlook, just click the second Jira entry and then “Remove”. This will hide the buttons, but still let’s you use the Office add-in from your phone or on the web!
...