In the Settings app, go to System > Notifications & actions, find Outlook and turn off the toggle in the same row.
Personally, I found it better to let the toggle on, click the whole Outlook row and disable just the "Show notifications in action center" toggle on the page that appears. The notifications are still on, but they vanish from the Action center once the notification banner hides.
