Access local Outlook running on client from a RemoteApp running on that client

Question

My program allows users to copy/paste whole emails from their Outlook client into my software. If my program runs as a local program I can basically us the following code to access the running Outlook instance and continue code logic from there:

Dim OL As Microsoft.Office.Interop.Outlook.Application 
OL = Microsoft.VisualBasic.Interaction.GetObject(, "Outlook.Application")

However, if my program runs as a RemoteApp I fail to access (from there) the local Outlook instance (the Outlook running locally on the users machine).

Trying something like this fails:

OL = Microsoft.VisualBasic.Interaction.GetObject("\\tsclient\c\Program Files\Microsoft Office\root\Office16\outlook.exe", )

This will throw an ActiveX exception. Path is correct and accessible.

How can I access that instance of Outlook from the RemoteApp?

Any help is greatly appreciated!