It seems it is possible to create client applications in the Dataverse space without using Low Code solutions.
For Power App Portals, which has "public" style licensing, the Application User that authenticates is off premise, and linked to a Contact record in the Customer Engagement/Portal applications.
Is it possible to write a Custom application (in JavaScript), authenticating a Customer Engagement Contact, perhaps through Azure AD B2C, OAuth, or even local authentication and access the CE data as them? Can App Permissions be utilized?
You can use Azure AD, instead of Azure AD B2C, for this scenario as documented here along with your custom JavaScript app.