How to add a Amazon polly TTS and speech marker to a 3D model build in MAYA?

Question

We have a web application which loads a 3D model(Build in MAYA) in the browser using Three.js. I need the following things to be added,

1. Text To Speech using Amazon Polly.
2. Get the Speech Marker from Amazon Polly and then the 3D model needs to use the Speech Marks and Whispering features that are available in Amazon Polly.

I have googled regarding it and found https://aws.amazon.com/sumerian/features/. In Amazon sumerian we have a feature called Sumerian Hosts, but it has predefined models.

So my question is it possible to integrate TTS with speech marks using Amazon Polly for 3D model build in MAYA using Three.js for web application build in nodejs.

Answer 1

In Amazon Sumerian you can import .obj files, .mtl files, meshes, materials, and textures using a single drag and drop. Also, Sumerian can be integrated with Amazon services like Lex, Polly etc.

To have a brief idea about the functionality that can be done using Amazon Sumerian please go through https://docs.sumerian.amazonaws.com/

I guess what you are looking for could be achieved in some other way also without using Sumerian but you can try once by importing your model in Sumerian and see whether you have the functionality of controlling the model like you wanted or not.

Do let me know if you are able to integrate Sumerian with you web app.