A way to play Azure output format "audio-16khz-128kbitrate-mono-mp3" in Java

Question

I used to get output format as "riff-24khz-16bit-mono-pcm" from Azure Test-to-Speech API service. Due to some technical changes the audio texts we are now getting is in audio-16khz-128kbitrate-mono-mp3.

Before this change we used to do following to play the audio from audio text:

    String stepTitle=soundData; // audioText output from Azure
    byte[] bytes = stepTitle.getBytes();
    Base64.Decoder decoder = Base64.getDecoder();

    byte[] decoded = decoder.decode(bytes);

    InputStream input = new ByteArrayInputStream(decoded);
    AudioInputStream audioInput = null;
    try {
        ///////// This line is giving exception ////////////////////////
        audioInput = AudioSystem.getAudioInputStream(input);
    } catch (UnsupportedAudioFileException | IOException e) {
        e.printStackTrace();
    } 

    AudioFormat audioFormats = new AudioFormat(
            AudioFormat.Encoding.PCM_SIGNED,
            24000,
            16,
            1,
            1 * 2,
            24000,
            false);

As mentioned above, while getting an audio input stream I am getting UnsupportedAudioFileException.

I have tried with mp3plugin.jar. But I think I was not able to get it to work correctly. Please help!

Answer 1

By referring to official TTS REST API documentation, I will exchange for a token with key, and use that token to convert text to speech. I will get a byte array of audio data, and then I use JLayer to play the audio.

Here is my sample:

public class TestTTS {

    static String key = "f1a0ea***********fa5e35";
    static String tokenEndpoint = "https://southeastasia.api.cognitive.microsoft.com/sts/v1.0/issueToken";
    static String serviceEndpoint = "https://southeastasia.tts.speech.microsoft.com/cognitiveservices/v1";

    public static String GetToken(){

        Map<String, String> headers = new HashMap<>();

        headers.put("Ocp-Apim-Subscription-Key",key);
        headers.put("Content-Type","application/x-www-form-urlencoded");

        try(CloseableHttpClient client = HttpClients.createDefault()){
            HttpPost post = new HttpPost(new URI(tokenEndpoint));
            for (String key : headers.keySet()) {
                post.setHeader(key, headers.get(key));
            }
            post.setEntity(new StringEntity(""));
            CloseableHttpResponse result = client.execute(post);
            return EntityUtils.toString(result.getEntity());
        } catch (URISyntaxException e) {
            e.printStackTrace();
        } catch (IOException e) {
            e.printStackTrace();
        }
        return "";
    }

    public static byte[] GetAudio(String token) {
        String content = "<speak version='1.0' xml:lang='en-US'><voice xml:lang='en-US' xml:gender='Female' name='en-US-JessaRUS'>Microsoft Speech Service Text-to-Speech API</voice></speak>";
        Map<String, String> headers = new HashMap<>();
        headers.put("Authorization","Bearer " + token);
        headers.put("Content-Type","application/ssml+xml");
        headers.put("X-Microsoft-OutputFormat"," audio-16khz-64kbitrate-mono-mp3");

        try(CloseableHttpClient client = HttpClients.createDefault()){
            HttpPost post = new HttpPost(new URI(serviceEndpoint));
            for (String key : headers.keySet()) {
                post.setHeader(key, headers.get(key));
            }
            post.setEntity(new StringEntity(content));
            CloseableHttpResponse result = client.execute(post);
            byte[] bytes = EntityUtils.toByteArray(result.getEntity());
            return bytes;
        } catch (URISyntaxException e) {
            e.printStackTrace();
        } catch (IOException e) {
            e.printStackTrace();
        }
        return new byte[0];
    }

    public static void main(String[] args) {
        byte[] bytes = GetAudio(GetToken());
        System.out.println(bytes.length);
        try(InputStream is = new ByteArrayInputStream(bytes)){
            Player player=new Player(is);
            player.play();
        } catch (IOException e) {
            e.printStackTrace();
        } catch (JavaLayerException e) {
            e.printStackTrace();
        }
    }
}

---

For JMF with mp3Plugin, I save the audio data to a temporary file, then play it.

    public static void PlayWithJMF(){
        Format input1 = new AudioFormat(AudioFormat.MPEGLAYER3);
        Format input2 = new AudioFormat(AudioFormat.MPEG);
        Format output = new AudioFormat(AudioFormat.LINEAR);
        PlugInManager.addPlugIn(
                "com.sun.media.codec.audio.mp3.JavaDecoder",
                new Format[]{input1, input2},
                new Format[]{output},
                PlugInManager.CODEC
        );

        try{
            FileOutputStream fos = new FileOutputStream("tmp.mp3");
            byte[] bytes = GetAudio(GetToken());
            System.out.println(bytes.length);
            fos.write(bytes);
            fos.flush();
            fos.close();
            File file = new File("tmp.mp3");
            javax.media.Player player = Manager.createPlayer(new MediaLocator(file.toURI().toURL()));
            player.start();
            while(true){
                if(player.getState() == 500){
                    player.close();
                    break;
                }
                Thread.sleep(500);
            }
        }catch (FileNotFoundException e) {
            e.printStackTrace();
        } catch (IOException e) {
            e.printStackTrace();
        } catch (NoPlayerException e) {
            e.printStackTrace();
        } catch (InterruptedException e) {
            e.printStackTrace();
        }
    }