STT Watson Python "Error received: [WinError 10014] The system detected an invalid pointer address in attempting to use a pointer argument in a call"

Question

Recently, I have attempted to create a program that can turn a live audio stream into text and search it for a keyword. I'd then like it to activate another listening function. My current code is as follows (without the second listening function):

from __future__ import print_function
import json
from os.path import join, dirname
from watson_developer_cloud import SpeechToTextV1
from watson_developer_cloud.websocket import RecognizeCallback, AudioSource
import threading

# If service instance provides API key authentication
# service = SpeechToTextV1(
#     ## url is optional, and defaults to the URL below. Use the correct URL for your region.
url='https://stream.watsonplatform.net/speech-to-text/api',
#     iam_apikey='your_apikey')

service = SpeechToTextV1(
    username='MY USERNAME',
    password='MY PASSWORD',
    url='https://stream.watsonplatform.net/speech-to-text/api')
"""
models = service.list_models().get_result()
print(json.dumps(models, indent=2))

model = service.get_model('en-US_BroadbandModel').get_result()
print(json.dumps(model, indent=2))

with open(join(dirname(__file__), 'audio-file.flac'),
          'rb') as audio_file:
    print(json.dumps(
        service.recognize(
            audio=audio_file,
            content_type='audio/flac',
            timestamps=True,
            word_confidence=True).get_result(),
        indent=2))
`"""
# Example using websockets
class MyRecognizeCallback(RecognizeCallback):
    def __init__(self):
        RecognizeCallback.__init__(self)

    def on_transcription(self, transcript):
        print(transcript)


    def on_connected(self):
        print('Connection was successful')

    def on_error(self, error):
        print('Error received: {}'.format(error))

    def on_inactivity_timeout(self, error):
        print('Inactivity timeout: {}'.format(error))

    def on_listening(self):
        print('Service is listening')

    def on_hypothesis(self, hypothesis):
        print(hypothesis)

    def on_data(self, data):
        print(data)

# Example using threads in a non-blocking way
mycallback = MyRecognizeCallback()
audio_file = open(join(dirname(__file__), 'audio-file.flac'), 'rb')
audio_source = AudioSource(audio_file)
recognize_thread = threading.Thread(
    target=service.recognize_using_websocket,
    args=(audio_source, "audio/wav; rate=44100", mycallback))
recognize_thread.start()

This code is currently returning the following error:

Error received: unable to transcode data stream audio/wav -> audio/x-float-array 
Error received: 'NoneType' object has no attribute 'connected'

Attached is everything that python has returned:

I am currently running x64 bit windows 10 with python 3.4.2

EDIT:

The error message now appears to have changed to the following:

Error received: unable to transcode data stream audio/wav -> audio/x-float-array 
Error received: [WinError 10014] The system detected an invalid pointer address in attempting to use a pointer argument in a call

Answer 1

EDIT: Your script doesn't work because you're mixing audio/wav with audio/flac. They are different formats, and not interchangeable.

Using this code will work, although I haven't tested running it through a thread.

with open("audio-file.flac", "rb") as audio_file:
    audio_source = AudioSource(audio_file)
    print("Sending file to Watson...")
    stt_auth.recognize_using_websocket( 
        audio=audio_source, 
        content_type="audio/flac", 
        recognize_callback=mycallback,
        interim_results=True, # Print all attempts, including not final responses.
    )

I would try to set up the thread with the filename as an argument. Note that I haven't tested this myself, but it should work.

def play_audiofile(name):
    with open("audio-file.flac", "rb") as audio_file:
        audio_source = AudioSource(audio_file)
        print("Sending file to Watson...")
        stt_auth.recognize_using_websocket( 
            audio=audio_source, 
            content_type="audio/flac", 
            recognize_callback=mycallback,
            interim_results=True, # Print all attempts, including not final responses.
        )

play_file_in_background = Thread(target=play_audiofile, args="audio-file.flac")
play_file_in_background.start()

while play_file_in_background.isAlive():
    pass  # Don't end until it has finished