Dataflow Scio : can't get the string result as the local language

54 Views Asked by At

I'new for dataflow, Scala and apache beam. I have created the dataflow to read the result from text file. And need to pass the value to the decryption function.

But, my issue is when I get the result from decryption function. it can't show the Thai language.(It present like '??') And I noticed that if I call this function before using scio. it can show correctly. I don't sure what is it the root cause and how to fix it. Can anyone please suggest. Thank you so much.


        val c = "AAAADCeGmijmVRjgaC6s7UCgaPP0LAhvgvq9NKZc0BaNJs+G01xGy3s="
        val msgbytes = decrypt(c).getBytes("UTF-8")
        val msg = new String(msgbytes, "UTF-8")
        println("msgbefore",msg)
        val query = sc.parallelize(uris).map{
            row => 
                val msgbytesaf = decrypt(c).getBytes("UTF-8")
                val msgaf = new String(msgbytesaf, "UTF-8")
                println("msgbefore",msg)
                println("msgafter",msgaf)
}

enter image description here

0

There are 0 best solutions below