json_decode() fails on json string with more byte length than visible characters

Question

This does not work:

$jsonDecode = json_decode($jsonData, TRUE);

However if I copy the string from $jsonData and put it inside the decode function manually it does work.

This works:

$jsonDecode = json_decode('{"id":"0","bid":"918","url":"http:\/\/www.google.com","md5":"6361fbfbee69f444c394f3d2fa062f79","time":"2014-06-02 14:20:21"}', TRUE);

I did output $jsonData copied it and put in like above in the decode function. Then it worked. However if I put $jsonData directly in the decode function it does not.

var_dump($jsonData) shows:

string(144) "{"id":"0","bid":"918","url":"http:\/\/www.google.com","md5":"6361fbfbee69f444c394f3d2fa062f79","time":"2014-06-02 14:20:21"}"

But if count these character, there are only 124.

The $jsonData comes from a encrypted $_GET variable. To encrypt it I use this:

$key = "SOME KEY";

$iv_size = mcrypt_get_iv_size(MCRYPT_BLOWFISH, MCRYPT_MODE_ECB);
$iv = mcrypt_create_iv($iv_size, MCRYPT_RAND);

$enc = mcrypt_encrypt(MCRYPT_BLOWFISH, $key, $data, MCRYPT_MODE_ECB, $iv);

$iv = rawurlencode(base64_encode($iv));
$enc = rawurlencode(base64_encode($enc));

//To Decrypt
$iv = base64_decode(rawurldecode($_GET['i']));
$enc = base64_decode(rawurldecode($_GET['e']));

$data = mcrypt_decrypt(MCRYPT_BLOWFISH, $key, $enc, MCRYPT_MODE_ECB, $iv);

Answer 1

Most likely you need to strip off the padding from your decrypted data. There are 124 visible characters in your string but var_dump reports 144. Which means 20 characters of padding needs to be removed (a series of "\0" bytes at the end of your string).

Probably that's 4 "\0" bytes at the end of a block + an empty 16-bytes block (to mark the end of the data).

How are you currently decrypting/encrypting your string?

Edit:

You need to add this to trim the zero bytes at the end of the string:

$jsonData = rtrim($jsonData, "\0");

Answer 2

Judging from the other comments, you could use,

$jsonDecode = json_decode(trim($jsonData), TRUE);

Answer 3

In notepad+ I changed encoding of json file on: "UTF-8 without BOM". JSON started to work

Answer 4

While moving on php 7.1 I encountered with json_decode error number 4 (json syntex error). None of the above solution on this page worked for me.

After doing some more searching i found solution at https://stackoverflow.com/a/15423899/1545384 and its working for me.

//Remove UTF8 Bom

function remove_utf8_bom($text)
{
    $bom = pack('H*','EFBBBF');
    $text = preg_replace("/^$bom/", '', $text);
    return $text;
}

Answer 5

Maybe it helps someone, check in your json string if you have any NULL values, json_decode will not work if a NULL is present as a value.

This super basic function may help you. I made the NULL in an array just in case I need to add more stuff in the future.

function jsonValueFix($json){
    $json = str_replace( array('NULL'),'""',$json );
    return $json;
}

Answer 6

I just used json_decode twice and it worked for me

$response = json_decode($apiResponse, true);
$response = json_decode($response, true);

Answer 7

Try the JSON validator.

The problem in my case was it used ' not ", so I had to replace it to make it working.

Answer 8

some time there is issue of html entities, for example \" it will represent like this \&quot, so you must need to parse the html entites to real text, that you can do using html_entity_decode() method of php.

$jsonData = stripslashes(html_entity_decode($jsonData));

$k=json_decode($jsonData,true);

print_r($k);

Answer 9

Interestingly mcrypt_decrypt seem to add control characters other than \0 at the end of the resulting text because of its padding algorithm. Therefore instead of rtrim($jsonData, "\0") it is recommended to use

preg_replace( "/\p{Cc}*$/u", "", $data)

on the result $data of mcrypt_decrypt. json_decode will work if all trailing control characters are removed. Pl refer to the comment by Peter Bailey at http://php.net/manual/en/function.mdecrypt-generic.php .

Answer 10

I had an error when I sent from ajax sent JSON.stringify(localStorage.getItem('orderFormData')). json_decode worked as soon as I removed JSON.stringify and started sending just a string

Answer 11

Be sure to set header to JSON

header('Content-type: application/json;');

Answer 12

You have to use preg_replace for avoiding the null results from json_decode

here is the example code

$json_string = stripslashes(html_entity_decode($json_string));

$bookingdata =  json_decode( preg_replace('/[\x00-\x1F\x80-\xFF]/', '', $json_string), true ); 

Answer 13

Assuming $jsonString contains your JSON data with potential hidden characters. You can use following code to remove such characters before decoding.

$jsonString = '...'; // Your JSON data

// Removing BOM and trimming whitespace
$jsonString = preg_replace('/\xEF\xBB\xBF|\xFE\xFF|\xFF\xFE|\x00/', '', trim($jsonString));

// Decode the JSON
$result = json_decode($jsonString);

if ($result === null && json_last_error() !== JSON_ERROR_NONE) {
    echo 'JSON decode error: ' . json_last_error_msg();
} else {
    // Use $result after successful decoding
    var_dump($result);
}

Answer 14

I had problem that json_decode did not work, solution was to change string encoding to utf-8. This is important in case you have non-latin characters.

Answer 15

TL;DR Be sure that your JSON not containing comments :)

I've taken a JSON structure from API reference and tested request using Postman. I've just copy-pasted the JSON and didn't pay attention that there was a comment inside it:

...
"payMethod": {
    "type": "PBL" //or "CARD_TOKEN", "INSTALLMENTS"
},
...

Of course after deletion the comment json_decode() started working like a charm :)

Answer 16

USE THIS CODE

<?php 
   $json = preg_replace('/[[:cntrl:]]/', '', $json_data);
   $json_array = json_decode($json, true);
   echo json_last_error();
   echo json_last_error_msg();
   print_r($json_array);
?>

Answer 17

str_replace("\t", " ", str_replace("\n", " ", $string))

because json_decode does not work with special characters. And no error will be displayed. Make sure you remove tab spaces and new lines. Depending on the source you get your data, you might need also: stripslashes(html_entity_decode($string))

Works for me:

<?php

$sql = <<<EOT

    SELECT *
        FROM `students`;

EOT;
    $string = '{ "query" : "' . str_replace("\t", " ", str_replace("\n", " ", $sql)).'" }';
    print_r(json_decode($string));

?>

output:

stdClass Object
(
    [query] =>          SELECT *      FROM `students`;     
)

Answer 18

Make sure your JSON is actually valid. For some reason I was convinced that this was valid JSON:

{ type: "block" }

While it is not. Point being, make sure to validate your string with a linter if you find json_decode not te be working.