ndarray greater than 15280 bytes

[sathiez]

Hi,
I am unable to send ndarray greater than 15280 bytes.

[ukclivecox]

Is this for gRPC or REST?

[sathiez]

REST

[ukclivecox]

Can you show the error and stack trace you are seeing from either the engine (service orchestrator) or your wrapped model?

[sathiez]

Hi,
Actually, if I send a ndarray with 19000 values, I am able to get a response/messag. For any array size more than 19000, I get no response/message. I don't get any error either.

[sathiez]

My request is
{"data":{"ndarray":'+str(img_array.tolist())+'}}

[ukclivecox]

What http code do you get back, 500. Does it say anything in it?
Can you check the logs of all the docker images running your graph to check for errors?

[sathiez]

Hi,
I am not getting any error message or any http code even nothing is displayed in log. Does REST have any size limit?

[ukclivecox]

You should get some response even if its a timeout.

Do you set the REST timeout explicitly?
Are you using the API Gateway or Ambassador?

I'm not aware of particular limits in the REST API flow although the individual components may have some, such as Ambassador, Flask etc.

[sathiez]

No I didn't set any timeout.
Yes I am using ambassador API Gateway

[ukclivecox]

With Ambassador you should get a timeout if the request takes more than 3secs by default.

[sathiez]

Even I am unable to receive ndarray in seldon api. But If I send a minimum number of arrays I can able to get the output properly.

[sathiez]

when I use curl and send the request I get "32152" . What does it mean?

[ukclivecox]

You'll need to give more detail on the full response.

[sathiez]

req.py
import cv2
import os
img_array = cv2.imread('imgpath')
os.system('curl -H "Content-Type: application/json" -d '{"data":{"ndarray":'+str(img.tolist())+'}}' http://localhost:8080/seldon/model/api/v0.1/predictions')

It doesnt give any error message or response/http message.
when i print(os.system(curl........)) it returned only 32512.