Sagemaker Runtime service "wrapping" content in a dictionary #588

cirocavani · 2022-10-18T21:58:32Z

Sagemaker Runtime service sends the body as a JSON Object with key "Body" and invocation body in value. This is different from boto3 where the content is sent as is (no extra JSON Object wrapping the payload).

Example:

using AWS: @service
@service Sagemaker_Runtime

body = Dict("feature1" => "value1")
response = Sagemaker_Runtime.invoke_endpoint(body, "sagemaker-endpoint")
# the content sent is `{"Body": {"feature1": "value1"}}` but the endpoint expects `{"feature1": "value1"}`

Workaround:

using AWS
using AWS.AWSServices: sagemaker_runtime

function invoke_endpoint(
    Body, EndpointName; aws_config::AbstractAWSConfig=global_aws_config()
)
    return sagemaker_runtime(
        "POST",
        "/endpoints/$(EndpointName)/invocations",
        Body;
        aws_config=aws_config,
    )
end

body = Dict("feature1" => "value1")
response = invoke_endpoint(payload, "sagemaker-endpoint")
# the endpoint receives `{"feature1": "value1"}`