GRID Docs | General Robotics

Locate points in an image matching a spatial-referring query.

Parameters

Union[str, Image.Image, np.ndarray]

required

RGB image.

str

required

Spatial-referring query.

float | None

Optional HTTP timeout.

Returns

Dict[str, Any]: {"output": {"points": [[x, y], ...]}} in pixel coordinates.

Example

from grid_cortex_client import CortexClient, ModelType
client = CortexClient()
result = client.run(ModelType.ROBOREFER, image_input=image,
                    prompt="the free area between the two boxes")
print(result["output"]["points"])

Overview

Cortex Models

roborefer

Parameters

Returns

Example

​Parameters

​Returns

​Example

Parameters

Returns

Example