> ## Documentation Index
> Fetch the complete documentation index at: https://docs.generalrobotics.dev/llms.txt
> Use this file to discover all available pages before exploring further.

# LLaVA 

The `LLaVA` class provides a wrapper for the LLaVA model, which answers questions
about visual media (images) using the LLaVA framework.

<ResponseField name="class LLaVA()">
  <ResponseField name="use_local" type="boolean" default="False">
    If True, inference call is run on the local VM, else offloaded onto GRID-Cortex. Defaults to False.
  </ResponseField>
</ResponseField>

<ResponseField name="def run()">
  <ResponseField name="rgbimage" type="np.ndarray" required="True">
    The input RGB image of shape $(M,N,3)$.
  </ResponseField>

  <ResponseField name="prompt" type="str" required="True">
    The question to answer about the media.
  </ResponseField>

  <ResponseField name="Returns" type="str">
    The response to the prompt.
  </ResponseField>
</ResponseField>

<RequestExample>
  ```python Inference Call theme={null}
  from grid.model.perception.vlm.llava import LLaVA
  car = AirGenCar()

  # We will be capturing an image from the AirGen simulator 
  # and run model inference on it.

  img =  car.getImage("front_center", "rgb").data

  model = LLaVA(use_local = False)
  result = model.run(rgbimage=img, prompt=<prompt>)
  print(result)
  ```
</RequestExample>

<Tabs>
  <Tab title="License">
    This code is licensed under the Apache 2.0 License.
  </Tab>

  <Tab title="Source">
    [https://llava-vl.github.io/](https://llava-vl.github.io/)
  </Tab>
</Tabs>
