Skip to content

Commit 8824f01

Browse files
authored
[DLStreamer] gvagenai: update model export requirements (#1544)
1 parent a720b3a commit 8824f01

File tree

1 file changed

+11
-39
lines changed
  • libraries/dl-streamer/samples/gstreamer/gst_launch/gvagenai

1 file changed

+11
-39
lines changed

libraries/dl-streamer/samples/gstreamer/gst_launch/gvagenai/README.md

Lines changed: 11 additions & 39 deletions
Original file line numberDiff line numberDiff line change
@@ -19,51 +19,23 @@ This sample builds GStreamer pipeline of the following elements:
1919
- `gvametapublish` for saving inference results to a JSON file
2020
- `fakesink` for discarding output
2121

22-
## MiniCPM-V Model Preparation
22+
## Model Preparation
2323

24-
You need to prepare your MiniCPM-V model in OpenVINO™ format, you can learn more from [Visual-language assistant with MiniCPM-V2 and OpenVINO™](https://github.com/openvinotoolkit/openvino_notebooks/blob/latest/notebooks/minicpm-v-multimodal-chatbot/minicpm-v-multimodal-chatbot.ipynb):
25-
26-
```bash
27-
optimum-cli export openvino --model openbmb/MiniCPM-V-2_6 --weight-format int4 MiniCPM-V-2_6
28-
```
29-
30-
Set the model path:
31-
32-
```bash
33-
export GENAI_MODEL_PATH=/path/to/your/MiniCPM-V-2_6
34-
```
35-
36-
## Phi-4-multimodal-instruct Model Preparation
37-
38-
You need to prepare your Phi-4-multimodal-instruct model in OpenVINO™ format, you can learn more from [Visual-language assistant with Phi-4-multimodal-instruct and OpenVINO™](https://github.com/openvinotoolkit/openvino_notebooks/blob/latest/notebooks/phi-4-multimodal/phi-4-multimodal.ipynb):
39-
40-
```bash
41-
optimum-cli export openvino --model microsoft/Phi-4-multimodal-instruct Phi-4-multimodal
42-
```
43-
44-
Set the model path:
45-
46-
```bash
47-
export GENAI_MODEL_PATH=/path/to/your/Phi-4-multimodal
48-
```
49-
50-
## Gemma 3 Model Preparation
51-
52-
You need to prepare your Gemma 3 model in OpenVINO™ format, you can learn more from [Visual-language assistant with Gemma 3 and OpenVINO™](https://github.com/openvinotoolkit/openvino_notebooks/blob/latest/notebooks/gemma3/gemma3.ipynb):
53-
54-
```bash
55-
optimum-cli export openvino --model google/gemma-3-4b-it Gemma3
56-
```
24+
> [!NOTE]
25+
> To install `optimum-cli` and other required dependencies for model export, refer to the respective OpenVINO™ notebook tutorials linked in the table below.
26+
> DL Streamer currently depends on OpenVINO™ GenAI 2025.3.0. For optimal compatibility, use the library versions specified in [export-requirements.txt](https://github.com/openvinotoolkit/openvino.genai/blob/releases/2025/3/samples/export-requirements.txt).
5727
58-
Set the model path:
28+
| Model | Export Command | Tutorial |
29+
|-------|----------------|----------|
30+
| **MiniCPM-V 2.6** | `optimum-cli export openvino --model openbmb/MiniCPM-V-2_6 --weight-format int4 MiniCPM-V-2_6` | [Visual-language assistant with MiniCPM-V2 and OpenVINO™](https://github.com/openvinotoolkit/openvino_notebooks/blob/latest/notebooks/minicpm-v-multimodal-chatbot/minicpm-v-multimodal-chatbot.ipynb) |
31+
| **Phi-4-multimodal-instruct** | `optimum-cli export openvino --model microsoft/Phi-4-multimodal-instruct Phi-4-multimodal` | [Visual-language assistant with Phi-4-multimodal-instruct and OpenVINO™](https://github.com/openvinotoolkit/openvino_notebooks/blob/latest/notebooks/phi-4-multimodal/phi-4-multimodal.ipynb) |
32+
| **Gemma 3** | `optimum-cli export openvino --model google/gemma-3-4b-it Gemma3` | [Visual-language assistant with Gemma 3 and OpenVINO™](https://github.com/openvinotoolkit/openvino_notebooks/blob/latest/notebooks/gemma3/gemma3.ipynb) |
5933

34+
After exporting the model, set the model path:
6035
```bash
61-
export GENAI_MODEL_PATH=/path/to/your/Gemma3
36+
export GENAI_MODEL_PATH=/path/to/your/model
6237
```
6338

64-
> [!NOTE]
65-
> For installation of `optimum-cli` and other required dependencies needed to export the models, please refer to the respective OpenVINO™ notebook tutorials linked in each model preparation section above.
66-
6739
## Running the Sample
6840

6941
**Usage:**

0 commit comments

Comments
 (0)