pixano_inference.configs.vllm
Typed model params for vLLM-based models.
VLLMVLMParams(**data)
Bases: BaseModelParams
Typed parameters for VLLMVLMModel.
Attributes:
| Name | Type | Description |
|---|---|---|
path |
str
|
HuggingFace model ID or local checkpoint path. |
config |
dict
|
Kwargs for |
processor_config |
dict
|
Kwargs for |