跳到内容

vllm_gaudi.models

模块

名称 描述
gemma3_mm
utils

register_model 

register_model()
源代码位于 vllm_gaudi/models/__init__.py 
4
5
6
7
8
9
def register_model():
    from vllm_gaudi.models.gemma3_mm import HpuGemma3ForConditionalGeneration  # noqa: F401

    ModelRegistry.register_model(
        "Gemma3ForConditionalGeneration",  # Original architecture identifier in vLLM
        "vllm_gaudi.models.gemma3_mm:HpuGemma3ForConditionalGeneration")