Skip to content

You are viewing the latest developer preview docs. Click here to view docs for the latest stable release.

vLLM

vllm.lora

Initializing search

Home
User Guide
Developer Guide
API Reference
CLI Reference
Community

vLLM

Home
User Guide
Developer Guide
API Reference
API Reference
- API Reference
- Contents
  Contents
  - vllm.beam_search
  - vllm.collect_env
  - vllm.config
  - vllm.connections
  - vllm.env_override
  - vllm.envs
  - vllm.forward_context
  - vllm
  - vllm.jsontree
  - vllm.logger
  - vllm.logits_process
  - vllm.outputs
  - vllm.pooling_params
  - vllm.sampling_params
  - vllm.scalar_type
  - vllm.scripts
  - vllm.sequence
  - vllm.test_utils
  - vllm.tracing
  - vllm.version
  - adapter_commons
  - assets
  - attention
  - benchmarks
  - compilation
  - core
  - device_allocator
  - distributed
  - engine
  - entrypoints
  - executor
  - inputs
  - logging_utils
  - lora
    lora
    
    vllm.lora vllm.lora
    Table of contents
    
    lora
    
    vllm.lora.fully_sharded_layers
    
    vllm.lora.layers
    
    vllm.lora.lora
    
    vllm.lora.models
    
    vllm.lora.peft_helper
    
    vllm.lora.request
    
    vllm.lora.resolver
    
    vllm.lora.utils
    
    vllm.lora.worker_manager
    
    ops
    
    punica_wrapper
  - model_executor
  - multimodal
  - platforms
  - plugins
  - profiler
  - prompt_adapter
  - ray
  - reasoning
  - spec_decode
  - transformers_utils
  - triton_utils
  - usage
  - utils
  - v1
  - worker
CLI Reference
Community

Table of contents

lora

vllm.lora

Modules:

Name	Description
`fully_sharded_layers`
`layers`
`lora`
`models`
`ops`
`peft_helper`
`punica_wrapper`
`request`
`resolver`
`utils`
`worker_manager`

Made with Material for MkDocs