vllm-project/vllm

description:

A high-throughput and memory-efficient inference and serving engine for LLMs

url:

https://github.com/vllm-project/vllm

sshUrl:

git@github.com:vllm-project/vllm.git

homepage:

https://docs.vllm.ai

created_at:

2023-02-09

license:

Apache License 2.0

latest_release:

v0.6.4.post1

• README.md

notes