Skip to content

DataStates/llm-inference

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
 
 
 
 
 
 

Repository files navigation

llm-inference

Contributions to accelerate and scale LLM inferences. For now, a simulator of vLLM scheduling strategy.

About

Contributions to accelerate and scale LLM inferences

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Languages