Mooncake: A KVCache-centric Disaggregated Architecture for LLM Serving
github.com

・

8 points

・

sarkory

・

2 days ago

1 comment