Skip to content

fix(pd): balance prefill nodes on decayed recent load to avoid cache-affinity starvation - #1433

Closed
sufubao wants to merge 1 commit into
ModelTC:mainfrom
sufubao:fix/cache-aware-prefill-starvation
Closed

fix(pd): balance prefill nodes on decayed recent load to avoid cache-affinity starvation#1433
sufubao wants to merge 1 commit into
ModelTC:mainfrom
sufubao:fix/cache-aware-prefill-starvation

Commits

Commits on Aug 5, 2026