Beyond Prediction: Tail-Aware Scheduling for LLM Inference

	▲	Beyond Prediction: Tail-Aware Scheduling for LLM Inference(yl3469.github.io)
		2 points by matt_d 7 hours ago