AutoSP: Long-Context LLM Training via Compiler-Based Sequence Parallelism

	▲	AutoSP: Long-Context LLM Training via Compiler-Based Sequence Parallelism(pytorch.org)
		1 points by matt_d 8 hours ago