Yeah, it's weird, considering ModernBERT, which the Laya models are based on, supports 8192 context window.