https://pillumina.github.io/tags/ngram-embedding/ Recent content in Ngram-Embedding on CctoctoFX https://pillumina.github.io/imgs/icon_head.png https://pillumina.github.io/imgs/icon_head.png Hugo -- 0.148.2 en Tue, 07 Jul 2026 00:00:00 +0000 https://pillumina.github.io/posts/qa/longcat-2.0-qa/ Tue, 07 Jul 2026 00:00:00 +0000 https://pillumina.github.io/posts/qa/longcat-2.0-qa/ 美团 LongCat-2.0 架构 QA，覆盖 1.6T 参数分解、Dual-Sublayer 设计、Shortcut MoE、LSA 稀疏注意力三件套、N-gram Embedding、6D 并行训练。