Menu
Back to Open Source

🐙 GitHub Detail

M

SimiaoZuo/MoEBERT

By SimiaoZuo

This PyTorch package implements MoEBERT: from BERT to Mixture-of-Experts via Importance-Guided Adaptation (NAACL 2022).

GitHub Python Apache License 2.0 Updated 11 Feb 2026

Live Snapshot

Stars

114

🍴

Forks

12

📄

License

Apache License 2.0

🧩

Type

Python

📘

About this open-source project

Live information fetched from GitHub.

This PyTorch package implements MoEBERT: from BERT to Mixture-of-Experts via Importance-Guided Adaptation (NAACL 2022).

🌿

Default Branch

master

🐞

Open Issues

5

👀

Watchers

114