単に、setup.pyで確認
| transformersのバージョン | transformersリリース日 | tokenizersのバージョン | その他のバージョン |
|---|---|---|---|
| v2.11.0 | Jun 2, 2020 | tokenizers == 0.7.0 | |
| v3.0.0 | Jun 30, 2020 | tokenizers == 0.8.0-rc4 | |
| v4.0.0 | Dec 1, 2020 | tokenizers == 0.9.4 | |
| v4.10.0 | Aug 31, 2021 | tokenizers>=0.10.1,<0.11 | "torch>=1.0","tensorflow-cpu>=2.3","tensorflow>=2.3","unidic>=1.0.2","unidic_lite>=1.0.7","numpy>=1.17" |
| v4.19.0 | May 12, 2022 | tokenizers>=0.11.1, !=0.11.3,<0.13 | "torch>=1.0", "tensorflow-cpu>=2.3","tensorflow>=2.3","unidic>=1.0.2","unidic_lite>=1.0.7","numpy>=1.17" |
| v4.22.0 | Sep 15, 2022 | tokenizers>=0.11.1,!=0.11.3,<0.13 | "torch>=1.0,!=0.12.0","tensorflow-cpu>=2.3","tensorflow>=2.3","unidic>=1.0.2","unidic_lite>=1.0.7","numpy>=1.17" |
| v4.31.0 | Jul 19,2023 | tokenizers>=0.11.1,!=0.11.3,<0.14 | "torch>=1.9,!=1.12.0","tensorflow-cpu>=2.6,<2.14","tensorflow>=2.6,<2.14",,"unidic>=1.0.2", "unidic_lite>=1.0.7","numpy>=1.17" |
コメント
役立つかな。。。。
