The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Download Latest Version 1.1.2 source code.zip (5.6 MB)
Email in envelope

Get an email when there's a new version of TextGen

Home / 1.1.2
Name Modified Size InfoDownloads / Week
Parent folder
1.1.2 source code.tar.gz 2023-11-02 5.5 MB
1.1.2 source code.zip 2023-11-02 5.6 MB
README.md 2023-11-02 543 Bytes
Totals: 3 Items   11.2 MB 0

1.1.2版本

  1. GPT模型支持了NEFTune给embedding加噪SFT训练方法,SFT中使用 --neft_alpha 参数启用 NEFTune,例如 --neft_alpha 5,示例代码:https://github.com/shibing624/textgen/blob/main/examples/gpt/training_llama_demo.py

  2. 兼容了 ChatGLM-6B 1,2,3 / Baichuan 1,2 / LLaMA 1,2 / BLOOM / Mistral / QWen 等GPT模型LoRA微调训练和预测,可以用于多轮对话微调训练

Full Changelog: https://github.com/shibing624/textgen/compare/1.1.1...1.1.2

Source: README.md, updated 2023-11-02