Skip to content

Commit 776366f

Browse files
committed
fix typo
1 parent 55e8404 commit 776366f

File tree

1 file changed

+8
-2
lines changed

1 file changed

+8
-2
lines changed

README_CN.md

Lines changed: 8 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -131,7 +131,13 @@ MAX_JOBS=8 python setup.py install
131131
torchrun --nproc_per_node 1 sess_megatron.py --model-dir "path/to/model_weights_dir"
132132
```
133133

134-
将 "path/to/model_weights_dir"替换为您下载模型权重后的本地地址。
134+
将 "path/to/model_weights_dir" 替换为您下载模型权重后的本地地址。
135+
136+
或者通过 huggingface 的 transformers 库进行推理测试:
137+
138+
```bash
139+
python sess_huggingface.py
140+
```
135141

136142
#### Python 脚本
137143

@@ -302,7 +308,7 @@ class MyClass(object):
302308

303309
训练配置:
304310
- 70% 为结构化 FIM (Fill in the middle)训练任务,30% 为自回归语言模型任务;
305-
- BFlot 16 数据类型
311+
- BFloat 16 数据类型
306312
- AdamW 优化器,学习率最大1e-5,最小 1e-6,采用余弦衰减
307313
- 预训练长度为 32,768
308314

0 commit comments

Comments
 (0)