DeepSeek/DeepSeek-Coder
1
0 Fork 0
mirror of https://github.com/deepseek-ai/DeepSeek-Coder.git synced 2026-10-26 16:45:27 +00:00
Code Issues Packages Projects Releases Wiki Activity

Merge pull request #135 from AntiQuality/patch-1

Browse Source 
Complete missing `import`
This commit is contained in:
Daya Guo authored and GitHub committed 2024-03-12 10:24:43 +08:00
2 parents 147170214b 74809cec37
commit fd2db2cafe
1 file changed
+2
Download Patch File Download Diff File Expand all files Collapse all files
README.md
+2
View File
@@ -129,6 +129,7 @@ This code will output the following result:
#### 3) Chat Model Inference
```python
from transformers import AutoTokenizer, AutoModelForCausalLM
import torch
tokenizer = AutoTokenizer.from_pretrained("deepseek-ai/deepseek-coder-6.7b-instruct", trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained("deepseek-ai/deepseek-coder-6.7b-instruct", trust_remote_code=True, torch_dtype=torch.bfloat16).cuda()
messages=[
@@ -177,6 +178,7 @@ You are an AI programming assistant, utilizing the DeepSeek Coder model, develop
#### 4) Repository Level Code Completion
```python
from transformers import AutoTokenizer, AutoModelForCausalLM
import torch
tokenizer = AutoTokenizer.from_pretrained("deepseek-ai/deepseek-coder-6.7b-base", trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained("deepseek-ai/deepseek-coder-6.7b-base", trust_remote_code=True, torch_dtype=torch.bfloat16).cuda()