andreas/llama-swap
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Add examples

Browse Source
This commit is contained in:
Benson Wong
2024-11-28 22:05:15 -08:00
parent 9a81c53664
commit 2fceb78e8d
3 changed files with 14 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
examples/speculative-decoding/README.md Normal file
View File

@@ -0,0 +1,3 @@
# Qwen 2.5 Coder with a Draft Model
Using a small draft model like qwen-2.5-coder-0.5B can have a big impact on the performance of the larger 32 billion parameter model.