JamesFlare/FlareBlog
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

update mermaid to 10.x

Browse Source
This commit is contained in:
JamesFlare1212
2024-03-17 01:26:59 -04:00
parent 8bb682728e
commit e076e5ba36
5 changed files with 58 additions and 180 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
.gitmodules vendored
View File

@@ -1,3 +1,4 @@
[submodule "themes/FixIt"] [submodule "themes/FixIt"]
path = themes/FixIt path = themes/FixIt
url = https://github.com/hugo-fixit/FixIt.git url = https://github.com/hugo-fixit/FixIt.git
branch = dev

13
README.md
View File

@@ -10,13 +10,20 @@ Clone the repository:
git clone https://github.com/JamesFlare1212/FlareBlog.git git clone https://github.com/JamesFlare1212/FlareBlog.git
``` ```
install hugo: Then, install Hugo.
For Linux:
```bash ```bash
apt install hugo wget https://github.com/gohugoio/hugo/releases/download/v0.122.0/hugo_extended_0.122.0_linux-amd64.deb
dpkg -i hugo_extended_0.122.0_linux-amd64.deb
``` ```
Run the server: For MacOS:
```bash
brew install hugo
```
Server the blog locally:
```bash ```bash
cd FlareBlog cd FlareBlog

111
content/en/posts/llama-cpp/compare-quantization-type/index.md
View File

@@ -113,95 +113,30 @@ To help us compare the quantization types, I made a table to show the size and p
| Q6\_K | 5.15G | +0.0008 | @ LLaMA-v1-7B | | Q6\_K | 5.15G | +0.0008 | @ LLaMA-v1-7B |
| Q8\_0 | 6.70G | +0.0004 | @ LLaMA-v1-7B | | Q8\_0 | 6.70G | +0.0004 | @ LLaMA-v1-7B |
To help us understand the relationship between size and ppl change, I made a scatter plot to show the relationship. To help us understand the relationship between size and ppl change, I made a quadrant chart to show the relationship.
{{< echarts >}} ```mermaid
{ quadrantChart
"title": { title Size vs Perplexity Change
"text": "ppl Change vs Size", x-axis Small Size --> Large Size
"top": "2%", y-axis Small Perplexity Change --> Large Perplexity Change
"left": "center" quadrant-1 Worst model
}, quadrant-2 High potential
"xAxis": { quadrant-3 Best models
"name": "Size (GB)", quadrant-4 Low priority
"nameLocation": "middle", Q3_K_M: [0.05, 0.95]
"nameGap": 30 Q3_K_L: [0.1, 0.8]
}, Q4_0: [0.15, 0.85]
"yAxis": { Q4_K_S: [0.2, 0.55]
"name": "ppl Change", Q4_K_M: [0.25, 0.4]
"nameLocation": "middle", Q4_1: [0.3, 0.7]
"nameGap": 40 Q5_0: [0.4, 0.45]
}, Q5_K_S: [0.4, 0.35]
"series": [ Q5_1: [0.5, 0.3]
{ Q5_K_M: [0.45, 0.2]
"symbolSize": 10, Q6_K: [0.7, 0.08]
"data": [ Q8_0: [0.95, 0.05]
{ ```
"name": "Q2_K",
"value": [2.63, 0.6717]
},
{
"name": "Q3_K_S",
"value": [2.75, 0.5551]
},
{
"name": "Q3_K_M",
"value": [3.07, 0.2496]
},
{
"name": "Q3_K_L",
"value": [3.35, 0.1764]
},
{
"name": "Q4_0",
"value": [3.56, 0.2166]
},
{
"name": "Q4_K_S",
"value": [3.59, 0.0992]
},
{
"name": "Q4_K_M",
"value": [3.80, 0.0532]
},
{
"name": "Q4_1",
"value": [3.90, 0.1585]
},
{
"name": "Q5_0",
"value": [4.33, 0.0683]
},
{
"name": "Q5_K_S",
"value": [4.33, 0.0400]
},
{
"name": "Q5_1",
"value": [4.70, 0.0349]
},
{
"name": "Q5_K_M",
"value": [4.45, 0.0122]
},
{
"name": "Q6_K",
"value": [5.15, 0.0008]
},
{
"name": "Q8_0",
"value": [6.70, 0.0004]
}
],
"type": "scatter"
}
],
"tooltip": {
"trigger": "item",
"formatter": "Q Type: {b}<br/>Data: {c}"
}
}
{{< /echarts >}}
## Summary ## Summary

111
content/zh-cn/posts/llama-cpp/compare-quantization-type/index.md
View File

@@ -113,95 +113,30 @@ Allowed quantization types:
| Q6\_K | 5.15G | +0.0008 | @ LLaMA-v1-7B | | Q6\_K | 5.15G | +0.0008 | @ LLaMA-v1-7B |
| Q8\_0 | 6.70G | +0.0004 | @ LLaMA-v1-7B | | Q8\_0 | 6.70G | +0.0004 | @ LLaMA-v1-7B |
为了帮助我们理解大小和 ppl 变化之间的关系，我制作了一个散点图来显示这种关系。 为了帮助我们理解大小和 ppl 变化之间的关系，我制作了一个象限图来显示这种关系。
{{< echarts >}} ```mermaid
{ quadrantChart
"title": { title 大小与困惑度变化对比
"text": "ppl 变化 vs 大小", x-axis "体积小" --> "体积大"
"top": "2%", y-axis "困惑度小" --> "困惑度大"
"left": "center" quadrant-1 "最差模型"
}, quadrant-2 "有潜力"
"xAxis": { quadrant-3 "最佳模型"
"name": "大小 (GB)", quadrant-4 "低优先级"
"nameLocation": "middle", Q3_K_M: [0.05, 0.95]
"nameGap": 30 Q3_K_L: [0.1, 0.8]
}, Q4_0: [0.15, 0.85]
"yAxis": { Q4_K_S: [0.2, 0.55]
"name": "ppl 变化", Q4_K_M: [0.25, 0.4]
"nameLocation": "middle", Q4_1: [0.3, 0.7]
"nameGap": 40 Q5_0: [0.4, 0.45]
}, Q5_K_S: [0.4, 0.35]
"series": [ Q5_1: [0.5, 0.3]
{ Q5_K_M: [0.45, 0.2]
"symbolSize": 10, Q6_K: [0.7, 0.08]
"data": [ Q8_0: [0.95, 0.05]
{ ```
"name": "Q2_K",
"value": [2.63, 0.6717]
},
{
"name": "Q3_K_S",
"value": [2.75, 0.5551]
},
{
"name": "Q3_K_M",
"value": [3.07, 0.2496]
},
{
"name": "Q3_K_L",
"value": [3.35, 0.1764]
},
{
"name": "Q4_0",
"value": [3.56, 0.2166]
},
{
"name": "Q4_K_S",
"value": [3.59, 0.0992]
},
{
"name": "Q4_K_M",
"value": [3.80, 0.0532]
},
{
"name": "Q4_1",
"value": [3.90, 0.1585]
},
{
"name": "Q5_0",
"value": [4.33, 0.0683]
},
{
"name": "Q5_K_S",
"value": [4.33, 0.0400]
},
{
"name": "Q5_1",
"value": [4.70, 0.0349]
},
{
"name": "Q5_K_M",
"value": [4.45, 0.0122]
},
{
"name": "Q6_K",
"value": [5.15, 0.0008]
},
{
"name": "Q8_0",
"value": [6.70, 0.0004]
}
],
"type": "scatter"
}
],
"tooltip": {
"trigger": "item",
"formatter": "Q Type: {b}<br/>Data: {c}"
}
}
{{< /echarts >}}
## 总结 ## 总结

2
themes/FixIt

Submodule themes/FixIt updated: c9af0b9018...3df577cb0d