Skip to content

Add BenchmarkDotNet harness: fork vs upstream jieba.NET 0.42.2 - #5

Merged
rabbitism merged 2 commits into
mainfrom
benchmark/fork-vs-upstream
Sep 7, 2026
Merged

rabbitism merged 2 commits into
mainfrom
benchmark/fork-vs-upstream

Conversation

@rabbitism

Copy link
Copy Markdown
Member

概述

新增 BenchmarkDotNet 性能对比套件,用于持续对比本仓库(fork)与 NuGet 上游 jieba.NET 0.42.2,方便后续优化量化验证。

布局

  • benchmark/Shared/BenchSuite.cs:共享套件——12 个场景(精确/无HMM/全模式/搜索引擎 × 短句/medium/大文本、词性标注、TF-IDF、TextRank)+ 冷启动;两个项目各自只引用一个实现(类型同名,无法单项目共存)。
  • benchmark/JiebaNet.ForkBench:引用本仓库源码(net10.0 资产,内嵌资源 + STJ)。
  • benchmark/JiebaNet.UpstreamBench:引用 NuGet 包 jieba.NET 0.42.2,并自动将仓库 Resources/ 词典复制到输出目录(上游从磁盘加载),保证数据一致。
  • benchmark/run.ps1:一键脚本——串行构建并运行双方(避免 CPU 争抢)、打印 BDN 原始表格、各测 3 次冷启动、最后输出按场景合并的对比表(upstream / fork > 1 表示 fork 更快)。

使用

cd benchmark
.\run.ps1                          # 全场景对比
.\run.ps1 -Side fork -Filter "*medium*"   # 子集

一次性运行结论(i9-10900KF / .NET 10.0.9 / ShortRun)

fork 全面小幅占优:分词路径 1.07x~1.30x(TF-IDF 1.52x、TextRank 1.42x),词性标注持平(0.97x);内存分配两边几乎一致;冷启动 ~375ms vs ~490ms(fork 且无文件依赖)。ShortRun 误差棒较宽,结论以方向为准。

其它

  • 两个 benchmark 项目已加入解决方案 /benchmark/ 文件夹,CI 会持续验证其可编译。
  • 详见 benchmark/README.md。

@rabbitism
rabbitism merged commit 655d27b into main Sep 7, 2026
5 checks passed
@rabbitism

Copy link
Copy Markdown
Member Author
Scenario fork ms upstream ms upstream / fork fork alloc upstream alloc
'Cut accurate no-HMM medium' 0.734 0.85 1.16 859.3 KB 859.3 KB
'Cut accurate no-HMM short' 0.01 0.011 1.07 15.18 KB 15.18 KB
'Cut accurate+HMM large (novel)' 233.839 303.418 1.3 185950.09 KB 185949.44 KB
'Cut accurate+HMM medium' 0.861 0.926 1.08 1059.15 KB 1059.15 KB
'Cut accurate+HMM short' 0.011 0.012 1.14 18.21 KB 18.21 KB
'CutAll large (novel)' 140.521 176.334 1.25 70972.87 KB 70972.63 KB
'CutAll medium' 0.462 0.576 1.25 580.17 KB 580.16 KB
'CutAll short' 0.006 0.007 1.23 10.43 KB 10.43 KB
'CutForSearch medium' 0.93 1.137 1.22 1111.2 KB 1111.2 KB
'POS cut medium' 6.608 6.384 0.97 2496.03 KB 2500.68 KB
'TextRank keywords medium' 8.228 11.7 1.42 2883.68 KB 2906.95 KB
'TF-IDF keywords medium' 0.994 1.51 1.52 1116.05 KB 1116.05 KB

@rabbitism
rabbitism deleted the benchmark/fork-vs-upstream branch September 7, 2026 18:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant