Skip to content

[codex] Add benchmark suite, model onboarding pipeline, and recent CTR models#556

Draft
shenweichen wants to merge 15 commits into
masterfrom
benchmarks
Draft

[codex] Add benchmark suite, model onboarding pipeline, and recent CTR models#556
shenweichen wants to merge 15 commits into
masterfrom
benchmarks

test: add reusable correctness contracts

2389e67
Select commit
Loading
Failed to load commit list.
Codacy Production / Codacy Static Code Analysis required action Jul 2, 2026 in 0s

19 new issues (0 max.) of at least severity.

Codacy Here is an overview of what got changed by this pull request:

Issues
======
- Added 19
           

Complexity increasing per file
==============================
- benchmarks/benchmark.py  42
- benchmarks/common.py  39
- benchmarks/datasets/census.py  18
- benchmarks/datasets/criteo.py  28
- benchmarks/datasets/sequence.py  26
- benchmarks/metrics.py  5
- benchmarks/onboard/__main__.py  12
- benchmarks/onboard/_util.py  60
- benchmarks/onboard/audit.py  34
- benchmarks/onboard/discover.py  22
- benchmarks/onboard/docs.py  47
- benchmarks/onboard/scaffold.py  34
- benchmarks/onboard/verify.py  62
- benchmarks/registry.py  29
- deepctr/layers/finalmlp.py  9
- deepctr/layers/onetrans.py  20
- deepctr/layers/wukong.py  8
- deepctr/models/finalmlp.py  3
- deepctr/models/masknet.py  2
- deepctr/models/sequence/onetrans.py  13
- deepctr/models/wukong.py  1
- tests/benchmark_test.py  16
- tests/models/FinalMLP_test.py  1
- tests/models/MaskNet_test.py  1
- tests/models/OneTrans_test.py  3
- tests/models/WuKong_test.py  1
- tests/correctness.py  58
- tests/layers/FinalMLP_correctness_test.py  2
- tests/layers/OneTrans_correctness_test.py  4
- tests/layers/WuKong_correctness_test.py  2
         

Clones added
============
- benchmarks/benchmark.py  5
- deepctr/layers/onetrans.py  1
- deepctr/models/masknet.py  1
- deepctr/models/sequence/onetrans.py  2
- deepctr/models/wukong.py  2
- tests/models/OneTrans_test.py  3
         

See the complete overview on Codacy

Annotations

Check warning on line 82 in benchmarks/common.py

See this annotation in the file changed.

@codacy-production codacy-production / Codacy Static Code Analysis

benchmarks/common.py#L82

Try, Except, Pass detected.

Check warning on line 93 in benchmarks/common.py

See this annotation in the file changed.

@codacy-production codacy-production / Codacy Static Code Analysis

benchmarks/common.py#L93

Try, Except, Pass detected.

Check warning on line 83 in benchmarks/datasets/criteo.py

See this annotation in the file changed.

@codacy-production codacy-production / Codacy Static Code Analysis

benchmarks/datasets/criteo.py#L83

Audit url open for permitted schemes. Allowing use of file:/ or custom schemes is often unexpected.

Check warning on line 50 in benchmarks/onboard/docs.py

See this annotation in the file changed.

@codacy-production codacy-production / Codacy Static Code Analysis

benchmarks/onboard/docs.py#L50

Try, Except, Pass detected.

Check notice on line 13 in benchmarks/onboard/verify.py

See this annotation in the file changed.

@codacy-production codacy-production / Codacy Static Code Analysis

benchmarks/onboard/verify.py#L13

Consider possible security implications associated with the subprocess module.

Check warning on line 63 in benchmarks/onboard/verify.py

See this annotation in the file changed.

@codacy-production codacy-production / Codacy Static Code Analysis

benchmarks/onboard/verify.py#L63

subprocess call - check for execution of untrusted input.

Check warning on line 116 in benchmarks/onboard/verify.py

See this annotation in the file changed.

@codacy-production codacy-production / Codacy Static Code Analysis

benchmarks/onboard/verify.py#L116

Try, Except, Pass detected.

Check warning on line 27 in tests/benchmark_test.py

See this annotation in the file changed.

@codacy-production codacy-production / Codacy Static Code Analysis

tests/benchmark_test.py#L27

Use of assert detected. The enclosed code will be removed when compiling to optimised byte code.

Check warning on line 28 in tests/benchmark_test.py

See this annotation in the file changed.

@codacy-production codacy-production / Codacy Static Code Analysis

tests/benchmark_test.py#L28

Use of assert detected. The enclosed code will be removed when compiling to optimised byte code.

Check warning on line 29 in tests/benchmark_test.py

See this annotation in the file changed.

@codacy-production codacy-production / Codacy Static Code Analysis

tests/benchmark_test.py#L29

Use of assert detected. The enclosed code will be removed when compiling to optimised byte code.

Check warning on line 34 in tests/benchmark_test.py

See this annotation in the file changed.

@codacy-production codacy-production / Codacy Static Code Analysis

tests/benchmark_test.py#L34

Use of assert detected. The enclosed code will be removed when compiling to optimised byte code.

Check warning on line 35 in tests/benchmark_test.py

See this annotation in the file changed.

@codacy-production codacy-production / Codacy Static Code Analysis

tests/benchmark_test.py#L35

Use of assert detected. The enclosed code will be removed when compiling to optimised byte code.

Check warning on line 42 in tests/benchmark_test.py

See this annotation in the file changed.

@codacy-production codacy-production / Codacy Static Code Analysis

tests/benchmark_test.py#L42

Use of assert detected. The enclosed code will be removed when compiling to optimised byte code.

Check warning on line 43 in tests/benchmark_test.py

See this annotation in the file changed.

@codacy-production codacy-production / Codacy Static Code Analysis

tests/benchmark_test.py#L43

Use of assert detected. The enclosed code will be removed when compiling to optimised byte code.

Check warning on line 65 in tests/benchmark_test.py

See this annotation in the file changed.

@codacy-production codacy-production / Codacy Static Code Analysis

tests/benchmark_test.py#L65

Use of assert detected. The enclosed code will be removed when compiling to optimised byte code.

Check warning on line 67 in tests/benchmark_test.py

See this annotation in the file changed.

@codacy-production codacy-production / Codacy Static Code Analysis

tests/benchmark_test.py#L67

Use of assert detected. The enclosed code will be removed when compiling to optimised byte code.

Check warning on line 68 in tests/benchmark_test.py

See this annotation in the file changed.

@codacy-production codacy-production / Codacy Static Code Analysis

tests/benchmark_test.py#L68

Use of assert detected. The enclosed code will be removed when compiling to optimised byte code.

Check warning on line 94 in tests/benchmark_test.py

See this annotation in the file changed.

@codacy-production codacy-production / Codacy Static Code Analysis

tests/benchmark_test.py#L94

Use of assert detected. The enclosed code will be removed when compiling to optimised byte code.

Check warning on line 95 in tests/benchmark_test.py

See this annotation in the file changed.

@codacy-production codacy-production / Codacy Static Code Analysis

tests/benchmark_test.py#L95

Use of assert detected. The enclosed code will be removed when compiling to optimised byte code.