Skip to content

sark: update to 0.34 - #1742

Open
inq wants to merge 4 commits into
MDA2AV:mainfrom
inq:sark-0.30
Open

inq wants to merge 4 commits into
MDA2AV:mainfrom
inq:sark-0.30

Conversation

@inq

@inq inq commented Nov 9, 2026

Copy link
Copy Markdown
Contributor

Sorry for the late update! Updated sark and merged the separate servers into one binary.

@inq

inq commented Nov 9, 2026

Copy link
Copy Markdown
Contributor Author

/benchmark-multiple -f sark,sark-gateway

@github-actions

github-actions Bot commented Nov 9, 2026

Copy link
Copy Markdown
Contributor

👋 Benchmark request received. A collaborator will review and approve the run.

@github-actions

github-actions Bot commented Nov 9, 2026

Copy link
Copy Markdown
Contributor

Benchmark Results

Frameworks: 2 | Test: all tests

✅ sark

Test Conn RPS Rate CPU/req p99 p99.9 CPU Mem Δ RPS Δ Mem
baseline 4096 3,889,312 — — — — 6289.0% 22.0GiB NEW NEW
pipelined 4096 32,708,928 — — — — 6591.9% 22.0GiB NEW NEW
limited-conn 4096 2,767,029 — — — — 6142.4% 22.0GiB NEW NEW
json-comp 4096 616,967 — — — — 6535.4% 22.0GiB NEW NEW
json-comp 16384 641,917 — — — — 6367.7% 22.1GiB NEW NEW
json-tls 4096 1,809,217 — — — — 5821.2% 22.1GiB NEW NEW
8gbit 512 49,351 0.9870 49.57us 119.0us 3581.0us 218.5% 22.0GiB NEW NEW
static-tls 1024 470,324 — — — — 6671.2% 22.0GiB NEW NEW
async-db 1024 324,646 — — — — 4325.5% 22.0GiB NEW NEW
fortunes 1024 136,726 — — — — 6612.6% 22.1GiB NEW NEW
baseline-h2 256 12,293,901 — — — — 5250.6% 22.1GiB NEW NEW
baseline-h2 1024 13,095,850 — — — — 6300.3% 23.2GiB NEW NEW
static-h2 256 526,901 — — — — 6558.9% 22.6GiB NEW NEW
static-h2 1024 466,708 — — — — 6304.9% 24.7GiB NEW NEW
baseline-h2c 256 11,732,898 — — — — 5639.4% 22.2GiB NEW NEW
baseline-h2c 1024 11,995,760 — — — — 6425.5% 22.9GiB NEW NEW
baseline-h2c 4096 10,852,707 — — — — 6307.2% 26.5GiB NEW NEW
json-h2c 1024 2,158,527 — — — — 6423.6% 22.9GiB NEW NEW
json-h2c 4096 1,977,850 — — — — 6271.1% 27.0GiB NEW NEW
baseline-h3 64 2,040,468 — — — — 4650.2% 22.1GiB NEW NEW
static-h3 64 128,406 — — — — 4112.5% 22.7GiB NEW NEW
unary-grpc 256 0 — — — — 25.7% 22.0GiB NEW NEW
unary-grpc 1024 0 — — — — 80.2% 22.2GiB NEW NEW
unary-grpc-tls 256 0 — — — — 5458.5% 22.1GiB NEW NEW
unary-grpc-tls 1024 0 — — — — 6322.0% 22.7GiB NEW NEW
echo-ws 512 3,786,907 — — — — 6540.0% 22.0GiB NEW NEW
echo-ws 4096 4,055,511 — — — — 6231.5% 22.0GiB NEW NEW
echo-ws 16384 3,773,418 — — — — 6170.8% 22.1GiB NEW NEW
echo-ws-pipeline 512 54,883,756 — — — — 6423.3% 22.0GiB NEW NEW
echo-ws-pipeline 4096 58,833,753 — — — — 6341.4% 22.0GiB NEW NEW
echo-ws-pipeline 16384 54,793,017 — — — — 6180.2% 22.1GiB NEW NEW
echo-ws-limited 512 1,989,391 — — — — 6121.8% 22.0GiB NEW NEW
echo-ws-limited 4096 2,586,977 — — — — 6224.5% 22.0GiB NEW NEW
latency-1m 1024 998,451 0.9985 27.31us 181.0us 2175.0us 3033.5% 22.0GiB NEW NEW
latency-10k 1024 9,981 0.9981 38.69us 122.0us 1115.0us 36.8% 22.0GiB NEW NEW
latency-500k-8cpu 1024 484,274 0.9685 ⚠️ 16.36us 1613312.0us 1740288.0us 810.3% 7.5GiB NEW NEW
async 32000 2,896,211 — — — — 6292.6% 22.1GiB NEW NEW

Composite score, main against this run, in the board's default view:

Family main this run Δ
HTTP/1.1 - 6289.5 (6 of 45) -
HTTP/2 - 1909.6 (4 of 17) -
HTTP/3 - 371.3 (7 of 9) -
Gateway 1236.7 (3 of 3) 1668.2 (3 of 3) +431.5
WebSocket - 2700.8 (4 of 21) -

The results on main were measured in another session, so a few points up or down can be the machine and not the change.

✅ sark-gateway

Test Conn RPS CPU Mem Δ RPS Δ Mem
gateway-64 512 75,268 3988.9% 5.4GiB -30.0% +92.9%
gateway-64 1024 58,241 3790.8% 8.0GiB -20.5% +63.3%
gateway-h3 64 88,103 3353.7% 3.2GiB -5.9% +261.3%
gateway-h3 256 61,621 2409.9% 4.2GiB -2.9% +90.9%
production-stack 256 125,899 2300.6% 4.0GiB NEW NEW
production-stack 1024 119,460 2323.9% 4.7GiB NEW NEW

@inq

inq commented Nov 10, 2026

Copy link
Copy Markdown
Contributor Author

/benchmark -f sark -t unary-grpc,unary-grpc-tls,async-db

@github-actions

Copy link
Copy Markdown
Contributor

👋 Benchmark request received. A collaborator will review and approve the run.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmark Results

Framework: sark | Test: unary-grpc,unary-grpc-tls,async-db

Test Conn RPS CPU Mem Δ RPS Δ Mem
unary-grpc 256 3,154,628 6614.0% 22.4GiB NEW NEW
unary-grpc 1024 3,226,570 6532.0% 23.3GiB NEW NEW
unary-grpc-tls 256 2,849,339 6430.5% 22.2GiB NEW NEW
unary-grpc-tls 1024 2,849,261 6403.8% 23.6GiB NEW NEW
async-db 1024 327,093 4380.7% 22.0GiB NEW NEW

Composite score, main against this run, in the board's default view:

Family main this run Δ
HTTP/1.1 - 0.0 (46 of 46) -
Gateway 1236.7 (3 of 3) 1236.7 (3 of 3) +0.0
gRPC - 830.0 (5 of 5) -

The results on main were measured in another session, so a few points up or down can be the machine and not the change.

Full log
.Main benchmark duration is started for thread #53Main benchmark duration is started for thread #
44.

52.
TLS Protocol: TLSv1.3
Cipher: TLS_AES_128_GCM_SHA256
Server Temp Key: X25519 253 bits
Application protocol: h2
22. Stopping all clients.Stopped all clients for thread #43

27. Stopping all clients.
17. Stopping all clients.
. Stopping all clients.Stopped all clients for thread #18
8Stopped all clients for thread #7

. Stopping all clients.Stopped all clients for thread #
56
35
28Main benchmark duration is over for thread #59. Stopping all clients.
59
. Stopping all clients.
46. Stopping all clients.

finished in 5.13s, 2892791.60 req/s, 132.47MB/s
requests: 14463958 total, 14566358 started, 14463958 done, 14463958 succeeded, 0 failed, 0 errored, 0 timeout
status codes: 14470069 2xx, 0 3xx, 0 4xx, 0 5xx
traffic: 662.34MB (694508997) total, 193.14MB (202525042) headers (space savings 75.00%), 96.60MB (101287921) data
                     min         max         mean         sd        +/- sd
time for request:      803us    113.46ms     33.78ms     10.65ms    75.19%
time for connect:     7.64ms    148.32ms     70.38ms     35.81ms    60.45%
time to 1st byte:    11.12ms    185.37ms    118.92ms     41.46ms    66.31%
req/s           :    1695.20     6026.91     2823.79      750.78    76.76%
[info] CPU 6210.9% | Mem 23.0GiB

[run 2/3]
starting benchmark...
63Main benchmark duration is started for thread #61.
.

58.

1.
TLS Protocol: TLSv1.3
Cipher: TLS_AES_128_GCM_SHA256
Server Temp Key: X25519 253 bits
Application protocol: h2
. Stopping all clients.
35. Stopping all clients.Main benchmark duration is over for thread #54. Stopping all clients.

35

finished in 5.08s, 2893771.60 req/s, 132.51MB/s
requests: 14468858 total, 14571258 started, 14468858 done, 14468858 succeeded, 0 failed, 0 errored, 0 timeout
status codes: 14474246 2xx, 0 3xx, 0 4xx, 0 5xx
traffic: 662.54MB (694724916) total, 193.21MB (202592196) headers (space savings 75.00%), 96.62MB (101317265) data
                     min         max         mean         sd        +/- sd
time for request:      747us     89.73ms     33.30ms     10.45ms    74.05%
time for connect:     3.21ms    124.05ms     54.14ms     32.60ms    56.05%
time to 1st byte:     6.09ms    153.19ms    104.74ms     33.38ms    76.76%
req/s           :    1710.97     5278.18     2824.28      752.31    73.73%
[info] CPU 6403.8% | Mem 23.6GiB

[run 3/3]
starting benchmark...
.
.Main benchmark duration is started for thread #4.
progress: Main benchmark duration is started for thread #5268% of clients started.

.

23.
.
.
TLS Protocol: TLSv1.3
Cipher: TLS_AES_128_GCM_SHA256
Server Temp Key: X25519 253 bits
41.

.
19Stopped all clients for thread #58
. Stopping all clients.
9. Stopping all clients.
55. Stopping all clients.
0. Stopping all clients.

finished in 5.07s, 2883717.20 req/s, 132.05MB/s
requests: 14418586 total, 14520986 started, 14418586 done, 14418586 succeeded, 0 failed, 0 errored, 0 timeout
status codes: 14423532 2xx, 0 3xx, 0 4xx, 0 5xx
traffic: 660.23MB (692300630) total, 192.53MB (201887504) headers (space savings 75.00%), 96.29MB (100962575) data
                     min         max         mean         sd        +/- sd
time for request:     1.46ms     89.52ms     33.45ms      9.75ms    77.35%
time for connect:     3.88ms    128.03ms     55.40ms     33.46ms    57.91%
time to 1st byte:    21.45ms    149.26ms    108.94ms     32.09ms    80.47%
req/s           :    1645.15     5859.97     2814.36      652.31    71.09%
[info] CPU 6157.2% | Mem 24.1GiB

=== Best: 2849261 req/s (CPU: 6403.8%, Mem: 23.6GiB) ===
[info] saved results/unary-grpc-tls/1024/sark.json
httparena-bench-sark
httparena-bench-sark

==============================================
=== sark / async-db / 1024c (tool=gcannon) ===
==============================================
[info] waiting for server...
[info] server ready

[run 1/3]
gcannon v0.5.3
  Target:    localhost:8080/
  Threads:   64
  Conns:     1024 (16/thread)
  Pipeline:  1
  Req/conn:  25
  Templates: 5
  Expected:  200
  Duration:  10s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency   2.53ms    788us   5.65ms   28.80ms   61.70ms

  3271743 requests in 10.00s, 3271345 responses
  Throughput: 327.07K req/s
  Bandwidth:  1.23GB/s
  Status codes: 2xx=3270937, 3xx=0, 4xx=0, 5xx=408
  Latency samples: 3271337 / 3271345 responses (100.0%)
  Reconnects: 131130
  Per-template: 652504,653935,655906,655659,653333
  Per-template-ok: 652422,653845,655826,655575,653261

  WARNING: 408/3271345 responses (0.0%) had unexpected status (expected 2xx)
[info] CPU 4380.7% | Mem 22.0GiB

[run 2/3]
gcannon v0.5.3
  Target:    localhost:8080/
  Threads:   64
  Conns:     1024 (16/thread)
  Pipeline:  1
  Req/conn:  25
  Templates: 5
  Expected:  200
  Duration:  10s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency   3.04ms    745us   6.98ms   38.50ms   79.60ms

  2815126 requests in 10.00s, 2812404 responses
  Throughput: 281.18K req/s
  Bandwidth:  1.06GB/s
  Status codes: 2xx=2809603, 3xx=0, 4xx=0, 5xx=2801
  Latency samples: 2812400 / 2812404 responses (100.0%)
  Reconnects: 114265
  Per-template: 561357,563267,564226,563535,560015
  Per-template-ok: 560842,562764,563686,562959,559348

  WARNING: 2801/2812404 responses (0.1%) had unexpected status (expected 2xx)
[info] CPU 3771.2% | Mem 22.0GiB

[run 3/3]
gcannon v0.5.3
  Target:    localhost:8080/
  Threads:   64
  Conns:     1024 (16/thread)
  Pipeline:  1
  Req/conn:  25
  Templates: 5
  Expected:  200
  Duration:  10s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency   2.91ms    736us   7.24ms   32.60ms   61.70ms

  3001832 requests in 10.00s, 3000726 responses
  Throughput: 300.01K req/s
  Bandwidth:  1.13GB/s
  Status codes: 2xx=2999604, 3xx=0, 4xx=0, 5xx=1122
  Latency samples: 3000715 / 3000726 responses (100.0%)
  Reconnects: 120930
  Per-template: 599105,600040,601213,601171,599186
  Per-template-ok: 598899,599828,600988,600932,598946

  WARNING: 1122/3000726 responses (0.0%) had unexpected status (expected 2xx)
[info] CPU 4204.8% | Mem 22.0GiB

=== Best: 327093 req/s (CPU: 4380.7%, Mem: 22.0GiB) ===
[info] input BW: 21.84MB/s (avg template: 70 bytes)
[info] saved results/async-db/1024/sark.json
httparena-bench-sark
httparena-bench-sark
[info] rebuilding site/data/*.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/frameworks.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/results/sark.json - 5 new, 9 total
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/current.json
[info] done
httparena-postgres
[info] restoring loopback MTU to 65536

@inq inq changed the title sark: update to 0.30 sark: update to 0.32 Nov 11, 2026
@inq

inq commented Nov 11, 2026

Copy link
Copy Markdown
Contributor Author

/benchmark-multiple -f sark,sark-gateway

@github-actions

Copy link
Copy Markdown
Contributor

👋 Benchmark request received. A collaborator will review and approve the run.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmark Results

Frameworks: 2 | Test: all tests

✅ sark

Test Conn RPS Rate CPU/req p99 p99.9 CPU Mem Δ RPS Δ Mem
baseline 4096 3,721,381 — — — — 6277.2% 21.9GiB NEW NEW
pipelined 4096 31,715,644 — — — — 6427.2% 21.9GiB NEW NEW
limited-conn 4096 2,677,513 — — — — 6135.3% 21.9GiB NEW NEW
json-comp 4096 595,793 — — — — 6516.9% 21.9GiB NEW NEW
json-comp 16384 624,442 — — — — 6359.5% 22.0GiB NEW NEW
json-tls 4096 1,773,584 — — — — 5855.3% 22.0GiB NEW NEW
8gbit 512 49,356 0.9871 50.93us 121.0us 3987.0us 254.8% 21.9GiB NEW NEW
static-tls 1024 468,332 — — — — 6730.6% 21.9GiB NEW NEW
async-db 1024 320,604 — — — — 4385.9% 21.9GiB NEW NEW
fortunes 1024 132,686 — — — — 6389.7% 22.1GiB NEW NEW
baseline-h2 256 12,221,623 — — — — 5167.5% 22.4GiB NEW NEW
baseline-h2 1024 12,865,342 — — — — 6125.2% 23.8GiB NEW NEW
static-h2 256 522,059 — — — — 6533.7% 22.6GiB NEW NEW
static-h2 1024 467,644 — — — — 6248.7% 24.6GiB NEW NEW
baseline-h2c 256 11,754,323 — — — — 5636.9% 22.2GiB NEW NEW
baseline-h2c 1024 11,905,198 — — — — 6357.7% 23.3GiB NEW NEW
baseline-h2c 4096 10,994,869 — — — — 6293.7% 26.8GiB NEW NEW
json-h2c 1024 2,132,278 — — — — 6417.4% 22.9GiB NEW NEW
json-h2c 4096 1,956,137 — — — — 6255.1% 26.7GiB NEW NEW
baseline-h3 64 2,091,899 — — — — 4318.3% 22.0GiB NEW NEW
static-h3 64 126,915 — — — — 4122.5% 22.3GiB NEW NEW
unary-grpc 256 3,027,798 — — — — 6596.0% 22.3GiB NEW NEW
unary-grpc 1024 3,108,794 — — — — 6446.8% 23.7GiB NEW NEW
unary-grpc-tls 256 2,737,910 — — — — 6307.1% 22.3GiB NEW NEW
unary-grpc-tls 1024 2,784,920 — — — — 6187.8% 24.1GiB NEW NEW
echo-ws 512 3,659,828 — — — — 6528.8% 21.9GiB NEW NEW
echo-ws 4096 3,976,405 — — — — 6260.8% 21.9GiB NEW NEW
echo-ws 16384 3,668,393 — — — — 6114.5% 22.0GiB NEW NEW
echo-ws-pipeline 512 53,909,756 — — — — 6601.5% 21.9GiB NEW NEW
echo-ws-pipeline 4096 57,879,875 — — — — 6315.1% 21.9GiB NEW NEW
echo-ws-pipeline 16384 53,455,641 — — — — 6173.4% 22.0GiB NEW NEW
echo-ws-limited 512 1,967,640 — — — — 6001.9% 21.9GiB NEW NEW
echo-ws-limited 4096 2,561,445 — — — — 6243.1% 21.9GiB NEW NEW
latency-1m 1024 998,088 0.9981 27.49us 176.0us 1822.0us 3017.9% 21.9GiB NEW NEW
latency-10k 1024 9,982 0.9982 38.27us 121.0us 699.0us 36.6% 21.9GiB NEW NEW
latency-500k-8cpu 1024 478,626 0.9573 ⚠️ 16.58us 1768960.0us 1906176.0us 810.7% 7.5GiB NEW NEW
async 32000 2,863,573 — — — — 6312.9% 22.0GiB NEW NEW

Composite score, main against this run, in the board's default view:

Family main this run Δ
HTTP/1.1 - 6182.1 (8 of 46) -
HTTP/2 - 1900.1 (4 of 17) -
HTTP/3 - 375.3 (7 of 9) -
Gateway 1236.7 (3 of 3) 1642.1 (3 of 3) +405.4
gRPC - 801.1 (5 of 5) -
WebSocket - 2650.4 (4 of 21) -

The results on main were measured in another session, so a few points up or down can be the machine and not the change.

✅ sark-gateway

Test Conn RPS CPU Mem Δ RPS Δ Mem
gateway-64 512 72,454 3794.9% 5.4GiB -32.6% +92.9%
gateway-64 1024 51,337 3927.7% 7.0GiB -29.9% +42.9%
gateway-h3 64 86,028 3385.8% 3.2GiB -8.1% +261.3%
gateway-h3 256 61,549 2377.3% 4.1GiB -3.0% +86.4%
production-stack 256 126,221 2376.1% 4.0GiB NEW NEW
production-stack 1024 119,377 2319.3% 4.5GiB NEW NEW

@inq inq changed the title sark: update to 0.32 sark: update to 0.33 Nov 12, 2026
@inq

inq commented Nov 12, 2026

Copy link
Copy Markdown
Contributor Author

/benchmark-multiple -f sark,sark-gateway

@github-actions

Copy link
Copy Markdown
Contributor

👋 Benchmark request received. A collaborator will review and approve the run.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmark Results

Frameworks: 2 | Test: all tests

✅ sark

Test Conn RPS Rate CPU/req p99 p99.9 CPU Mem Δ RPS Δ Mem
baseline 4096 3,826,703 — — — — 6308.5% 14.9GiB NEW NEW
pipelined 4096 32,362,300 — — — — 6445.6% 14.9GiB NEW NEW
limited-conn 4096 2,742,158 — — — — 6378.4% 14.9GiB NEW NEW
json-comp 4096 614,855 — — — — 6471.8% 14.9GiB NEW NEW
json-comp 16384 641,264 — — — — 6416.3% 15.0GiB NEW NEW
json-tls 4096 1,800,887 — — — — 5847.2% 14.9GiB NEW NEW
8gbit 512 48,719 0.9744 ⚠️ 50.68us 126.0us 1858.0us 211.1% 14.9GiB NEW NEW
static-tls 1024 470,575 — — — — 6724.9% 14.9GiB NEW NEW
async-db 1024 316,338 — — — — 4346.8% 14.9GiB NEW NEW
fortunes 1024 132,972 — — — — 6593.4% 15.0GiB NEW NEW
baseline-h2 256 12,307,894 — — — — 5308.4% 15.1GiB NEW NEW
baseline-h2 1024 12,826,683 — — — — 6305.7% 16.4GiB NEW NEW
static-h2 256 521,918 — — — — 6672.7% 15.5GiB NEW NEW
static-h2 1024 474,242 — — — — 6310.0% 17.6GiB NEW NEW
baseline-h2c 256 11,744,555 — — — — 5515.8% 15.1GiB NEW NEW
baseline-h2c 1024 11,896,934 — — — — 6354.9% 16.4GiB NEW NEW
baseline-h2c 4096 11,005,200 — — — — 6296.5% 19.8GiB NEW NEW
json-h2c 1024 2,145,830 — — — — 6412.6% 15.8GiB NEW NEW
json-h2c 4096 1,967,110 — — — — 6267.5% 19.7GiB NEW NEW
baseline-h3 64 1,980,357 — — — — 4083.8% 15.1GiB NEW NEW
static-h3 64 123,122 — — — — 3859.4% 15.2GiB NEW NEW
unary-grpc 256 3,074,829 — — — — 6654.8% 15.2GiB NEW NEW
unary-grpc 1024 3,125,298 — — — — 6457.3% 16.7GiB NEW NEW
unary-grpc-tls 256 2,740,505 — — — — 6456.6% 15.3GiB NEW NEW
unary-grpc-tls 1024 2,788,921 — — — — 6171.0% 17.0GiB NEW NEW
echo-ws 512 3,605,951 — — — — 6478.4% 14.9GiB NEW NEW
echo-ws 4096 3,970,779 — — — — 6260.3% 14.9GiB NEW NEW
echo-ws 16384 3,678,912 — — — — 6124.9% 15.0GiB NEW NEW
echo-ws-pipeline 512 53,955,193 — — — — 6476.3% 14.9GiB NEW NEW
echo-ws-pipeline 4096 58,198,275 — — — — 6345.5% 14.9GiB NEW NEW
echo-ws-pipeline 16384 53,857,404 — — — — 6476.0% 15.0GiB NEW NEW
echo-ws-limited 512 1,971,402 — — — — 5994.5% 14.9GiB NEW NEW
echo-ws-limited 4096 2,557,561 — — — — 6374.1% 14.9GiB NEW NEW
latency-1m 1024 997,824 0.9978 27.46us 181.0us 8054.0us 3006.4% 14.9GiB NEW NEW
latency-10k 1024 9,981 0.9981 40.60us 122.0us 718.0us 38.7% 14.9GiB NEW NEW
latency-500k-8cpu 1024 484,330 0.9687 ⚠️ 16.47us 2155520.0us 2323456.0us 823.9% 6.6GiB NEW NEW
async 32000 2,857,647 — — — — 6317.0% 15.0GiB NEW NEW

Composite score, main against this run, in the board's default view:

Family main this run Δ
HTTP/1.1 - 6223.0 (8 of 46) -
HTTP/2 - 1903.4 (4 of 17) -
HTTP/3 - 358.7 (7 of 9) -
Gateway 1236.7 (3 of 3) 1648.4 (3 of 3) +411.6
gRPC - 805.9 (5 of 5) -
WebSocket - 2650.5 (4 of 21) -

The results on main were measured in another session, so a few points up or down can be the machine and not the change.

✅ sark-gateway

Test Conn RPS CPU Mem Δ RPS Δ Mem
gateway-64 512 73,713 3792.7% 5.4GiB -31.4% +92.9%
gateway-64 1024 59,927 3574.2% 6.7GiB -18.2% +36.7%
gateway-h3 64 86,467 3388.5% 3.2GiB -7.7% +261.3%
gateway-h3 256 60,441 2348.2% 4.2GiB -4.7% +90.9%
production-stack 256 124,594 2336.7% 4.0GiB NEW NEW
production-stack 1024 119,935 2425.8% 4.7GiB NEW NEW

@inq inq changed the title sark: update to 0.33 sark: update to 0.34 Nov 13, 2026
@inq

inq commented Nov 13, 2026

Copy link
Copy Markdown
Contributor Author

/benchmark-multiple -f sark,sark-gateway

@github-actions

Copy link
Copy Markdown
Contributor

👋 Benchmark request received. A collaborator will review and approve the run.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmark Results

Frameworks: 2 | Test: all tests

✅ sark

Test Conn RPS Rate CPU/req p99 p99.9 CPU Mem Δ RPS Δ Mem
baseline 4096 3,804,106 — — — — 6540.5% 11.8GiB NEW NEW
pipelined 4096 31,915,865 — — — — 6419.0% 11.8GiB NEW NEW
limited-conn 4096 2,727,576 — — — — 6379.4% 11.8GiB NEW NEW
json-comp 4096 602,519 — — — — 6437.8% 11.8GiB NEW NEW
json-comp 16384 628,150 — — — — 6335.8% 12.0GiB NEW NEW
json-tls 4096 1,806,840 — — — — 5866.2% 11.9GiB NEW NEW
8gbit 512 49,211 0.9842 50.41us 127.0us 1092.0us 233.4% 11.8GiB NEW NEW
static-tls 1024 466,190 — — — — 6683.6% 11.8GiB NEW NEW
async-db 1024 317,448 — — — — 4286.6% 11.8GiB NEW NEW
fortunes 1024 141,549 — — — — 6379.1% 11.8GiB NEW NEW
baseline-h2 256 12,281,468 — — — — 5258.6% 12.0GiB NEW NEW
baseline-h2 1024 12,887,909 — — — — 6315.8% 12.9GiB NEW NEW
static-h2 256 528,166 — — — — 6420.2% 12.4GiB NEW NEW
static-h2 1024 476,466 — — — — 6325.4% 13.9GiB NEW NEW
baseline-h2c 256 11,559,437 — — — — 5491.0% 12.1GiB NEW NEW
baseline-h2c 1024 11,915,322 — — — — 6433.7% 12.9GiB NEW NEW
baseline-h2c 4096 11,034,086 — — — — 6267.8% 16.6GiB NEW NEW
json-h2c 1024 2,146,006 — — — — 6418.1% 12.8GiB NEW NEW
json-h2c 4096 1,968,128 — — — — 6431.5% 15.4GiB NEW NEW
baseline-h3 64 2,123,463 — — — — 4207.8% 11.9GiB NEW NEW
static-h3 64 129,817 — — — — 4222.0% 12.5GiB NEW NEW
unary-grpc 256 3,012,121 — — — — 6485.7% 12.2GiB NEW NEW
unary-grpc 1024 3,096,212 — — — — 6476.5% 13.6GiB NEW NEW
unary-grpc-tls 256 2,750,316 — — — — 6420.7% 12.2GiB NEW NEW
unary-grpc-tls 1024 2,763,814 — — — — 6149.0% 13.8GiB NEW NEW
echo-ws 512 3,681,781 — — — — 6429.8% 11.8GiB NEW NEW
echo-ws 4096 3,984,313 — — — — 6264.7% 11.8GiB NEW NEW
echo-ws 16384 3,661,200 — — — — 6124.5% 11.9GiB NEW NEW
echo-ws-pipeline 512 53,627,767 — — — — 6495.6% 11.8GiB NEW NEW
echo-ws-pipeline 4096 57,558,422 — — — — 6324.9% 11.8GiB NEW NEW
echo-ws-pipeline 16384 53,563,059 — — — — 6484.7% 11.9GiB NEW NEW
echo-ws-limited 512 1,963,675 — — — — 6151.5% 11.8GiB NEW NEW
echo-ws-limited 4096 2,556,933 — — — — 6129.9% 11.8GiB NEW NEW
latency-1m 1024 997,651 0.9977 27.71us 178.0us 2893.0us 3033.0% 11.8GiB NEW NEW
latency-10k 1024 9,985 0.9985 42.92us 121.0us 304.0us 41.0% 11.8GiB NEW NEW
latency-500k-8cpu 1024 475,970 0.9519 ⚠️ 16.72us 1318400.0us 1422848.0us 808.4% 3.5GiB NEW NEW
async 32000 2,855,231 — — — — 6282.5% 11.9GiB NEW NEW

Composite score, main against this run, in the board's default view:

Family main this run Δ
HTTP/1.1 - 6219.8 (8 of 46) -
HTTP/2 - 1904.0 (4 of 17) -
HTTP/3 - 382.1 (7 of 9) -
Gateway 1236.7 (3 of 3) 1631.6 (3 of 3) +394.9
gRPC - 798.6 (5 of 5) -
WebSocket - 2647.9 (4 of 21) -

The results on main were measured in another session, so a few points up or down can be the machine and not the change.

✅ sark-gateway

Test Conn RPS CPU Mem Δ RPS Δ Mem
gateway-64 512 74,435 4027.8% 4.5GiB -30.8% +60.7%
gateway-64 1024 54,464 3811.8% 7.0GiB -25.7% +42.9%
gateway-h3 64 86,674 3376.9% 2.4GiB -7.5% +171.0%
gateway-h3 256 60,403 2391.7% 3.2GiB -4.8% +45.5%
production-stack 256 123,431 2199.5% 3.2GiB NEW NEW
production-stack 1024 115,620 2181.5% 3.8GiB NEW NEW

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant