Skip to content

Add Sharaf Potateh benchmark entry - #1753

Open
sake92 wants to merge 3 commits into
MDA2AV:mainfrom
sake92:main
Open

sake92 wants to merge 3 commits into
MDA2AV:mainfrom
sake92:main

Conversation

@sake92

@sake92 sake92 commented Nov 11, 2026

Copy link
Copy Markdown

Adds sharaf scala framework.
This flavor is based on potateh experimental backend.

@sake92

sake92 commented Nov 12, 2026

Copy link
Copy Markdown
Author

/benchmark -f sharaf-potateh

@github-actions

Copy link
Copy Markdown
Contributor

👋 Benchmark request received. A collaborator will review and approve the run.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmark Results

Framework: sharaf-potateh | Test: all tests

Test Conn RPS CPU Mem Δ RPS Δ Mem
baseline 4096 69,085 1181.0% 1.4GiB ~0% ~0%
pipelined 4096 92,539 820.7% 3.4GiB ~0% ~0%
limited-conn 4096 9,945 7.6% 230MiB ~0% ~0%

Composite score, main against this run, in the board's default view:

Family main this run Δ
HTTP/1.1 - 20.0 (32 of 32) -

The results on main were measured in another session, so a few points up or down can be the machine and not the change.

Full log
=== Best: 69085 req/s (CPU: 1181.0%, Mem: 1.4GiB) ===
[info] input BW: 5.34MB/s (avg template: 81 bytes)
[info] saved results/baseline/4096/sharaf-potateh.json
httparena-bench-sharaf-potateh
httparena-bench-sharaf-potateh

==============================================
=== sharaf-potateh / pipelined / 4096c (tool=gcannon) ===
==============================================
[info] waiting for server...
[info] server ready

[run 1/3]
gcannon v0.5.3
  Target:    localhost:8080/pipeline
  Threads:   64
  Conns:     4096 (64/thread)
  Pipeline:  16
  Req/conn:  unlimited (keep-alive)
  Expected:  200
  Duration:  5s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency   113.35ms   68.40ms   181.10ms    1.31s    3.72s

  515461 requests in 5.00s, 459605 responses
  Throughput: 91.89K req/s
  Bandwidth:  16.83MB/s
  Status codes: 2xx=459605, 3xx=0, 4xx=0, 5xx=0
  Latency samples: 459602 / 459605 responses (100.0%)
[info] CPU 865.6% | Mem 1.2GiB

[run 2/3]
gcannon v0.5.3
  Target:    localhost:8080/pipeline
  Threads:   64
  Conns:     4096 (64/thread)
  Pipeline:  16
  Req/conn:  unlimited (keep-alive)
  Expected:  200
  Duration:  5s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency   210.06ms   164.60ms   340.60ms    1.44s    2.40s

  501777 requests in 5.00s, 454193 responses
  Throughput: 90.80K req/s
  Bandwidth:  16.63MB/s
  Status codes: 2xx=454193, 3xx=0, 4xx=0, 5xx=0
  Latency samples: 454192 / 454193 responses (100.0%)
[info] CPU 796.7% | Mem 2.0GiB

[run 3/3]
gcannon v0.5.3
  Target:    localhost:8080/pipeline
  Threads:   64
  Conns:     4096 (64/thread)
  Pipeline:  16
  Req/conn:  unlimited (keep-alive)
  Expected:  200
  Duration:  5s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency   292.64ms   257.70ms   495.70ms    1.26s    2.85s

  517161 requests in 5.00s, 462697 responses
  Throughput: 92.50K req/s
  Bandwidth:  16.94MB/s
  Status codes: 2xx=462697, 3xx=0, 4xx=0, 5xx=0
  Latency samples: 462695 / 462697 responses (100.0%)
[info] CPU 820.7% | Mem 3.4GiB

=== Best: 92539 req/s (CPU: 820.7%, Mem: 3.4GiB) ===
[info] saved results/pipelined/4096/sharaf-potateh.json
[warn] sharaf-potateh pipelined/4096: container log was 8497500 bytes, truncated to 8000000
httparena-bench-sharaf-potateh
httparena-bench-sharaf-potateh

==============================================
=== sharaf-potateh / limited-conn / 4096c (tool=gcannon) ===
==============================================
[info] waiting for server...
[info] server ready

[run 1/3]
gcannon v0.5.3
  Target:    localhost:8080/
  Threads:   64
  Conns:     4096 (64/thread)
  Pipeline:  1
  Req/conn:  10
  Templates: 3
  Expected:  200
  Duration:  5s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency   1.95ms    288us   5.36ms   18.50ms   31.20ms

  49837 requests in 5.00s, 49726 responses
  Throughput: 9.94K req/s
  Bandwidth:  1.82MB/s
  Status codes: 2xx=49726, 3xx=0, 4xx=0, 5xx=0
  Latency samples: 49719 / 49726 responses (100.0%)
  Reconnects: 3971714
  Errors: connect 3966530, read 0, timeout 0
  Per-template: 16574,16609,16536
  Per-template-ok: 16574,16609,16536
[info] CPU 7.6% | Mem 230MiB

[run 2/3]
gcannon v0.5.3
  Target:    localhost:8080/
  Threads:   64
  Conns:     4096 (64/thread)
  Pipeline:  1
  Req/conn:  10
  Templates: 3
  Expected:  200
  Duration:  5s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency      0us      0us      0us      0us      0us

  0 requests in 5.00s, 0 responses
  Throughput: 0 req/s
  Bandwidth:  0B/s
  Status codes: 2xx=0, 3xx=0, 4xx=0, 5xx=0
  Latency samples: 0 / 0 responses (0.0%)
  Reconnects: 5142783
  Errors: connect 5142773, read 0, timeout 0
  Per-template: 0,0,0
  Per-template-ok: 0,0,0
[info] CPU 0.0% | Mem 0MiB

[run 3/3]
gcannon v0.5.3
  Target:    localhost:8080/
  Threads:   64
  Conns:     4096 (64/thread)
  Pipeline:  1
  Req/conn:  10
  Templates: 3
  Expected:  200
  Duration:  5s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency      0us      0us      0us      0us      0us

  0 requests in 5.00s, 0 responses
  Throughput: 0 req/s
  Bandwidth:  0B/s
  Status codes: 2xx=0, 3xx=0, 4xx=0, 5xx=0
  Latency samples: 0 / 0 responses (0.0%)
  Reconnects: 5004873
  Errors: connect 5004868, read 0, timeout 0
  Per-template: 0,0,0
  Per-template-ok: 0,0,0
[info] CPU 0.0% | Mem 0MiB

=== Best: 9945 req/s (CPU: 7.6%, Mem: 230MiB) ===
[info] input BW: 786.67KB/s (avg template: 81 bytes)
[info] saved results/limited-conn/4096/sharaf-potateh.json
httparena-bench-sharaf-potateh
httparena-bench-sharaf-potateh
[info] skip: sharaf-potateh does not subscribe to json-comp
[info] skip: sharaf-potateh does not subscribe to json-tls
[info] skip: sharaf-potateh does not subscribe to 8gbit
[info] skip: sharaf-potateh does not subscribe to static-tls
[info] skip: sharaf-potateh does not subscribe to async-db
[info] skip: sharaf-potateh does not subscribe to fortunes
[info] skip: sharaf-potateh does not subscribe to baseline-h2
[info] skip: sharaf-potateh does not subscribe to static-h2
[info] skip: sharaf-potateh does not subscribe to baseline-h2c
[info] skip: sharaf-potateh does not subscribe to json-h2c
[info] skip: sharaf-potateh does not subscribe to baseline-h3
[info] skip: sharaf-potateh does not subscribe to static-h3
[info] skip: sharaf-potateh does not subscribe to gateway-64
[info] skip: sharaf-potateh does not subscribe to gateway-h3
[info] skip: sharaf-potateh does not subscribe to production-stack
[info] skip: sharaf-potateh does not subscribe to unary-grpc
[info] skip: sharaf-potateh does not subscribe to unary-grpc-tls
[info] skip: sharaf-potateh does not subscribe to echo-ws
[info] skip: sharaf-potateh does not subscribe to echo-ws-pipeline
[info] skip: sharaf-potateh does not subscribe to echo-ws-limited
[info] skip: sharaf-potateh does not subscribe to latency-1m
[info] skip: sharaf-potateh does not subscribe to latency-10k
[info] skip: sharaf-potateh does not subscribe to latency-500k-8cpu
[info] skip: sharaf-potateh does not subscribe to async
[info] rebuilding site/data/*.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/frameworks.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/results/sharaf-potateh.json - 3 new, 3 total
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/current.json
[info] done
[info] restoring loopback MTU to 65536

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant