Skip to content

Simplify benchmark setup - #2844

Merged
jviotti merged 2 commits into
mainfrom
benchmark-fixes
Sep 17, 2026
Merged

jviotti merged 2 commits into
mainfrom
benchmark-fixes

Conversation

@jviotti

@jviotti jviotti commented Sep 16, 2026

Copy link
Copy Markdown
Member

Signed-off-by: Juan Cruz Viotti [email protected]

Review in cubic

@augmentcode

augmentcode Bot commented Sep 16, 2026

Copy link
Copy Markdown
🤖 Augment PR Summary

Summary: This PR simplifies benchmark setup by replacing runtime benchmark arguments and conditional branches with dedicated benchmark functions.



Changes:

  • Adds an opaque helper to keep fixed string lengths and property counts from being optimized away.
  • Splits JSON string equality, fast-hash, key-hash, and object-last-key benchmarks into fixed-size variants.
  • Registers each JSON variant directly instead of using Google Benchmark Arg/Args registrations.
  • Splits deeply nested JSON-pointer parsing into explicit tracked and untracked benchmarks.
  • Removes the runtime branch that previously selected tracker usage.
  • Builds the KrakenD reference frame once before the reachability benchmark loop.
  • Removes the optional frame wrapper and the corresponding pause/resume timing calls.
Technical notes: The changes make individual benchmark cases explicit and aim to avoid setup-control-flow and compile-time folding from affecting measured work.

🤖 Was this summary useful? React with 👍 or 👎

@augmentcode augmentcode Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Review completed. 1 suggestion posted.

Fix All in Augment

Items Reviewed

Comment augment review to trigger a new review at any time.

Comment thread benchmark/jsonschema.cc Outdated
// Kept out of the timed region so that neither building nor discarding the
// frame counts towards the reachability measurement
std::optional<sourcemeta::core::SchemaFrame> frame;
const sourcemeta::core::SchemaFrame frame{

@augmentcode augmentcode Bot Sep 16, 2026

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Constructing one SchemaFrame here retains its mutable reachability cache across state iterations: is_reachable memoizes every base location, so only the first iteration builds the graph/cache and later iterations measure warm lookups. The previous per-iteration frame reset that cache (while excluding construction time), so this changes the benchmark from cold reachability computation to an amortized cached result.

Severity: medium

Fix This in Augment

🤖 Was this useful? React with 👍 or 👎, or 🚀 if it prevented an incident/outage.

@cubic-dev-ai cubic-dev-ai Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

1 issue found across 3 files

Prompt for AI agents (unresolved issues)

Check if these issues are valid — if so, understand the root cause of each and fix them. If appropriate, use sub-agents to investigate and fix each issue separately.


<file name="benchmark/jsonschema.cc">

<violation number="1" location="benchmark/jsonschema.cc:111">
P1: After the first iteration, `Schema_Frame_KrakenD_Reachable` measures cached `is_reachable` lookups instead of reachability computation. Recreate the frame with timing paused for each iteration so the reachability cache is reset before every measurement.</violation>
</file>

Reply with feedback, questions, or to request a fix.

Re-trigger cubic

Comment thread benchmark/jsonschema.cc Outdated
// Kept out of the timed region so that neither building nor discarding the
// frame counts towards the reachability measurement
std::optional<sourcemeta::core::SchemaFrame> frame;
const sourcemeta::core::SchemaFrame frame{

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P1: After the first iteration, Schema_Frame_KrakenD_Reachable measures cached is_reachable lookups instead of reachability computation. Recreate the frame with timing paused for each iteration so the reachability cache is reset before every measurement.

Prompt for AI agents
Check if this issue is valid — if so, understand the root cause and fix it. At benchmark/jsonschema.cc, line 111:

<comment>After the first iteration, `Schema_Frame_KrakenD_Reachable` measures cached `is_reachable` lookups instead of reachability computation. Recreate the frame with timing paused for each iteration so the reachability cache is reset before every measurement.</comment>

<file context>
@@ -109,18 +108,12 @@ static void Schema_Frame_KrakenD_Reachable(benchmark::State &state) {
-  // Kept out of the timed region so that neither building nor discarding the
-  // frame counts towards the reachability measurement
-  std::optional<sourcemeta::core::SchemaFrame> frame;
+  const sourcemeta::core::SchemaFrame frame{
+      sourcemeta::core::SchemaFrame::Mode::References, schema,
+      sourcemeta::core::schema_walker, sourcemeta::core::schema_resolver};
</file context>

Comment thread benchmark/json.cc
Signed-off-by: Juan Cruz Viotti <[email protected]>
Signed-off-by: Juan Cruz Viotti <[email protected]>

@github-actions github-actions Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (windows/msvc)

Details
Benchmark suite Current: 4349fe0 Previous: d548cca Ratio
Regex_Lower_S_Or_Upper_S_Asterisk 2.6099094396339693 ns/iter 3.881521763392991 ns/iter 0.67
Regex_Caret_Lower_S_Or_Upper_S_Asterisk_Dollar 2.597845357142806 ns/iter 3.857078564540935 ns/iter 0.67
Regex_Period_Asterisk 2.637888571428399 ns/iter 3.8771735491072152 ns/iter 0.68
Regex_Group_Period_Asterisk_Group 2.6361082142857737 ns/iter 3.885647321428503 ns/iter 0.68
Regex_Period_Plus 2.619889285714245 ns/iter 3.5714820926338007 ns/iter 0.73
Regex_Period 2.662432988694263 ns/iter 3.5663592793457757 ns/iter 0.75
Regex_Caret_Period_Plus_Dollar 2.686459999999816 ns/iter 3.6063743247223523 ns/iter 0.74
Regex_Caret_Group_Period_Plus_Group_Dollar 2.6275978571427623 ns/iter 3.5721095471929116 ns/iter 0.74
Regex_Caret_Period_Asterisk_Dollar 2.630444908365512 ns/iter 3.888721600198547 ns/iter 0.68
Regex_Caret_Group_Period_Asterisk_Group_Dollar 2.6465568050819854 ns/iter 3.8463407074170783 ns/iter 0.69
Regex_Caret_X_Hyphen 4.26882437499998 ns/iter 6.080243750000237 ns/iter 0.70
Regex_Period_Md_Dollar 22.322900000002477 ns/iter 44.020484874819736 ns/iter 0.51
Regex_Caret_Slash_Period_Asterisk 4.291238125000518 ns/iter 5.76537299999984 ns/iter 0.74
Regex_Caret_Period_Range_Dollar 2.8641945522928007 ns/iter 4.206041917765179 ns/iter 0.68
Regex_Nested_Backtrack 28.297675320099007 ns/iter 63.56478571428831 ns/iter 0.45
JSON_Array_Of_Objects_Unique 318.2885267856912 ns/iter 525.2848999999742 ns/iter 0.61
JSON_Parse_1 5537.575000000215 ns/iter 7611.588169643215 ns/iter 0.73
JSON_Parse_Real 9815.752608245873 ns/iter 13831.606332114536 ns/iter 0.71
JSON_Parse_Decimal 6688.105357142149 ns/iter 8600.104910714279 ns/iter 0.78
JSON_Parse_Schema_ISO_Language 5497355.999999627 ns/iter 7041192.222222511 ns/iter 0.78
JSON_Parse_Integer 3694.366974345175 ns/iter 4659.044684528647 ns/iter 0.79
JSON_Parse_String_NonSSO_Plain 5690.221428571768 ns/iter 5985.7633928572795 ns/iter 0.95
JSON_Parse_String_SSO_Plain 2524.402142857087 ns/iter 2895.8208398187567 ns/iter 0.87
JSON_Parse_String_Escape_Heavy 13308.362500000369 ns/iter 16498.254229381568 ns/iter 0.81
JSON_Parse_Object_Short_Keys 7941.404017856511 ns/iter 10114.245312499825 ns/iter 0.79
JSON_Parse_Object_Scalar_Properties 4294.095982142793 ns/iter 5270.011607142878 ns/iter 0.81
JSON_Parse_Object_Array_Properties 6734.092857142977 ns/iter 8974.947433270387 ns/iter 0.75
JSON_Parse_Object_Object_Properties 7082.638392857022 ns/iter 9102.329241071111 ns/iter 0.78
JSON_Parse_Nested_Containers 47530.00968724164 ns/iter 63904.0178571396 ns/iter 0.74
JSON_From_String_Copy 39.539246651790606 ns/iter 48.93344431517886 ns/iter 0.81
JSON_From_String_Temporary 43.65982459763663 ns/iter 63.426142857144285 ns/iter 0.69
JSON_Number_To_Double 63.95785714286007 ns/iter 104.48117187499939 ns/iter 0.61
JSON_Object_At_Last_Key_8 3.2642251957924677 ns/iter
JSON_Object_At_Last_Key_32 9.721649956599757 ns/iter
JSON_Object_At_Last_Key_128 51.041680000003 ns/iter
JSON_Object_At_Last_Key_512 159.60100446427307 ns/iter
JSON_Fast_Hash_Helm_Chart_Lock 56.346529999996164 ns/iter 87.62617912383661 ns/iter 0.64
JSON_Equality_Helm_Chart_Lock 106.4903906249981 ns/iter 165.12859375000642 ns/iter 0.64
JSON_Divisible_By_Decimal 174.81331304553265 ns/iter 281.49624983300265 ns/iter 0.62
JSON_String_Equal_10 5.225290999999288 ns/iter
JSON_String_Equal_100 5.713050000000155 ns/iter
JSON_String_Equal_Small_By_Perfect_Hash_10 1.1729539062500294 ns/iter
JSON_String_Equal_Small_By_Runtime_Perfect_Hash_10 7.55268749999998 ns/iter
JSON_String_Fast_Hash_10 3.640139636356665 ns/iter
JSON_String_Fast_Hash_100 3.57676336494701 ns/iter
JSON_String_Key_Hash_10 2.60413142857122 ns/iter
JSON_String_Key_Hash_100 5.931949999999233 ns/iter
JSON_Object_Defines_Miss_Same_Length 2.3288864482937273 ns/iter 3.001290266517279 ns/iter 0.78
JSON_Object_Defines_Miss_Too_Small 2.346825332202395 ns/iter 3.157447036183427 ns/iter 0.74
JSON_Object_Defines_Miss_Too_Large 2.2368334796466787 ns/iter 2.985413165644606 ns/iter 0.75
Pointer_Object_Traverse 32.489004464285436 ns/iter 51.65609821428266 ns/iter 0.63
Pointer_Object_Try_Traverse 35.96275868775215 ns/iter 52.23508928571009 ns/iter 0.69
Pointer_Push_Back_Pointer_To_Weak_Pointer 181.35750321590245 ns/iter 136.85527960467567 ns/iter 1.33
Pointer_Walker_Schema_ISO_Language 9276489.333333302 ns/iter 11626916.071429199 ns/iter 0.80
Pointer_Untracked_Deeply_Nested 1533492.633928546 ns/iter
Pointer_Tracked_Deeply_Nested 2233579.598662094 ns/iter
Pointer_Position_Tracker_Get_Deeply_Nested 384.09626116069666 ns/iter 428.53283215358897 ns/iter 0.90
Schema_Tracker_ISO_Language 6284900.000000196 ns/iter 9506700.000000212 ns/iter 0.66
Schema_Tracker_ISO_Language_To_JSON 42536956.24999665 ns/iter 54510409.09091179 ns/iter 0.78
Schema_Frame_WoT_References 3374861.2745099827 ns/iter 4283096.24999983 ns/iter 0.79
Schema_Frame_OMC_References 13596219.999999449 ns/iter 20849090.625000954 ns/iter 0.65
Schema_Frame_OMC_Pointers 25948242.85714432 ns/iter 38667347.36842066 ns/iter 0.67
Schema_Frame_OMC_Locations 12117923.214284638 ns/iter 18291680.48780408 ns/iter 0.66
Schema_Frame_ISO_Language_Locations 56893190.90908446 ns/iter 88420299.99999568 ns/iter 0.64
Schema_Frame_ISO_Language_Root 1346.101274062049 ns/iter 1682.6033152210293 ns/iter 0.80
Schema_Frame_KrakenD_References 24515928.571430225 ns/iter 37559357.89473597 ns/iter 0.65
Schema_Frame_KrakenD_Reachable 161157424.99999896 ns/iter 194570999.99999627 ns/iter 0.83
Schema_Frame_ISO_Language_Locations_To_JSON 122831750.00000787 ns/iter 157746100.00001132 ns/iter 0.78
Schema_Frame_Many_Resources_References 365176550.0000011 ns/iter 547918299.9999921 ns/iter 0.67
Schema_Frame_Deeply_Nested_References 11030928.88888821 ns/iter 18301193.333333764 ns/iter 0.60
JSONPath_Descendant_Filter_Nested 1427.0164611535088 ns/iter 1902.8173239441248 ns/iter 0.75
URITemplateRouter_Create 22928.985167578223 ns/iter 31582.906249999964 ns/iter 0.73
URITemplateRouter_Match 119.37370312500306 ns/iter 170.2003105044759 ns/iter 0.70
URITemplateRouter_Match_BasePath 137.08291129094295 ns/iter 195.8840492908829 ns/iter 0.70
URITemplateRouterView_Restore 15577.602678573347 ns/iter 20002.44907434369 ns/iter 0.78
URITemplateRouterView_Match 87.46709877379219 ns/iter 155.27876092505252 ns/iter 0.56
URITemplateRouterView_Match_BasePath 100.64975443528922 ns/iter 154.01006696430994 ns/iter 0.65
URITemplateRouterView_Arguments 337.5917075729148 ns/iter 468.0893277438937 ns/iter 0.72
JSONL_Parse_Large 21350899.999998063 ns/iter 25454867.857141443 ns/iter 0.84
JSONL_Parse_Large_GZIP 21180355.882352963 ns/iter 24432975.000000365 ns/iter 0.87
JSONLD_Catalog_Annotation_List_Populate 2011150.7246376963 ns/iter 2536945.454545589 ns/iter 0.79
JSONLD_Catalog_Materialize 5181950.999999572 ns/iter 9151896.000000004 ns/iter 0.57
HTML_Build_Table_100000 42634382.35293774 ns/iter 56715963.636365406 ns/iter 0.75
HTML_Render_Table_100000 5907055.000000128 ns/iter 6794894.444443697 ns/iter 0.87
Markdown_To_HTML_Realistic_Document 2971520.657277051 ns/iter 4740065.771811897 ns/iter 0.63
Markdown_To_HTML_Pathological 9464817.333332576 ns/iter 14838737.77777818 ns/iter 0.64
Markdown_To_HTML_Short_Descriptions 398.39994419642113 ns/iter 577.7064285714418 ns/iter 0.69
GZIP_Compress_ISO_Language_Set_3_Locations 21835969.999998875 ns/iter 31249954.54545466 ns/iter 0.70
GZIP_Decompress_ISO_Language_Set_3_Locations 7418261.607143556 ns/iter 8475564.444443585 ns/iter 0.88
GZIP_Decompress_Default_Level_ISO_Language_Set_3_Locations 8942824.000000656 ns/iter 10227085.33333419 ns/iter 0.87
GZIP_Decompress_Stream_Default_Level_ISO_Language_Set_3_Locations 8636742.222222438 ns/iter 13390948.214285865 ns/iter 0.64
GZIP_Compress_ISO_Language_Set_3_Schema 1599009.5823096947 ns/iter 2062997.101449543 ns/iter 0.78
GZIP_Decompress_ISO_Language_Set_3_Schema 449041.1003235723 ns/iter 457183.85800400836 ns/iter 0.98
JOSE_VerifySignature_RS256 12283.49285714257 ns/iter 18572.68904186628 ns/iter 0.66
JOSE_VerifySignature_ES512 848581.4732142367 ns/iter 1187022.0312500733 ns/iter 0.71
CRYPTO_CRC32_Large_JSONL 76682.35491072395 ns/iter 90646.36160713846 ns/iter 0.85

This comment was automatically generated by workflow using github-action-benchmark.

@github-actions github-actions Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (linux/gcc)

Details
Benchmark suite Current: 4349fe0 Previous: d548cca Ratio
CRYPTO_CRC32_Large_JSONL 47021.161246334916 ns/iter 101796.87911447552 ns/iter 0.46
JOSE_VerifySignature_RS256 20973.71585552621 ns/iter 21992.398411751718 ns/iter 0.95
JOSE_VerifySignature_ES512 545160.6229508226 ns/iter 582286.3978405349 ns/iter 0.94
GZIP_Compress_ISO_Language_Set_3_Locations 30751360.65217521 ns/iter 30219190.521739103 ns/iter 1.02
GZIP_Decompress_ISO_Language_Set_3_Locations 4652231.967105087 ns/iter 5180969.7279410595 ns/iter 0.90
GZIP_Decompress_Default_Level_ISO_Language_Set_3_Locations 6392008.119265784 ns/iter 7248568.680412068 ns/iter 0.88
GZIP_Decompress_Stream_Default_Level_ISO_Language_Set_3_Locations 8785942.246753938 ns/iter 9084009.701298298 ns/iter 0.97
GZIP_Compress_ISO_Language_Set_3_Schema 2137328.1926605576 ns/iter 2052340.3460411825 ns/iter 1.04
GZIP_Decompress_ISO_Language_Set_3_Schema 405176.9628770198 ns/iter 433336.98762373783 ns/iter 0.94
Markdown_To_HTML_Realistic_Document 4787316.691780991 ns/iter 5221654.3007518295 ns/iter 0.92
Markdown_To_HTML_Pathological 15766734.044444142 ns/iter 12869668.611111147 ns/iter 1.23
Markdown_To_HTML_Short_Descriptions 565.8766312933097 ns/iter 702.7109160162107 ns/iter 0.81
HTML_Build_Table_100000 46444467.33333514 ns/iter 38541477.111108534 ns/iter 1.21
HTML_Render_Table_100000 3265352.03381642 ns/iter 1933922.4364640506 ns/iter 1.69
JSONLD_Catalog_Annotation_List_Populate 719641.4576098094 ns/iter 705342.8969696814 ns/iter 1.02
JSONLD_Catalog_Materialize 3475941.181372768 ns/iter 3593768.6512820385 ns/iter 0.97
JSONL_Parse_Large 9355659.840000499 ns/iter 9677037.8888888 ns/iter 0.97
JSONL_Parse_Large_GZIP 9701064.486111004 ns/iter 10008761.746479182 ns/iter 0.97
URITemplateRouter_Create 17869.77259638558 ns/iter 21240.41391541545 ns/iter 0.84
URITemplateRouter_Match 147.9664428177162 ns/iter 167.19525984279946 ns/iter 0.88
URITemplateRouter_Match_BasePath 165.04941136512284 ns/iter 184.5418919065499 ns/iter 0.89
URITemplateRouterView_Restore 3685.440494158758 ns/iter 8218.253966794096 ns/iter 0.45
URITemplateRouterView_Match 118.18262827102728 ns/iter 124.99073737772238 ns/iter 0.95
URITemplateRouterView_Match_BasePath 130.47219781683262 ns/iter 141.8498048448247 ns/iter 0.92
URITemplateRouterView_Arguments 542.7491805940649 ns/iter 486.6809825834032 ns/iter 1.12
JSONPath_Descendant_Filter_Nested 1596.8329020384626 ns/iter 1676.8753266724623 ns/iter 0.95
Schema_Frame_WoT_References 2162074.9074073774 ns/iter 2285139.437908635 ns/iter 0.95
Schema_Frame_OMC_References 9664994.287671307 ns/iter 9884435.442856848 ns/iter 0.98
Schema_Frame_OMC_Pointers 18312364.447368916 ns/iter 18553917.0263158 ns/iter 0.99
Schema_Frame_OMC_Locations 8566779.38095223 ns/iter 8536406.951219948 ns/iter 1.00
Schema_Frame_ISO_Language_Locations 43076258.17647048 ns/iter 41193645.52941066 ns/iter 1.05
Schema_Frame_ISO_Language_Root 280.94534099931695 ns/iter 317.14072569728944 ns/iter 0.89
Schema_Frame_KrakenD_References 16305411.302325442 ns/iter 15867671.400000442 ns/iter 1.03
Schema_Frame_KrakenD_Reachable 132983910.99999662 ns/iter 117577706.16667546 ns/iter 1.13
Schema_Frame_ISO_Language_Locations_To_JSON 33751697.666665286 ns/iter 32296910.818181667 ns/iter 1.05
Schema_Frame_Many_Resources_References 148608455.00001007 ns/iter 135133049.40000808 ns/iter 1.10
Schema_Frame_Deeply_Nested_References 11586488.147541286 ns/iter 11072562.969231442 ns/iter 1.05
Pointer_Object_Traverse 25.47551096979352 ns/iter 23.32188837692336 ns/iter 1.09
Pointer_Object_Try_Traverse 27.20912254030405 ns/iter 24.51798064768348 ns/iter 1.11
Pointer_Push_Back_Pointer_To_Weak_Pointer 168.03194862353158 ns/iter 132.6108884710303 ns/iter 1.27
Pointer_Walker_Schema_ISO_Language 1924884.763231177 ns/iter 1542456.9823400383 ns/iter 1.25
Pointer_Untracked_Deeply_Nested 1191437.3056027358 ns/iter
Pointer_Tracked_Deeply_Nested 2219923.075949485 ns/iter
Pointer_Position_Tracker_Get_Deeply_Nested 735.1724044395647 ns/iter 606.5402620411081 ns/iter 1.21
Schema_Tracker_ISO_Language 4977303.688888746 ns/iter 4885394.270833071 ns/iter 1.02
Schema_Tracker_ISO_Language_To_JSON 16693690.166666405 ns/iter 16078572.863636704 ns/iter 1.04
JSON_Array_Of_Objects_Unique 419.7814498696896 ns/iter 439.47023179496074 ns/iter 0.96
JSON_Parse_1 4804.920136340738 ns/iter 5342.057459334223 ns/iter 0.90
JSON_Parse_Real 4950.767255409423 ns/iter 5570.281763472224 ns/iter 0.89
JSON_Parse_Decimal 8152.746056122021 ns/iter 10257.722710126303 ns/iter 0.79
JSON_Parse_Schema_ISO_Language 3427281.470588444 ns/iter 3652113.4010418043 ns/iter 0.94
JSON_Parse_Integer 3657.0871942157814 ns/iter 3757.886478836924 ns/iter 0.97
JSON_Parse_String_NonSSO_Plain 3446.5242087035003 ns/iter 3372.6123660648664 ns/iter 1.02
JSON_Parse_String_SSO_Plain 2635.280352717809 ns/iter 2997.1954152964586 ns/iter 0.88
JSON_Parse_String_Escape_Heavy 15427.92928737904 ns/iter 16470.469019054395 ns/iter 0.94
JSON_Parse_Object_Short_Keys 7678.3843833636065 ns/iter 8840.123851937991 ns/iter 0.87
JSON_Parse_Object_Scalar_Properties 3950.8839316343574 ns/iter 4501.208299299653 ns/iter 0.88
JSON_Parse_Object_Array_Properties 5765.453506286324 ns/iter 6599.025070802475 ns/iter 0.87
JSON_Parse_Object_Object_Properties 5695.567550202241 ns/iter 6601.952611947388 ns/iter 0.86
JSON_Parse_Nested_Containers 36490.10488490658 ns/iter 40625.18693536872 ns/iter 0.90
JSON_From_String_Copy 8.740759991280434 ns/iter 9.417037048296072 ns/iter 0.93
JSON_From_String_Temporary 7.389524002337726 ns/iter 7.975793651791653 ns/iter 0.93
JSON_Number_To_Double 18.792526745072298 ns/iter 19.6630082164158 ns/iter 0.96
JSON_Object_At_Last_Key_8 5.840988922115362 ns/iter
JSON_Object_At_Last_Key_32 19.594022776161125 ns/iter
JSON_Object_At_Last_Key_128 74.97958654232383 ns/iter
JSON_Object_At_Last_Key_512 304.6504304763014 ns/iter
JSON_Fast_Hash_Helm_Chart_Lock 66.06736423573915 ns/iter 71.84412383244606 ns/iter 0.92
JSON_Equality_Helm_Chart_Lock 128.09429735255077 ns/iter 147.4897014457027 ns/iter 0.87
JSON_Divisible_By_Decimal 277.3913842957676 ns/iter 272.8803205524341 ns/iter 1.02
JSON_String_Equal_10 5.010360037467917 ns/iter
JSON_String_Equal_100 6.159165253614106 ns/iter
JSON_String_Equal_Small_By_Perfect_Hash_10 0.825846385069988 ns/iter
JSON_String_Equal_Small_By_Runtime_Perfect_Hash_10 12.968745005219429 ns/iter
JSON_String_Fast_Hash_10 3.104799514147328 ns/iter
JSON_String_Fast_Hash_100 3.1265616572228163 ns/iter
JSON_String_Key_Hash_10 1.7290302520844392 ns/iter
JSON_String_Key_Hash_100 11.834497901354597 ns/iter
JSON_Object_Defines_Miss_Same_Length 3.6871198605534645 ns/iter 3.1151960422314993 ns/iter 1.18
JSON_Object_Defines_Miss_Too_Small 3.4742326962218706 ns/iter 3.1189666780592864 ns/iter 1.11
JSON_Object_Defines_Miss_Too_Large 3.4887990944529292 ns/iter 3.1124876094077494 ns/iter 1.12
Regex_Lower_S_Or_Upper_S_Asterisk 2.3030934246539214 ns/iter 2.109313910465861 ns/iter 1.09
Regex_Caret_Lower_S_Or_Upper_S_Asterisk_Dollar 2.3767597076566775 ns/iter 2.101814498853589 ns/iter 1.13
Regex_Period_Asterisk 2.3541552876316016 ns/iter 2.0249126631332452 ns/iter 1.16
Regex_Group_Period_Asterisk_Group 2.2747515609682396 ns/iter 2.023979754264185 ns/iter 1.12
Regex_Period_Plus 2.3034046216599013 ns/iter 2.1018330086318295 ns/iter 1.10
Regex_Period 2.3979039515738605 ns/iter 2.1023155695814606 ns/iter 1.14
Regex_Caret_Period_Plus_Dollar 2.3560596908614073 ns/iter 2.022159234573406 ns/iter 1.17
Regex_Caret_Group_Period_Plus_Group_Dollar 2.27910869544735 ns/iter 2.0228461586729853 ns/iter 1.13
Regex_Caret_Period_Asterisk_Dollar 2.3055357563537235 ns/iter 2.1020336474230374 ns/iter 1.10
Regex_Caret_Group_Period_Asterisk_Group_Dollar 2.3836007867996933 ns/iter 2.107182343024549 ns/iter 1.13
Regex_Caret_X_Hyphen 6.0002680783481965 ns/iter 7.017757663504895 ns/iter 0.86
Regex_Period_Md_Dollar 24.367175677885214 ns/iter 30.59388203357102 ns/iter 0.80
Regex_Caret_Slash_Period_Asterisk 5.922943457484168 ns/iter 7.705528581247124 ns/iter 0.77
Regex_Caret_Period_Range_Dollar 2.980163570931718 ns/iter 3.970411294718312 ns/iter 0.75
Regex_Nested_Backtrack 38.39369534244717 ns/iter 40.034996318939264 ns/iter 0.96

This comment was automatically generated by workflow using github-action-benchmark.

@github-actions github-actions Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (linux/llvm)

Details
Benchmark suite Current: 4349fe0 Previous: d548cca Ratio
Regex_Lower_S_Or_Upper_S_Asterisk 2.197064833995852 ns/iter 1.719098506373966 ns/iter 1.28
Regex_Caret_Lower_S_Or_Upper_S_Asterisk_Dollar 2.1797855101052437 ns/iter 1.710767922009563 ns/iter 1.27
Regex_Period_Asterisk 2.178122412686848 ns/iter 1.6958658664136557 ns/iter 1.28
Regex_Group_Period_Asterisk_Group 2.179017260728845 ns/iter 1.6931314316060009 ns/iter 1.29
Regex_Period_Plus 2.801587639932992 ns/iter 2.0633557292944675 ns/iter 1.36
Regex_Period 2.8013655144913163 ns/iter 2.0807165754111745 ns/iter 1.35
Regex_Caret_Period_Plus_Dollar 2.801576138057789 ns/iter 2.1207728023631254 ns/iter 1.32
Regex_Caret_Group_Period_Plus_Group_Dollar 2.801238411195406 ns/iter 2.0410071446664033 ns/iter 1.37
Regex_Caret_Period_Asterisk_Dollar 3.4253327299415535 ns/iter 1.7557969429812477 ns/iter 1.95
Regex_Caret_Group_Period_Asterisk_Group_Dollar 3.421559741563835 ns/iter 1.7123838057209966 ns/iter 2.00
Regex_Caret_X_Hyphen 7.468070880604535 ns/iter 3.7541024099691813 ns/iter 1.99
Regex_Period_Md_Dollar 26.918573932233322 ns/iter 19.30077770939072 ns/iter 1.39
Regex_Caret_Slash_Period_Asterisk 6.222484680243502 ns/iter 3.7205089599636856 ns/iter 1.67
Regex_Caret_Period_Range_Dollar 4.3554723110761095 ns/iter 2.609939849806866 ns/iter 1.67
Regex_Nested_Backtrack 40.45606258604651 ns/iter 30.83993575390147 ns/iter 1.31
JSON_Array_Of_Objects_Unique 447.692695716434 ns/iter 337.2428632925179 ns/iter 1.33
JSON_Parse_1 4471.900466255666 ns/iter 3705.486907098862 ns/iter 1.21
JSON_Parse_Real 5297.711294978777 ns/iter 3903.9417933539307 ns/iter 1.36
JSON_Parse_Decimal 7597.248916969446 ns/iter 6238.905800639414 ns/iter 1.22
JSON_Parse_Schema_ISO_Language 3278792.878504476 ns/iter 2639419.469465543 ns/iter 1.24
JSON_Parse_Integer 3712.0401801823946 ns/iter 2792.837781706211 ns/iter 1.33
JSON_Parse_String_NonSSO_Plain 3123.4122388496194 ns/iter 2239.899778610118 ns/iter 1.39
JSON_Parse_String_SSO_Plain 2632.5203185632536 ns/iter 2092.240840333211 ns/iter 1.26
JSON_Parse_String_Escape_Heavy 12435.72724367966 ns/iter 10527.388431209156 ns/iter 1.18
JSON_Parse_Object_Short_Keys 7937.687872040876 ns/iter 6153.67852129932 ns/iter 1.29
JSON_Parse_Object_Scalar_Properties 4055.60193507432 ns/iter 3153.484657829673 ns/iter 1.29
JSON_Parse_Object_Array_Properties 5533.854319087768 ns/iter 4400.760084546307 ns/iter 1.26
JSON_Parse_Object_Object_Properties 5496.5832568141295 ns/iter 4184.9899217458615 ns/iter 1.31
JSON_Parse_Nested_Containers 34346.30813383245 ns/iter 28191.674398267587 ns/iter 1.22
JSON_From_String_Copy 11.106721954763445 ns/iter 7.711126713017613 ns/iter 1.44
JSON_From_String_Temporary 9.972181606490425 ns/iter 6.419376134405751 ns/iter 1.55
JSON_Number_To_Double 22.264088407349615 ns/iter 22.481148951481213 ns/iter 0.99
JSON_Object_At_Last_Key_8 3.8466006058774416 ns/iter
JSON_Object_At_Last_Key_32 12.340791400514005 ns/iter
JSON_Object_At_Last_Key_128 48.27906778114236 ns/iter
JSON_Object_At_Last_Key_512 391.1582505222198 ns/iter
JSON_Fast_Hash_Helm_Chart_Lock 66.01411621302903 ns/iter 53.54234201683606 ns/iter 1.23
JSON_Equality_Helm_Chart_Lock 157.193549562381 ns/iter 116.6814640421421 ns/iter 1.35
JSON_Divisible_By_Decimal 239.1281929467747 ns/iter 199.68109921336645 ns/iter 1.20
JSON_String_Equal_10 5.924219802549122 ns/iter
JSON_String_Equal_100 6.545780186639681 ns/iter
JSON_String_Equal_Small_By_Perfect_Hash_10 0.9394177382641564 ns/iter
JSON_String_Equal_Small_By_Runtime_Perfect_Hash_10 14.92684168774705 ns/iter
JSON_String_Fast_Hash_10 3.1158147151261293 ns/iter
JSON_String_Fast_Hash_100 2.804712171045123 ns/iter
JSON_String_Key_Hash_10 2.7333414846943644 ns/iter
JSON_String_Key_Hash_100 9.043039989087456 ns/iter
JSON_Object_Defines_Miss_Same_Length 3.0882762482065536 ns/iter 3.344904402701168 ns/iter 0.92
JSON_Object_Defines_Miss_Too_Small 3.4260084106897937 ns/iter 4.252931296446677 ns/iter 0.81
JSON_Object_Defines_Miss_Too_Large 2.840081415554866 ns/iter 3.511335055228702 ns/iter 0.81
Pointer_Object_Traverse 28.494003951174488 ns/iter 20.558686321036685 ns/iter 1.39
Pointer_Object_Try_Traverse 33.627065887234494 ns/iter 24.85171209845929 ns/iter 1.35
Pointer_Push_Back_Pointer_To_Weak_Pointer 203.5781225787834 ns/iter 112.38700933523006 ns/iter 1.81
Pointer_Walker_Schema_ISO_Language 1518859.596026493 ns/iter 1788767.0434781292 ns/iter 0.85
Pointer_Untracked_Deeply_Nested 1220141.3717277325 ns/iter
Pointer_Tracked_Deeply_Nested 1623615.285714271 ns/iter
Pointer_Position_Tracker_Get_Deeply_Nested 620.9882652087381 ns/iter 631.9739367207304 ns/iter 0.98
Schema_Tracker_ISO_Language 4405568.093749679 ns/iter 3569952.613401966 ns/iter 1.23
Schema_Tracker_ISO_Language_To_JSON 16515576.534883685 ns/iter 12759038.907407533 ns/iter 1.29
Schema_Frame_WoT_References 2151957.938837771 ns/iter 1856853.1546666238 ns/iter 1.16
Schema_Frame_OMC_References 9405611.194029346 ns/iter 7967693.044943727 ns/iter 1.18
Schema_Frame_OMC_Pointers 17875135.200000614 ns/iter 15044582.914893387 ns/iter 1.19
Schema_Frame_OMC_Locations 8092266.0232558455 ns/iter 6886452.291261878 ns/iter 1.18
Schema_Frame_ISO_Language_Locations 40207304.11765031 ns/iter 32048509.77272661 ns/iter 1.25
Schema_Frame_ISO_Language_Root 309.28889311183707 ns/iter 227.31829010428996 ns/iter 1.36
Schema_Frame_KrakenD_References 14869423.57446859 ns/iter 12445690.074074449 ns/iter 1.19
Schema_Frame_KrakenD_Reachable 145768426.19999295 ns/iter 101390578.83335076 ns/iter 1.44
Schema_Frame_ISO_Language_Locations_To_JSON 30178566.454542924 ns/iter 23496359.400000226 ns/iter 1.28
Schema_Frame_Many_Resources_References 129957280.00000782 ns/iter 127613401.33333004 ns/iter 1.02
Schema_Frame_Deeply_Nested_References 10788509.415384887 ns/iter 8905252.337499548 ns/iter 1.21
JSONPath_Descendant_Filter_Nested 1608.727053023609 ns/iter 1245.5598477948988 ns/iter 1.29
URITemplateRouter_Create 23701.601906594948 ns/iter 16693.342813750798 ns/iter 1.42
URITemplateRouter_Match 179.9189443555283 ns/iter 157.1477596442754 ns/iter 1.14
URITemplateRouter_Match_BasePath 208.6820566047554 ns/iter 162.3757543811879 ns/iter 1.29
URITemplateRouterView_Restore 8506.990455346855 ns/iter 3133.97263803668 ns/iter 2.71
URITemplateRouterView_Match 161.7385730786084 ns/iter 113.06469150752861 ns/iter 1.43
URITemplateRouterView_Match_BasePath 184.6211729323045 ns/iter 130.3388809141438 ns/iter 1.42
URITemplateRouterView_Arguments 445.0077225489149 ns/iter 379.8405351580926 ns/iter 1.17
JSONL_Parse_Large 9008306.102564288 ns/iter 7397768.229166601 ns/iter 1.22
JSONL_Parse_Large_GZIP 9111942.573334394 ns/iter 7570982.354838624 ns/iter 1.20
JSONLD_Catalog_Annotation_List_Populate 597358.2683134688 ns/iter 611314.4731369473 ns/iter 0.98
JSONLD_Catalog_Materialize 3466608.896551384 ns/iter 2984110.7489713333 ns/iter 1.16
HTML_Build_Table_100000 38031495.89473857 ns/iter 30347738.608695537 ns/iter 1.25
HTML_Render_Table_100000 1928528.0611111629 ns/iter 2740332.9884615107 ns/iter 0.70
Markdown_To_HTML_Realistic_Document 4147770.958333635 ns/iter 3373734.495237982 ns/iter 1.23
Markdown_To_HTML_Pathological 14060744.920000162 ns/iter 12074429.701753711 ns/iter 1.16
Markdown_To_HTML_Short_Descriptions 573.4540847228029 ns/iter 389.2821041754114 ns/iter 1.47
GZIP_Compress_ISO_Language_Set_3_Locations 37385872.21052489 ns/iter 27484349.960000142 ns/iter 1.36
GZIP_Decompress_ISO_Language_Set_3_Locations 5100366.277371778 ns/iter 3597515.2666668906 ns/iter 1.42
GZIP_Decompress_Default_Level_ISO_Language_Set_3_Locations 7064609.1414135005 ns/iter 5063854.863636128 ns/iter 1.40
GZIP_Decompress_Stream_Default_Level_ISO_Language_Set_3_Locations 8664833.873417247 ns/iter 6997631.95918343 ns/iter 1.24
GZIP_Compress_ISO_Language_Set_3_Schema 2227288.25796168 ns/iter 2039741.8100559555 ns/iter 1.09
GZIP_Decompress_ISO_Language_Set_3_Schema 420367.6466706692 ns/iter 370602.2772798973 ns/iter 1.13
JOSE_VerifySignature_RS256 46944.5410264948 ns/iter 40764.11468474711 ns/iter 1.15
JOSE_VerifySignature_ES512 1749293.6725000164 ns/iter 1424997.2768924686 ns/iter 1.23
CRYPTO_CRC32_Large_JSONL 101522.78504130783 ns/iter 46622.27962938114 ns/iter 2.18

This comment was automatically generated by workflow using github-action-benchmark.

@jviotti
jviotti merged commit 0a9c2c8 into main Sep 17, 2026
15 checks passed
@jviotti
jviotti deleted the benchmark-fixes branch September 17, 2026 00:08

@github-actions github-actions Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (macos/llvm)

Details
Benchmark suite Current: 4349fe0 Previous: d548cca Ratio
Regex_Lower_S_Or_Upper_S_Asterisk 2.113289003640396 ns/iter 2.4458773866424153 ns/iter 0.86
Regex_Caret_Lower_S_Or_Upper_S_Asterisk_Dollar 2.074626378048798 ns/iter 3.2361281001743696 ns/iter 0.64
Regex_Period_Asterisk 2.0367374022854383 ns/iter 2.9817568475584237 ns/iter 0.68
Regex_Group_Period_Asterisk_Group 2.1871370411902036 ns/iter 2.7465650700199813 ns/iter 0.80
Regex_Period_Plus 2.963565009886792 ns/iter 3.101322419088842 ns/iter 0.96
Regex_Period 2.940583824437911 ns/iter 3.665649256232191 ns/iter 0.80
Regex_Caret_Period_Plus_Dollar 2.6537761984171793 ns/iter 6.745284935841646 ns/iter 0.39
Regex_Caret_Group_Period_Plus_Group_Dollar 2.8293093257193798 ns/iter 3.5991437436702984 ns/iter 0.79
Regex_Caret_Period_Asterisk_Dollar 2.0832094325918624 ns/iter 4.204881694375515 ns/iter 0.50
Regex_Caret_Group_Period_Asterisk_Group_Dollar 2.2200042480328217 ns/iter 3.2223477520996915 ns/iter 0.69
Regex_Caret_X_Hyphen 7.5919814791485445 ns/iter 9.399257562497773 ns/iter 0.81
Regex_Period_Md_Dollar 19.62818720551918 ns/iter 28.302115623960752 ns/iter 0.69
Regex_Caret_Slash_Period_Asterisk 6.046957270707941 ns/iter 6.153072627768088 ns/iter 0.98
Regex_Caret_Period_Range_Dollar 2.5262439563997208 ns/iter 3.715755033635101 ns/iter 0.68
Regex_Nested_Backtrack 35.28770549589267 ns/iter 48.96395824003388 ns/iter 0.72
JSON_Array_Of_Objects_Unique 427.5893372688228 ns/iter 623.2141671602113 ns/iter 0.69
JSON_Parse_1 3862.9284990418187 ns/iter 4209.266289596499 ns/iter 0.92
JSON_Parse_Real 6609.873338274051 ns/iter 8720.503281958241 ns/iter 0.76
JSON_Parse_Decimal 7912.093909749297 ns/iter 8749.69235519031 ns/iter 0.90
JSON_Parse_Schema_ISO_Language 2653030.921874411 ns/iter 2928869.6682465235 ns/iter 0.91
JSON_Parse_Integer 3836.8396346030745 ns/iter 3745.7898533703114 ns/iter 1.02
JSON_Parse_String_NonSSO_Plain 3804.307286635258 ns/iter 3836.954611962654 ns/iter 0.99
JSON_Parse_String_SSO_Plain 2137.0834237120953 ns/iter 1945.8130782789246 ns/iter 1.10
JSON_Parse_String_Escape_Heavy 20087.326248700418 ns/iter 18393.716632441938 ns/iter 1.09
JSON_Parse_Object_Short_Keys 6541.926153875041 ns/iter 6463.829649577381 ns/iter 1.01
JSON_Parse_Object_Scalar_Properties 3334.0723342462998 ns/iter 3542.884377181736 ns/iter 0.94
JSON_Parse_Object_Array_Properties 3970.193749517554 ns/iter 4296.020303340382 ns/iter 0.92
JSON_Parse_Object_Object_Properties 4203.755087649234 ns/iter 3845.203745323005 ns/iter 1.09
JSON_Parse_Nested_Containers 31888.080006979955 ns/iter 32252.569668821376 ns/iter 0.99
JSON_From_String_Copy 13.299618904253327 ns/iter 16.161948079327566 ns/iter 0.82
JSON_From_String_Temporary 7.907321878685618 ns/iter 8.962034285218863 ns/iter 0.88
JSON_Number_To_Double 42.269750760894865 ns/iter 42.50289641239527 ns/iter 0.99
JSON_Object_At_Last_Key_8 5.105213411845676 ns/iter
JSON_Object_At_Last_Key_32 16.804750964008242 ns/iter
JSON_Object_At_Last_Key_128 67.89199330345929 ns/iter
JSON_Object_At_Last_Key_512 245.83068216478554 ns/iter
JSON_Fast_Hash_Helm_Chart_Lock 70.73737835493144 ns/iter 81.3258016447864 ns/iter 0.87
JSON_Equality_Helm_Chart_Lock 210.1977932578491 ns/iter 222.65186905537712 ns/iter 0.94
JSON_Divisible_By_Decimal 252.29070537207838 ns/iter 239.92100229392645 ns/iter 1.05
JSON_String_Equal_10 8.153292421520582 ns/iter
JSON_String_Equal_100 8.075910255822963 ns/iter
JSON_String_Equal_Small_By_Perfect_Hash_10 0.41483954051972066 ns/iter
JSON_String_Equal_Small_By_Runtime_Perfect_Hash_10 3.9176748541626543 ns/iter
JSON_String_Fast_Hash_10 2.8804229743208216 ns/iter
JSON_String_Fast_Hash_100 2.4465835721369853 ns/iter
JSON_String_Key_Hash_10 2.074015364547877 ns/iter
JSON_String_Key_Hash_100 2.770446278507119 ns/iter
JSON_Object_Defines_Miss_Same_Length 3.340454888659445 ns/iter 2.8673537784898357 ns/iter 1.16
JSON_Object_Defines_Miss_Too_Small 3.2972504683195014 ns/iter 3.2893599460172505 ns/iter 1.00
JSON_Object_Defines_Miss_Too_Large 3.34038626601143 ns/iter 3.0063704838892487 ns/iter 1.11
Pointer_Object_Traverse 24.31158837715814 ns/iter 23.072123731154296 ns/iter 1.05
Pointer_Object_Try_Traverse 41.79111746123196 ns/iter 41.412651452639594 ns/iter 1.01
Pointer_Push_Back_Pointer_To_Weak_Pointer 167.8236455760574 ns/iter 156.95882157571913 ns/iter 1.07
Pointer_Walker_Schema_ISO_Language 1817328.843091579 ns/iter 2122158.059304683 ns/iter 0.86
Pointer_Untracked_Deeply_Nested 1044781.7397057272 ns/iter
Pointer_Tracked_Deeply_Nested 1334786.8198875224 ns/iter
Pointer_Position_Tracker_Get_Deeply_Nested 446.50550245764737 ns/iter 436.82276099251527 ns/iter 1.02
Schema_Tracker_ISO_Language 3823789.528204986 ns/iter 3380827.2058821535 ns/iter 1.13
Schema_Tracker_ISO_Language_To_JSON 13739935.884613119 ns/iter 12618518.822580794 ns/iter 1.09
Schema_Frame_WoT_References 2777982.8125005676 ns/iter 2561988.2703705556 ns/iter 1.08
Schema_Frame_OMC_References 12217279.85000219 ns/iter 12149976.614034785 ns/iter 1.01
Schema_Frame_OMC_Pointers 24486324.72413104 ns/iter 24141498.764707007 ns/iter 1.01
Schema_Frame_OMC_Locations 10733381.735295713 ns/iter 9197702.951610154 ns/iter 1.17
Schema_Frame_ISO_Language_Locations 28737419.884613212 ns/iter 23933458.33333266 ns/iter 1.20
Schema_Frame_ISO_Language_Root 137.03311653341265 ns/iter 119.51510808841653 ns/iter 1.15
Schema_Frame_KrakenD_References 17275636.170735396 ns/iter 20866446.12195525 ns/iter 0.83
Schema_Frame_KrakenD_Reachable 210865971.99996504 ns/iter 175837333.66670156 ns/iter 1.20
Schema_Frame_ISO_Language_Locations_To_JSON 30010955.000007015 ns/iter 25890193.965520225 ns/iter 1.16
Schema_Frame_Many_Resources_References 129192319.49998295 ns/iter 143328041.59998888 ns/iter 0.90
Schema_Frame_Deeply_Nested_References 14644810.38775208 ns/iter 14618069.711537791 ns/iter 1.00
JSONPath_Descendant_Filter_Nested 1450.2670325381075 ns/iter 1372.6507156684916 ns/iter 1.06
URITemplateRouter_Create 21433.637668999792 ns/iter 22931.762161195133 ns/iter 0.93
URITemplateRouter_Match 209.9503921357928 ns/iter 189.58559689559954 ns/iter 1.11
URITemplateRouter_Match_BasePath 245.11948633001577 ns/iter 238.27254216248616 ns/iter 1.03
URITemplateRouterView_Restore 13064.381725414638 ns/iter 11848.707131415818 ns/iter 1.10
URITemplateRouterView_Match 152.49907792142804 ns/iter 157.7437153738345 ns/iter 0.97
URITemplateRouterView_Match_BasePath 181.945536729342 ns/iter 190.2316962397107 ns/iter 0.96
URITemplateRouterView_Arguments 655.234321936852 ns/iter 719.4392896505809 ns/iter 0.91
JSONL_Parse_Large 7278017.7340422245 ns/iter 9534433.823529633 ns/iter 0.76
JSONL_Parse_Large_GZIP 7366383.861702818 ns/iter 8960651.50649307 ns/iter 0.82
JSONLD_Catalog_Annotation_List_Populate 572770.509403141 ns/iter 657097.89866459 ns/iter 0.87
JSONLD_Catalog_Materialize 2606107.8798447005 ns/iter 3146122.084999661 ns/iter 0.83
HTML_Build_Table_100000 31111473.50000465 ns/iter 33321322.89999663 ns/iter 0.93
HTML_Render_Table_100000 1611579.7157896706 ns/iter 1930303.4825867794 ns/iter 0.83
Markdown_To_HTML_Realistic_Document 3635394.6615387634 ns/iter 3669592.2131983642 ns/iter 0.99
Markdown_To_HTML_Pathological 11929187.847457241 ns/iter 11700935.416664986 ns/iter 1.02
Markdown_To_HTML_Short_Descriptions 411.9419777560776 ns/iter 446.9627469905871 ns/iter 0.92
GZIP_Compress_ISO_Language_Set_3_Locations 34495102.10000426 ns/iter 37225468.75000034 ns/iter 0.93
GZIP_Decompress_ISO_Language_Set_3_Locations 3593625.216494401 ns/iter 4355831.944443859 ns/iter 0.83
GZIP_Decompress_Default_Level_ISO_Language_Set_3_Locations 5299858.901514998 ns/iter 5594084.463636632 ns/iter 0.95
GZIP_Decompress_Stream_Default_Level_ISO_Language_Set_3_Locations 7038415.154546453 ns/iter 7664294.169999266 ns/iter 0.92
GZIP_Compress_ISO_Language_Set_3_Schema 2341207.9207920628 ns/iter 2633890.066421057 ns/iter 0.89
GZIP_Decompress_ISO_Language_Set_3_Schema 369959.7920424023 ns/iter 390494.6748879219 ns/iter 0.95
JOSE_VerifySignature_RS256 26605.898119185935 ns/iter 33911.72019526094 ns/iter 0.78
JOSE_VerifySignature_ES512 1225779.3386807162 ns/iter 1129921.2468468605 ns/iter 1.08
CRYPTO_CRC32_Large_JSONL 28264.33041225749 ns/iter 24590.895935768905 ns/iter 1.15

This comment was automatically generated by workflow using github-action-benchmark.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant