-
-
Notifications
You must be signed in to change notification settings - Fork 5
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Track evaluation depth as a recursive argument (#201)
Signed-off-by: Juan Cruz Viotti <[email protected]>
- Loading branch information
Showing
4 changed files
with
63 additions
and
62 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.
21b2224
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Benchmark (macos/llvm)
Compiler_Draft6_AdaptiveCard
32590336957.999966
ns/iter32874253374.999966
ns/iter0.99
Compiler_2019_09_OMC_JSON_V2
6740815083.00003
ns/iter7445065750.000026
ns/iter0.91
Evaluator_Draft4_Meta_1_No_Callback
273.24636906673425
ns/iter316.1394086427567
ns/iter0.86
Evaluator_Draft4_Required_Properties
388.34383967437816
ns/iter450.6620471897142
ns/iter0.86
Evaluator_Draft4_Many_Optional_Properties_Minimal_Match
23.72339953986068
ns/iter29.346204515617565
ns/iter0.81
Evaluator_Draft4_Few_Optional_Properties_Minimal_Match
14.51875797614672
ns/iter16.286284268984875
ns/iter0.89
Evaluator_Draft4_Items_Schema
768.622836181901
ns/iter846.5621298025235
ns/iter0.91
Evaluator_Draft4_Nested_Object
4.098897768283928
ns/iter4.398489997672311
ns/iter0.93
Evaluator_Draft4_Properties_Triad_Optional
1002.0209548721255
ns/iter1104.7126506431478
ns/iter0.91
Evaluator_Draft4_Properties_Triad_Closed
716.6688446160916
ns/iter792.4494203241684
ns/iter0.90
Evaluator_Draft4_Properties_Triad_Required
1063.197289442821
ns/iter1091.4448500181416
ns/iter0.97
Evaluator_Draft4_Properties_Closed
96.69520856846464
ns/iter121.82840435849756
ns/iter0.79
Evaluator_Draft4_Non_Recursive_Ref
14.113816568825335
ns/iter16.29041964869751
ns/iter0.87
Evaluator_Draft4_Pattern_Properties_True
1209.3663686491263
ns/iter1227.6176474215551
ns/iter0.99
Evaluator_Draft4_Ref_To_Single_Property
15.395195672430578
ns/iter17.926868357641332
ns/iter0.86
Evaluator_Draft4_Additional_Properties_Type
25.352783392641378
ns/iter27.402445994060905
ns/iter0.93
Evaluator_Draft4_Nested_Oneof
95.96090495149755
ns/iter105.15139021138607
ns/iter0.91
Evaluator_Draft4_Long_Enum
22.901136555624838
ns/iter24.683145991176023
ns/iter0.93
Evaluator_Draft4_Type_Object
8.824303744490177
ns/iter10.400092870201158
ns/iter0.85
Evaluator_Draft6_Property_Names
295.50720621371573
ns/iter331.0307148358441
ns/iter0.89
Evaluator_Draft7_If_Then_Else
39.131689921418676
ns/iter44.84361965934845
ns/iter0.87
Evaluator_Draft7_Vercel_1
93880.55746972948
ns/iter98866.23491837735
ns/iter0.95
Evaluator_2019_09_Unevaluated_Properties
219.4557319801684
ns/iter234.43542275415837
ns/iter0.94
Evaluator_2019_09_OMC_JSON_V2_1
7026.746161422286
ns/iter6773.275414380326
ns/iter1.04
Evaluator_2020_12_Dynamic_Ref
706.8834894205391
ns/iter712.5673270192636
ns/iter0.99
This comment was automatically generated by workflow using github-action-benchmark.
21b2224
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Benchmark (linux/llvm)
Compiler_Draft6_AdaptiveCard
57958090809
ns/iter57933851975.99997
ns/iter1.00
Compiler_2019_09_OMC_JSON_V2
11006546474.999992
ns/iter10993956199.000025
ns/iter1.00
Evaluator_Draft4_Meta_1_No_Callback
493.6494071404948
ns/iter478.72336305802963
ns/iter1.03
Evaluator_Draft4_Required_Properties
926.1311993593779
ns/iter957.7069340217801
ns/iter0.97
Evaluator_Draft4_Many_Optional_Properties_Minimal_Match
60.9610902964276
ns/iter58.33495333838399
ns/iter1.05
Evaluator_Draft4_Few_Optional_Properties_Minimal_Match
41.00600987052514
ns/iter39.28950076407092
ns/iter1.04
Evaluator_Draft4_Items_Schema
1477.6858597084374
ns/iter1501.3066449057028
ns/iter0.98
Evaluator_Draft4_Nested_Object
11.454680986890377
ns/iter12.09205275682082
ns/iter0.95
Evaluator_Draft4_Properties_Triad_Optional
1338.8863629462687
ns/iter1309.1830674469916
ns/iter1.02
Evaluator_Draft4_Properties_Triad_Closed
1045.516045766335
ns/iter1024.0597257346692
ns/iter1.02
Evaluator_Draft4_Properties_Triad_Required
1354.4871277598818
ns/iter1357.2495267278734
ns/iter1.00
Evaluator_Draft4_Properties_Closed
171.75995077898978
ns/iter172.84447143631616
ns/iter0.99
Evaluator_Draft4_Non_Recursive_Ref
44.035435291415304
ns/iter47.3755330993062
ns/iter0.93
Evaluator_Draft4_Pattern_Properties_True
2051.0804311750203
ns/iter1977.3750106161124
ns/iter1.04
Evaluator_Draft4_Ref_To_Single_Property
40.715344225918
ns/iter39.725934085974785
ns/iter1.02
Evaluator_Draft4_Additional_Properties_Type
68.40516750257399
ns/iter76.47396712204572
ns/iter0.89
Evaluator_Draft4_Nested_Oneof
183.68672921175892
ns/iter191.61618376326635
ns/iter0.96
Evaluator_Draft4_Long_Enum
34.39521940019013
ns/iter34.7875848922764
ns/iter0.99
Evaluator_Draft4_Type_Object
23.52585059030548
ns/iter24.13156642440499
ns/iter0.97
Evaluator_Draft6_Property_Names
615.3206741932518
ns/iter649.8082558529774
ns/iter0.95
Evaluator_Draft7_If_Then_Else
89.81998916901792
ns/iter89.44994357483324
ns/iter1.00
Evaluator_Draft7_Vercel_1
146234.76081730667
ns/iter141986.1800239179
ns/iter1.03
Evaluator_2019_09_Unevaluated_Properties
280.7449769248063
ns/iter279.5282933130534
ns/iter1.00
Evaluator_2019_09_OMC_JSON_V2_1
10460.225429949061
ns/iter10436.90279111681
ns/iter1.00
Evaluator_2020_12_Dynamic_Ref
1081.156225691408
ns/iter1131.8964518490318
ns/iter0.96
This comment was automatically generated by workflow using github-action-benchmark.
21b2224
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Benchmark (linux/gcc)
Evaluator_2020_12_Dynamic_Ref
1193.1475187200938
ns/iter1077.5724619727575
ns/iter1.11
Evaluator_2019_09_Unevaluated_Properties
332.39443631910194
ns/iter337.7914690348356
ns/iter0.98
Evaluator_2019_09_OMC_JSON_V2_1
12759.713958222466
ns/iter12824.18571905082
ns/iter0.99
Evaluator_Draft7_If_Then_Else
71.53247253234242
ns/iter79.80617312882747
ns/iter0.90
Evaluator_Draft7_Vercel_1
157972.8022363363
ns/iter149051.41849662238
ns/iter1.06
Evaluator_Draft6_Property_Names
1270.185939113111
ns/iter1256.1841736682943
ns/iter1.01
Evaluator_Draft4_Meta_1_No_Callback
544.0663528275943
ns/iter544.99518359693
ns/iter1.00
Evaluator_Draft4_Required_Properties
1847.482005178865
ns/iter1864.9251306247927
ns/iter0.99
Evaluator_Draft4_Many_Optional_Properties_Minimal_Match
52.45259748969614
ns/iter52.71227745717979
ns/iter1.00
Evaluator_Draft4_Few_Optional_Properties_Minimal_Match
42.62628027119503
ns/iter41.54889875985314
ns/iter1.03
Evaluator_Draft4_Items_Schema
1356.5130801091213
ns/iter1336.364236164436
ns/iter1.02
Evaluator_Draft4_Nested_Object
6.1519300824997645
ns/iter8.177937381646633
ns/iter0.75
Evaluator_Draft4_Properties_Triad_Optional
1394.2382564236716
ns/iter1361.7414123384053
ns/iter1.02
Evaluator_Draft4_Properties_Triad_Closed
1085.1143568928544
ns/iter1066.9785102862131
ns/iter1.02
Evaluator_Draft4_Properties_Triad_Required
1478.9673535447062
ns/iter1434.7913154158143
ns/iter1.03
Evaluator_Draft4_Properties_Closed
209.729451261147
ns/iter212.71472332369993
ns/iter0.99
Evaluator_Draft4_Non_Recursive_Ref
59.05557830685274
ns/iter59.011878098750415
ns/iter1.00
Evaluator_Draft4_Pattern_Properties_True
2184.536030459414
ns/iter2095.041575388007
ns/iter1.04
Evaluator_Draft4_Ref_To_Single_Property
46.9175860905861
ns/iter45.97740634419776
ns/iter1.02
Evaluator_Draft4_Additional_Properties_Type
113.55411429381843
ns/iter113.62693423086438
ns/iter1.00
Evaluator_Draft4_Nested_Oneof
159.5521726202027
ns/iter156.7140709518004
ns/iter1.02
Evaluator_Draft4_Long_Enum
26.121699584936447
ns/iter26.990644426976097
ns/iter0.97
Evaluator_Draft4_Type_Object
16.828014674298533
ns/iter18.68449182122194
ns/iter0.90
Compiler_2019_09_OMC_JSON_V2
11374399208
ns/iter11400943141.000084
ns/iter1.00
Compiler_Draft6_AdaptiveCard
65521135512.99999
ns/iter66186420902.00001
ns/iter0.99
This comment was automatically generated by workflow using github-action-benchmark.
21b2224
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Benchmark (macos/gcc)
Compiler_Draft6_AdaptiveCard
42783633232.1167
ns/iter45999326944.3512
ns/iter0.93
Compiler_2019_09_OMC_JSON_V2
7778801202.774048
ns/iter8437051057.815552
ns/iter0.92
Evaluator_Draft4_Meta_1_No_Callback
288.8627749941998
ns/iter310.39710450552474
ns/iter0.93
Evaluator_Draft4_Required_Properties
482.25268834178627
ns/iter529.1378941506025
ns/iter0.91
Evaluator_Draft4_Many_Optional_Properties_Minimal_Match
28.582711816967123
ns/iter32.575315646709804
ns/iter0.88
Evaluator_Draft4_Few_Optional_Properties_Minimal_Match
17.558398510419373
ns/iter19.420506930437327
ns/iter0.90
Evaluator_Draft4_Items_Schema
851.801819619314
ns/iter932.7842495410666
ns/iter0.91
Evaluator_Draft4_Nested_Object
4.175038538560154
ns/iter4.1703415731794795
ns/iter1.00
Evaluator_Draft4_Properties_Triad_Optional
1031.5714150750596
ns/iter1114.4984831819413
ns/iter0.93
Evaluator_Draft4_Properties_Triad_Closed
829.9953345765814
ns/iter891.3909887756215
ns/iter0.93
Evaluator_Draft4_Properties_Triad_Required
1040.7463490115645
ns/iter1105.2265452650315
ns/iter0.94
Evaluator_Draft4_Properties_Closed
113.08800131936533
ns/iter124.20954752349449
ns/iter0.91
Evaluator_Draft4_Non_Recursive_Ref
22.9558328174598
ns/iter25.530977471349644
ns/iter0.90
Evaluator_Draft4_Pattern_Properties_True
1613.99143391026
ns/iter1699.562062296388
ns/iter0.95
Evaluator_Draft4_Ref_To_Single_Property
16.961505737148357
ns/iter18.565421623550186
ns/iter0.91
Evaluator_Draft4_Additional_Properties_Type
38.774278949809556
ns/iter40.92814758197576
ns/iter0.95
Evaluator_Draft4_Nested_Oneof
101.88961112811432
ns/iter112.84177435943627
ns/iter0.90
Evaluator_Draft4_Long_Enum
15.70948712896602
ns/iter17.695104771587694
ns/iter0.89
Evaluator_Draft4_Type_Object
10.661000922757953
ns/iter12.404142579231737
ns/iter0.86
Evaluator_Draft6_Property_Names
403.6263133756744
ns/iter443.48401770068085
ns/iter0.91
Evaluator_Draft7_If_Then_Else
43.535559921703744
ns/iter50.136399269104004
ns/iter0.87
Evaluator_Draft7_Vercel_1
95296.8828464278
ns/iter103391.80970252064
ns/iter0.92
Evaluator_2019_09_Unevaluated_Properties
236.44210877334768
ns/iter253.68247344459735
ns/iter0.93
Evaluator_2019_09_OMC_JSON_V2_1
6205.393647892979
ns/iter6842.760967584698
ns/iter0.91
Evaluator_2020_12_Dynamic_Ref
777.0121371059288
ns/iter857.3820668328074
ns/iter0.91
This comment was automatically generated by workflow using github-action-benchmark.
21b2224
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Benchmark (windows/msvc)
Compiler_Draft6_AdaptiveCard
120560053599.99994
ns/iter120826007699.99998
ns/iter1.00
Compiler_2019_09_OMC_JSON_V2
25691453400
ns/iter25532280399.999992
ns/iter1.01
Evaluator_Draft4_Meta_1_No_Callback
869.1251923548069
ns/iter899.0429468558253
ns/iter0.97
Evaluator_Draft4_Required_Properties
1341.8369642855462
ns/iter1346.0219214189892
ns/iter1.00
Evaluator_Draft4_Many_Optional_Properties_Minimal_Match
138.4481790871152
ns/iter146.90506696426147
ns/iter0.94
Evaluator_Draft4_Few_Optional_Properties_Minimal_Match
92.8229288918248
ns/iter96.79843764290874
ns/iter0.96
Evaluator_Draft4_Items_Schema
2677.4912817945474
ns/iter2721.4215975792386
ns/iter0.98
Evaluator_Draft4_Nested_Object
55.46691071428102
ns/iter54.442383928566024
ns/iter1.02
Evaluator_Draft4_Properties_Triad_Optional
4835.92681779111
ns/iter4816.434166458041
ns/iter1.00
Evaluator_Draft4_Properties_Triad_Closed
3882.2310267860867
ns/iter3878.147321428723
ns/iter1.00
Evaluator_Draft4_Properties_Triad_Required
4827.4800022137615
ns/iter4783.09322151148
ns/iter1.01
Evaluator_Draft4_Properties_Closed
345.2700990588468
ns/iter360.85856744905055
ns/iter0.96
Evaluator_Draft4_Non_Recursive_Ref
152.17508928567926
ns/iter150.13650669034217
ns/iter1.01
Evaluator_Draft4_Pattern_Properties_True
7748.46540178485
ns/iter7767.006696427968
ns/iter1.00
Evaluator_Draft4_Ref_To_Single_Property
94.16924579601094
ns/iter101.06735937501553
ns/iter0.93
Evaluator_Draft4_Additional_Properties_Type
236.46204950199458
ns/iter235.2376411565392
ns/iter1.01
Evaluator_Draft4_Nested_Oneof
369.9740232189761
ns/iter379.6849679133975
ns/iter0.97
Evaluator_Draft4_Long_Enum
113.91134374999723
ns/iter122.84446428570358
ns/iter0.93
Evaluator_Draft4_Type_Object
77.16737723215365
ns/iter87.48571484438837
ns/iter0.88
Evaluator_Draft6_Property_Names
1124.7812500000366
ns/iter1157.56906250013
ns/iter0.97
Evaluator_Draft7_If_Then_Else
180.73871256594364
ns/iter187.57951674815314
ns/iter0.96
Evaluator_Draft7_Vercel_1
233703.54871110822
ns/iter244447.40542355165
ns/iter0.96
Evaluator_2019_09_Unevaluated_Properties
706.1924107143775
ns/iter710.754196428606
ns/iter0.99
Evaluator_2019_09_OMC_JSON_V2_1
15499.136160716125
ns/iter15533.627232139834
ns/iter1.00
Evaluator_2020_12_Dynamic_Ref
2197.7537499999753
ns/iter2205.183125000332
ns/iter1.00
This comment was automatically generated by workflow using github-action-benchmark.