Performance comparison

Test program

This document serves as the base. Under JSON Pointer #/schemas, it contains 8 schemas.

The program validates these 8 schemas 500 times in a loop. It prints the time elapsed for initialization and then each 20 iterations.

Version 0.2.1

Iteration 0 (in 1263 ms)
Iteration 20 (in 9902 ms)
Iteration 40 (in 17344 ms)
Iteration 60 (in 24841 ms)
Iteration 80 (in 32239 ms)
Iteration 100 (in 39720 ms)
Iteration 120 (in 47126 ms)
Iteration 140 (in 54578 ms)
Iteration 160 (in 62001 ms)
Iteration 180 (in 69407 ms)
Iteration 200 (in 76832 ms)
Iteration 220 (in 84290 ms)
Iteration 240 (in 91734 ms)
Iteration 260 (in 99174 ms)
Iteration 280 (in 106610 ms)
Iteration 300 (in 114067 ms)
Iteration 320 (in 121461 ms)
Iteration 340 (in 128910 ms)
Iteration 360 (in 136349 ms)
Iteration 380 (in 143792 ms)
Iteration 400 (in 151243 ms)
Iteration 420 (in 158665 ms)
Iteration 440 (in 166147 ms)
Iteration 460 (in 173604 ms)
Iteration 480 (in 181047 ms)
END -- time in ms: 188128

Version 0.3

Iteration 0 (in 196 ms)
Iteration 20 (in 794 ms)
Iteration 40 (in 1243 ms)
Iteration 60 (in 1709 ms)
Iteration 80 (in 1967 ms)
Iteration 100 (in 2320 ms)
Iteration 120 (in 2710 ms)
Iteration 140 (in 2966 ms)
Iteration 160 (in 3218 ms)
Iteration 180 (in 3483 ms)
Iteration 200 (in 3734 ms)
Iteration 220 (in 3985 ms)
Iteration 240 (in 4236 ms)
Iteration 260 (in 4483 ms)
Iteration 280 (in 4730 ms)
Iteration 300 (in 4979 ms)
Iteration 320 (in 5226 ms)
Iteration 340 (in 5476 ms)
Iteration 360 (in 5727 ms)
Iteration 380 (in 5978 ms)
Iteration 400 (in 6225 ms)
Iteration 420 (in 6474 ms)
Iteration 440 (in 6716 ms)
Iteration 460 (in 6961 ms)
Iteration 480 (in 7206 ms)
END -- time in ms: 7438

Yes, that's right: a more than 25 times improvement!

Version 0.5.x

Iteration 0 (in 225 ms)
Iteration 20 (in 572 ms)
Iteration 40 (in 806 ms)
Iteration 60 (in 1088 ms)
Iteration 80 (in 1167 ms)
Iteration 100 (in 1241 ms)
Iteration 120 (in 1341 ms)
Iteration 140 (in 1415 ms)
Iteration 160 (in 1490 ms)
Iteration 180 (in 1572 ms)
Iteration 200 (in 1721 ms)
Iteration 220 (in 1796 ms)
Iteration 240 (in 1870 ms)
Iteration 260 (in 1943 ms)
Iteration 280 (in 2015 ms)
Iteration 300 (in 2093 ms)
Iteration 320 (in 2256 ms)
Iteration 340 (in 2347 ms)
Iteration 360 (in 2418 ms)
Iteration 380 (in 2492 ms)
Iteration 400 (in 2564 ms)
Iteration 420 (in 2637 ms)
Iteration 440 (in 2710 ms)
Iteration 460 (in 2782 ms)
Iteration 480 (in 2854 ms)
END -- time in ms: 2924

Yup, more than twice faster than 0.3.x or 0.4.x.