Benchmarks SP2
The SP2 benchmark comprises a data-generator for arbitrarily large documents, which builds upon the well-known DBLP scenario, and thus comes close to a real-world application scenario. The benchmark’s queries make meaningful requests against this data while also testing typical SPARQL operator constellations and RDF access patterns. With this focus, the benchmark can help tune existing SPARQL engines and detect deficiencies in them.
AllegroGraph’s SPARQL, one of the W3C’s “interoperable implementations”, includes a query optimizer, and has full support for named graphs. It can be used with the RDFS++ reasoning (i.e., query over real and inferred triples). SPARQL can be used with all the available AllegroGraph interfaces (Java, Python, Ruby, Perl, C#, Clojure, Lisp, etc).
SP2 – 25 Million Dataset Results (Query Time in seconds)
<!--
|
Query #
|
# Results
|
Query Time #1
|
Query Time #2
|
Query Time #3
|
|---|---|---|---|---|
|
1
|
1
|
0.066
|
0.004
|
0.001
|
|
2
|
1,876,999
|
25.592
|
24.483
|
24.387
|
|
3a
|
594,890
|
1.955
|
1.962
|
1.954
|
|
3b
|
4,075
|
0.284
|
0.280
|
0.279
|
|
3c
|
0
|
0.316
|
0.304
|
0.305
|
|
4
|
113,634,340
|
982.168
|
1,016.813
|
914.367
|
|
5a
|
696,681
|
42.366
|
31.138
|
30.979
|
|
5b
|
696,681
|
19.642
|
19.525
|
19.535
|
|
6
|
1,945,167
|
45.790
|
46.425
|
46.443
|
|
7
|
5,099
|
17.211
|
15.900
|
15.923
|
|
8
|
493
|
0.323
|
0.204
|
0.206
|
|
9
|
4
|
45.284
|
38.185
|
38.273
|
|
10
|
656
|
0.003
|
0.001
|
0.001
|
|
11
|
10
|
26.430
|
9.967
|
9.959
|
|
12a
|
Yes
|
0.122
|
0.097
|
0.097
|
|
12b
|
Yes
|
0.019
|
0.018
|
0.018
|
|
12c
|
No
|
0.001
|
0.001
|
0.001
|
SP2 – 1 Million Dataset Results (Query Time in seconds)
<!--
|
Query #
|
# Results
|
Query Time #1
|
Query Time #2
|
Query Time #3
|
Competitor
|
|---|---|---|---|---|---|
|
1
|
1
|
0.003
|
0.002
|
0.002
|
0.020
|
|
2
|
32,770
|
0.825
|
0.831
|
0.794
|
20.217
|
|
3a
|
52,676
|
0.197
|
0.195
|
0.185
|
4.371
|
|
3b
|
379
|
0.052
|
0.051
|
0.051
|
0.237
|
|
3c
|
0
|
0.040
|
0.038
|
0.039
|
0.171
|
|
4
|
2,586,733
|
26.406
|
22.616
|
22.876
|
NA
|
|
5a
|
35,241
|
1.305
|
1.304
|
1.354
|
NA
|
|
5b
|
35,241
|
0.931
|
0.937
|
0.961
|
7.737
|
|
6
|
62,795
|
1.445
|
1.440
|
1.509
|
18.237
|
|
7
|
292
|
0.943
|
0.784
|
0.823
|
NA
|
|
8
|
400
|
6.470
|
0.467
|
0.453
|
1.851
|
|
9
|
4
|
1.426
|
1.429
|
1.438
|
2.579
|
|
10
|
572
|
0.002
|
0.002
|
0.002
|
0.152
|
|
11
|
10
|
1.469
|
1.466
|
1.352
|
0.460
|
|
12a
|
Yes
|
1.208
|
1.204
|
1.183
|
NA
|
|
12b
|
Yes
|
0.464
|
0.465
|
0.458
|
NA
|
|
12c
|
No
|
0.006
|
0.005
|
0.005
|
NA
|
SP2 – 5 Million Dataset Results (Query Time in seconds)
<!--
|
Query #
|
# Results
|
Query Time #1
|
Query Time #2
|
Query Time #3
|
Competitor
|
|---|---|---|---|---|---|
|
1
|
1
|
0.002
|
0.002
|
0.005
|
0.018
|
|
2
|
248,738
|
5.189
|
5.233
|
5.090
|
152.622
|
|
3a
|
192,373
|
0.878
|
0.879
|
0.823
|
20.513
|
|
3b
|
1,317
|
0.082
|
0.082
|
0.084
|
0.727
|
|
3c
|
0
|
0.153
|
0.152
|
0.151
|
0.608
|
|
4
|
18,362,955
|
172.973
|
169.715
|
217.747
|
NA
|
|
5a
|
210,662
|
7.591
|
13.962
|
14.610
|
NA
|
|
5b
|
210,662
|
4.111
|
4.124
|
4.120
|
50.440
|
|
6
|
417,625
|
9.077
|
9.348
|
8.780
|
122.003
|
|
7
|
1,200
|
33.416
|
32.898
|
33.019
|
NA
|
|
8
|
493
|
1.316
|
1.069
|
1.279
|
10.446
|
|
9
|
4
|
7.955
|
7.968
|
7.697
|
14.080
|
|
10
|
656
|
0.003
|
0.002
|
0.001
|
0.525
|
|
11
|
10
|
8.483
|
8.485
|
8.462
|
2.133
|
|
12a
|
Yes
|
7.432
|
7.452
|
7.644
|
NA
|
|
12b
|
Yes
|
6.303
|
1.352
|
1.254
|
NA
|
|
12c
|
No
|
0.007
|
0.005
|
0.005
|
NA
|
The platform for the test was 2 – 4 core Intel E5520 Processors at 2.26 GHz, with 48 GB RAM, running Fedora 14.