cim-bench
c#c++cligojavaparserpowerflow-toolpythonqueryrustserializersparqltriplestoretyped-modelvalidator
Realgrid (86.5 MB)
| Tool | Tags | Version | Load time | Export time | Memory (MB) | Lines | Generators | Loads | Substations |
|---|---|---|---|---|---|---|---|---|---|
| triplets | parser serializer query python | 0.1.0 | 159.1 ms | 946.1 ms | 370.5 | 7,561 | 1,347 | 6,687 | 4,875 |
| OpenCGMES | parser serializer query sparql triplestore java | 1.1.0-SNAPSHOT | 1.10 s | 4.00 s | 3055.9 | 7,561 | 1,347 | 6,687 | 4,875 |
| cimoxide | parser validator typed-model python rust | 0.0.4 | 1.26 s | – | 537.4 | 7,561 | 1,347 | 6,687 | 4,875 |
| Apache Jena | parser serializer query sparql triplestore java | 6.0.0 | 1.58 s | 4.29 s | 2586.6 | 7,561 | 1,347 | 6,687 | 4,875 |
| PowSyBL CGMES | parser serializer query sparql triplestore java | 7.1.1 | 1.77 s | 2.17 s | 2721.5 | 7,561 | 1,347 | 6,687 | 4,875 |
| maplib | parser serializer query sparql triplestore python rust | 0.20.19 | 2.01 s | 15.26 s | 454.8 | 7,561 | 1,347 | 6,687 | 4,875 |
| PyPowSyBl | parser serializer query powerflow-tool python java | 1.15.0 | 4.24 s | 1.55 s | 2089.0 | 7,561 | 1,347 | 6,687 | 4,791 |
| GraphDB | parser serializer query sparql triplestore java | 10.8.14 | 5.60 s | 1.95 s | 2457.4 | 7,561 | 1,347 | 6,687 | 4,875 |
| VeraGrid | parser serializer query powerflow-tool python | 6.3.0 | 10.80 s | 16.73 s | 304.7 | 7,561 | 1,347 | 6,687 | 4,875 |
| GMSS CIM | parser query sparql c# | 10.1.1.0 | 11.83 s | – | 2646.2 | 0 | 0 | 0 | 0 |
| libcimpp | parser query typed-model c++ | 2.2.0 | 19.53 s | – | 133.8 | 7,561 | 1,347 | 6,687 | 4,875 |
| RDFlib | parser serializer query sparql triplestore python | 7.6.0 | 23.27 s | 18.61 s | 1078.4 | 7,561 | 2,694 | 13,374 | 4,875 |
Query performance
| Tool | generators | lines | loads | substations |
|---|---|---|---|---|
| Apache Jena | 519.2 μs | 203.5 ms | 4.9 ms | 864.4 μs |
| GraphDB | 409.6 μs | 252.1 ms | 1.2 ms | 718.6 μs |
| OpenCGMES | 521.7 μs | 144.9 ms | 2.5 ms | 744.9 μs |
| PowSyBL CGMES | 288.3 μs | 347.4 ms | 983.1 μs | 330.9 μs |
| PyPowSyBl | 2.2 ms | 33.2 ms | 16.1 ms | 3.5 ms |
| RDFlib | 443.7 μs | 446.88 s | 2.1 ms | 750.0 μs |
| VeraGrid | 0.1 μs | 0.1 μs | 0.1 μs | 0.1 μs |
| cimoxide | 9.3 ms | 12.9 ms | 26.3 ms | 7.4 ms |
| libcimpp | 5.4 ms | 5.4 ms | 12.8 ms | 5.4 ms |
| maplib | 459.0 μs | 44.6 ms | 1.1 ms | 485.3 μs |
| triplets | 7.4 ms | 12.6 ms | 11.2 ms | 6.4 ms |
Load time - Realgrid (86.5 MB)
triplets
159.1 ms
OpenCGMES
1.10 s
cimoxide
1.26 s
Apache Jena
1.58 s
PowSyBL CGMES
1.77 s
maplib
2.01 s
PyPowSyBl
4.24 s
GraphDB
5.60 s
VeraGrid
10.80 s
GMSS CIM
11.83 s
libcimpp
19.53 s
RDFlib
23.27 s
Export time - Realgrid (86.5 MB)
triplets
946.1 ms
PyPowSyBl
1.55 s
GraphDB
1.95 s
PowSyBL CGMES
2.17 s
OpenCGMES
4.00 s
Apache Jena
4.29 s
maplib
15.26 s
VeraGrid
16.73 s
RDFlib
18.61 s
Memory - Realgrid (86.5 MB)
libcimpp
134 MB
VeraGrid
305 MB
triplets
370 MB
maplib
455 MB
cimoxide
537 MB
RDFlib
1,078 MB
PyPowSyBl
2,089 MB
GraphDB
2,457 MB
Apache Jena
2,587 MB
GMSS CIM
2,646 MB
PowSyBL CGMES
2,722 MB
OpenCGMES
3,056 MB
Average query time - Realgrid (86.5 MB) (log scale)
VeraGrid
0.1 μs
libcimpp
7.2 ms
triplets
9.4 ms
maplib
11.7 ms
PyPowSyBl
13.8 ms
cimoxide
14.0 ms
OpenCGMES
37.2 ms
Apache Jena
52.4 ms
GraphDB
63.6 ms
PowSyBL CGMES
87.2 ms
RDFlib
111.72 s
Svedala (7.3 MB)
| Tool | Tags | Version | Load time | Export time | Memory (MB) | Lines | Generators | Loads | Substations |
|---|---|---|---|---|---|---|---|---|---|
| triplets | parser serializer query python | 0.1.0 | 10.1 ms | 147.8 ms | 82.9 | 97 | 39 | 73 | 57 |
| OpenCGMES | parser serializer query sparql triplestore java | 1.1.0-SNAPSHOT | 88.4 ms | 357.3 ms | 293.5 | 97 | 39 | 73 | 56 |
| cimoxide | parser validator typed-model python rust | 0.0.4 | 103.8 ms | – | 60.6 | 97 | 39 | 73 | 57 |
| Apache Jena | parser serializer query sparql triplestore java | 6.0.0 | 120.1 ms | 403.1 ms | 402.0 | 97 | 39 | 73 | 56 |
| maplib | parser serializer query sparql triplestore python rust | 0.20.19 | 218.0 ms | 1.28 s | 140.6 | 97 | 39 | 73 | 57 |
| PowSyBL CGMES | parser serializer query sparql triplestore java | 7.1.1 | 252.8 ms | 168.5 ms | 467.6 | 97 | 39 | 73 | 57 |
| PyPowSyBl | parser serializer query powerflow-tool python java | 1.15.0 | 428.4 ms | 138.0 ms | 1566.6 | 97 | 39 | 73 | 57 |
| VeraGrid | parser serializer query powerflow-tool python | 6.3.0 | 701.7 ms | 1.54 s | 71.8 | 97 | 39 | 73 | 56 |
| GraphDB | parser serializer query sparql triplestore java | 10.8.14 | 712.3 ms | 191.8 ms | 1344.3 | 97 | 39 | 73 | 57 |
| GMSS CIM | parser query sparql c# | 10.1.1.0 | 1.01 s | – | 312.9 | 97 | 78 | 146 | 57 |
| RDFlib | parser serializer query sparql triplestore python | 7.6.0 | 2.00 s | 1.95 s | 207.5 | 97 | 78 | 146 | 57 |
Query performance
| Tool | generators | lines | loads | substations |
|---|---|---|---|---|
| Apache Jena | 165.9 μs | 4.1 ms | 295.9 μs | 64.3 μs |
| GMSS CIM | 120.6 μs | 2.92 s | 284.7 μs | 92.1 μs |
| GraphDB | 137.9 μs | 5.9 ms | 288.6 μs | 82.4 μs |
| OpenCGMES | 160.7 μs | 4.7 ms | 251.6 μs | 81.7 μs |
| PowSyBL CGMES | 110.1 μs | 8.3 ms | 161.8 μs | 74.5 μs |
| PyPowSyBl | 265.9 μs | 292.9 μs | 194.2 μs | 120.9 μs |
| RDFlib | 68.8 μs | 805.7 ms | 199.8 μs | 66.3 μs |
| VeraGrid | 0.1 μs | 0.0 μs | 0.1 μs | 0.1 μs |
| cimoxide | 292.4 μs | 259.0 μs | 878.1 μs | 286.6 μs |
| maplib | 331.3 μs | 14.6 ms | 869.9 μs | 355.0 μs |
| triplets | 1.5 ms | 1.7 ms | 1.7 ms | 1.0 ms |
Load time - Svedala (7.3 MB)
triplets
10.1 ms
OpenCGMES
88.4 ms
cimoxide
103.8 ms
Apache Jena
120.1 ms
maplib
218.0 ms
PowSyBL CGMES
252.8 ms
PyPowSyBl
428.4 ms
VeraGrid
701.7 ms
GraphDB
712.3 ms
GMSS CIM
1.01 s
RDFlib
2.00 s
Export time - Svedala (7.3 MB)
PyPowSyBl
138.0 ms
triplets
147.8 ms
PowSyBL CGMES
168.5 ms
GraphDB
191.8 ms
OpenCGMES
357.3 ms
Apache Jena
403.1 ms
maplib
1.28 s
VeraGrid
1.54 s
RDFlib
1.95 s
Memory - Svedala (7.3 MB)
cimoxide
61 MB
VeraGrid
72 MB
triplets
83 MB
maplib
141 MB
RDFlib
208 MB
OpenCGMES
294 MB
GMSS CIM
313 MB
Apache Jena
402 MB
PowSyBL CGMES
468 MB
GraphDB
1,344 MB
PyPowSyBl
1,567 MB
Average query time - Svedala (7.3 MB) (log scale)
VeraGrid
0.1 μs
PyPowSyBl
218.5 μs
cimoxide
429.0 μs
Apache Jena
1.2 ms
OpenCGMES
1.3 ms
triplets
1.5 ms
GraphDB
1.6 ms
PowSyBL CGMES
2.2 ms
maplib
4.0 ms
RDFlib
201.5 ms
GMSS CIM
731.2 ms
CLI tools
Benchmarked as subprocesses (full process lifecycle per run) - not comparable with the in-process library numbers above.
| Tool | Tags | Version | Dataset | Operation | Time | Peak RSS (MB) |
|---|---|---|---|---|---|---|
| cimgo | cli validator serializer go | ? | realgrid | convert | 3.69 s | 621.7 |
| cimgo | cli validator serializer go | ? | realgrid | validate | 4.34 s | 717.1 |
| pocket-rdf | cli serializer query sparql python | ? | realgrid | query | 26.06 s | 1241.1 |
| pocket-rdf | cli serializer query sparql python | ? | realgrid | serialize | 28.47 s | 1250.0 |
| cimgo | cli validator serializer go | ? | svedala | convert | 379.6 ms | 76.8 |
| cimgo | cli validator serializer go | ? | svedala | validate | 279.9 ms | 43.9 |
| pocket-rdf | cli serializer query sparql python | ? | svedala | query | 2.21 s | 142.4 |
| pocket-rdf | cli serializer query sparql python | ? | svedala | serialize | 2.31 s | 142.0 |
CLI time - Realgrid (86.5 MB)
cimgo (convert)
3.69 s
cimgo (validate)
4.34 s
pocket-rdf (query)
26.06 s
pocket-rdf (serialize)
28.47 s
CLI peak RSS - Realgrid (86.5 MB)
cimgo (convert)
622 MB
cimgo (validate)
717 MB
pocket-rdf (query)
1,241 MB
pocket-rdf (serialize)
1,250 MB
CLI time - Svedala (7.3 MB)
cimgo (validate)
279.9 ms
cimgo (convert)
379.6 ms
pocket-rdf (query)
2.21 s
pocket-rdf (serialize)
2.31 s
CLI peak RSS - Svedala (7.3 MB)
cimgo (validate)
44 MB
cimgo (convert)
77 MB
pocket-rdf (serialize)
142 MB
pocket-rdf (query)
142 MB