CSI

This site provides experiments for the paper CSI: New Evidence – A Progress Report by Julian Nagele, Bertram Felgenhauer, and Aart Middeldorp.

Experiments for Confluence of TRSs (Table 1)

For experiments we considered the 291 TRSs in Cops. We compared the power of the current version of CSI (1.0) to its initial release (CSI 0.1) and to the version used in CoCo 2016 (0.6). The fourth column shows the results when using CSI's certifiable strategy, i.e., only criteria that can be checked by CETA, whose verdict is shown in the fifth column. Note that clicking a cell in the Results table below shows the corresponding tool output.

Statistics

 CSI-0.1CSI-0.6CSI-1.0✔CSI-1.0CeTA
#yes 115 179 206 116 177
total time 130.2 212.6 308.5 46.3 13.4
average time 1.1 1.2 1.5 0.4 0.1
#no 46 55 61 61 0
total time 12.5 33.9 112.9 69.7 0.0
average time 0.3 0.6 1.9 1.1 -
#maybe 111 15 14 31 0
total time 652.9 221.6 209.4 609.3 0.0
average time 5.9 14.8 15.0 19.7 -
#timeout 18 30 9 53 0
total time 1080.0 1800.0 540.0 3180.0 0.0
average time 60.0 60.0 60.0 60.0 -
#error 1 12 1 30 0
total time 0.6 394.3 34.7 968.5 0.0
average time 0.6 32.9 34.7 32.3 -
#total 291 291 291 291 177
total time 1876.2 2662.3 1205.5 4873.8 13.4

Results

 CSI-0.1CSI-0.6CSI-1.0✔CSI-1.0CeTA
10.30.50.80.30.0
20.20.40.760.0 
30.20.40.718.3 
40.20.50.80.20.0
50.10.30.40.20.0
60.10.30.40.20.0
70.10.30.40.20.0
80.20.71.10.30.0
90.10.40.40.20.0
100.10.40.40.20.0
110.20.50.60.20.0
120.10.30.40.20.0
130.10.30.40.20.0
140.10.50.60.20.0
1560.060.010.46.20.0
161.214.51.51.50.0
176.20.50.621.6 
180.20.40.50.20.0
190.20.50.50.30.0
200.90.81.00.30.0
210.10.50.70.30.0
221.30.70.80.30.0
230.10.40.50.20.0
246.160.020.512.30.1
256.12.12.560.0 
 CSI-0.1CSI-0.6CSI-1.0✔CSI-1.0CeTA
266.160.060.060.0 
271.215.515.818.4 
286.11.71.960.0 
290.10.30.50.30.0
301.70.61.00.30.0
310.10.30.40.20.0
320.10.40.40.20.0
331.20.60.70.30.0
341.20.30.50.30.0
350.10.40.70.20.0
361.20.40.60.20.3
371.20.60.80.30.0
380.20.50.60.30.0
390.10.50.60.20.0
400.10.40.50.30.0
410.10.40.60.20.0
420.40.80.90.40.0
430.10.40.40.20.0
440.10.30.40.20.0
450.10.50.60.20.0
460.10.40.50.20.0
476.160.014.210.10.0
482.40.70.80.30.0
490.10.80.81.50.0
500.20.60.60.30.0
 CSI-0.1CSI-0.6CSI-1.0✔CSI-1.0CeTA
510.30.40.50.30.0
522.014.714.814.8 
530.20.40.720.7 
541.314.514.812.1 
550.30.40.614.0 
561.214.614.812.7 
571.214.614.89.1 
581.914.714.914.8 
591.10.30.518.3 
603.75.75.90.80.3
616.10.51.00.30.0
626.10.60.860.0 
631.40.40.80.30.0
640.10.70.81.50.0
650.30.40.90.30.0
660.20.50.60.30.0
670.20.40.50.30.0
680.20.60.70.30.0
690.20.50.70.20.0
700.10.30.50.20.0
710.20.50.80.20.0
720.20.50.50.20.0
730.20.40.50.30.0
741.30.50.80.20.0
751.10.50.50.30.0
 CSI-0.1CSI-0.6CSI-1.0✔CSI-1.0CeTA
7660.060.00.660.0 
7760.060.03.360.0 
7860.060.011.87.50.0
796.10.40.460.0 
800.10.40.60.20.0
811.20.60.70.30.0
820.10.50.70.20.0
830.20.50.60.30.0
840.10.40.50.30.0
850.20.40.60.20.0
861.20.50.80.30.0
871.20.81.60.30.0
880.10.50.60.30.0
896.114.614.618.9 
900.20.50.60.20.0
915.01.61.818.2 
920.20.40.60.20.0
930.20.40.60.30.0
942.52.53.260.0 
950.10.30.50.30.0
961.20.40.90.30.0
970.20.40.718.3 
980.20.40.70.20.0
990.20.40.80.30.0
1001.32.32.80.30.0
 CSI-0.1CSI-0.6CSI-1.0✔CSI-1.0CeTA
1010.20.40.50.20.0
1021.32.32.80.40.0
1032.20.60.50.30.1
1040.10.40.70.20.0
1056.11.10.928.5 
1062.41.11.30.30.0
1071.20.30.418.3 
1085.20.30.618.3 
10960.060.05.960.0 
1106.160.060.060.0 
1111.30.50.80.30.0
1120.90.51.00.30.0
1130.10.60.70.30.0
1140.31.11.40.30.0
1150.91.82.10.40.0
1164.20.91.60.30.0
1176.11.41.618.2 
1181.81.61.918.2 
1191.20.40.618.2 
1206.130.71.344.4 
1211.30.91.20.30.1
1226.11.20.960.0 
1236.10.81.160.0 
1246.11.21.844.7 
1256.11.11.160.0 
 CSI-0.1CSI-0.6CSI-1.0✔CSI-1.0CeTA
1266.160.060.060.0 
1274.21.81.460.0 
1282.41.01.40.30.0
1296.11.61.637.8 
1302.21.01.40.40.0
1312.51.31.30.30.0
1322.81.11.060.0 
1336.21.11.060.0 
1341.91.62.012.6 
1350.10.61.20.30.0
1366.11.31.160.0 
1371.31.01.40.30.0
1386.10.90.90.40.0
1396.147.23.442.3 
1406.160.01.560.0 
1412.91.51.88.88.4
1426.160.01.360.0 
1436.160.00.660.0 
14424.221.20.860.0 
14560.060.02.160.0 
1462.41.21.50.30.0
1472.51.20.960.0 
1482.51.00.917.2 
1491.20.51.00.30.0
1500.10.61.00.30.0
 CSI-0.1CSI-0.6CSI-1.0✔CSI-1.0CeTA
1516.11.51.160.0 
1526.11.72.10.50.0
1532.81.10.820.1 
1544.060.05.037.4 
15560.060.01.160.0 
1566.11.31.360.0 
1576.11.21.126.5 
1580.10.71.10.30.0
1592.21.41.90.40.0
1606.225.531.060.0 
1616.10.91.027.2 
1626.137.81.429.3 
1631.20.60.90.20.0
1646.160.01.660.0 
1651.21.11.40.30.0
1662.41.01.30.30.0
1671.30.81.20.30.0
1686.11.41.60.50.0
1696.160.034.725.1 
1706.148.060.045.2 
17160.060.01.060.0 
1726.31.20.860.0 
1736.114.514.760.0 
1746.137.61.832.0 
17516.460.03.753.4 
 CSI-0.1CSI-0.6CSI-1.0✔CSI-1.0CeTA
1766.11.71.936.7 
1771.20.30.80.20.0
1781.20.60.70.30.0
1790.10.40.50.20.0
1802.51.21.60.30.0
1816.11.71.943.9 
1826.130.731.042.9 
1836.139.61.760.0 
1846.160.00.860.0 
1856.142.81.560.0 
1862.41.01.50.30.0
1876.140.11.637.5 
1886.11.31.128.7 
1896.11.72.041.1 
1901.21.01.30.30.0
1916.160.01.760.0 
1926.11.01.060.0 
1936.11.31.517.0 
1941.21.31.70.60.0
1956.160.01.660.0 
19660.014.01.760.0 
1972.91.20.918.3 
1986.11.11.160.0 
1992.41.10.926.1 
2002.50.91.40.30.0
 CSI-0.1CSI-0.6CSI-1.0✔CSI-1.0CeTA
2012.71.00.82.92.3
2026.11.31.260.0 
20360.018.56.860.0 
2046.11.51.842.7 
2050.20.61.20.20.0
2066.160.01.321.8 
2072.31.11.20.30.0
2080.660.07.231.5 
2096.21.21.128.7 
2106.11.41.227.9 
2112.20.60.60.30.1
2122.20.60.80.30.0
2132.20.40.60.30.0
2142.80.51.10.50.0
2152.90.81.160.0 
2166.110.610.66.30.2
2176.11.61.860.0 
2183.00.40.651.2 
2192.30.40.518.2 
2200.10.30.50.20.0
2212.70.50.551.1 
2226.20.40.618.2 
2231.20.50.70.30.0
2241.20.50.60.20.0
2250.10.40.40.20.0
 CSI-0.1CSI-0.6CSI-1.0✔CSI-1.0CeTA
2260.20.30.40.20.0
2276.114.714.718.2 
2286.20.50.618.2 
2290.20.50.918.3 
2306.215.716.160.0 
2316.214.514.818.3 
2321.80.40.70.20.0
2336.10.40.70.30.0
2342.414.514.520.6 
2356.20.50.50.30.0
2360.10.40.40.20.0
2370.10.40.60.30.0
2380.10.50.60.20.0
2390.20.40.60.20.0
2400.10.40.60.30.0
2410.10.40.50.30.0
2420.20.50.60.30.0
2430.30.40.60.30.0
2440.10.40.60.20.0
24560.00.40.60.20.0
2463.70.40.60.20.0
24760.00.40.50.30.0
2480.20.50.50.20.0
24960.00.60.70.30.0
2506.114.614.618.5 
 CSI-0.1CSI-0.6CSI-1.0✔CSI-1.0CeTA
25160.00.80.90.40.0
25260.00.40.50.20.0
25360.00.50.60.30.0
2540.10.40.50.20.0
2551.90.40.60.20.0
25660.060.060.060.0 
25760.060.060.060.0 
2580.80.40.60.20.0
2592.21.62.160.0 
2602.41.82.260.0 
2610.10.50.50.30.0
3920.10.30.40.20.0
4126.20.71.10.60.0
4136.10.60.60.40.0
4146.160.060.060.0 
4156.221.860.060.0 
4166.20.40.60.30.0
4176.160.060.060.0 
4186.20.50.80.30.0
4196.20.41.20.30.0
4206.10.50.40.30.0
4216.10.40.70.30.0
4226.10.50.80.30.0
42354.20.40.61.10.0
4241.80.40.50.20.0
 CSI-0.1CSI-0.6CSI-1.0✔CSI-1.0CeTA
4251.90.40.50.30.0
4422.32.71.80.30.0
4961.215.515.618.8 
4976.160.014.210.10.0
4982.21.82.218.2 
5021.20.50.70.30.0
5030.10.30.60.30.0
5040.10.50.70.30.0
5050.10.30.40.20.0
5060.20.50.70.30.0
5070.10.40.50.20.0
5080.30.40.50.30.0
5090.10.30.50.20.0
5100.10.40.50.20.0
5110.20.50.50.20.0
5120.20.50.40.20.0