ConCon Certification

ConCon 1.4.0 and ConCon 1.3.2 Comparison

Benchmarks

cops.uibk.ac.at

Tool Configurations

ConCon 1.4.0
A concon -s --conf A --no-inlining theBenchmark.trs 58
✔A concon -s --cert --conf A --no-inlining theBenchmark.trs 58
A+i concon -s --conf A theBenchmark.trs 58
✔A+i concon -s --cert --conf A theBenchmark.trs 58
T concon -s --no-inlining theBenchmark.trs 58
✔T concon -s --cert --no-inlining theBenchmark.trs 58
T+i concon -s theBenchmark.trs 58
✔T+i concon -s --cert theBenchmark.trs 58
ConCon 1.3.2
A concon -s --conf A theBenchmark.trs 58
T concon -s theBenchmark.trs 58
✔T concon -s --cert theBenchmark.trs 58

Summary

  ConCon 1.4.0 ConCon 1.3.2
status A ✔A A+i ✔A+i T ✔T T+i ✔T+i A T ✔T
YES 46 43 47 44 57 50 57 50 42 56 38
NO 0 0 0 0 27 27 29 29 0 26 0
MAYBE 73 76 72 75 35 42 33 40 77 37 81
total 119 119 119 119 119 119 119 119 119 119 119

Individual Results

  ConCon 1.4.0 ConCon 1.3.2
problem A ✔A A+i ✔A+i T ✔T T+i ✔T+i A T ✔T
262.trs MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE
263.trs MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE
264.trs YES YES YES YES YES YES YES YES YES YES MAYBE
266.trs MAYBE MAYBE MAYBE MAYBE YES YES YES YES MAYBE YES YES
267.trs YES YES YES YES YES YES YES YES YES YES YES
268.trs MAYBE MAYBE MAYBE MAYBE YES YES YES YES MAYBE YES YES
271.trs MAYBE MAYBE MAYBE MAYBE NO NO NO NO MAYBE MAYBE MAYBE
272.trs YES YES YES YES YES YES YES YES YES YES YES
278.trs MAYBE MAYBE MAYBE MAYBE YES YES YES YES MAYBE YES YES
279.trs MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE
284.trs MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE
285.trs MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE
286.trs MAYBE MAYBE MAYBE MAYBE YES MAYBE YES MAYBE MAYBE YES MAYBE
287.trs YES YES YES YES YES YES YES YES MAYBE YES YES
288.trs YES YES YES YES YES YES YES YES MAYBE MAYBE YES
289.trs MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE
292.trs YES YES YES YES YES YES YES YES YES YES MAYBE
293.trs MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE
294.trs YES YES YES YES YES YES YES YES YES YES YES
307.trs YES YES YES YES YES YES YES YES YES YES YES
308.trs YES YES YES YES YES YES YES YES YES YES YES
310.trs MAYBE MAYBE MAYBE MAYBE NO NO NO NO MAYBE NO MAYBE
311.trs MAYBE MAYBE MAYBE MAYBE NO NO NO NO MAYBE NO MAYBE
312.trs MAYBE MAYBE MAYBE MAYBE NO NO NO NO MAYBE NO MAYBE
313.trs MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE
315.trs MAYBE MAYBE MAYBE MAYBE NO NO NO NO MAYBE NO MAYBE
316.trs YES YES YES YES YES YES YES YES YES YES MAYBE
317.trs MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE
319.trs YES YES YES YES YES YES YES YES YES YES MAYBE
321.trs MAYBE MAYBE MAYBE MAYBE NO NO NO NO MAYBE NO MAYBE
322.trs YES YES YES YES YES YES YES YES YES YES YES
323.trs MAYBE MAYBE MAYBE MAYBE NO NO NO NO MAYBE NO MAYBE
324.trs MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE
325.trs MAYBE MAYBE MAYBE MAYBE NO NO NO NO MAYBE NO MAYBE
326.trs YES YES YES YES YES YES YES YES YES YES YES
327.trs MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE
328.trs MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE
329.trs YES YES YES YES YES YES YES YES YES YES YES
330.trs MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE
332.trs YES YES YES YES YES YES YES YES YES YES YES
333.trs YES YES YES YES YES YES YES YES YES YES YES
334.trs YES YES YES YES YES YES YES YES YES YES YES
335.trs YES YES YES YES YES YES YES YES YES YES YES
336.trs YES YES YES YES YES YES YES YES MAYBE YES YES
337.trs MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE
339.trs YES YES YES YES YES YES YES YES YES YES MAYBE
340.trs YES MAYBE YES MAYBE YES MAYBE YES MAYBE YES YES MAYBE
341.trs YES YES YES YES YES YES YES YES YES YES YES
342.trs MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE
343.trs YES YES YES YES YES YES YES YES YES YES YES
344.trs YES YES YES YES YES YES YES YES YES YES YES
345.trs MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE
346.trs MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE
347.trs MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE
348.trs MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE
349.trs MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE
350.trs MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE
351.trs MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE NO NO MAYBE MAYBE MAYBE
352.trs MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE
353.trs MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE NO NO MAYBE MAYBE MAYBE
354.trs YES YES YES YES YES YES YES YES YES YES YES
355.trs MAYBE MAYBE MAYBE MAYBE YES YES YES YES MAYBE YES YES
356.trs YES YES YES YES YES YES YES YES YES YES YES
357.trs MAYBE MAYBE MAYBE MAYBE NO NO NO NO MAYBE NO MAYBE
358.trs MAYBE MAYBE MAYBE MAYBE NO NO NO NO MAYBE NO MAYBE
359.trs YES YES YES YES YES YES YES YES YES YES YES
360.trs MAYBE MAYBE MAYBE MAYBE NO NO NO NO MAYBE NO MAYBE
361.trs MAYBE MAYBE MAYBE MAYBE YES MAYBE YES MAYBE MAYBE YES MAYBE
362.trs YES YES YES YES YES YES YES YES YES YES MAYBE
363.trs MAYBE MAYBE MAYBE MAYBE NO NO NO NO MAYBE NO MAYBE
364.trs YES YES YES YES YES YES YES YES YES YES YES
365.trs MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE
366.trs MAYBE MAYBE MAYBE MAYBE NO NO NO NO MAYBE NO MAYBE
367.trs MAYBE MAYBE MAYBE MAYBE NO NO NO NO MAYBE NO MAYBE
368.trs MAYBE MAYBE MAYBE MAYBE NO NO NO NO MAYBE NO MAYBE
369.trs MAYBE MAYBE MAYBE MAYBE NO NO NO NO MAYBE NO MAYBE
370.trs YES YES YES YES YES YES YES YES YES YES MAYBE
371.trs YES YES YES YES YES YES YES YES YES YES MAYBE
372.trs MAYBE MAYBE MAYBE MAYBE NO NO NO NO MAYBE NO MAYBE
373.trs MAYBE MAYBE MAYBE MAYBE NO NO NO NO MAYBE NO MAYBE
374.trs MAYBE MAYBE MAYBE MAYBE NO NO NO NO MAYBE NO MAYBE
375.trs YES YES YES YES YES YES YES YES YES YES MAYBE
376.trs YES YES YES YES YES YES YES YES YES YES YES
377.trs MAYBE MAYBE MAYBE MAYBE NO NO NO NO MAYBE NO MAYBE
378.trs MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE
379.trs MAYBE MAYBE MAYBE MAYBE NO NO NO NO MAYBE NO MAYBE
380.trs YES YES YES YES YES YES YES YES YES YES YES
381.trs MAYBE MAYBE MAYBE MAYBE NO NO NO NO MAYBE NO MAYBE
382.trs MAYBE MAYBE MAYBE MAYBE NO NO NO NO MAYBE NO MAYBE
383.trs MAYBE MAYBE MAYBE MAYBE NO NO NO NO MAYBE NO MAYBE
384.trs MAYBE MAYBE MAYBE MAYBE NO NO NO NO MAYBE NO MAYBE
385.trs MAYBE MAYBE MAYBE MAYBE NO NO NO NO MAYBE NO MAYBE
386.trs YES YES YES YES YES YES YES YES MAYBE YES YES
387.trs MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE
388.trs YES YES YES YES YES YES YES YES YES YES YES
389.trs MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE
390.trs YES YES YES YES YES YES YES YES YES YES YES
391.trs MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE
403.trs YES YES YES YES YES YES YES YES YES YES YES
404.trs MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE
405.trs MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE
406.trs YES MAYBE YES MAYBE YES MAYBE YES MAYBE YES YES MAYBE
407.trs MAYBE MAYBE MAYBE MAYBE YES MAYBE YES MAYBE MAYBE YES MAYBE
408.trs YES YES YES YES YES YES YES YES YES YES MAYBE
409.trs MAYBE MAYBE MAYBE MAYBE YES MAYBE YES MAYBE MAYBE YES MAYBE
410.trs MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE
411.trs MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE
439.trs YES YES YES YES YES YES YES YES YES YES YES
440.trs YES MAYBE YES MAYBE YES MAYBE YES MAYBE YES YES MAYBE
441.trs MAYBE MAYBE MAYBE MAYBE NO NO NO NO MAYBE NO MAYBE
488.trs YES YES YES YES YES YES YES YES YES YES YES
489.trs MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE
490.trs YES YES YES YES YES YES YES YES YES YES YES
491.trs YES YES YES YES YES YES YES YES YES YES MAYBE
492.trs YES YES YES YES YES YES YES YES YES YES MAYBE
493.trs MAYBE MAYBE YES YES YES YES YES YES MAYBE YES YES
494.trs MAYBE MAYBE MAYBE MAYBE YES YES YES YES MAYBE YES YES
495.trs MAYBE MAYBE MAYBE MAYBE YES YES YES YES MAYBE YES YES
499.trs MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE MAYBE