Differences

This shows you the differences between two versions of the page.

Link to this comparison view

vv-lab:accountsubtype [2015/02/18 22:52] (current)
egm created
Line 1: Line 1:
 +[[Concurrency Tool Comparison]]
  
 +== Model Description ==
 +
 +The model manifests a data race when a set of thread reads from a shared variable while another thread is writing to the same object. ​
 +
 +Classes: 6
 +
 +SLOC: 91
 +
 +Parameters: (#​PersonalAccounts,​ #​BusinessAccounts)
 +
 +== Summary Results Table ==
 +
 +{| align=center | border=1
 +|- bgcolor="​white"​ |
 +| colspan=5 align="​center"​ | #​accountsubtype (20,1)
 +|- bgcolor="​lightblue"​
 +! Tool
 +! Trials (successful)
 +! Time
 +! Transition (paths)
 +! Max Depth (error depth)
 +|-
 +| JPF "​Randomized DFS"
 +| 5000 (3) 0.00
 +| align="​right"​| 74.91s
 +| 626362.67 (0.00)
 +| 621.00 (580.33)
 +|- bgcolor="​white"​ |
 +| colspan=5 align="​center"​ | accountsubtype (1,1)
 +|- bgcolor="​lightblue"​
 +! Tool
 +! Trials (successful)
 +! Time
 +! Transition (paths)
 +! Max Depth (error depth)
 +|-
 +| JPF "​Randomized DFS"
 +| 100 (100) 1.00
 +| align="​right"​| 1.01s
 +| 122.36 (0.00)
 +| 64.71 (61.16)
 +|-
 +| CHESS
 +| 1 (1) 1.00
 +| align="​right"​| 0.34s
 +| 5280.00 (60.00)
 +| 88.00 (NA)
 +|-
 +| ConTest
 +| 1000 (13) 0.01
 +| align="​right"​| NA
 +| NA (NA)
 +| NA (NA)
 +|-
 +| CalFuzzer
 +| 1000 (730) 0.73
 +| align="​right"​| NA
 +| NA (NA)
 +| NA (NA)
 +|- bgcolor="​white"​ |
 +| colspan=5 align="​center"​ | accountsubtype (1,2)
 +|- bgcolor="​lightblue"​
 +! Tool
 +! Trials (successful)
 +! Time
 +! Transition (paths)
 +! Max Depth (error depth)
 +|-
 +| CHESS
 +| 1 (1) 1.00
 +| align="​right"​| 4.85s
 +| 116100.00 (900.00)
 +| 129.00 (NA)
 +|-
 +| ConTest
 +| 1000 (80) 0.08
 +| align="​right"​| NA
 +| NA (NA)
 +| NA (NA)
 +|-
 +| CalFuzzer
 +| 1000 (1000) 1.00
 +| align="​right"​| NA
 +| NA (NA)
 +| NA (NA)
 +|- bgcolor="​white"​ |
 +| colspan=5 align="​center"​ | accountsubtype (10,1)
 +|- bgcolor="​lightblue"​
 +! Tool
 +! Trials (successful)
 +! Time
 +! Transition (paths)
 +! Max Depth (error depth)
 +|-
 +| JPF "​Randomized DFS"
 +| 5000 (931) 0.19
 +| align="​right"​| 211.03s
 +| 2437012.58 (0.00)
 +| 328.01 (312.45)
 +|-
 +| JPF Stateless Random Walk
 +| 10124 (815) 0.08
 +| align="​right"​| NA
 +| NA (NA)
 +| NA (NA)
 +|-
 +| CHESS
 +| 1 (0) 0.00
 +| align="​right"​| NA
 +| NA (NA)
 +| NA (NA)
 +|-
 +| ConTest
 +| 1000 (13) 0.01
 +| align="​right"​| NA
 +| NA (NA)
 +| NA (NA)
 +|-
 +| CalFuzzer
 +| 1000 (720) 0.72
 +| align="​right"​| NA
 +| NA (NA)
 +| NA (NA)
 +|- bgcolor="​white"​ |
 +| colspan=5 align="​center"​ | accountsubtype (11,1)
 +|- bgcolor="​lightblue"​
 +! Tool
 +! Trials (successful)
 +! Time
 +! Transition (paths)
 +! Max Depth (error depth)
 +|-
 +| JPF "​Randomized DFS"
 +| 4999 (584) 0.12
 +| align="​right"​| 286.22s
 +| 3179153.11 (0.00)
 +| 356.39 (340.48)
 +|-
 +| JPF Stateless Random Walk
 +| 10116 (531) 0.05
 +| align="​right"​| NA
 +| NA (NA)
 +| NA (NA)
 +|-
 +| ConTest
 +| 1000 (0) 0.00
 +| align="​right"​| NA
 +| NA (NA)
 +| NA (NA)
 +|-
 +| CalFuzzer
 +| 1000 (680) 0.68
 +| align="​right"​| NA
 +| NA (NA)
 +| NA (NA)
 +|- bgcolor="​white"​ |
 +| colspan=5 align="​center"​ | accountsubtype (2,1)
 +|- bgcolor="​lightblue"​
 +! Tool
 +! Trials (successful)
 +! Time
 +! Transition (paths)
 +! Max Depth (error depth)
 +|-
 +| CHESS
 +| 1 (1) 1.00
 +| align="​right"​| 64.58s
 +| 1596000.00 (12000.00)
 +| 133.00 (NA)
 +|-
 +| ConTest
 +| 1000 (15) 0.02
 +| align="​right"​| NA
 +| NA (NA)
 +| NA (NA)
 +|-
 +| CalFuzzer
 +| 1000 (680) 0.68
 +| align="​right"​| NA
 +| NA (NA)
 +| NA (NA)
 +|- bgcolor="​white"​ |
 +| colspan=5 align="​center"​ | accountsubtype (2,2)
 +|- bgcolor="​lightblue"​
 +! Tool
 +! Trials (successful)
 +! Time
 +! Transition (paths)
 +! Max Depth (error depth)
 +|-
 +| JPF "​Randomized DFS"
 +| 100 (100) 1.00
 +| align="​right"​| 1.17s
 +| 359.13 (0.00)
 +| 135.38 (132.10)
 +|- bgcolor="​white"​ |
 +| colspan=5 align="​center"​ | accountsubtype (20,1)
 +|- bgcolor="​lightblue"​
 +! Tool
 +! Trials (successful)
 +! Time
 +! Transition (paths)
 +! Max Depth (error depth)
 +|-
 +| JPF "​Randomized DFS"
 +| 5000 (3) 0.00
 +| align="​right"​| 74.91s
 +| 626362.67 (0.00)
 +| 621.00 (580.33)
 +|-
 +| JPF Stateless Random Walk
 +| 10126 (2) 0.00
 +| align="​right"​| NA
 +| NA (NA)
 +| NA (NA)
 +|-
 +| ConTest
 +| 1000 (0) 0.00
 +| align="​right"​| NA
 +| NA (NA)
 +| NA (NA)
 +|-
 +| CalFuzzer
 +| 1000 (670) 0.67
 +| align="​right"​| NA
 +| NA (NA)
 +| NA (NA)
 +|- bgcolor="​white"​ |
 +| colspan=5 align="​center"​ | accountsubtype (5,1)
 +|- bgcolor="​lightblue"​
 +! Tool
 +! Trials (successful)
 +! Time
 +! Transition (paths)
 +! Max Depth (error depth)
 +|-
 +| CHESS
 +| 1 (0) 0.00
 +| align="​right"​| NA
 +| NA (NA)
 +| NA (NA)
 +|-
 +| ConTest
 +| 1000 (10) 0.01
 +| align="​right"​| NA
 +| NA (NA)
 +| NA (NA)
 +|-
 +| CalFuzzer
 +| 1000 (660) 0.66
 +| align="​right"​| NA
 +| NA (NA)
 +| NA (NA)
 +|- bgcolor="​white"​ |
 +| colspan=5 align="​center"​ | accountsubtype (5,5)
 +|- bgcolor="​lightblue"​
 +! Tool
 +! Trials (successful)
 +! Time
 +! Transition (paths)
 +! Max Depth (error depth)
 +|-
 +| ConTest
 +| 1000 (270) 0.27
 +| align="​right"​| NA
 +| NA (NA)
 +| NA (NA)
 +|-
 +| CalFuzzer
 +| 1000 (1000) 1.00
 +| align="​right"​| NA
 +| NA (NA)
 +| NA (NA)
 +|- bgcolor="​white"​ |
 +| colspan=5 align="​center"​ | accountsubtype (8,1)
 +|- bgcolor="​lightblue"​
 +! Tool
 +! Trials (successful)
 +! Time
 +! Transition (paths)
 +! Max Depth (error depth)
 +|-
 +| JPF "​Randomized DFS"
 +| 5000 (1986) 0.40
 +| align="​right"​| 256.71s
 +| 3154370.20 (0.00)
 +| 271.04 (257.72)
 +|-
 +| JPF Stateless Random Walk
 +| 10126 (1538) 0.15
 +| align="​right"​| NA
 +| NA (NA)
 +| NA (NA)
 +|-
 +| CHESS
 +| 1 (0) 0.00
 +| align="​right"​| NA
 +| NA (NA)
 +| NA (NA)
 +|-
 +| ConTest
 +| 1000 (12) 0.01
 +| align="​right"​| NA
 +| NA (NA)
 +| NA (NA)
 +|-
 +| CalFuzzer
 +| 1000 (700) 0.70
 +| align="​right"​| NA
 +| NA (NA)
 +| NA (NA)
 +|- bgcolor="​white"​ |
 +| colspan=5 align="​center"​ | accountsubtype (8,2)
 +|- bgcolor="​lightblue"​
 +! Tool
 +! Trials (successful)
 +! Time
 +! Transition (paths)
 +! Max Depth (error depth)
 +|-
 +| JPF "​Randomized DFS"
 +| 5000 (4957) 0.99
 +| align="​right"​| 27.88s
 +| 316964.83 (0.00)
 +| 312.38 (304.05)
 +|-
 +| JPF Stateless Random Walk
 +| 10126 (5168) 0.51
 +| align="​right"​| NA
 +| NA (NA)
 +| NA (NA)
 +|-
 +| ConTest
 +| 1000 (110) 0.11
 +| align="​right"​| NA
 +| NA (NA)
 +| NA (NA)
 +|-
 +| CalFuzzer
 +| 1000 (1000) 1.00
 +| align="​right"​| NA
 +| NA (NA)
 +| NA (NA)
 +|- bgcolor="​white"​ |
 +| colspan=5 align="​center"​ | accountsubtype (8,8)
 +|- bgcolor="​lightblue"​
 +! Tool
 +! Trials (successful)
 +! Time
 +! Transition (paths)
 +! Max Depth (error depth)
 +|-
 +| JPF "​Randomized DFS"
 +| 5000 (5000) 1.00
 +| align="​right"​| 1.50s
 +| 1206.08 (0.00)
 +| 557.65 (557.25)
 +|-
 +| JPF Stateless Random Walk
 +| 10127 (9942) 0.98
 +| align="​right"​| NA
 +| NA (NA)
 +| NA (NA)
 +|-
 +| ConTest
 +| 1000 (380) 0.38
 +| align="​right"​| NA
 +| NA (NA)
 +| NA (NA)
 +|-
 +| CalFuzzer
 +| 1000 (1000) 1.00
 +| align="​right"​| NA
 +| NA (NA)
 +| NA (NA)
 +|- bgcolor="​white"​ |
 +| colspan=5 align="​center"​ | accountsubtype (9,1)
 +|- bgcolor="​lightblue"​
 +! Tool
 +! Trials (successful)
 +! Time
 +! Transition (paths)
 +! Max Depth (error depth)
 +|-
 +| JPF "​Randomized DFS"
 +| 4999 (1422) 0.28
 +| align="​right"​| 285.10s
 +| 3369017.81 (0.00)
 +| 300.13 (284.94)
 +|-
 +| JPF Stateless Random Walk
 +| 10124 (1068) 0.11
 +| align="​right"​| NA
 +| NA (NA)
 +| NA (NA)
 +|-
 +| ConTest
 +| 1000 (12) 0.01
 +| align="​right"​| NA
 +| NA (NA)
 +| NA (NA)
 +|-
 +| CalFuzzer
 +| 1000 (700) 0.70
 +| align="​right"​| NA
 +| NA (NA)
 +| NA (NA)
 +|}
 +
 +''''​*''''​ Deterministic implementation
 +
 +''''​-''''​ No data to report as tool failed to find error
 +
 +''''​na''''​ Data not output by tool (not available)
 +
 +'''​blank'''​ Not yet run
 +
 +===Hardness=== ​
 +Hardness in a non-deterministic algorithm is the number of trials that find an error divided by the total number of trials where a trial is an independent run of the algorithm. For example, if 100 trials are run and 50 of those are successful in finding an error, then the hardness is reported as 0.50 or 50%.  For deterministic algorithms(or tools) hardness is either 1 (easy) or 0 (hard). ​ The time, transitions,​ and depth are the average over the successful experiments for non-deterministic algorithms.
 +
 +===Transitions===
 +* CHESS: computed as the number of paths times the depth
 +* JPF: computed as the number of states plus the number of revisited states
 +
 +==Chess==
 +
 +* ChessBound=2
 +* ChessMonitorVolatiles=true ​
 +
 +{| align=center | border=1 | -bgcolor=grey
 +! AccountSubtype Params !! Tests !! Found Error !! Time Taken !! Steps (Depth)
 +|- 
 +| 1,1 ||  >=60 || Yes || 0.343 secs || 88
 +|-
 +| 1,2 || >=900 || Yes || 4.852 secs || 129
 +|-
 +| 2,1 || >=12,000 || Yes || 64.584 secs || 133
 +|-
 +| 5,1 || >​=491,​000 || No || 3600.456 secs || 268 
 +|-
 +| 8,1 || >​-391,​000 || No || 3601.423 ​ secs || 403 
 +|-
 +| 10,1 || >​=673,​000 || No || 7209.165 secs || 493
 +|}
 +
 +==Java PathFinder==
 +===Stateless Random Walk===
 +{| align="​center"​ | border=1 ​
 +|- bgcolor="​lightblue"​
 +! Parameters
 +! Trials (successful)
 +! Time
 +! Transition (paths)
 +! Max Depth (error depth)
 +!  abs time (ms)
 +!  rel. time (ms)
 +!  search depth
 +!  errorDepth
 +!  new states
 +!  revisited states
 +!  end states
 +!  backtracks
 +!  processed states
 +!  restored states
 +!  total memory (kB)
 +!  max total memory
 +!  free memory (kB)
 +!  heap objects
 +!  Max heap objects
 +|-
 +|(10,1)
 +| 10124 (815) 8.05%
 +| align="​right"​| 1.28s
 +| 316.91 (0.00)
 +| 0.00 (0.00)
 +| align="​right"​ | 1282.34
 +| align="​right"​ | 1282.34
 +| align="​right"​ | 0.00
 +| align="​right"​ | 0.00
 +| align="​right"​ | 316.91
 +| align="​right"​ | 0.00
 +| align="​right"​ | 0.00
 +| align="​right"​ | 0.00
 +| align="​right"​ | 0.00
 +| align="​right"​ | 0.00
 +| align="​right"​ | 12371.24
 +| align="​right"​ | 932096.00
 +| align="​right"​ | 0.00
 +| align="​right"​ | 228.00
 +| align="​right"​ | 228.00
 +|-
 +|(11,1)
 +| 10116 (531) 5.25%
 +| align="​right"​| 1.27s
 +| 344.37 (0.00)
 +| 0.00 (0.00)
 +| align="​right"​ | 1271.48
 +| align="​right"​ | 1271.48
 +| align="​right"​ | 0.00
 +| align="​right"​ | 0.00
 +| align="​right"​ | 344.37
 +| align="​right"​ | 0.00
 +| align="​right"​ | 0.00
 +| align="​right"​ | 0.00
 +| align="​right"​ | 0.00
 +| align="​right"​ | 0.00
 +| align="​right"​ | 12780.60
 +| align="​right"​ | 932096.00
 +| align="​right"​ | 0.00
 +| align="​right"​ | 235.00
 +| align="​right"​ | 235.00
 +|-
 +|(8,1)
 +| 10126 (1538) 15.19%
 +| align="​right"​| 0.91s
 +| 261.14 (0.00)
 +| 0.00 (0.00)
 +| align="​right"​ | 910.58
 +| align="​right"​ | 910.58
 +| align="​right"​ | 0.00
 +| align="​right"​ | 0.00
 +| align="​right"​ | 261.14
 +| align="​right"​ | 0.00
 +| align="​right"​ | 0.00
 +| align="​right"​ | 0.00
 +| align="​right"​ | 0.00
 +| align="​right"​ | 0.00
 +| align="​right"​ | 14698.82
 +| align="​right"​ | 932096.00
 +| align="​right"​ | 0.00
 +| align="​right"​ | 214.00
 +| align="​right"​ | 214.00
 +|-
 +|(8,2)
 +| 10126 (5168) 51.04%
 +| align="​right"​| 1.30s
 +| 309.53 (0.00)
 +| 0.00 (0.00)
 +| align="​right"​ | 1303.24
 +| align="​right"​ | 1303.24
 +| align="​right"​ | 0.00
 +| align="​right"​ | 0.00
 +| align="​right"​ | 309.53
 +| align="​right"​ | 0.00
 +| align="​right"​ | 0.00
 +| align="​right"​ | 0.00
 +| align="​right"​ | 0.00
 +| align="​right"​ | 0.00
 +| align="​right"​ | 11760.11
 +| align="​right"​ | 932096.00
 +| align="​right"​ | 0.00
 +| align="​right"​ | 221.00
 +| align="​right"​ | 221.00
 +|-
 +|(8,8)
 +| 10127 (9942) 98.17%
 +| align="​right"​| 1.76s
 +| 557.81 (0.00)
 +| 0.00 (0.00)
 +| align="​right"​ | 1757.50
 +| align="​right"​ | 1757.50
 +| align="​right"​ | 0.00
 +| align="​right"​ | 0.00
 +| align="​right"​ | 557.81
 +| align="​right"​ | 0.00
 +| align="​right"​ | 0.00
 +| align="​right"​ | 0.00
 +| align="​right"​ | 0.00
 +| align="​right"​ | 0.00
 +| align="​right"​ | 16175.35
 +| align="​right"​ | 932096.00
 +| align="​right"​ | 0.00
 +| align="​right"​ | 263.00
 +| align="​right"​ | 263.00
 +|-
 +|(20,1)
 +| 10126 (2) 0.02%
 +| align="​right"​| 2.61s
 +| 590.50 (0.00)
 +| 0.00 (0.00)
 +| align="​right"​ | 2606.00
 +| align="​right"​ | 2606.00
 +| align="​right"​ | 0.00
 +| align="​right"​ | 0.00
 +| align="​right"​ | 590.50
 +| align="​right"​ | 0.00
 +| align="​right"​ | 0.00
 +| align="​right"​ | 0.00
 +| align="​right"​ | 0.00
 +| align="​right"​ | 0.00
 +| align="​right"​ | 20352.00
 +| align="​right"​ | 932096.00
 +| align="​right"​ | 0.00
 +| align="​right"​ | 298.00
 +| align="​right"​ | 298.00
 +|-
 +|(9,1)
 +| 10124 (1068) 10.55%
 +| align="​right"​| 1.23s
 +| 289.09 (0.00)
 +| 0.00 (0.00)
 +| align="​right"​ | 1230.36
 +| align="​right"​ | 1230.36
 +| align="​right"​ | 0.00
 +| align="​right"​ | 0.00
 +| align="​right"​ | 289.09
 +| align="​right"​ | 0.00
 +| align="​right"​ | 0.00
 +| align="​right"​ | 0.00
 +| align="​right"​ | 0.00
 +| align="​right"​ | 0.00
 +| align="​right"​ | 12467.72
 +| align="​right"​ | 932096.00
 +| align="​right"​ | 0.00
 +| align="​right"​ | 221.00
 +| align="​right"​ | 221.00
 +|}
 +
 +===Stateful Randomized Depth-first search===
 +
 +* 100 randomized depth-first search trial, where each trial is time-bounded at
 +one hour. A total of 100 computation hours dedicated in discovering the error. ​
 +
 +* 2 MB of RAM allocated on each machine
 +
 +* The Error Discovering Trials is the number of trials that discovered an error
 +among the initially launched trials (100). ​
 +{| align="​center"​ | border=1 ​
 +|- bgcolor="​lightblue"​
 +! Parameters
 +! Trials (successful)
 +! Time
 +! Transition (paths)
 +! Max Depth (error depth)
 +!  abs time (ms)
 +!  rel. time (ms)
 +!  search depth
 +!  errorDepth
 +!  new states
 +!  revisited states
 +!  end states
 +!  backtracks
 +!  processed states
 +!  restored states
 +!  total memory (kB)
 +!  max total memory
 +!  free memory (kB)
 +!  heap objects
 +!  Max heap objects
 +|-
 +|(10,1)
 +| 5000 (931) 18.62%
 +| align="​right"​| 211.03s
 +| 2437012.58 (0.00)
 +| 328.01 (312.45)
 +| align="​right"​ | 211031.46
 +| align="​right"​ | 3032.36
 +| align="​right"​ | 328.01
 +| align="​right"​ | 312.45
 +| align="​right"​ | 432510.58
 +| align="​right"​ | 2004502.00
 +| align="​right"​ | 1.56
 +| align="​right"​ | 2436699.13
 +| align="​right"​ | 432196.58
 +| align="​right"​ | 0.00
 +| align="​right"​ | 156919.20
 +| align="​right"​ | 932096.00
 +| align="​right"​ | 63601.53
 +| align="​right"​ | 248.00
 +| align="​right"​ | 248.00
 +|-
 +|(20,1)
 +| 5000 (3) 0.06%
 +| align="​right"​| 74.91s
 +| 626362.67 (0.00)
 +| 621.00 (580.33)
 +| align="​right"​ | 74906.67
 +| align="​right"​ | 4906.67
 +| align="​right"​ | 621.00
 +| align="​right"​ | 580.33
 +| align="​right"​ | 131921.33
 +| align="​right"​ | 494441.33
 +| align="​right"​ | 1.67
 +| align="​right"​ | 625781.33
 +| align="​right"​ | 131339.33
 +| align="​right"​ | 0.00
 +| align="​right"​ | 248981.33
 +| align="​right"​ | 932096.00
 +| align="​right"​ | 153579.33
 +| align="​right"​ | 318.00
 +| align="​right"​ | 318.00
 +|-
 +|(11,1)
 +| 4999 (584) 11.68%
 +| align="​right"​| 286.22s
 +| 3179153.11 (0.00)
 +| 356.39 (340.48)
 +| align="​right"​ | 286218.75
 +| align="​right"​ | 3170.55
 +| align="​right"​ | 356.39
 +| align="​right"​ | 340.48
 +| align="​right"​ | 554758.12
 +| align="​right"​ | 2624395.00
 +| align="​right"​ | 1.52
 +| align="​right"​ | 3178811.63
 +| align="​right"​ | 554416.11
 +| align="​right"​ | 0.00
 +| align="​right"​ | 162449.64
 +| align="​right"​ | 932096.00
 +| align="​right"​ | 66486.34
 +| align="​right"​ | 255.00
 +| align="​right"​ | 255.00
 +|-
 +|(1,1)
 +| 100 (100) 100.00%
 +| align="​right"​| 1.01s
 +| 122.36 (0.00)
 +| 64.71 (61.16)
 +| align="​right"​ | 1006.42
 +| align="​right"​ | 1006.42
 +| align="​right"​ | 64.71
 +| align="​right"​ | 61.16
 +| align="​right"​ | 97.66
 +| align="​right"​ | 24.70
 +| align="​right"​ | 1.56
 +| align="​right"​ | 60.20
 +| align="​right"​ | 34.94
 +| align="​right"​ | 0.00
 +| align="​right"​ | 16581.12
 +| align="​right"​ | 6990528.00
 +| align="​right"​ | 0.00
 +| align="​right"​ | 185.00
 +| align="​right"​ | 185.00
 +|-
 +|(8,1)
 +| 5000 (1986) 39.72%
 +| align="​right"​| 256.71s
 +| 3154370.20 (0.00)
 +| 271.04 (257.72)
 +| align="​right"​ | 256712.01
 +| align="​right"​ | 3167.19
 +| align="​right"​ | 271.04
 +| align="​right"​ | 257.72
 +| align="​right"​ | 556990.73
 +| align="​right"​ | 2597379.47
 +| align="​right"​ | 1.62
 +| align="​right"​ | 3154111.48
 +| align="​right"​ | 556731.40
 +| align="​right"​ | 0.00
 +| align="​right"​ | 167893.78
 +| align="​right"​ | 932096.00
 +| align="​right"​ | 72185.19
 +| align="​right"​ | 234.00
 +| align="​right"​ | 234.00
 +|-
 +|(8,2)
 +| 5000 (4957) 99.14%
 +| align="​right"​| 27.88s
 +| 316964.83 (0.00)
 +| 312.38 (304.05)
 +| align="​right"​ | 27881.65
 +| align="​right"​ | 2204.46
 +| align="​right"​ | 312.38
 +| align="​right"​ | 304.05
 +| align="​right"​ | 55864.49
 +| align="​right"​ | 261100.34
 +| align="​right"​ | 1.48
 +| align="​right"​ | 316659.78
 +| align="​right"​ | 55558.96
 +| align="​right"​ | 0.00
 +| align="​right"​ | 56404.08
 +| align="​right"​ | 932096.00
 +| align="​right"​ | 14745.03
 +| align="​right"​ | 241.00
 +| align="​right"​ | 241.00
 +|-
 +|(8,8)
 +| 5000 (5000) 100.00%
 +| align="​right"​| 1.50s
 +| 1206.08 (0.00)
 +| 557.65 (557.25)
 +| align="​right"​ | 1495.24
 +| align="​right"​ | 1441.24
 +| align="​right"​ | 557.65
 +| align="​right"​ | 557.25
 +| align="​right"​ | 709.95
 +| align="​right"​ | 496.14
 +| align="​right"​ | 1.02
 +| align="​right"​ | 647.83
 +| align="​right"​ | 151.68
 +| align="​right"​ | 0.00
 +| align="​right"​ | 17889.01
 +| align="​right"​ | 932096.00
 +| align="​right"​ | 151.20
 +| align="​right"​ | 283.00
 +| align="​right"​ | 283.00
 +|-
 +|(20,1)
 +| 5000 (3) 0.06%
 +| align="​right"​| 74.91s
 +| 626362.67 (0.00)
 +| 621.00 (580.33)
 +| align="​right"​ | 74906.67
 +| align="​right"​ | 4906.67
 +| align="​right"​ | 621.00
 +| align="​right"​ | 580.33
 +| align="​right"​ | 131921.33
 +| align="​right"​ | 494441.33
 +| align="​right"​ | 1.67
 +| align="​right"​ | 625781.33
 +| align="​right"​ | 131339.33
 +| align="​right"​ | 0.00
 +| align="​right"​ | 248981.33
 +| align="​right"​ | 932096.00
 +| align="​right"​ | 153579.33
 +| align="​right"​ | 318.00
 +| align="​right"​ | 318.00
 +|-
 +|(2,2)
 +| 100 (100) 100.00%
 +| align="​right"​| 1.17s
 +| 359.13 (0.00)
 +| 135.38 (132.10)
 +| align="​right"​ | 1171.33
 +| align="​right"​ | 1171.33
 +| align="​right"​ | 135.38
 +| align="​right"​ | 132.10
 +| align="​right"​ | 224.98
 +| align="​right"​ | 134.15
 +| align="​right"​ | 1.37
 +| align="​right"​ | 226.03
 +| align="​right"​ | 91.51
 +| align="​right"​ | 0.00
 +| align="​right"​ | 16812.80
 +| align="​right"​ | 6990528.00
 +| align="​right"​ | 0.00
 +| align="​right"​ | 199.00
 +| align="​right"​ | 199.00
 +|-
 +|(9,1)
 +| 4999 (1422) 28.45%
 +| align="​right"​| 285.10s
 +| 3369017.81 (0.00)
 +| 300.13 (284.94)
 +| align="​right"​ | 285097.42
 +| align="​right"​ | 3288.38
 +| align="​right"​ | 300.13
 +| align="​right"​ | 284.94
 +| align="​right"​ | 589956.73
 +| align="​right"​ | 2779061.08
 +| align="​right"​ | 1.61
 +| align="​right"​ | 3368731.87
 +| align="​right"​ | 589670.18
 +| align="​right"​ | 0.00
 +| align="​right"​ | 175321.11
 +| align="​right"​ | 932096.00
 +| align="​right"​ | 75030.19
 +| align="​right"​ | 241.00
 +| align="​right"​ | 241.00
 +|}
 +
 +==ConTest==
 +
 +* 100 to 1000 independent trials
 +
 +* The ratio of the error discovery trials over the total number of trials is the 
 +path error density. ​
 +
 +{| align=center | border=1 | -bgcolor=grey
 +! AccountSubtype Params !! Path Error Density
 +|- 
 +| 1,1 || 0.013
 +|-
 +| 2,1 || 0.015
 +|-
 +| 1,2 || 0.08
 +|-
 +| 5,1 || 0.01
 +|-
 +| 5,5 || 0.27
 +|-
 +| 8,1 || 0.012
 +|-
 +| 9,1 || 0.012
 +|-
 +| 8,2 || 0.11
 +|-
 +| 8,8 || 0.38
 +|-
 +| 10,1 || 0.013
 +|-
 +| 11,1 || 0.000
 +|-
 +| 20,1 || 0.000
 +|}
 +
 +
 +==CalFuzzer==
 +
 +* 100 to 1000 independent trials
 +
 +* The ratio of the error discovery trials over the total number of trials is the 
 +path error density. ​
 +
 +{| align=center | border=1 | -bgcolor=grey
 +! AccountSubtype Params !! Path Error Density
 +|- 
 +| 1,1 || 0.73
 +|-
 +| 2,1 || 0.68
 +|-
 +| 1,2 || 1.00
 +|-
 +| 5,1 || 0.66
 +|-
 +| 5,5 || 1.00
 +|-
 +| 8,1 || 0.70
 +|-
 +| 9,1 || 0.70
 +|-
 +| 8,2 || 1.00
 +|-
 +| 8,8 || 1.00
 +|-
 +| 10,1 || 0.72
 +|-
 +| 11,1 || 0.68
 +|-
 +| 20,1 || 0.67
 +|}
vv-lab/accountsubtype.txt ยท Last modified: 2015/02/18 22:52 by egm
Back to top
CC Attribution-Share Alike 4.0 International
chimeric.de = chi`s home Valid CSS Driven by DokuWiki do yourself a favour and use a real browser - get firefox!! Recent changes RSS feed Valid XHTML 1.0