Differences
This shows you the differences between two versions of the page.
Both sides previous revisionPrevious revisionNext revision | Previous revisionLast revisionBoth sides next revision | ||
research:software:gradualtalk:ggt [2014/03/27 13:15] – eallende | research:software:gradualtalk:ggt [2014/03/31 12:26] – eallende | ||
---|---|---|---|
Line 6: | Line 6: | ||
- | For instructions on how to use these benchmarks and examples, please read the included '' | + | For instructions on how to use these benchmarks and examples, please |
- | **Still need to generate tar of the benchmark suit** | + | The benchmark suite is ready to run in a Windows or Linux machine. To run in another OS with bash, the corresponding [[http:// |
- | The benchmark suite is ready to run in a Windows machine. To run in another | + | ===== Contents of the image ===== |
+ | |||
+ | |||
+ | This image includes: | ||
+ | * examples of SGGT and RGGT | ||
+ | * the micro and macro benchmarks | ||
+ | |||
+ | Also, the Windows Cog VM is included | ||
+ | put the corresponding | ||
+ | benchmarks scripts. | ||
+ | |||
+ | ===== Examples ===== | ||
+ | The example images of SGGT and RGGT are located in the example folder. | ||
+ | |||
+ | To run the SGGT image, execute: | ||
+ | |||
+ | Win: | ||
+ | Linux: ./sggt.sh | ||
+ | |||
+ | To run the RGGT image, execute: | ||
+ | |||
+ | Win: | ||
+ | Linux: | ||
+ | |||
+ | ==== Qualifier syntax ==== | ||
+ | The syntax for the qualifiers are: | ||
+ | |||
+ | Up qualifier: | ||
+ | Down qualifier: vv Ex: vvString, vv(Integer-> | ||
+ | |||
+ | ===== Benchmarks ===== | ||
+ | The micro and macro benchmark are configured to run in a machine with Windows | ||
+ | |||
+ | ==== Micro-benchmarks ==== | ||
+ | |||
+ | To run the micro-benchmarks, | ||
+ | |||
+ | Win: | ||
+ | Linux: ./ | ||
+ | |||
+ | |||
+ | The results of the microbenchmarks are stored in the results directory | ||
+ | microbenchmarks (" | ||
+ | - GT for non-gradual Gradual Typing | ||
+ | - RGGT for Relaxed Gradual Gradual Typing | ||
+ | |||
+ | In the results-X.txt file, each line states: | ||
+ | - the size of the collection. | ||
+ | - the time taken in: | ||
+ | - Wrapper Creation | ||
+ | - Closure Evaluation, NQ, Wrapped. | ||
+ | - Wrapper Creation | ||
+ | - Closure Evaluation, NQ, Unwrapped. | ||
+ | - Wrapper Creation | ||
+ | - Closure Evaluation, NQ, NoDyn. | ||
+ | - Wrapper Creation | ||
+ | - Closure Evaluation, DQ, Unwrapped (only RGGT). | ||
+ | - Wrapper Creation | ||
+ | - Closure Evaluation, DQ, NoDyn (only RGGT). | ||
+ | - Wrapper Creation | ||
+ | - Closure Evaluation, UQ, Unwrapped (only RGGT). | ||
+ | - Wrapper Creation | ||
+ | - Closure Evaluation, UQ, NoDyn (only RGGT). | ||
+ | |||
+ | Legend: NQ=No Qualifiers, DQ=Down arrow qualifier, UQ=Up arrow qualifier | ||
+ | |||
+ | ==== Macro-benchmarks | ||
+ | |||
+ | To run the macro-benchmarks, | ||
+ | |||
+ | Win: | ||
+ | Linux: ./ | ||
+ | |||
+ | The results of the microbenchmarks | ||
+ | macrobenchmarks (" | ||
+ | -GT-Wrapped | ||
+ | -GT-Unwrapped | ||
+ | -RGGT-Wrapped | ||
+ | -RGGT-Wrapped-NQ | ||
+ | -RGGT-Wrapped-DQ | ||
+ | -RGGT-Wrapped-UQ | ||
+ | |||
+ | Legend: NQ=No Qualifiers, DQ=Down arrow qualifier, UQ=Up arrow qualifier | ||
+ | |||
+ | Each file containts the time taken to run the macro-benchmark in that variant. |