Differences
This shows you the differences between two versions of the page.
Next revision | Previous revisionNext revisionBoth sides next revision | ||
research:software:gradualtalk:ggt [2014/03/24 16:35] – created eallende | research:software:gradualtalk:ggt [2014/03/28 04:30] – eallende | ||
---|---|---|---|
Line 2: | Line 2: | ||
The benchmarks used in the paper " | The benchmarks used in the paper " | ||
- | {{research: | + | {{research: |
+ | This file also include example images for SGGT and RGGT. | ||
- | For instructions on how to use these benchmarks, please read the included '' | ||
- | **Still need to generate tar of the benchmark suit** | + | For instructions on how to use these benchmarks and examples, please continue reading this page or read the included '' |
- | The benchmark suite is ready to run in a Windows machine. To run in another OS, the corresponding [[http:// | + | The benchmark suite is ready to run in a Windows |
+ | |||
+ | |||
+ | ===== Contents of the image ===== | ||
+ | |||
+ | |||
+ | This image includes: | ||
+ | * examples of SGGT and RGGT | ||
+ | * the micro and macro benchmarks | ||
+ | |||
+ | Also, the Windows Cog VM is included in the image. To run in an OS with bash, | ||
+ | put the corresponding Cog VM in the " | ||
+ | benchmarks scripts. | ||
+ | |||
+ | ===== Examples ===== | ||
+ | The example images of SGGT and RGGT are located in the example folder. | ||
+ | |||
+ | To run the SGGT image, execute: | ||
+ | |||
+ | Win: | ||
+ | Linux: ./sggt.sh | ||
+ | |||
+ | To run the RGGT image, execute: | ||
+ | |||
+ | Win: | ||
+ | Linux: ./rggt.sh | ||
+ | |||
+ | |||
+ | ===== Benchmarks ===== | ||
+ | The micro and macro benchmark are configured to run in a machine with Windows or Linux. | ||
+ | |||
+ | ==== Micro-benchmarks ==== | ||
+ | |||
+ | To run the micro-benchmarks, | ||
+ | |||
+ | Win: | ||
+ | Linux: ./ | ||
+ | |||
+ | |||
+ | The results of the microbenchmarks are stored in the results directory inside the directory of the | ||
+ | microbenchmarks (" | ||
+ | - GT for non-gradual Gradual Typing | ||
+ | - RGGT for Relaxed Gradual Gradual Typing | ||
+ | |||
+ | In the results-X.txt file, each line states: | ||
+ | - the size of the collection. | ||
+ | - the time taken in: | ||
+ | - Wrapper Creation | ||
+ | - Closure Evaluation, NQ, Wrapped. | ||
+ | - Wrapper Creation | ||
+ | - Closure Evaluation, NQ, Unwrapped. | ||
+ | - Wrapper Creation | ||
+ | - Closure Evaluation, NQ, NoDyn. | ||
+ | - Wrapper Creation | ||
+ | - Closure Evaluation, DQ, Unwrapped (only RGGT). | ||
+ | - Wrapper Creation | ||
+ | - Closure Evaluation, DQ, NoDyn (only RGGT). | ||
+ | - Wrapper Creation | ||
+ | - Closure Evaluation, UQ, Unwrapped (only RGGT). | ||
+ | - Wrapper Creation | ||
+ | - Closure Evaluation, UQ, NoDyn (only RGGT). | ||
+ | |||
+ | Legend: NQ=No Qualifiers, DQ=Down arrow qualifier, UQ=Up arrow qualifier | ||
+ | |||
+ | ==== Macro-benchmarks ==== | ||
+ | |||
+ | To run the macro-benchmarks, | ||
+ | |||
+ | Win: | ||
+ | Linux: ./ | ||
+ | |||
+ | The results of the microbenchmarks are stored in the results directory inside the directory of the | ||
+ | macrobenchmarks (" | ||
+ | -GT-Wrapped | ||
+ | -GT-Unwrapped | ||
+ | -RGGT-Wrapped | ||
+ | -RGGT-Wrapped-NQ | ||
+ | -RGGT-Wrapped-DQ | ||
+ | -RGGT-Wrapped-UQ | ||
+ | |||
+ | Legend: NQ=No Qualifiers, DQ=Down arrow qualifier, UQ=Up arrow qualifier | ||
+ | |||
+ | Each file containts the time taken to run the macro-benchmark in that variant. |