Software Evaluation Corner ====== Artifact Evaluation at ESEC/FSE 2013 ====== Results presented in technical papers are often validated or supported by software artifacts. To reward the effort of creating artifacts, authors of accepted research paper may, if they wish, have their tools, data or model evaluated by the Artifact Evaluation Committee. After the research paper notification of [[http://esec-fse.inf.ethz.ch|ESEC/FSE 2013]], authors of accepted papers will be contacted to submit their artifact for evaluation. Evaluation of the artifact will be sent to the authors before the camera ready deadline. Artifacts that are positively evaluated, will be formally recognized in the proceedings and at the conference. ====== Distinguished Artifacts ====== There are 2 artifacts that deserved to be distinguished: * Paul Marinescu and Cristian Cadar. KATCH: High-Coverage Testing of Software Patches * Aravind Machiry, Rohan Tahiliani and Mayur Naik. Dynodroid: An Input Generation System for Android Apps ====== Submission Summary ====== * Due on: Sunday June 2nd 2013 (end of the week of the paper notification) **-- CLOSED** * Notification from the AEC: Monday June 24, 2013 (one week before the camera ready version) **-- PASSED** * Format: [[events/workshops/esecfse2013/guidelines|Guidelines for Packaging AEC Submissions]] * Contact: [[mailto:abergel@dcc.uchile.cl|Alexandre Bergel]] and [[mailto:bettini@di.unito.it|Lorenzo Bettini]] ====== Process ====== Artifacts will be evaluated in a similar fashion than papers are. They will be reviewed by a committee (the Artifact Evaluation Committee, AEC) and graded according to what your accepted paper describes. Software artifacts who successfully passed our evaluation will be officially recognized (in the proceedings, during the conference, during the social event presentation). Fireworks will be for the distinguished software artifacts. ====== Artifacts Meeting Expectation ====== In total we have received 22 artifacts. 12 have been assessed as "met expectation" or "Exceeded expectations". Below is the list of artifacts that have been positively evaluated. Out of the 12 positively evaluated artifacts, 8 will be presented on Friday 23 August 2013, during a dedicated slot 17:00 - 17:40. Each presentation will have 5 minutes: * Paul Marinescu and Cristian Cadar -- //KATCH: High-Coverage Testing of Software Patches// * Dirk Beyer, Stefan Löwe, Evgeny Novikov, Andreas Stahlbauer and Philipp Wendler -- //Linux Driver Revisions for Regression Verification - [[http://www.sosy-lab.org/~dbeyer/cpa-reuse/regression-benchmarks/|online]]// * Shahar Maoz, Jan Oliver Ringert and Bernhard Rumpe -- //Synthesis of Component and Connector Models from Crosscutting Structural Views// * Marin Silic, Goran Delac and Sinisa Srbljic -- //Prediction of Atomic Web Services Reliability Based on K-means Clustering [[http://ccl.fer.hr/wordpress/people/research-assistants/marin-silic/clus-evaluation-dataset/|online]]// * Nishant Sinha and Rezwana Karim -- //Compiling Mockups to Flexible UIs// [[https://www.youtube.com/watch?v=OoPdw0kWRcA|online video]] * Alex Gyori, Danny Dig, Lyle Franklin and Jan Lahoda -- //Crossing the gap from imperative to functional programming through refactoring [[http://refactoring.info/tools/LambdaFicator/|online]]// * Peng Liu -- //Finding Incorrect Compositions of Atomicity// * Yunhui Zheng, Xiangyu Zhang and Vijay Ganesh -- //Z3-str: A String Theory Plugin on Z3 for Web Application Analysis// The remaining 4 artifacts will be presented during their paper presentation slot: * Meiyappan Nagappan, Thomas Zimmermann and Christian Bird -- //Diversity in Software Engineering Research -- [[http://sailhome.cs.queensu.ca/replication/representativeness/|online]]// * Chengnian Sun and Siau-Cheng Khoo -- //Mining Succinct Predicated Bug Signatures// * Aravind Machiry, Rohan Tahiliani and Mayur Naik -- //Dynodroid: An Input Generation System for Android Apps [[http://pag-www.gtisc.gatech.edu/dynodroid/data/|online]]// * Pietro Braione, Giovanni Denaro and Mauro Pezze' -- //Enhancing Symbolic Execution with Built-in Term Rewriting and Constrained Lazy Initialization// ====== Artifact Evaluation Committee ====== The committee has been carefully selected by the chairs to reflect the relevant topics of ESEC/FSE. * [[http://cfbolz.de|Carl Friedrich Bolz]], Heinrich-Heine-Universität Düsseldorf, Germany * [[http://damiencassou.seasidehosting.st/seaside|Damien Cassou]], University of Lille 1, France * [[http://www.lta.disco.unimib.it/lta/personalPages/giovanniDenaro/giovanniDenaro.php|Giovanni Denaro]], University of Milano-Bicocca, Italy * [[http://www.doc.ic.ac.uk/~srdipi/|Nicolás R. D'Ippolito]], Imperial College London, UK * [[http://www.gousios.gr|Georgios Gousios]], TU Delft, Netherlands * [[http://www.cc.gatech.edu/~wjin6/mypage/index.html|Wei Jin]], Georgia Institute of Technology, USA * [[http://www.disi.unige.it/person/LagorioG/|Giovanni Lagorio]], University of Genova, Italy * [[http://www.i3s.unice.fr/~mosser/start|Sébastien Mosser]], University of Nice - Sophia Antipolis, France * [[http://www.inf.usi.ch/phd/olivero/|Fernando Olivero]], University of Lugano, Switzerland * [[https://sites.google.com/a/ic.ufal.br/marcio/|Márcio Ribeiro]], Federal University of Alagoas, Brazil * [[http://apice.unibo.it/xwiki/bin/view/AlessandroRicci/|Alessandro Ricci]], University of Bologna, Italy * [[http://users.dcc.uchile.cl/~jsandova/|Juan Pablo Sandoval Alcocer]], University of Chile, Chile Chairs: * [[http://bergel.eu|Alexandre Bergel]], University of Chile, Chile * [[http://www.lorenzobettini.it|Lorenzo Bettini]], University of Torino, Italy ====== Other Artifact Evaluation Committees ====== * [[http://ecoop13-aec.cs.brown.edu|ECOOP'13]] * [[http://splashcon.org/2013/cfp/due-june-01-2013/665-oopsla-artifacts|OOPSLA'13]] * [[http://cs.brown.edu/~sk/Memos/Conference-Artifact-Evaluation/|ESEC/FSE'11]]