This is an old revision of the document!


PLOMO2: A new generation of tools to navigate and profile programs

An INRIA Equipe Associee between RMOD and PLEIAD, a continuation of the PLOMO Equipe Associee named after cerro El Plomo, the highest peak (5424 meters) that is visible from Santiago. Foto by by Thiago "James".

Introduction

Performing effective software development and maintenance are best achieved with effective tool support. Provided by a variety of tools, each one presenting a specific kind of information supporting the task at hand. The goal of the first PLOMO was to develop new meta tools to improve and bring synergy in the existing infrastructure of Pharo (for software development) and the Moose software analysis platform (for maintenance). With Plomo2, we want to build on top of this work and invent a new generation tools to navigate and profile programs.

The hypotheses that Plomo2 will seek to verify are:

  • Use of reflection enables new profiling techniques
  • Use of visualization in a programming environment improves programmer performance

The overall objectives of Plomo2 are:

  1. Infrastructure for profiling programs and recording programmer activity.
  2. Visual software maps defined in a flexible and agile fashion
  3. Combining dynamic information with visualization to improve the development environment
  4. Empirical evaluation of this environment

All the efforts will be performed on Pharo and Moose, two platforms heavily used by the RMoD and Pleiad teams.

Work plan

Work Package One:

For both for program profiling and programmer activity recording, we need a way to deeply hook into the system. We plan for this to improve the reflective infrastructure of Pharo.

During the previous period we worked on OPAL, a new compiler toolchain for Pharo. In essence the work on the compiler framework does not move forward the state of the art in compiler technology. However it has already been proven to be a crucial building block. It provided the fundamentals for many research experiments and new features for Pharo. For example, Pleiad and RMoD collaborated on a novel type system for Pharo that was realized using the new compiler infrastructure. Other examples are the many new features of Pharo 3 that use parts of the new compiler chain, like AST-based navigation in the editor or breakpoints.

The Opal flexible compiler infrastructure will allow us to build a new generation of reflective infrastructure. Such infrastructure is keys to support tools (profilers) and new language design (AOP, proxies, isolation). We are now in a position to perform a new iteration on the reflective layer and metaobject protocol for Pharo. In 2005 we started to develop new reflective foundations and we learned a lot (partial reflection, metalevel recursion handling, object-centric on the fly propagation, proxies, isolation). We are now in a situation to step back and redesign the reflective layer based on all the cases we identified and developed.

The results of this work package will be used and thus validated by WP3. In addition, we plan to realize the next generation of the AOP framework Phantom using the reflection framework. This especially makes sure that the framework is general and not just limited for the use in tools.

Work Package Two:

Plomo made a lot of progress by realizing the Roassal visualisation framework. We plan to enhance the infrastructure to visually render software-related data. We will investigate two complementary directions:

  1. Interaction and scalability in Roassal 2D. Roassal is an Agile Visualization Engine that offers large range of options to make the user interact with the visualization. Visualization software require particular customizations to cope with large amount of data. Navigation should support interactive and semantic zooming, which is an essential feature for navigating large amount of data elements. Additional layers, including drawing dependency matrices, vectorial and interactive charts are required
  2. Visual representation of 3D environment gives a sensation of immersion that is often key to identify some patterns in a data structure. Current programming environments exploiting 3D are either fixed to a particular representation or unfit to be used as the base of a programming environment

Work Package Three:

The goal of the third work package is to build on top of both WP1 and WP2: Combining dynamic information with visualization to improve the development environment.

  1. Visualization to navigate and browse source code – System complexity is a polymetric view efficient at representing class hierarchies in a software source code. It has been shown that system complexity is effective for software maintenance. We will augment the range of application of it by using it to navigate and browser application source code.
  2. Visualizing dynamic information to navigate source code. The static view of code should be enhanced with dynamic information gathered from program execution. A good example here is visualization of profiling and tracing information.
  3. Context based on history – It has been shown that analyzing past user actions may precisely infer what will be the next user actions. Unfortunately, history is poorly supported in traditional programming environment. Making history a first class element in the programming environment is the topic of this work package.

This work package will therefore validate both WP1 and WP2. We will validate the ideas developed as part of WP3 by carrying out an empirical evaluation.

Achievements

2014

Scientific Results

WP 1

Progress on a new iteration on the reflective layer and metaobject protocol for Pharo: We have implemented the Slots Mechanism in Pharo, which resulted in a first-class reification of instance variables and their accessing through assignment and reading. This allows us to hook into reading and writing of instance variables and perform meta-level operations on them, e.g. adding breakpoints to the reading of a specific instance var, or a transparent notification mechanism for when a specific instance variable is written. The latter can be used, e.g. in WP3 to dynamically update a visualization of the object that contains the instance variable whenever the variable changes.

WP 2

Interaction and scalability in Roassal 2D: OSWindow, FFI, (SDL2 binding for the former is through the latter).

Visual representation of 3D environment: Woden

WP 3

Publications

  • Johan Fabry, Andy Kellens, Simon Denier, Stephane Ducasse – AspectMaps: Extending Moose to Visualize AOP Software – Science of Computer Programming, volume 79, number 1, pp.6-22, January 2014, Elsevier
  • Johan Fabry, Romain Robbes, Marcus Denker – DIE: A Domain Specific Aspect Language for IDE Events – Journal of Universal Computer Science, volume 20, number 2, pp.135-168, February 2014
  • Esteban Allende, Oscar Callaú, Johan Fabry, Éric Tanter, Marcus Denker – Gradual Typing for Smalltalk – Science of Computer Programming, volume 96, number 1, pp.52-69, December 2014, Elsevier
  • Benjamin Van Ryseghem, Stéphane Ducasse, Johan Fabry – Seamless Composition and Reuse of Customizable User Interfaces with Spec – Science of Computer Programming, volume 96, number 1, pp.34-51, December 2014, Elsevier
  • Alexandre Bergel, Sergio Maass, Stéphane Ducasse, Tudor Girba – A Domain-Specific Language For Visualizing Software Dependencies as a Graph. Proceedings of 2nd IEEE Working Conference on Software Visualization (VISSOFT NIER) pdf
  • A book chapter about the Spec user interface description framework has been finished for a new Pharo Book. pdf

Publications in preparation

  • LinuxMag articles on Roassal and Charter

Software artifacts

  • Moose: Cleaned and pushing toward 5.0
  • Roassal2: Fully based on Athens, the vector graphic support in Pharo
  • Improvement of the FFI description pdf
  • OSWindow has been integrated in Pharo4.
  • Opal

Other artifacts

Event organization

  • International Workshop on Smalltalk Technologies (IWST), co-located at ESUG 2014. Paper awards were sponsored by Lam Research.

Visits

Santiago To Lille:

  • Ronie Saldago: 24/08/2014 until 07/09/2014. Subject was FFI and OSWindow.
  • Miguel Campusano: 16/08/2014 until 11/09/2014. Subject was Slots and visual representation of code.
  • Alexandre Bergel: 13/12/2014 until 01/01/2015. Subject is
  • Juraj Kubelka: 06/12/2014 until 19/12/2014. Subject is

Lille to Santiago:

  • Marcus Denker: 2/1/2015 until 20/1/2015, sponsored by PLEIAD. Subject is Slots.