Palladio Developer Wiki

Palladio Addon (Liste)
Name	Palladio Experiment Automation
Contacts	Sebastian Lehrig (https://www.tu-chemnitz.de/informatik/ST/mitarbeiter.php), Philipp Merkle (http://sdq.ipd.kit.edu/people/philipp merkle/)
State	Incubation
Is Stand-alone Analysis?	No
Extends Analyses	SimuCom, SimuLizar
Extends Metamodels	New Views
Code Location	https://github.com/PalladioSimulator/Palladio-Addons-ExperimentAutomation
Update Site	https://sdqweb.ipd.kit.edu/eclipse/experimentautomation/nightly/

Short Summary

The Palladio Experiment Automation enables automatic execution of Palladio simulation runs. Allows to specify experiment runs for arbitrary solvers within a model; also supports experiment variations, e.g., for sensitivity analyses.

Documentation

This page describes the Palladio Experiment Automation project, which enables automatic Palladio simulation runs.

So far, the Palladio Bench requires user interaction to configure and launch a simulation run, both of which is done using the the SimuBench launch configuration type. While being sufficient for single simulation runs, larger simulation studies with plenty of similar but distinct runs are tedious to perform this way and the desire for automation arises. The Palladio Experiment Automation project aims a filling this gap.

Features

Simulates a specified PCM model with a given simulation configuration
Simulates an experiment series referring to a specified PCM model which is automatically modified over the course of the experiment series. E.g. the population of a closed workload might be systematically increased.
Comes with a configuration-metamodel whose instances describe which PCM model is to be used, what is the simulation configuration and how the PCM model is going to be modified over the course of the experiment series
Runs headless, i.e. without a graphical user interface (GUI) present. This way, experiments can be launched from command line, but also in a graphical environment.

Further information

Development of the Palladio Experiment Automation started in the course of a master's thesis, so please refer to the corresponding thesis for more information: [1] (pp. 65 ff.)

Technical documentation

Technical overview

Palladio Experiment Automation...

...comprises a number of Eclipse plug-ins
...is an Eclipse Application, meaning that it extends the org.eclipse.core.runtime.applications extension point
...provides no graphical widgets or views, respectively - experiment series or single simulation runs are configured solely on the basis of a configuration model

Installation

Installation from Update Site

There is no release version yet. Currently, use the following (nightly) update site:

https://sdqweb.ipd.kit.edu/eclipse/experimentautomation/nightly/

Installation from GitHub

Use the GitHub repository to check out all plug-ins ("org.palladiosimulator.experimentautomation*"):

https://github.com/PalladioSimulator/Palladio-Addons-ExperimentAutomation

Creating and Editing Configuration Models

Install Eclipse and Palladio with Experiment Automation feature enabled
Create a project (or use an existing one) - the project type (General, Java, ...) does not matter
Select File -> New... -> Other... -> Example EMF Model Creation Wizards -> Experiments Model
Name your model as desired (then hit Next), and choose "Experiment Repository" in the topmost drop-down field (hit Finish)
Copy the pcm.variation file into the folder where your .experiments file resides. The .variation file can be found in the experimentautomation.application project in the "model" subfolder. To use the variations, the file has to be loaded, using the "Load Resource..." entry of the context menu of the tree editor.
Start modelling as usual with generated EMF tree-editors. You can find a simple example in the project "org.palladiosimulator.experimentautomation.examples.espresso".

Running Experiments

Start the Palladio-Bench with Experiment Automation feature enabled
Create a PCM model to be simulated
Create a configuration model as described above - the configuration model indirectly references the afore-created PCM model
Select Run -> Run Configurations... and double click on Eclipse Application
Choose the newly created Eclipse launch configuration
Select "Run as application" and choose "org.palladiosimulator.experimentautomation.application"
Switch to the "Arguments" tab
In the field "Program arguments", provide an additional argument as shown in this example:
```
-os ${target.os} -ws ${target.ws} -arch ${target.arch} -nl ${target.nl} -consoleLog D:\models\my.experiments
```
- This argument is the path to your configuration model (.experiments extension).
Hit Run and lean back
Once the experiments are finished, you will find all data in the recorder (e.g., EDP2 or SensorFramework) you configured