Tramdemo - a demonstration dialogue system using multilingual and multimodal grammars

Demo Movie

There is a video of a demo of the Tramdemo system. It is a bit old, and the current system has a few more features than shown in the video.

Download

Compiled Tramdemo program.

Source code and grammars.

There is a tramdemo darcs repo with the development version. Get darcs here.

Documentation

The TALK project deliverable D1.2a describes the use of multimodal grammars in dialogue systems. Section 3 of the deliverable details the grammars used by the tramdemo application.

Running

This section describes how to run the binary version of the system. If you want to modify the system, see the section Building.

Download

Get the latest binary package of the Tramdemo system, and unpack it.

Requirements for running

In order to run the Tramdemo system, you need to have the following software installed:

Java JRE 1.5.0. The java executable should be on the path, or you can set the variable JAVA in tramdemo_{unix,win}.props (for Unix and Windows, respectively).
OOA 2.3.0. The environment variable OAA_HOME should point to the OAA installation.
A speech recognizer (optional, only needed if you run TramDemo SR, see below). Currently supported are:
- Nuance Recserver (English.America or Swedish) with NuanceWrapper. The NUANCE environment variable should point to the Nuance installation.
A speech synthesizer (optional, without it you will only get map output, the speech output can be seen in the output window: View -> Show output window). Currently supported:
- Nuance Vocalizer 4.0 (US English), with NuanceWrapper.
- RealSpeak (Swedish), with NuanceWrapper. Set the variable REALSPEAK in tramdemo_win.props to point to the RealSpeak installation.
- FreeTTS. Set FREETTS in tramdemo_{unix,win}.props to point to the FreeTTS installation. You also need FreeTTSAgent. Set FREETTSAGENT in tramdemo_{unix,win}.props to point to the FreeTTSAgent installation.

Running

Start the starter GUI:
Unix:

$ ./tramdemo_speech.sh

Windows:

> ./tramdemo_speech.bat

(First time, or after modifying the input grammars) Compile the speech recognition grammar: Compile English Query GSL Grammar -> Start or Compile Swedish Query GSL Grammar -> Start
Start the Facilitator.
Start the speech recognizer. Start either of these:

Nuance (English)

Start Nuance Recserver license manager and Nuance Recserver (English).

Nuance (Swedish)

Start Nuance Recserver license manager and Nuance Recserver (Swedish).
Start the speech synthesizer. Start either of these:

Nuance Vocalizer (English)

Start Nuance Vocalizer license manager and Nuance Vocalizer (English).

RealSpeak (Swedish)

Start RealSpeak (Swedish).

FreeTTS (English)

Start FreeTTSAgent.
(Only if you use Nuance Recserver, Nuance Vocalizer or RealSpeak) Start NuanceWrapper. Choose English or Swedish depending on the language used for speech recognition and synthesis.
Start GFAgent (used for parsing and linearization).
Start QueryInterpreterAgent (simplifies queries).
Start GraphAgent (calculatess shortest paths).
Start MapAgent (shows the map and receives clicks).
Start the main application agent (a very simple dialogue manager). You can use either of these agents:

TramDemo SR

Uses input from a speech recognizer

TramDemo Text

Gets input from a dialog window.

Building

Requirements for building

To build the system, you need the following system:

GF 2.2. The gf executable should be on the path, or you can set the variable JAVA in the Makefile.
Java JRE 1.5.0. The javac executable should be on the path, or you can set the variable JAVA in the Makefile.
OOA 2.3.0. The environment variable OAA_HOME should point to the OAA installation.
gfc2java. Set the variable GFC2JAVA in the Makefile to point to the gfc2java JAR file.
dialogutil. Set the variable DIALOGUTIL in the Makefile to point to the dialogutil JAR file.

Compiling

Build tramdemo.jar;
```
$ gmake 
```