Tramdemo - a demonstration dialogue system using multilingual
and multimodal grammars
Björn Bringert,
bringert@cs.chalmers.se
Demo Movie
There is a video
of a demo of the Tramdemo system. It is a bit old, and the current
system has a few more features than shown in the video.
Download
Compiled Tramdemo program.
Source code and grammars.
There is a
tramdemo darcs repo with the development version.
Get darcs here.
Documentation
The TALK project
deliverable D1.2a describes the use of multimodal grammars in dialogue
systems. Section 3 of the deliverable details the
grammars used by the tramdemo application.
Running
This section describes how to run the binary version of the system.
If you want to modify the system, see the section Building.
Download
Get the latest
binary
package of the Tramdemo system, and unpack it.
Requirements for running
In order to run the Tramdemo system, you need to have the following software
installed:
-
Java JRE
1.5.0. The java executable should be on the path, or you can
set the variable JAVA in tramdemo_{unix,win}.props (for Unix
and Windows, respectively).
-
OOA 2.3.0.
The environment variable OAA_HOME should point to the OAA installation.
-
A speech recognizer (optional, only needed if you run TramDemo SR, see
below). Currently supported are:
-
Nuance Recserver (English.America or Swedish) with NuanceWrapper.
The NUANCE environment variable should point to the Nuance installation.
-
A speech synthesizer (optional, without it you will only
get map output, the speech output can be seen in the output window:
View -> Show output window). Currently supported:
- Nuance Vocalizer 4.0 (US English), with NuanceWrapper.
- RealSpeak (Swedish), with NuanceWrapper. Set the variable
REALSPEAK in tramdemo_win.props to point to the RealSpeak installation.
- FreeTTS.
Set FREETTS in tramdemo_{unix,win}.props
to point to the FreeTTS installation. You also need
FreeTTSAgent.
Set FREETTSAGENT in tramdemo_{unix,win}.props
to point to the FreeTTSAgent installation.
Running
-
Start the starter GUI:
Unix:
$ ./tramdemo_speech.sh
Windows:
> ./tramdemo_speech.bat
- (First time, or after modifying the input grammars)
Compile the speech recognition grammar:
Compile English Query GSL Grammar -> Start or
Compile Swedish Query GSL Grammar -> Start
- Start the Facilitator.
- Start the speech recognizer. Start either of these:
- Nuance (English)
-
Start Nuance Recserver license manager and
Nuance Recserver (English).
- Nuance (Swedish)
-
Start Nuance Recserver license manager and
Nuance Recserver (Swedish).
-
Start the speech synthesizer. Start either of these:
- Nuance Vocalizer (English)
-
Start Nuance Vocalizer license manager and
Nuance Vocalizer (English).
- RealSpeak (Swedish)
-
Start RealSpeak (Swedish).
- FreeTTS (English)
-
Start FreeTTSAgent.
-
(Only if you use Nuance Recserver, Nuance Vocalizer or RealSpeak)
Start NuanceWrapper. Choose English or Swedish depending on the
language used for speech recognition and synthesis.
- Start GFAgent (used for parsing and linearization).
- Start QueryInterpreterAgent (simplifies queries).
- Start GraphAgent (calculatess shortest paths).
- Start MapAgent (shows the map and receives clicks).
-
Start the main application agent (a very simple dialogue manager).
You can use either of these agents:
- TramDemo SR
- Uses input from a speech recognizer
- TramDemo Text
- Gets input from a dialog window.
Requirements for building
To build the system, you need the following system:
-
GF 2.2.
The gf executable should be on the path, or you can
set the variable JAVA in the Makefile.
-
Java JRE
1.5.0. The javac executable should be on the path, or you can
set the variable JAVA in the Makefile.
-
OOA 2.3.0.
The environment variable OAA_HOME should point to the OAA installation.
-
gfc2java.
Set the variable GFC2JAVA in the Makefile to point to the gfc2java
JAR file.
-
dialogutil.
Set the variable DIALOGUTIL in the Makefile to point to the dialogutil
JAR file.
Compiling
-
Build tramdemo.jar;
$ gmake