Skip to content
sagatake edited this page Oct 7, 2024 · 29 revisions

Table of Contents

Greta: Embodied Conversational Agent

VIDEO EXAMPLE OF GRETA FUNCTIONALITIES!

https://user-images.githubusercontent.com/49474878/132516042-2bdfc9a5-8414-4589-88fd-bf3186221f43.mp4

What is Greta

Greta is a real-time three dimensional embodied conversational agent with a 3D model of a woman compliant with MPEG-4 animation standard. It is able to communicate using a rich palette of verbal and nonverbal behaviours. Greta can talk and simultaneously show facial expressions, gestures, gaze, and head movements.

Two standard XML languages FML and BML allows the user to define her communicative intentions and behaviours based on standard SAIBA architecture.

Greta can be used with different external TTS softwares. Currently she can speak various languages: English, Italian, French, German, Swedish and Polish.

Greta is used in various European projects: ANIMATAS, ARIA-VALUSPA, Council-of-Coaches, ILHAIRE, REVERIE, SSPNet, TARDIS, VERVE, and national French projects: A1:1, Acorformed, Anipev, CECIL,IMMEMO, GV-LEX, Impressions, MOCA, Social-touch, TAPAS (French/English, Japanese). It is integrated in several open-source architectures for human-agent interaction: ARIA-VALUSPA/AVP Aria-Valuspa, SEMAINE, Agents United Plateform, and lately in IAVA.

System demonstrator

You can find the installer of the public version of Greta System (Psyclone version), the installer of the ActiveMQ version for the SEMAINE project and some demo videos.

Content of the wiki pages

The wiki is structured in order to give you enough knowledge to use the Greta platform. As you can see in the sidebar at right the wiki is divided in 2 areas:

  • Getting started with Greta: here you will find tutorials about how install the platform and getting start with it. It will give you a guide in the installation's steps and also examples to how use the platform, generate gestures, facial expressions, hand shapes and instances for interacion;
  • Functionalities: in this section you will have more details about the modules of the platform, what are thier functionalities and how to use them;
Note that the code in the github is divided in 2 main branches:
  • master: is the main version, under GPL licence since September 2024, that contains all the latest modifications (Download this);
  • master-lgpl: is the LGPL version, the previous master branch before September 2024. Some of the latest functionalities might not be included.

Communication ports (Last updated: 2 October, 2024)

List of ports

Port Connection (left: server, right: client) Comment
1234 LM-studio - Mistral.py when you run LLM locally
3150 meaning_miner_adapter_server.py - meaning_miner_adapter_client.py MeaningMiner
4000 Mistral.java - Mistral.py Mistral LLM
4040 DeepGramFrame.java - DeepGram.py DeepGram ASR
4444 ASAPFrame.java -[actual].py ASAP
5000 OpenFaceOfflineZeroMQ.exe - any TurnManagement, feedback
5960 turnManagement.java - turnManager.py TurnManagement, feedback
5961 turnManagement.java - turnManager.py TurnManagement, turnManagement
8087 SpeechRecognizerFrame.java - nothing GoogleASR receiver
8088 SpeechRecognizerFrame.java - nothing GoogleASR receiver
9000 mic_server.py - any Microphone
50150 OpenFaceOfflineZeroMQ.java- RealTimePipeFinal.py MODIFF-MI
50151 RealTimePipeFinal.py - ASAPFrame.java MODIFF-MI
50167 MICounserlorIncrementalDA - Drinking.py - RealTimePipeFinal.py MODIFF-MI
50168 MICounserlorIncrementalDA - Drinking.py - RealTimePipeFinal.py MODIFF-MI
50200 “MICounserlorIncrementalDA - Drinking.py” - any MI
61616 Broker.java - any ActiveMQ

Note

  • MODIFF-MI: adaptive facial expression
  • MI: motivational interview
  • MM: meaning miner

Getting started with Greta

Greta Architecture

Quick start

Advanced

Functionalities

Core functionality

Auxiliary functionalities

Preview functionality

Nothing to show here

Previous functionality (possibly it still works, but not supported anymore)

Clone this wiki locally