User:Sebastian Berlin (WMSE)/tmp

Integration with TTS-server


Documentation

The extension uses a service for TTS operations, such as creating audio for utterances. This TTS server consists of a main server, a lexicon server, TTS engines and any additional components that may be required for certain languages.

To prepare an utterance for playing, the extension sends a request to the server. This request contains the utterance as text the and which language it is in. The server processes the text using a lexicon and one of the installed TTS engines, depending on what voice is being used. Once the audio has been generated, a response is returned with a URL to the audio file along with some information that will enable highlighting and skipping. This is then used by the extension to actually play the utterance to the user and the process is repeated for the following utterances as needed.

Main Wikispeech Server
Repo

The main server has a web API that includes an endpoint for generating speech. It handles internal communication between the underlying servers, listed below.

Pronlex
Repo

A lexicon server with its own API. Holds information about lexicon entries and has endpoints for lookup and manipulation of them. When processing an utterance, words are looked up in the lexicon and if there is a matching entry it is used for the pronunciation.

TTS engines
The server supports having multiple TTS engines. Which one is used for a certain utterance depends on which voice is given in the request.

MaryTTS
Repo

Comes with support for Arabic, English and Swedish.

Mishkal
Repo

Used to vocalize Arabic text.