A. Creation of the PLS dictionary:

1. Get spelling dictionary.
2. License is GPL. It says in the file README_en.txt:

This spell check dictionary for Interlingua is licensed under GPL. [...] This hyphenation rules for Interlingua are licensed under GPL.

This means that I can use this spelling dictionary as source.
3. Extract dict-ia-2010-11-29.oxt.
4. ISO 639-1 language code is ia.
5. Probably I will use this table for grapheme to phoneme conversion.

6. Check the encoding of ia_iso.aff and ia_iso.dic. Both files are encoded in ISO 8859-1. Probably it is best if I convert the encoding of both files into UTF-8.
iconv -f ISO-8859-1 -t UTF-8 < ia_iso.dic > interlingua-utf8.dic
iconv -f ISO-8859-1 -t UTF-8 < ia_iso.aff > interlingua-utf8.aff
Change the first line in interlingua-utf8.aff into SET UTF-8. Both files contain CRLF at the end of each line (Windows mode). I don’t know whether this is ok with the unmunch command. I will check it out:

ubuntu@ubuntu:~/Documents/2011-II/Interlingua$ unmunch interlingua-utf8.dic interlingua-utf8.aff > interlingua-wordlist

Obviously, it worked. The CRLF is part of the source files. The target file contains just a LF (Unix mode). There are a lot of duplicate entries. I think that these duplicate entries will be removed later by an .xsl script.

7. Add lexicon tags at the beginning and the end of interlingua-wordlist.

8. Create XML file:

ubuntu@ubuntu:~/Documents/2011-II/Interlingua$ saxonb-xslt -s:interlingua-wordlist -xsl:'http://spirit.blau.in/simon/files/2010/04/create-xml-file.xsl' -o:interlingua.xml

9. Create PLS dictionary:

ubuntu@ubuntu:~/Documents/2011-II/Interlingua$ saxonb-xslt -s:interlingua.xml -xsl:'improve-interlingua.xsl' -o:interlingua-dictionary.xml

B. Download the dictionary. Import it into simon.

The left column contains the words. The pronunciation column contains the corresponding SAMPA transcriptions. The Category column contains just “Unknown” entries.

Now you know how I created the dictionary and how the result looks like in simon.

A. Creation of the dictionary:

1. Get Arabic spelling dictionary.
2. Check the license. Inside the file dict_ar-3.0.oxt there is a file with the name COPYING (in the docs folder). It says in the file:

GPL 2.0/LGPL 2.1/MPL 1.1 tri-license

This means that I can use this tri-licensed spelling dictionary as source for my future GPLv3 PLS dictionary.

3. Now I have to extract dict_ar-3.0.oxt.
4. Let’s try the unmunch command inside the Ubuntu terminal:

ubuntu@ubuntu:~/Documents/2011-II/Arabic$ unmunch ar.dic ar.aff > arabic

It failed. I wasn’t able to unmunch the word list.
5. I have to remove all numbers from ar.dic. This can be done with the sed command:

sed 's/[0-9]*//g' ar.dic > arabic-without-numbers

6. Remove the slash (“/”) from arabic-without-numbers with Geany.
7. Add lexicon tags at the beginning and the end of the file.
8. Ubuntu terminal:

ubuntu@ubuntu:~/Documents/2011-II/Arabic$ saxonb-xslt -s:arabic-without-numbers -xsl:'http://spirit.blau.in/simon/files/2010/04/create-xml-file.xsl' -o:arabic.xml

9. ISO 639-1 language code is ar.
10. Maybe I will use this table for the grapheme to phoneme conversion.
11. Ubuntu terminal:

ubuntu@ubuntu:~/Documents/2011-II/Arabic$ saxonb-xslt -s:arabic.xml -xsl:'improve-arabic.xsl' -o:arabic-dictionary.xml

I have to remove the number sign (“#”) with Geany from arabic.xml.

B. Download the dictionary. Import it into simon.

The left column contains 457089 Arabic words. The pronunciation column contains the corresponding SAMPA transcriptions. The third column contains just entries with “Unknown”. This is because the PLS dictionary contains no role attributes.

Now you know how I created the dictionary. And you know how the result looks like in simon.

A. Creation of the dictionary:

1. Get Hebrew spelling dictionary from OpenOffice.org.
2. License is GPL. There is a copyright notice inside the file he_IL.aff.

3. I tried to unmunch the dictionary in the Ubuntu terminal, but unfortunately I failed:

ubuntu@ubuntu:~/Documents/2011-II/Hebrew$ unmunch he_IL.dic he_IL.aff > hebrew-test

4. The source file he_IL.dic contains a lot of numbers. I remove them with the Ubuntu terminal:

ubuntu@ubuntu:~/Documents/2011-II/Hebrew$ sed 's/[0-9]*//g' he_IL.dic > hebrew-without-numbers

With Geany, I remove the “,” (commas) and the “/” (slashes) that still are included within in the file hebrew-without-numbers. Now I have a clean word list with 43.000 Hebrew words.

5. Add lexicon tags at the beginning and the end of hebrew-without-numbers.
6. Ubuntu terminal:

ubuntu@ubuntu:~/Documents/2011-II/Hebrew$ saxonb-xslt -s:hebrew-without-numbers -xsl:'http://spirit.blau.in/simon/files/2010/04/create-xml-file.xsl' -o:hebrew.xml

7. ISO 639-1 language code is he.
8. I need a table for grapheme to phoneme conversion. Maybe I will use this table. There are several tables available at Wikipedia. I am not sure which one I should use. I have an idea: as far as I know, Yiddish and Hebrew share the same alphabet. This means I could try to use the Yiddish improve-yiddish.xsl style sheet:

ubuntu@ubuntu:~/Documents/2011-II/Hebrew$ saxonb-xslt -s:hebrew.xml -xsl:'/home/ubuntu/Documents/2011-II/Yiddish/dictionaries/improve-yiddish.xsl' -o:hebrew-dictionary.xml

The result is that most Hebrew letters have been converted into IPA. There is only one Hebrew letter that hasn’t been converted: [א] I will add this phone to the .xsl style sheet with the name improve-hebrew.xsl. Now I try it again:

ubuntu@ubuntu:~/Documents/2011-II/Hebrew$ saxonb-xslt -s:hebrew.xml -xsl:'improve-hebrew.xsl' -o:hebrew-dictionary.xml

The result is not so good: Maybe I should adjust the grapheme to phoneme conversion rules for modern standard Israeli Hebrew. Or is this not necessary? I think for a first draft I can use the Yiddish transformation rules.

B. Download the dictionary. Import it into simon as shadow dictionary.

Take a look at the result: The left column contains 43933 Hebrew words. The pronunciation column contains the corresponding SAMPA transcriptions. The category column is unemployed (or to be more exact: displays just Unknown) since the source PLS dictionary contains no role attributes.

Now you know how I created the dictionary. And you know how the result looks like in simon. This dictionary uses more or less Yiddish pronunciation because I was too lazy to adjust it to modern standard Israeli Hebrew. It shouldn’t be a problem to adjust the style sheet improve-hebrew.xsl so that the phoneme results are better.

A. How I create Ralf's Yiddish dictionary:

1. Get spelling dictionary.
2. License is GPLv3.
3. Extract jidysz.net.ooo.spellchecker.oxt.
4. Ubuntu terminal:
cd /home/ubuntu/Documents/2011-II/Yiddish/dictionaries
sudo apt-get install hunspell-tools
unmunch yi.dic yi.aff > yiddish-wordlist
5. Add <lexicon> at the beginning of yiddish-wordlist. Add </lexicon> at the end of this file.
6. Generate .xml document with lexicon, lexeme and grapheme elements:

ubuntu@ubuntu:~/Documents/2011-II/Yiddish/dictionaries$ saxonb-xslt -s:yiddish-wordlist -xsl:'http://spirit.blau.in/simon/files/2010/04/create-xml-file.xsl' -o:yiddish.xml

7. ISO 639-1 language code is yi.
8. I think I will use this table as source for the grapheme to phoneme mapping.
9. Ubuntu terminal:

ubuntu@ubuntu:~/Documents/2011-II/Yiddish/dictionaries$ saxonb-xslt -s:yiddish.xml -xsl:'improve-yiddish.xsl' -o:yiddish-dictionary.xml

B. Download the dictionary, and import it into simon.

Take a look at the result. The left column contains the Yiddish words. This dictionary contains 99980 words. The right column contains the corresponding SAMPA transcription.
Yiddish is written in the Hebrew alphabet. The Hebrew alphabet is written from right to left. Obviously, the corresponding SAMPA transcriptions are written from left to right. This means that the phoneme order should be fine.

There are a lot of other PLS dictionaries available. Find the PLS dictionary that suits your language.

1. Import Schott’s German dictionary as active dictionary into simon.

2. Open the Grammar tab. Press the Import button.

3. Simon starts a wizard. Press the Next button.

4. Let’s try and check the option Also import unknown sentences. I don’t know whether this is a good decision. So let’s give it a try.
This is interesting: “words with more than one terminal” – is it now possible to use more than one entry for the role attribute? The current version of Schott’s German dictionary employs just one entry for each role attribute. The PLS standard allows more entries.
Please, download and extract Schott’s German utterances. This compressed folder 15000-german-utterances.zip contains a plain text file with more than 15000 utterances. I am the author of these utterances, and I have licensed them under the GPLv3. The utterances are designed to be used in conjunction with Schott’s German dictionary (former name: Ralf’s German dictionary). Every word that is included within Schott’s German utterances should be included in Schott’s German dictionary, too. I am 99% sure that this is the case, but I can’t guarantee it. If some words are missing in Schott’s German dictionary, please inform me, and I will include them within the next version of Schott’s German dictionary.
You can import my German utterances using simon’s Import Text option (copy & paste).

5. The import has been completed. There are a lot of lines that contain the Unknown terminal. Probably it would have been better if I wouldn’t have checked the option Also import unknown sentences in step 4.

6. Because simon didn’t react any more, I forced it to quit. I tried to start simon several times, but it wouldn’t start. Now there are several simon zombie statuses displayed. I was able to end these zombie / sleeping processes. But at the moment, it seems to be impossible to start simon again (a new zombie / sleeping status is beeing created if I try to start simon again).

Conclusion: I don’t recommend to check the option Also import unknown sentences. I tried the import Grammar function before without checking this option. Simon reacted normal, everything seemed to be fine.

Click here to view the video on YouTube.

These are the words that were recognized in the video:

Randschicht Randproblem Randprobleme Randproblemen Randproblems Randpunkt Randsportart Randstellung Randträger Rechenvorrichtung Randwerbung Randwinkel Randträger Randzone Rangabzeichen Rangabzeichens Rangelei Rangfolgen Rangliste Ranglisten Rangordnung Rangordnungen Ranguns Rangstufe Rangstufen Rappe Ratte Rapport Rapporte Rapporten Rapports Rapsfeld Rapsfelder Rapsfeldern Rapsfelds Rasenfläche Rassenkämpfen Rasenloch Rasenplätze Rasenplatz Rasenplätze Rasenplätzen Rasensport Rasenstück Rasentraktor Rasentrimmer Raserei Rasereien Rasierapparat Rasierapparaten Rasierapparats Rasierer Rasierklinge Rasierpinsel Rasierschaum Rasierseife Rasierwasser Rasierzeug Rasmussen Raspe Raspeln Rassenhass Rassenhasses Rassenkampf Rassenkonflikt Rassenkrawall Rassenkunde Rassenkämpfe Rassenkämpfen Rassenmischung Rassenmischungen Rassenproblem Rassenprobleme Rassentrennung Rassenunruhen Rassepferd Rastalocken Rastblech Rastdorn Rastdorne Rasterbild Rasterdecke Rasterdruck Rasterelektronenmikroskop Rasterfahndung Rasterfahndungen Rastergestaltung Rastermaße Rastermaßen Rastermaßes Rastern Rasterpapier Rasterpunkt Rasterpunktabfühlung Rasterpunktlesen Rasters Rasterung Rasterweite Rasterweiten Rastkappe Rastkontakt Rastlappen Rastlosigkeit Rastmechanismus Rastmoment Rastmontage Rastplatz Rastplätze Rastplätzen Rastpunkt Raststätten Rasur Ratifikationen Ratifikationsurkunde Ratifikationsurkunden Ratifizierens Ratifizierung Ratifizierungen Ratifizierungsdebatte Rechnerbaugruppe Ratingen Ration Rationalisieren Rationalisierens Rationalisierung Rationalisierungen Rationalisierungsdruck Rationalismus Rationalist Rationalisten Rationalität Rationen Rationierens Rationierung Rationierungen Ratlosigkeit Rasanz Ratsamkeit Ratsbeschluss Ratsbeschlusses Ratschlag Ratschlags Ratspräsidenten Ratspräsident Ratsmitgliedern Ratsmitglieder Ratsmitglied Ratsherren Ratsche Ratssitzung Ratssitzungen Ratstisch Ratsvorsitz Ratsvorsitzende Randverbinder Rattenfleckfieber Rattenfänger Rattengift Rattenhaus Rattenkönig Rattenloch Rattenloches Rattenplage Rattenschwanz Rattermarken Ratzinger Rauchkammer Rauch Rauchabzug Rauchbombe Rauchens Rauchen Raucher Raucherinsel Rauchern Rauchgas Raucherzimmer Raucherzone Rauchers Rauchfahne Rauchfang Rauchfass Rauchfleisch Rauchgas Rauchgasfilter Rauchgasfühler Rauchgaskanal Rauchgaswäsche Rauchgaszug Rauchgenuss Rauchgenusses Rauchglas Rauchigkeit Rauchkammer Rauchmaschine Rauchmelder Rauchpilz Rauchschwaden Rauchsäule Rauchsäulen Rauchverbot Rauchvergiftung Rauchverzehrer Rauchverzicht Rauchvorhang Rauchwand braven Raudi Rauchpilz Raufbold Rauferei Raufhandel Rauflustigkeit Raufrost Rauheiten Rauheit Rauheitsbeiwert Rauheitsbestimmung Rauhut Raum Raumabtrennung Raumakustik Raumangst Raumanzug Raumaufteilung Raumaufteilungen Raumausstatter Raumbedarfs Raumbelastung Ratsmitgliedern Raumbereich Raumbereichen Raumbereichs Raumbuch Raumfahrtagentur Raumfahrtbehörde Raumtransport Raumtransport Raumfahrtkonzern Raumfahrtkonzerns Raumfahrtprogramm Raumfahrtsparte Raumfahrttechnik Raumfahrzeuge Raumfahrzeuge Raumflug Raumflugs Raumforscher Raumforschung Raumfähre Raumgeräuschpegel Raumgeschwindigkeit Raumgestaltung Raumgewicht Raumgruppe Raumhöhe Rauminhalt Raumkapsel Raumkelle Raumklima Raumladung Raumlufttechnik Raummangel Raummaß Raumordnung Raumordnungsverfahrens Raumpfleger Raumpflegerin Raumplanung Raumprogramm Raumrichtung Raumschiff Raumschiffen Raumschiffes Raumthermostat Raumverhältnis Raumverhältnisse Raumverhältnissen Raumverhältnisses Raumwinkel Raumzeitalter Raute Rauchwaren Raupenantrieb Raupenantrieben Raupenbagger Rauschebart Rauschens Rauschgift Rauschgiftdezernat Rauschgifte Rauschgiftsucht Rauschgiftverbot Rauschgold Rauschgoldengel Rauschmittel Rauschpegel Rauschpegels Rauschunterdrückung Rauschuntergrund Rauschuntergrunds Rausschmeißer Rauschgifts Rausschmisse Raupentrieb Rauchzeichen Randwähler Ravennas Reagenzglases Reagenzgläser Reagenzpapier Reaktionsmöglichkeiten

A lot of words were recognized correctly. That is not a bad result.

ubuntu@ubuntu:~/Documents/2011-II/speech2text/build$ sudo make uninstall

Then download of simon_0.3.0-1ubuntu8_amd64.deb. Then I installed this version with Ubuntu Software Center.

I want to export the following information: Filename, Expected result, Actual result, Recognition rate (below 50%). The resulting document should be a simple text file (or XML file or whatever). Is this possible with the current Export test result function of simon?

ubuntu@ubuntu:~/Documents/2011-II/speech2text$ sudo add-apt-repository ppa:grasch-simon-listens/simon

Then I typed into the Ubuntu terminal:

ubuntu@ubuntu:~/Documents/2011-II/speech2text$ sudo apt-get update

And then the following message appeared:

[...] W: Failed to fetch http://ppa.launchpad.net/grasch-simon-listens/simon/ubuntu/dists/natty/main/source/Sources 404 Not Found

W: Failed to fetch http://ppa.launchpad.net/grasch-simon-listens/simon/ubuntu/dists/natty/main/binary-amd64/Packages 404 Not Found

Then I took a look into http://ppa.launchpad.net/grasch-simon-listens/simon/ubuntu/dists/. Obviously there isn’t a directory called natty.

I want to get the newest version of simon/sam. Where can I find it?
–> It is not here. This version is from October 2010.
–> At ppa.launchpad.net/grasch-simon-listens/ I find only versions made for lucid and maverick.
–> I wasn’t successful with git because some problem with qwt 6 came up.

I want to see whether the newest version of sam has an ‘Export test results’ button.