A third EDRM data set is now available, the EDRM Internationalization Data Set.
The data set currently consists of a snapshot of selected Ubuntu localization mailing list archives covering 23 languages in 724 MB of email.
Contents: Ubuntu Localization Mailiing List Archives
Version 1.0 of this data set includes email from the Ubuntu localization email lists. Email in this data set has the following characteristics:
- Email Format: The email is in MIME format
- Archive Format: The individual email messages are in Mbox files
- Encodings: A variety of encodings are used in the email including UTF-8 and language specific encodings.
- Thread Information: Thread information is carried in the References header described in IETF RFC 5322, 2822, and 822.
The individual files are located in the data-sets sub-directory and are as follows:
| No. | Language | Filename | Size | MD5 Hash |
| 1 | Arabic | ubuntu-l10n-ara.mbox | 460 KB | 188ff0562b3f19ac9d27f593e42b12bf |
| 2 | Catalan | ubuntu-l10n-ca.mbox | 12.5 MB | 496b0423c78e34dedcb6cbb74cc79dee |
| 3 | Chinese | ubuntu-zh.mbox | 18.1 MB | 66ee3f59e22db673a44039032668ee2b |
| 4 | Danish | ubuntu-dk.mbox | 7.6 MB | 455859067abc2bcf3751510ca42a18dd |
| 5 | Dutch | ubuntu-nl.mbox | 28.3 MB | d6898d6ef3ee510f37da0eb0f14f0a7d |
| 6 | 6. Finnish | ubuntu-fi.mbox | 3.8 MB | 759f705f082fea8d39a1d28fa78b06d1 |
| 7 | French | ubuntu-fr.mbox | 98.0 MB | 125bf18ea59fff8a01bc7053ed2e9fd9 |
| 8 | German | ubuntu-de.mbox | 52.8 MB | f132ac11770c0d1910929321bf2f3e98 |
| 9 | Greek | ubuntu-gr.mbox | 62.0 MB | 11d813616ee29ff44c77803a05e8e083 |
| 10 | Hebrew | ubuntu-il.mbox | 3.0 MB | e11dc6deeb199d4fde8d3701b41433d2 |
| 11 | Hungarian | ubuntu-hu.mbox | 15.7 MB | 6aef6743d192aa8d375c269f92f08dd8 |
| 12 | Italian | ubuntu-it.mbox | 121.0 MB | 9017477d47bf5df2bc90b28862a4d459 |
| 13 | Japanese | ubuntu-jp.mbox | 6.2 MB | 7d6a2e76d47f61e3df38a02411b8b7dc |
| 14 | Korean | ubuntu-ko.mbox | 4.6 MB | fe0258196f2a16a0c78ee495b5d5ceae |
| 15 | Norweigan | ubuntu-no.mbox | 1.2 MB | 3fefc955d5361e653f1e38bea10c9a99 |
| 16 | Polish | ubuntu-pl.mbox | 11.9 MB | 31848efb067e95cd125db6cdc09d9676 |
| 17 | Portuguese | ubuntu-pt.mbox | 40.6 MB | 52f9713e950788bd24a37fa82a0d3246 |
| 18 | Romanian | ubuntu-ro.mbox | 8.3 MB | e8babafe832b02483cde01440ef16d2c |
| 19 | Russian | ubuntu-ru.mbox | 52.5 MB | 83e1624bd55e1faef0bba563ec0905cc |
| 20 | Spanish | ubuntu-es.mbox | 137.0 MB | 476aaed127f5d6054e0d14e8a57a567b |
| 21 | Swedish | ubuntu-se.mbox | 21.3 MB | 0a2660adaa6062787acf1d6d35d698d0 |
| 22 | Tamil | ubuntu-tam.mbox | 10.1 MB | 8419008f1a76a8837626813c207e4ae5 |
| 23 | Turkish | ubuntu-tr.mbox | 8.1 MB | 1eff19455427184e9d055f1b81db283a |
Credits
Ubuntu mailing list files are courtesy of Ubuntu.
The latest files can be downloaded from: http://lists.ubuntu.com.
