The SAWA Corpus - A parallel Corpus English - Swahili

•Transferir como PPT, PDF•

1 gostou•1,003 visualizações

Guy De Pauw

by Guy De Pauw, Peter Waiganjo Wagacha and Gilles-Maurice de Schryver

Tecnologia

The SAWA Corpus A Parallel Corpus English - Swahili Guy De Pauw (guy.depauw@aflat.org) Peter Waiganjo Wagacha (waiganjo@aflat.org) Gilles-Maurice de Schryver (gillesmaurice.deschryver@aflat.org)

Resource-scarceness ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Data-driven approaches ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Machine Translation ,[object Object],[object Object],[object Object],[object Object],data-driven Learn translation from examples: !! Parallel corpus !!

Parallel Corpus ,[object Object],[object Object],[object Object]

Example ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

3 phases ,[object Object],[object Object],[object Object],[object Object],[object Object]

Data Collection ,[object Object],[object Object],[object Object],[object Object],[object Object]

Data Collection ,[object Object],[object Object]

[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Available data in SAWA Corpus All manually sentence aligned! English Sentences Kiswahili Sentences English Words Kiswahili Words New Testament 16.4k 16.3k 189.2k 151.1k Quran 14.3k 14.5k 165.5k 124.3k Declaration of HR 0.2k 1.8k 1.8k Kamusi.org 5.6k 35.5k 26.7k Movie Subtitles 9.0k 72.2k 58.4k Investment Reports 3.2k 3.1k 52.9k 54.9k Local Translator 1.5k 1.6k 25.0k 25.7k Total 50.2k 50.3k 542.1k 442.9k

Available data in SAWA Corpus All manually sentence aligned! Thanks to Mahmoud Shokrollahi-Far University College of Nabiye Akram (Iran) English Sentences Kiswahili Sentences English Words Kiswahili Words New Testament 16.4k 16.3k 189.2k 151.1k Quran 14.3k 14.5k 165.5k 124.3k Declaration of HR 0.2k 1.8k 1.8k Kamusi.org 5.6k 35.5k 26.7k Movie Subtitles 9.0k 72.2k 58.4k Investment Reports 3.2k 3.1k 52.9k 54.9k Local Translator 1.5k 1.6k 25.0k 25.7k Total 50.2k 50.3k 542.1k 442.9k

Available data in SAWA Corpus All manually sentence aligned! Thanks to Dr. James Omboga Zaja University of Nairobi English Sentences Kiswahili Sentences English Words Kiswahili Words New Testament 16.4k 16.3k 189.2k 151.1k Quran 14.3k 14.5k 165.5k 124.3k Declaration of HR 0.2k 1.8k 1.8k Kamusi.org 5.6k 35.5k 26.7k Movie Subtitles 9.0k 72.2k 58.4k Investment Reports 3.2k 3.1k 52.9k 54.9k Local Translator 1.5k 1.6k 25.0k 25.7k Total 50.2k 50.3k 542.1k 442.9k

Word alignment ,[object Object],No she ‘ s uh , , up north La , , , yuko , aa juu kaskazini

Word alignment You caught me skiving , I ‘ m afraid . Samahani , umenidaka nikihepa .

Word alignment ,[object Object],[object Object]

Current results ,[object Object],Precision Recall F (  =1) 39.4% 44.5% 41.79%

Alignment problems nimemkatalia have turned him down I

Morphological decomposition have turned him down I ni+ me+ m+ katalia

Current results ,[object Object],[object Object],Precision Recall F (  =1) 50.2% 64.5% 55.8%

Future work ,[object Object],[object Object],[object Object]

Future work ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Conclusion ,[object Object],[object Object],[object Object],[object Object]

Mais conteúdo relacionado

Semelhante a The SAWA Corpus - A parallel Corpus English - Swahili

Writing Template With Drawing Box. Online assignment writing service.Jeanne Hall

CASL Report1TEDxBaltimore

Essay On Down Syndrome.pdfChristina Morgan

Essay On Down Syndrome.pdfJenn Cooper

How To Write An Essay On Your Ipad. Online assignment writing service.Amy Cruz

Doc106Dr Lendy Spires

Writing To Inform - Poverty - GCSE English - Marked By Teachers.ComNicole Gomez

Examples Of Informal Essay. Fantastic Informal Essay ThatsnotusHeidi Marshall

Essay Writers Online.pdfVictoria Coleman

Essay Writers Online. College essay: Professional essay writers onlineYngris Seino

Essay On ReligionRobin Ortiz

SEND HANDHAKES I WILL PICK3POINTSWhat do you consider the .docxlorileemcclatchie

Semelhante a The SAWA Corpus - A parallel Corpus English - Swahili (12)

Writing Template With Drawing Box. Online assignment writing service.

CASL Report1

Essay On Down Syndrome.pdf

How To Write An Essay On Your Ipad. Online assignment writing service.

Doc106

Writing To Inform - Poverty - GCSE English - Marked By Teachers.Com

Examples Of Informal Essay. Fantastic Informal Essay Thatsnotus

Essay Writers Online.pdf

Essay Writers Online. College essay: Professional essay writers online

Essay On Religion

SEND HANDHAKES I WILL PICK3POINTSWhat do you consider the .docx

Mais de Guy De Pauw

Technological Tools for Dictionary and Corpora Building for Minority Language...Guy De Pauw

Semi-automated extraction of morphological grammars for Nguni with special re...Guy De Pauw

Resource-Light Bantu Part-of-Speech TaggingGuy De Pauw

Natural Language Processing for Amazigh LanguageGuy De Pauw

POS Annotated 50m Corpus of Tajik LanguageGuy De Pauw

The Tagged Icelandic Corpus (MÍM)Guy De Pauw

Describing Morphologically Rich Languages Using Metagrammars a Look at Verbs ...Guy De Pauw

Tagging and Verifying an Amharic News CorpusGuy De Pauw

A Corpus of SantomeGuy De Pauw

Automatic Structuring and Correction Suggestion System for Hungarian Clinical...Guy De Pauw

Compiling Apertium Dictionaries with HFSTGuy De Pauw

The Database of Modern Icelandic InflectionGuy De Pauw

Learning Morphological Rules for Amharic Verbs Using Inductive Logic ProgrammingGuy De Pauw

Issues in Designing a Corpus of Spoken IrishGuy De Pauw

How to build language technology resources for the next 100 yearsGuy De Pauw

Towards Standardizing Evaluation Test Sets for Compound AnalysersGuy De Pauw

The PALDO Concept - New Paradigms for African Language Resource DevelopmentGuy De Pauw

A System for the Recognition of Handwritten Yorùbá CharactersGuy De Pauw

IFE-MT: An English-to-Yorùbá Machine Translation SystemGuy De Pauw

A Number to Yorùbá Text Transcription SystemGuy De Pauw

Mais de Guy De Pauw (20)

Technological Tools for Dictionary and Corpora Building for Minority Language...

Semi-automated extraction of morphological grammars for Nguni with special re...

Resource-Light Bantu Part-of-Speech Tagging

Natural Language Processing for Amazigh Language

POS Annotated 50m Corpus of Tajik Language

The Tagged Icelandic Corpus (MÍM)

Describing Morphologically Rich Languages Using Metagrammars a Look at Verbs ...

Tagging and Verifying an Amharic News Corpus

A Corpus of Santome

Automatic Structuring and Correction Suggestion System for Hungarian Clinical...

Compiling Apertium Dictionaries with HFST

The Database of Modern Icelandic Inflection

Learning Morphological Rules for Amharic Verbs Using Inductive Logic Programming

Issues in Designing a Corpus of Spoken Irish

How to build language technology resources for the next 100 years

Towards Standardizing Evaluation Test Sets for Compound Analysers

The PALDO Concept - New Paradigms for African Language Resource Development

A System for the Recognition of Handwritten Yorùbá Characters

IFE-MT: An English-to-Yorùbá Machine Translation System

A Number to Yorùbá Text Transcription System

Último

TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc

AWS Community Day CPH - Three problems of TerraformAndrey Devyatkin

Histor y of HAM Radio presentation slidevu2urc

Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUK Journal

Automating Google Workspace (GWS) & more with Apps Scriptwesley chun

ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProduct Anonymous

GenAI Risks & Security Meetup 01052024.pdflior mazor

HTML Injection Attacks: Impact and Mitigation StrategiesBoston Institute of Analytics

presentation ICT roal in 21st century educationjfdjdjcjdnsjd

Real Time Object Detection Using Open CVKhem

Scaling API-first – The story of a global engineering organizationRadu Cotescu

Axa Assurance Maroc - Insurer Innovation Award 2024The Digital Insurer

The 7 Things I Know About Cyber Security After 25 Years | April 2024Rafal Los

Artificial Intelligence: Facts and MythsJoaquim Jorge

A Domino Admins Adventures (Engage 2024)Gabriella Davis

🐬 The future of MySQL is Postgres 🐘RTylerCroy

Boost Fertility New Invention Ups Success Rates.pdfsudhanshuwaghmare1

Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...apidays

TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc

Driving Behavioral Change for Information Management through Data-Driven Gree...Enterprise Knowledge

The SAWA Corpus - A parallel Corpus English - Swahili

1. The SAWA Corpus A Parallel Corpus English - Swahili Guy De Pauw (guy.depauw@aflat.org) Peter Waiganjo Wagacha (waiganjo@aflat.org) Gilles-Maurice de Schryver (gillesmaurice.deschryver@aflat.org)

10.

11.

12. Available data in SAWA Corpus All manually sentence aligned! English Sentences Kiswahili Sentences English Words Kiswahili Words New Testament 16.4k 16.3k 189.2k 151.1k Quran 14.3k 14.5k 165.5k 124.3k Declaration of HR 0.2k 1.8k 1.8k Kamusi.org 5.6k 35.5k 26.7k Movie Subtitles 9.0k 72.2k 58.4k Investment Reports 3.2k 3.1k 52.9k 54.9k Local Translator 1.5k 1.6k 25.0k 25.7k Total 50.2k 50.3k 542.1k 442.9k

13. Available data in SAWA Corpus All manually sentence aligned! English Sentences Kiswahili Sentences English Words Kiswahili Words New Testament 16.4k 16.3k 189.2k 151.1k Quran 14.3k 14.5k 165.5k 124.3k Declaration of HR 0.2k 1.8k 1.8k Kamusi.org 5.6k 35.5k 26.7k Movie Subtitles 9.0k 72.2k 58.4k Investment Reports 3.2k 3.1k 52.9k 54.9k Local Translator 1.5k 1.6k 25.0k 25.7k Total 50.2k 50.3k 542.1k 442.9k

14. Available data in SAWA Corpus All manually sentence aligned! Thanks to Mahmoud Shokrollahi-Far University College of Nabiye Akram (Iran) English Sentences Kiswahili Sentences English Words Kiswahili Words New Testament 16.4k 16.3k 189.2k 151.1k Quran 14.3k 14.5k 165.5k 124.3k Declaration of HR 0.2k 1.8k 1.8k Kamusi.org 5.6k 35.5k 26.7k Movie Subtitles 9.0k 72.2k 58.4k Investment Reports 3.2k 3.1k 52.9k 54.9k Local Translator 1.5k 1.6k 25.0k 25.7k Total 50.2k 50.3k 542.1k 442.9k

15. Available data in SAWA Corpus All manually sentence aligned! English Sentences Kiswahili Sentences English Words Kiswahili Words New Testament 16.4k 16.3k 189.2k 151.1k Quran 14.3k 14.5k 165.5k 124.3k Declaration of HR 0.2k 1.8k 1.8k Kamusi.org 5.6k 35.5k 26.7k Movie Subtitles 9.0k 72.2k 58.4k Investment Reports 3.2k 3.1k 52.9k 54.9k Local Translator 1.5k 1.6k 25.0k 25.7k Total 50.2k 50.3k 542.1k 442.9k

16. Available data in SAWA Corpus All manually sentence aligned! English Sentences Kiswahili Sentences English Words Kiswahili Words New Testament 16.4k 16.3k 189.2k 151.1k Quran 14.3k 14.5k 165.5k 124.3k Declaration of HR 0.2k 1.8k 1.8k Kamusi.org 5.6k 35.5k 26.7k Movie Subtitles 9.0k 72.2k 58.4k Investment Reports 3.2k 3.1k 52.9k 54.9k Local Translator 1.5k 1.6k 25.0k 25.7k Total 50.2k 50.3k 542.1k 442.9k

17. Available data in SAWA Corpus All manually sentence aligned! English Sentences Kiswahili Sentences English Words Kiswahili Words New Testament 16.4k 16.3k 189.2k 151.1k Quran 14.3k 14.5k 165.5k 124.3k Declaration of HR 0.2k 1.8k 1.8k Kamusi.org 5.6k 35.5k 26.7k Movie Subtitles 9.0k 72.2k 58.4k Investment Reports 3.2k 3.1k 52.9k 54.9k Local Translator 1.5k 1.6k 25.0k 25.7k Total 50.2k 50.3k 542.1k 442.9k

18. Available data in SAWA Corpus All manually sentence aligned! English Sentences Kiswahili Sentences English Words Kiswahili Words New Testament 16.4k 16.3k 189.2k 151.1k Quran 14.3k 14.5k 165.5k 124.3k Declaration of HR 0.2k 1.8k 1.8k Kamusi.org 5.6k 35.5k 26.7k Movie Subtitles 9.0k 72.2k 58.4k Investment Reports 3.2k 3.1k 52.9k 54.9k Local Translator 1.5k 1.6k 25.0k 25.7k Total 50.2k 50.3k 542.1k 442.9k

19. Available data in SAWA Corpus All manually sentence aligned! Thanks to Dr. James Omboga Zaja University of Nairobi English Sentences Kiswahili Sentences English Words Kiswahili Words New Testament 16.4k 16.3k 189.2k 151.1k Quran 14.3k 14.5k 165.5k 124.3k Declaration of HR 0.2k 1.8k 1.8k Kamusi.org 5.6k 35.5k 26.7k Movie Subtitles 9.0k 72.2k 58.4k Investment Reports 3.2k 3.1k 52.9k 54.9k Local Translator 1.5k 1.6k 25.0k 25.7k Total 50.2k 50.3k 542.1k 442.9k

20. Available data in SAWA Corpus All manually sentence aligned! English Sentences Kiswahili Sentences English Words Kiswahili Words New Testament 16.4k 16.3k 189.2k 151.1k Quran 14.3k 14.5k 165.5k 124.3k Declaration of HR 0.2k 1.8k 1.8k Kamusi.org 5.6k 35.5k 26.7k Movie Subtitles 9.0k 72.2k 58.4k Investment Reports 3.2k 3.1k 52.9k 54.9k Local Translator 1.5k 1.6k 25.0k 25.7k Total 50.2k 50.3k 542.1k 442.9k

21.

22. Word alignment You caught me skiving , I ‘ m afraid . Samahani , umenidaka nikihepa .

23.

24.

25.

26. Alignment problems nimemkatalia have turned him down I

27. Morphological decomposition have turned him down I ni+ me+ m+ katalia

28.

29.

30.

31.

32.

The SAWA Corpus - A parallel Corpus English - Swahili

Recomendados

Recomendados

Mais conteúdo relacionado

Semelhante a The SAWA Corpus - A parallel Corpus English - Swahili

Semelhante a The SAWA Corpus - A parallel Corpus English - Swahili (12)

Mais de Guy De Pauw

Mais de Guy De Pauw (20)

Último

Último (20)

The SAWA Corpus - A parallel Corpus English - Swahili