{"id":2896,"date":"2020-02-10T18:25:15","date_gmt":"2020-02-10T18:25:15","guid":{"rendered":"https:\/\/www.translatorswithoutborders.org\/blog\/?p=2896"},"modified":"2024-08-22T14:28:32","modified_gmt":"2024-08-22T14:28:32","slug":"language-data-gap","status":"publish","type":"post","link":"https:\/\/translatorswithoutborders.org\/blog\/language-data-gap\/","title":{"rendered":"Language data fills a critical gap for humanitarians"},"content":{"rendered":"

Until now, humanitarians have not had access to data about the languages people speak. But a series of open-source language datasets is about to improve how we communicate with communities in crisis. Eric DeLuca and William Low explain how a seemingly simple question drove an innovative solution.<\/i><\/strong><\/p>\n

\"\"<\/p>\n

\u201cDo you know what languages these new migrants speak?\u201d<\/span><\/p><\/blockquote>\n

Lucia, an aid worker based in Italy, asked this seemingly simple question to researchers from Translators without Borders in 2017. Her organization was providing rapid assistance to migrants as they arrived at the port in Sicily. Lucia and her colleagues were struggling to provide appropriate language support. They often lacked interpreters who spoke the right languages and they asked migrants to fill out forms in languages that the migrants didn\u2019t understand.<\/span><\/p>\n

Unfortunately, there wasn\u2019t a simple answer to Lucia\u2019s question. In the six months prior to our conversation with Lucia, Italy registered migrants from <\/span>21 different countries<\/span><\/a>. Even when we knew that people came from a particular region in one of these countries, there was no simple way to know what language they were likely to speak.<\/span><\/p>\n

The problem wasn\u2019t exclusive to the European refugee response. Translators without Borders partners with organizations around the world which struggle with a similar lack of basic language data.<\/span><\/p>\n

Where is the data?<\/span><\/h1>\n

As we searched various linguistic and humanitarian resources, we were convinced that we were missing something. Surely there was a global language map? Or at least language data for individual countries?<\/span><\/p>\n

The more we looked, the more we discovered how much we didn\u2019t know. The language data that does exist is often protected by restrictive copyrights or locked behind paywalls. Languages are often visualized as discrete polygons or specific points on a map, which seems at odds with the messy spatial dynamics that we experience in the real world.\u00a0<\/span><\/p>\n

In short, <\/span>language data isn\u2019t accessible, or easily verifiable, or in a format that humanitarians can readily use.<\/strong><\/p>\n

We are releasing language datasets for nine countries<\/span><\/h2>\n

Today we launch the first openly available language datasets for humanitarian use. This includes a series of static and dynamic maps and 23 datasets covering nine countries<\/a>: DRC, Guatemala, Malawi, Mozambique, Nigeria, Pakistan, Philippines, Ukraine, and Zambia.<\/span><\/p>\n

This work is based on a partnership between TWB and University College London. The pilot project received support from Research England\u2019s Higher Education Innovation Fund, managed by UCL Innovation & Enterprise.<\/span> With support from the <\/span>Centre for Translation Studies at UCL<\/span><\/a>, this project was the first of its kind in the world to systematically gather and share language data for humanitarian use.<\/span><\/p>\n

The majority of these datasets are based on existing sources \u2014 census and other government data. We curated, cleaned, and reformatted the data to be more accessible for humanitarian purposes. We are exploring ways of deriving new language data in countries without existing sources, and extracting language information from digital sources.<\/span><\/p>\n

This project is built on four main principles:<\/span><\/p>\n

\"TWB<\/p>\n

1. Language data should be easily accessible<\/span><\/h3>\n

We started analyzing existing government data because we realized there was a lot of quality information that was simply hard to access and analyze. The language indicators from the <\/span>2010 Philippines census<\/span><\/a>, for example, were spread over 87 different spreadsheets. Many census bureaus also publish in languages other than English, making it difficult for humanitarians who work primarily in English to access the data. We have gone through the process of curating, translating, and cleaning these datasets to make them more accessible.<\/span><\/p>\n

2. Language data should work across different platforms<\/span><\/h3>\n

We believe that data interoperability is important. That is, it should be easy to share and use data across different humanitarian systems. This requires data to be formatted in a consistent way and spatial parameters to be well documented. As much as possible, we applied a consistent geographic standard to these datasets. We avoided polygons and GPS points, opting instead to use OCHA administrative units and P-codes. At times this will reduce data precision, but it should make it easier to integrate the datasets into existing humanitarian workflows.<\/span><\/p>\n

We worked with the <\/span>Centre for Humanitarian Data<\/span><\/a> to develop and apply consistent standards for coding. We built an <\/span>HXL<\/span><\/a> hashtag scheme to help simplify integration and processing. Language standardization was one of the most difficult aspects of the project, as governments do not always refer to languages consistently. The <\/span>Malawi dataset<\/span><\/a>, for example, distinguishes between \u201cChewa\u201d and \u201cNyanja,\u201d which are two different names for the same language. In some cases, we merged duplicate language names. In others, we left the discrepancies as they exist in the original dataset and made a note in the metadata.<\/span><\/p>\n

Even when language names are consistent, the spelling isn\u2019t always. In the <\/span>DRC dataset<\/span><\/a>, \u201cKiswahili\u201d is displayed with its Bantu prefix. We have opted instead to use the more common English reference of \u201cSwahili.\u201d<\/span><\/p>\n

Every dataset uses <\/span>ISO 639-3<\/span><\/a> language codes and provides alternative names and spellings to alleviate some of the typical frustrations associated with inconsistent language references.<\/span><\/p>\n

3. Language data should be open and free to use<\/span><\/h3>\n

We have made all of these datasets available under a Creative Commons Attribution Noncommercial Share Alike license (<\/span>CC BY-NC-SA-4.0<\/span><\/a>). This means that you are free to use and adapt them as long as you cite the source and do not use them for commercial purposes. You can also share derivatives of the data as long as you comply with the same license when doing so.<\/span><\/p>\n

The datasets are all available in .xlsx and .csv formats on <\/span>HDX<\/span><\/a>, and detailed metadata clearly states the source of each dataset along with known limitations.\u00a0<\/span><\/p>\n

Importantly, everything is free to access and use.<\/span><\/p>\n

4. Language data should not increase people\u2019s vulnerability<\/span><\/h3>\n

Humanitarians often cite the potential sensitivities of language as the primary reason for not sharing language data. In many cases, language can be used as a proxy indicator for ethnicity. In some, the two factors are interchangeable.<\/span><\/p>\n

As a result, we developed a thorough risk-review process for each dataset. This identifies specific risks associated with the data, which we can then mitigate. It also helps us to understand the potential benefits. Ultimately, we have to balance the benefits and risks of sharing the data. Sharing data helps humanitarian organizations and others to develop communication strategies that address the needs of minority language speakers.<\/span><\/p>\n

In most cases, we aggregated the data to protect individuals or vulnerable groups. For each dataset, we describe the method we used to collect and clean the data, and specify potential imitations. In a few instances, we chose to not publish datasets at all.<\/span><\/p>\n

How can you help?<\/span><\/h2>\n

This is just the beginning of our effort to provide more accessible language data for humanitarian purposes. Our goal is to make language data openly available for every humanitarian crisis, and we can\u2019t do it alone. We need your help to:<\/span><\/p>\n

    \n
  1. Integrate and share this data.<\/strong> <\/span>We are not looking to create another data portal. Our strategy is to make these datasets as accessible and interoperable as possible using existing platforms. But we need your feedback so we can improve and expand them.<\/span><\/span><\/li>\n
  2. Add language-related questions into your ongoing surveys<\/strong>.<\/span> Existing language data is often outdated and does not necessarily represent large-scale population movements. Over the past year, we have worked with partners such as IOM DTM, REACH, WFP, and UNICEF to integrate <\/span>standard language questions<\/span><\/a> into ongoing surveys. This is essential if we are to develop language data for the countries that don\u2019t have regular censuses. The recent <\/span>multi-sectoral needs assessment in Nigeria<\/span><\/a> is a good example of how a few strategic language questions can lead to data-driven humanitarian decisions.<\/span><\/span><\/span><\/li>\n
  3. Use this language data to improve humanitarian communication strategies.<\/strong> As we develop more data, we hope to provide the tools for Lucia and other humanitarians to design more appropriate communication strategies. Decisions to hire interpreters and field workers, develop radio messaging, or create new posters and flyers should all be data-driven. That\u2019s only possible if we know which languages people speak. An inclusive and participatory humanitarian system requires two-way communication strategies that use languages and formats that people understand.<\/span><\/li>\n<\/ol>\n

    Clearly, the answer to Lucia\u2019s question turned out to be more complicated than any of us expected. This partnership between TWB and the Centre for Translation Studies at UCL has finally made it possible to incorporate language data into humanitarian workflows. We have established a consistent format, an HXL coding scheme, and processes for standardizing language references. But the work does not stop with these nine countries. Over the next few months we will continue to curate and share existing language datasets for new countries. In the longer term we will be working with various partners to collect and share language data where it does not currently exist. We believe in a world where knowledge knows no language barriers. Putting language on the map is the first step to achieving that.<\/span><\/p>\n

    Eric DeLuca is the Monitoring, Evaluation, and Learning Manager at Translators without Borders.<\/span><\/i>\n\nWilliam Low is a Senior Data and GIS Researcher at University College London.<\/span><\/i><\/pre>\n
    Funding for this project was provided by Research England\u2019s Higher Education Innovation Fund, managed by UCL Innovation & Enterprise.<\/span><\/i><\/p>\n
    \"\"<\/p>\n","protected":false},"excerpt":{"rendered":"
    Until now, humanitarians have not had access to data about the languages people speak. But a series of open-source language datasets is about to improve how we communicate with communities in crisis. Eric DeLuca and William Low explain how a seemingly simple question drove an innovative solution. \u201cDo you know what languages these new migrants … Continue reading “Language data fills a critical gap for humanitarians”<\/span><\/a><\/p>\n","protected":false},"author":25,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[296],"tags":[290,288],"class_list":["post-2896","post","type-post","status-publish","format-standard","hentry","category-language-technology","tag-data","tag-language-technology"],"yoast_head":"\nLanguage data fills a critical gap for humanitarians - TWB Blog<\/title>\n<meta name=\"description\" content=\"Until now, humanitarians have not had access to data about the languages people speak. We're about to improve how we communicate with communities in crisis.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/translatorswithoutborders.org\/blog\/language-data-gap\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Language data fills a critical gap for humanitarians - TWB Blog\" \/>\n<meta property=\"og:description\" content=\"Until now, humanitarians have not had access to data about the languages people speak. We're about to improve how we communicate with communities in crisis.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/translatorswithoutborders.org\/blog\/language-data-gap\/\" \/>\n<meta property=\"og:site_name\" content=\"Translators without Borders Blog\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/translatorswithoutborders\" \/>\n<meta property=\"article:published_time\" content=\"2020-02-10T18:25:15+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-08-22T14:28:32+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/translatorswithoutborders.org\/blog\/wp-content\/uploads\/2020\/02\/C0004T01-3-1-1024x627.jpg\" \/>\n<meta name=\"author\" content=\"Translators Without Borders\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@TranslatorsWB\" \/>\n<meta name=\"twitter:site\" content=\"@TranslatorsWB\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Translators Without Borders\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"8 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/translatorswithoutborders.org\\\/blog\\\/language-data-gap\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/translatorswithoutborders.org\\\/blog\\\/language-data-gap\\\/\"},\"author\":{\"name\":\"Translators Without Borders\",\"@id\":\"https:\\\/\\\/translatorswithoutborders.org\\\/blog\\\/#\\\/schema\\\/person\\\/eadfd55fcdedf3bd8feded8ac5046d39\"},\"headline\":\"Language data fills a critical gap for humanitarians\",\"datePublished\":\"2020-02-10T18:25:15+00:00\",\"dateModified\":\"2024-08-22T14:28:32+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/translatorswithoutborders.org\\\/blog\\\/language-data-gap\\\/\"},\"wordCount\":1508,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\\\/\\\/translatorswithoutborders.org\\\/blog\\\/#organization\"},\"image\":{\"@id\":\"https:\\\/\\\/translatorswithoutborders.org\\\/blog\\\/language-data-gap\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/translatorswithoutborders.org\\\/blog\\\/wp-content\\\/uploads\\\/2020\\\/02\\\/C0004T01-3-1-1024x627.jpg\",\"keywords\":[\"Data\",\"Language Technology\"],\"articleSection\":[\"Language Technology\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/translatorswithoutborders.org\\\/blog\\\/language-data-gap\\\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/translatorswithoutborders.org\\\/blog\\\/language-data-gap\\\/\",\"url\":\"https:\\\/\\\/translatorswithoutborders.org\\\/blog\\\/language-data-gap\\\/\",\"name\":\"Language data fills a critical gap for humanitarians - TWB Blog\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/translatorswithoutborders.org\\\/blog\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/translatorswithoutborders.org\\\/blog\\\/language-data-gap\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/translatorswithoutborders.org\\\/blog\\\/language-data-gap\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/translatorswithoutborders.org\\\/blog\\\/wp-content\\\/uploads\\\/2020\\\/02\\\/C0004T01-3-1-1024x627.jpg\",\"datePublished\":\"2020-02-10T18:25:15+00:00\",\"dateModified\":\"2024-08-22T14:28:32+00:00\",\"description\":\"Until now, humanitarians have not had access to data about the languages people speak. We're about to improve how we communicate with communities in crisis.\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/translatorswithoutborders.org\\\/blog\\\/language-data-gap\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/translatorswithoutborders.org\\\/blog\\\/language-data-gap\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/translatorswithoutborders.org\\\/blog\\\/language-data-gap\\\/#primaryimage\",\"url\":\"https:\\\/\\\/i0.wp.com\\\/translatorswithoutborders.org\\\/blog\\\/wp-content\\\/uploads\\\/2020\\\/02\\\/C0004T01-3-1.jpg?fit=1176%2C720&ssl=1\",\"contentUrl\":\"https:\\\/\\\/i0.wp.com\\\/translatorswithoutborders.org\\\/blog\\\/wp-content\\\/uploads\\\/2020\\\/02\\\/C0004T01-3-1.jpg?fit=1176%2C720&ssl=1\",\"width\":1176,\"height\":720},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/translatorswithoutborders.org\\\/blog\\\/language-data-gap\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/translatorswithoutborders.org\\\/blog\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Language data fills a critical gap for humanitarians\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/translatorswithoutborders.org\\\/blog\\\/#website\",\"url\":\"https:\\\/\\\/translatorswithoutborders.org\\\/blog\\\/\",\"name\":\"Translators without Borders Blog\",\"description\":\"\",\"publisher\":{\"@id\":\"https:\\\/\\\/translatorswithoutborders.org\\\/blog\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/translatorswithoutborders.org\\\/blog\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/translatorswithoutborders.org\\\/blog\\\/#organization\",\"name\":\"Translators without Borders\",\"url\":\"https:\\\/\\\/translatorswithoutborders.org\\\/blog\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/translatorswithoutborders.org\\\/blog\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/i2.wp.com\\\/translatorswithoutborders.org\\\/blog\\\/wp-content\\\/uploads\\\/2017\\\/03\\\/cropped-twblogo_3-1.png?fit=248%2C65&ssl=1\",\"contentUrl\":\"https:\\\/\\\/i2.wp.com\\\/translatorswithoutborders.org\\\/blog\\\/wp-content\\\/uploads\\\/2017\\\/03\\\/cropped-twblogo_3-1.png?fit=248%2C65&ssl=1\",\"width\":248,\"height\":65,\"caption\":\"Translators without Borders\"},\"image\":{\"@id\":\"https:\\\/\\\/translatorswithoutborders.org\\\/blog\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/www.facebook.com\\\/translatorswithoutborders\",\"https:\\\/\\\/x.com\\\/TranslatorsWB\",\"http:\\\/\\\/translatorswb\",\"https:\\\/\\\/www.linkedin.com\\\/company-beta\\\/1500298\\\/?pathWildcard=1500298\"]},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/translatorswithoutborders.org\\\/blog\\\/#\\\/schema\\\/person\\\/eadfd55fcdedf3bd8feded8ac5046d39\",\"name\":\"Translators Without Borders\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/797d99aadcc65779070b9bcdddee2a1ed6ef28301ee0b8e63c8dcc304cfdb418?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/797d99aadcc65779070b9bcdddee2a1ed6ef28301ee0b8e63c8dcc304cfdb418?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/797d99aadcc65779070b9bcdddee2a1ed6ef28301ee0b8e63c8dcc304cfdb418?s=96&d=mm&r=g\",\"caption\":\"Translators Without Borders\"},\"url\":\"https:\\\/\\\/translatorswithoutborders.org\\\/blog\\\/author\\\/translators-without-borders\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Language data fills a critical gap for humanitarians - TWB Blog","description":"Until now, humanitarians have not had access to data about the languages people speak. We're about to improve how we communicate with communities in crisis.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/translatorswithoutborders.org\/blog\/language-data-gap\/","og_locale":"en_US","og_type":"article","og_title":"Language data fills a critical gap for humanitarians - TWB Blog","og_description":"Until now, humanitarians have not had access to data about the languages people speak. We're about to improve how we communicate with communities in crisis.","og_url":"https:\/\/translatorswithoutborders.org\/blog\/language-data-gap\/","og_site_name":"Translators without Borders Blog","article_publisher":"https:\/\/www.facebook.com\/translatorswithoutborders","article_published_time":"2020-02-10T18:25:15+00:00","article_modified_time":"2024-08-22T14:28:32+00:00","og_image":[{"url":"https:\/\/translatorswithoutborders.org\/blog\/wp-content\/uploads\/2020\/02\/C0004T01-3-1-1024x627.jpg","type":"","width":"","height":""}],"author":"Translators Without Borders","twitter_card":"summary_large_image","twitter_creator":"@TranslatorsWB","twitter_site":"@TranslatorsWB","twitter_misc":{"Written by":"Translators Without Borders","Est. reading time":"8 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/translatorswithoutborders.org\/blog\/language-data-gap\/#article","isPartOf":{"@id":"https:\/\/translatorswithoutborders.org\/blog\/language-data-gap\/"},"author":{"name":"Translators Without Borders","@id":"https:\/\/translatorswithoutborders.org\/blog\/#\/schema\/person\/eadfd55fcdedf3bd8feded8ac5046d39"},"headline":"Language data fills a critical gap for humanitarians","datePublished":"2020-02-10T18:25:15+00:00","dateModified":"2024-08-22T14:28:32+00:00","mainEntityOfPage":{"@id":"https:\/\/translatorswithoutborders.org\/blog\/language-data-gap\/"},"wordCount":1508,"commentCount":0,"publisher":{"@id":"https:\/\/translatorswithoutborders.org\/blog\/#organization"},"image":{"@id":"https:\/\/translatorswithoutborders.org\/blog\/language-data-gap\/#primaryimage"},"thumbnailUrl":"https:\/\/translatorswithoutborders.org\/blog\/wp-content\/uploads\/2020\/02\/C0004T01-3-1-1024x627.jpg","keywords":["Data","Language Technology"],"articleSection":["Language Technology"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/translatorswithoutborders.org\/blog\/language-data-gap\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/translatorswithoutborders.org\/blog\/language-data-gap\/","url":"https:\/\/translatorswithoutborders.org\/blog\/language-data-gap\/","name":"Language data fills a critical gap for humanitarians - TWB Blog","isPartOf":{"@id":"https:\/\/translatorswithoutborders.org\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/translatorswithoutborders.org\/blog\/language-data-gap\/#primaryimage"},"image":{"@id":"https:\/\/translatorswithoutborders.org\/blog\/language-data-gap\/#primaryimage"},"thumbnailUrl":"https:\/\/translatorswithoutborders.org\/blog\/wp-content\/uploads\/2020\/02\/C0004T01-3-1-1024x627.jpg","datePublished":"2020-02-10T18:25:15+00:00","dateModified":"2024-08-22T14:28:32+00:00","description":"Until now, humanitarians have not had access to data about the languages people speak. We're about to improve how we communicate with communities in crisis.","breadcrumb":{"@id":"https:\/\/translatorswithoutborders.org\/blog\/language-data-gap\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/translatorswithoutborders.org\/blog\/language-data-gap\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/translatorswithoutborders.org\/blog\/language-data-gap\/#primaryimage","url":"https:\/\/i0.wp.com\/translatorswithoutborders.org\/blog\/wp-content\/uploads\/2020\/02\/C0004T01-3-1.jpg?fit=1176%2C720&ssl=1","contentUrl":"https:\/\/i0.wp.com\/translatorswithoutborders.org\/blog\/wp-content\/uploads\/2020\/02\/C0004T01-3-1.jpg?fit=1176%2C720&ssl=1","width":1176,"height":720},{"@type":"BreadcrumbList","@id":"https:\/\/translatorswithoutborders.org\/blog\/language-data-gap\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/translatorswithoutborders.org\/blog\/"},{"@type":"ListItem","position":2,"name":"Language data fills a critical gap for humanitarians"}]},{"@type":"WebSite","@id":"https:\/\/translatorswithoutborders.org\/blog\/#website","url":"https:\/\/translatorswithoutborders.org\/blog\/","name":"Translators without Borders Blog","description":"","publisher":{"@id":"https:\/\/translatorswithoutborders.org\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/translatorswithoutborders.org\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/translatorswithoutborders.org\/blog\/#organization","name":"Translators without Borders","url":"https:\/\/translatorswithoutborders.org\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/translatorswithoutborders.org\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/i2.wp.com\/translatorswithoutborders.org\/blog\/wp-content\/uploads\/2017\/03\/cropped-twblogo_3-1.png?fit=248%2C65&ssl=1","contentUrl":"https:\/\/i2.wp.com\/translatorswithoutborders.org\/blog\/wp-content\/uploads\/2017\/03\/cropped-twblogo_3-1.png?fit=248%2C65&ssl=1","width":248,"height":65,"caption":"Translators without Borders"},"image":{"@id":"https:\/\/translatorswithoutborders.org\/blog\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/translatorswithoutborders","https:\/\/x.com\/TranslatorsWB","http:\/\/translatorswb","https:\/\/www.linkedin.com\/company-beta\/1500298\/?pathWildcard=1500298"]},{"@type":"Person","@id":"https:\/\/translatorswithoutborders.org\/blog\/#\/schema\/person\/eadfd55fcdedf3bd8feded8ac5046d39","name":"Translators Without Borders","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/797d99aadcc65779070b9bcdddee2a1ed6ef28301ee0b8e63c8dcc304cfdb418?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/797d99aadcc65779070b9bcdddee2a1ed6ef28301ee0b8e63c8dcc304cfdb418?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/797d99aadcc65779070b9bcdddee2a1ed6ef28301ee0b8e63c8dcc304cfdb418?s=96&d=mm&r=g","caption":"Translators Without Borders"},"url":"https:\/\/translatorswithoutborders.org\/blog\/author\/translators-without-borders\/"}]}},"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/p8ykT2-KI","jetpack-related-posts":[{"id":2084,"url":"https:\/\/translatorswithoutborders.org\/blog\/the-global-response-to-displacement-and-language-barriers-three-reasons-for-hope\/","url_meta":{"origin":2896,"position":0},"title":"The global response to displacement and language barriers – three reasons for hope","author":"Translators Without Borders","date":"September 21, 2018","format":false,"excerpt":"United Nations (UN) member states will soon have a critical opportunity to make systematic improvements to how the world assists and protects refugees and migrants. Three promising developments \u2014 on language data, multilingual information provision, and translation and interpreting support \u2014 show momentum is building towards ensuring all migrants, including\u2026","rel":"","context":"In \"crisis response\"","block_context":{"text":"crisis response","link":"https:\/\/translatorswithoutborders.org\/blog\/tag\/crisis-response\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/translatorswithoutborders.org\/blog\/wp-content\/uploads\/2018\/09\/Screen-Shot-2018-09-21-at-8.32.46-AM.png?fit=1099%2C728&ssl=1&resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/translatorswithoutborders.org\/blog\/wp-content\/uploads\/2018\/09\/Screen-Shot-2018-09-21-at-8.32.46-AM.png?fit=1099%2C728&ssl=1&resize=350%2C200 1x, https:\/\/i0.wp.com\/translatorswithoutborders.org\/blog\/wp-content\/uploads\/2018\/09\/Screen-Shot-2018-09-21-at-8.32.46-AM.png?fit=1099%2C728&ssl=1&resize=525%2C300 1.5x, https:\/\/i0.wp.com\/translatorswithoutborders.org\/blog\/wp-content\/uploads\/2018\/09\/Screen-Shot-2018-09-21-at-8.32.46-AM.png?fit=1099%2C728&ssl=1&resize=700%2C400 2x, https:\/\/i0.wp.com\/translatorswithoutborders.org\/blog\/wp-content\/uploads\/2018\/09\/Screen-Shot-2018-09-21-at-8.32.46-AM.png?fit=1099%2C728&ssl=1&resize=1050%2C600 3x"},"classes":[]},{"id":1936,"url":"https:\/\/translatorswithoutborders.org\/blog\/language-collective-blind-spot\/","url_meta":{"origin":2896,"position":1},"title":"Language: Our Collective Blind Spot in the Participation Revolution","author":"Translators Without Borders","date":"April 16, 2018","format":false,"excerpt":"Two years ago, I embarked on an amazing journey. I started working for Translators without Borders (TWB). While being a first-time Executive Director poses challenges, immersing myself in the world of language and language technology has by far been the more interesting and perplexing challenge. \u00a0 Language issues in humanitarian\u2026","rel":"","context":"In "How we work"","block_context":{"text":"How we work","link":"https:\/\/translatorswithoutborders.org\/blog\/category\/how-we-work\/"},"img":{"alt_text":"Students, Writing, Language","src":"https:\/\/i0.wp.com\/translatorswithoutborders.org\/blog\/wp-content\/uploads\/2018\/04\/Eric-DeLuca-Translators-without-Borders-1024x683.png?resize=350%2C200&ssl=1","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/translatorswithoutborders.org\/blog\/wp-content\/uploads\/2018\/04\/Eric-DeLuca-Translators-without-Borders-1024x683.png?resize=350%2C200&ssl=1 1x, https:\/\/i0.wp.com\/translatorswithoutborders.org\/blog\/wp-content\/uploads\/2018\/04\/Eric-DeLuca-Translators-without-Borders-1024x683.png?resize=525%2C300&ssl=1 1.5x, https:\/\/i0.wp.com\/translatorswithoutborders.org\/blog\/wp-content\/uploads\/2018\/04\/Eric-DeLuca-Translators-without-Borders-1024x683.png?resize=700%2C400&ssl=1 2x"},"classes":[]},{"id":1441,"url":"https:\/\/translatorswithoutborders.org\/blog\/languages-refugee-crisis-greece\/","url_meta":{"origin":2896,"position":2},"title":"What you didn’t know about languages that matter in the European refugee crisis","author":"Translators Without Borders","date":"July 14, 2017","format":false,"excerpt":"In April 2017, Translators without Borders carried out a study to analyze what might be causing the\u00a0language and communication barriers that exist in the context of the ongoing humanitarian migration crisis in Greece. A striking feature of this crisis is the wide range of languages and ethnicities involved. Approximately 95\u2026","rel":"","context":"In "Must Reads"","block_context":{"text":"Must Reads","link":"https:\/\/translatorswithoutborders.org\/blog\/category\/translators-without-borders\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/translatorswithoutborders.org\/blog\/wp-content\/uploads\/2017\/07\/300x300-Blog-Featured-Images-14.png?fit=300%2C300&ssl=1&resize=350%2C200","width":350,"height":200},"classes":[]},{"id":1739,"url":"https:\/\/translatorswithoutborders.org\/blog\/putting-language-on-the-map\/","url_meta":{"origin":2896,"position":3},"title":"Putting language on the map in Nigeria","author":"Translators Without Borders","date":"December 11, 2017","format":false,"excerpt":"Without data on the languages of affected people, humanitarian organizations are ill-equipped to communicate with them effectively. In May of this year, Translators without Borders (TWB) started trying\u00a0to better understand what data is available regarding the language preferences of populations affected by humanitarian crises. The short answer is that there\u2026","rel":"","context":"In "How we work"","block_context":{"text":"How we work","link":"https:\/\/translatorswithoutborders.org\/blog\/category\/how-we-work\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/translatorswithoutborders.org\/blog\/wp-content\/uploads\/2017\/12\/Eric150x150.jpg?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":1459,"url":"https:\/\/translatorswithoutborders.org\/blog\/not-everyday-translation-hif-vlog-1\/","url_meta":{"origin":2896,"position":4},"title":"This is no ordinary translation; this can save lives.","author":"Translators Without Borders","date":"July 21, 2017","format":false,"excerpt":"FOLLOW US ON OUR JOURNEY TO SCALE UP REMOTE CRISIS RESPONSE LANGUAGE SERVICES.\u00a0 Refugees and migrants arriving in Europe need clear information they can understand at every point in their journey. They need it in order to move, to find their way through complex asylum procedures, and to keep themselves\u2026","rel":"","context":"In "How we work"","block_context":{"text":"How we work","link":"https:\/\/translatorswithoutborders.org\/blog\/category\/how-we-work\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/translatorswithoutborders.org\/blog\/wp-content\/uploads\/2017\/07\/hif.jpg?fit=300%2C300&ssl=1&resize=350%2C200","width":350,"height":200},"classes":[]},{"id":2114,"url":"https:\/\/translatorswithoutborders.org\/blog\/digital-development-language-gaps-and-a-prophetic-bird\/","url_meta":{"origin":2896,"position":5},"title":"Digital development, language gaps, and a prophetic bird","author":"Translators Without Borders","date":"October 26, 2018","format":false,"excerpt":"Language technology can help those in need use technology to proactively communicate and access information. We are in the midst of an unprecedented surge of increasingly powerful technologies that can help solve humanitarian and development challenges. Yet meaningful access to these technologies is not equally available to all people. Hundreds\u2026","rel":"","context":"In \"humanitarian response\"","block_context":{"text":"humanitarian response","link":"https:\/\/translatorswithoutborders.org\/blog\/tag\/humanitarian-response\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/translatorswithoutborders.org\/blog\/wp-content\/uploads\/2018\/10\/IMG_20180720_114323-2-1.jpg?fit=1200%2C900&ssl=1&resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/translatorswithoutborders.org\/blog\/wp-content\/uploads\/2018\/10\/IMG_20180720_114323-2-1.jpg?fit=1200%2C900&ssl=1&resize=350%2C200 1x, https:\/\/i0.wp.com\/translatorswithoutborders.org\/blog\/wp-content\/uploads\/2018\/10\/IMG_20180720_114323-2-1.jpg?fit=1200%2C900&ssl=1&resize=525%2C300 1.5x, https:\/\/i0.wp.com\/translatorswithoutborders.org\/blog\/wp-content\/uploads\/2018\/10\/IMG_20180720_114323-2-1.jpg?fit=1200%2C900&ssl=1&resize=700%2C400 2x, https:\/\/i0.wp.com\/translatorswithoutborders.org\/blog\/wp-content\/uploads\/2018\/10\/IMG_20180720_114323-2-1.jpg?fit=1200%2C900&ssl=1&resize=1050%2C600 3x"},"classes":[]}],"rttpg_featured_image_url":null,"rttpg_author":{"display_name":"Translators Without Borders","author_link":"https:\/\/translatorswithoutborders.org\/blog\/author\/translators-without-borders\/"},"rttpg_comment":235,"rttpg_category":"<a href=\"https:\/\/translatorswithoutborders.org\/blog\/category\/language-technology\/\" rel=\"category tag\">Language Technology<\/a>","rttpg_excerpt":"Until now, humanitarians have not had access to data about the languages people speak. But a series of open-source language datasets is about to improve how we communicate with communities in crisis. Eric DeLuca and William Low explain how a seemingly simple question drove an innovative solution. \u201cDo you know what languages these new migrants…","_links":{"self":[{"href":"https:\/\/translatorswithoutborders.org\/blog\/wp-json\/wp\/v2\/posts\/2896","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/translatorswithoutborders.org\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/translatorswithoutborders.org\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/translatorswithoutborders.org\/blog\/wp-json\/wp\/v2\/users\/25"}],"replies":[{"embeddable":true,"href":"https:\/\/translatorswithoutborders.org\/blog\/wp-json\/wp\/v2\/comments?post=2896"}],"version-history":[{"count":7,"href":"https:\/\/translatorswithoutborders.org\/blog\/wp-json\/wp\/v2\/posts\/2896\/revisions"}],"predecessor-version":[{"id":3550,"href":"https:\/\/translatorswithoutborders.org\/blog\/wp-json\/wp\/v2\/posts\/2896\/revisions\/3550"}],"wp:attachment":[{"href":"https:\/\/translatorswithoutborders.org\/blog\/wp-json\/wp\/v2\/media?parent=2896"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/translatorswithoutborders.org\/blog\/wp-json\/wp\/v2\/categories?post=2896"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/translatorswithoutborders.org\/blog\/wp-json\/wp\/v2\/tags?post=2896"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}