Facebook’s Language Translation Now Entirely Done With AI


The social network’s efforts with machine learning and artificial intelligence have advanced enough to the point that it can completely take over Facebook’s language translation. Text in posts and comments are now automatically translated so that people all around the world can read them. Given that Facebook now has 2 billion active users, this is an impressive feat.

From SMT to Neural Networks

In order to pull this off on a social network, the machine learning needs to take into account context, slang, typos, abbreviations, and intent all at once. Previously Facebook was using phrase-based machine translation, which is a type of statistical machine translation (SMT).

Don’t miss the best of The Mac Observer

Set us as a preferred source and our Apple reporting ranks higher in your Google Search results and Discover feed — one tap, no account changes.

Or get it by email

With phrase-based translation, the goal is to translate entire sequences of words that have different lengths as an effort improve on word-based translation. But now, Facebook has moved on to neural networks with sequence-to-sequence LSTM (long short-term memory).

Generic image of a neural network, that powers Facebook's language translation.

This is more accurate than phrase-based translation because it doesn’t have to break up sentences into blocks of phrases. The neural network can work with the whole sentence at once and understand the context. The new system increased the accuracy by an average of 11 percent.

Since the neural network can work with abbreviations too, it can successfully translate the English-to-Spanish abbreviation of “tmrw” (tomorrow) into “mañana.” People can still rate translations too, which leads to greater accuracy over time as the system learns which translations were better than others.

Discussion

2 comments
Newest first
Join the discussionCommenting as a guest — your email is never published · Log in

Protected by Akismet — be kind, stay on topic.

This site uses Akismet to reduce spam. Learn how your comment data is processed.

  1. b2bdataservices Subscriber 9 years ago

    Good one..!!

    Reply
  2. Lee Dronick Subscriber 9 years ago

    Now if they can just filter out hoaxes and fake news.

    Reply