Translation Software That Learns by Reading

redcone writes "New Scientist is reporting that translation software that develops an understanding of languages by scanning through thousands of previously translated documents has been released by U.S. researchers. According to the article "The translated documents used to teach the translation algorithms can be electronic, on paper, or even audio files. The system is not only faster than other methods, but also better suited to tackling less common languages and the unusual vocabulary found in specialised or technical texts.""

High school Spanish

[KaSkA101 (692931)]

Why didn't I have this software during High School Spanish?

Scanning Audio Files

[BobPaul (710574)]

Why didn't I have this software during High School Spanish?

It says it can scan through audio files an input source. I wonder if this causes it to "learn" the auditory signatures (and thus only knows the translation when given audio input), or if it relies on text to speech from to convert it to text first?

If it does the latter, than based on the quality of current text-to-speech software, this probably wouldn't do much good in a total immersion classroom situation...

Sure would have helped with my German

Re:High school Spanish

[xtrvd (762313)]

Fortunately I had the next best thing in High School Spanish. The trick is simply going to the #spain channel on efnet and talking nice to some people. You'd be amazed as to how often my teacher would fail my fellow students because they attempted using the primitive babelfish.altavista.com to do their work for them; she could easily spot the syntax errors and mis-spelled english words which were never translated.

Until I see this new process in the works, however, there is nothing that will make me believe it's better than finding another human who can *understand* what you are saying and the context to which you are implying.

efnet spanish

[Garabito (720521)]

k apr3ndist3 3sp4ni0l en IRC?
q w3n0! 3so si está 1337!

Re:efnet spanish

[sahonen (680948)]

Is it sadder that you wrote that... Or that I can read it?

Re:High school Spanish

[Temposs (787432)]

Until I see this new process in the works, however, there is nothing that will make me believe it's better than finding another human who can *understand* what you are saying and the context to which you are implying. "Better" is an ambiguous term. For what these researchers made the program for, it is better than humans for one reason: speed. Sure they want the translations to be reliable, but more importantly is that a computer can do in a few days what would take a human a month, for this application at

Dealing with Disruptive Technology

[Simonetta (207550)]

This message brings up some excellent points about dealing with disruptive technology. A teacher whose job it is to get students to master material in a certain subject realizes that there is a machine that provide the same function that previously could only be gained by hard study.
What is more important, the knowledge gained through rigorous study or the ablility to acomplish what the studing provides through a machine.
Being technical oriented, I have to say the machine. But I am not being disresp

technical texts

[Olaserov (785074)]

I wonder if we could train it to translate a EULA ;)

translate to American please

[by Anonymous Coward]

Can someone translate that article from British english to American english please.

Thanks.

Re:translate to American please

[Grey Ninja (739021)]

Here's a couple of suggestions for you:

r3Ð(0n3 wr173$ "N3w $(13n71$7 1$ r3p0r71n9 7h47 7r4n$£4710n $07w4r3 7h47 Ð3v3£0p$ 4n nÐ3r$74nÐ1n9 0 £4n9493$ b¥ $(4nn1n9 7hr09h 7h0$4nÐ$ 0 pr3v10$£¥ 7r4n$£473Ð Ð0(m3n7$ h4$ b33n r3£34$3Ð b¥ .$. r3$34r(h3r$. 4((0rÐ1n9 70 7h3 4r71(£3 "7h3 7r4n$£473Ð Ð0(m3n7$ $3Ð 70 734(h 7h3 7r4n$£4710n 4£90r17hm$ (4n b3 3£3(7r0n1(, 0n p4p3r, 0r 3v3n 4Ð10 1£3$. 7h3 $¥$73m 1$ n07 0n£¥ 4$73r 7h4n 07h3r m37h0Ð$, b7 4£$0 b3773r $173Ð 70 74(|{£1n9 £3$$ (0mm0n £4n9493$ 4nÐ 7h3 n$4£ v0(4b£4r¥ 0nÐ 1n $p3(14£1$3Ð 0r 73(hn1(4£ 73x7$.""

And translation #2:

REDCONE WRIETS NU SCEINTIST IS R3PORTNG TAHT TRANSLATION R TAHT D3V3LOPS AN UNDERSTANDNG OF LANGUAEGS BY SCANNG THROUGH THOUSANDS OF PREVIOUSLY TRANSLAETD DOCUMENTS HAS B3N REL3AESD BY US!!!! OMG R3S3ARCHARS!!1!1!! LOL ACORDNG 2 DA ARTICL3 TEH TRANSLAETD DOCUMENTS US3D 2 T3ACH TEH TRANSLATION ALGORITHMS CAN B 3LECTRONIC ON PAEPR OR 3V3N AUDIO FIELS!!1111 TEH SYSTEM IS NOT ONLY FASTER THAN OTH3R M3THODS BUT ALSO BT3R SUIETD 2 TAKLNG LAS COMON LANGUAEGS AND TEH UNUSUAL VOCABULARY FOUND IN SPACIALIESD OR TECHNICAL TEXTS!1!! WTF

Re:translate to American please

[chris_sawtell (10326)]

No trouble at all. First take the original text, computer translate it into German, and then back into English.

Now reorder the phrases in every sentence so that the object phrase starts the sentence, change every sentence which contains the word because so that the word because and the words following it start the sentence. Make sure that every infinitive verb has the adverb between the word to and the verb. Change every occurrence of which to that Find every word more than 3 syllables long and inject sever

Re:translate to American please

[aussie_a (778472)]

I can translate it to Australian:

That redcone fella did say something about some rag reporting some computer thingymebob that lets me understand what all those japs are saying. The city rag reckons it's real fast.

Yay!

[gardyloo (512791)]

Hope for slashdot. I've always wondered if we only have artificially intelligent editors...

Harry Potter and the Bible

[MikeFM (12491)]

I remember hearing about this a couple years ago. They were using translations of Harry Potter and the Bible to teach this software to translate. It seems to work well. I wonder what it'd make of different translations of technical documentation. That'd probably be even more interesting than what it'd make out of 'quidditch'.

This could be great if it were opensourced. It'd be nice to translate email, instant messages, websites, technical docs, and lots of other stuff we're currently using the fish for. The fish is nice but not that effecient to add to other programs and it's translations aren't usually that great.

Re:Harry Potter and the Bible

[obeythefist (719316)]

I never read that one. I thought the next book title was going to be "Harry Potter and the Half-Blood Prince".

Or did JK Rowling suddenly become pious?

Oh fuck.

[hot_Karls_bad_cavern (759797)]

Something in my head just popped.

Damn, i love this place. Seriously, dammit. Here we have post on a tech/it site titled "Harry Potter and the Bible " modded +4 Interesting at the time of this posting ... that is actually interesting. And even i find it interesting and the fact that you are most likely of age and know what is and how to spell "quidditch" is quite frightening. i'm sad to say i knew it too (they took my Ko0lBadge away a long time ago).

My head totally hurts. Clod.

Turing test

[OneArmedMan (606657)]

I wonder if something similar to this could be used for AI , for say Turing Test's ?

Wow! Does a much better job...

[bigtallmofo (695287)]

Teach Software translating on scanning up

Not hard wares that sticks an comprehension of talks by scanning on thousands of fish translated papers has been vomited by US scientists.

Many existing translation not hard wares uses palm rules for botching words and phrases. But the new software, snarked by Kevin Knight and Daniel Marcu at the Information Sciences[...]

Read More... [newscientist.com]

That's great....

[Frodo Crockett (861942)]

...bu7 (4n 17 unÐ3r$74nÐ £337?

That sounds like a good approach

[FunWithHeadlines (644929)]

I wish them luck (cuz they'll need it), but if anything is going to produce translation software that really works it will have to include learning elements of this nature. It's one thing to get dictionary translations. That's been around for decades, with its laughable results. Humans speak in metaphor and simile and slang and contractions and abbreviations of thought all the time. We're the cat's meow of language (try that, computer!).

But if you give computers a bunch of human stuff to read, you expose the dictionaries to language as it is actually used, not just as the dictionary has it. Then when odd language usage falls upon us like it's raining cats and dogs, they will have a database of similar usage to draw upon. Hey, it's an uphill climb, but this is a good avenue to try. Cheerio, computers, and a top o' the mornin' to ya.

Easy

[beldraen (94534)]

English->Cat: Meow!

Re:That sounds like a good approach

[maxwell demon (590494)]

Bah, one language to other and back is too little. You have to do the complete thing, of course. As you can do here [tashian.com]. I've done it to your text for you (of course including the east asian languages):

If it is possible and cuz of the translation of the software of the
wealth (until the necessity to the danger) this person whom it causes,
this member of the quality of the well-educated way and, in me who I
consult that it examines it, of its type of the search of the thing
the truth that the lheo requests to neces

Philosophical caveat

[Raindance (680694)]

As a caveat, we should be wary of saying the system "understands" a language.

I would say generally that humans able to translate between languages generally understand both languages, but whether a statistical, probabilistic model based on correlations understands a language might be a stretch.

Further reading: Searle's Chinese Room argument- http://en.wikipedia.org/wiki/Chinese_room

This is akin to asking, Does your tax software understand the tax code? Does Photoshop understand the principles of image manipulation?

Are these silly questions to ask?

Further reading: Dennett on intentionality (http://en.wikipedia.org/wiki/Dennett but the entry is pretty sparse).

RD

Re:Philosophical caveat

[MikeFM (12491)]

Does anybody understand the tax code? Why should software be any different?

I think that software that can learn can be said to understand a problem just as much as a human can. The difference between understanding and just doing is having the ability to learn from new data and to change your actions as required.

Re:Philosophical caveat

[back_pages (600753)]

Great example of this:

Mom baked for three hours.
The pie baked for three hours.

"Mom" and "The pie" are the subjects. The verb and entire predicate are identical. Understanding the language disambiguates these sentences, but the ambiguity is part of what defines humor.

A man walked into a bar. Ouch!

A man wanted to win a pun contest in the local newspaper, so he entered 10 times in order to increase the chances that one of his entries would win. Unfortunately, no pun in ten did.

You can translate that 50 ways from Sunday but without understanding the language - understanding what makes those statements interesting - the machine will lose all their meaning.

Re:Philosophical caveat

[evilmousse (798341)]

that's exactly why i like my anime fansubbed instead of sanitized.

Re:Philosophical caveat

[idlake (850372)]

You are right: this software does not understand language; it works out statistical correspondences, but it has no understanding of the physical correlates of words. That also means that it has intrinsic limitations.

Note also that such statistical approaches are nothing new, it's just that computers are finally getting powerful enough that people can use them.

None of that has anything to do with Searle. Searle wouldn't admit that the system understands language even if it knew things about the real worl

Re:Philosophical caveat

[lakeland (218447)]

NO! NO! NO! Not the Searle argument again. That guy is an absolute nutter and should be banned! Actually, on second thoughts, as long as I never have to hear his drivel again, I don't mind what happens to him.

His argument essentially boils down to: "The computer doesn't understand because all it does is manipulate symbols. Even if it does exactly the same steps as a human, the human understood and the computer was just being a mimic. Giving the computer a body wouldn't make it any less of a mimic".

The

Re:Philosophical caveat

[Coulson (146956)]

Searle's Chinese Room argument is hogwash.

In his scenario, Searle claims that neither the people moving the Chienese tokens, nor the book of instructions telling them what to do "understands" what is being said. That is obviously true, but it misses the point. That's like saying that the neurons in your head don't understand what you are saying, and so neither do you.

The workers in the Chinese Room argument are just hardware. They're akin to neurons in the brain, or chips in a computer. They're blind

Google definitely would buy into this...

[egyber (788117)]

Don't remember exactly where I read this, but google apparently has long believed that there is enough data on the internet alone to be able to intelligently translate... What these guys claim to have done is, it would seem, the missing peace of the puzzle for google. I wouldn't be surprised if google gets in on this.

Re:Google definitely would buy into this...

[MikeFM (12491)]

I tried that in about 1997. It did work pretty well but the biggest problem was the limitation of having copies of the same document in different languages. There are quite a few but they were dwarfed by the amount of single-language documents. Also the fact is that most text on the Internet is written the way that I write - badly. This can lead to translations that are written the way real people write which can be good for conversational bots but which is probably bad for translation software.

Some of the

Translating specialised texts ...

[rkmath (26375)]

The article (and the text of the orginial posting) makes it seem like translating a specialized technical text is somehow harder than translating, say, a newspaper article. As someone experienced in translating technical (science/engineering) documents, I can say that any tech document is far _easier_ to translate after an initial learning curve.

The main reason (I think) is that: tech documents have specialised vocabulary and idioms, but these are much fewer than the idioms one has to master in order to understand the editorial page in a newspaper.

With a rudimentary knowledge of Russian and French, I have found it much easier to read an engineering textbook or paper in these languages, than reading any nontechnical text. (This is not necessarily the case with other languages. Any document in Japanese for instance is an entirely different ballgame ...)

Re:Translating specialised texts ...

[by Anonymous Coward]

The article (and the text of the orginial posting) makes it seem like translating a specialized technical text is somehow harder than translating, say, a newspaper article. As someone experienced in translating technical (science/engineering) documents, I can say that any tech document is far _easier_ to translate after an initial learning curve.


Of course that is true, for a human translator. Your knowledge of the technical field itself is a resource you can use to aid in your translation of technical texts. For machines, it's usually necessary to use a translator specifically geared to the subject matter. For instance, you would definitely want to use a different machine translator for a newspaper article as opposed to a biomedical research journal.

This new approach is supposed to mitigate these problems. If they can do a good job of it, they may be able to bring machine translation to areas where previously human translators have been required or greatly preferred.

Re:Translating specialised texts ...

[Beryllium Sphere(tm) (193358)]

Absolutely true. One of Beryllium Sphere's partners is a computational linguist. For quite a while her bread and butter was building representations of knowledge about heavy equipment maintenance to support automatic translation of Caterpillar Tractor technical manuals.

There's more to help you than just the specialized vocabulary. It's good that "crankshaft" is unambiguous but it also helps to know in advance that "bolt" will be a noun and not a verb.

Also, to be blunt, nobody expects technical prose to so

DadaDodo

[Tripax (162140)]

This reminda me of Jamie Zawinskies hack Dadadodo [jwz.org] which used probability trees to create new texts from old texts by examining the probability any given word follows the previous word/string of words. I always thought his program was cool, in that his description of it involved Markov Chains and William S. Burroughs.

Mission statements

[Savage-Rabbit (308260)]

That thing reminds me of Dilbert's mission statement generator. [dilbert.com] The scary thing is that the material from Dilbert's babble engine actually sounds like alot of the stuff you are likely to find on actual corporate websites.

Microsoft Research already does this

[drdink (77)]

I did a presentation for an AI class a while ago and discovered that Microsoft already does this with their MSR-MT [microsoft.com] project. Apparently the Spanish entries in their Knowledge Base were translated by this as well.

Arabic to English

[Caseyscrib (728790)]

I'd like to see an arabic-to-english translator. I was interested in reading news from the middle east, because I don't particularly trust our media to translate it properly. A good example of this is Bin Laden's transcript [kuro5hin.org].

After a quick web search, all I was able to find was this site [sakhr.com], which has a pretty sketchy TOS agreement.

Re:Arabic to English

[Caseyscrib (728790)]

I never said I trusted either source. But when you can read Arabic propaganda and contrast it with your own media's propaganda, it helps you to understand what the underlying causes for war are. It is also key to recognizing the true aggressor, because in every war both governments play the "good guys" role to their citizens. Direct translation helps you to understand the culture of your enemy. Things as simple as webpage advertisements, editorials, personals, etc, are lost in translation by CNN and the

Dragon Naturally Speaking

[headkase (533448)]

Using statistical methods to predict the next item in a sequence is still not true hard ai though, this technique is used with the voice recognition software "Dragon Natually Speaking" creating in effect pattern chains. What Dragon did on the character level this software appears to do on the word level. This is still not true AI however, as the statistics will only map to probabilistic sequences not abstractly map instead to the concepts. What would really impress me is if they came up with a mapping algorithm that instead of using probability used a function like mini-max fitness testing on a neural-network substrate.
It would be interesting to see the results of analysing large sections of languages however, but the only immediate use I can fathom for this would be for cryptography or information compression algorithms. However the results could probably be used to provide insight into how languages evolve or how memes spread from language to language.
Or the brief explanation in the article did not make it clear enough how this differs from what was previously state-of-the-art, e.g. Dragon.

Time flies like an arrow...

[Secret Agent 99 (855215)]

...and fruit flies like a banana.

When an automated translator can handle that one without bursting into flames, I'll start to believe.

How is that news? Research was done 10 years ago.

[by Anonymous Coward]

The basic approach has been developed over 10
years ago by IBM: The Mathematics of Statistical Machine Translation [upenn.edu]. And even free software has been available for a while, see
http://www.fjoch.com/GIZA++.html [fjoch.com].

It's only a matter of time before...

[gkwok (773963)]

Skynet begins to learn at a geometric rate. It becomes self-aware at 2:14am Eastern Time....

No samples?

[Guspaz (556486)]

Sounds interesting, but I couldn't find a single sample translation on their site; ie a block of text in language A (Say, french), and language B (Say, english). Translated from A to B by their software.

Without even the simplest of examples or samples we have only their word on how well this works.

DOOMED

[FoXDie (853291)]

Recently robots have been made that can Run, Wield shotguns, and Recognize faces. Now they can read. [DOOMED I SAY]

Too bad about the times it needs to think

[Timbotronic (717458)]

I like the approach they've taken, but machine translation can only ever go so far.

A friend of mine was trying to translate an English novel into German a while back. She had to work out a replacement for a sentance where the word 'therapist' was construed as 'the rapist'. Hell of a job and she's a professional translator.

Automatic translation looks pretty good for technical documents, news and anything completely literal. When you get writing with double meanings, humour and plays on words it gets way harder - often to the point where there is no correct translation.

Tests

[headkase (533448)]

The biggest test of the translator is converting from one language to another and then back again multiple times. If the content doesn't get corrupted then it works as advertised.

Johnny Five Alive

[Anne Thwacks (531696)]

Input...Need more Input

Re:Universal Translator

[ari_j (90255)]

I was thinking the same thing - I don't have time to investigate how it works, but if you created one that translated symbolically-represented phonemes (languages other than Germanic and Eastern probably know this concept as "spelling") you'd have a pretty good system going. From the article lead-in here on Slashdot, it sounds as if it will take the basic rules of a language and maybe some "seed" data, and from there learn by comparing text in language A and language B that have the same meaning.

so how can they grade you in school?

[cheekyboy (598084)]

One has to wonder if the language of choice English or whatever is so structured and rule ridden and not just made up on the fly. Then how come its so difficult to determine all the rules? Is it there are too many of them? too many contexes? Or just trying to translate bad grammer which fails the rules but any human can decipher it.

Sometimes brute force, ie look up tables for 100000000 translated versions can be better, so much for logic eh :-)