Friday, January 13, 2006

Is language learning Bayesian?

There's an interesting article in The Economist about how Bayesian statistics are increasingly being used in the cognitive sciences [via MindHacks]. Two researchers set out to test how well humans apply Bayesian reasoning, by giving them nuggets of information and asking them to draw general conclusions.

For example, many of the participants were told the amount of money that a film had supposedly earned since its release, and asked to estimate what its total “gross” would be, even though they were not told for how long it had been on release so far.
...
All of these things have well-established probability distributions, and all of them, together with three other items on the list—an individual's lifespan given his current age, the run-time of a film, and the amount of time spent on hold in a telephone queuing system—were predicted accurately by the participants from lone pieces of data.

The participants in the study could moreover hold their own for data with many different sorts of naturally-occurring prior distributions. (Priors are "assumption[s] about the way the world works...that can be expressed as a mathematical probability distribution of the frequency with which events of a particular magnitude can happen.") Psychologists therefore suggest...

...that the Bayesian capacity to draw strong inferences from sparse data could be crucial to the way the mind perceives the world, plans actions, comprehends and learns language, reasons from correlation to causation, and even understands the goals and beliefs of other minds.

Hmm. Drawing strong inferences from sparse data? Sounds a lot like a solution to the problem of the poverty of the stimulus. But if language learning is Bayesian, then what is the prior? Does the prior = UG? What structure would it take? How are language universals encoded into it? Are language universals encoded into it? Certainly an interesting problem to think about.

Links:
Original paper [pdf]
Tom Griffiths' webpage, which includes a Bayesian reading list.
Josh Tenenbaum's webpage, which also has a paper on word-learning as Bayesian inference.

1 Comments:

Blogger kold_kadavr_ flatliner said...

Dunno, Paw...
yet, heer's my goldang take...

Would U please help a plethora of King Size, wildchild, rawkuss wordz which are lookin 4 a home in thy novelty?? Thx. Whew. They're pretty insane. They're bereft of reason. Oi! Blimey! They're bloody PINK spiders!!!

Gotta lotta gobba shrewd, surreal, supersonic, sardonic satires, sassy N savvy elixers N electronic elegance on our YOUTHwitheTRUTH blogs. Wannum? Have'm. N'joym. Gettm outta my hair!!!

How mucha wanna betcha our irrational, antioxident, hot-shot, full-throttle, pleasure-beyond-measure, fuse-blowin-exploits R a copious madhouse of one lavish bookay D.O.A.? Our proFUSE NRGod who leads U.S. to explosive fairy-tales in the 'one-stop-shop' symphony Upstairs? God's the BigDude, the Owner of ElysianFields, the Grand Prize, the Austere Overdrive, NoPurchaseNecessary: our bombastic tenaCITY on a Hill which'll plant the Seeds 4u2 grow-up to new N greater heights!! Mama mia! Thatsa good pasta!!

CAUTION: our 22ish, avant-guard, accurately-atrocious, offa-the-reservation-like-Jimmy-Hoffa, metal-breadcrumm-fabYOUlishousness R sooo out-of-order, toots, they're an intimate wealth of bottomless sophistication. And dats da fak, Jak. Go ahead. Sue me. Yawn. But, yet, here's the perennial KOO D'TAH: who else has actually SEEN the Great Beyond in spirit & lived to tella youse bout the bionic, bloated, brevity-like-earth we're living on?? Yes, earthling, I had an NDE, almost salivating4salvation. So gain altitude, never attitude: death has no favorites.

If Mr. abSUREditty's an ultra-great-reward, and not everyone enters, Q: why is it an excruciating deluge of epic-.357-caliber where the quality's a limitless bulldozer plowin, pushin-your-power-cord with eternal goodies? A: the Prize-A+-TheEnd just gives U.S. moe-curley-graphix 2 VitSee: an explosion-of-extravagance which few R asking 4 anymore! Grrr. They're too concerned withe grotesque sanity of ambivilant, whorizontal piss-ants which swiftly crawl like lemmings to their scorecard destruction. C'est la guerre.

THANK GAWWWD!!! the Don has the ebullient BAWLS!!! to do the Manifest Destiny!!! To lead U.S. forward to the White House Upstairs with his SQUARES!!!

So, break-free, earthling; be like a contraversial outgrowth of incredibly-intoxicating-effusiveness in your zeitgeist. Wiseabove. Wanna join this useFULL idiot Upstairs 4 the most zany, kooky, X-acto-knife antidotes? Extremely exquisite, explicit endorphins in abundance? Puh-lenty of pulverizingly-tantalizing psychopathic psychosomatics with eXtras? i2i-kick-velocity's-ass-ultra-maximum-rocket-fuel-party-hardy at my pad ya ever encountered without d'New Joisey accent 4 an eternal slew of precarious, magnanimous & primeval absurdities indelibly etched in the granite corridors of eternity with a total-barrage-of-melt-in-thy-mouth 'depth-of-undenial'???

Make Your Choice -SAW
...cuzz nobody gitts outta here alive, earthling.

1:14 PM  

Post a Comment

<< Home