darb.ketyov.com

Caveat lector: This blog is where I try out new ideas. I will often be wrong, but that's the point.

Home | Personal | Entertainment | Professional | Publications | Blog

Search Archive

Loading...

21.3.14

A decade of reverse-engineering the brain

Salesmanship trumps science. Every. Single. Time.

The big news in the tech world today is the superstar team-up of Elon Musk, Mark Zuckerberg, and Ashton Kutcher investing $40M in Vicarious, whose aim is to, "[t]ranslate the neocortex into computer code". Because then “you have a computer that thinks like a person," according to Vicarious co-founder Scott Phoenix. “Except it doesn’t have to eat or sleep.”

I took at look at this mystery team of neuroscientists who've secretly reverse-engineered how the human brain works and, according to the Vicarious team page, the scientific talent (and I assume lead) is Dileep George.

George was formerly the CTO of Numenta, the company that was spun out of Palm founder Jeff Hawkins' book On Intelligence (which is a fine book with a neat theory, by the way).

Hawkins founded the Redwood Neuroscience Institute which eventually was absorbed into UC Berkeley as the Redwood Center for Theoretical Neuroscience. This was all happening right when I began my PhD at Berkeley.

In 2004.

George gave a talk at the Accelerating Change conference in 2005, the abstract of which reads:
We are at a juncture where great progress has been made in the understanding of the workings of the human neocortex. This gives us a unique opportunity to convert this knowledge into a technology that will solve important problems in computer vision, artificial intelligence, robotics and machine learning. In this talk, based on joint work with Jeff Hawkins, I will describe the state of our understanding of neocortical function and the role Numenta is playing in the development of a new technology modeled after the neocortex.
My question is, how is Vicarious different? What's changed in the last 9 or 10 years or so? Because the high-level press release stuff sounds exactly the same as the Numenta stuff from a decade ago.

What happened to Numenta's lofty aims?

They're now called "Grok" and, according to their about page:
Grok, formerly known as Numenta, builds solutions that help companies automatically and intelligently act on their data. Grok’s technology and product platform are based on biologically inspired machine learning technology first described in co-founder Jeff Hawkin's book, On Intelligence. Grok ingests data streams and creates actionable predictions in real time. Grok's automated modeling and continuous learning capabilities makes it uniquely suited to drive intelligent action from fast data.
George did some amazing computational neuroscience research at Numenta. But for all the talk about how slow academia is, you'd think after ten years and tens (hundreds?) of millions of dollars spent in the fast-paced world of private industry, the sales pitch would have changed by now.

The Blue Brain Project is nearing the end of its first decade as well. And, again, there's some great work coming out of these places, but I cannot overstate my frustration at the hype-to-deliverables ratio of these organizations.

Granted, I wasn't in the meetings. Maybe a lot has changed, but none of that change is making its way out to anywhere where the rest of us can see it.

Having watched this stuff for a decade now, the grand promises have not been delivered on. It's clear to me that VCs need some skeptics on their advisory teams. Any neuroscientist and/or machine learning researcher in that meeting would certainly ask:

"What's different?"