Shortcomings of Deep Learning

是 否 +2 论坛币

k人 参与回答

经管之家送您一份

应届毕业生专属福利!

求职就业群

赵安豆老师微信：zhaoandou666

经管之家联合CDA

送您一个全额奖学金名额~ !

立即领取

感谢您参与论坛问题回答

经管之家送您两个论坛币！

+2 论坛币

By Oren Etzioni, CEO of the Allen AI, Founder of Farecast, Professor at UW, CSE

Deep Learning has been incredibly successful in recent years, but it is still merely a tool for classifying items into categories (or for nonlinear regression).

We have seen outstanding results in mapping images, audio segments, even board positions, into categories with ever-increasing accuracy, but AI needs to go way beyond classification and regression.

Let's talk about AlphaGo, which is a phenomenal technical achievement by the team at DeepMind.

Yet, the overblown claims about the impressive success of AlphaGo are a case of a person climbing to the top of the tree and shouting "I'm on my way to the moon!"

Here's why:

• AlphaGo relied on a massive amount of labeled data, which is easily available in games, and often unavailable in other contexts. Consider, for example, classifying citations into "influential" versus "not" in Semantic Scholar. While unlabeled data is plentiful, labeled data is difficult to obtain.
• We don't know how to build sophisticated background knowledge or reasoning capabilities into deep learning systems.
• AlphaGo relied on a set of manually-crafted neural networks, that have to be changed from application to application.
• AlphaGo relied on people to specify its input representation and its output target categories--it cannot specify its own.
• In many cases, even specifying the appropriate categories is difficult due to nuance, ambiguity, etc.
  

The bottom line is: when we successfully define an objective function and reduce a real-world task to an optimization problem -- our CS "muscles" kick into overdrive, and we can solve it given enough data and a successful representation (sooner or later). However, may problems are ill-structured and require additional analysis to even formalize. For example, how do we formally write down the meaning of a single sentence?

Most of these comments are not specific to AlphaGo or Deep Learning, but are broadly applicable to all supervised learning programs. As Alan Newell said (in a different context), "you can't play 20 questions with nature and win!"

With all due respect to the brilliant Geoff Hinton, thought is not a vector, and AI is not a problem in statistics.

扫码加我 拉你入群

请注明：姓名-公司-职位

以便审核进群资格，未注明则拒绝

分享0 收藏1 回帖

关键词：Learning earning coming Learn Short successful beyond recent images about