The Next Generation of Neural Networks
BackGoogle Tech Talks November, 29 2007 In the 1980's, new learning algorithms for neural networks promised to solve difficult classification tasks, like speech or object recognition, by learning many layers of non-linear features. The results were disappointing for two reasons: There was never enough labeled data to learn millions of complicated features and the learning was much too slow in deep neural networks with many layers of features. These problems can now be overcome by learning one layer of features at a time and by changing the goal of learning. Instead of trying to predict the labels, the learning algorithm tries to create a generative model that produces data which looks just like the unlabeled training data. These new neural networks outperform other machine learning methods when labeled data is scarce but unlabeled data is plentiful. An application to very fast document retrieval will be described. Speaker: Geoffrey Hinton Geoffrey Hinton received his BA in experimental psychology from Cambridge in 1970 and his PhD in Artificial Intelligence from Edinburgh in 1978. He did postdoctoral work at Sussex University and the University of California San Diego and spent five years as a faculty member in the Computer Science department at Carnegie-Mellon University. He then became a fellow of the Canadian Institute for Advanced Research and moved to the Department of Computer Science at the University of Toronto. He spent three years from 1998 until 2001 setting up the Gatsby Computational Neuroscience Unit at University College London and then returned to the University of Toronto where he is a University Professor. He holds a Canada Research Chair in Machine Learning. He is the director of the program on "Neural Computation and Adaptive Perception" which is funded by the Canadian Institute for Advanced Research. Geoffrey Hinton is a fellow of the Royal Society, the Royal Society of Canada, and the Association for the Advancement of Artificial Intelligence. He is an honorary foreign member of the American Academy of Arts and Sciences, and a former president of the Cognitive Science Society. He received an honorary doctorate from the University of Edinburgh in 2001. He was awarded the first David E. Rumelhart prize (2001), the IJCAI award for research excellence (2005), the IEEE Neural Network Pioneer award (1998) and the ITAC/NSERC award for contributions to information technology (1992). A simple introduction to Geoffrey Hinton's research can be found in his articles in Scientific American in September 1992 and October 1993. He investigates ways of using neural networks for learning, memory, perception and symbol processing and has over 200 publications in these areas. He was one of the researchers who introduced the back-propagation algorithm that has been widely used for practical applications. His other contributions to neural network research include Boltzmann machines, distributed representations, time-delay neural nets, mixtures of experts, Helmholtz machines and products of experts. His current main interest is in unsupervised learning procedures for neural networks with rich sensory input.
Category: People
Uploaded: December 4th, 2007 @ 10:13 am
Author: googletechtalks
Length: 59:23
Rating:
Views: 53,891
Tags: education engedu google googletechtalks talk talks techtalk techtalks
Related Video Links:
» View Video Comments For The Next Generation of Neural Networks
» View googletechtalks's Other Uploaded Videos
Video Thumbnails:
Video Embedding Code:
* Embed this video on your website, social bookmark, myspace, or blog.
-
Pages:
Home
YouTube's Blog -
Tags:
fire fighter tattoo fire island angel fire fire station fire door jada fire fire ant essential of fire fighting ring of fire fire rescue high on fire fire hot quote street of fire gates of fire pokemon fire red fire magic fire fighter picture fire hell sex after the fire used fire truck house fire st elmos fire fire hose petroleum chicago fire fire fire fire mountain gem fire pit malibu fire fire video fire and water damage restoration fire in the sky fire fighter jobs pokemon fire red cheat fire fire hair like teach fire fighting wild fire fire dragon fire apparatus boy set fire earth wind and fire fire protection and prevention fire and ice fire fighting equipment fighter fire layout myspace comet on fire angel fire new mexico jada fire clip fire crotch jade fire fire engine fire works we didnt start the fire fire hydrant new london fire fire truck harry potter and the goblet of fire asphalt cement fire catch a fire fire starter girl on fire edie fire extinguisher fire escape fire mountain fire dept fire prevention and safety fire safe hearts on fire angel circumventor fire playing with fire angel fire resort fire picture fire academy a song of ice and fire fire fox propane fire chariot of fire fire prevention fire alarm system light my fire fire protection forest fire fire department fire sprinkler outdoor fire pit fire in one wing fire fighter fire emblem chicago fire department playing with fire 2 fire rhapsody play with fire great fire of london day of fire arcade fire fire alarm fire king fire safety man on fire fire equipment andrew bird bowl of fire