User Tools

Site Tools


«– HUMANOBS.ORG | Main Page | Schedule

Daniel Silver: Inductive Transfer, Machine Lifelong Learning and AGI

Invited Lecture I - August 3, 2012

Core arguments at a glance

  • Machine learning
  • Inductive transfer and transfer learning
  • Machine Lifelong Learning and its relevance to AGI
  • Examples of Transfer Learning and Machine Lifelong Learning


We will cover machine learning fundamentals, recent work on transfer learning, and its importance in the larger contexts of Machine Lifelong Learning and AGI. More specifically, Context-sensitive Multiple Task Learning, or csMTL, is presented as a method of transfer learning which uses a single output neural network and additional contextual inputs for learning multiple tasks. Motivated by problems with the application of standard MTL networks to machine lifelong learning, csMTL was developed and found to improve predictive performance for a primary task from impoverished training sets when learning in the presence of related tasks. We will show that the reason for this performance improvement is a reduction in the number of effective free parameters in the csMTL network brought about by the shared output node and weight update constraints due to the context inputs. An examination of other ML models developed from csMTL encoded data provides initial evidence that this improvement is not shared across all machine learning algorithms. Connections to recent work in Deep Learning Architectures will be made. And an interesting csMTL application that transfers knowledge between image transformation tasks will be demonstrated using some familiar facial images.

Readings For This Presentation

From Our Required Readings List

  • Silver, D.L., Poirier, R., Currie, D. (2008). Inductive transfer with context-sensitive neural networks. Machine Learning 73(3): 313-336. PDF
  • Silver, D.L. (2011). Machine Lifelong Learning: Challenges and Benefits for Artificial General Intelligence. AGI 2011: 370-375. PDF
public/events/agi-summerschool-2012/danny.txt · Last modified: 2012/08/13 09:12 by thorisson