ANC Seminar - David Hogg

Tuesday, 7th November 2023

Joint learning of visual concepts and natural language

Abstract: 

Large language models and deep learning from sensory data are transforming AI. This work has highlighted the importance of a conceptual understanding that can support human-like reasoning.  The absence of this understanding in current models limits transparency and veracity.  

In this talk, I will describe a system (OLAV) for bootstrapping knowledge in language and vision using grammar induction and word grounding to the perceptual world. The motivation is to explore approaches that might be adapted in combination with deep learning and large language models to support conceptual reasoning. 

OLAV is able to learn to form discrete concepts from sensory data, ground language to these concepts and induce a grammar for describing the perceptual world. The learning is based on raw linguistic and visual data. 

Bio: 

David’s research is on artificial intelligence, particularly in the area of computer vision. He pioneered the use of three-dimensional geometric models for tracking flexible structures such as the human body in natural scenes, and contributed to establishing statistical approaches to learning of shape and motion as one of the pre-eminent paradigms in the field. He works extensively across disciplinary boundaries, applying AI in engineering, biology, and medicine. He has been Pro-Vice-Chancellor for Research and Innovation at Leeds, visiting professor at the MIT Media Lab, chair of the EPSRC ICT Strategic Advisory Team, and chair of the Academic Advisory Group of the Worldwide Universities Network. He is a Turing Fellow, Fellow of the European Association for Artificial Intelligence (EurAI), a Distinguished Fellow of the British Machine Vision Association, and a Fellow of the International Association for Pattern Recognition. He is Director of the UKRI Centre for Doctoral Training in AI for Medical Diagnosis and Care. 

Event type: Seminar

Date: Tuesday, 7th November

Time: 11:00

Location: G.03

Speaker(s): David Hogg

Chair/Host: Chris Williams