University Homepage School Homepage School Contacts School Search

 

Matthew Stone

Department of Computer Science and Center for Cognitive Science Rutgers University

Towards a computational account of knowledge, action and instruction

Abstract

"Enter your name in the first line of the form" is a very simple instruction, yet it places an almost paradoxical requirement on a speaker issuing it.

The speaker means this description to identify an action to the hearer. Thus, to be confident in the instruction, the speaker must know that the hearer can select the right action using the description. Yet, normally the speaker will not know what the hearer will enter to fulfill the directive. In this sense, the speaker cannot know what the hearer will do.

Reconciling these requirements depends on the speaker's representing different states of knowledge explicitly and reasoning about them correctly. In my overview talk, I motivate one such reconciliation, based on three points:

1. A modal first-order logic of knowledge can provide a language in which specifications and queries of agents' abilities have a natural form involving existential quantifiers and hypothetical implications.
2. Such queries can be posed and evaluated with predictable search using a logic programming proof procedure for this language.
3. To plan and validate abstract instructions in NLG, we can therefore create a modal specification of the private and shared information of the hearer and perform an incremental assessment of sentence interpretation using logic programming queries.

Subsequent talks substantiate each of these claims in detail.