| Reference code: | PT/FB/BL-2012-224.10 |
| Location: | Arquivo PCA - Pasta 16/2012
|
Title:
| Hear my lips: Implicit detection of asynchronous audio-visual speech
|
| Publication year: | 2015
|
URL:
| http://ecem2015.univie.ac.at/fileadmin/user_upload/k_ecem2015/proceedings/ECEM2015_Abstracts_150821
|
| Abstract/Results: | ABSTRACT:
When watching TV we often have the impression that poorly synchronised audio can “popout”, drawing attention to the speaking actor’s mouth. But how does such capture relate to the levels at which audiovisual asynchrony detection becomes explicit?
Participant eye movements were recorded while they watched an edited thirteen minute TV interview. Unbeknownst to participants, the audiovisual synchrony was manipulated across cuts to create eleven synch conditions between -200ms (audio first) and +200ms (video first). Each synch condition was presented twice with a return to 0ms in between. Conditions gradually increased across the video, +40 to +200ms, then decreased from -40ms to -200ms. Following the initial free-viewing, participants were then instructed to explicitly identify whether the audio was in synch for a 5s clip taken from the same interview under the same eleven synch conditions.
Analysis of participant eye movements during free-viewing revealed a significant bias towards the mouth and away from the eyes at -120ms, +80ms and +120ms asynchrony, levels at which asynchrony was not explicitly detected. These results indicate that asynchronous audiovisual speech captures overt attention even when the degree of asynchrony is subthreshold for explicit awareness and may be used as a measure of implicit asynchrony detection.
|
| Accessibility: | Document exists in file
|
Language:
| eng
|
Author:
| Smith, T.
|
Secondary author(s):
| Batten, J., Seppälä, K., Bedford, R.
|
Document type:
| Conference abstract
|
Number of reproductions:
| 1
|
Reference:
| Smith, T., Batten, J., Seppälä, K., & Bedford, R. (2015). Hear my lips: Implicit detection of asynchronous audio-visual speech
by eye movements. In Ansorge, U, Ditye, T., Florack, A. & Leder, H. (Eds), ECEM 2015 - Abstracts of the 18th European Conference on Eye Movements (p. 121). Vienna, Austria. |
| Indexed document: | No
|
| Keywords: | Eye movements / Visual attention
|
<!-- mm occ=1 guid=[ca64f27d5ad22c3fa1a3ed52dc7403da] WebBehavior$=[2] --> |