Doctor Jeesun Kim
ASSOCIATE PROFESSOR,
The MARCS Institute
Personal
Qualifications
- PhD University of New South Wales
- MSc University of New South Wales
UWS Organisational Unit (School / Division)
- The MARCS Institute
Contact
| Email: | J.Kim@uws.edu.au |
|---|---|
| Extension: | 6856 |
| Mobile: | |
| Location: | 1.1.56 Bankstown |
| Website: |
PLEASE NOTE: obtaining information from this Directory must be for the legitimate purposes of doing business with and within the University of Western Sydney (UWS), and must not be used for unsolicited bulk e-mailing (spamming) or similar purposes.
Biography
Kim's broad research interest is in the processes involved in the perception and production of communication-related information using the auditory and visual modalities. Her research activity involves collaboration with engineers, mathematicians, computer scientists, as well as other psychologists in Australia and overseas (e.g., Germany, Finland, France, Korea, the Netherlands & the USA). Her recent work includes measuring/analyzing/animating facial movements of talkers in various conditions and testing how such conditions impact on the perception of visual and auditory-visual speech. Starting with an ARC IREX fellowship (2000), Kim has been awarded a number of national and international fellowships. In 2001 she was awarded a prestigious National Academy of Education Postdoctoral Fellowship, in 2002 an APD fellowship, and more recently a QEII fellowship (2006). She has been invited 6 times as a visiting scholar to the Max Planck Institute for psycholinguistics. Kim has contributed to her research field by assisting in the organization of a number of academic conferences. For example, in 2004, she was the organiser of a special Auditory-Visual Speech session at Interspeech 2004. Also, she has been a member of the Scientific Reviewer Committee of Interspeech - Eurospeech since 2005. In addition, she is a casual referee for a number of international journals.
This information has been contributed by Doctor Kim.
Publications
Chapters in Books
- Kim, J. and Davis, C. (2009), 'Developmental reading disorders in Korean', The Handbook of East Asian Psycholinguistics, Volume III Korean, Cambridge University Press 9780521833356.
- Davis, C. and Kim, J. (2006), 'Changing circumstance: How flexible is lexical access', From Inkmarks to Ideas, Psychology Press .
- Kim, J. and Davis, C. (2006), 'Literacy acquisition in Korean Hangul', Handbook of Orthography and Literacy. Part1, Lawrence Erlbaum .
- Davis, C., Kim, J. and Sanchez-Casas, R. (2003), 'Masked priming across languages: An insight into bilingual lexical processing', Masked Priming: State of the Art, Psychology Press .
Journal Articles
- Cvejic, E., Kim, J. and Davis, C. (2012), 'Recognizing prosody across modalities, face areas and speakers: Examining perceivers' sensitivity to variable realizations of visual prosody', Cognition, 12.
- Harry, B., Davis, C. and Kim, J. (2012), 'Subliminal access to abstract face representations does not rely on attention', Consciousness and Cognition, 11.
- Cvejic, E., Kim, J. and Davis, C. (2012), 'Effects of seeing the interlocutor on the production of prosodic contrasts (L)', Journal of the Acoustical Society of America, -86.
- Harry, B., Davis, C., Davis, C. and Kim, J. (2012), 'Exposure in central vision facilitates view-invariant face recognition in the periphery', Journal of Vision, .
- Harry, B., Davis, C., Davis, C. and Kim, J. (2012), 'Common and distinct mechanisms associated with view-specific and view-invariant recognition', Consciousness and Cognition, 2.
- Kim, J. and Davis, C. (2012), 'Perceiving emotion from a talker: How face and voice work together', Visual Cognition, 20.
- Harry, B., Davis, C., Davis, C. and Kim, J. (2012), 'Common and distinct mechanisms associated with view-specific and view-invariant recognition', Consciousness and Cognition, 2.
- Harry, B., Davis, C. and Kim, J. (2012), 'Subliminal access to abstract face representations does not rely on attention', Consciousness and Cognition, 11.
- Harry, B., Davis, C. and Kim, J. (2012), 'Exposure in central vision facilitates view-invariant face recognition in the periphery', Journal of Vision, 9.
- Kim, J. and Davis, C. (2012), 'Perceiving emotion from a talker : how face and voice work together', Visual Cognition, 20.
- Cvejic, E., Kim, J. and Davis, C. (2012), 'Recognizing prosody across modalities, face areas and speakers : examining perceivers' sensitivity to variable realizations of visual prosody', Cognition, 12.
- Cvejic, E., Kim, J. and Davis, C. (2012), 'Effects of seeing the interlocutor on the production of prosodic contrasts (L)', Journal of the Acoustical Society of America, -86.
- Burnham, D., Kim, J., Davis, C., Ciocca, V., Schoknecht, C., Kasisopa, B. and Luksaneeyanawin, S. (2011), 'Are tones phones?', Journal of Experimental Child Psychology, 20.
- Davis, C. and Kim, J. (2011), 'What's in a mask? Information masking with forward and backward visual masks', Quarterly Journal of Experimental Psychology, 13.
- Kim, J., Sironic, A. and Davis, C. (2011), 'Hearing speech in noise: Seeing a loud talker is better', Perception, 10.
- Kim, J., Kroos, C. and Davis, C. (2010), 'Hearing a point-light talker: An auditory influence on a visual motion detection task', Perception, 12.
- Cvejic, E., Kim, J. and Davis, C. (2010), 'Prosody off the top of the head: Prosodic contrasts can be discriminated by head motion', Speech Communication, 10.
- Davis, C., Kim, J. and Barbaro, A. (2010), 'Masked speech priming: Neighborhood size matters (L)', Journal of the Acoustical Society of America, 4.
- Hazan, V., Kim, J. and Chen, Y. (2010), 'Audiovisual perception in adverse conditions: Language, speaker and listener effects', Speech Communication, 14.
- Kim, J. and Davis, C. (2010), 'Knowing what to look for: Voice affects face race judgements', Visual Cognition, 17.
- Kim, J., Davis, C. and Groot, C. (2009), 'Speech identification in noise: Contribution of temporal, spectral, and visual speech cues', Journal of the Acoustical Society of America, 12.
- Davis, C., Kim, J. and Forster, K. (2008), 'Being forward not backward: Lexical limits to masked priming', Cognition, 12.
- Davis, C., Kislyuk, D., Kim, J. and Sams, M. (2008), 'The effect of viewing speech on auditory speech processing is different in the left and right hemispheres', Brain Research, 11.
- Kim, J., Davis, C. and Cutler, A. (2008), 'Perceptual tests of rhythmic similarity: II. Syllable rhythm', Language and Speech, 17.
- Davis, C. and Kim, J. (2006), 'Audio-visual speech perception off the top of the head', Cognition, .
- Warner, N., Kim, J., Davis, C. and Cutler, A. (2005), 'Use of complex phonological patterns in processing: Evidence from Korean', Journal of Linguistics, 35.
- Kim, J., Davis, C., Burnham, D. and Lukasaneeyanawin, S. (2004), 'The effect of script on poor readers' sensitivity to dynamic visual stimuli', Brain and Language, 10.
- Kim, J., Taft, M. and Davis, C. (2004), 'Orthographic and phonological links in the lexicon: When lexical and sublexical information conflict', Reading and Writing, 32.
- Kim, J. and Davis, C. (2004), 'Characteristics of poor readers of Korean Hangul: Auditory, visual and phonological processing', Reading and Writing, 33.
- Kim, J., Davis, C. and Krins, P. (2004), 'Amodal processing of visual speech as revealed by priming', Cognition, 9.
- Davis, C. and Kim, J. (2004), 'Audio-visual interactions with intact clearly audible speech', Quarterly Journal of Experimental Psychology, 19.
- Kim, J. and Davis, C. (2004), 'Investigating the audi-visual speech detection advantage', Speech Communication, 12.
- Kim, J. and Davis, C. (2003), 'Task effects in masked cross-script translation and phonological priming', Journal of Memory and Language, 16.
- Kim, J. and Davis, C. (2003), 'Hearing foreign voices: does knowing what is said affect visual-masked-speech detection', Perception, 10.
- Kim, J. and Davis, C. (2002), 'Using Korean to investigate phonological priming effects without the influence of orthography', Language and Cognitive Processes, 23.
- Kim, J. and Davis, C. (2001), 'Loss of rapid phonological recoding in reading Hanja, the logographic script of Korean', Psychonomic Bulletin and Review, 6.
- Davis, C. and Kim, J. (2001), 'Repeating and remembering foreign language words: Implications for language teaching system', Artificial Intelligence Review, 11.
Conference Papers
- Fitzpatrick, M., Kim, J. and Davis, C. (2012), 'The intellegibility of Lombard Speech: Communicative setting matters', Interspeech 2012, Portland, Oregon, US.
- Kim, J., Davis, C. and Kitamura, C. (2012), 'Auditory-visual speech to infants and adults: Signals and correlations', Interspeech 2012, Portland, Oregon, US.
- Joosten, B., Postma, E., Krahmer, E., Swers, M. and Kim, J. (2012), 'Automated measurement of spontaneous surprise', International Conference on Methods and Techniques in Behavioral Research, Utrecht, The Netherlands.
- Fitzpatrick, M., Kim, J. and Davis, C. (2012), 'The intelligibility of Lombard speech : communicative setting matters', Interspeech, Portland, Or..
- Kim, J., Davis, C. and Kitamura, C. (2012), 'Auditory-visual speech to infants and adults : signals and correlations', Interspeech, Portland, Or..
- Kim, J. and Davis, C. (2011), 'Testing Audio-Visual Familiarity Effects on Speech Perception in Noise', 17th International Congress of Phonetic Sciences, Hong Kong.
- Cvejic, E., Kim, J. and Davis, C. (2011), 'Temporal relationship between auditory and visual prosodic cues', Interspeech 2011, Florence, Italy.
- Kim, J. and Davis, C. (2011), 'Auditory speech processing is affected by visual speech in the periphery', Interspeech 2011, Florence, Italy.
- Paris, T., Kim, J. and Davis, C. (2011), 'Visual Speech Speeds Up Auditory Identification Responses', Interspeech 2011, Florence, Italy.
- Fitzpatrick, M., Kim, J. and Davis, C. (2011), 'The effect of seeing the interlocutor on speech production in different noise types', Interspeech 2011, Florence, Italy.
- Paris, T., Kim, J. and Davis, C. (2011), 'Visual Speech Influences Speeded Auditory Identification', International Conference on Audio-Visual Speech Processing 2011, Volterra, Italy.
- Cvejic, E., Kim, J. and Davis, C. (2011), 'Perceiving Visual Prosody from Point-Light Displays', International Conference on Audio-Visual Speech Processing, Volterra, Italy.
- Fitzpatrick, M., Kim, J. and Davis, C. (2011), 'The effect of seeing the interlocutor on auditory and visual speech production in noise', International Conference on Audio-Visual Speech Processing, Volterra, Italy.
- Kim, J. and Davis, C. (2011), 'Audiovisual speech processing in visual speech noise', International Conference on Audio-Visual Speech Processing, Volterra, Italy.
- Cvejic, E., Kim, J. and Davis, C. (2010), 'It's all the same to me: Prosodic discrimination across speakers and face areas', Speech Prosody 2010 Conference, Chicago, USA.
- Davis, C. and Kim, J. (2010), 'Transfer of Talker-Familiarity Effects', 20th International Congress on Acoustics, ICA 2010, Sydney, Australia.
- Fitzpatrick, M. and Kim, J. (2010), 'Audio-visual speech perception in noise by first and second language listeners', 20th International Congress on Acoustics, ICA 2010, Sydney, Australia.
- Cvejic, E., Kim, J. and Davis, C. (2010), 'Modification of prosodic cues when an interlocutor cannot be seen: The effect of visual feedback on acoustic prosody production', 20th International Congress on Acoustics, ICA 2010, Sydney, Australia.
- Kim, J. and Davis, C. (2010), 'Emotion perception by eye and ear and halves and wholes', 9th International Conference on Auditory-Visual Speech Processing, Japan.
- Cvejic, E., Kim, J. and Davis, C. (2010), 'Abstracting visual prosody across speakers and face areas', 9th International Conference on Auditory-Visual Speech Processing, Japan.
- Kitamura, C. and Kim, J. (2010), 'Infants match auditory and visual speech in schematic point-light displays', 9th International Conference on Auditory-Visual Speech Processing, Japan.
- Cvejic, E., Kim, J., Davis, C. and Gibert, G. (2010), 'Prosody for the Eyes: Quantifying Visual Prosody using Guided Principal Component Analysis', Interspeech 2010, Japan.
- Davis, C. and Kim, J. (2010), 'Is speech produced in noise more distinct and/or consistent?', 13th International Australasian Conference on Speech Science and Technology 2010, Melbourne, Australia.
- Cutler, A., Davis, C. and Kim, J. (2009), 'Non-automaticity of use of orthographic knowledge in phoneme evaluation', Interspeech 2009, Brighton, UK.
- Kim, J., Davis, C., Kroos, C. and Hill, H. (2009), 'Speaker discriminability for visual speech modes', Interspeech 2009, Brighton, UK.
- Kuratate, T., Ayers, K., Kim, J., Riley, M. and Burnham, D. (2009), 'Are Virtual Humans Uncanny?: Varying speech, appearance and motion to better understand the acceptability of synthetic humans', 2009 Conference on Audio Visual Speech Processing, Norwich, UK.
- Davis, C. and Kim, J. (2009), 'Recognizing spoken vowels in multi-talker babble: Spectral and visual speech cues', 2009 AVSP Conference, Norwich, UK.
- Kim, J., Kroos, C. and Davis, C. (2008), 'Hearing a talking face: An auditory influence on a visual detection task', The ISCA Research and Tutorial Workshop on Auditory-Visual Speech Processing (AVSP 2008), Moreton Island, Queensland, Australia.
- Burnham, D., Abrahamyan, A., Cavedon, L., Davis, C., Hodgins, A. and Kim, J. (2008), 'From Talking to Thinking Heads: 2008', The ISCA Research and Tutorial Workshop on Auditory-Visual Speech Processing (AVSP 2008), Moreton Island, Australia.
- Kuratate, T., Ayers, K., Kim, J. and Burnham, D. (2008), 'Exploring the Uncanny Valley Effect with Talking Heads', Interspeech 2008, Brisbane, Australia.
- Cvejic, E., Kim, J. and Davis, C. (2008), 'Visual Speech Modifies the Phoneme Restoration Effect', Interspeech 2008, Brisbane Australia.
- Davis, C., Kim, J. and Barbaro, A. (2008), 'Masked speech priming: No priming in dense neighbourhoods', Interspeech 2008, Brisbane Australia.
- Kim, J. and Davis, C. (2007), 'Restoration effects in auditory and visual speech', Auditory-Visual Speech Processing 2007, Hilvarenbeek, The Netherlands.
- Davis, C., Kim, J., Kuratate, T. and Burnham, D. (2007), 'Making a thinking-talking head', Auditory-visual Speech Processing 2007, Hilvarenbeek. The Netherlands..
- Mixdorff, H., Pech, U., Davis, C. and Kim, J. (2007), 'Map Task Dialogs in Noise - a Paradigm for Examining Lombard Speech.', 16th International Congress of Phonetic Sciences, Saarbrucken, Germany.
- Davis, C., Sironic, A. and Kim, J. (2006), 'Perceptual processing of audiovisual Lombard speech', Australian International Conference on Speech Science & Technology, Auckland, New Zealand.
- Cutler, A., Kim, J. and Otake, T. (2006), 'On the Limits of L1 Influence on Non-L1 Listening: Evidence from Japanese Perception of Korean', Australian International Conference on Speech Science & Technology, Auckland, New Zealand.
- Davis, C., Kim, J. and Sironic, A. (2006), 'In-Quiet and Lombard Audiovisual Speech', 7th International Seminar on Speech Production, Ubatuba SP BRAZIL.
- Davis, C., Kim, J., Grauwinkel, K. and Mixdorff, H. (2006), 'Lombard speech: Auditory (A), Visual (V) and AV effects', Speech Prosody 2006, .
- Kim, J., Davis, C., Vignali, G. and Hill, H. (2005), 'A visual concomitant of the lombard reflex', AVSP'2005, .
- Kim, J. and Davis, C. (2004), 'Audio-Visual Spoken Language Processing', INTERSPEECH - ICSLP 2004, Seoul Korea.
- Davis, C. and Kim, J. (2004), 'Off the top of the head: Audio-Visual Speech Perception from the nose up', INTERSPEECH - ICSLP 2004, Seoul Korea.
Research
Current Projects
| Title: | Understanding speech in noise: linking perception and computation |
|---|---|
| Years: | 2013-03-01 - 2016-02-29 |
| ID: | P00020814 |
| UWS Researchers: | Jeesun Kim and Christopher Davis |
| Funding: |
|
| Title: | Motherese by ear and eye: Infant perception of visual prosody |
| Years: | 2012-03-01 - 2015-02-28 |
| ID: | P00020110 |
| UWS Researchers: | Christine Kitamura and Jeesun Kim |
| Funding: |
|
Previous Projects
| Title: | Dynamic Auditory-Visual Humans |
|---|---|
| Years: | 2007-08-06 - 2008-12-31 |
| ID: | P0015758 |
| UWS Researchers: | Christopher Davis, Denis Burnham, Catherine Best, Roger Dean, Catherine Stevens, Jeesun Kim, Takaaki Kuratate, Christian Kroos, Michael Tyler and Connie So |
| Funding: |
|
| Title: | Micro-Structural Training for Speech Segmentation in a Second Language |
| Years: | 2007-12-10 - 2009-07-31 |
| ID: | P0015901 |
| UWS Researchers: | Anne Cutler and Jeesun Kim |
| Funding: |
|
| Title: | Putting international heads together: Building on the UWS Thinking Head Project |
| Years: | 2007-06-05 - 2012-12-31 |
| ID: | P0015655 |
| UWS Researchers: | Christopher Davis, Jeesun Kim, Takaaki Kuratate and Denis Burnham |
| Funding: |
|
| Title: | Establishing how head and face movement properties contribute to the perception of speech and identity |
| Years: | 2006-09-01 - 2012-01-31 |
| ID: | P0015312 |
| UWS Researchers: | Christopher Davis and Jeesun Kim |
| Funding: |
|
| Title: | Disrupting visual awareness using the new Transcranial Magnetic Stimulation (TMS) laboratory at UWS |
| Years: | 2006-12-20 - 2010-02-15 |
| ID: | P0015439 |
| UWS Researchers: | Christopher Davis and Jeesun Kim |
| Funding: |
|
| Title: | Clear speech strategies: How auditory/visual cues are weighted |
| Years: | 2011-06-29 - 2012-12-31 |
| ID: | P00020270 |
| UWS Researchers: | Jeesun Kim |
| Funding: |
|
Supervision
Doctor Kim is available to be a principal supervisor for doctoral projects
Current Supervision
| Title: | Improving Segmentation of Continuous Speech in a Second Language: Establishing a Difficulty Gradient for English Phonotactic Sequences for Mandarin and Arabic Listeners |
|---|---|
| Field of Research: | |
| Title: | Understanding Audiovisual Interaction using Behaviour and Brain Based Measures |
| Field of Research: | |
| Title: | Hearing Under Difficult Circumstances |
| Field of Research: |
Previous Supervision
| Title: | It's not just what you say, but also how you say it: Exploring the Auditory and Visual Properties of Speech Prosody |
|---|---|
| Field of Research: | AUDIO VISUAL STUDIES |
| Thesis: | It's not just what you say, but also how you say it: Exploring the Auditory and Visual Properties of Speech Prosody |
