Research Papers

Wilcock, G., Jokinen, K. (To appear) 2021.
Towards increasing naturalness and flexibility in human-robot dialogue systems.
In Marchi E., Siniscalchi SM., Cumani S., Salerno VM, Li H. (Eds.), Increasing Naturalness and Flexibility in Spoken Dialogue Interaction: 10th International Workshop on Spoken Dialogue Systems.
Springer. ISBN 9789811593222.

2020

Wilcock, G., Jokinen, K. 2020.
WikiTalk and WikiListen: Towards listening robots that can join in conversations with topically relevant contributions.
24th European Conference on Artificial Intelligence, ECAI-2020, Santiago de Compostela, Spain.

Ijuin, K., Jokinen, K. 2020.
Exploring Gaze Behaviour and Perceived Personality Traits.
In Meiselwitz, G. (Ed.), International Conference of Human-Computer Interaction HCII 2020.
LNCS 12194, pp. 1–9. Springer. ISBN 9783030495756.

Jokinen, K. 2020.
Situated Agents, Personality and Human-Centric AI.
34th Annual Conference of the Japanese Society for Artificial Intelligence, JSAI 2020.

Jokinen, K. 2020.
The AICO Multimodal Corpus – Data Collection and Preliminary Analyses.
In Proceedings of the 12th Language Resources and Evaluation Conference, LREC 2020.
European Language Resources Association. ISBN 9791095546344.

Mori, T., Jokinen, K., Den, Y. 2020.
Analysis of Body Behaviours in Human-Human and Human-Robot Interactions.
In Proceedings of LREC2020 Workshop “People in language, vision and the mind” (ONION2020). European Language Resources Association.

Jokinen, K. 2020.
Exploring Boundaries among Interactive Robots and Humans.
In: D’Haro, L.F, Callejas, Z., Nakamura, S. (Eds.), Conversational Dialogue Systems for the Next Decade.
LNEE. Springer.

Oshiyama, C., Niwa, S., Jokinen, K., Nishimura, T. 2020.
Development of a Dialogue System that Supports Recovery for Patients with Schizophrenia.
In: D’Haro, L.F, Callejas, Z., Nakamura, S. (Eds.), Conversational Dialogue Systems for the Next Decade.
LNEE. Springer.

2019

Jokinen, K. 2019.
Social Emotions for Social Robots – Studies on Affective Impressions in Human-Human and Human-Robot Interactions.
In Salichs, M.A., Ge, S.S., Barakova, E.I., Cabibihan, J.-J., Wagner, A.R., Castro-González, Á., He, H. (Eds.), Social Robotics: 11th International Conference, ICSR 2019.
LNCS 11876. Springer, pp. 267-277. ISBN 9783030358884

Jokinen, K., Watanabe, K. 2019.
Boundary-Crossing Robots: Societal Impact of Interactions with Socially Capable Autonomous Agents.
In Salichs, M.A., Ge, S.S., Barakova, E.I., Cabibihan, J.-J., Wagner, A.R., Castro-González, Á., He, H. (Eds.), Social Robotics: 11th International Conference, ICSR 2019.
LNCS 11876. Springer, pp. 3-13. ISBN 9783030358884

Ijuin, K., Jokinen, K. 2019.
Utterances in Social Robot Interactions — Correlation Analyses between Robot’s Fluency and Participant’s Impression.
In Proceedings of the 7th International ACM Conference on Human-Agent Interaction (HAI ’19).
Association for Computing Machinery, New York, NY, USA, pp. 280–282.

Jokinen K., Nishimura S., Watanabe K., Nishimura T. 2019.
Human-Robot Dialogues for Explaining Activities.
In: D’Haro L., Banchs R., Li H. (Eds), 9th International Workshop on Spoken Dialogue System Technology.
LNEE 579. Springer, pp. 239-252. ISBN 9789811394423.

Trong, T.N., Jokinen K., Hautamäki V. 2019.
Enabling Spoken Dialogue Systems for Low-Resourced Languages—End-to-End Dialect Recognition for North Sami.
In: D’Haro L., Banchs R., Li H. (Eds), 9th International Workshop on Spoken Dialogue System Technology.
LNEE 579. Springer, pp. 221-238. ISBN 9789811394423.

Jokinen, K. 2019.
Constructing Human-Robot Interaction with Standard Cognitive Architecture.
In Cangelosi, A., Lieto, A. (Eds), Proceedings of the 7th International Workshop on Artificial Intelligence and Cognition, AIC 2019.
CEUR Workshop Proceedings, Vol. 2483, pp. 1-9, Aachen, Germany. ISSN 1613-0073.

Lala, D., Wilcock, G., Jokinen, K., Kawahara, T. 2019.
ERICA and WikiTalk.
In Proceedings of 28th International Joint Conference on Artificial Intelligence.
IJCAI-2019, Macao, China. pp. 6533–6535.

Laohakangvalvit, T., Jokinen, K. 2019.
Eye-gaze Behaviors between Human-Human and Human-Robot Interactions in Natural Scene.
ERCEM, August 2019.

Ijuin, K., Jokinen, K., Kato, T., Yamamoto, S. 2019.
Eye-gaze in social robot interactions – Grounding of information and eye-gaze patterns.
33rd Annual Conference of the Japanese Society for Artificial Intelligence, JSAI 2019.

Jokinen, K., Fukuda, K., Iino, N., Nishimura, S., Nishimura, T., Oota, Y., Watanabe, K., Yoshida, Y. 2019.
Privacy and Sensor Information in the Interactive Service Applications for Elder People.
Proceedings of 7th National Conference of Serviceology, Tokyo.

Trong, T.N., Jokinen, K. 2019.
What Should We Talk about? – Models for Topics, Laughter and Body Movements in First Encounters.
2nd AAAI Workshop on Reasoning and Learning for Human-Machine Dialogues (Deep-Dial), AAAI-2019, Hawaii, USA.

2018

Jokinen K. 2018.
Dialogue Models for Socially Intelligent Robots.
In Ge S.S., Cabibihan, J.-J., Salichs, M.A., Broadbent, E., He, H., Wagner, A., Castro-González, Á. (Eds) Social Robotics: 10th International Conference, ICSR 2018, Qingdao, China, November 28-30, 2018, Proceedings.
LNAI 11357. Springer, pp. 127-138. ISBN 9783030052034.

Jokinen, K., Wilcock, G. 2018.
Multimodal Open-domain Conversations with Robotic Platforms.
In X. Alameda-Pineda, E. Ricci and N. Sebe (eds.), Multimodal Behavior Analysis in the Wild: Advances and Challenges,
Academic Press, pp 9-26. ISBN 9780128146019.

Jokinen, K. 2018.
AI-based Dialogue Modelling for Social Robots.
AI and Multimodal Human-Robot Interaction (AI-MHRI), IJCAI-2018,
Stockholm, Sweden.

Jokinen, K. 2018.
Researching Less-Resourced Languages – the DigiSami Corpus.
In Proceedings of the Eleventh International Conference on Language
Resources and Evaluation (LREC-2018), Miyazaki, Japan.
European Language Resources Association (ELRA).

Jokinen, K. 2018.
Conversational Gaze Modelling in First Encounter Robot Dialogues.
LREC Workshop Language and Body in Real Life & Multimodal Corpora (REAL-MM), Miyazaki, Japan. pp.60-64.

Jokinen, K., Trong, TN. 2018.
Laughter and Body Movements as Communicative Actions in Interactions.
LREC Workshop Annotation, Recognition and Evaluation of Actions (AREA), Miyazaki, Japan.

Trong TN., Hautamäki, V., Jokinen, K. 2018.
Staircase Network: structural language identification via hierarchical attentive units.
Odyssey 2018 The Speaker and Language Recognition Workshop, Les Sables d’Olonne, France.

2017

Iino, N., Nishimura, S., Fukuda, K., Watanabe, K., Jokinen, K., Nishimura, T. 2017.
Development and Use of an Activity Model Based on Structured Knowledge: A Music Teaching Support System.
IEEE International Conference on Data Mining Workshops (ICDMW), pp. 584-589. ISSN: 23759259.

Jokinen, K., Hiovain, K., Laxström, N., Rauhala I., Wilcock, G. 2017.
DigiSami and Digital Natives: Interaction Technology for the North Sami language.
In Jokinen, K.. Wilcock, G. (eds.), Dialogues with Social Robots: Enablements, Analyses, and Evaluation.
LNEE 427. Springer, pp. 3-19. ISBN 9789811025853.

Laxström, N., Wilcock, G., Jokinen, K. 2017.
Internationalisation and localisation of spoken dialogue systems.
In Jokinen, K.. Wilcock, G. (eds.), Dialogues with Social Robots: Enablements, Analyses, and Evaluation.
LNEE 427. Springer, pp. 207-219. ISBN 9789811025853.

Wilcock, G., Laxström, N., Leinonen, J., Smit, P., Kurimo, M., Jokinen, K. 2017.
Towards SamiTalk: a Sami-speaking Robot linked to Sami Wikipedia.
In Jokinen, K.. Wilcock, G. (eds.), Dialogues with Social Robots: Enablements, Analyses, and Evaluation.
LNEE 427. Springer, pp. 343-351. ISBN 9789811025853.

Wilcock, G., Jokinen, K. 2017.
Bringing Cognitive Infocommunications to small language communities.
In Proceedings of 8th IEEE International Conference on Cognitive Infocommunication, CogInfoCom-2017, Debrecen, Hungary, pp. 259-264.

Jokinen, K., Wilcock, G.. 2017.
Expectations and First Experience with a Social Robot.
In Proceedings of 5th International Conference on Human Agent Interaction, HAI-2017, Bielefeld, Germany, pp. 511-515. ISBN: 9781450351133.

Jokinen, K., Nishimura, S., Fukuda, K., Nishimura, T. 2017.
Dialogues with IoT companions: Enabling human interaction with intelligent service items.
The 2nd IEEE International Conference on Companion Technology (ICCT-2017), Ulm, Germany. pp. 1-3.

2016

Grönroos, S-A., Hiovain, K., Smit, P., Rauhala, I., Jokinen, K., Kurimo, M.,
Virpioja, S. 2016.
Low-Resource Active Learning of Morphological Segmentation.
Northern European Journal of Language Technology, Vol. 4, pp. 47-72.

Wilcock, G., Jokinen, K., Yamamoto, S. 2016.
What topic do you want to hear about?: A bilingual talking robot using English and Japanese Wikipedias.
In The 26th International Conference on Computational Linguistics, Proceedings of COLING 2016: System Demonstrations, COLING-2016, Osaka, pp. 116-120.

Jokinen, K., Wilcock, G. 2016.
Double Topic Shifts in Open Domain Conversations: Natural Language Interface for a Wikipedia-based Robot Application.
In Open Knowledge Base and Question Answering Workshop: Proceedings of the Workshop, COLING-2016, Osaka, pp. 59-66.

Jokinen, K., Trong, TN., Wilcock, G. 2016.
Body Movements and Laughter Recognition: Experiments in First Encounter Dialogues.
In Proceedings of the Workshop on Multimodal Analyses enabling Artificial Agents in Human-Machine Interaction, MA3HMI-2016, Tokyo.

Laxström, N., Jokinen, K., Wilcock, G. 2016.
Situated Interaction in a Multilingual Spoken Information Access Framework.
In Rudnicky, A., Raux, A., Lane, I., Misu, T. (eds.), Situated Dialog in Speech-Based Human-Computer Interaction,
Springer, pp. 165-175. ISBN 9783319218342.

2015

Wilcock, G., Jokinen, K. 2015.
Multilingual WikiTalk: Wikipedia-based talking robots that switch languages.
In Proceedings of 16th Annual SIGdial Meeting on Discourse and Dialogue, SIGDIAL-2015, Prague, pp. 162-164.

Jokinen, K. 2015.
Top-down Bottom-up Experiments on Detecting Co-speech Gesturing in
Conversation.
Proceedings from the 3rd European Symposium on Multimodal Communication, Dublin.
Linköping Electronic Conference Proceedings 105:7, pp. 38-44.

Vels, M., Jokinen, K. 2015.
Detecting Body, Head, and Speech in Engagement.
Proceedings of the IVA 2015 Workshop on Engagement in Social Intelligent Virtual Agents (ESIVA 2015).

2014

Jokinen, K., Wilcock, G. 2014.
Multimodal Open-domain Conversations with the Nao Robot.
In Mariani, J., Rosset, S., Garnier-Rizet, M., Devillers, L. (eds.), Natural Interaction with Robots, Knowbots and Smartphones: Putting Spoken Dialogue Systems into Practice,
Springer, pp 213-224. ISBN 9781461482796.

Wilcock, G., Jokinen, K. 2014.
Advances in Wikipedia-based Interaction with Robots.
In Proceedings of the ICMI 2014 Workshop on Multimodal, Multi-Party, Real-World Human-Robot Interaction, ICMI-2014, Istanbul.

Jokinen, K., Wilcock, G. 2014.
Automatic and Manual Annotations in First Encounter Dialogues.
In Human Language Technologies – The Baltic Perspective: Proceedings of the 6th International Conference Baltic HLT 2014, BalticHLT-2014, Kaunas.

Jokinen, K., Wilcock, G. 2014.
Modelling User Experience in Human-Robot Interactions.
In Proceedings of 2nd Workshop on Multimodal Analyses Enabling Articial Agents in Human-Machine Interaction, Interspeech-2014, Singapore.

Jokinen, K., Wilcock, G. 2014.
Towards Automatic Annotation of Communicative Gesturing.
In Proceedings of the 3rd Workshop on Vision and Language, COLING-2014, Dublin.

Jokinen, K., Wilcock, G. 2014.
Community-based Resource Building and Data Collection.
In 4th Workshop on Spoken Language Technologies for Under-resourced Languages, Workshop Proceedings, SLTU-2014, St. Petersburg, pp. 201-206.

Jokinen, K. 2014.
Bridging Gaps Between Planning and Open-Domain Spoken Dialogues.
In: Gala, N., Rapp R., Bel-Enguix G. (eds.), Language Production, Cognition, and the Lexicon. Text, Speech and Language Technology vol. 48, Springer,
DOI 10.1007/978-3-319-08043-7_20

Jokinen, K. 2014.
Eye-trackers and Multimodal Communication Studies.
In: Paggio, P., Wessel-Tolvig, B. (eds.) Proceedings from the 1st European
Symposium on Multimodal Communication, Valletta, Malta.
Linköping Electronic Conference Proceedings 101:4, pp. 29-39.

Jokinen, K. 2014.
Multimodal Interaction in the Context of Foreign Language Learning.
In: Raud, N., Burdakova, O. (eds.) Culture, Languages, History: Integration and Border-Crossing. Studia Humaniora et Paedagogica Collegii Narovensis (V). pp. 181-194.

Saatmann, P., Jokinen, K. 2014.
Experiments with hand-tracking algorithm in video conversations.
In Proceedings of the 2nd European and the 5th Nordic Symposium on Multimodal Communication, Tartu, Estonia.
Linköping Electronic Conference Proceedings 110:11, pp. 81-86.

2013

G. Wilcock and K. Jokinen. 2013.
WikiTalk Human-Robot Interactions.
In Proceedings of 15th ACM International Conference on Multimodal Interaction, ICMI-2013, Sydney.

G. Wilcock and K. Jokinen. 2013.
Towards Cloud-based Speech Interfaces for Open-Domain CogInfoCom Systems.
In Proceedings of 4th IEEE International Conference on Cognitive Infocommunications, CogInfoCom-2013, Budapest.

K. Jokinen and G. Wilcock. 2013.
Open-domain Conversations with Humanoid Robots.
In Proceedings of 24th International Joint Conference on Natural Language Processing, IJCNLP-2013, Nagoya.

K. Jokinen and G. Wilcock. 2013.
User Experience in Human-Robot Interactions.
In Proceedings of 4th International Workshop on Perceptual Quality of Systems, PQS-2013, Vienna.

K. Jokinen and G. Wilcock. 2013.
Open-Domain Information Access with Talking Robots.
In Proceedings of 14th Annual SIGdial Meeting on Discourse and Dialogue, SIGDIAL-2013, Metz, pp. 360-362.

D. Anastasiou, K. Jokinen and G. Wilcock. 2013.
Evaluation of WikiTalk – User Studies of Human-Robot Interaction.
In Proceedings of 15th International Conference on Human-Computer Interaction, HCII-2013, Las Vegas.

A. Csapo, E. Gilmartin, J. Grizou, JG. Han, R. Meena, D. Anastasiou, K. Jokinen and G. Wilcock. 2013.
Speech, Gaze and Gesturing: Multimodal Conversational Interaction with Nao Robot.
In Proceedings of 8th International Summer Workshop on Multimodal Interfaces, eNTERFACE-2012, Metz, pp. 7-12.

K. Jokinen and G. Wilcock. 2012.
Multimodal Signals and Holistic Interaction Structuring.
In Proceedings of 24th International Conference on Computational Linguistics, COLING-2012, Mumbai.

K. Jokinen and G. Wilcock. 2012.
Open-domain Conversations with Humanoid Robots.
In Proceedings of 24th International Conference on Computational Linguistics, COLING-2012, Mumbai.

R. Meena, K. Jokinen and G. Wilcock. 2012.
Integration of Gestures and Speech in Human-Robot Interaction.
In Proceedings of 3rd IEEE International Conference on Cognitive Infocommunications, CogInfoCom-2012, Kosice, pp. 673-678.

JG. Han, N. Campbell, K. Jokinen and G. Wilcock. 2012.
Investigating the Use of Non-verbal Cues in Human-Robot Interaction with a Nao Robot.
In Proceedings of 3rd IEEE International Conference on Cognitive Infocommunications, CogInfoCom-2012, Kosice, pp. 679-683.

A. Csapo, E. Gilmartin, J. Grizou, JG. Han, R. Meena, D. Anastasiou, K. Jokinen and G. Wilcock. 2012.
Multimodal Conversational Interaction with a Humanoid Robot.
In Proceedings of 3rd IEEE International Conference on Cognitive Infocommunications, CogInfoCom-2012, Kosice, pp. 667-672.

A. Csapo, E. Gilmartin, J. Grizou, JG. Han, R. Meena, D. Anastasiou, K. Jokinen and G. Wilcock. 2012.
Open-domain Conversation with a Nao Robot.
In Proceedings of 3rd IEEE International Conference on Cognitive Infocommunications, CogInfoCom-2012, Kosice, pp. 685-686.

K. Jokinen and G. Wilcock. 2012.
Multimodal Open-domain Conversations with the Nao Robot.
In Proceedings of Fourth International Workshop on Spoken Dialogue Systems, IWSDS-2012, Paris.

K. Jokinen and G. Wilcock. 2012.
Constructive Interaction for Talking about Interesting Topics.
In Proceedings of Eighth Language Resources and Evaluation Conference, LREC-2012, Istanbul. ISBN 9782951740877.

G. Wilcock and K. Jokinen. 2011.
Adding Speech to a Robotics Simulator.
In R. Lopez-Cozar Delgado and T. Kobayashi (eds.), Proceedings of the Paralinguistic Information and its Integration in Spoken Dialogue Systems Workshop,
Springer, pp 375-380. ISBN 9781461413349.

K. Jokinen and G. Wilcock. 2011.
Emergent Verbal Behaviour in Human-Robot Interaction.
In Proceedings of 2nd International Conference on Cognitive Infocommunications, CogInfoCom 2011, Budapest.

G. Wilcock and K. Jokinen. 2007.
SCXML, Multimodal Dialogue Systems and MMI Architecture.
In Workshop on W3C Multimodal Architecture and Interfaces – Minutes, Fujisawa, Japan.

K. Jokinen and G. Wilcock. 2006.
Contextual Inferences in Intercultural Communication.
In M. Suominen et al. (eds.), A Man of Measure: Festschrift in Honour of Fred Karlsson. Special Supplement to SKY Journal of Linguistics, Vol. 19.
The Linguistic Association of Finland, Turku, pp. 291-300. ISSN 1456-8438.

G. Wilcock, K. Jokinen, C. Mellish and E. Reiter (eds.). 2005.
Proceedings of the 10th European Workshop on Natural Language Generation.
ENLG-05, Aberdeen. University of Aberdeen.

K. Jokinen. 2005.
A Grammar for Finnish DiscoursePatterns.
In A. Arppe et al. (eds.), Inquiries into Words, Constraints and Contexts: Festschrift for Kimmo Koskenniemi on his 60th Birthday.
CSLI Studies in Computational Linguistics ONLINE, CSLI Publications, Stanford, pp. 268-277. ISSN 1557-5772.

K. Jokinen and G. Wilcock. 2003.
Adaptivity and Response Generation in a Spoken Dialogue System.
In J. van Kuppevelt and R. Smith (eds.), Current and New Directions in Discourse and Dialogue (Text, Speech and Language Technology, Volume 22).
Kluwer Academic Publishers, pp. 213-234. ISBN 140201614X.

G. Wilcock and K. Jokinen. 2003.
Generating Responses and Explanations from RDF/XML and DAML+OIL.
In Knowledge and Reasoning in Practical Dialogue Systems, IJCAI 2003 Workshop, Acapulco, pp. 58-63.

G. Wilcock and K. Jokinen. 2003.
Generation Models for Spoken Dialogues.
In R. Freedman and C. Callaway (eds.), Natural Language Generation in Spoken and Written Dialogue, Papers from 2003 AAAI Spring Symposium, (Technical Report SS-03-06).
American Association for Artificial Intelligence, pp. 159-165. ISBN 1577351835.

K. Jokinen, A. Kerminen, M. Kaipainen, T. Jauhiainen, G. Wilcock, M. Turunen, J. Hakulinen, J. Kuusisto and K. Lagus. 2002.
Adaptive Dialogue Systems – Interaction with Interact.
In Proceedings of the 3rd SIGdial Workshop on Discourse and Dialogue, SIGDIAL 2002, Philadelphia, pp. 64-73.

G. Wilcock and K. Jokinen. 2001.
Design of a Generation Component for a Spoken Dialogue System.
In Proceedings of the Sixth Natural Language Processing Pacific Rim Symposium, NLPRS 2001, Tokyo, pp. 545-550.

K. Jokinen and G. Wilcock. 2001.
Confidence-based Adaptivity in Response Generation for a Spoken Dialogue System.
In Proceedings of the 2nd SIGdial Workshop on Discourse and Dialogue, SIGDIAL 2001, Aalborg, pp. 80-89.