Multimodal affect analysis of psychodynamic play therapy
Objective: We explore state of the art machine learning based tools for automatic facial and linguistic affect analysis to allow easier, faster, and more precise quantification and annotation of children's verbal and non-verbal affective expressions in psychodynamic child psychotherapy. Method: The sample included 53 Turkish children: 41 with internalizing, externalizing and comorbid problems; 12 in the non-clinical range. We collected audio and video recordings of 148 sessions, which were manually transcribed. Independent raters coded children's expressions of pleasure, anger, sadness and anxiety using the Children's Play Therapy Instrument (CPTI). Automatic facial and linguistic affect analysis modalities were adapted, developed, and combined in a system that predicts affect. Statistical regression methods (linear and polynomial regression) and machine learning techniques (deep learning, support vector regression and extreme learning machine) were used for predicting CPTI affect dimensions. Results: Experimental results show significant associations between automated affect predictions and CPTI affect dimensions with small to medium effect sizes. Fusion of facial and linguistic features work best for pleasure predictions; however, for other affect predictions linguistic analyses outperform facial analyses. External validity analyses partially support anger and pleasure predictions. Discussion: The system enables retrieving affective expressions of children, but needs improvement for precision.
Medienart: |
E-Artikel |
---|
Erscheinungsjahr: |
2021 |
---|---|
Erschienen: |
2021 |
Enthalten in: |
Zur Gesamtaufnahme - volume:31 |
---|---|
Enthalten in: |
Psychotherapy research : journal of the Society for Psychotherapy Research - 31(2021), 3 vom: 20. März, Seite 402-417 |
Sprache: |
Englisch |
---|
Beteiligte Personen: |
Halfon, Sibel [VerfasserIn] |
---|
Links: |
---|
Themen: |
Face analysis |
---|
Anmerkungen: |
Date Completed 21.05.2021 Date Revised 21.05.2021 published: Print-Electronic Citation Status MEDLINE |
---|
doi: |
10.1080/10503307.2020.1839141 |
---|
funding: |
|
---|---|
Förderinstitution / Projekttitel: |
|
PPN (Katalog-ID): |
NLM317163272 |
---|
LEADER | 01000naa a22002652 4500 | ||
---|---|---|---|
001 | NLM317163272 | ||
003 | DE-627 | ||
005 | 20231225162648.0 | ||
007 | cr uuu---uuuuu | ||
008 | 231225s2021 xx |||||o 00| ||eng c | ||
024 | 7 | |a 10.1080/10503307.2020.1839141 |2 doi | |
028 | 5 | 2 | |a pubmed24n1057.xml |
035 | |a (DE-627)NLM317163272 | ||
035 | |a (NLM)33148118 | ||
040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
041 | |a eng | ||
100 | 1 | |a Halfon, Sibel |e verfasserin |4 aut | |
245 | 1 | 0 | |a Multimodal affect analysis of psychodynamic play therapy |
264 | 1 | |c 2021 | |
336 | |a Text |b txt |2 rdacontent | ||
337 | |a ƒaComputermedien |b c |2 rdamedia | ||
338 | |a ƒa Online-Ressource |b cr |2 rdacarrier | ||
500 | |a Date Completed 21.05.2021 | ||
500 | |a Date Revised 21.05.2021 | ||
500 | |a published: Print-Electronic | ||
500 | |a Citation Status MEDLINE | ||
520 | |a Objective: We explore state of the art machine learning based tools for automatic facial and linguistic affect analysis to allow easier, faster, and more precise quantification and annotation of children's verbal and non-verbal affective expressions in psychodynamic child psychotherapy. Method: The sample included 53 Turkish children: 41 with internalizing, externalizing and comorbid problems; 12 in the non-clinical range. We collected audio and video recordings of 148 sessions, which were manually transcribed. Independent raters coded children's expressions of pleasure, anger, sadness and anxiety using the Children's Play Therapy Instrument (CPTI). Automatic facial and linguistic affect analysis modalities were adapted, developed, and combined in a system that predicts affect. Statistical regression methods (linear and polynomial regression) and machine learning techniques (deep learning, support vector regression and extreme learning machine) were used for predicting CPTI affect dimensions. Results: Experimental results show significant associations between automated affect predictions and CPTI affect dimensions with small to medium effect sizes. Fusion of facial and linguistic features work best for pleasure predictions; however, for other affect predictions linguistic analyses outperform facial analyses. External validity analyses partially support anger and pleasure predictions. Discussion: The system enables retrieving affective expressions of children, but needs improvement for precision | ||
650 | 4 | |a Journal Article | |
650 | 4 | |a Research Support, Non-U.S. Gov't | |
650 | 4 | |a face analysis | |
650 | 4 | |a multimodal affect analysis | |
650 | 4 | |a psychodynamic play therapy | |
650 | 4 | |a text analysis | |
700 | 1 | |a Doyran, Metehan |e verfasserin |4 aut | |
700 | 1 | |a Türkmen, Batıkan |e verfasserin |4 aut | |
700 | 1 | |a Oktay, Eda Aydın |e verfasserin |4 aut | |
700 | 1 | |a Salah, Ali Albert |e verfasserin |4 aut | |
773 | 0 | 8 | |i Enthalten in |t Psychotherapy research : journal of the Society for Psychotherapy Research |d 1996 |g 31(2021), 3 vom: 20. März, Seite 402-417 |w (DE-627)NLM090670124 |x 1468-4381 |7 nnns |
773 | 1 | 8 | |g volume:31 |g year:2021 |g number:3 |g day:20 |g month:03 |g pages:402-417 |
856 | 4 | 0 | |u http://dx.doi.org/10.1080/10503307.2020.1839141 |3 Volltext |
912 | |a GBV_USEFLAG_A | ||
912 | |a GBV_NLM | ||
951 | |a AR | ||
952 | |d 31 |j 2021 |e 3 |b 20 |c 03 |h 402-417 |