https://orcid.org/0000-0003-0351-7729
Figures
Abstract
Background
The Self-Expression Emotion Regulation in Art Therapy Scale (SERATS) was developed as art therapy lacked outcome measures that could be used to monitor the specific effects of art therapy. Although the SERATS showed good psychometric properties in earlier studies, it lacked convergent validity and thus construct validity.
Method
To test the convergent validity of the SERATS correlation was examined with the EES (Emotional Expressivity Scale), Emotion Regulation Strategies for Artistic Creative Activities Scale (ERS-ACA) and Healthy-Unhealthy Music Scale (HUMS). Patients diagnosed with a Personality Disorder, and thus having self-regulation and emotion regulation problems (n = 179) and a healthy student population (n = 53) completed the questionnaires (N = 232).
Results
The SERATS showed a high reliability and convergent validity in relation to the ERS-ACA approach strategies and self-development strategies in both patients and students and the HUMS healthy scale, in patients. Hence, what the SERATS measures is highly associated with emotion regulation strategies like acceptance, reappraisal, discharge and problem solving and with improving a sense of self including self-identity, increased self-esteem and improved agency as well as the healthy side of art making. Respondents rated the SERATS as relatively easy to complete compared to the other questionnaires.
Citation: Haeyen S, Noorthoorn E (2021) Validity of the Self-Expression and Emotion Regulation in Art Therapy Scale (SERATS). PLoS ONE 16(3): e0248315. https://doi.org/10.1371/journal.pone.0248315
Editor: Peter M. ten Klooster, University of Twente, NETHERLANDS
Received: November 6, 2020; Accepted: February 23, 2021; Published: March 10, 2021
Copyright: © 2021 Haeyen, Noorthoorn. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: Data are available from the DANS database (https://easy.dans.knaw.nl/ui/datasets/id/easy-dataset:190689 / https://doi.org/10.17026/dans-zcx-gjvh). Haeyen, Phd S.W. (HAN University of Applied Sciences) (2020): The validity of the Self-expression Emotion Regulation in Art Therapy Scale (SERATS).
Funding: The authors received no specific funding for this work.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Art therapy, a treatment based on the experience and the use of art media in a methodically targeted manner, is used quite frequently in mental healthcare [1]. Patients as well as professionals consider it important and meaningful [e.g. 2–5] and a limited number of effect studies show the effectiveness of art therapy [4–7]. Art therapy offers a space for exploration and experiencing emotions and/or (inner) conflicts. Feelings or themes that are difficult to process or handle can be explored without being directly expressed in words, as described in many handbooks on art therapy [e.g. 3, 8–10]. The working with art materials is experiential and often offers a trigger for activating emotions [10–15]. Although these clinical experiences and the few performed effect studies suggest art therapy is an effective intervention, it lacks outcome measures to monitor and evaluate the specific effects related to it [5, 16–18]. Art therapy is mostly integrated in such programmes. A specific scale for measuring art therapy in multidisciplinary programs is needed because such scale isolates the contribution of art therapy as a part of a broader programme. If results are more isolated these can provide situation-specific feedback. This makes it possible to stimulate the quality of art therapy by intervening in certain aspects and/or by using the results to discuss the therapy process with the service-users for evaluation and improvement. More general scales do not fit well art therapy and the involved processes. A specific scale improves insight in the contribution of art therapy to the treatment process as such. Our aim is to develop an instrument to measure perceived effects of art therapy among patients with emotional and self-regulation problems.
In literature there are some related but not very suitable outcome measures to monitor and evaluate art therapy. The few available diagnostic scales, such as the Diagnostic Drawing Series [19] or the Art-Based Intervention self-report questionnaire on the art-making experience [16], are assessment or observation tools and not specifically suited to measure the effects of art therapy treatment [20]. Other scales do not fit well the therapy aspect of art therapy or do not fit process of art-making. For example, the recently developed instrument focused on artistic creative activities called `Emotion Regulation Strategies for Artistic Creative Activities Scale’ (ERS-ACA) measures ERSs when engaging in artistic creative activities [21]. That study focused on “design or crafts” activities including even gardening, baking or cooking as ‘artistic’ activities, rather than on (art) therapy and it involved a general healthy sample rather than a clinical sample. A scale about emotion regulation but not about the process of art-making is the Emotion Regulation Questionnaire (ERQ) [21]. This is a 10-item scale on a 7-point Likert scale that focuses on ERSs in daily life (rather than related to a specific activity). The scale has two subscales: ‘cognitive reappraisal’ and ‘expressive suppression’. The ‘cognitive reappraisal’ subscale includes distraction and calm focus on the problem. It does not include broader cognitive strategies such as problem solving or acceptance [22]. The scale focuses on these specific strategies. This makes the scale narrow in scope. Even more important, the items do not fit the specific character of art therapy. Finally, the Cognitive Emotion Regulation Questionnaire (CERQ) focuses on coping following negative situations or events and includes subscales on emotional regulation strategies such as rumination and reappraisal, but also on more specific subscales such as self-blame, other-blame and catastrophizing [23]. Although interesting, it also does not fit the specific context of art therapy. Consequently, there is a gap for a new validated scale for measuring the results of art therapy.
As no instruments were available to measure the specific effects of art therapy, we used developed effect categories from previous research [2] as input for the development of an assessment tool for examining the contribution of art therapy in the multidisciplinary treatment of personality disorders. These effect categories were developed on the patients’ experiences with art therapy, expressed during individual and focus group interviews. The development of the Self-Expression and Emotion Regulation in Art Therapy Scale (SERATS) was reported [24].
Emotion-regulation problems and emotional vulnerability are key issues for personality disorders [5, 25, 26]. Emotion regulation refers to the processes of how people influence experienced emotions: when we have emotions, how we experience them and how we express them [27]. The way people express emotions plays an important role in social interactions [28, 29]. Personality disorder patients often suffer from weakened autonomy and an unstable, diffuse or negative self-image. They often encounter difficulties with self-determinism in the sense of impulsiveness, how to handle distance and closeness, and achieving personal goals. They also often have difficulties with interpersonal relationships, with being able to feel connected and with intimacy. This often involves destructive and/or self-destructive behavior, suicidal thoughts, negative or distorted cognitions, and affective deregulation. They tend to be overwhelmed by emotions, have a high level of tension, get agitated quickly, and find it difficult to calm themselves down [5].
In the art process, the personality disorder patient is responsible for the creation of the art product, and this asks for self-management or self-direction [5]. Art therapy may help patients to recognize difficult emotions, to integrate conflicting thoughts, feelings or behaviors and to find a more constructive way of dealing with them [30]. In art therapy, emotional states can be triggered by what happens during the art process and the interaction with the art materials [7]. The most improved treatment goals of art therapy, reported by patients diagnosed with a personality disorder in a quantitative survey (N = 528) were: expression of emotions, improved (more stable/positive) self-image, making own choices/autonomy and, recognition of, insight in and changing of personal patterns of feelings, behaviors and thoughts [30]. In art therapy, the inner self becomes visible, tangible and concrete through the work produced. It may be a conscious or unconscious process, and the meaning is always determined in a dialogue with the client [2, 5, 8]. The artwork mirrors aspects of the patient, both by the content of the image as by its formal image characteristics as many experts agree. Art therapy seems to help the handling of emotions in allowing a slow, manageable pace to the organisation of thoughts and feelings through art making and a stepwise process of converting these into words and then communication with others in a group discussion. The art therapy process supports explicit and implicit mentalisation [e.g. 31, 32]. The SERATS was developed based on previous studies [2, 5, 24, 35] to capture art therapy specific effects, related to emotion regulation and self-expression, such as resolving inner conflicts [33], awareness of the here and now [31], and achieving personal insight [34].
Patients with a personality disorder cluster B are often overwhelmed and entangled in their intense emotions. In response, they make every effort not to feel, often by exhibiting destructive behavior. Cluster C patients are often afraid to rely on their feelings and start avoiding them. They visibly or invisibly withdraw from contact (with themselves and with the other). What is consistent in terms of emotion regulation is that these patients often do not know what they are feeling anymore, and the therapeutic process is aimed at reconnecting with underlying feelings first. Only when this emotional awareness of what they are experiencing here and now is there (see Table 1, SERATS item 1), someone can increasingly notice that they can express feelings in the artwork (item 2). On the basis of this, they may experience that they are beginning to discover and understand themselves and the situations they are dealing with better (item 3,4,5) and that they can discharge themselves through art making (item 6). An art product can help to maintain an experience or feeling (item 7) so that more continuity can be experienced. Final results of this process can become apparent in the application of new behaviors outside of art therapy (item 8) and that they acquire more self-insight (item 9). This process in art therapy is about becoming more aware, being able to give direction and thereby processing difficulties. In art therapy, this is initially achieved through an experiential route, by bottom-up emotion regulation. This experience leads to behavior change and an improved self-understanding.
The context specific SERATS is constructed in a series of analyses [24], in which the psychometric properties of this scale were tested, using two independent patient samples, respectively (n = 335, n = 34). Context specific because all items describe what happens to a patient in the context of art therapy. Patients who participated had been diagnosed with personality disorders of clusters B or C. The exploratory and confirmatory factor analyses resulted in a unidimensional 9-item scale with item factor loading above .7. The content of the final items is focussed on experiencing, becoming aware and expressing feelings, regulating emotions/feelings (letting out, making fall into place or holding on to) by applying new behavior and gaining insight, all in relation to the art therapy experience. Because the focus of the scale is self-expression and emotion regulation, we named the scale the SERATS.
The scale showed a high internal reliability with a Cronbach’s alpha of .94 and high test-retest reliability of r = .96. In other studies, we examined if the SERATS-scores also changed, in a pretest-posttest design and in a randomised clinical trial (RCT) with an isolated art therapy intervention [5, 35] to investigate if the change in the SERATS could be attributed uniquely to art therapy This meant that patients only received art therapy and no other interventions. We used GLM repeated measures analyses and computed change of the effect size in Cohen’s d (Δ d) between the effect size at the post-test and the effect size at the pre-test. The effect of time was significant for SERATS, F (1, 31) = 111.55, p = .00. In addition, the effect size was very large, d = 2.03. Therefore, we concluded that the SERATS was sensitive to change in art therapy, which was in line with the earlier results [35].
We also explored the validity of the SERATS in two studies [24, 35] by examining the association between de SERATS and a range of measures. We examined the correlations between the SERATS and the AAQ-II (psychological flexibility, i.e., the Acceptance and Action Questionnaire-II [36], MAAS (Mindfulness Attention Awareness Scale) [37], the OQ45 (general mental functioning, i.e., Outcome Questionnaire 45) [38], the SMI (presence of different maladaptive and adaptive mental modes) [39], and the MHC-SF (social-, emotional-, and psychological well-being, i.e., Mental Health Continuum—short form) [40]. The results showed that the SERATS did not correlate enough with these outcomes (r < .4). These results indicated discriminant validity of the SERATS but lacked convergent validity. Convergent and discriminant validity are both considered subcategories or subtypes of construct validity. The important thing to recognize is that they work together. If there is evidence for both convergent and discriminant validity, then by definition is demonstrated that there is evidence for construct validity. The previous studies focusing on the SERATS examined the psychometric qualities of this new questionnaire. Only if the SERATS emerged as reliable and valid we wanted to encourage the use of the SERATS in other studies.
Although the SERATS showed good psychometric properties, it lacked construct validity. The measures we used in the earlier studies were chosen for testing the effects of art therapy. They were not specific for a validity study. It could be theoretically possible that the lack of convergent validity was related to a wrong choice of measures. We used general questionnaires about emotional functioning in previous studies [24, 35]. One of these with a subscale `emotional functioning’ (OQ45; Outcome Questionnaire 45) and another about the presence of emotional modes, which can be well understood as emotion regulation strategies (SMI; Schema Mode Inquiry). However, correlations between these scales and the SERATS were too small to determine convergent validity. To validate the SERATS we needed questionnaires close to the content of the context specific SERATS.
This asked for further investigation and the use of more related outcome measures [5, 35]. Convergent validity is important to in defining what the SERATS measures exactly. In this study we examine the convergent validity of the SERATS using specific outcome measures on self-expression and regulation of emotions.
The primary aim of the current study is to examine the validity of the Self-expression and Emotion Regulation in Art therapy scale (the SERATS). When the SERATS is validated we will discuss practical use and advantages. A well validated scale focused on self-expression and emotion regulation designed for art therapy would allow us to understand how art therapy is received and thereby support the design of interventions to enhance the regulation of emotions (in the short-term), mood (in the mid-term) and mental health (in the longer-term). This is an important goal given that art therapy showed in a number of studies to be particularly effective in regulating emotions, mood and mental health [5, 41–43]. There is increasing use of them as adjunct therapies within mental health and as recommended daily activities to support wellbeing [44–46].
Materials and methods
The objective of this explorative study was to test the convergent validity of the SERATS (its correspondence with measures of a similar construct). Therefore, three other questionnaires focused on emotion regulation and self-expression were selected.
Participants and procedure
Adult patients (18–65 years) admitted to a specialized treatment program of personality disorders. All patients were diagnosed with one or more personality disorders as a primary diagnosis (n = 179). The age of these participants varied from 18 to 67 years with a mean of 37.66 years (SD = 12.8 years); 106 participants were female (70.9%), 43 were male (17%). Next to the diagnoses of PD cluster B (80%), C (63%) and PD NOS (not otherwise specified) (70%) there were comorbid diagnosis of mood (81.5%) and anxiety disorders (91.3%). Many patients reported to be diagnosed with more than one PD/comorbid disorders.
A healthy population not being treated for mental problems also participated. A group of students (18 years and older) completed the questionnaires (n = 53). These were students of a bachelor’s program in art therapy and were therefore active in the visual arts. The age of these participants varied from 18 to 59 years with a mean of 24.20 years (SD = 7.94 years); 51 participants were female (96.2%), 2 were male (3.8%). This yielded complete responses from 232 participants, which were used for analyses of convergent validity and correlation with related constructs.
Only patients receiving art therapy treatment as a part of the specialized treatment could complete the SERATS and were included in this study. The one-off collection of the four questionnaires (duration max. 20 minutes) was administered at one point in time immediately after an art therapy session. This was expected to have no risks for the participants. Participation in this study was completely voluntarily, and participants were allowed to stop participating without any clarification. The questionnaires were handed out to patients and students by therapists and teachers of their institutions. Each participant signed an informed consent letter.
All procedures performed in the current study were in accordance with the 1964 Helsinki declaration and its later amendments; and with comparable ethical standards. No patient data was recorded. Data were analysed based on fully anonymized data that allowed none of the cases to be traced to an individual. No ethical approval was required in accordance with Dutch law, as no intervention was carried out. Institutional ethical and legal check according to Dutch law and procedures was performed by the hospitals data protection officer, a Master of Law.
Measures
The questionnaires administered alongside the SERATS are the EES (Emotional Expressivity Scale), the Emotion Regulation Strategies for Artistic Creative Activities Scale (ERS-ACA) and the Healthy-Unhealthy Music Scale (HUMS).
The Emotional Expressivity Scale (EES) is a measure of individual differences in the degree to which people outwardly express their emotions rates the emotions someone displays outwardly across a range of severity [47]. The EES does not indicate specific positive or negative emotions but describes general expressiveness of emotions [48]. The EES is a self- report measure which contains 17 items. The scale includes example items such as “I display my emotions to other people” and “People can read my emotions”. The participants respond on a 6-point Likert scale that varies from 1 = never true to 6 = always true. To calculate the scores, the average is taken, with a higher score meaning greater emotional expressiveness. The EES shows convergent and discriminant validity that have been established through self-reporting, other reporting and through observation methods [49].
The Emotion Regulation Strategies for Artistic Creative Activities Scale (ERS-ACA) measures types of emotional regulation strategies (ERSs) used when engaging in artistic creative activities [21]. This is an 18-item scale with an overall ‘general’ factor of emotion regulation strategies alongside three subscales: a 7-item factor comprising ‘avoidance strategies’ (such as distraction, suppression and detachment), a 6-item factor comprising ‘approach strategies’ (such as acceptance, reappraisal and problem solving), and a 5-item factor comprising ‘self-development strategies’ (such as enhanced self-identify, improved self-esteem and increased agency). Example items for subscale 1. `Avoidance strategies’ are: “it directs my attention so I forget unwanted thoughts and feelings”, and “it helps me to disengage from things that are bothering me”. For subscale 2. `Approach strategies’: “it helps me to come to terms with my own emotions” and “I can contemplate what is going on in my life with a clear mind”. For subscale 3. `Self-development strategies’: “it reaffirms my identity” and “it gives me a sense of purpose”. The factor analysis (n = 740, n = 47924) showed strong internal reliability (Cronbach’s alpha: General Factor = 0.93, Factor 1 = 0.9, Factor 2 = 0.88, Factor 3 = 0.88). The scale showed convergent and divergent validity, construct validity, consistency of internal reliability and test-retest reliability. The scale possesses high internal reliability and consistency of reliability, good convergent and divergent validity, clear construct validity, and strong test-retest reliability (n = 165) [21].
The Healthy-Unhealthy (music) Scale (HUMS) consists of 13 items, which measures the healthy and unhealthy dimensions of musical engagement [50]. The scale is divided into the Healthy and Unhealthy subscale. The reliability and validity tests provided favorable and confirmative results. Cronbach’s alpha coefficients were .78 for Healthy and .83 for Unhealthy. The concurrent validity of the HUMS was confirmed through correlations to wellbeing, happiness and school satisfaction on one hand and depression, rumination, and stress on the other. For the Health-Unhealthy Music scale the word ‘music’ was modified to ‘art making’. Example items for Unhealthy subscale are: `When I am making art, I get stuck in bad memories’ or `Art making gives me an excuse not to face up to the real world ‘ and examples for the Heathy subscale is: ‘Art making gives me the energy to get going’ or `I feel happier after art making’.
The Self-Expression and Emotion Regulation in Art Therapy Scale (SERATS; [24]) is a one-factor instrument that measures self-expression and emotion regulation in art therapy. The instrument consists of nine items (e.g. “I am able to depict my feelings in art therapy.” and “Making art is kind of an outlet for me.”), that are scored on a 5-point Likert scale running from never true (1) to almost always true (5). The reliability is excellent with a Cronbach’s alpha of .94 and high test-retest reliability of r = .96. The SERATS is sensitive to change. The scale showed discriminant validity but convergent validity is not yet established [24].
Translation process.
We used versions of the instruments in the Dutch language which were available for the EES and the SERATS. The instrument translation process of the HUMS and the ERS-ACA included back-translation [51]. This means that the instrument used was translated from the source language into the target language by a translator. Then the target language version was translated back into the source language by other translators. Then, the two source language versions were compared. Semantic equivalence between source language version and target language version can be verified. Direct comparison of two source language versions provides additional evidence of quality.
Analysis
All analyses were performed with SPSS 22 [52]. Convergent validity was evaluated by inspection of the Pearson correlations between the SERATS and the other measures. The sample was determined on the basis of the number of dimensions, whereby there must be at least 20 subjects per dimension [53]. Because in all scales there are 8 scales together, we ended up with a minimum of 160 participants. We also wanted to compare these results with a healthy group. For this, the minimum number was set at 50 [53]. The target correlation we wanted to find was >. 4 [54]. Pearson’s r correlation coefficients were used to explore the relationship between the SERATS and the other related scales focused on emotion regulation and self-expression. Cronbach’s alphas were computed for the scale to confirm the stability of internal consistency of the scale. The answers on the additional question about the experienced difficulty was analyzed with frequencies.
Results
The data showed a normal distribution (skewness/kurtosis) on the item-level as well as the level of the (sub)scales.
Reliability analysis
We first evaluated the internal consistency (with Cronbach’s alpha) of the (sub)scales in the complete dataset with all respondents (patients and students) and after that for the dataset split in the subgroups. The SERATS showed a high reliability with a Cronbach’s Alpha of .90. The ERS-ACA also showed high reliability (.87 to .91). The EES and the HUMS showed far lower reliabilities with respectively .49 and .73. The results are shown in Table 2.
Construct validity
We did not have ante hoc hypotheses about how strongly the SERATS should correlate with the outcomes, because this study is explorative. The target correlation we wanted to find was >. 4 [54]. The correlations between the SERATS on the one hand and the EES, ERS-ACA, and HUMS on the other hand were the highest for the ERS-ACA approach strategies with r = .69 in the patient sample and .81 in the student sample. The ERS-ACA self-development strategies showed less high correlations with the SERATS but still >.5 and significant at the 0.01 level in both samples. It is striking that the student sample shows a high correlation between the SERATS and the ERS-ACA avoidance strategies (.57 **) in contrast to the patient sample. The student sample also shows relatively a high but negative correlation between SERATS and emotional expressivity (EES). The patient sample shows a high and significant correlation between the SERATS and the HUMS healthy scale (see Table 3).
Experienced difficulty with the questionnaires
The answers on the additional question about the experienced difficulty were analyzed with frequencies. Table 4 shows that most people experienced the SERATS as relatively `easy’ to complete (mean 4.58) by both patients and students. This while the other three questionnaires scored higher, and thus as less easy/more difficult to complete. These scores are relative because the highest score still means a little more difficult but does not indicate `very difficult’. There was some difference in kurtosis. The distribution of the answers shows that the SERATS is more left-divided, while the other questionnaires show more distribution that leans to the right. This means that more people found the SERATS easier while this is the opposite with the other questionnaires.
Discussion
The SERATS was developed as art therapy lacked outcome measures that could be used to monitor the specific effects of art therapy. Although the SERATS showed good psychometric properties in earlier studies, it lacked convergent validity and thus construct validity. The objective of this study was to test the convergent validity of the SERATS (its correspondence with measures of a similar construct). Therefore, three other questionnaires focused on emotion regulation and self-expression were selected, the EES (Emotional Expressivity Scale), the Emotion Regulation Strategies for Artistic Creative Activities Scale (ERS-ACA) and the Healthy-Unhealthy Music Scale (HUMS). In total 232 participants completed the four questionnaires: patients with emotion regulation problems (PDs) and a healthy student population. The SERATS showed again a high reliability in patients diagnosed with personality disorders (α = .90). The SERATS was positively associated with ERS-ACA approach strategies and self-development strategies in both patients and students. This means that what the SERATS measures is highly associated with emotion regulation strategies like acceptance, reappraisal, discharge and problem solving and with improving a sense of self including self-identity, increased self-esteem and improved agency.
The student sample showed a relatively high but negative correlation between SERATS and emotional expressivity (EES). This seems counter intuitive. However, looking at the items in the EES the central theme is the level of extravert emotional functioning. The EES is not linked to making art. A higher score means more emotional expressive in terms of general behavior. The student sample concerns art therapy students. They are generally more introvert and they prefer expression in the artistic medium rather than be verbally expressive. This could explain this negative correlation at this point.
There were some differences between the two groups: patients showed a higher correlation between the SERATS and the HUMS healthy scale while this was not the case in students. The student sample shows a high correlation between the SERATS and the ERS-ACA avoidance strategies while patients show a very low correlation at that point. Maybe this could be explained as a healthy strategy that students can manage but patients are struggling with. Given the scores, students seem to be able to avoid negative emotions when they want to. They seem to be able to avoid their fear, take another perspective or control their attention in a more positive direction while patients seem to have far more difficulties with this. They seem to fuse with their unwanted, negative emotions instead of defusing from them while making art. Avoidance seems to be an interesting goal to focus on for patients in therapy to gain a better emotion regulation. Given the scores, patients use avoidance (detachment, distraction and suppression) to a much lesser effective degree in their struggle with emotions. In turn, the patient sample shows a higher association between the SERATS and the HUMS healthy scale than the student sample. This could indicate that the positive, healthy side of art making is valued more by patients than by students and that they may need it more or use it for their self-expression and emotion regulation. The respondents rated the SERATS as relatively easy to complete compared to the other three questionnaires.
In conclusion, the SERATS is a useful and user-friendly tool for monitoring the effect of art therapy that is indicative of making art in a healthy way that serves positive emotion regulation and self-development.
A strength of the present study is the inclusion of specific chosen measures to test for convergent validity. The measures we used focus on emotion regulation and self-expression, and the context of art making, and were therefore fitting the objective of this study well. Another strength is that we developed and tested our scale in and with the effort of the target group of PD patients in specialized mental health care practice and also included a healthy population. The ERS-ACA focuses on artistic creative activities, `design or crafts’ activities including gardening, baking or cooking as ‘artistic’ activities, rather than art therapy and it involved a general healthy sample and not a clinical sample. Therefore, the SERATS seems to be better suited to patients with self-regulation and emotion regulation problems.
A limitation of the SERATS is that it is related to the specific context of art therapy. Taking this into account, the SERATS does not offer a zero measurement: the patient is questioned about art therapy and must experience this therapy at least during one or two sessions to have a first impression. Only when patients encountered the intervention earlier it can be used as a zero measurement. At the same time, a pure zero-measurement may be problematic more often because patients with personality disorders often already have a longer history of various treatments at start. Another limitation is that the SERATS does not cover all possible aspects of the art therapy situation but focuses only on self-expression and emotion regulation. Aspects like ability of structuring, the therapeutic relation, reality testing, or the experience of a number of different materials are not measured by the SERATS. However, the meaning of the SERATS comes forward is that it catches self-expression and emotion regulation. These are relevant and also transdiagnostic aspects of many mental health problems like impulse control and emotion regulation and anxiety. The results in this study seem to stress the SERATS as focusing on the healthy side of art making.
Emotion regulation implies the recognition and acceptance of emotions, problem solving and reappraisal, which appear to be protective against psychopathology (opposite of dysregulation: suppression, avoidance and rumination) [27, 55, 56]. In literature, emotion regulation is increasingly considered a central component of mental health given that it drives individuals’ abilities to manage their emotional experiences and adapt to daily life, and has been shown to influence a number of mental health conditions [57].
The use of the SERATS to monitor and measure art therapy can serve different goals. It supports further research on art therapy and its effects on self-expression and emotion regulation and enhance our understanding about how art therapy affects mental health. This could also shine some light on the added value of art therapy in multidisciplinary treatment programs. Due to the context-specific questions in the SERATS, it can evaluate art therapy progress in a multidisciplinary program, although one will have to be careful in establishing a causal relationship because this requires a stricter research design.
The implications and considerations for the use of the SERATS for art therapists working with people struggling with self-expression and emotion regulation problems, can be found on different levels. Art therapists can use it as a tool for reflection on their therapeutic efficacy and they can use outcomes to be discussed with their patients. The use of feedback in treatment can empower patients. It increases the sense of ownership of their own therapeutic change process, and it may result in faster progress or may be especially effective for `not on track’ patients [58]. This can stimulate the therapeutic relationship. PD patients often lack a sense of ownership due to self-related problems. For these patients, discussing results with their therapist may stimulate self-insight and `reframing’ their very often negative self-image [59]. It may improve treatment adherence and the therapeutic alliance [60, 61]. Poor treatment adherence is an often-described central challenge in PD patients. Social desirability in completing the questionnaire cannot be completely ruled out. Social desirability is a known problem of self-reporting questionnaires. However, there is no reason that this would be the case by how the SERATS was drafted. One could reason that feedback sessions with patient can be organized when some attention is paid to the possibility of social desirable answers. Such was however not performed in the current study.
Using the SERATS promotes participation of the patient and can lead to adjustment and acceleration of the therapy [62, 63]. Patients and art therapists involved in earlier studies mentioned that the SERATS meets the standards of clarity and readability, is specific for art therapy and usability in practice [24]. The preferred frequency for the use of the SERATS is three months; more frequent use would interfere with the therapy and less frequent seemed less useful. Discussing the results with patients was most helpful with patients who did not speak out easily or with who the therapeutic relationship was difficult. Art therapists mentioned that it stimulated awareness and reflection in patients which matched well the treatment goals. A possible limiting factor is the involved time investment.
Measuring outcomes of art therapy is important for several reasons and the SERATS offers objective, reliable and valid information. As an external assessment on art therapy it offers a therapeutic value in practice when making use of the feedback in the therapeutic relationship, it makes it possible to monitor effects of art therapy and contribute to quality improvement of art therapy. Doing so, the SERATS contributes to the improvement of mental health care aimed at a healthy emotional functioning for patients with severe self-expression and emotion regulation problems.
In short, we developed the SERATS as a brief, one-factor instrument that measures self-expression and emotion regulation in art therapy. The instrument consists of nine items scored on a 5-point Likert scale running from never true (1) to almost always true (5). The reliability is excellent (α = .94) and test-retest reliability is high (r = .96), despite it being a short instrument. The SERATS is sensitive to change in art therapy. The SERATS shows construct validity; discriminant validity and also convergent validity in relation to other questionnaires about self-expression and emotion regulation in the context of art making. The SERATS is a useful and user-friendly tool for monitoring the effect of art therapy that is indicative of making art in a healthy way that serves positive emotion regulation and self-development.
Acknowledgments
We thank everyone who contributed, all patients and students who were willing to complete the questionnaires, all the therapists who were willing to hand over and collect the questionnaires. We hope that with this research you can give something back that is helpful in practice and in further research. We also thank the institutions involved for making this possible. Thanks are also due to Arjan Doolaar for his help with the references.
References
- 1.
Borgesius E, Visser ECM. Vaktherapie en dagbesteding in de geneeskundige GGZ. [Arts therapies and day care in the medical mental healthcare]. Zorginstituut Nederland. Report number: 2015136409.
- 2. Haeyen S, van Hooren S, Hutschemaekers G. Perceived effects of art therapy in the treatment of personality disorders, cluster B/C: A qualitative study. Arts Psychother. 2015;45: 1–10. https://10.1016/j.aip.2015.04.005
- 3.
Haeyen S. Art therapy and emotion regulation problems: Theory and workbook. London, UK: Palgrave Macmillan; 2018.
- 4. Karterud S, Pedersen G. Short-term day hospital treatment for personality disorders: Benefits of the therapeutic components. Ther Communities 2004;25(1): 43–54. Available from: https://psycnet.apa.org/record/2004-15753-005
- 5.
Haeyen S. Effects of art therapy: The case of personality disorders cluster B/C. Dissertation manuscript. Radboud University, Nijmegen, the Netherlands; 2018.
- 6. Haeyen S, van Hooren S, van der veld W, Hutschemaekers G. Efficacy of art therapy in individuals with personality disorders cluster B/C: a randomized controlled trial. Journal of Personality Disorders, 2018); (32)4, 527–542. pmid:28926306
- 7. van den Broek E, Keulen- de Vos M, Bernstein D. P. Arts therapies and schema focused therapy: A pilot study. The Arts in Psychotherapy, 2011;38(5), 325–332.
- 8.
Malchiodi CA (ed.). Handbook of art therapy. 2nd ed. New York, NY: Guilford; 2012.
- 9.
Schweizer C, Bruyn J, Haeyen S, Henskens B, Rutten-Saris M, Visser H. Handboek beeldende therapie: Uit de verf. [Handbook of art therapy: Express yourself]. Houten, the Netherlands: Bohn Stafleu van Loghum; 2009.
- 10.
Hinz LD. Expressive therapies continuum: A framework for using art in therapy. London, UK: Routledge; 2019.
- 11.
Keulen-de Vos ME. Emotional states, crime and violence: A schema therapy approach to the understanding and treatment of forensic patients with personality disorders. Dissertation manuscript. Maastricht University, Maastricht, the Netherlands; 2013.
- 12. Lyshak-Stelzer F, Singer P, St. John P, Chemtob C. Art therapy for adolescents with posttraumatic stress disorder symptoms: A pilot study. Art Ther. 2007;24(4): 163–169. https://10.1080/07421656.2007.10129474
- 13. Pénzes I, van Hooren S, Dokter D, Smeijsters H, Hutschemaekers G. Material interaction and art product in art therapy assessment in adult mental health. Arts Health. 2016;8(3): 213–228. https://10.1080/17533015.2015.1088557
- 14. Pifalo T. Art therapy with sexually abused children and adolescents: Extended research study. Art Ther. 2006;23(4): 181–185. https://10.1080/07421656.2006.10129337
- 15. Schouten K, de Niet G, Knipscheer J, Kleber R, Hutschemaekers G. The effectiveness of art therapy in the treatment of traumatized adults. Trauma Violence Abuse. 2014;16(2): 220–228. https://10.1177/1524838014555032 pmid:25403446
- 16. Snir S, Regev D. ABI—Art-based Intervention Questionnaire. Arts Psychother. 2013;40(3): 338–346. https://10.1016/j.aip.2013.06.005
- 17. Regev D, Guttmann J. The psychological benefits of artwork: The case of children with learning disorders. Arts Psychother. 2005;32(4), 302–312. https://10.1016/j.aip.2005.02.001
- 18. Slayton SC, D’Archer J, Kaplan F. Outcome studies on the efficacy of art therapy: A review of findings. Art Ther. 2010;27(3), 108–118. https://10.1080/07421656.2010.10129660
- 19. Fowler JP, Ardon AM. Diagnostic Drawing Series and dissociative disorders: A Dutch Study. Arts Psychother. 2002;29(4); 221–230. https://10.1016/S0197-4556(02)00171-5
- 20. Pénzes I, van Hooren S, Dokter D, Hutschemaekers G. Formal elements of art products indicate aspects of mental health. Front Psychol. 2020;11(572700). https://10.3389/fpsyg.2020.572700 pmid:33101143
- 21. Fancourt D, Garnett C, Spiro N, West R, Mullensiefen D. How do artistic creative activities regulate our emotions? Validation of the Emotion Regulation Strategies for Artistic Creative Activities Scale (ERS-ACA). PLoS ONE. 2019;14(2). https://https://doi.org/10.1371/journal.pone.0211362
- 22. Gross JJ, John OP. Individual differences in two emotion regulation processes: Implications for affect, relationships, and well-being. J Pers Soc Psychol, 2003;85(2), 348–362. https://doi.org/10.1037/0022-3514.85.2.348 pmid:12916575
- 23. Garnefski N, Kraaij V, Spinhoven P. Negative life events, cognitive emotion regulation and emotional problems. Pers Individ Dif. 2001;30(8): 1311–1327. https://doi.org/10.1016/S0191-8869(00)00113-6.
- 24. Haeyen S, van Hooren S, van der Veld WM, Hutschemaekers G. Measuring the contribution of art therapy in multidisciplinary treatment of personality disorders: The construction of the Self-expression and Emotion Regulation in Art Therapy Scale (SERATS). Personal Ment Health. 2018;12(1), 3–14. https://doi.org/10.1002/pmh.1379 pmid:28730717
- 25.
American Psychiatric Association. Diagnostic and statistical manual of mental disorders. 5th ed. Washington, DC: American Psychiatric Association; 2013.
- 26.
World Health Organization. International Classification of Diseases, Tenth Revision, Clinical Modification (ICD-10-CM). Geneva, Switzerland: World Health Organization; 2015.
- 27. Gross JJ. The emerging field of emotion regulation: An integrative review. Rev Gen Psychol 1998;2(3): 271–299. https://doi.org/10.1037/1089-2680.2.3.27123.
- 28. Gross JJ. Emotion regulation in adulthood: Timing is everything. Curr Dir Psychol Sci. 2001;10(6): 214–219. https://doi.org/10.1111/1467-8721.0015224.
- 29.
Gross JJ, Thompson RA. Emotion regulation: Conceptual Foundations: Handbook of emotion regulation. New York, NY: Guilford Press; 2007.
- 30. Haeyen S, Chakhssi F, van Hooren S. Benefits of Art Therapy in People diagnosed with Personality Disorders: A Quantitative Survey. Front. Psychol. 2020;11,686. pmid:32351431
- 31.
Gussak D, Rosal M. (eds.). The Wiley handbook of art therapy. Hoboken, NJ: Wiley-Blackwell; 2016.
- 32. Springham N, Findlay D, Woods A, Harris J. How can art therapy contribute to mentalization in borderline personality disorder? Int J Art Ther. 2012;17(3): 115–129. https://doi.org/10.1080/17454832.2012.734835
- 33.
American Art Therapy Association. What is art therapy? http://arttherapy.org/ [Accessed 15th March 2017]
- 34.
Malchiodi C. Art is about resilience, it always has been. Psychology Today. Weblog. https://www.psychologytoday.com/blog/arts-and-health/201508/art-is-about-resilience-it-always-has-been
- 35.
Haeyen S, van Hooren S., van der Veld WM, Hutschemaekers G. The Psychometric Properties of the SERATS. A further investigation. Chapter 7, 119–128, in: S. Haeyen, Effects of Arts Therapy: The case of personality disorders cluster B/C. Dissertation manuscript. Radboud University, Nijmegen, the Netherlands; 2018.
- 36. Kleen M, de Groot F, A-Tjak J. Het meten van experientiele vermijding: De Nederlandse versie van de Acceptance and Action Questionnaire-II (AAQII) [Measuring experiential avoidance: The Dutch version of the Acceptance and action Questionnaire-II (AAQII)]. Gedragstherapie. 2008;41(4): 349–361. Available from: https://www.actcursus.nl/wp-content/uploads/2017/08/jacobsea-AAQII-2008.pdf
- 37. Schroevers M, Nyklícek I, Topman R. Validatie van de Nederlandstalige versie van de Mindful Attention Awareness Scale (MAAS) [Validation of the Dutch version of the Mindful Attention Awareness Scale (MAAS)]. Gedragstherapie. 2008:41(3), 225–240. Available from: http://hdl.handle.net/11370/ccd6cd4c-cd9c-40db-9664-1bd1108c51f6
- 38. Lambert MJ, Burlingame GM, Umphress V, Hansen NB, Vermeersch DA, Clouse GC, et al. The reliability and validity of the Outcome Questionnaire. Clin Psychol Psychother. 1996:3(4): 249–258. https://doi.org/10.1002/(SICI)1099-0879(199612)3:4<249::AID-CPP106>3.0.CO;2-S
- 39.
Young J, Arntz A, Atkinson T, Lobbestael J, Weishaar M, van Vreeswijk MF, et al. Schema Mode Inventory (SMI version 1). New York, NY: Schema Therapy Institute; 2007.
- 40. Lamers SMA, Westerhof GJ, Bohlmeijer ET, ten Klooster PM, Keyes CLM. Evaluating the psychometric properties of the Mental Health Continuum-Short Form (MHC-SF). J Clin Psychol. 2011;67(1): 99–110. https://doi.org/10.1002/jclp.20741 pmid:20973032
- 41. Van Lith T, Schofield MJ, Fenner P. Identifying the evidence-base for art-based practices and their potential benefit for mental health recovery: A critical review. Disabil Rehabil, 2013;35(16): 1309–1323. https://doi.org/10.3109/09638288.2012.732188 pmid:23116320
- 42. Leckey J. The therapeutic effectiveness of creative activities on mental well-being: A systematic review of the literature. J Psychiatr Ment Health Nurs. 2011;18(6): 501–509. pmid:21749556
- 43. Williams E, Dingle GA, Jetten J, Rowan C. Identification with arts-based groups improves mental wellbeing in adults with chronic mental health conditions. J Appl Soc Psychol. 2018;49(10). https://doi.org/10.1111/jasp.12561
- 44. Bungay H, Clift S. Arts on prescription: A review of practice in the UK. Perspect Public Health. 2010;130(6): 277–281. https://doi.org/10.1177/1757913910384050 pmid:21213564
- 45. Jensen A, Bonde L. The use of arts interventions for mental health and wellbeing in health settings. Perspect Public Health. 2018;138(4): 209–214. https://doi.org/10.1177/1757913918772602 pmid:29708025
- 46. Jensen A, Stickley T, Torrissen W, Stigmar K. Arts on prescription in Scandinavia: A review of current practice and future possibilities. Perspect Public Health. 2017;137(5):268–274. pmid:27852837
- 47. Kring AM, Smith DA, Neale JM. Individual differences in dispositional expressiveness: Development and validation of the emotional expressivity scale. J Pers Soc Psychol. 1994;66(5):934–49. https://doi.org/10.1037//0022-3514.66.5.934 pmid:8014836
- 48. Burgin CJ, Brown LH, Royal A, Silvia PJ, Barrantes-Vidal N, Kwapil TR. Being with others and feeling happy: Emotional expressivity in everyday life. Pers Individ Dif, 2012;53(3), 185–190. https://doi.org/10.1016/j.paid.2012.03.006 pmid:27013770
- 49. Dobbs JL, Sloan DM, Karpinski A. A psychometric investigation of two self-report measures of emotional expressivity. Pers Individ Dif, 2007;43(4). 693–702. https://doi.org/10.1016/j.paid.2007.01.010
- 50. Saarikallio S, Gold C, McFerran K. Development and validation of the Healthy-Unhealthy Music Scale. Child Adolesc Ment Health. 2015;20(4): 210–217. https://doi.org/10.1111/camh.12109 pmid:26726295
- 51. Maneesriwongul W, Dixon JK. Instrument translation process: A methods review. J Adv Nurs. 2004;48(2):175–186. https://doi.org/10.1111/j.1365-2 pmid:15369498
- 52.
SPSS Statistics for Windows. (Version 22.0) [Software] IBM Corp.
- 53. Benett DG, Wright TA. Sample size requirements for estimating Pearson, Kendall and Spearman correlations. Psychometrika. 2000;65(1), 23–28. https://doi.org/10.1007/BF02294183648.2004.03185.x
- 54. de Winter JC, Gosling SD, Potter J. Comparing the Pearson and Spearman correlation coefficients across distributions and sample sizes: A tutorial using simulations and empirical data. Psychol Methods. 2016;21(3):273–290. https://doi.org/10.1037/met0000079 pmid:27213982
- 55. Aldao A, Nolen-Hoeksema S, Schweizer S. Emotion-regulation strategies across psychopathology: A meta-analytic review. Clin Psychol Rev. 2010;30(2), 217–237. https://doi.org/10.1016/j.cpr.2009.11.004; pmid:20015584
- 56. Koole SL, Rothermund K. “I feel better but I don’t know why”: The psychology of implicit emotion regulation. Cogn Emot. 2011;25(3), 389–399. https://doi.org/10.1080/02699931.2010.550505 pmid:21432681
- 57. Mennin D, Farach F. Emotion and evolving treatments for adult psychopathology. Clin Psychol Sci Pract. 2007;14(4): 329–352. https://doi.org/10.1111/j.1468-2850.2007.00094.x
- 58. de Jong K, Nugter M, Polak M, Wagenborg J, Spinhoven P, Heiser W. The Outcome Questionnaire (OQ-45) in a Dutch population: A cross-cultural validation. Clin Psychol Psychother, 2007;14(4): 288–301. https://doi.org/10.1002/cpp.529
- 59. Finn S, Tonsager M. Information-gathering and therapeutic models of assessment: Complementary paradigms. Psychol Assess. 1997;9(4): 374–385. https://doi.org/10.1037/1040-3590.9.4.374
- 60. Barnicot K, Katsakou C, Marougka S, Priebe S. Treatment completion in psychotherapy for borderline personality disorder: A systematic review and meta-analysis. Acta Psychiatr Scand. 2011;123(5): 327–338. https://doi.org/10.1111/j.1600-0447.2010.01652.x pmid:21166785
- 61. Kvarstein EH, Nordviste O, Dragland L, Wilberg T. Outpatient psychodynamic group psychotherapy—outcomes related to personality disorder, severity, age and gender. Personal Ment Health. 2017;11(1): 37–50. https://doi.org/10.1002/pmh.1352 pmid:27766761
- 62. Lambert M, Whipple J, Hawkins E, Vermeersch D, Nielsen S, Smart D. Is it time for clinicians to routinely track patient outcome? A meta-analysis. Clin Psychol. 2003;10(3): 288–301. https://doi.org/10.1093/clipsy.bpg025
- 63. Sapyta J, Riemer M, Bickman L. Feedback to clinicians: Theory, research and practice. J Clin Psychol. 2005;61(2): 145–153. https://doi.org/10.1002/jclp.20107 pmid:15609360