Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Student-teacher agreement on personality traits and social competencies during early adolescence: A longitudinal study

  • Marek Blatný ,

    Contributed equally to this work with: Marek Blatný, Veronika Koutná, Martin Jelínek, Petr Květon, Alexander T. Vazsonyi

    Roles Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Supervision, Writing – original draft, Writing – review & editing

    blatny@phil.muni.cz

    Affiliation Department of Psychology, Faculty of Arts, Masaryk University, Brno, Czech Republic

  • Veronika Koutná ,

    Contributed equally to this work with: Marek Blatný, Veronika Koutná, Martin Jelínek, Petr Květon, Alexander T. Vazsonyi

    Roles Data curation, Investigation, Methodology, Project administration, Writing – original draft, Writing – review & editing

    Affiliation Department of Psychology, Faculty of Arts, Masaryk University, Brno, Czech Republic

  • Martin Jelínek ,

    Contributed equally to this work with: Marek Blatný, Veronika Koutná, Martin Jelínek, Petr Květon, Alexander T. Vazsonyi

    Roles Conceptualization, Formal analysis, Methodology, Validation, Writing – original draft, Writing – review & editing

    Affiliation Department of Psychology, Faculty of Arts, Masaryk University, Brno, Czech Republic

  • Petr Květon ,

    Contributed equally to this work with: Marek Blatný, Veronika Koutná, Martin Jelínek, Petr Květon, Alexander T. Vazsonyi

    Roles Formal analysis, Methodology, Validation, Writing – original draft, Writing – review & editing

    Affiliation Department of Psychology, Faculty of Arts, Masaryk University, Brno, Czech Republic

  • Alexander T. Vazsonyi

    Contributed equally to this work with: Marek Blatný, Veronika Koutná, Martin Jelínek, Petr Květon, Alexander T. Vazsonyi

    Roles Conceptualization, Data curation, Formal analysis, Funding acquisition, Methodology, Supervision, Writing – original draft, Writing – review & editing

    Affiliation Department of Family Sciences, University of Kentucky, Lexington, Kentucky, United States of America

Abstract

The present study sought to validate existing knowledge on inter-rater agreement on personality traits and social competencies. Based on longitudinal data, the study aimed to determine whether the agreement between student and teacher reports changes over time. The research sample consisted of a total of 296 early adolescents (181 females, 115 males, average age in the first wave of the two-year study period was 12.37 years). The personality traits and social competencies of students were rated by class teachers (N = 28, 75% females). Personality traits were measured by the Big Five Inventory and social competencies by the Social Skills Improvement System. The main findings of the study are as follows: 1) the highest agreement between student and teacher ratings of personality traits and social competencies was found for characteristics that were high in observability; 2) there was greater agreement between student and teacher ratings of social competencies for girls; 3) high temporal stability was found for personality traits and social competencies for both students and teachers; there were no substantial changes in the agreement of student and teacher ratings over time. Attention to hidden or difficult-to-assess student characteristics may prevent developmental, school, and social/interpersonal problems in adolescents.

Introduction

Inter-rater agreement on personality characteristics has received much attention in psychological research, as it helps establish the reliability and validity of personality assessments. Moreover, the degree of agreement between self-ratings and those of other observers has significant implications for various aspects of a person’s life. Low levels of self-observer agreement may indicate a discrepancy between an individual’s self-perception and the perceptions of others, and this mismatch could lead to misunderstandings and difficulties in forming and maintaining relationships [1]. Thus, for psychological research, it is particularly important to study the personality characteristics for which self-perceptions and those of others are most discrepant and to look for the causes and consequences of these discrepancies.

Personality

Previous research on inter-rater agreement has focused primarily on personality traits in the context of the Five-Factor Model of personality [26]. In their seminal work, John and Robins [4] found that inter-rater agreement is associated with the content domain of the Five-Factor Model (FFM), observability, and social desirability. In addition, they focused on the differences between two types of inter-rater agreement: peer-peer agreement and self-peer agreement. They found that more observable and less evaluative traits such as Extraversion elicited higher inter-rater agreement. Self-peer agreement was lower than peer-peer agreement, but this effect was only for traits high in evaluativeness; for neutral traits, self-peer agreement was as high as peer-peer agreement.

Vazire [6] formulated the Self-Other Knowledge Asymmetry (SOKA) Model. According to this model, self-evaluation is more accurate than the judgment of others for traits with low observability (e.g., Neuroticism), whereas the judgement of others is more accurate than self-evaluation for traits with high evaluativeness (e.g., intellect). Trait observability is associated with informational asymmetry. The self has access to its own thoughts and feelings, which are inaccessible to the outside observer; others, on the other hand, have a better physical perspective on observable behavior. Trait evaluativeness is associated with motivational asymmetry. The main motivational difference between self-perception and the perception of others is the degree of ego involvement. Self-judgments of a highly evaluative trait are biased by various self-serving biases, whereas the judgments of others, who are not emotionally involved, may therefore be closer to reality.

An important issue with regard to inter-rater agreement is the acquaintance of the rater and the person being rated. In their meta-analysis, Connelly and Ones [2] found not only that increased frequency of interactions with the target persons increases the accuracy of their judgement of personality traits, but that a close personal proximity of informants to the target person is necessary to substantially increase the accuracy of their personality judgements, particularly for traits with low observability.

Research suggests that self-perceptions tend to be less accurate during adolescence and early adulthood, with individuals overestimating their positive qualities and underestimating their negative qualities. As individuals mature, self-perceptions become more aligned with observer perceptions, resulting in higher self-observer agreement [7,8].

Social competencies

In recent years, in addition to personality traits, attention has also been paid to agreement in the assessment of social competencies in childhood and adolescence using behavioral rating scales with multiple informants (e.g., parents, teachers or classmates). However, there seems little agreement in this area, which accords with the low inter-rater agreement found in various research with children and adolescents [9]. In their meta-analysis of agreement on social competence, Renk and Phares [10] reported that agreement in informant pairs including child/adolescent self-report (e.g., teacher-student) is lower when compared to other informant pairs (e.g., teacher-parent). These findings are consistent with Gresham et al. [11] who found a similar level of teacher-student agreement, with the highest agreement for the Responsibility and Engagement competencies and the lowest agreement for the Communication and Empathy competencies.

These cross-informant discrepancies in perceptions of social competence do not necessarily imply measurement error or lack of validity. Several factors may influence the level of agreement, including observability and willingness to report [12]. The level of cross-informant agreement also varies depending on the age of the child. For example, Zsolnai and Kasik [13] found a decreasing level of teacher-student agreement on social skills between 7 and 11-year-olds, while Sørlie et al. [14] found increasing teacher-student cross-informant correlation between grades 8 and 10.

Most of the evidence on the development of social competence stems from studies of preschoolers and younger school-age children. These studies show that developmental trends may depend on the child’s sex and on the informant. Girls tend to be rated higher on social competencies in the ratings of teachers as early as in kindergarten, but also later in life [1315]. Boys, on the other hand, were found to have higher levels of individual differences in social competence than girls [15]. Hajovsky et al. [15] described a linear decline in competence for boys and stagnation/stability for girls between kindergarten and grade 6 in the reports of teachers. However, the authors add that boys do not necessarily exhibit a decline in competence, but rather they fall short of the standards set by girls. Sørlie et al. [14] found that social competencies are established earlier in development and remain stable during adolescence.

Objectives of the study

Research on the level of inter-rater agreement, particularly the SOKA model (Vazire, 2010), has highlighted the significant role of the Self in processing information about oneself. Markus [16] introduced the concept of the Self as a system of cognitive schemas. According to Markus, people have developed a schema for their important traits; thus, they are “schematic” for certain areas of personal characteristics, while for those areas of personal characteristics for which they have not developed a schema—and which are therefore not part of their self-concept—they are “aschematic.” For an individual to be able to create such a schema, the characteristic in question must not only be descriptive but also important to them. Previous research has been based primarily on self-descriptive scales and has not taken into account the subjective importance of the behavioral, cognitive, and emotional characteristics being assessed. This study aims to further investigate whether what is accessible only to the self—the subjective importance of a personal characteristic—can be observed by an external rater through the behavior of the person being evaluated.

The objective of the present study is therefore to validate existing knowledge on the effect of the observability of personality traits on the level of inter-rater agreement and to extend it to social competencies with the inclusion of a scale assessing the “importance” of social competencies. The assumption is that social competencies such as Cooperation and Engagement are highly visible compared to more private ones such as Empathy and Self-Control [11,17], and that the agreement will be higher for more visible competencies. It can also be assumed that the level of a given social skill will be more readily apparent in the child’s behavior than the child’s perception of its subjective importance, and therefore, agreement on the rating of level will be higher than agreement on the rating of the importance of a competence.

On the basis of longitudinal data, the study aims to determine whether agreement between self- and teacher reports changes over time and whether teachers are able to identify developmental trends in personality traits and social competencies. Research suggests that inter-rater agreement on personality traits tends to be lower during adolescence compared to middle adulthood [8] and the level of teacher-student agreement on social skills is reported to be lower for older school-age children compared to younger school-age children [13]. Therefore, it was expected that the level of student-teacher agreement on personality traits and social competencies would be generally low and stable over time.

Method

Ethics statements

The study was approved by the University of Kentucky Institutional Review Board (14–0623-P4S) and by the Board of the Institute of Psychology, Czech Academy of Sciences. Written informed consent was obtained from parents of all participants in the study.

Procedure

The current longitudinal study is part of the Brno Longitudinal Study of Youth (BLSY), an accelerated longitudinal study that followed two cohorts of youth (at grades 6 and 7), aged 12 and 13 years at baseline. The convenience sample was recruited from nine schools in Brno, a medium-sized city in the Czech Republic, which were selected on the basis of the school’s interest and willingness to participate. The recruitment for this study took place from 10/10/2014–11/11/2014. The study received University IRB approval and followed ethical guidelines; written informed consent was obtained from parents of all participants in the study.

The study analyzed data from four waves of data collection. The first wave of data collection took place in December 2014, followed by subsequent waves at six-month intervals. The data were collected in group settings in classrooms using a paper-and-pencil questionnaire (taking around 90 minutes to complete), which was administered in a controlled school environment by trained administrators. The students and their class teachers completed their questionnaires concurrently. Teachers received financial compensation for rating their students.

The scale scores were computed as the average response to items, where there were no more than two missing responses for a given scale. During the first wave of data collection, valid data were obtained from 453 students (the total scores of the observed variables were successfully computed for all students and each of them received an assessment from their class teacher). Valid data was obtained from 490 students in the second wave, from 462 students in the third wave, and from 468 students in the fourth wave. Due to the longitudinal nature of the study, only data from those students who participated in all four waves of data collection and received teacher ratings were included in the subsequent analyses.

Research sample

The research sample consisted of a total of 296 participants (181 females, 115 males). The average age of the participants in the first wave of data collection was 12.37 years (SD = 0.63), who were attending either first grade (N = 57) or second grade (N = 39) in the case of Gymnasiums or high schools, or sixth grade (N = 102) or seventh grade (N = 98) in the case of primary schools or middle schools. The personality traits and social competencies of students were assessed by their class teachers (form tutors) (N = 28, 75% females).

Instruments

The Big Five Inventory (BFI; [18]) assessed five basic personality traits, based on 44 items rated on a five-point response scale (ranging from 1 to 5). In addition to rating their own traits, the respondents were also rated by their class teachers. The internal consistencies of all dimensions were satisfactory (McDonald’s ω > 0.70) with the exception of self-reported Extraversion (McDonald’s ω = 0.58) and Agreeableness (McDonald’s ω = 0.69).

The Social Skills Improvement System (SSIS; [19]) was used to assess behavioral and interpersonal skill difficulties, screen for problem behaviors, and identify students at risk of social behavior difficulties and poor academic performance. In this study, the SSIS scales assessing social competencies were utilized (Communication, Cooperation, Assertion, Responsibility, Empathy, Engagement, and Self-control. Each item was rated for the truthfulness of the statement (on a four-point scale from 1 to 4) and the importance of the skill (on a three-point scale from 1 to 3). In addition to rating their own competencies, respondents were also rated by their class teachers. The internal consistency of the scales was satisfactory (McDonald’s ω > 0.70), although eight scales had slightly lower internal consistency (McDonald’s ω > 0.60; the lowest level was the Importance Responsibility scale for teachers with ω = 0.62). Internal consistency was assessed in the first wave of measurement.

Data analysis

Pearson correlations were used for assessing the agreement between the self-ratings and the teacher ratings. In the case of personality traits, the mean values for each dimension were also compared using paired t-tests. However, this was not possible for social competencies due to the differences in the content of the items used for self-ratings and teacher ratings. The stability of the self-ratings and teacher ratings was examined using Pearson correlations, and changes in levels were assessed using General Linear Model for repeated measures. A procedure based on Fisher’s z transformation was employed to calculate averaged correlation coefficients and Cohen’s d. All analyses were conducted separately for girls and boys, and sex was considered as a between-subject factor in the analysis of variance. Effect sizes were interpreted following the recommendation by Funder and Ozer [20]: r > 0.10 (d > 0.20; ηp2 > 0.01) indicated a small effect size, r > 0.20 (d > 0.41; ηp2 > 0.04) indicated a medium effect size, and r > 0.30 (d > 0.63; ηp2 > 0.09) indicated a large effect size.

Results

Agreement between self-ratings and teacher ratings – personality traits

From the correlation coefficients between the self-ratings and teacher ratings of personality traits among boys (see Table 1) and girls (Table 2), it can be concluded that the agreement between ratings is generally not high. The highest values across all measurement waves for both boys and girls were observed for Extraversion, as is evident from the average correlation coefficient shown in Table 3. Similarly, moderate agreement was observed for Openness among both boys and girls, for which average correlation coefficients for self-other agreement were almost identical. In contrast to the aforementioned traits, differences were found between girls and boys in the level of agreement for Conscientiousness, where the coefficients for girls were statistically significant and higher than 0.2 in all waves.

thumbnail
Table 1. The relationship between self-rating and teacher-rating of personality traits in males.

https://doi.org/10.1371/journal.pone.0351394.t001

thumbnail
Table 2. The relationship between self-rating and teacher-rating of personality traits in females.

https://doi.org/10.1371/journal.pone.0351394.t002

thumbnail
Table 3. Averaged agreement between self-rating and teacher-rating of personality traits across all waves.

https://doi.org/10.1371/journal.pone.0351394.t003

In terms of mean levels (Cohen’s d), the differences were in the category of at least small effect sizes for Extraversion and Openness in both girls and boys, and for Neuroticism only in girls, as can be seen in Table 3. In all of the aforementioned cases, teachers consistently reported lower values of the traits than the students’ self-ratings. This difference was most pronounced for Extraversion, which was observed in all waves for both girls and boys, with the overall effect size within the range of a medium effect. There was a similarly marked difference for Neuroticism in girls, for which girls’ self-ratings were consistently higher than the teacher ratings in all waves, although this effect was not found for boys.

Agreement between self-ratings and teacher ratings – social competencies

In contrast to the analysis of personality traits, no mean level comparisons were made between self-ratings and teacher ratings, due to the differences in the composition of items. Therefore, Tables 4 and 5 only summarize the data on the agreement between self-ratings and teacher ratings in the domain of social competencies and their importance. All the data indicate a low level of agreement between self-ratings and teacher ratings in the area of social competencies. In terms of importance, only a few significant correlation coefficients were found, apart from in the fourth wave of measurement for boys, in which there was a significant agreement in the rating of four skills. Although the agreement between self-ratings and teacher ratings for social competencies overall can be considered relatively low, Cooperation and Engagement stand out as exceptions. For these competencies, relationships between the ratings were consistently found for boys and girls, ranging from a small to medium effect size in boys and a medium to large effect size in girls.

thumbnail
Table 4. The relationship between self-rating and teacher-rating of social skills in males.

https://doi.org/10.1371/journal.pone.0351394.t004

thumbnail
Table 5. The relationship between self-rating and teacher-rating of social skills in females.

https://doi.org/10.1371/journal.pone.0351394.t005

Table 6 provides aggregated data for all four waves of measurement. It is evident that there is essentially only weak agreement between the self-ratings and teacher ratings, although it is stronger for Cooperation and Engagement, and more so for girls. With regard to the importance of these skills, there is virtually no agreement between the ratings.

thumbnail
Table 6. Averaged agreement between self-rating and teacher-rating of social skills across all waves.

https://doi.org/10.1371/journal.pone.0351394.t006

Stability of self-ratings and teacher ratings – personality traits

The stability of personality trait ratings is generally high (Table 7). When comparing stability coefficients for teachers and students, the data clearly indicate that teacher ratings exhibit higher overall stability than self-ratings. With regard to differences between girls and boys, the only noticeable differences can be found for self-ratings. Among girls, the stability of the Extraversion and Neuroticism traits is slightly higher than for boys.

thumbnail
Table 7. Stability of self-rating and teacher-rating in consecutive waves (Pearson correlations) – personality traits.

https://doi.org/10.1371/journal.pone.0351394.t007

Table 8 presents the results of the General Linear Model, which captures the changes in personality traits over time, taking into account the sex of the individuals rated. In the case of Extraversion, a significant change was found for this trait over time, which was further conditioned by the sex of the respondents. Fig 1 illustrates that while girls showed the most pronounced decline between the second and third measurement, boys experienced this shift between the third and fourth measurement. For Agreeableness, a relatively substantial change was observed over time, which was primarily driven by the difference between the levels measured in the first and final waves, with no interaction effect of sex. In the case of Neuroticism, an interaction effect of time and sex was found, with a gradual increase in this trait among girls, while for boys it remained relatively constant. From the perspective of teachers, there was a perceived difference in the level of Neuroticism in students between the first and second measurements when compared to the third and fourth measurements.

thumbnail
Table 8. Differences in self-rating and teacher-rating depending on time and sex – personality traits.

https://doi.org/10.1371/journal.pone.0351394.t008

thumbnail
Fig 1. Differences in self-rating and teacher-rating based on time and sex – personality traits.

Estimated marginal means and corresponding 95% confidence intervals are displayed.

https://doi.org/10.1371/journal.pone.0351394.g001

Stability of self-ratings and teacher-ratings – social competencies

The temporal stability of the self-rating of social competencies is generally comparable across different scales and typically ranges from 0.5 to 0.8 (see Table 9). Furthermore, neither the sex of the person rated nor the evaluator’s role (student vs. teacher) significantly influenced the level of stability. Regarding the stability of the rating of the importance of social competencies, the stability of the teacher rating of Self-Control deviates from the general pattern for both boys and girls.

thumbnail
Table 9. The stability of self-rating and teacher-rating in consecutive waves (Pearson correlations) – social skills and their importance.

https://doi.org/10.1371/journal.pone.0351394.t009

With regard to changes in the level of self-rating of social competencies (see Table 10 and Fig 2), the level of Engagement gradually decreases over time, regardless of sex. In the case of Self-Control, a significant decline was observed in the second wave of measurement. From the perspective of teachers, significant changes over time were found for Cooperation, Responsibility, and Empathy. For the first two aforementioned social competencies, an interaction effect of time and sex was identified, whereby teachers perceived both Cooperation and Responsibility to be higher in girls than in boys. In the case of Cooperation, a gradual divergence of average values in the third and fourth waves of measurement can be observed, while for Responsibility the largest differences were recorded in the first wave of measurement.

thumbnail
Table 10. Differences in self-rating and teacher-rating depending on time and sex – social skills and their importance.

https://doi.org/10.1371/journal.pone.0351394.t010

thumbnail
Fig 2. Differences in self-rating and teacher-rating based on time and sex – social skills.

Estimated marginal means and corresponding 95% confidence intervals are displayed.

https://doi.org/10.1371/journal.pone.0351394.g002

From the perspective of students, the importance of all social skills decreases over time (Fig 3). The low agreement between self-ratings and teacher ratings on the importance of social skills (see Table 6) is also reflected in the fact that the developmental trends captured in the self-ratings of students do not correspond to those of teacher ratings.

thumbnail
Fig 3. Differences in self-rating and teacher-rating are displayed based on time and sex – social skills importance.

Note. Estimated marginal means and corresponding 95% confidence intervals are shown.

https://doi.org/10.1371/journal.pone.0351394.g003

Discussion

Agreement between self-ratings and teacher ratings – personality traits

The findings of this study are consistent with previous research, as the highest agreement between self- and other-ratings of personality traits was found for Extraversion, a trait high in observability and low in evaluativeness, while the lowest agreement was found for Neuroticism, a trait with the opposite valence (low in observability and high in evaluativeness). Agreement between self- and teacher ratings was also found for traits that are manifested specifically in academic and learning behaviors, i.e., Openness to Experience and Conscientiousness [21], with a higher agreement for Conscientiousness found for girls than for boys. However, the agreement between the self-ratings and teacher ratings is only low to moderate in magnitude. Similar patterns of relationships were observed in all four measurement waves of the longitudinal study.

Beyond trait observability, the relatively modest magnitude of agreement may also reflect systematic sources of rater disagreement. One important factor is method variance associated with differences in assessment formats and perspectives. Self-reports capture internal experiences, self-concepts, and context-generalized tendencies, whereas teacher ratings are based primarily on observable behavior. These methodological differences can introduce systematic discrepancies that are independent of the traits themselves and may contribute to lower cross-informant agreement, as discussed, for example, by De Los Reyes [9] in the context of mental health assessment. As a result, disagreement between informants may partly reflect genuine cross-situational variability rather than measurement inaccuracy.

Agreement between self-ratings and teacher ratings – social competencies

The agreement between self-ratings and teacher ratings on social competencies was not high and was weaker than for personality traits. In contrast to the analysis of personality traits, we observed differences according to the sex of the respondents. For boys, agreement between self- and teacher ratings was only observed for the social competence Cooperation, while more significant relationships were found for girls. Slightly higher agreement was observed between self- and teacher ratings for girls across the four measurement waves. In all cases, these were social competencies that are highly observable, which is consistent with findings from personality trait research. The lowest agreement between self- and teacher-ratings for both boys and girls was for Empathy, which is a social competence low in observability. These findings are consistent with the study by Mudarra et al. [22], who found agreement between self-ratings and teacher ratings only for Cooperation in a sex-undifferentiated cohort of students. One reason for the lower agreement between self-ratings and teacher ratings for boys could be that 75% of the teachers in our sample were females. According to Mullola et al. [23] male teachers perceived boys more positively and more capable in educational competence and teachability than female teachers.

Discrepancies in the assessment of social competencies may also be influenced by the relational context between teachers and students. The quality of the teacher–student relationship can shape both the amount and type of information available to the teacher, as well as potential biases in perception. Teachers who have more frequent, positive, or closer interactions with students may be better able to detect subtle aspects of their social functioning, whereas more distant or conflictual relationships may limit insight or introduce evaluative biases. Such relational factors may therefore contribute to variability in agreement across competencies and between students. Furthermore, social competencies are inherently context-dependent and may be expressed differently across social environments. Behaviors such as empathy or communication may manifest differently in peer interactions outside the classroom than in teacher-supervised settings. Consequently, discrepancies between self- and teacher ratings may partly reflect context-specific variations in behavioral expression, not disagreement regarding the same underlying construct.

Stability of self-ratings and teacher ratings – personality traits

The stability of the rating of personality traits was generally very high in the period under study, which is consistent with current findings [24], from the perspectives of both students and teachers. However, a comparison of the stability coefficients shows that the teachers’ rating of the personality stability of students was higher than the students’ own rating of stability.

Teachers can be more objective in assessing personality than students themselves, because they can draw on years of experience with many different children. They are also able to identify age-appropriate and developmentally typical behavior and observe children’s social interactions in a structured environment [25]. On the other hand, teacher assessment may also be biased by number of factors, such as implicit norms and theories and individual preferences [26]. Teachers may also form a view of a student that they subsequently apply regardless of the student’s development and personality changes. Thus, a teacher’s rating of high student personality stability may reflect not only the degree of stability of the student’s personality, but also the teacher’s perception of the student.

Stability of self-ratings and teacher ratings – social competencies

The temporal stability of the level of social competence was high from the perspective of both students and teachers and was generally comparable across different social skills regardless of the student’s sex. The findings therefore support the view that social competence is formed in early and middle childhood and remains stable from early adolescence onwards [14].

In the assessments of teachers, girls had higher levels of Cooperation and Responsibility. The higher level of social competencies of girls compared to boys has been documented by several studies [e.g., 1315]. However, certain gender stereotypes may play a role in teacher ratings. Teachers’ implicit theories of social behavior are more negative for boys, with whom they associate externalizing behavior [23,27]. As a consequence, teachers may also perceive boys to be less responsible and cooperative.

Agreement between and the stability of self-ratings and teacher ratings – importance of social competencies

Agreement between student and teacher ratings of the importance of social competencies has not been widely explored. Our findings revealed virtually no agreement between the self-ratings and teacher ratings of the importance of social competencies. This confirms our assumption that information that is only accessible to the self and not expressed in overt behavior is difficult for an outside observer to recognize and evaluate, unless the observer is someone close [2,6].

At the same time, this near-zero agreement may also be influenced by methodological factors similar to those discussed for the aforementioned characteristics. Among contextual factors that may further attenuate agreement, individual values, motivations, and situational priorities are likely to play an important role, as they may differ substantially between students and teachers. While students’ ratings may reflect personal goals and peer-related concerns, teacher ratings may be anchored in educational expectations and classroom norms. These differences in evaluative frameworks may further contribute to systematic divergence between informants.

The importance of all social competencies from the perspective of students decreased over time, which may be related to developmental trends in early adolescence. This period is characterized by the influence and importance of peers beginning to outweigh that of the student’s family. Thus, many adolescents succumb to peer pressure, which can also lead to negative consequences such as drinking, smoking, and sexual activity, and the diminishing importance of social norms and socially desirable behavior [28].

Practical implications

Educational professionals should focus on actively identifying less conspicuous student manifestations, as the agreement between teacher ratings and students’ internal experiences is very low for traits with low observability, such as neuroticism or empathy. While teachers easily recognize extraversion and external cooperation, students’ internal anxieties or subjective sensitivities often remain hidden. For effective early prevention of interpersonal and school problems, it is therefore essential to combine multiple sources of information—such as student self-report questionnaires—and not rely solely on external observation within the structured classroom environment.

Schools should implement mechanisms for the critical reflection of gender differences when assessing social competencies, as teachers (who are often female themselves) tend to rate girls as more responsible and cooperative, while boys may face negative bias. This discrepancy may stem from implicit theories and norms that associate boys with externalizing behavior, thereby undervaluing their actual skills. Targeted teacher training regarding these biases can prevent situations where boys unnecessarily fail to meet standards that are primarily set based on the manifestations of girls.

School administrations and psychologists should address the risk of labeling students, which arises from the fact that teachers perceive students’ personality stability as higher than the students do themselves. Teachers may form a fixed image of a student and subsequently apply it regardless of the student’s actual development and changes over time. It is therefore necessary to apply a formative approach to assessment and regularly revise the perspective on the student, especially during early adolescence.

Limitations

The predominance of female teachers in our sample may have influenced the ratings of students’ social competencies, as these may be more accurately assessed in boys by male teachers. Moreover, the teachers in our study rated students four times in a period of two years and thus may have been overwhelmed by the number of student assessments. This may have led them to project perceptions they had formed of students at the beginning of the study into their ratings. Although this was a longitudinal study, the four measurements were taken over a relatively short period of two years, which may be too short a time to observe developmental trends in personality traits and social competencies.

An important methodological limitation concerns the internal consistency of the employed scales. While most measures demonstrated adequate levels of reliability across both assessment contexts (self-ratings and teacher ratings), several scales reached only borderline values. In such cases, the observed student–teacher agreement is likely to underestimate the true level of correspondence due to attenuation effects associated with measurement error (see [29]). Particular caution is warranted when interpreting agreement for Extraversion (with the lowest McDonald’s omega), which appeared to be the most readily observable personality trait from the teacher’s perspective. In light of this limitation, it is plausible that Extraversion is, in fact, even more distinct from the other personality characteristics in terms of student–teacher agreement than the present findings indicate.

Our findings may also be influenced by the cultural context. Although the Czech Republic, as an active member of the OECD, has long integrated international standards into its educational policies, as evidenced by its regular participation in prestigious comparative studies such as PISA and TALIS, the teacher-student relationship in the Czech Republic is traditionally asymmetrical, emphasizing formal authority and external discipline—if a student’s internal anxiety does not disrupt the lesson and manifests quietly, it often remains invisible to the teacher.

Conclusions

Current knowledge suggests that personal characteristics, whether personality traits or social competencies, that are manifested in behavior are more easily recognized by an external observer than characteristics that are not manifested in behavior and are only available to the Self. Teachers should be aware of this fact in the exercise of their profession and not rely only on what they can infer from the visible behavior of the students but also bear in mind that many of the personality characteristics of the child may be hidden to them. High levels of neuroticism can potentially lead to the development of internalized psychopathology (depression, anxiety), which is also more difficult for an outside observer to assess than externalized psychopathology [30]. Attention to hidden, unrevealed, or difficult-to-assess student characteristics may thus prevent developmental, school, and broader social/interpersonal problems in adolescents.

There are two main avenues for further research. First and foremost, our findings should be validated through a broader international study that would include not only OECD member countries but also countries from other cultural contexts. Further research should also be supplemented by a qualitative study following up on the questionnaire survey, which would examine the main sources of information about others from which raters draw their conclusions about their personalities, and would also identify typical ways of thinking about others. Ready et al. [31] noted that when peers were asked to rate a target on difficult-to-judge traits, they tended to draw on their own personalities; the authors referred to this phenomenon as “self-based heuristics.” Understanding such judgment processes may help clarify why some student characteristics remain hidden from teachers and may support more accurate, balanced, and developmentally sensitive assessment practices in schools.

Supporting information

S1 File. Inclusivity in global research questionnaire.

https://doi.org/10.1371/journal.pone.0351394.s001

(DOCX)

References

  1. 1. Luan Z, Bleidorn W. Self-other personality agreement and internalizing problems in adolescence. J Pers. 2020;88(3):568–83. pmid:31472074
  2. 2. Connelly BS, Ones DS. An other perspective on personality: meta-analytic integration of observers’ accuracy and predictive validity. Psychol Bull. 2010;136(6):1092–122. pmid:21038940
  3. 3. Funder DC. On the accuracy of personality judgment: a realistic approach. Psychol Rev. 1995;102(4):652–70. pmid:7480467
  4. 4. John OP, Robins RW. Determinants of interjudge agreement on personality traits: the big five domains, observability, evaluativeness, and the unique perspective of the self. J Pers. 1993;61(4):521–51. pmid:8151500
  5. 5. Kim H, Di Domenico SI, Connelly BS. Self–other agreement in personality reports: a meta-analytic comparison of self- and informant-report means. Psychol Sci. 2019;30(1):129–38.
  6. 6. Vazire S. Who knows what about a person? The self-other knowledge asymmetry (SOKA) model. J Pers Soc Psychol. 2010;98(2):281–300. pmid:20085401
  7. 7. Luan Z, Hutteman R, Denissen JJA, Asendorpf JB, van Aken MAG. Do you see my growth? Two longitudinal studies on personality development from childhood to young adulthood from multiple perspectives. J Res Person. 2017;67:44–60.
  8. 8. Roberts BW, DelVecchio WF. The rank-order consistency of personality traits from childhood to old age: a quantitative review of longitudinal studies. Psychol Bull. 2000;126(1):3–25. pmid:10668348
  9. 9. De Los Reyes A, Augenstein TM, Wang M, Thomas SA, Drabick DAG, Burgers DE, et al. The validity of the multi-informant approach to assessing child and adolescent mental health. Psychol Bull. 2015;141(4):858–900. pmid:25915035
  10. 10. Renk K, Phares V. Cross-informant ratings of social competence in children and adolescents. Clin Psychol Rev. 2004;24(2):239–54. pmid:15081518
  11. 11. Gresham FM, Elliott SN, Cook CR, Vance MJ, Kettler R. Cross-informant agreement for ratings for social skill and problem behavior ratings: an investigation of the Social Skills Improvement System-Rating Scales. Psychol Assess. 2010;22(1):157–66. pmid:20230162
  12. 12. Karver MS. Determinants of multiple informant agreement on child and adolescent behavior. J Abnorm Child Psychol. 2006;34(2):242–53.
  13. 13. Zsolnai A, Kasik L. Functioning of social skills from middle childhood to early adolescence in Hungary. Int J Emot Educ. 2014;6(2):54–68.
  14. 14. Sørlie M, Hagen KA, Ogden T. Social competence and antisocial behavior: continuity and distinctiveness across early adolescence. J Res Adolesc. 2008;18(1).
  15. 15. Hajovsky DB, Caemmerer JM, Mason BA. Gender differences in children’s social skills growth trajectories. Appl Develop Sci. 2022;26(3):488–503.
  16. 16. Markus H. Self-schemata and processing information about the self. J Personal Soc Psychol. 1977;35(2):63–78.
  17. 17. Ogden T. The validity of teacher ratings of adolescents’ social skills. Scand J Educ Res. 2003;47(1):63–76.
  18. 18. John OP, Srivastava S. The Big-Five trait taxonomy: History, measurement, and theoretical perspectives. In: Pervin LA, John OP, editors. Handbook of personality: theory and research. New York: Guilford Press; 1999. 102–38.
  19. 19. Gresham FM, Elliott SN. Social skills improvement system: rating scales. Pearson Assessments; 2008.
  20. 20. Funder DC, Ozer DJ. Evaluating effect size in psychological research: sense and nonsense. Adv Methods Pract Psychol Sci. 2019;2(2):156–68.
  21. 21. Brandt ND, Becker M, Tetzner J, Brunner M, Kuhl P. What teachers and parents can add to personality ratings of children: unique associations with academic performance in elementary school. Eur J Pers. 2021;35(6):814–32.
  22. 22. Mudarra MJ, Álvarez-González B, García-Salguero B, Elliott SN. Multi-informant assessment of adolescents’ social–emotional skills: patterns of agreement and discrepancy among teachers, parents, and students. Behav Sci. 2022;12(3):62.
  23. 23. Mullola S, Ravaja N, Lipsanen J, Alatupa S, Hintsanen M, Jokela M, et al. Gender differences in teachers’ perceptions of students’ temperament, educational competence, and teachability. Br J Educ Psychol. 2012;82(Pt 2):185–206. pmid:22583086
  24. 24. Pullmann H, Raudsepp L, Allik J. Stability and change in adolescents’ personality: a longitudinal study. Eur J Pers. 2006;20(6):447–59.
  25. 25. Clark DA, Durbin CE, Hicks BM, Iacono WG, McGue M. Personality in the age of industry: structure, heritability, and correlates of personality in middle childhood from the perspective of parents, teachers, and children. J Res Pers. 2017;67:132–43. pmid:28408770
  26. 26. Plaks JE. Implicit theories: assumptions that shape social and moral cognition. Advances in experimental social psychology. Elsevier; 2017. 259–310. https://doi.org/10.1016/bs.aesp.2017.02.003
  27. 27. Glock S, Kleen H. Gender and student misbehavior: evidence from implicit and explicit measures. Teach Teach Educ. 2017;67:93–103.
  28. 28. Flannery DJ, Williams LL, Vazsonyi AT. Who are they with and what are they doing? Delinquent behavior, substance use, and early adolescents’ after-school time. Am J Orthopsychiatry. 1999;69(2):247–53. pmid:10234390
  29. 29. Spearman C. The Proof and Measurement of Association between Two Things. Am J Psychol. 1904;15(1):72.
  30. 30. Zapolski TCB, Smith GT. Comparison of parent versus child-report of child impulsivity traits and prediction of outcome variables. J Psychopathol Behav Assess. 2013;35(3):301–13.
  31. 31. Ready RE, Clark LA, Watson D, Westerhouse K. Self- and peer-reported personality: agreement, trait ratability, and the “self-based heuristic”. J Res Person. 2000;34(2):208–24.