Figures
Abstract
Introduction
In the current international context, entrepreneurship education claims a privileged place within educational systems, given that it contributes decisively to innovation and to the set of competences demanded in the new knowledge-based economy. The state of the research in this line highlights the existing formative deficiencies at these basic education levels, despite the fact that numerous initiatives of fostering business culture have already been developed. Among the currently existing gaps, conspicuous by its absence is the lack of instruments capable of efficiently measure the basic business knowledge, needed to progressively constitute a consistent business identity stands out. In this sense, we set ourselves the construction and validation of a basic business knowledge scale for the Secondary Education stage.
Methods
This study was implemented in two phases. In the first phase, the dimensions and components of the Basic Business Knowledge Scale were identified via a systematic review of the literature following the PRISMA-P protocol and a qualitative study. In the second phase, the scale was developed and validated. On the one hand, a content validation was conducted through interviews of experts and students, studying the content validity (the Content Validity Ratio and the Content Validity Index) and the face validity (Think-aloud protocols). On the other hand, the construct validity was analyzed through an Explanatory Factor Analysis (EFA) and a Confirmatory Factor Analysis (CFA). Then, the reliability was calculated with the Cronbach Alpha and the test stability with a test-retest. The convergent validity has been validated by the average variance extracted (AVE) and the discriminant validity between constructs was established through the AVE estimated for each construct with the squared interconstruct correlations associated with that factor. The sample was made up of 1440 students (679 girls and 761 boys) from age 11 to 17 (M = 14.6, SD = 1.597).
Results
The EFA and the CFA showed evidence of a first-order three-factor structure (Knowledge in Business Management (KBM), Legal Knowledge (LK) and Strategic Knowledge (SK)), and a second-order factor, Basic Business Knowledge. In the construct validity two items were eliminated due to their factor loadings being lower than .40. The results of the fit indices contributed acceptable values regarding the proposed model. The three subscales and the scale as a whole revealed a satisfactory internal consistency with Cronbach alphas over .75. The intraclass correlation coefficient (ICC) was above .90, showing an appropriate stability. The convergent validity offers values over .80 in the composite reliability (CR) and the average variance extracted (AVE) is greater than .50. Moreover, in the divergent validity, the values of the square root of the AVE are greater than the correlations with the other constructs. Finally, the Basic Business Knowledge Scale has 18 items.
Conclusions
We find evidence concerning the validity and reliability of the Basic Business Knowledge Scale, tested with Spanish Secondary Education students within the compulsory stage of teaching. We believe that this Scale can contribute to a better understanding of the formation of indispensable basic culture to establish a genuine business spirit.
Citation: Bernal-Guerrero A, Cárdenas-Gutiérrez AR, Montoro-Fernández E (2020) Basic business knowledge scale for secondary education students. Development and validation with Spanish teenagers. PLoS ONE 15(7): e0235681. https://doi.org/10.1371/journal.pone.0235681
Editor: Frantisek Sudzina, Aalborg University, DENMARK
Received: March 28, 2020; Accepted: June 19, 2020; Published: July 7, 2020
Copyright: © 2020 Bernal-Guerrero et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the paper and its Supporting Information files.
Funding: We confirm that the investigation has been funded by the Ministry of Economy and Competitiveness of the Government of Spain, State Plan 2013-2016 Excellence - R & D Projects, under Grant number EDU-2013-42936-P. The funders had no role in study design, data collection and analysis, decision to publish or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
The formation of entrepreneurial competence is becoming a requirement within the current conditions of development, characterized by an emphasis on innovation, a high level of interactive skills and the priority of knowledge [1]. Universities have the responsibility of playing a key role in the formation of qualified specialists with high creative and intellectual potentials and capable of implementing viable business projects, therefore becoming drivers of a sustainable economic growth. That way, the great existing interest in the current universities concerning the business culture development practices and the entrepreneurial literacy of their students is thus understood [2] [3]. Yet, prior to that and essential for the configuration of a business identity, it is necessary the establishment within compulsory education, with permanent vocation, of a knowledge system in the field of entrepreneurship [4].
It is necessary to progressively and effectively cultivate business education from primary school, especially within the framework of a postmodern society where people have to assume the role of their lives like never before [5], as they do not encounter closed living programs as took place in traditional societies. In this sense, non-cognitive factors [6] [7], such as motivation and leadership, creativity and innovation, proactivity and autonomy, become essential for the formation of business identity and economic grouth of society, togheter with properly entrepreneurial knowledge and behavior [8]. Although there are differences concerning the pedagogical focuses applied and about what indicators more clearly reflect success in formation, there appears to be a consensus regarding the need to boost a unique framework of entrepreneurship education [9] as a new and fruitful way for the promotion of economic development.
Indeed, business education can be strategically promoted and strengthened in multiple ways [10]. Amongst others recently formulated, with practices of coproduction, involving from an early age business environments in the formal educational process [11], or raising a direct contact with the business environment through the methodology of projects [12]. This also occurs through the use of certain advanced technological tools [13] [14], directly cultivating self-efficacy as a predictor of business behavior [15], using autonomous learning in a business context, trying to drive employability [16], underlining the relevance of finding business opportunities [17] [18] [19] and linking them with sustainable development, permeating them with moral strength, beyond the appropriation of tangible business results [20] [21]. Likewise, this takes place indirectly cultivating a person’s entrepreneurial qualities, without associating them in the first instance with the creation of enterprises and businesses [22], as well as relating certain entrepreneurial skills with the design and development of life projects [23].
Although a model of business competence established for a specific educational system is difficult to adjust to the needs and objectives of other educational systems [24], we consider that there is a certain potential of transfer between the diverse models compared. Entrepreneurial competence requires specific attitudes, skills and knowledge, although a diversity of possible developments can be admitted according to the diverse business and economic contexts which we refer to. In a recent study [25], combining the established theory of planned behavior [26] and the model of “iceberg competences” [27], five established areas determine the appearance of entrepreneurial intention: motives, features, self-concept, skills and knowledge. The need for knowledge is also claimed, as a “framework of qualifications” and implicitly so in other domains which are configurators of competence [28].
In spite of having minimized the value of cultural contents from functionalist approaches, in many predominant cases learning without disciplinary knowledge is fading. Not all knowledge is dispensable or substitutable by any other, given that it is not a question of solely developing certain aptitudes or mental capacities, attitudes or skills, geared to the generation of innovation and initiative [29], but rather confirming a solid cultural formation around the subject upon which to build a specific business identity [30]. Ken Robinson [31], one of the most influential current authors about the essential educational value of creativity, proposes, to overcome the outdated educational system inherited from the Industrial Revolution, a personalized approach of education with the aim of harnessing the potential of available technological and professional resources and of fostering the participation of students for them to lose fear of making mistakes and develop their passion for learning and for establishing their creativity. Nevertheless, he considers that none of this is possible without a balanced vindicating of the value of disciplinary knowledge.
Indeed, the lack of formation in contents linked with business management, with legal aspects associated to business organizations and with the formalization of businesses, as well as with certain basic and strategic aspects for the creation of enterprises and their consolidation, can hamper the entrepreneurial initiatives taken outside the educational system. And this set of knowledge is indispensable, even though we use alternative strategies to achieve it [32].
Some recent studies reveal that secondary schools students are insufficiently able from a practical point of view to survive in the real economic world and to undertake their own business activities [33]. For example, the limited attention paid to financial education in formal education weakens the entrepreneurial capacity of adult people. This eventuality has been extensively analyzed in the literature, showing the incidence of financial education in entrepreneurship, which is remarked in a broad bibliometric study that spans the last three decades about the global trends of research concerning the effect of financial formation on the creativity of individual entrepreneurship [34].
The current situation calls for the substantive and functional incorporation in entrepreneurship education, within primary and secondary schools, of fundamental specific contents for the configuration of an entrepreneurial identity linked to ethical principles for a sustainable economic development of society [35] [36], as an effective way of forming future entrepreneurs. The assertion of specific knowledge linked with entrepreneurship does not necessarily mean the choice of a traditional didactic methodology, since pedagogical innovation is not incompatible with the formative contents finally selected [37] [38].
We are witnessing a considerable amount of proposals of entrepreneurship education, of a diverse kind and scope, trying to drive business culture. The majority of countries have specific programs, projects and pedagogical experiences related with entrepreneurship, most of which have been developed in the higher levels of education and for adults in a diversity of extracurricular ways. Progressively, this attention has also been aimed, with profusion and intensity, not only at the university increasing level but also at the primary and secondary stages of education. For the most part, the integration of entrepreneurial competence in schools has been conducted through the creation and the functioning of microenterprises, or through the development of subjects specifically created to do so. It still remains a long way to go in the formation of entrepreneurship in schools, therefore being necessary the deepening, together with certain attitudes and skills contained in the proactive management of projects and their consequences, on the knowledge of the functioning of the economy and recognizing the opportunities and challenges that entrepreneurs must face in the real world [39].
However, the set of initiatives, actions and programs for the promotion of business culture in schools suffers from a lack of rigorous evaluations of its real achievements and their quality [40]. Although there have been some relevant contributions, we are missing, in general, precise and sufficient diagnoses about its effectiveness. Particularly, there is a notable gap in the diagnosis of the precise knowledge for the configuration of a business profile, or rather proto-business in the compulsory teaching levels, this being a scarcely applied way of assuring the future success of business initiatives.
We believe the design of an assessment instrument about business knowledge to be a suitable response to this situation. This instrument would facilitate the research and understanding of business knowledge related with the shaping of a business identity. The development of a scale which measures business knowledge in adolescence is necessary to orientate, get to know and assure appropriate educational actions related with entrepreneurship education at this age. The aim of this study is specifically to formulate a valid and reliable basic business knowledge scale for the stage of Compulsory Secondary Education (Middle School and High School).
Materials and methods
Study design
Following the Standards for Educational and Psychological Tests [41], this research has been carried out in two phases [42] [43] [44]: 1) the identification of the dimensions and components of business knowledge in the stage of Compulsory Secondary Education; 2) the development and validation of the scale of business knowledge in adolescence (Fig 1).
Phase 1: Conceptual base, identification of the dimensions and components.
1) Literature review. The aim was to define the dimensions and components of introductory and fundamental business knowledge. To do so, a systematic bibliographic review was done along with a selection of studies following the PRISMA-P protocol [45] [46]. The PRISMA-P protocol comes from medical research and has recently begun to be applied in literature reviews in the field of education, to obtain greater rigor and methodological consistency [47]. However, its use in educational bibiometric research implies that not all of its parts are applicable, since clinical trials are not reviewed. Furthermore, in the case of this study, where the systematic review that has been carried out is not the purpose of the research, but a phase of it, since the ultimate purpose is the construction and validation of a questionnaire. Thus, four items corresponding to the Methods and Results sections of the PRISMA-P protocol are applied, because the remaining items are not applicable to this research (S1 File). The search, identification and selection were carried out in two phases. In the first phase, an expert author in literature reviews searched in the databases of Web of Science, ERIC and Scopus with the following equation: (“Entrepreneur* education programs” OR “business education programs”). The criteria of the bibliographic search were articles in scientific journals with publication dates from January 1st. 2000 to 31st. December 2017, being identified 204 potential articles. In the second phase, three independent researchers assessed the potential articles which had some of the following terms in the title and in the abstract: a) business knowledge; b) entrepreneurship education and entrepreneurial education or business education; c) compulsory secondary education; and d) Middle School and High School. We established two inclusion criteria which in the end guided the bibliographic selection carried out in the first phase: a) Type of articles: research works related with theoretical, descriptive, evaluative, qualitative and mixed studies were included; and b) type of population: research works centered on students in the formal education stages were taken into account. As a criterion for exclusion we adopted the one of studies related with research works in non-formal education. 6 duplicated studies were eliminated and 174 articles were excluded. Thus, 24 articles were selected for the thematic and inductive analysis of the content via a codification system [48] (Fig 2). The Kappa index of Fleiss was calculated to achieve a concordance between the researchers [49] obtaining a score of K = .82, considered as a very good value [50] [51].
Adapted from Moher et al. [46].
2) Qualitative study. Via a qualitative study, 10 in depth interviews were done with experts in entrepreneurship education in the stages of compulsory education to find out their perceptions, knowledge and teaching experiences related with business knowledge taught in the programs of entrepreneurship education or business education (S2 and S3 Files). The selection criteria were to have developed these programs during a minimum of two academic years in Compulsory Secondary Education centers and to have been their coordinators. Also, 16 exhaustive interviews were conducted with secondary education students (S2 and S3 Files). The selection criterion was to have taken part in those programs during at least one school year. The aim of interviewing the students was to get to know what typology and which main characteristics the knowledge contained in the programs had. All the interviews were recorded, transcribed and codified via a system of categories to find out the components of the business knowledge and were done from 1st. February to 29th. March 2018. Each of them lasted from 30 to 45 minutes. An analysis of the content of the interviews was made using the NVivo 11 Plus for Windows software. The scripts were scrutinized by fifteen experts who analyzed their validity and the pertinence of the items. The experts, selected for their recognized academic and professional interests in the area of entrepreneurship education, came from diverse sectors: the university area (7), educational centers (5) and organizations or foundations of the civil society (3). To avoid the disaggregating effect of individual valuations [52] [53], a search was established for the maximum level of consensus between the experts themselves. To do so, it was agreed that a level of consensus above 80% had to be achieved and that there had to be an acceptable degree of homogeneity in the answers (coefficient of variation less than 80%) in the two rounds of participation. Later, the research team discussed and reflected about the content of the interviews, finishing the analysis when the saturation of the information was attained and new topics did not arise.
In this first phase an initial set of 54 items for 3 dimensions was generated, emanating from both the systematic review of the selected documents and the qualitative study carried out: Knowledge in Business Management (KBM), Legal Knowledge (LK) and Strategic Knowledge (SK).
Phase 2: Development and validation of the scale.
1) Item generation. The 54 items generated in Phase 1 were carefully reviewed by the research team, and a total of 11 items were considered superfluous and therefore eliminated; 43 being kept. As to the type of answer, there is not a consensus concerning the categories of the Likert scale which must be used [54]. In our case, the scale has been designed for adolescents, taking into account the age of the studied group and, to avoid confusion while filling out the questionnaire, it was decided to adopt a three-value Likert scale: 2,“It has been worked on at class and I think I’ve learnt it” (Worked and learned, WL); 1, “I think it has been worked on at class, but I haven’t learnt it” (Worked but not learned, WNL); 0, “I think it hasn’t been worked on at class and I haven’t learnt it” (Not worked, NW).
2) Content validity. In a first stage, for the content validity, a panel of experts made up of twelve specialists in entrepreneurship education, business management, firm projects, marketing, corporate social responsibility and economics carried out a first review about formal questions, the drafting and the scaling of the test. In a second stage, the Content Validity Ratio (CVR) and the Content Validity Index (CVI) were calculated, asking the experts about the need (CVR), relevance, clarity and simplicity (CVI) of each of the items. Another twelve experts calculated the CVR, evaluating each item with a Likert scale with the following values: 1 = essential; 2 = useful, but not essential; 3 = not essential. Based on the Lawshe scores, the items with a score equal to or greater than .56 were kept in the scale [55] [56]; being eliminated 17 items in this process. The CVI [57] [58] of each item was calculated on a 4-point Likert scale (1 = not relevant; 2 = somewhat relevant; 3 = quite relevant; 4 = highly relevant [59], and all the items which had a value equal to or higher than .80 were kept. In the CVI, 6 items were eliminated for not fulfilling this criterion. Thus, 20 items remained to carry out the factor analysis. The total scores of the CVR and the CVI were .88 and .93, respectively, revealing a good degree of content validity [59].
3) Face validity. Cognitive interviews were used to establish the face validity of the scale [60] [61] [62]; specifically, the Think-aloud protocols [63] [64] [65] [66] [67]. 14 participants were selected by a convenience sampling, of similar characteristics to the study aim group, aged between 11 and 16 years old from the Compulsory Secondary Education (ESO) stage and with the following distribution of participants per course: 1° ESO (4 students), 2° ESO (4 students), 3° ESO (3 students) and 4° ESO (3 students). With the aim of finding out the ambiguity, understandability, difficulty and interpretation of the items, each student was given a scale and was interviewed to evaluate what they thought when they read and answered each item. Later, the questionnaire was revised with the arguments of the interviewed students.
4) Construct validity. To obtain the construct validity, an exploratory factor analysis (EFA) was done at first to know the scale’s composition and structure, and secondly a confirmatory factor analysis (CFA) was carried out to verify if the data fit the model extracted from the EFA [68].
5) Reliability. The evaluation of the reliability was done via the internal consistency and the time stability of the scale with the test-retest procedure. The internal consistency was calculated by the Cronbach alpha coefficient for each dimension and the total scale, along with the composite reliability (CR). The time stability of the scale, via the test-retest procedure, was performed managing the scale twice with a time interval of two weeks to a subgroup of 50 students. The test-retest reliability was evaluated via the intraclass correlation coefficient (ICC).
6) External validity. The convergent validity was studied with the average variance extracted (AVE) and the composite reliability. The discriminant validity was analyzed with the AVE estimated for each construct with the squared interconstruct correlations associated with that factor.
Recruiting and sample
The sample was obtained via a multi-stage sampling procedure stratified by conglomerates. The sample was based on three criteria, considering as the sample unit the centers where the entrepreneurship education programs were implemented and had had a minimum duration of two academic years.
The education strategies for entrepreneurship applied in the autonomous communities of Spain constitute the first criterion. According to the Oslo Agenda on Education for Entrepreneurship in Europe [69], are three strategies: specific (this covers relevant and necessary aspects for the implementation of entrepreneurship from a predominantly formative perspective, reflecting political priorities); general (this aims to guarantee the coordination between the educational and the business actions, underlining the importance of education as a driver of innovation and entrepreneurship); and isolated initiatives (this seeks to foster certain key elements of the formation of entrepreneurial spirit). Using this criterion, two autonomous communities were selected for each strategy: Andalusia and Galicia, with a specific strategy; Asturias and the Murcia Region, with a general strategy; and Madrid and Catalonia, with isolated initiatives [70].
The second criterion consisted in limiting the study to the education centers supported by public funds given by YEE programs (Young European Enterprise) in ESO, an educational stage which comprises four academic years with an age range between 11 and 16 years old (in the case of the student being a repeater, this can be up to 18 years old). To do so, information was compiled from the databases of the UECOE (Spanish Union of Teaching Cooperatives) and VALNALÓN (a public firm under the authority of the Ministry of Employment, Industry and Tourism of the Government of Asturias), being the databases with more information concerning school centers which implement entrepreneurial education in Spain. 16 educational centers were selected from the six autonomous communities mentioned (Fig 3).
Reprinted from http://mapchart.net under a CC BY license, with permission from Mina Giannekas owner and developer, original copyright 2020.
Thirdly, it was established as an inclusion criterion in the research that the educational centers selected had to have a minimum of two academic years in applying the YEE program before our study was done. Under this inclusion criterion, 11 educational centers were selected from the six autonomous communities. No center rejected taking part in the study, the 11 centers chosen making up the total set of school centers which implemented the YEE program. The recruitment of the sample was done from 5th. Abril to 27th. June 2018. The initial sample was composed of the 1473 participants who were at their classes the day of the data collection. However, 33 students were eliminated because they did not fill out the items of the Basic Business Knowledge Scale (BBKS), setting the final sample in 1440 students. The study aim population is 1.964.787 students, corresponding to the total number of students enrolled in ESO in the 2017/2018 academic year in Spain (Ministry of Education, Culture and Sport, split into two in June 2018: Ministry of Education and Vocational training, and Ministry of Culture and Sport). This sample (n = 1440) is statistically representative of the population, assuming an error of 3.4% and a confidence level of 99%. The socio-demographic characteristics of the sample are described in Table 1. The final sample of the study was made up of 679 girls (47.2%) and 761 boys (52.8%), with an age range of 10-17 years old (M = 14.6, SD = 1.597).
Procedure
The study was done by means of the following procedure: 1) the eligible educational centers were informed about the study and, later, the directors and people in charge of the YEE of the participating centers signed their consent; 2) the management of the educational centers informed the parents or legal tutors about the study and they gave their written consent for the participation of the students under 16 years old; 3) the researchers went to the centers to explain the instructions to fulfill the questionnaire and to help the participants when necessary in the presence of the corresponding tutor; 4) the students were informed of the aim of the study, of their voluntary participation respecting their anonymity and of the confidential treatment of the information provided, thus obtained their written informed consent before completing the test; 5) the students completed the questionnaire online [71] through the Moodle educational platform, within the computer rooms of their respective centers, during a 50-minute session. For this, each participant was given an access code previously coded by the research team. The following is an example of the access code and its corresponding encryption: 1-ALUM-1-ESO-1. Code N° 1 refers to the autonomous community; the ALUM and N° code refers to the number of students surveyed by each autonomous community and the ESO and N° code identifies the educational stage and course of the student.
Ethical declaration
The Spanish Committee responsible for Ministry of Economy and Competitiveness (MINECO, Government of Spain) reviewed the application, including ethical aspects, and approved the investigation under Grant EDU2013-42936-P. This research was implemented strictly following the current regulations in Spain and Europe in relation with the protection, treatment and free circulation of personal data and regarding the access to scientific information and its preservation [72] [73] [74]. This research was part of student´s standard curricular activities within school hours. The parents or legal tutors gave their written consent for the participation of the students under 16 years old.
Data analysis
A metric analysis of the 20 items was performed with measures of central tendency (Means), dispersion (Standard Deviation), distribution (Skewness and Kurtosis) and corrected total-item correlations between the item and the dimension to which it belongs. In order to prove the factor validity, the sample was divided into two random subsamples (N1 + N2 = 1440). An exploratory factor analysis (EFA) [75] was applied to the first half of the sample (N1 = 720). The EFA was performed with the Parallel Analysis method (PA), via OLS (Ordinary Least Squares) estimation methods through the ULS (Unweighted Least Squares) technique with direct oblimin rotation (appropriate when correlation between the dimensions to be analyzed is assumed) [76]. The suitability of the sample was studied via the Kaiser-Meyer-Olkin (KMO) and Bartlett’s Sphericity Test [77] [78]. Eigenvalues over 1 and the percentage of variance explained were used to determine the number of factors [79]. Factor loadings above .40 were taken into account as adequate to maintain or eliminate the items. Later, a confirmatory factor analysis (CFA) was done to the second half of the sample (N2 = 720) to validate the structure of the scale obtained from the EFA [68], using the parallel analysis method with the ULS technique and direct oblimin rotation. Following the recommendations of Hair, Black, Babin and Anderson [80] and that of Hoyle [81], and due to the value of χ2 being very sensitive to small variations of the hypothesized model when one is working with large samples [82], we used a combined strategy of different goodness-of-fit indices: a) good fit values if the Goodness of Fit Index GFI, Comparative Fit Index CFI ≥ .96, the Tucker-Lewis Index TLI ≥ .95, the Root Mean Squared Error of Approximation RMSEA ≤ .05; b) moderate fit values if the CFI, GFI and TLI ≥ .90, RMSEA ≤ .08; c) poor values if the CFI, GFI and TLI ≥ .90, RMSEA ≤ .10.); and d) the Standardized Root Mean Square Residual SRMSR with values of .08 or lower indicate a good fit [80] [82].
The reliability analysis was done for each dimension via the Cronbach alpha, the Composite Reliability (CR) with values over .7 as an indicator of good internal consistency [83] and the intraclass correlation coefficient where values over .75 were considered acceptable [84] [85]. The evidence of the external validity was based on the convergent and discriminant validity. The convergent validity has been validated via the average variance extracted (AVE). As a criterion of acceptance, the AVE has to be .50 or greater [86] and the CR equal to .7. The discriminant validity between constructs was established via the square root of the AVE, which must be greater than the correlation between the constructs [86]. The statistical analyses were done with the statistic packets: FACTOR 10.4 [87]; EQS 6.2 [88]; Smart PLS 2.0 M3 [89] and SPSS 23.0 [90].
Results
1) BBKS metric item analysis
At first, the averages range from 1.98 to 2.75. Standard Deviation is above 1 considered good [91]. Skewness has been between -1.28 and 1.12, and Kurtosis scores between -1.44 and 0.23. Considering for both statistics that the values within the range between -1.5 and +1.5 are adequate [92] [93] [94]. Secondly, the corrected total item correlations between the item and the dimension to which it is assumed to belong are above .45, being considered adequate values [95] (Table 2).
2) Construct validity
Exploratory factor analysis (EFA).
An EFA was performed with the first half of the sample (N1 = 720), where the Kaiser-Meyer-Olkin (KMO = 0.93) and the Bartlett´s Test of Sphericity (χ2 = 8608,1; p < 0.001) showed their suitability for the factor analysis. The scale of basic business knowledge is made up of three factors with 20 items. Two items with loadings below .40 were eliminated (KBM 17 and KBM 19). The exploratory solution derived from the EFA is, as we have described before, composed of three factors:
- Knowledge in Business Management (KBM): they are those relating to the development of productivity, competitiveness and viability of the company in the most efficient and effective possible way.
- Legal Knowledge (LK): they are those relating to the legal and administrative aspects associated with the constitution of a company.
- Strategic Knowledge (SK): these refer to the business context to establish a competitive advantage or difference in the products and/or services offered by the company in relation to its competitors.
The EFA was constructed with a total of 18 items in three dimensions (Table 3).
The goodness-of-fit indicators indicated the suitability of the results: GFI = .99, CFI = .98, TLI = .97, RMSEA = .05 and SRMSR = .03. The percentage of total variance explained was 60.3%. The first factor, KBM, obtained 36.9% and is comprised of 7 items. The second factor, LK, explains 15.1% and includes 5 items. The third factor, SK, explains 8.3% and is made up of 6 items. The factor loadings ranged from .869 to .416 and the eigenvalues of greater than 1. The results of the EFA with the factor loadings, eigenvalues and explained variance are shown in Table 4.
Confirmatory factor analysis (CFA).
The CFA was done with the second half of the sample (N2 = 720). It was applied via a second-order factor analysis where the items were analyzed and it was determined if the three dimensions configured the Basic Business Knowledge Scale (BBKS). All the factor loadings were statistically significant (p < 0.001). The fit indices GFI = .99, CFI = .99, TLI = .99, RMSEA = .03 and SRMSR = .02 showed the good fit of the proposed model [96] (Fig 4).
n = 720; All factor loadings are standardized and are statistically significant, p < 0.001.
3) Reliability
The Cronbach alpha coefficient for each of the domains varied between .76 and .83. The AVE scores were above .50 and the composite reliability has been greater than the criterion of .70. The intraclass correlation coefficient was .92. The results obtained in all the dimensions, which exceed the minimum recommended values [97] [80], indicate that the scale has a satisfactory stability (Table 5).
4) External validity
As to the convergent validity, all the factors present values above .7 in the CR and the AVE is greater than .50. This indicates the appropriateness of the items in the measuring of the dimensions [98] (Table 5). As to the discriminant validity, the values of the square root of the AVE are greater than the correlations with the other constructs. The independence of the latent variables is thus confirmed [99] (Table 6).
Discussion
To educate in and for entrepreneurship has different dimensions (economic, cultural, social, ethical, political, etc.) which makes this field a complex and difficult area to outline [100]. This complexity partially explains the difficulty of attaining a consensus concerning a specific educational model. Hence, different proposals with indictors and evaluative mechanisms arise [101]. Along with a strictly cognitive dimension, business competence possibly requires the inclusion of meta-cognitive, affective and motivational aspects [102] [103]. This is similar to the research activities developed in the theoretical analysis of the “learn to learn” construct [104] [105], a requisite of another of the key competences pointed out by the European Union since 2007. Another dimension, linked to the social and relational area, could even be aggregated [106] [107].
While research pursues its advances seeking the best formative and evaluative model of business competence possible [108] [21], as a complex construct, the partial contributions in this direction are shown relevant for the theory and the practice of entrepreneurship education, even promoting the future construction of more holistic and complex instruments.
This research has developed the study of the validity and reliability of a scale to measure the basic business knowledge of students in the stage of Compulsory Secondary Education. The curricular integration of entrepreneurship education in the compulsory stages is not being as effective as would be desirable for the development of business spirit. In the GEM 2018-2019 Report [109], in relation with the conditions for entrepreneurship at a global level, the experts value business education and formation in the compulsory education stage as being very low. Regarding this, the evaluation of business competence in the Compulsory Secondary Education stage is an area that has hardly been developed and which lacks valid and reliable instruments [70]. Although instruments which measure the intention, attitude or entrepreneurial personality risks in adolescents have been recently designed [110] [111] [112] [113] [114], there are not assessment instruments that measure the business knowledge which students should acquire in this educational stage.
There were 20 items left to study the construct validity after the initial phases of the identification of the dimensions, the generation of items, and content and face validity. In the exploratory factor analysis (EFA), 18 items were extracted with satisfactory factor loadings and 2 were not kept because they had low factor loadings: KBM 17 “The technical characteristics of a firm’s products/services” and KBM 19 “What is a logotype, how is it made and what is it for?”. The exploratory factor solution obtained from the 18 items was the extraction of three factors: Knowledge in Business Management (KBM), Legal Knowledge (LK) and Strategic Knowledge (SK). The factor loadings of the items related with each of the factors were satisfactory and the fit indices were suitable.
Later, a confirmatory factor analysis was done where a single factor called “Basic Business Knowledge” was extracted, obtaining a more parsimonious factor solution. The cut-off points of the different fit indices –the CFI, GFI, TLI, RMSEA and SRMSR- showed acceptable values, confirming a unifactorial structure of business knowledge for adolescents configured by three dimensions identified in the EFA: KBM with 7 items, LK with 5 items and SK with 6 items. The reliability of the three factors and of the whole scale has been above .75, being pertinent for its use in research [115]. The indicators of composite reliability of each factor also revealed very appropriate values, while average variance explained was over .55, higher than the .50 recommended by Hair [116]. Besides, the external validity fulfilled the established criteria. Hence, the results confirm a model with a structure made up of three first-order factors (KBM, LK and SK) and a second-order factor called Basic Business Knowledge (BBK).
Research evinces a more complex configuration about the composition of business knowledge, especially in the post-compulsory stages. However, this study delimits the number of dimensions of business knowledge in the stage of Compulsory Secondary Education into three areas: management, jurisprudence and business strategy. Although it could seem to be an infra-representation of business knowledge, it is rather an adaptation to the business contents corresponding to this educational stage, in accordance with the “Progression Model” of business education in the European Union [117]. This explains the absence of other necessary dimensions of business knowledge more suited to higher education contents in the structure of our Scale, but perhaps inappropriate for the conformation of a basic structure, primarily constituting the indispensable cultural foundations of entrepreneurship [118]. Compulsory Secondary Education is a key stage for acquiring business knowledge as it means the link between the initial business education of primary education and the more specific education of post-compulsory studies. An appropriate evaluation concerning the students’ knowledge will beneficially redound in the acquiring of the entrepreneurial culture needed for the formation of a business identity. Due to all this, the development of instruments which facilitate the metric of the basic knowledge of entrepreneurship is required, improving its diagnosis and permanent valuation.
In this respect, the results suggest that the Basic Business Knowledge Scale is a valid and reliable instrument that has enabled the identification of the dimensions of business knowledge in adolescents in the Compulsory Secondary Education stage (S5 File). This instrument contributes to the reduction of the evaluative gap which hinders a better understanding of the configuration of the business identity in ages with a high level of cultural permeability. In this sense, the Scale could be used along with other instruments linked to the business domain to understand how business identity is formed or to diagnose and detect the students’ formative needs.
Although the study has contributed verified evidence about its validity and reliability, this research has certain limitations: a) the sex variable has not been taken into account when carrying out the study; b) social and demographic variables which may influence the formation of business knowledge have not been studied; c) the study has been centered on a specific age range, type of school and business education program. It would thus be advisable for future research to be carried out with students of a different age group and sex, in different schools and business education programs, as well as in other social and economic contexts. Furthermore, our Scale could be expanded in future researches by including elements of the economic logic of human action.
Conclusion
The findings of this research offer evidence concerning the validity and reliability of the Basic Business Knowledge Scale in students of the Compulsory Secondary Education stage. This Scale, as well as being useful for metric contributions in this area, is an appropriate tool for the diagnosis and the evaluation of basic business knowledge in entrepreneurship programs, particularly of business education in the secondary education stage.
Supporting information
S4 File. Basic Business Knowledge Scale for Secondary Education Students (BBKS)- Spanish version.
https://doi.org/10.1371/journal.pone.0235681.s004
(DOC)
S5 File. Basic Business Knowledge Scale for Secondary Education Students (BBKS)- English version.
https://doi.org/10.1371/journal.pone.0235681.s005
(DOCX)
References
- 1. Gotz M. The industry 4.0 induced agility and new skills in clusters. Foresight and STI Governance. 2019; 13(2): 72–83.
- 2. Nabi G, Fayolle A, Liñán F, Krueger N, Welsmley A. The impact of entrepreneurship education in higher education: A systematic review and research agenda. AMLE. 2017; 16(2): 1–23.
- 3. Pluzhnik IL, Ilnitskaya TO, Lucci F. Are entrepreneurs born or made? Effective academic models to foster entrepreneurial graduates. Obrazovanie i Nauka-Education and Science. 2018; 20(5): 56–78.
- 4.
Bernal A, Liñán F. The personal dimension of an entrepreneurial competence: an approach from the Spanish basic education context. In: Fayolle A, editor. A Research Agenda for Entrepreneurship Education. Cheltenham, UK, Northampton, USA: Edward Elgar Publishing; 2018. pp. 262–280.
- 5. Kyrö P. Entrepreneurship in the postmodern society. Wirtschafts Politiche Blätter. 2000; 47: 37–45.
- 6. Heckman JJ. Policies to foster human. Res. Econ. 2000; 54(1): 3–56.
- 7. Heckman JJ. Schools, skills, and synapses. Econ. Inq. 2008; 46(3): 289–324. pmid:20119503
- 8. Al Mamun A, Fazal SA. Effect of entrepreneurial orientation on competences and micro-enterprise performance. APJIE. 2018; 12(3): 379–398.
- 9. Mwasalwiba ES. Entrepreneurship education: A review of its objectives, teaching methods, and impact indicators. Educ + Train. 2010; 52(1): 20–47.
- 10. Fiet JO. The pedagogical side of entrepreneurship theory. J Bus Ventur. 2001; 16(2): 101–117.
- 11. Floris M, Pillitu D. Improving entrepreneurship education in primary schools: a piooner project. Int J Educ Manag. 2019; 33(6): 1148–1169.
- 12. Hebles M, Llanos-Contreras D, Yaniz C. Perceived evolution of the entrepreneurial competence based on the implementation of a training program in entrepreneurship and innovation. REOP. 2019; 30(1): 9–26.
- 13. Beltrán MJ, Romero-Rodríguez LM, Ramírez MS. Entrepreneurship competencies in energy sustainability MOOCs. J. Entrep. Innov. Emerg. Econ. 2019; 11(4): 598–616.
- 14. Wu YJ, Yuan CH, Pan CI. Entrepreneurship education: An experimental study with information and communication technology. Sustain. 2018; 10(3): 1–13.
- 15. Neto RDA, Rodrigues VP, Stewart D, Xiao AW, Snyder J. The influence of self-efficacy on entrepreneurial behavior among K-12 teachers. J. Teach. Educ. 2018; 72: 44–53.
- 16. Kapasi I, Grekova G. What do students think of self-determined learning in entrepreneurship education? Educ + Train. 2018; 60(7-8): 841–856.
- 17. Baron R, Ensley MD. Opportunity recognition as the detection of meaningful patterns: Evidence from comparisons of novice and experienced entrepreneurs. MS. 2006; 52(9): 1331–1344.
- 18. Davidsson P. Entrepreneurial opportunities and the entrepreneurship nexus: A re-conceptualization. J Bus Ventur. 2015; 30(5): 674–695.
- 19. Dimov D. Beyond the single-person, single-insight attribution in understanding entrepreneurial opportunities. Entrep. Theory Pract. 2007; 31(5): 713–731.
- 20. Gallego AM, Torres V, Becerra E, Córdoba K, Pérez PA. Entrepreneurship as a culture: A strategy to strengthen citizenship skills and teamwork in early childhood? Infancias Imágenes. 2018; 17(2): 176–184.
- 21. Ploum L, Blok V, Lans T, Omta O. Exploring the relation between individual moral antecedents and entrepreneurial opportunity recognition for sustainable development. J. Clean. Prod. 2018; 172: 1582–1591.
- 22. Paños J. Educación emprendedora y metodologías activas para su fomento. REIFOP. 2017; 20(3): 33–48.
- 23. Chang J, Rieple A. Assessing student’s entrepreneurial skills development in live projects. J. Small Bus. Enterp. Dev. 2013; 20(1): 225–241.
- 24. Lillevali U, Taks M. Competence models as a tool for conceptualizing the systematic process of entrepreneurship competence development. Educ. Res. Int. 2017; 2017: 1–16.
- 25. Menke C. Unravelling entrepreneurial competencies and their relation to entrepreneurial intent. IJEV. 2018; 10(6): 663–687.
- 26. Ajzen I. The theory of planned behavior. Org Behav Human Dec Proc. 1991; 50(2): 179–211.
- 27.
Spencer LM, Spencer SM. Competence at Work. New York: John Wiley and Sons; 1993.
- 28. Samad NA, Ahmad WMW, Sern L, Harun H, Awang H, Noor SNFM. Exploring domains and elements for behavioral competency and employability skills. JTET. 2018; 10(1): 82–90.
- 29. Titko J, Bierne J. Competence development of young entrepreneurs through educational innovations. J. Mark. Manage. 2019; 3: 255–264.
- 30. Liñán F, Ceresia F, Bernal A. Who intends to enroll in entrepreneurship education? Entrepreneurial self-identity as a precursor. Entrepreneurship Education and Pedagogy. 2018; 1(3): 222–242.
- 31.
Robinson K. Creative Schools: The Grassroots Revolution That’s Transforming Education. New York: Penguin Random House; 2015.
- 32. Wang SM, Yueh HP, Wen PC. How the New Type of Entrepreneurship Education Complements the Traditional One in Developing Entrepreneurial Competencies and Intention. Front. Psychol. 2019; 10: 1–12.
- 33. Krpalek P, Krelova KK, Berkova K. Entrepreneurship in relation to contemporary concepts of education. J. Mark. Manage. 2018; 2: 11–22.
- 34. Abad-Segura E, González-Zamar MD. Effects of Financial Education and Financial Literacy on Creative Entrepreneurship: A Worldwide Research. Educ. Sci. 2019; 9(238): 1–17.
- 35.
Nussbaum MC. Creating Capabilities: The Human Development Approach. Cambridge: Harvard University Press; 2011.
- 36.
Sen AK, Kliksberg B. People first. An Overview of the Key Problems of the Globalized World Through Ethics for Development. Buenos Aires: EUDEBA; 2007.
- 37.
Lackéus M. Entrepreneurship in Education: What, Why, When, How. Paris: OECD, Centre for Entrepreneurship, SMEs, Tourism and Local Development; 2015.
- 38. Lackéus M, Lundqvist M, Middleton KW. Bridging the traditional-progressive education rift through entrepreneurship. Int. J. Entrepreneurial Behav. Res. 2016; 22(6): 777–803.
- 39.
Fayolle A, editor. A Research Agenda for Entrepreneurship Education. Cheltenham, UK, Northampton, USA: Edward Elgar Publishing; 2018.
- 40. Draycott M, Rae D, Vause K. The assessment of enterprise education in the secondary sector: A new approach? Educ + Train. 2011; 53(8/9): 673–691.
- 41.
American Educational Research Association, American Psychological Association, National Council on Measurement in Education. Standards for educational and psychological testing. Washington, DC: American Educational Research Association; 2014.
- 42.
Irwing P, editor. The Wiley handbook of psychometric testing: A multidisciplinary reference on survey, scale and test development. UK: John Wiley & Sons Ltd; 2018.
- 43.
Lane S, Raymond MR, Haladyna TM. Handbook of test development. 2nd edition. New York: Routledge; 2016.
- 44.
Leong TL, Bartram D, Cheung FM, Geisinger KF, Illiescu D, editors. The ITC International Handbook of Testing and Assessment. New York: Oxford University Press; 2016.
- 45. Moher D, Shamseer L, Clarke M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Syst Rev. 2015; 4(1): 1–9. pmid:25554246
- 46. Moher D, Liberati A, Tetzlaff J, Altman DG, The PRISMA Group. Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement. PLoS Med. 2009; 6(7): 1–6.
- 47. Chiappe A, Ternent-de-Samper A, Wills A, Restrepo-Uribe I. La educación del siglo XXI y el despertar de las bellas durmientes: una revisión sistemática de la literatura. EKS. 2020; 21: 1–6.
- 48. Braun V, Clarke V. Using thematic analysis in psychology. Qual. Res. Psychol. 2006; 3(2): 77–101.
- 49. Fleiss JL, Cohen J, Everitt BS. Large sample standard errors of kappa and weighted kappa. Psychol Bull. 1969; 72(5): 323–327.
- 50.
Altman DG. Practical statistics for medical research. New York: Chapman and Hall; 1991.
- 51. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977; 33(1): 159–74. pmid:843571
- 52. Escobar-Pérez J, Cuervo-Martínez A. Validez de contenido y juicio de expertos: Una aproximación a su utilización. Avances en Medición. 2008; 6: 27–36.
- 53.
Lannoy A. L’utilisation du judgement d’experts en sûreté de fonctionnement. Paris: Tec & Doc Lavoisier; 2001.
- 54. Matas A. Diseño del formato de escalas tipo Likert: un estado de la cuestión Likert-Type Scale Format Design: State of Art. Redie. 2018; 20(1): 38–47.
- 55. Ayre C, Scally AJ. Critical Values for Lawshe’s Content Validity Ratio: Revisiting the Original Methods of Calculation. Meas. Eval. Couns. Dev. 2014; 47(1): 79–86.
- 56. Lawshe CH. A quantitative approach to content validity. Pers. Psychol. 1975; 28: 563–575.
- 57. Polit DF, Beck CT. The content validity index: Are you sure you know what’s being reported? Critique and recommendations. RINAH. 2006; 29: 489–497.
- 58. Polit D, Beck CT, Owen SV. Is the CVI an Acceptable Indicator of Content Validity? Appraisal and Recommendations. RINAH. 2007; 30: 459–467.
- 59. Davis LL. Instrument review: Getting the most from a panel of experts. Appl Nurs Res. 1992; 5: 194–197.
- 60.
Blair J, Brick PD. Methods for the analysis of cognitive interviews. Proceedings of Section on Survey Research Methods-JSM 2010. American Statiscal Association. [cited 2019 October 18]. Available from: http://www.asasrms.org/Proceedings/y2010/Files/30786559514.pdf.
- 61. Beatty PC, Willis GB. Research synthesis: The practice of cognitive interviewing. Public Opin Q. 2007; 71(2): 287–311.
- 62.
Willis GB. Cognitive interviewing: A tool for improving questionnaire design. Thousand Oaks, CA: Sage; 2005.
- 63. Cowan J. The potential of cognitive think-aloud protocols for educational action-research. Act. Learn. High. Educ. 2019; 20(3): 219–232.
- 64. Ericsson K, Simon H. Verbal reports as data. Psychol. Rev. 1980; 87(3): 215–51.
- 65.
Ericsson K, Simon H. Protocol Analysis: Verbal Reports as Data. Cambridge, MA: The MIT Press; 1984.
- 66. Gu P. To code or not to code: Dilemmas in analysing think-aloud protocols in learning strategies research. System. 2014; 43(1): 74–81.
- 67. Charters E. The use of think-aloud methods in qualitative research an introduction to think-aloud methods. Brock Educ. J. 2003; 12(2): 68–82.
- 68.
Brown TA. Confirmatory factor analysis for applied research. 2nd edition. New York: Guilford Press; 2015.
- 69.
European Commission. Entrepreneurship education in Europe: fostering entrepreneurial mindsets through education and learning. In: Final Proceedings of the Conference on Entrepreneurship Education in Oslo. 2006. [Cited 29 October 2019]. Available from: https://ec:europa:eu/growth/content/entrepreneurship-education-europe-fostering-entrepreneurial-mindsets-through-education-anden.
- 70.
Diego I, Vega JA. La educación para el emprendimiento en el sistema educativo español. Año 2015. Estudio RediE. Madrid: MEC; 2015.
- 71.
Drasgow F, editor. Technology and testing. Nueva York: Routledge; 2016.
- 72.
Law 37/2007 of November 16, on reuse of public sector information (BOE, Official State Bulletin, number 276, of 11-17-2007).
- 73.
Commission Recommendation (EU) 2018/790 of 25 April 2018 on access to and preservation of scientific information (Official Journal of the European Union, L134/12, of 31-5-2018).
- 74.
Regulation (EU) 2016/679 of the European Parliament and of the Council of 27 April 2016 on the protection of natural persons with regard to the processing of personal data and on the free movement of such data, and repealing Directive 95/46/EC (Official Journal of the European Union, L119/1, of 4-5-2016).
- 75. Izquierdo I, Olea J, Abad FC. Exploratory factor analysis in validation studies: Uses and recommendations. Psicothema. 2014; 23(1): 395–400.
- 76. Worthington RL, Whittaker TA. Scale Development Research: Acontent Analysis and Recommendations for Best Practices. TCP. 2006; 6(34): 806–838.
- 77.
Nunnally JC, Bernstein IH, Berge JMF. Psychometric Theory. Vol 2. New York: McGraw-Hill; 1967.
- 78.
Harrington D. Confirmatory factor analysis. New York: McGraw-Hill; 1994.
- 79. Courtney MGR, Gordon M. Determining the number of factors to retain in EFA: Using the SPSS R-Menu v2.0 to make more judicious estimations. Pract. Assess. Res. Evaluation. 2013; 18(8): 1–14.
- 80.
Hair JF, Black WC, Babin BJ, Anderson RE. Multivariate data analysis. NewYork: Pearson Prentice Hall; 2014.
- 81.
Hoyle R. Structural equation modeling. Concepts, issues, and applications. London: Sage; 1995.
- 82. Hu LT, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Struct Equ Model. 1999; 6(1): 1–55.
- 83.
Nunnally JC, Bernstein IH. Psychometric Theory. 3rd edition. New York: McGraw-Hill; 1994.
- 84. Bartko JJ. The intraclass correlation coefficient as a measure of reliability. Psychol Rep. 1966; 19: 3–11. pmid:5942109
- 85. Terry KK, Mae YL. A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research. J Chiropr Med. 2016 Jun; 15(2): 155–163.
- 86. Fornell C, Larcker DF. Evaluating structural equation models with unobservable variables and measurement error. J Mark Res. 1981; 18(1): 39–50.
- 87. Lorenzo-Seva U, Ferrando PJ. Evaluating structural equation models with unobservable variables and measurement error. Behav Res Methods Instrum Comput. 2006; 38(1): 88–91.
- 88.
Bentler PM. EQS 6 Structural Equations Program Manual. Encino, CA: Mulivariate Software, Inc; 2006.
- 89.
Chin WW. PLS-Graph. Version 3.00. build 1060. Texas: University of Houston; 2004.
- 90.
IBM. SPSS statistics for Windows. Version 21.0. Armonk, NY: IBM; 2012.
- 91. Carretero-Dios H, Pérez C. Normas para el desarrollo y revisión de estudios instrumentales. Int. J. Clin. Health Psychology. 2005; 5(3): 521–551.
- 92. Ferrando PJ, Anguiano-Carrasco C. El análisis factorial como técnica de investigación en psicología. Papeles del Psicólogo. 2010; 31(1): 18–33.
- 93.
George D, Mallery M. Using SPSS for Windows step by step: a simple guide and reference. Boston, MA: Allyn & Bacon; 2003.
- 94. Pérez E, Medrano L. Análisis Factorial Exploratorio: Bases Conceptuales y Metodológicas. RACC. 2010; 2(1): 58–66.
- 95. Lloret-Segura S, Ferreres-Traver A, Hernández-Baena A, Tomás-Marco I. El análisis factorial exploratorio de los ítems: una guía práctica, revisada y actualizada. AN PSICOL-SPAIN. 2014; 30(3): 1151–1169.
- 96. Schreiber JB, Nora A, Stage FK, Barlow EA, King J. Reporting structural equation modeling and confirmatory factor analysis results: A review. J Educ Res. 2006; 99(6): 323–338.
- 97. Bagozzi R, Yi Y. On the Evaluation of Structural Equation Models. J Acad Mark Sci. 1988; 16(1): 74–94.
- 98.
Nunnally J. Psychometric methods. New York: McGraw-Hill; 1978.
- 99.
Hair J, Hult G, Ringle C, Sarstedt M, Gudergan S. Advanced issues in Partial least Squares Structural Equation Modeling. Los Angeles: Sage; 2017.
- 100.
Bacigalupo M, Kampylis P, Punie Y, van den Brande G. EntreComp: The Entrepreneurship Competence Framework. Luxembourg: Publication Office of the European Union; 2016.
- 101.
Osterwalder A, Pigneur Y. Business Model Creation. Amsterdam: Modderman Drukwerk; 2010.
- 102. Arpiainen RL, Täks M, Tynjälä P, Lackéus M. The sources and dynamics of emotions in entrepreneurship education learning process. TRAMES. Journal of the Humanities and Social Sciences. 2013; 17(4): 331–346.
- 103. Baggen Y, Mainert J, Lans T, Biemans HJ, Greiff S, Mulder M. Linking complex problem solving to opportunity identification competence within the context of entrepreneurship. Int. J. of Lifelong Educ. 2015; 34(4): 412–429.
- 104.
Hoskins B, Fredriksson Ulf. Learning to Learn: What is it and can it be measured. Luxembourg: Office for Official Publications of the European Communities; 2008.
- 105.
Kupiainen S, Hautamakï J, Rantanen P. EU Pre-Pilot on learning to learn: Report on the compiled data, 2008-1190/001-001 TRA-TRINDIC. Brussels: EU Commission; 2008.
- 106. Baeten M, Dochy F, Struyven K, Parmentier E, Vanderbruggen A. Student-centred learning environments: An investigation into student teachers’ instructional preferences and approaches to learning. Learn. Environ. Res. 2016; 19(1): 43–62.
- 107. Thoutenhoofd ED, Pirries A. From self-regulation to learning to learn: observations on the construction of self and learning. Br. Educ. Res. J. 2015; 41(1): 72–84.
- 108.
Lans T, Baggen Y, Ploum LJL. Towards more synergy in entrepreneurial competence research in entrepreneurship education. In: Fayolle A, editor. A research agenda for entrepreneurship education. UK: Edward Elgar Publishing; 2018. pp. 224–242.
- 109.
Peña-Legazkue I, Guerrero M, González JL. Global Entrepreneurship Monitor. Informe España. Santander: Universidad de Cantabria, 2019.
- 110. Athayde R. Measuring enterprise potential in young people. Entrep. Theory Pract. 2009; 33(2): 481–500.
- 111. Muñiz J, Suárez-Álvarez J, Pedrosa I, Fonseca-Pedrero E, García-Cueto E. Perfil de personalidad emprendedora en jóvenes: componentes y evaluación. Psicothema. 2014; 26(4): 545–553.
- 112. Sánchez JC. The impact of an entrepreneurship education program on entrepreneurial competencies and intention. J. Small Bus. Manag. 2013; 51(3): 447–465.
- 113. Suárez-Álvarez J, Pedrosa I, García-Cueto E, Muñiz J. Screening Enterprising Personality in Youth: An empirical model. Spanish. J. Psychol. 2014; 17(60): 1–9.
- 114. Schelfhout W, Bruggemana K, De Maeyerb S. Evaluation of entrepreneurial competence through scaled behavioural indicators: Validation of an instrument. Stud. Educ. Evaluation. 2016; 51: 29–41.
- 115. Carretero-Dios H, Pérez C. Normas para el desarrollo y revisión de estudios instrumentales: consideraciones sobre la selección de tests en la investigación psicológica. Stud. Educ. Evaluation. 2005; 51: 29–41.
- 116.
Hair JF, Hult GTM, Ringle CM, Sarstedt M. A Primer on Partial Least Square Structural Equation Modeling (PLS-SEM). 2rd edition. Thousand Oaks: Sage; 2017.
- 117.
McCoshan A, Lloyd P, Blakemore M, Gluck D, Betts J, Lepropre M, et al. Towards Greater Cooperation and Coherence in Entrepreneurship Education. Report and Evaluation of the Pilot Action High Level Reflection Panels on Entrepreneurship Education initiated by DG Enterprise and Industry and DG Education and Culture. 2010. [cited 2019 November 25]. Available from: http://ec.europa.eu/enterprise/policies/sme/promotingentrepreneurship/educationtrainingentrepreneurship/reflectionpanels/files/entreducatinpanelen.pdf.
- 118.
European Commission/EACEA/Eurydice Entrepreneurship Education at School in Europe. Eurydice Report. Luxembourg: Publications Office of the European Union; 2016.