Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Environmentally friendly, but behaviorally complex? A systematic review of e-scooter riders’ psychosocial risk features

  • Sergio A. Useche ,

    Roles Conceptualization, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing

    sergioalejandro.useche@esic.edu

    Affiliation ESIC Business & Marketing School, Valencia, Spain

  • Adela Gonzalez-Marin,

    Roles Formal analysis, Investigation, Methodology, Writing – original draft, Writing – review & editing

    Affiliation Department of Economic and Legal Sciences, University Center of Defense, Santiago del la Ribera, Spain

  • Mireia Faus,

    Roles Funding acquisition, Investigation, Methodology, Writing – original draft

    Affiliation INTRAS (Research Institute on Traffic and Road Safety), University of Valencia, Valencia, Spain

  • Francisco Alonso

    Roles Funding acquisition, Resources, Software, Supervision, Visualization

    Affiliation INTRAS (Research Institute on Traffic and Road Safety), University of Valencia, Valencia, Spain

Abstract

Introduction

E-scooters have made a place for themselves on urban roads as an affordable, easy-to-use and environmentally friendly method of transportation. However, and partly because of their road behaviors and safety outcomes, e-scooter users have started to represent a focus of attention for transport planners and policymakers.

Aim

The present systematic review aims to target and analyze the existing studies investigating the psychosocial characteristics of e-scooter riders, focusing on their behavioral and risk-related features.

Methods

For this systematic review, the PRISMA methodology was used, which allows for the selection of suitable papers based on the study topic, in accordance with a set of pre-defined criteria and a search algorithm. A total of 417 indexed articles were filtered, resulting in only 32 eligible original articles directly addressing the issue. WOS, Scopus, NCBI, Google Scholar, and APA databases were used to create and test search techniques.

Results

At the literature level, most of the existing studies are distributed in a few regions of the globe. At the user’s level, results show how e-scooters are most commonly used by young, highly educated, urban-dwelling males, usually for short trips. In regard to road behavior, individuals with the lowest degrees of risk perception remain more prone to engaging in risky road behaviors likely to increase their crash involvement. This might be worsened by the lack of normative e-scooter regulations (and their enforcement) in many countries, plus the marked absence of road training processes. As common limitations, it can be mentioned that 87.5% of these studies used self-report methods, while 59.4% had local coverage.

Conclusions

The findings of this systematic review endorse the growing need to develop and enforce traffic laws and training processes for e-scooter users. In addition, road safety education and training programs are highlighted by existing studies as potentially pertinent alternatives to increase risk perception, and reduce risky behaviors, road conflicts and crash likelihood among e-scooter riders.

Introduction

Urban policymakers have faced different challenges linked to transportation sustainability, efficiency, safety, and security during recent decades. For instance, road fatalities, environmental pollution and transport densification remain active threats to road users worldwide [1, 2]. Alongside a rapid transformation of transport dynamics, ‘micromobility’ stands out as a very attractive option for many people [3]. Indeed, recent studies, apart from denoting its unexpected growth, highlight its effects on travel patterns, users’ behavior and community health [4, 5].

Among all personal mobility vehicles (PMVs), and especially in urban areas, the most popular devices are–at present–electronic scooters, usually known as e-scooters [6, 7]. Normally, e-scooters are relatively cheap and affordable electric devices available in (foldable) small size, light weight (commonly between 17–30 lbs., or 8–13 kg), and low maintenance costs. They can, however, reach considerable speeds with low energy consumption [4, 7]. Further, and given their capability to facilitate commuting by avoiding traffic jams and interchangeably using different types of roads, the e-scooter trade has been strengthened by its “environmentally friendly” features, as it is considered a sustainable and low-polluting means of transport, of course as long as it is used correctly [8].

In addition, electric scooter sharing has increased the number of people using e-scooters [9]. Shared e-scooters can be picked up and dropped off anywhere within a commonly wide service area. In this regard, their convenience and flexibility have led to electric scooter sharing changing mobility dynamics. In fact, the evidence indicates that shared e-scooters have grown more rapidly than any other type of shared urban micro-mobility vehicle [10]. In other words, many cities (as well as many of their inhabitants) have adopted both private and shared e-scooters over the last few years. They were encouraged by potential benefits such as decreasing travel time, making trips cheaper, reducing carbon dioxide (CO2) emissions and avoiding massive transport means, especially during the COVID-19 pandemic [3, 11].

Notwithstanding all their benefits, the existing literature addressing PMVs remarks on some common drawbacks for e-scooter users:

In the first place, most of the current e-scooter riders do not count on specialized training for their operation. In other words, driver training and licensing procedures are not commonly required for their acquisition and usage. In addition, many of these riders are young adults, which already places them as a ‘risk’ profile according to road safety figures [4, 5].

Secondly, some studies argue that the features of PMVs might make e-scooter riders think that it is a ‘harmless toy’, making them even more likely to perform road risky behaviors [2, 6].

Thirdly, it is worth highlighting that PMVs have several limitations in terms of passive safety, which often depends almost totally on the use of appropriate protective devices and wearables. However, the state of affairs in terms of legal knowledge and enforcement is of considerable concern [5, 12]. Accordingly, it is known that head contusions and fractures are e-scooter riders’ most common injuries [13].

Fourthly, and despite (i) the frequent problem of accident underreporting, and (ii) that they cannot be directly compared to numbers of drivers and pedestrians, e-scooter-related crash figures keep rising in different countries. For instance, 1,500 crashes involving e-scooters were registered between 2017 and 2019 in the United States [14]. Meanwhile, in Spain, only during the year 2020, there were more than 100 severe crashes involving e-scooter riders [15].

Another usual constraint highlighted by studies is legislation, or the lack of it. In many regions, the novelty of e-scooters means that there is still no national legislation regulating the rules of the road for these devices in most countries. At worst, these laws remain unknown to users or unenforced by authorities [16]. In addition, in low-regulated areas, and since e-scooters cannot be fully identified with plates, sanctions for risky behavior are considerably scarce.

Indeed, some sources suggest that these feelings of anonymity and unpunishability might enhance the likelihood of several generic traffic violations, such as red-light running, riding on the pavement, speeding, zig-zagging, riding while intoxicated, getting too close to pedestrians and vehicles, and not wearing helmets [5, 12, 17].

Another huge ambiguity is where e-scooters should circulate. Preliminary, technical studies on this means of transport tend to report contrasting results regarding, among others, the most appropriate place for their circulation, i.e., sidewalks, conventional roads, bike lanes, or all of them [4, 18]. This has led some government entities to have contradictory opinions about, on the one hand, promoting environmentally-friendly transport solutions and, on the other, guaranteeing users’ road safety, especially in the absence of any type of road education or training [18]. Although still scarce, a few studies seem to coherently endorse the need of fostering laws and human behavioral-based solutions for facing this emerging challenge for road safety, especially in the case of some pioneer countries with a more developed state of affairs in this matter, including Australia, France or Singapore where e-scooter regulations do actually exist, showing some promising results [4, 19].

Some of these advances can be seen in a previous recent review study conducted by Orozco-Fontalvo, Llerena & Cantillo [20], analyzing the existing literature on e-scooters but with a special focus on e-scooter usage trends, prices, regulations and their environmental impact. Interestingly, this systematic review highlights (apart from their absence) several deficiencies in the application of laws and regulations regarding electric scooters. Another interesting finding of this study is related to the user profile: their findings indicate that e-scooter riders were predominantly young people (especially men), who previously used sustainable transport modes, especially bicycles, even though other relevant issues such as riders’ psychosocial characteristics, road behavior and risk-related issues remain pending to be addressed.

Study aim

Bearing in mind the aforementioned considerations, the aim of this systematic review was to target and analyze the existing studies investigating the psychosocial characteristics of e-scooter users, focusing on their behavioral and risk-related features. For this purpose, a set of data source search criteria, which will be detailed below, was defined to properly retrieve/analyze the most relevant studies made and provide relevant insights for strengthening further research and policymaking in this field.

Methods and materials

Study approach

Overall, systematic reviews can be understood as a method of mapping the current literature by successively following a transparent and systematic approach to establish a research topic, discover studies, assess their quality, and synthesize findings, either qualitatively or statistically [21]. Also, and far from necessarily seeking the ability to generalize findings (that is something that often inexperienced researchers mistakenly look for in a systematic review), this method focuses on describing the state of affairs on a certain topic or research question to the best of the possibilities.

For this research, the core recommendations provided by Arksey and O’Malley’s methodology for systematic reviews of the literature were followed to explain and improve each stage of the framework [22]. The five stages are as follows:

  1. Identifying the Research Question,
  2. Finding Relevant Studies,
  3. Selecting the Studies,
  4. Charting the Data and Collating,
  5. Summarizing and Reporting the Results.

Step 1: Identifying the research question.

As previously mentioned, the present systematic review aims to target and analyze the existing studies investigating the psychosocial characteristics of e-scooter users and their behavioral and risk-related features. As specialized literature commonly endorses the idea that risky road (human) behavior constitutes the main predictor of crashes [23, 24], it is important to explore the characteristics of e-scooter users as an emerging group of users in cities according to their demographic profiles. In this sense, we seek to explore the main themes of the studies on e-scooter users as well as the possible discrepancies (or concordances) of the results.

As this does not constitute a meta-analytic experience, no statistical comparisons were made. Also, it is worth remarking that, as in many other "emerging" research topics, it is common to find that some regions are underrepresented in terms of scientific production in this field. A summary and topic analysis of all the selected research articles were included in the final report.

Step 2: Finding relevant studies.

The current review was conducted in accordance with the PRISMA standards for systematic review notification. PRISMA is the acronym for “Preferred Reporting Items for Systematic Reviews and Meta-Analyses”, and it is an evidence-based method that establishes a set of items for reporting in systematic reviews [25].

PRISMA starts the process with the records identified in the searches carried out in each of the different databases. It continues with the total number of records after duplicates are eliminated and ends with the individual studies in the qualitative and quantitative synthesis [26]. This methodology, which allows following a structured (but still flexible) set of steps, has been widely used in other studies and systematic reviews on various topics, including human behavior and traffic crashes in the case of different groups of road users [2730].

The databases that were used to conduct a preliminary literature search were the Web of Science, American Psychological Association (APA), Scopus, National Center for Biotechnology Information (NCBI) and Google Scholar. These databases were selected because of the large number of articles they store and their relationship to behavioral-based studies, especially from the fields of psychology/behavioral sciences and applied road safety [31, 32].

Other lists of systematic and comprehensive reviews of other primary research publications, which were theoretically eligible but not collected by our search algorithms, were also examined. This was carried out in order to target potentially suitable studies not indexed within the aforementioned data sources.

The search covered publications from the beginning of the database, and included the literature published in the accessed indexes/databases up to January 2022. Among the terms, we looked for were: “e-scooter users”, “e-scooter riders”, “e-scooter”, “attitudes”, “behavior” (and “behaviour”), “safety”, “risk perception”, “road risk perception” “user profile” “and “road users”. We came up with these terms, after reviewing the titles and keywords of the articles we found during our preliminary search,.

Based on what is advised in specialized literature [3335], our research criteria comprised the application of three essential and widely used Boolean operators: "AND", to jointly retrieve results over terms whose main value for the systematic review lies in the fact of being used in the same study (e.g., e-scooters, riders); "OR", especially to emphasize on potentially similar terms that should vary in terms of writing and naming, but not in meaning (e.g., behavior/behaviour); and "NOT", to exclude frequently observed, clearly irrelevant results (e.g., price, regulations).

Step 3: Selecting the studies.

During this stage, articles that did not refer to our research goal were eliminated, excluding articles on e-scooters with a technical or technological profile and only including user-focused research, usually of a more psychological or sociological nature. Conference/summaries, protocols, letters, editorials, case reports, and case series were not among the considered publications. We also limited our eligibility criteria to publications published in English and Spanish that were either publicly available or could (at worst) be requested through the library system, making them able to be analyzed.

A subset of titles and summaries was initially examined by each author independently, and the results were tallied. This constitutes a common process in the case of systematic reviews addressing road behavioral-based research. It covers the case of different groups of users and/or compares them, as it has been done during recent years with the case of reviews on cyclist behaviors [36, 37].

Another relevant clarification worth to be made is that, given our focus on behavioral and risk-related factors and not on e-scooter crash consequences, issues such as road trauma and riders’ fatalities were not included in our search criteria, albeit these topics could be among the various topics addressed by the studies to analyze.

Step 4: Charting the data.

The descriptive-analytic method of Arksey & O’Malley was used to critically review the papers that matched the inclusion criteria [22]. The following information was retrieved and recorded for each eligible article: author(s), year of publication, country of study, study design, group of users investigated, sample size, key findings, and highlighted results, as well as their core limitations and shortcomings. Other previous systematic reviews in the field of road users’ behavior report similar information from the selected articles [38, 39].

Step 5: Collating, summarizing, and reporting the results.

Since this helps to increase the chances of adequately categorizing, unifying and diagramming the information for comparative purposes (favoring the data understanding among readers), the descriptive data were evaluated using a thematic-based organization technique after the graphed data were summarized in tables. For this purpose, the main sections and issues used for empirical research were summarized in successive columns (see Table 1).

thumbnail
Table 1. Structured sescription of study setting, key outcomes and limitations of eligible studies.

https://doi.org/10.1371/journal.pone.0268960.t001

Results

The database search initially returned 478 possible papers able to be analyzed. However, once the doubled (paper duplicates) or non-accessible items were dismissed from the research process, the search criteria yielded a total of 417 possible outcomes after applying this filter. Also, and to avoid discarding potentially useful information sources as a consequence of indexing issues, we used a manual selection process to find papers fitting the review’s goal, ending up with 32 papers that were qualified under the aforementioned criteria. The description of the data sources and selection procedures used is graphically presented in the flowchart (Fig 1).

thumbnail
Fig 1. PRISMA diagram appending non-duplicate search results according to the different data sources.

Abbreviations: WOS (Web of Science); APA (American Psychological Association); NCBI (National Center for Biotechnology Information).

https://doi.org/10.1371/journal.pone.0268960.g001

Search results

Characteristics of eligible research articles.

Since (and as mentioned before) this research problem has been raised within the last decade, we did not set a time frame for our search. Following this logic guideline, we found 32 papers that met the minimum inclusion criteria and were published in English between 2015 and 2022, indicating that the study topic is current. Furthermore, the research was carried out in a variety of countries. Thus, at the same time it highlights the scarcity of original studies on this subject in almost all the countries around the globe. There were 15 countries represented (ordered from highest to lowest number of empirical studies available) in the literature search results: United States (n = 10), Germany (n = 5), Singapore (n = 3), New Zealand (n = 2), China (n = 2), Australia (n = 1), France (n = 1), Greece (n = 1), Saudi Arabia (n = 1), Sweden (n = 1), Taiwan (n = 1), Poland (n = 1), Denmark (n = 1), Canada (n = 1) and Finland (n = 1), as shown in Fig 2.

thumbnail
Fig 2. Geographical distribution (country of origin) of the selected studies (number of studies per country).

https://doi.org/10.1371/journal.pone.0268960.g002

It stands out that observational/cross-sectional studies most frequently address user-related features and trip dynamics (n = 15). In the same way, users’ features-related studies commonly perform comparisons among road users (n = 10). Germany is the country where more empirical studies solely focused on e-scooter riders’ behavior have been performed so far (n = 4).

Regarding methodological features of the selected eligible studies, it is worth pointing out that all of them were empirical-based and (more specifically) followed a cross-sectional design, and the vast majority are also observational, usually–although not exclusively–through online surveys or face-to-face interviews (n = 30 of the studies fulfilled this characteristic). There are only two articles where an experimental methodology is used. In both, virtual reality devices are used to expose subjects to various situations controlled by the researchers in order to observe their behaviors and decisions under such circumstances.

In all these selected research articles throughout the review process, the focus of the core study was directly related to e-scooter riders’ psychosocial issues. However, in some of them, apart from being able to gather data about psychosocial features of e-scooter users themselves, we also have the assessments of other road users on critical matters such as perceived safety, observed risk behaviors or interaction between users. Thus, in more detail, the investigations are as follows: evaluate only e-scooter riders (n = 15), compare them with non-e-scooter users (n = 10), pedestrians (n = 3), cyclists (n = 3) and with drivers and cyclists (n = 1).

Analysis of studies.

In order to meet our core study aim, the studies were analyzed in consideration of both the PRISMA protocol guidelines [25], as well as other scoping reviews previously published, that dealt with similar and/or compatible topics or applied studies [20, 22]. These sources suggested reporting very general issues of the studies (e.g., authors, year) and their study setting, key results, and even limitations.

Although all of the studies selected approached psychosocial issues among e-scooter riders regarding their behaviors, risks and safety, the aims of these sources are very heterogeneous, so it was important to group them for the case of this systematic review. For this purpose, studies were categorized according to their core aims, albeit some secondary aims could have overlapped. This strategy allowed us to divide them into three blocks of studies, as presented in Table 1: (i) Studies aimed at profiling e-scooter users, i.e., e-scooter riders’ basic features and transport dynamics (n = 15); (ii) Those targeting to examine e-scooter users’ riding behavior, attitudes and interaction with other road users (n = 10); and (iii) Researches assessing risk perceptions in relation to e-scooter riders (n = 7).

Discussion

The core aim of this systematic review was to target and analyze the existing studies investigating the psychosocial characteristics of e-scooter riders, focusing on their behavioral and risk-related features. Overall, all empirical papers addressing the profile of e-scooter users tend to highlight similar demographic, i.e., gender and age group-based characteristics, regardless of the country in which their research was conducted. A wide-ranging synthesis of the approached studies’ outcomes shows how e-scooter users are more likely to be males, young, highly educated and/or working full time, and living in urban areas. Additionally, they are often regardless of income levels, given that e-scooters are considered affordable even for the case of Low and Middle-Income Countries, or LMICs [41, 42].

Usage and trip-related patterns in e-scooter riding

Regarding travel patterns of e-scooter users in literature, the sources selected allow to affirm that, overall, e-scooter trips tend to have a relatively short length. This fact is usually attributable to their energy storage capacity, which still remains somewhat limited. Further, the still low potential of e-scooter for longer trips seems to be–in addition to geographical and infrastructural shortcomings–the main motive why it is not as widely used by those living in peripheral or rural areas [51, 72].

Accordingly, it should be noted that the environmental value of e-scooters can be considered “relative”, as it carries both benefits and constraints. For instance, while using them to replace motorized transportations means makes them “environmentally friendly”, their usage may limit the active mobility of (e.g.) people potentially performing short urban trips by walking or cycling [20]. Further, frequent bicycle and motorcycle users are those reporting themselves as more reluctant to change their commuting habits, including shifting to e-scooters for their urban trips [40].

Another factor constantly observed in the analyzed papers is, in brief, the growing association between Information and Communication Technologies (ICTs) and the use of e-scooters. ITCs refer to the set of technologies that allow access, production, processing, treatment, storage, transmission and communication of information. Although this was not a main study variable across the studies analyzed, it is worth highlighting that, overall, the usage of new technologies tends to be (in literature) positively associated with both the intention to use e-scooters and a greater intensity of use [48, 52, 53]. Once considering this issue, it seems to fit the exposed user profile coherently: as it becomes cheaper and it easily interacts with ICT using patterns, young people who at the same time tend to be the most familiar with connected technologies and perceive the lesser risks on them and remain the most prone to adopt ‘connected’ devices for everyday mobility [43].

Accordingly, previous studies in this regard have shown that key technological developments applied to mobility tend to elicit more positive attitudes. Thus, they explain a greater intention of being adopted among individuals having higher degrees of previous interaction with other technologies. At the same time, they remain more open to new technology-related experiences [73, 74], but also more prone to assume new (and sometimes greater) levels of risk [75]. This is precisely another key outcome to be subsequently discussed in this study.

Risk-related perceptions, assumptions and outcomes

Firstly, it is worth addressing the “troublesome” issue of subjective risk perceptions. Despite having been widely endorsed by previous studies as one of the best predictors of the intention to use both e-scooters and other PMDs, nowadays, it represents a challenge in terms of intervention. This is due to the widespread absence of policies, programs and law requirements for road safety education and training for e-scooter riders [20, 68]. Despite this significant constraint, empirical literature already provides some highlights that endorse the need for further work on developing proper interventions and policies to increase road risk perception among e-scooter users.

For instance, it has been demonstrated how an overall greater degree of subjective risk perceptions coherently contributes to explaining the fact that females shift to e-scooters with less frequency than their male counterparts, as, on average, they perceive them with higher levels of insecurity and more vulnerable to suffer different types of victimization on-road or transit environments [40]. This is (consistently) their main stated reason for avoiding certain trip modalities [44], including many of the different possible risk-related scenarios usually present at urban locations [76].

Also, there is a fact that, although is consistently linked in the literature to risky road behaviors and crashes, remains relatively understudied: what could be the factors most closely explaining great risk assumptions among e-scooter riders? [46, 55, 65]. In this regard, some studies highlight that, besides age and gender issues, trip-related purposes might play a relevant role in predicting risky road behaviors, making it necessary to focus on enhancing risk perceptions in any way possible [30, 55, 65]. This means that the problem can also be understood as "circular": since it does not require a licensing course, users could be encouraged to acquire an e-scooter. Consequently, they become exempt from the need to go through a road training process, making it simpler but riskier at the same time.

Moreover, another factor that seems to make things worse is that the purpose of e-scooters has been largely leisurized. Therefore, PMDs tend to be often perceived as "fun" devices, while their main strengths could be, instead, their (e.g.) practicality, comfort and environmental contributions [47]. In behavioral terms, it is feasible to hypothesize that this potentially problematic association between PMDs and leisure might enhance a certain relaxation among users, who may systematically decrease their protective habits. At the same time, their risks assumptions tend to grow, e.g., using helmets on a less regular basis, riding in the wrong way, or using sidewalks at high speeds, even for relatively short periods of their trips [12, 62].

Could e-scooter riders’ behaviors be “the worst”?

To date, there is no accurate answer provided with a very high intercontextual validity to this question. However, some studies suggest that e-scooter users could be performing more (and more frequently) risky behaviors than cyclists and motorcyclists [59]. Some studies suggest that this could be enhanced by the disparity of opinions, laws, and directions regarding the proper regulation of the circulation of e-scooters in urban locations [5, 77].

Regarding other users’ perceptions, pedestrians have been shown to be those self-reporting the greatest feeling of unsafety when interacting with e-scooters, whose riders tend to be considered as ‘riskier’ than cyclists [66, 67]. This may be due to several reasons. For one, the novelty of e-scooters makes them unfamiliar to many people, who are much more accustomed to sharing their space with bicycles [49]. This is compounded by the high speeds (commonly up to 25km/h) these vehicles can reach, and the nature of the injuries commonly suffered in their crashes [78, 79]. Specifically, serious knee, thorax and/or head injuries are the more likely to occur in e-scooter-pedestrian crashes, the last being usually the most affected, according to hospital records [15].

As a response to this big concern, some pioneer efforts have been made to analyze the consequences of these crashes. For instance, research conducted in Germany [64, 80], Denmark [81], and New Zealand [82], among other countries, determined that the introduction of e-scooters in urban traffic has had a significant impact on healthcare centers. Furthermore, in Spain, an increase of 31% in injuries and 20% in deaths due to this cause has been detected in the last year [15]. In this regard, the results synthesized in this study suggest that, at the risky road behavior level, the absence of helmets can be considered as an underestimated factor. Although not preventing traffic crashes, the absence of helmets weighed most heavily in the deaths recorded in 2020, highlighting its importance as a passive safety measure [83, 84].

On the other hand, in many cities, there are lanes delimited exclusively for cyclists, aimed at reducing the chances of them invading pavement and other pedestrian locations [44]. In this regard, identifying conflict zones and delimiting safe spaces for e-scooters to minimize the risks of collisions or falls remain a crucial issue for preventing road conflicts, near-misses, and crashes involving PMD riders [67].

Altogether, studies analyzing the socio-demographic and behavioral elements of e-scooter users present similar findings, even though their number and deepness can be considered relatively scarce. This is a key limitation currently existing in the literature, consequently affecting the present review. Further, e-scooter riders’ features, dynamics and figures remain unaddressed in many geographical locations, making it difficult to provide globally reliable inferences on this topic, even though some insights are provided by the existing literature.

Common limitations of existing studies and further research

Finally, it is worth acknowledging some limitations commonly present in the existing literature on the topic. As this is a systematic review, we will focus on the studies analyzed. In the first place, and as reported in Table 1 (see right column), the majority of research on e-scooter users’ behavior and risk-related factors uses surveys as the method par excellence for data collection, accounting for 87.5% of the research papers. While this type of design is very useful for gathering large samples and extensive datasets [85], self-reported information implies many potential biases. Among the most frequent, social desirability, stereotypes, unrealistic attributions (e.g., over- or under-estimations) or differences between respondents and non-respondents attributable to nonresponse bias stand out [86, 87]. Therefore, these study outcomes should be carefully and contextually analyzed. Also, future research could be benefited from employing other methods to complement the evidence obtained from questionnaire-based research.

Another limitation that occurs in 59.4% of the selected studies is the small territory in which they have been carried out. In many cases, the studies present a local coverage that may restrict the degree of generalizability of the results [88]. This phenomenon is exacerbated if the sample is small (34.3% of the articles selected) and/or if the questionnaires are only administered in specific areas of a locality that are not representative of the population as a whole (this represents 40.6% of the articles in the review). In these studies, biases arise from the characteristics of the population stratum analyzed (e.g., a university campus will have mostly young participants, or a particular neighborhood will have subjects of a similar socio-economic level).

To a lesser extent, the studies report limitations such as low reliability (6.25%), low exhaustiveness (3.12%) or data limitations derived from the quality of the images recorded (6.25%). In any case, all the limitations indicated do not detract from the value of the results. On the contrary, they provide greater validity and rigor to the research process developed [89]. Moreover, the accumulation of evidence provides findings and indications that should be considered in future studies covering this research field.

Conclusions

The findings of this study show, at the literature level, that most of the existing studies are distributed in a few regions of the world (North America, Central Europe, Eastern Asia and Oceania). At the user’s level, results indicate that e-scooters are most commonly used by young, highly educated, urban-dwelling males, usually for short trips.

Further, the accumulated evidence can state that the basic particularities of e-scooter users, as well as their attitudes, behaviors, and perceptions, are similar despite the differential cultural characteristics of the countries analyzed. Notwithstanding, there is no cross-culturally validated evidence regarding the mechanisms linking e-scooter riders’ psychosocial features, behaviors, and crashes. Consequently, and at the practical level, this study shows how the existing empirical scientific production on this matter: (i) remains considerably scarce, and (ii) is reduced to a few countries (and the production is minimum in LMICs), even though e-scooter riding has grown in a global level during the last decade.

Therefore, further research addressing psychosocial and behavioral risk-related issues among e-scooter riders and other MVP users might contribute to formulating, developing and enforcing more effective regulations and actions aimed at reducing their psychosocial road risks and, therefore, their crash likelihood.

Ethics

The Research Ethics Committee at the Research Institute on Traffic and Road safety at the University of Valencia assessed and approved the study protocol, certifying its accordance to the current ethical guidlines applicable to systematic reviews (IRB approval number RE0001160921). As this is a systematic review and there are no human participants, informed consent is not required.

Supporting information

S1 Checklist. PRISMA checklist for systematic reviews.

https://doi.org/10.1371/journal.pone.0268960.s001

(DOCX)

Acknowledgments

The authors wish to thank Arash Javadinejad and Sara Pascual (professional translators) for the edition of the revised (R1) and final (R2) version of the manuscript.

References

  1. 1. Brenner N, Schmid C. The ‘urban age’ in question. Int J Urban Reg Res, 2014, 38(3): 731–755. https://doi.org/10.1111/1468-2427.12115.
  2. 2. Sutton JC. Gridlock: Congested cities, contested policies, unsustainable mobility. 2015. Routledge.
  3. 3. Li A, Zhao P, Haitao H, Mansourian A, Axhausen KW. How did micro-mobility change in response to COVID-19 pandemic? A case study based on spatial-temporal-semantic analytics. Comput Environ Urban Syst, 2021, 90: 101703. pmid:34629583
  4. 4. Glavić D, Trpković A, Milenković M, Jevremović S. The E-Scooter Potential to Change Urban Mobility—Belgrade Case Study. Sustainability, 2021, 13(11): 5948. https://doi.org/10.3390/su13115948.
  5. 5. Fonseca-Cabrera AS, Llopis-Castelló D, Pérez-Zuriaga AM, Alonso-Troyano C, García A. Micromobility Users’ Behaviour and Perceived Risk during Meeting Manoeuvres. Int J Environ Res Public Health, 2021, 18(23): 12465. pmid:34886198
  6. 6. Hollingsworth J, Copeland B, Johnson JX. Are e-scooters polluters? The environmental impacts of shared dockless electric scooters. Environ Res Lett, 2019, 14(8): 084031. https://doi.org/10.1088/1748-9326/ab2da8.
  7. 7. Hosseinzadeh A, Algomaiah M, Kluger R, Li Z. E-scooters and sustainability: Investigating the relationship between the density of E-scooter trips and characteristics of sustainable urban development. Sustain Cities Soc, 2021, 6: 102624. https://doi.org/10.1016/j.scs.2020.102624.
  8. 8. Gössling S. Integrating e-scooters in urban transportation: Problems, policies, and the prospect of system change. Transp Res D Transp Environ, 2020, 79: 102230. https://doi.org/10.1016/j.trd.2020.102230.
  9. 9. Jiao J., & Bai S. Understanding the shared e-scooter travels in Austin, TX. ISPRS Int J Geo-Inf, 2020, 9(2): 135. https://doi.org/10.3390/ijgi9020135.
  10. 10. Eccarius T., & Lu C. C. Adoption intentions for micro-mobility–Insights from electric scooter sharing in Taiwan. Transp Res D Transp Environ, 2020, 84: 102327. https://doi.org/10.1016/j.trd.2020.102327.
  11. 11. Guo Y., & Zhang Y. Understanding factors influencing shared e-scooter usage and its impact on auto mode substitution. Transp Res D Transp Environ, 2021, 99: 102991. https://doi.org/10.1016/j.trd.2021.102991.
  12. 12. Haworth NL, Schramm A. Illegal and risky riding of electric scooters in Brisbane. Med J Australia, 2019, 211(9): 412–413. pmid:31291003
  13. 13. Ishmael CR, Hsiue PP, Zoller SD, Wang P, Hori KR, Gatto JD, et al. An early look at operative orthopedic injuries associated with electric scooter accidents: bringing high-energy trauma to a wider audience. J Bone Joint Surg Am, 2020, 102(5): e18. pmid:31895168
  14. 14. Felton R. E-Scooter Ride-Share Industry Leaves Injuries and Angered Cities in its Path. Consumer Reports. 2019. Available online: https://www.consumerreports.org/product-safety/e-scooter-ride-share-industry-leaves-injuries-and-angered-cities-in-its-path/ (accessed on 30 Jan 2022).
  15. 15. Mapfre Fundación. Pruebas de choque (crash-test) de patinetes eléctricos y riesgos asociados a su proceso de recarga: recomendaciones para un uso seguro. 2021. Available online: https://documentacion.fundacionmapfre.org/documentacion/publico/es/catalogo_imagenes/grupo.do?path=1109839 (accessed on 26 Jan 2022).
  16. 16. Yang H, Ma Q, Wang Z, Cai Q, Xie K, Yang D. Safety of micro-mobility: analysis of E-Scooter crashes by mining news reports. Accid Anal Prev, 2020, 143: 105608. pmid:32480017
  17. 17. Sparks AM, Fessler DM, Zinsser M. Exploring the Roles of Conformity, Hazard, and Convenience in Risk Mitigation Decisions: An Observational Study of Helmet Use Among Bicyclists and E-scooter Riders in Los Angeles During Two Natural Experiments. 2019. https://doi.org/10.31234/osf.io/gspbm.
  18. 18. RACE. Así está la normativa de patinetes eléctricos en España. 2021. Available online: https://www.race.es/patinete-electrico-legislacion (accessed on 27 Jan 2022).
  19. 19. Yan X, Yang W, Zhang X, Xu Y, Bejleri I, Zhao X. Do e-scooters fill mobility gaps and promote equity before and during COVID-19? A spatiotemporal analysis using open big data, 2021. https://doi.org/10.48550/arXiv.2103.09060.
  20. 20. Orozco-Fontalvo M, Llerena L, Cantillo V. Dockless electric scooters: A review of a growing micromobility mode. Int. J. Sustain. Transp., 2022, 1–17. https://doi.org/10.1080/15568318.2022.2044097.
  21. 21. Armstrong R, Hall BJ, Doyle J, Waters E. Scoping the scope’of a Cochrane review. J Public Health, 2011, 33(1): 147–150.
  22. 22. Arksey H, O’Malley L. Scoping studies: towards a methodological framework. Int J Soc Res Methodol, 2005, 8(1): 19–32. https://doi.org/10.1080/1364557032000119616.
  23. 23. Puchades VM, Pietrantoni L, Fraboni F, De Angelis M, Prati G. Unsafe cycling behaviors and near crashes among Italian cyclists. Int J Inj Control Saf Promot, 2018, 25(1): 70–77. https://doi.org/10.1080/17457300.2017.1341931.
  24. 24. Stephens AN, Brown J, de Rome L, Baldock MRJ, Fernandes R, Fitzharris M. The relationship between Motorcycle Rider Behaviour Questionnaire scores and crashes for riders in Australia. Accid Anal Prev, 2017, 102: 202–212. pmid:28324820
  25. 25. Moher D, Altman DG, Liberati A, Tetzlaff J. PRISMA statement. Epidemiology, 2011, 22(1): 128. pmid:21150360
  26. 26. Urrútia G, Bonfill X. PRISMA declaration: A proposal to improve the publication of systematic reviews and meta-analyses. Medicina clínica, 2010, 135(11): 507–511. pmid:20206945
  27. 27. Garbarino S, Guglielmi O, Sanna A, Mancardi GL, Magnavita N. Risk of occupational accidents in workers with obstructive sleep apnea: systematic review and meta-analysis. Sleep, 2016, 39(6): 1211–1218. pmid:26951401
  28. 28. Heidari M, Aryankhesal A, Khorasani-Zavareh D. Laypeople roles at road traffic crash scenes: a systematic review. Int J Inj Control Saf Promot, 2019, 26(1): 82–91. pmid:29939119
  29. 29. Akbari M, Lankarani KB, Heydari ST, Motevalian SA, Tabrizi R, Sullman MJ. Is driver education contributing towards road safety? a systematic review of systematic reviews. J Inj Violence Res, 2021, 13(1):69. pmid:33459279
  30. 30. Oviedo-Trespalacios O, Truelove V, Watson B, Hinton JA. The impact of road advertising signs on driver behaviour and implications for road safety: A critical systematic review. Transp Res A Policy Pract, 2019, 122: 85–98. https://doi.org/10.1016/j.tra.2019.01.012.
  31. 31. Azami-Aghdash S, Aghaei MH, Sadeghi-Bazarghani H. Epidemiology of road traffic injuries among elderly people; a systematic review and meta-analysis. Bull Emerg Trauma, 2018, 6(4): 279. pmid:30402515
  32. 32. Malakoutikhah M, Rabiei H, Hassanipour S, Jahangiri M. The prevalence of unsafe behaviors in Iranian workers: a systematic review and meta-analysis. Iran J Public Health, 2021, 50(2): 257. pmid:33747989
  33. 33. Bramer W. M., de Jonge G. B., Rethlefsen M. L., Mast F., & Kleijnen J. A systematic approach to searching: an efficient and complete method to develop literature searches. J Med Libr Assoc, 2018, 106(4): 531. pmid:30271302
  34. 34. Scells, H., Zuccon, G., & Koopman, B. Automatic Boolean query refinement for systematic review literature search. In WWW’19: The world wide web conference, 2019, (pp. 1646–1656). https://doi.org/10.1145/3308558.3313544.
  35. 35. Gusenbauer M., & Haddaway N. R. Which academic search systems are suitable for systematic reviews or meta‐analyses? Evaluating retrieval qualities of Google Scholar, PubMed, and 26 other resources. Res. Synth. Methods, 2020, 11(2): 181–217. pmid:31614060
  36. 36. Esmaeilikia M, Radun I, Grzebieta R, Olivier J. Bicycle helmets and risky behaviour: A systematic review. Transp Res Part F Traffic Psychol Behav, 2019, 60: 299–310. https://doi.org/10.1016/j.trf.2018.10.026.
  37. 37. Olivier J, Creighton P. Bicycle injuries and helmet use: a systematic review and meta-analysis. Int J Epidemiol, 2017, 46(1): 278–292. pmid:27450862
  38. 38. Spindler DJ, Allen MS, Vella SA, Swann C. The psychology of elite cycling: a systematic review. J Sports Sci, 2018, 36(17): 1943–1954. pmid:29346033
  39. 39. Schönbach DM, Altenburg TM, Marques A, Chinapaw MJ, Demetriou Y. Strategies and effects of school-based interventions to promote active school transportation by bicycle among children and adolescents: a systematic review. Int J Behav Nutr Phys Act, 2020, 17(1): 1–17.
  40. 40. Nikiforiadis A, Paschalidis E, Stamatiadis N, Raptopoulou A, Kostareli A, Basbas S. Analysis of attitudes and engagement of shared e-scooter users. Transport Res D-Tr E, 94, 2021: 102790. https://doi.org/10.1016/j.trd.2021.102790.
  41. 41. Fitt H, Curl A. Perceptions and experiences of Lime scooters: Summary survey results. 2019. Available online: http://hdl.handle.net/10092/16336 (accessed on 28 Jan 2022).
  42. 42. Christoforou Z, Gioldasis C, de Bortoli A, Seidowsky R. Who is using e-scooters and how? Evidence from Paris. Transport Res D-Tr E, 2021, 92: 102708. https://doi.org/10.1016/j.trd.2021.102708.
  43. 43. Ratan R, Earle K, Rosenthal S, Chen VHH, Gambino A, Goggin G., et al. The (digital) medium of mobility is the message: Examining the influence of e-scooter mobile app perceptions on e-scooter use intent. Comp Hum Behav, 2021, 3: 100076. https://doi.org/10.1016/j.chbr.2021.100076.
  44. 44. Buehler R, Broaddus A, Sweeney T, Zhang W, White E, Mollenhauer M. Changes in Travel Behavior, Attitudes, and Preferences among E-Scooter Riders and Nonriders: First Look at Results from Pre and Post E-Scooter System Launch Surveys at Virginia Tech. Transp Res Record, 2021, 2675(9): 335–345. https://doi.org/10.1177/03611981211002213.
  45. 45. Sanders RL, Branion-Calles M, Nelson TA. To scoot or not to scoot: Findings from a recent survey about the benefits and barriers of using E-scooters for riders and non-riders. Transport Res A Policy Pract, 2020, 139: 217–227. https://doi.org/10.1016/j.tra.2020.07.009.
  46. 46. Almannaa MH, Alsahhaf FA, Ashqar HI, Elhenawy M, Masoud M, Rakotonirainy A. Perception analysis of E-scooter riders and non-riders in Riyadh, Saudi Arabia: Survey outputs. Sustainability, 2021, 13(2): 863. https://doi.org/10.3390/su13020863.
  47. 47. Kopplin CS, Brand BM, Reichenberger Y. Consumer acceptance of shared e-scooters for urban and short-distance mobility. Transport Res D-Tr E, 2021, 91: 102680. https://doi.org/10.1016/j.trd.2020.102680.
  48. 48. Huang FH, Lin SR. A Survey of User Experience of Two Wheeler Users in Long-Term Interactions. In Congress of the International Ergonomics Association (pp. 1465–1472). 2018. Springer, Cham.
  49. 49. Fitt H, Curl A. The early days of shared micro mobility: A social practices approach. J Transport Geogr, 2020, 86: 102779. https://doi.org/10.1016/j.jtrangeo.2020.102779.
  50. 50. Hyvönen K, Repo P, Lammi M. Light electric vehicles: substitution and future uses. Transport Res Proc, 2016, 19: 258–268. https://doi.org/10.1016/j.trpro.2016.12.085.
  51. 51. Zhang W, Buehler R, Broaddus A, Sweeney T. What type of infrastructures do e-scooter riders prefer? A route choice model. Transport Res D-Tr E, 2021, 94: 102761. https://doi.org/10.1016/j.trd.2021.102761.
  52. 52. Bieliński T, Ważna A. Electric scooter sharing and bike sharing user behaviour and characteristics. Sustainability, 2020, 12(22): 9640. https://doi.org/10.3390/su12229640.
  53. 53. Flores PJ, Jansson J. The role of consumer innovativeness and green perceptions on green innovation use: The case of shared e‐bikes and e‐scooters. J Consumer Behav, 2021, 20(6): 1466–1479. https://doi.org/10.1002/cb.1957.
  54. 54. Mitra R, Hess PM. Who are the potential users of shared e-scooters? An examination of socio-demographic, attitudinal and environmental factors. Travel Behav Soc, 2021, 23: 100–107. https://doi.org/10.1016/j.tbs.2020.12.004.
  55. 55. Taleqani AR, Hough J. Risk Perception of Bicycle/Scooter Riders Risky Behaviors. 2020. Available online: https://www.ugpti.org/resources/reports/downloads/surtcom20-04.pdf (accessed on 26 Jan 2022).
  56. 56. Haworth N, Schramm A, Twisk D. Comparing the risky behaviors of shared and private e-scooter and bicycle riders in downtown Brisbane, Australia. Accident Anal Prev, 2021, 15, 105981. pmid:33549973
  57. 57. Brunner P, Löcken A, Denk F, Kates R, Huber W. Analysis of experimental data on dynamics and behavior of e-scooter riders and applications to the impact of automated driving functions on urban road safety. In 2020 IEEE Intelligent Vehicles Symposium (IV) (pp. 219–225). IEEE. https://doi.org/10.1109/IV47402.2020.9304835.
  58. 58. Rodon C, Ragot-Court I. Assessment of risky behaviors among E-bike users: A comparative study in Shanghai. Transp Res Interdiscip Perspectiv, 2019, 2: 100042. https://doi.org/10.1016/j.trip.2019.100042.
  59. 59. Bai L, Liu P, Guo Y, Yu H. Comparative analysis of risky behaviors of electric bicycles at signalized intersections. Traffic Inj Prev, 2015, 16(4): 424–428. pmid:25133656
  60. 60. Tuncer S, Laurier E, Brown B, Licoppe C. Notes on the practices and appearances of e-scooter users in public space. J Transp Geogr, 2020, 85: 102702. https://doi.org/10.1016/j.jtrangeo.2020.102702.
  61. 61. Brown A, Klein NJ, Thigpen C, Williams N. Impeding access: The frequency and characteristics of improper scooter, bike, and car parking. Transp Res Interdiscip Perspectiv, 2020, 4: 100099. https://doi.org/10.1016/j.trip.2020.100099.
  62. 62. Arellano JF, Fang K. Sunday drivers, or too fast and too furious? Transport Findings, 2019. https://doi.org/10.32866/001c.11210.
  63. 63. Siebert FW, Ringhand M, Englert F, Hoffknecht M, Edwards T, Rötting M. Braking bad–Ergonomic design and implications for the safe use of shared E-scooters. Saf Sci, 2021, 140: 105294. https://doi.org/10.1016/j.ssci.2021.105294.
  64. 64. Siebert FW, Hoffknecht M, Englert F, Edwards T, Useche SA, Rötting M. Safety Related Behaviors and Law Adherence of Shared E-Scooter Riders in Germany. HCI in Mobility, Transport, and Automotive Systems (HCII 2021). Lect Notes Comput Sci, 2021, 30: 12791. https://doi.org/10.1007/978-3-030-78358-7_31.
  65. 65. James O, Swiderski JI, Hicks J, Teoman D, Buehler R. Pedestrians and e-scooters: An initial look at e-scooter parking and perceptions by riders and non-riders. Sustainability, 2019, 11(20): 5591. https://doi.org/10.3390/su11205591.
  66. 66. Che M, Lum KM, Wong Y. D. Users’ attitudes on electric scooter riding speed on shared footpath: A virtual reality study. Int J Sustain Transp, 2020, 1–10. https://doi.org/10.1080/15568318.2020.1718252.
  67. 67. Maiti A, Vinayaga-Sureshkanth N, Jadliwala M, Wijewickrama R, Griffin GP. Impact of E-Scooters on Pedestrian Safety: A Field Study Using Pedestrian Crowd-Sensing. arXiv preprint arXiv:1908.05846. 2019. Available online: https://www.tdcommons.org/dpubs_series/2280 (accessed on 29 Jan 2022).
  68. 68. Kuo JY, Sayeed A, Tangirala NT, Han VCY, Dauwels J, Mayer MP. Pedestrians’ acceptance of personal mobility devices on the shared path: A structural equation modelling approach. In 2019 IEEE Intelligent Transportation Systems Conference (ITSC) (pp. 2349–2354). 2019. IEEE. https://doi.org/10.1109/ITSC.2019.8917167.
  69. 69. Löcken, A., Brunner, P., & Kates, R. Impact of Hand Signals on Safety: Two Controlled Studies With Novice E-Scooter Riders. In 12th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (pp. 132–140), 2020. https://doi.org/10.1145/3409120.3410641.
  70. 70. Currans KM, Iroz-Elardo N, Ewing R, Choi D, Siracuse B, Lyons T, et al. Scooting to a New Era in Active Transportation: Examining the Use and Safety of E-scooters. Research Report #NITC-RR-1281. Portland, OR: National Institute for Transportation and Communities (NITC), 2022. https://doi.org/10.15760/trec.272.
  71. 71. Derrick WTC. Perceptions and attitudes towards micro e-scooters in Singapore. 2020. Available online: https://open-education-repository.ucl.ac.uk/681/1/Wee%2C%20Derrick.pdf.
  72. 72. Llamazares J., Useche S. A., Montoro L., & Alonso F. Commuting accidents of Spanish professional drivers: when occupational risk exceeds the workplace. Int J Occup Saf Ergon, 2021, 27(3): 754–762. pmid:31132927
  73. 73. Useche SA, Peñarada-Ortega M., Gonzalez-Marin A, Llamazares F. Assessing the effect of drivers’ gender on their intention to use fully automated vehicles. Appl Sci, 2021. Appl Sci, 2022, 12, 103. https://doi.org/10.3390/app12010103.
  74. 74. Alonso F., Faus M., Esteban C., & Useche S. A. Is there a predisposition towards the use of new technologies within the traffic field of emerging countries? The case of the Dominican Republic. Electronics, 2021, 10(10): 1208. https://doi.org/10.3390/electronics10101208.
  75. 75. Useche SA, Hezaveh AM, Llamazares FJ, Cherry C. Not gendered… but different from each other? A structural equation model for explaining risky road behaviors of female and male pedestrians. Accid Anal Prev, 2021, 150: 105942. pmid:33338915
  76. 76. Soto J, Orozco-Fontalvo M, Useche SA. Public Transportation and Fear of Crime at BRT Systems: Approaching to the case of Barranquilla (Colombia) through Integrated Choice and Latent Variable models. Transp Res Part A Policy Pract, 2021, 155(10): 142–160. https://doi.org/10.1016/j.tra.2021.11.001.
  77. 77. Prada CG, García-Andrade XC. La fragmentada regulación de los vehículos de movilidad personal: un problema común en Perú y España. Revista de Derecho, 2019, 20(1): 161–201. Available online: https://revistas.udep.edu.pe/derecho/article/view/1836 (accessed on 28 Jan 2022).
  78. 78. Sikka N, Vila C, Stratton M, Ghassemi M, Pourmand A. Sharing the sidewalk: A case of E-scooter related pedestrian injury. Am J Emerg Med 2019, 37(9): 1807–e5. pmid:31201118
  79. 79. Ma Q, Yang H, Ma Y, Yang D, Hu X, Xie K. Examining municipal guidelines for users of shared E-Scooters in the United States. Transport Res D-Tr E, 2021, 92: 102710. https://doi.org/10.1016/j.trd.2021.102710.
  80. 80. Störmann P, Klug A, Nau C, Verboket RD, Leiblein M, Müller D, et al. Characteristics and injury patterns in electric-scooter related accidents—a prospective two-center report from Germany. J Clin Med, 2020, 9(5): 1569. pmid:32455862
  81. 81. Nielsen KI, Nielsen FE, Rasmussen SW. Injuries following accidents with electric scooters. Danish Med J, 2021, 68(2): A09200697–A09200697. Available online: https://ugeskriftet.dk/files/scientific_article_files/2021-01/a09200697_web.pdf (accessed on 30 Jan 2022). pmid:33543698
  82. 82. Bekhit MNZ, Le Fevre J, Bergin CJ. Regional healthcare costs and burden of injury associated with electric scooters. Injury, 2020, 51(2): 271–277. pmid:31668353
  83. 83. O’Hern S, Stephens AN, Young KL, Koppel S. Personality traits as predictors of cyclist behaviour. Accident Anal Prev, 2020, 145: 105704. pmid:32771694
  84. 84. Curl A, Fitt H. Same, but different? Cycling and e‐scootering in a rapidly changing urban transport landscape. New Zeal Geogr, 2020, 76(3): 194–206.
  85. 85. Scheaffer R. L., Mendenhall W. III, Ott R. L., & Gerow K. G. Elementary survey sampling. Cengage Learning, 2011.
  86. 86. Mahmood K. Do people overestimate their information literacy skills? A systematic review of empirical evidence on the Dunning-Kruger effect. Commun. Inf. Lit., 2016, 10(2): 3. https://doi.org/10.15760/comminfolit.2016.10.2.24.
  87. 87. Johnson T. P., & Wislar J. S. Response rates and nonresponse errors in surveys. Jama, 2012, 307(17): 1805–1806. pmid:22550194
  88. 88. Ahmad N., Boutron I., Dechartres A., Durieux P., & Ravaud P. Applicability and generalisability of the results of systematic reviews to public health practice and policy: a systematic review. Trials, 2010, 11(1): 1–9. pmid:20187938
  89. 89. Walker T. J., Tullar J. M., Diamond P. M., Kohl H. W., & Amick B. C. Validity and reliability of the 8-item work limitations questionnaire. J. Occup. Rehabil. 2017, 27(4): 576–583. pmid:28025750