Our study focuses on exploring (1) the intention of health professionals to use and recommend e-mental health applications, (2) how this intention of health professionals might be influenced, (3) which group of health professionals might be most accessible to promote e-mental health applications for maternal depression, and (4) for which tasks they rate them to be most useful.
Materials and methods
Based on a questionnaire informed by the theory of planned behavior, we collected 131 responses of U.S., Spanish, and Swiss health professionals in the field of pregnancy and maternal care (including psychologists, psychiatrists, midwives, and doctors) by means of an online survey. We analyzed the gathered data applying a structured equation model.
Our study reveals that health professionals would in general intend to recommend and use e-mental health applications. However, their attitude towards e-mental health applications varies regarding the respective use cases and also differs among health professions.
Citation: Sprenger M, Mettler T, Osma J (2017) Health professionals' perspective on the promotion of e-mental health apps in the context of maternal depression. PLoS ONE 12(7): e0180867. https://doi.org/10.1371/journal.pone.0180867
Editor: Gabriele Fischer, Medizinische Universitat Wien, AUSTRIA
Received: September 7, 2016; Accepted: June 22, 2017; Published: July 12, 2017
Copyright: © 2017 Sprenger et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the paper and its Supporting Information files.
Funding: This study was partially supported by the Universidad de Zaragoza, Gobierno de Aragón, Fondo Social Europeo, Fundación Bancaria Ibercaja, and Fundación CAI- (CH-21/16) and the Swiss National Science Foundation (grant no. IZK0Z1_171209). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Being pregnant and becoming a mother is for most women a life-changing experience. However, not all women can cope with the new situation as emotional changes might cause maternal depression. This kind of depression includes all depressive conditions that occur either during pregnancy or within the first twelve months following delivery . The percentage of women affected by maternal depression is significant: Depressions during pregnancy affect 38%  and 6 to 19.5%—depending on the country of reference—suffer from depressive conditions after giving birth [3, 4].
Women affected by maternal depression often feel hopeless or overstrained and might even not be able to cope with their role of being a mother . Analogous to other depressive conditions, maternal depression is associated with a diminishing quality of life and a decrease in social functioning that negatively impacts not only the woman herself, but also the development of the (unborn) child [6, 7]. Especially with regard to the latter, maternal depression can lead to long-term consequences resulting in sub-optimal cognitive, behavioral, and emotional development of children  and adolescents . Hence, the detection and treatment of maternal depression are important in order to prevent long-term consequences for women and their children. Despite this urgent necessity, one of the main problems is that maternal depression often remains unnoticed and consequently untreated as less than half of the cases are identified by health professionals in routine clinical practice [10, 11].
Possible reasons for this phenomenon have been identified, for example, the inadequate health professionals training about the problems related to maternal mental health, the low quality perception of the resources available, and the denial of depressive symptoms experienced by pregnant and postpartum women [12–14].
One of the proposed solutions to close the gaps mentioned above has been the use of e-mental health applications that provide mental health services via the Internet or related technologies  such as mental screening, psychological assessment, and treatment via ICT devices from anywhere, anytime, while usually saving time and money . In addition, e-mental health applications could be good resources among health professionals, especially in primary care services, in order to help them promote mental health services in their routine practice . In fact, practice models which allow a comprehensive incorporation of e-mental health resources into primary healthcare systems have recently been proposed .
In the field of maternal mental health, some relevant advantages of e-mental health applications for pregnant and postpartum women have been described. For example, since women can remain anonymous while using these applications they are more likely to share sensitive information regarding their mental health with reduced feelings of stigma [19, 20]. Moreover, an e-mental health application provides a low threshold to use which is especially true for mobile apps that allow for a non-intrusive utilization thanks to the ubiquity of smartphones in everyday life [21, 22]. As women can use the e-mental health application when it suits their time schedule, the flexibility is enhanced and the psychological consultation can be seen as a service on demand [19, 20]. From a societal perspective, e-mental health applications could not only increase the likelihood of detecting and treating maternal depression but also minimize costs as therapist contact time would be reduced and chances for a fast cure could be increased thanks to the early detection of the condition .
Due to these advantages, in recent years there has been a growing effort towards developing and testing e-mental health applications for maternal depression with positive outcomes [23–25] and high acceptability and feasibility ratings among users [20, 21, 26]. Despite all these advantages, yet their adoption and use is marginal. While existing studies dealing with user acceptance and use intention commonly focus on women as end-users, a possible explanation for low adoption rates could be related, first, to a limited number of evidence-based e-mental health applications available so far , and second, to the role and attitude of health professionals, among others.
Our interest is focused on the role and attitude of health professionals as the adoption of e-mental health applications across the entire general mental healthcare process could be positively influenced by them [27–29]. This mental healthcare process includes the general steps that are at the heart of the science of psychology and applicable to a wide variety of mental health issues . Fig 1 gives an illustrative overview: The first step of the general mental healthcare process is screening. Screening refers to an initial patient evaluation including medical and psychiatric history, mental status, as well as the patient’s suitability for a particular treatment modality . If the screening outcomes show no risk tendencies, people can benefit from a positive psychology intervention in order to increase their psychological resources to cope with daily stress [32–34]. If the screening indicates the patient to be at risk of a psychological condition, he will be thoroughly assessed as well as diagnosed and—depending on the identified level of risk—transferred to a prevention [35, 36] or treatment program . It is recommended to conduct a follow-up assessment over time in order to verify that the prevention and treatment programs have the envisioned long-term results .
Several studies have shown that the successful implementation of digitized services within healthcare not only requires the integration of work practices and processes [39, 40], timely as well as role-specific exchange of information and education [41, 42], but also in most cases effective personal interaction between the different actors involved [43, 44]. For instance, according to the Consolidated Framework for Implementation Research (CFIR)  the consideration of the inner and outer setting as well as the needs and requirements of affected individuals are important antecedents for a successful implementation of new (digitized) processes and interventions. In this sense, the integration of diverse perspectives prior to deciding about the implementation of new digitized services is crucial and helps to identify potential obstacles and opportunities from introducing new technological solutions in an early stage of the process . While there has been a strong emphasis in identifying these obstacles and opportunities in clinical medicine, only sparse knowledge exists about the expectations, actual needs, and attitudes of health professionals, who work in the area of clinical and health psychology . Since the recommendation and guidance by trustworthy coaches, such as therapists, have a positive influence on the usage of e-mental health applications [27, 48, 49], the perspective of healthcare providers has to be considered when studying the potential use of e-mental health applications in the context of maternal depression . For this reason, the aim of this study is to figure out if health professionals working with pregnant and postpartum women would act as promoters for e-mental health applications to prevent maternal depression .
Materials and methods
Our study concentrates on analyzing the behavioral intention of health professionals towards using and recommending e-mental health applications for maternal depression. To investigate behavioral intentions of health professionals, we base our work on the theory of planned behavior (TPB) . TPB uses three constructs: attitude, subjective norms, and perceived behavioral control, which we will contextualize for this study and explain next (Fig 2).
The attitude reflects in our case the degree to which a health professional has a favorable or unfavorable appraisal regarding the use and recommendation of e-mental health applications in the context of maternal depression . According to the theory of planned behavior, the constructs “attitude” and “behavioral intention” correlate positively with each other. Hence, we derive:
Hypothesis 1: Positive attitudes increase the behavioral intention to use and recommend e-mental health applications in the context of maternal depression.
Subjective norms refer to the health professionals’ believes about what their colleagues or other important people in their lives might recommend them to do : Would they suggest them to use and recommend e-mental health applications for maternal depression? Based on the theory of planned behavior, a positive correlation between the construct “subjective norms” and “behavioral intention” is to be expected. Thus, we suggest:
Hypothesis 2: Subjective norms that favor using and recommending e-mental health applications in the context of maternal depression will have a positive effect on the corresponding health professional’s behavioral intention.
In our case, perceived behavioral control reflects to which extent health professionals think that it is easy or difficult to use and recommend e-mental health applications for maternal depression . In line with the theory of planned behavior, a positive correlation between the constructs “perceived behavioral control” and “behavioral intention” can be anticipated. Therefore, we propose:
Hypothesis 3: Higher levels of perceived behavioral control will have a positive effect on the behavioral intention to use and recommend e-mental health applications in the context of maternal depression.
With regard to the operationalization of constructs we strived for reuse and adaptation of existing measurement items in the literature. As a plethora of studies already applied the theory of planned behavior , we searched the literature to identify reusable items that already measured the constructs attitude, subjective norms, perceived behavioral control, and behavioral intention. Based on , we adjusted the identified measurement items to our research interest by adapting them to the context of e-mental health applications for maternal depression. For example,  applied the item “Using telemedicine technology would be entirely within my control” as one operationalization for the construct “perceived behavioral control” in their telemedicine study. We transferred this operationalization in our study to “Recommending and using e-mental health applications in the context of maternal depression would be totally in my control”. Analogously, we developed the items for all constructs by reusing and adapting measurement items of other TPB studies presented in literature. In line with [55–57], we developed three items per construct that will be discussed later.
Research method and data analysis
To test our hypotheses and to identify the health professionals’ behavioral intention, we conducted a survey that was based on an online questionnaire. The participants of the survey were asked to indicate their level of agreement with the statements used as measurement items for our constructs on a Likert scale from 1 (strongly disagree) to 5 (strongly agree).
As our research interest was not only to determine the behavioral intention and the influencing factors, but also to identify the steps in the general mental healthcare process where an e-mental health application would be most useful, we included a corresponding question in our survey. Moreover, we asked additional questions regarding profession, the role of technology in the work setting, as well as the expertise in the field of maternal depression. These questions were intended to identify differences among groups (cf. S1 File for an overview of the survey questions).
The link to the online survey was distributed in Europe and the United States of America via email and online platforms targeting health professionals in the field of pregnancy related work. Overall, we received 131 answers which were all complete as the online tool required the participants to answer each question before they could proceed to the next one and only saved the answers after asking permission for it at the very end of the survey. On average, the health professionals were 46 years old and practicing their job for 19 years. The participants were mostly midwives and nurses involved in maternal care (79), psychologists and psychiatrists (27), as well as doctors (12), whereas the remaining answers came from other health professions (e.g. health professionals at research institutes). We deem this distribution to be suitable as most pregnant women and new mothers spend a lot of time with midwifes and nurses (at the doctor’s office during pregnancy, in the hospital during childbirth, and at home during house calls after giving birth). Psychologists and psychiatrists are an important group as they deal with all kinds of mental health issues, including depressions. The opinions of doctors involved in the maternal process are also important as they regularly consult with their female patients during pregnancy and after giving birth. To ensure that our results are not biased, we used tests that accounted for the unequal distribution of professions among the survey participants when performing statistical analyses regarding differences among professions.
For data analysis, we transferred our research model into a structural equation model with reflective measurements to test it with the help of a partial least squares (PLS) approach. Here, we applied the SmartPLS2.0.M3 software package . Following , this approach has advantages over linear regression models as it allows the simultaneous analysis of the relationship between latent variables (i.e. our constructs) and their respective indicators (i.e. our measurement items). Moreover, in contrast to covariance-based structural equation models (CBSEM), PLS focuses rather on the predictive power of the model than on its accuracy . In our case, this is suitable as we apply a model that already proved to be accurate in various studies .
The structural equation model requires, in general, a smaller sample size compared to other approaches like CBSEM . In  an example of a research model is presented where the maximum number of independent variables in the measurement and structural model is five: Here, a sample size of 70 would be needed to reach a statistical power of 80% with rather small effect sizes (i.e. 0.25) at a significance level of 5%. For our research model (with a maximum number of three independent variables in the measurement and structural model) this approach suggests a sample size between 30 and 124 –depending on the effect sizes—with a significance level of 5%. The fact that our sample size is sufficient is corroborated by the quality criteria and the significant levels of our results, which we will elaborate on in the following. The significances of all estimates were verified by two-tailored t-test, whereas we applied the bootstrapping function within SmartPLS with 500 resamples as suggested by .
The results of the PLS approach are evaluated according to standardized reporting requirements .
For the measurement model these requirements include (i) internal consistency, (ii) indicator reliability, (iii) convergent validity, and (iv) discriminant validity :
Internal consistency is often measured with Cronbach’s alpha (CA) which represents the inter-correlation of the measurement items. CA is based on the assumption that a construct’s measurement items have equal loadings. As this assumption is not always met, it is advisable to additionally calculate the composite reliability (CR) which accounts for differences between the measurement item’s loadings. For both CA and CR, values should be above 0.7, whereas our results meet these quality criteria (Table 1).
Indicator reliability reflects how much of an item’s variation is explained by its construct. This quality criterion is met when the loadings of the measurement items (λ) are above 0.7. This is true for all but one of our measurement items at a significance level of α<0.01 (cf. Table 2). The deletion of a measurement item that does not meet the required value of 0.7 is usually recommended, if the CA and CR values of the respective construct do not meet the quality criteria and could be improved by excluding the measurement item. In our case, the CA and CR values for the construct “behavioral intention” are already meeting the quality criteria. Hence, the measurement item “behavioral intention_2” will be included in the model even though its loading has only a value of 0.6.
In addition to indicator reliability, the average variance extracted (AVE) is analyzed to see if convergent validity is given. Whereas the indicator reliability reflects the communality of an item, the AVE can be referred to as the communality of a construct. The AVE is determined by calculating the mean value of the construct’s squared item loadings and should be above 0.5. In our case, this condition is met for all our constructs (Table 1).
Discriminant validity deals with the question how much the constructs differ from each other. This can be evaluated by the Fornell-Larcker criterion that requires the construct’s square root of the AVE to be greater than its correlations with the other constructs. As this is true for all our constructs, our measurement model meets the discriminant validity criterion.
For data analysis regarding differences among professions we used the statistical software IBM SPSS Statistics 21 . As we tested for the differences among three groups (i.e. midwifes and nurses involved in maternal care (n = 79), psychologists and psychiatrists (n = 27), as well as doctors (n = 12)), we applied a one-way ANOVA to check if there are significant differences among professions and a post-hoc Bonferroni test to detect among which groups these differences are present.
Health professionals’ behavioral intention
The significance and variance of path estimates regarding the health professionals’ behavioral intention to use and recommend e-mental health apps is explained by the structural model , which we will present next. As expected by the hypotheses, all path coefficients are positive. However, only the constructs “attitude” and “perceived behavioral control” are highly significant (Fig 3). The high value of R2 (0.738) shows that the model is able to explain a high level of variance regarding the construct “behavioral intention”. Additionally, we calculated the Stone-Geisser value Q2 which, in case Q2>0, indicates that the model has predictive power . In our case the Q2 value is 0.4988, meaning the behavioral intention to use and recommend e-mental health applications in the context of maternal depression can be predicted by the exogenous constructs (i.e. attitude, subjective norms, and perceived behavioral control).
After the measurement model and the structural model are evaluated, the results can be analyzed from a content perspective. Looking at the mean values of the independent latent variables’ measurement items (Table 2) our results reveal that health professionals have a positive attitude towards e-mental health applications in the context of maternal depression (all measurement items’ mean values of “attitude” >3) and that they perceive their corresponding behavioral control to be rather high (all measurement items’ mean values of “perceived behavioral control” >3). As the values for the construct “subjective norms” are below average (all measurement items’ mean values of “subjective norms” <3), the influence of the health professionals’ environment to use and recommend e-mental health applications in the context of maternal depression is rather low. With regard to our hypotheses, our research results corroborate that the behavioral intention to use and recommend e-mental health applications for maternal depression depends on the attitude towards these applications (hypothesis 1) and the perceived behavioral control to use and recommend them (hypothesis 3): The more favorable the attitude and the higher the perceived behavioral control, the higher the behavioral intention to use and recommend e-mental health applications for maternal depression. Considering the high mean values of the measurement items for the constructs “attitude” and “perceived behavioral control” as well as the significant, positive influence of these two constructs on the behavioral intention, it is no surprise that the mean values of the dependent latent variable are rather high (two of the three measurement items’ mean values of “behavioral intention” >3). Hence, health professionals seem to be willing to inform pregnant women and new mothers about the utility of these e-mental health applications. They would also use and recommend them, but not whenever possible (mean value of “behavioral intention_2” <3).
As health professionals would not use and recommend e-mental health applications in the context of maternal depression whenever possible, we will further analyze the perceived usefulness of such an application for the different steps of the aforementioned general mental healthcare process. The idea is to identify those process steps for which it would be most beneficial to support them with e-mental health applications. Moreover, we will analyze if there are differences among different health professions in order to detect the group of health professionals that would be most accessible regarding e-mental health applications for maternal depression.
Utility of e-mental health applications depending on mental healthcare process steps and health professions
To determine for which steps of the general mental healthcare process e-mental health applications could be most useful, the mean values per process step can be consulted (1: not at all useful, 5: extremely useful). As all mean values are >3 (Table 3), health professionals seem to see the value of such applications for each process step. With regard to the process steps “screening” and “prevention program”, e-mental health applications are judged to be especially useful. As our research interest is also in detecting potential differences among health professions, the mean values of the three different groups, i.e. doctors, midwifes / nurses, and psychologists / psychiatrists, have to be compared. In order to evaluate if the values are significantly different from each other, a one-way ANOVA has to be calculated followed by a Bonferroni post-hoc test that indicates between which groups these significant differences are present.
Our results show that there are significant differences among professions regarding the following general mental healthcare process steps: positive psychology intervention, assessment and diagnosis, prevention program, and treatment program (Table 3). The statistical test reveals that these significant differences exist between psychologists / psychiatrists and the other groups (i.e. doctors and midwifes / nurses). Although psychologists / psychiatrists see the usefulness of e-mental health applications in the context of maternal depression for most steps in the general mental healthcare process, they are rather skeptical when it comes to the assessment and diagnosis as well as the treatment of the maternal depression (mean values are <3).
As extant literature concerning adoption barriers of e-mental health identified the lack of technology usage and the fear of being replaced by technology as one of the main reasons why psychologists / psychiatrists are skeptical concerning e-mental health applications [66, 67], we analyzed the responses to the survey questions regarding the use of technology in daily work and the expertise in the field of maternal depression. Here, we hoped to find possible answers, even though there might be other reasons why psychologists / psychiatrists are more hesitant to use and recommend e-mental health applications for maternal depression (which we will further elaborate on in the Discussion section).
The role of technology in the work setting was analyzed with the help of three questions (Table 4; upper part), whereas the survey included a definition and an example for clarification. The results show that technology is beneficial for all health professions (all values are >3). However, the comparison between groups reveals differences between the group of psychologists / psychiatrists and the two other groups, whereas the values of psychologists / psychiatrists are significantly lower. Hence, psychologists / psychiatrists do not use technology for their work as often as other health professionals do and they do not judge technology to be that useful or beneficial for their work compared to doctors and midwifes / nurses.
Concerning the threat of being replaced by technology, we analyzed if psychologists / psychiatrists have a significantly higher level of knowledge regarding maternal depression as this would reflect their expertise in the field and indicate a potential rivalry between their job and the e-mental health applications. Per definition, the diagnosis and treatment of mental health conditions is at the heart of their job. This would also explain why they find e-mental health applications most useful for screening (first process step) and follow-up (last process step), whereas they judge the applications to be less useful for the core steps of the general mental healthcare process. The results confirm that psychologists / psychiatrists have a significantly higher level of knowledge concerning maternal depression (Table 4; lower part).
Overall, our study has important implications for research and practice. From an academic perspective, we conducted—to our knowledge—the first survey that concentrated on the different groups of health professionals involved in maternal treatment and care (doctors, midwifes, nurses, psychologists, psychiatrists) and on their perspective towards e-mental health applications in the context of maternal depression. By applying the theory of planned behavior, our study provides insights on the behavioral intention of health professionals and on the underlying factors. Moreover, we evaluated the perceived usefulness of the application per mental healthcare process step and per health profession. Thereby, our study goes one level deeper by not only focusing on behavioral intention overall, but by also giving insights on which process step(s) e-mental health applications are judged to be of most value for and which groups of health professionals are most accessible for promoting these applications. In view of the usefulness of e-mental health applications per process step and health professional group, the above presented results show that there are differences between distinct professional groups. Overall, psychologists and psychiatrists attribute a lower level of usefulness to each process step compared to the other surveyed health professionals. Still, they judge e-mental health applications for maternal depression as useful for screening, prevention program, follow-up, and positive psychology intervention. In contrast to the other health professions, they do not value e-mental health applications for the treatment or assessment and diagnosis of maternal depression. When it comes to the question how e-mental health applications could be promoted, we would like to offer three propositions (Fig 4), which we describe next.
Focusing on specific use cases
When focusing on specific use cases, our results would suggest an application that supports screening, prevention program, follow-up, and positive psychology intervention as all health professions see here the most value. Since the attitude has the highest impact on the behavioral intention to use and recommend the e-mental health application, a provider of such an application (i.e. a private or public organization, association, or any other entity whose purpose is service to the community) would have to clearly define the value propositions for all use cases in order to convince the health professionals of the application’s value. Often, the value of e-mental health is presented in such a way that it addresses only patients (e.g. e-mental health as a way to improve the convenience and accessibility) or health systems (e.g. e-mental health as means of cost reduction for the overall health system) . To ensure that health professionals promote an e-mental health application for maternal depression, the value proposition has also to exhibit the benefits for them. For example, in the case of “screening”, a provider of an e-mental health application for maternal depression could highlight the application’s utility for a first assessment which ensures that women that are at risk of maternal depression are motivated to contact a health professional. For women with no risk, the application would rather create awareness for the topic of maternal depression itself. Thereby the health professionals’ efficiency might be increased, as the application helps them to focus rather on women that are really at risk.
When opting for addressing only specific use cases, the provider of an e-mental health application would also need to define the interfaces between the application-supported process steps and the ones that are not supported by the application. For example, if the application would support screening but not the assessment and diagnosis step, the application could recommend the women to go to a health professional for a thorough assessment in case the screening would indicate a certain risk for maternal depression.
Even though focusing on specific use cases is a valid approach, the downside is that the non-supported process steps are left out although the application might also be beneficial for them. Extant studies revealed the (potential) value of e-mental health applications for the treatment as well as the assessment and diagnosis both in the context of other mental health conditions [68–71] and related to maternal depression .
Focusing on specific health professionals
In order to leverage the potential benefits for the entire mental healthcare process, another option would be to address all process steps with the application, but to focus only on doctors as well as midwifes and nurses to promote the adoption of an e-mental health application. Since more pregnant women and new mothers are rather in contact with a doctor or a midwife / nurse than with a psychologist / psychiatrist, focusing on the former health professions might be a suitable option. Moreover, psychologists / psychiatrists have probably more patients with severe depression where they might not see technology support as an option at all . Similar to focusing on specific use cases, an application provider would need to define a compelling value proposition for doctors as well as midwifes and nurses. As these health professionals might be rather confronted with not yet diagnosed or mild depression cases, the application could aim at supporting them here.
The disadvantage of only concentrating on specific health professions other than psychologists and psychiatrists is that the potential value of an e-mental health application for rather severe depression candidates is not leveraged. Even though these cases might need more face to face therapy time, an e-mental health application could still be useful to complement the conventional therapeutic service .
Winning psychologists and psychiatrists for all use cases
The third option would be to target all health professionals for all use cases with the e-mental health application. However, a prerequisite would be to understand first, why psychologists / psychiatrists do not perceive an e-mental health application to be useful for the treatment or assessment and diagnosis of maternal depression. Extant literature as well as our results suggest that technology in general is not seen as important in the daily work for psychologists / psychiatrists as for other health professions. Demonstrating the advantages for the psychologists and psychiatrists of an e-mental health application is therefore crucial. For example, an e-mental health application could be used for a first assessment and diagnosis, especially for those women who would refrain from seeking help by a health professional. In case the application would identify a woman to have a high risk of depression, the application might encourage her to go see a psychologist or psychiatrist . Thereby, the application would give health professionals access to new clients and thereby to an additional source of revenue. By stressing the advantages for the health professionals, psychologists and psychiatrists might be less inclined to see e-mental health applications as a form of competition, which was suggested by extant research as well as our results to be another potential reason for their rather skeptical attitude. To get their support, an e-mental health application for maternal depression would have to be positioned as a beneficial, complementary service and not as a substitute to psychological consultations. By clarifying this, the attitude as well as the perceived behavioral control of psychologists / psychiatrists towards an e-mental health application could be enhanced which would have a positive effect on their behavioral intention to use and recommend these applications and become valuable promoters.
Conclusion and limitations
The insights presented in this paper are relevant from a practical point of view. Service providers aiming at developing an e-mental health application for maternal depression can use the results of our paper to inform the design of their service (e.g. which steps of the general mental healthcare process should be covered by the application) as well as the corresponding go-to-market approach (e.g. which group of health professionals would support the application; how could other groups be convinced of its value).
Still, our study is not without limitations. Our investigation has focused primarily on analyzing the expectations, actual needs, and attitudes of health professionals. In this sense, our results portray the “soft” or human side, concentrating only on one of the five major elements of implementation research. Hence, future research could—as suggested by the CFIR –extend our work by exploring additional nuances regarding the intervention, inner and outer setting, and implementation process itself.
Furthermore, although we tried to cover all groups of health professionals that are relevant in our research setting, we cannot judge the representativeness of our sample. As this is especially true concerning the number of participants per group, we opted for statistical tests that accounted for the different group sizes when analyzing differences among health professions. Another important limitation is that we have no guarantee that a positive behavioral intention will lead to a successful introduction and adoption of an e-mental health application for maternal depression. Besides the technical feasibility and the positive evaluation of relevant stakeholders, such an e-mental health application has to be economically viable in order to survive in the long run . Future research in this area could shed some light on suitable business models, especially regarding the identification of adequate revenue mechanisms as well as the stakeholders that would be willing to pay them.
S1 File. Questionnaire used for data collection in this study.
- 1. Gaynes BN, Gavin N, Meltzer-Brody S, Lohr KN, Swinson T, Gartlehner G, et al. Perinatal depression: Prevalence, screening accuracy, and screening outcomes. Rockville, MD: Agency for Healthcare Research and Quality; 2005 2005-02-01.
- 2. Field T. Prenatal depression effects on early development: A review. Infant Behavior and Development. 2011;34(1):1–14. pmid:20970195
- 3. Grote V, Vik T, von Kries R, Luque V, Socha J, Verduci E, et al. Maternal postnatal depression and child growth: A european cohort study. BMC Pediatrics. 2010;10(14).
- 4. Shakeel N, Eberhard-Gran M, Sletner L, Slinning K, Martinsen EW, Holme I, et al. A prospective cohort study of depression in pregnancy, prevalence and risk factors in a multi-ethnic population. BMC Pregnancy and Childbirth. 2015;15(5):1–11.
- 5. Seeley S, Murray L, Cooper PJ. The outcome for mothers and babies of health visitor intervention. Health Visitor. 1996;69(4):135–8.
- 6. O'Hara MW, Wisner KL. Perinatal mental illness: Definition, description and aetiology. Best Practice & Research Clinical Obstetrics & Gynaecology. 2014;28(1):3–12.
- 7. Sockol LE. A systematic review of the efficacy of cognitive behavioral therapy for treating and preventing perinatal depression. Journal of Affective Disorders. 2015;177:7–21. pmid:25743368
- 8. Petrou S, Cooper P, Murray L, Davidson LL. Economic costs of post-natal depression in a high-risk british cohort. The British Journal of Psychiatry. 2002;181(6):505–12.
- 9. Korhonen M, Luoma I, Salmelin R, Tamminen T. A longitudinal study of maternal prenatal, postnatal and concurrent depressive symptoms and adolescent well-being. Journal of Affective Disorders. 2012;136(3):680–92. pmid:22036793
- 10. Hewitt CE, Gilbody SM. Is it clinically and cost effective to screen for postnatal depression: A systematic review of controlled clinical trials and economic evidence. BJOG: An International Journal of Obstetrics & Gynaecology. 2009;116(8):1019–27.
- 11. Santoro K, Peabody H. Identifying and treating maternal depression: Strategies and considerations for health plans. Washington, DC: National Institute for Health Care Management, 2010.
- 12. Chew-Graham CA, Sharp D, Chamberlain E, Folkes L, Turner KM. Disclosure of symptoms of postnatal depression, the perspectives of health professionals and women: A qualitative study. BMC Family Practice. 2009;10(1):7.
- 13. Byatt N, Biebel K, Lundquist RS, Moore Simas TA, Debordes-Jackson G, Allison J, et al. Patient, provider, and system-level barriers and facilitators to addressing perinatal depression. Journal of Reproductive and Infant Psychology. 2012;30(5):436–49.
- 14. Heneghan AM, Morton S, DeLeone NL. Paediatricians’ attitudes about discussing maternal depression during a paediatric primary care visit. Child: Care, Health and Development. 2007;33(3):333–9.
- 15. Christensen H, Griffiths KM, Evans K. E-mental health in australia: Implications of the internet and related technologies for policy. Canberra: Commonwealth Department of Health and Ageing; 2002.
- 16. Peñate W. About the effectiveness of telehealth procedures in psychological treatments. International Journal of Clinical and Health Psychology. 2012;12(3):475–87.
- 17. Ageing AGDoHa. E-mental health strategy for australia 2012 [http://www.health.gov.au/internet/main/publishing.nsf/Content/7C7B0BFEB985D0EBCA257BF0001BB0A6/$File/emstrat.pdf].
- 18. Reynolds J, Griffiths KM, Cunningham JA, Bennett K, Bennett A. Clinical practice models for the use of e-mental health resources in primary health care by health professionals and peer workers: A conceptual framework. JMIR Mental Health. 2015;2(1):e6. pmid:26543912
- 19. O'Mahen HA, Woodford J, McGinley J, Warren FC, Richards DA, Lynch TR, et al. Internet-based behavioral activation—treatment for postnatal depression (netmums): A randomized controlled trial. Journal of Affective Disorders. 2013;150(3):814–22. pmid:23602514
- 20. Danaher BG, Milgrom J, Seeley JR, Stuart S, Schembri C, Tyler MS, et al. Web-based intervention for postpartum depression: Formative research and design of the mommoodbooster program. JMIR Research Protocols. 2012;1(2):e18. pmid:23612274
- 21. Haga SM, Drozd F, Brendryen H, Slinning K. Mamma mia: A feasibility study of a web-based intervention to reduce the risk of postpartum depression and enhance subjective well-being. JMIR Research Protocols. 2013;2(2):e29. pmid:23939459
- 22. Osma J, Plaza I, Crespo E, Medrano C, Serrano R. Proposal of use of smartphones to evaluate and diagnose depression and anxiety symptoms during pregnancy and after birth. IEEE-EMBS International Conference on Biomedical and Health Informatics (BHI); Valencia: IEEE; 2014. p. 547–50.
- 23. O'Mahen HA, Woodford J, McGinley J, Warren FC, Richards DA, Lynch TR, et al. Internet-based behavioral activation—treatment for postnatal depression (netmums): A randomized controlled trial. Journal of Affective Disorders 2013;150(3):814–22. pmid:23602514
- 24. Barrera AZ, Wickham R, Muñoz RF. Online prevention of postpartum depression for spanish- and english-speaking pregnant women: A pilot randomized controlled trial. Internet Interventions. 2015;2(3):257–65. pmid:26273567
- 25. Maloni JA, Przeworski A, Damato EG. Web recruitment and internet use and preferences reported by women with postpartum depression after pregnancy complications. Archives of Psychiatric Nursing. 2013;27(2):90–5. pmid:23540519
- 26. Osma J, Barrera AZ, Ramphos E. Are pregnant and postpartum women interested in health-related apps? Implications for the prevention of perinatal depression. Cyberpsychology, Behavior, and Social Networking. 2016;19(6):412–5.
- 27. Mohr DC, Cuijpers P, Lehman K. Supportive accountability: A model for providing human support to enhance adherence to ehealth interventions. Journal of Medical Internet Research. 2011;13(1):e30. pmid:21393123
- 28. Vis C, Kleiboer A, Prior R, Bønes E, Cavallo M, Clark SA, et al. Implementing and up-scaling evidence-based emental health in europe: The study protocol for the mastermind project. Internet Interventions. 2015;2(4):399–409.
- 29. Wykes T, Brown M. Over promised, over-sold and underperforming?–e-health in mental health. Journal of Mental Health. 2016;25(1):1–4. pmid:26732733
- 30. American Psychological Association. Clinical psychology solves complex human problems 2016 [http://www.apa.org/action/science/clinical/index.aspx].
- 31. Farlex Partner Medical Dictionary. Screening 2012 [http://medical-dictionary.thefreedictionary.com/screening].
- 32. Tugade MM, Fredrickson BL, Feldman Barrett L. Psychological resilience and positive emotional granularity: Examining the benefits of positive emotions on coping and health. Journal of Personality. 2004;72(6):1161–90. pmid:15509280
- 33. Seligman MEP, Csikszentmihalyi M. Positive psychology: An introduction. American Psychologist. 2000;55(1):5–14. pmid:11392865
- 34. Seligman MEP, Steen TA, Park N, Peterson C. Positive psychology progress: Empirical validation of interventions. American Psychologist. 2005;60(5):410–21. pmid:16045394
- 35. Austin MP. Antenatal screening and early intervention for "perinatal" distress, depression and anxiety: Where to from here? Archives of Women’s Mental Health. 2004;7(1):1–6. pmid:14963727
- 36. Muñoz RF, Beardslee WR, Leykin Y. Major depression can be prevented. American Psychologist. 2012;67(4):285–95. pmid:22583342
- 37. Barlow DH, Bullis JR, Comer JS, Ametaj AA. Evidence-based psychological treatments: An update and a way forward. Annual Review of Clinical Psychology. 2013;9:1–27. pmid:23245338
- 38. Flay BR, Biglan A, Boruch RF, Castro FG, Gottfredson D, Kellam S, et al. Standards of evidence: Criteria for efficacy, effectiveness and dissemination. Prevention Science. 2005;6(3):151–75. pmid:16365954
- 39. Murray E, Burns J, May C, Finch T, O'Donnell C, Wallace P, et al. Why is it difficult to implement e-health initiatives? A qualitative study. Implement Science. 2011;6(6).
- 40. Staemmler M. Service delivery for e-health applications. Studies in Health Technology Informatics. 2011;169:537–41. pmid:21893807
- 41. Bygholm A, Günther J, Bertelsen P, Nøhr C. Ehealth education of professionals in the baltic sea area. Studies in Health Technology and Informatics. 2012;180:934–8. pmid:22874330
- 42. Mair FS, May C, O'Donnell C, Finch T, Sullivan F, Murray E. Factors that promote or inhibit the implementation of e-health systems: An explanatory systematic review. Bulletin of the World Health Organization. 2012;90(5):357–64. pmid:22589569
- 43. Ragaban N, Day K, Orr M. Align, share responsibility and collaborate: Potential considerations to aid in e-health policy development. In: Maeder AJ, Martin-Sanchez FJ, editors. Health informatics: Building a healthcare future through trusted information. Amsterdam: IOS Press; 2012. p. 186–91.
- 44. Berg M, Aarts J, van der Lei J. Ict in health care: Sociotechnical approaches. Methods Archive. 2003;42(4):297–301.
- 45. Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: A consolidated framework for advancing implementation science. Implementation Science. 2009;4(1):50.
- 46. Mettler T, Vimarlund V. The need of a multi-actor perspective to understand expectations from virtual presence: Managing elderly homecare informatics. Informatics for Health and Social Care. 2011;36(4):220–32. pmid:21375391
- 47. Meurk C, Leung J, Hall W, Head BW, Whiteford H. Establishing and governing e-mental health care in australia: A systematic review of challenges and a call for policy-focussed research. Journal of Medical Internet Research. 2016;18(1):e10. pmid:26764181
- 48. Cuijpers P, Donker T, van Straten A, Li J, Andersson G. Is guided self-help as effective as face-to-face psychotherapy for depression and anxiety disorders? A systematic review and meta-analysis of comparative outcome studies. Psychological Medicine. 2010;40(12):1943–57. pmid:20406528
- 49. Vernmark K, Lenndin J, Bjäreheda J, Carlsson M, Karlsson J, Öberg J, et al. Internet administered guided self-help versus individualized e-mail therapy: A randomized trial of two versions of cbt for major depression. Behaviour Research and Therapy. 2010;48(5):368–76. pmid:20152960
- 50. Ajzen I. From intentions to actions: A theory of planned behavior. In: Kuhl J, Beckmann J, editors. Action control. Berlin Heidelberg: Springer; 1985. p. 11–39.
- 51. Ajzen I. The theory of planned behavior. Organizational Behavior and Human Decision Processes. 1991;50(2):179–211.
- 52. Conner M, Norman P. Predicting health behavior. In: Conner M, Norman P, editors. Predicting health behavior: Research and practice with social cognition models. Berkshire: McGraw-Hill Education; 2005. p. 1–27.
- 53. Hagger MS. Retired or not, the theory of planned behaviour will always be with us. Health Psychology Review. 2015;9(2):125–30. pmid:25966053
- 54. Ajzen I, Fishbein M. Understanding attitudes and predicting social behavior. Englewood Cliffs: Prentice-Hall; 1980.
- 55. Chau PYK, Hu PJ-H. Investigating healthcare professionals' decisions to accept telemedicine technology: An empirical test of competing theories. Information & Management. 2002;39(4):297–311.
- 56. Fleming ML, Barner JC, Brown CM, Shepherd MD, Strassels S, Novak S. Using the theory of planned behavior to examine pharmacists' intention to utilize a prescription drug monitoring program database. Research in Social and Administrative Pharmacy. 2014;10(2):285–96. pmid:23816495
- 57. Venkatesh V, Brown S, Hoehle H. Understanding technology adoption in the household context: A comparison of seven theoretical models. European Conference on Information Systems (ECIS); Barcelona 2012.
- 58. SmartPLS GmbH. Smartpls 2.0 2016 [https://www.smartpls.com/smartpls2].
- 59. Gefen D, Rigdon EE, Straub D. An update and extension to sem guidelines for administrative and social science research. MIS Quarterly. 2011;35(2):iii–xiv.
- 60. Chin WW. How to write up and report pls analyses. In: Vinzi VE, Chin WW, Henseler J, Wang H, editors. Handbook of partial least squares concepts, methods and applications. Berlin, Heidelberg: Springer; 2010. p. 655–90.
- 61. Godin G, Bélanger-Gravel A, Eccles M, Grimshaw J. Healthcare professionals' intentions and behaviours: A systematic review of studies based on social cognitive theories. Implementation Science. 2008;3(36):1–12.
- 62. Chin WW, Marcolin BL, Newsted PR. A partial least squares latent variable modeling approach for measuring interaction effects: Results from a monte carlo simulation study and an electronic-mail emotion/adoption study. Information Systems Research. 2003;14(2):189–217.
- 63. Hair JF Jr, Hult GTM, Ringle CM, Sarstedt M. A primer on partial least squares structural equation modeling (pls-sem). Los Angeles, CA: Sage; 2014.
- 64. Bollen KA, Stine RA. Bootstrapping goodness-of-fit measures in structural equation models. Sociological Methods & Research. 1992;21(2):205–29.
- 65. IBM. Ibm spss statistics 2016 [http://www-01.ibm.com/software/analytics/spss/products/statistics/].
- 66. Lal S, Adair CE. E-mental health: A rapid review of the literature. Psychiatric Services. 2014;65(1):24–32. pmid:24081188
- 67. Emmelkamp PMG. Technological innovations in clinical assessment and psychotherapy. Psychotherapy and Psychosomatics. 2005;74(6):336–43. pmid:16244509
- 68. Proudfoot J, Ryden C, Everitt B, Shapiro DA, Goldberg D, Mann A, et al. Clinical efficacy of computerised cognitive-behavioural therapy for anxiety and depression in primary care: Randomised controlled trial. The British Journal of Psychiatry. 2004;185(1):46–54.
- 69. Carlbring P, Nilsson-Ihrfelt E, Waara J, Kollenstam C, Buhrman M, Kaldo V, et al. Treatment of panic disorder: Live therapy vs. Self-help via the internet. Behaviour Research and Therapy. 2005;43(10):1321–33. pmid:16086983
- 70. Grime PR. Computerized cognitive behavioural therapy at work: A randomized controlled trial in employees with recent stress-related absenteeism. Occupational Medicine. 2004;54(5):353–9. pmid:15289593
- 71. Warmerdam L, Riper H, Klein M, van den Ven P, Rocha A, Ricardo Henriques M, et al. Innovative ict solutions to improve treatment outcomes for depression: The ict4depression project. Studies in Health Technology and Informatics. 2012;181:339–43. pmid:22954884
- 72. Christensen H, Griffiths K. The internet and mental health practice. Evidence Based Mental Health. 2003;6(3):66–9. pmid:12893781
- 73. Meinel C, Leifer L. Design thinking research. In: Plattner H, Meinel C, Leifer L, editors. Design thinking. Berlin Heidelberg: Springer; 2010. p. xiii–xxi.