Figures
Abstract
Parenting interventions offer an evidence-based method for the prevention and early intervention of child mental health problems, but to-date their population-level effectiveness has been limited by poor reach and engagement, particularly for fathers, working mothers, and disadvantaged families. Tailoring intervention content to parents’ context offers the potential to enhance parent engagement and learning by increasing relevance of content to parents’ daily experiences. However, this approach requires a detailed understanding of the common parenting situations and issues that parents face day-to-day, which is currently lacking. We sought to identify the most common parenting situations discussed by parents on parenting-specific forums of the free online discussion forum, Reddit. We aimed to understand perspectives from both mothers and fathers, and thus retrieved publicly available data from r/Daddit and r/Mommit. We used latent Dirichlet allocation to identify the 10 most common topics discussed in the Reddit posts, and completed a manual text analysis to summarize the parenting situations (defined as involving a parent and their child aged 0–18 years, and describing a potential/actual issue). We retrieved 340 (r/Daddit) and 578 (r/Mommit) original posts. A model with 31 latent Dirichlet allocation topics was best fitting, and 24 topics included posts that met our inclusion criteria for manual review. We identified 45 unique but broadly defined parenting situations. The majority of parenting situations were focused on basic childcare situations relating to eating, sleeping, routines, sickness, and toilet training; or related to how to respond to child negative emotions or difficult behavior. Most situations were discussed in relation to infant or toddler aged children, and there was high consistency in the themes raised in r/Daddit and r/Mommit. Our results offer potential to tailor parenting interventions in a meaningful way, creating opportunities to develop content and resources that are directly relevant to parents’ lived experiences.
Citation: Westrupp EM, Greenwood CJ, Fuller-Tyszkiewicz M, Berkowitz TS, Hagg L, Youssef G (2022) Text mining of Reddit posts: Using latent Dirichlet allocation to identify common parenting issues. PLoS ONE 17(2): e0262529. https://doi.org/10.1371/journal.pone.0262529
Editor: Ali B. Mahmoud, St John’s University, UNITED KINGDOM
Received: March 8, 2021; Accepted: December 28, 2021; Published: February 2, 2022
Copyright: © 2022 Westrupp et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: We draw on publicly available data from Reddit. Due to the nature of the data, we were not able to obtain individual participant consent. Instead, we applied for a formal Exemption from Ethical Review from The Deakin University Human Research Ethics Committee (DUHREC). This process involved declaring that we would not share our data in order to protect any identifying features in the full dataset (e.g., full quotes of posts that might be directly searched online to reveal the original poster). Researchers who wish to obtain access to our dataset are able to make a request to the following: Human Research Ethics Office, Deakin University 221 Burwood Hwy Burwood, VIC 3125 AUSTRALIA Phone: +61 3 9251 7123 Email: research-ethics@deakin.edu.au Project: HEAG-H 140_2019: Internet text analysis of parenting situations.
Funding: The author(s) received no specific funding for this work.
Competing interests: The authors have declared that no competing interests exist.
Introduction
A key limitation of community-based parenting interventions is that they are usually offered as one-size-fits-all packages, which stands in contrast to evidence that parents differ in the techniques that are most applicable to them [1–4], and therefore require tailored approaches [5]. Tailoring may take into account parents’ needs or their day-to-day parenting context. To-date, tailoring in parenting interventions has focused on parents’ perceived needs through adapting or adding intervention modules to be relevant to specific parent or child subpopulations [6–8], or determined by individual parent results from baseline surveys [9–11]. In contrast, tailoring related to parenting context has been minimal, despite the potential for this approach to increase parent engagement and intervention efficacy, in light of low rates of homework completion in parenting interventions [3], and recognized limitations in the human ability to generalize skills outside of specific learning contexts [12]. To enable a more systematic way of tailoring interventions to specific parenting situations, and thus facilitate parents to immediately implement intervention concepts in their daily lives, the field requires an accurate map of the wide range of day-to-day parenting situations that parents may need support with. The current study aims to meet this need, by investigating the most common issues that draw parents online to discuss their experiences of parenting with other parents.
Parenting interventions offer a strong evidence-based method for the prevention or early intervention of childhood mental health problems [9, 13]. Mental disorders rank as one of the highest causes of the global burden of disease [14]. To assist prevention efforts, the World Health Organization Nurturing Care Framework published in 2018 called for greater investment in adult education to enhance ‘nurturing care’ and thus promote positive early childhood development [13]. Despite many decades of investment and research, the long-term and population-level effectiveness of parenting programs has been lower than expected [1]. Children are influenced by their parents through multiple pathways, including modeling of behavior [15, 16], the emotional climate of the family [15], the nature and quality of the home environment [17], and via their parents’ functioning and parenting practices [18–20]. Parenting interventions often target one or more of these domains, with the intention of modifying early determinants of children’s socio-emotional development.
The field of parenting interventions is at an important juncture. Despite established efficacy for those who use the programs, parenting interventions have had very low reach (<10% population) [21, 22], particularly for fathers, working mothers, and disadvantaged families [3]. Most parenting interventions also struggle with low rates of parent engagement, adherence, homework completion, and participation [3, 23, 24]. A review of the qualitative evidence related to barriers for parent involvement in parenting programs found that parents identified two common reasons for dropping out: lack of fit with the therapist, and the nature of the program content or delivery method, for example, disliking the group activities, feeling that the content wasn’t relevant, or that their needs were not recognized [25]. Fathers also identified mother-oriented services as a key barrier [25]. The next wave of parenting interventions need to address these barriers by designing more widely acceptable and flexible interventions, and through motivating and engaging parents by ensuring that content is flexibly tailored to a range of parent contexts and needs.
There are a number of different ways that community interventions can be tailored; for example, according to identified need or context. In regards to tailoring according to parent needs, there are two key approaches. The first approach has been to modify established interventions to meet the needs of specific parent sub-groups, such as parents of children with autism spectrum disorders [6], incarcerated parents [7], or parents struggling with sibling conflict [8]. This type of whole-of-intervention tailoring aims to increase the relevance of intervention content to the perceived needs of the targeted sub-group of parents, but does not systematically adapt content to needs or the context of individual parents. A second approach has been tested more recently, and involves adapting the allocation of intervention content based on parent-level needs. This is illustrated in an online parenting intervention program where parents are provided with individualized recommendations regarding the specific subset or order of modules they should complete based on their results from a baseline parenting survey [9–11]. This approach has promising results [9–11].
However, to-date, there has been much more limited focus on tailoring according to parents’ context. Although relatively neglected, there may be great potential to enhance parent engagement and learning through tailoring interventions to context, i.e., to specific parenting situations. In general, core intervention concepts within parenting interventions tend to be introduced and described at a higher-order conceptual level, or in relation to set hypothetical parenting examples. In face-to-face individual and group interventions, some degree of tailoring to context may occur in the sense that practitioners may discuss intervention concepts in relation to situations that parents raise during the session [26–28]. However, in most manualized parenting programs, there is only limited time to discuss parent-led examples, and this is even more limited in group-based or online programs. The fact that only a few examples are typically discussed, and that (in group settings) the examples may not even be relevant to individual parents, means that parents must later, and on their own, recall the higher-level concepts, and then reflect on how they might best be adapted to their own parenting situations. This mental gymnastics often must occur in-the-moment as parents attempt to change their usual patterns of responding to their child, while actually interacting with their child.
Imagine the possibility that parents can instead select a recent parenting situation that they have experienced in the past 24 to 48 hours and that they found difficult to manage. Instead of core concepts being described generically, they could be discussed directly in relation to the parent-selected example. In this case, it is likely that the parents’ attention and interest would be heightened, given that the situation is immediately relevant to them. Description of content in relation to recent, known, examples is also likely to reduce parents’ cognitive load, by reducing their working memory requirements; parents no longer need to consider and remember the parameters of a hypothetical example while simultaneously learning about new parenting concepts and techniques, and then attempting to problem-solve how they could adapt it to their own relevant example. Instead, if intervention content is tailored to a recent parenting situation, it is likely they will have opportunity to implement the tailored intervention concepts when the situation occurs again, given that many parenting situations are often repeated, particularly those that draw parents online to discuss or seek advice from other parents.
Tailoring interventions to specific parenting situations requires a detailed understanding of the common parenting situations and issues that parents face day-to-day. To our knowledge, this is currently lacking. The current study therefore aims to identify common parenting situations experienced by parents on a daily basis, which parents themselves identify as being difficult to manage. Our study seeks to better understand the types of parenting situations that motivate parents to reach out to other parents. Research shows that the internet has become a primary source of support for modern parents; parents go online, at any time of day or night, and seek parenting information and support from other parents on social media and online parenting forums [29].
Publically available data from online parenting forums offer an incredibly rich source of parent-centered data, expressed in parents’ own words, and therefore uniquely untouched by researcher bias. Parent response options in quantitative surveys, and even in qualitative data collection procedures, are inherently influenced by researcher-design factors and choices. In comparison, online parenting forums reflect a naturally occurring situation where parents are free to interact and discuss parenting issues without any constraints [30]. Therefore, data from online discussion forums offer considerable opportunity to create an accurate map of parenting situations to enable intervention tailoring.
The current study will use internet scraping to retrieve rich, publically-available data from the online discussion forum, Reddit. Reddit is one of the most popular social media platforms in the world, and the r/Daddit and r/Mommit forums have 163,000 and 106,000 members (at the time of writing), respectively. Importantly, the use of Reddit enables us to address the limitations of previously mother-centric research, by offering scope to investigate fathers’ experiences in a rare father-specific forum where fathers are comfortable talking to other fathers about their parenting experiences [31]. We will utilise an increasingly popular machine learning text mining method, latent Dirichlet allocation (LDA) [32–35], to conduct a text analysis identifying the most common topics discussed in the Reddit posts. The LDA algorithm performs probability-based text mining to extract a set of topics from a corpus of text, based on patterns of words associated with each topic [32, 33]. LDA is a data-driven method, which minimizes researcher bias in the generation of topics, selection of key words, and ranking of relevant posts per topic [33]. This approach enables text analysis of very large datasets where more traditional qualitative text analysis approaches may not be feasible. LDA has been used to identify topics on Reddit discussion forums related to public health interest in same-sex marriage [36]; depression, mental health, treatment, and relationships [37]; Ebola, influenza, electronic cigarettes, and marijuana [38]; electronic cigarettes and Hookah use [39], and eating disorders [40]. LDA has also been used to investigate parenting, for example, one study compared LDA topics for mothers and fathers, and for fathers of preterm versus term children, derived from interview data assessing parents’ reflective functioning [41].
The current study will use LDA and qualitative synthesis (i.e., manual text analysis) to address the following research question: What are the specific parenting situations being discussed within topics that emerge from text analysis of the Reddit r/Daddit and r/Mommit forums? Extraction of content from both of these parent-related forums will enable greater coverage of parenting issues for both fathers and mothers, in light of research showing gender differences in parenting topics discussed on Reddit [30]. It will also enable evaluation of potential differences in the concerns raised by each.
Methods
Ethics approval
The current study was approved by the Deakin University Human Ethics Advisory Group—Health (Project number: HEAG-H 140_2019). In line with HEAG-H advice, it was not possible to directly quote individual posts from publicly available datasets, thus data are presented in aggregated form only. Data were collected and used in accordance with Reddit’s Terms and Conditions.
Data analysis
Fig 1 outlines our processing and data analysis pipeline. Broadly, this comprised (a) data extraction, (b) data cleaning, (c) LDA topic modeling, and (d) qualitative synthesis. Of relevance, our approach to data cleaning and topic modeling is based on previously published work [42]. R software v3.6.1 [43] was used for all processing and analysis.
Data extraction
We scraped publicly available data using ‘RedditExtractoR’ v2.1.5 [44] from two forums focused on experiences of mothers and fathers on Reddit (i.e., r/Daddit; r/Mommit). Data scraping was conducted on 11 February 2020 and we retained those posts that were the first of a particular thread (known as the ‘original post’) and that contained textual data in the body of the post, e.g., did not comprise just an image. Responses to the original posts were not included in analyses as this study aimed to only identify common parenting situations rather than describe the conversations and language used surrounding these situations. Due to limits in how data can be scraped from Reddit, only the first 10 pages of original posts from these forums could be scraped at any one time. Thus, we extracted 340 (r/Daddit) and 578 (r/Mommit) original posts that spanned an approximate 4–6 week period prior to our date of data scraping (r/Daddit earliest original post extraction date was 13 Jan 2020; r/Mommit earliest original post extraction date was 12 Dec 2019).
Data preparation
The corpus of data were prepared for analysis using the ‘tm’ v0.7–6 [45] package. This process involved removing all non-alphabetical characters, punctuation, and blank spaces; converting all text to lowercase; removing all non-words; and removing “stop words” (e.g., “the”, “is”, “at”, “which”, “on”). We also manually ‘stemmed’ the corpus by reviewing the entire list of unique words and ensuring words with different suffixes (e.g., “happy”, “happiness”, “happiest”) were coded as the same word (e.g., “happy”). During this review we also corrected obvious misspellings and international differences in spelling.
LDA topic modelling
Common topics within the corpus were identified using latent Dirichlet allocation (LDA) [33], which is a common method used to identify themes in collections of scholarly textual data [32–35], as well as large sets of documents or texts in research or clinical contexts [46]. An outline of the statistical methodology of LDA is presented in detail elsewhere [33, 47], but briefly described here. LDA is a Bayesian probabilistic modelling method that aims to identify the unknown number of latent topics that are assumed to underlie a body of text [33]. LDA draws from a Dirichlet distribution to generate distributions of probabilities that describe how (1) words (i.e., word-topic-probabilities) and (2) documents (i.e., document-topic-probabilities) are related to the latent topics underlying the dataset. Specifically, word-topic-probabilities are estimates of the probability a word is generated from a specific topic, whilst document-topic-probabilities are estimates of the probability that a topic has been generated in a specific document [48]. Inspection of the highest word-topic and document-topic probabilities for each topic can help characterize the theme of each latent topic. In the current study, we used LDA to find common topics within the corpus of original posts from r/Daddit and r/Mommit, and from these we aimed to identify parenting situations.
To conduct the LDA, we converted the corpus to a document-term-matrix, comprising rows representing each original post (i.e., document = original post) and columns representing each word in the corpus (i.e., term = word). Each cell in the document-term-matrix contains the frequency of times a specific word (defined by the column) occurred in a specific post (defined by the row). From this document-term-matrix, the entire corpus was represented, including patterns of words that commonly occur together within the same post.
The LDA was conducted using the ‘topicmodels’ v0.2–8 package [49]. As per Kosinski, Wang [50], LDA hyperparameters were set to delta = 0.1 and alpha = 50/k (where k is the number of LDA topics being estimated). To identify the number of LDA topics that best fit the patterns within the corpus, we first estimated a 2-topic model and then sequentially increased the number of LDA topics being modelled until we estimated a 50-topic model. We then selected the best fitting model based on the perplexity value for each model; a common method for evaluating model fit in LDA models [33, 51], where models with lower perplexity are considered to fit the data better than models with higher perplexity. Our estimate of perplexity for each model was derived as an average of the perplexity across a five-fold cross validation process. Within this process, the corpus of original posts was randomly split into five portions with a model generated (i.e., trained) on four of the portions, and then validated on the fifth portion. This process was repeated until each portion had been used for validation once. We also used the ‘LDAvis’ v0.3.2 package [52] to obtain the percentage of tokens (i.e. words) contributing to a specific topic.
Qualitative analysis and interpretation
As mentioned previously, to interpret the topics derived from the optimal model, we relied on two metrics that form the basis of interpretation for LDA models. The first is a matrix of values that quantify the probability that each word on the corpus would be generated from a specific topic (i.e., β matrix; higher β = the word is more likely to occur in the topic). The second is a matrix of values that quantifies the proportion of words in an original post estimated to be generated by a specific topic (i.e., γ matrix; higher γ = the original post is more aligned with topic). Specifically, we focused interpretation on the 10 most relevant posts per topic according to γ values. We completed a qualitative synthesis of the topics and original posts via a manual text analysis to interpret each topic and characterize specific parenting situations described in original posts within each topic. This procedure involved classifying each post according to whether they met a pre-specified definition of a ‘parenting situation’, defined as follows: (1) the post referenced a scenario involving a child aged 0–18 years; and (2) the scenario involved a parent and their child; and (3) referenced a potential or actual difficulty or issue, for which the parent was giving or seeking advice in how to manage or improve. Posts were also only included if one or more of the 10 topic words was used in a way that conveyed meaning relevant to the central themes of a given post and topic, rather than being peripheral.
Results
LDA results
Fig 2 presents the perplexity values for each of the topic model scenarios, modeling 2–50 LDA topics, based on the number of topics retained in our LDA. Dots represent perplexity scores for each of the 5-fold cross-validation models for each topic. The blue line represents the average perplexity scores across the 5-fold cross validation. The lowest average perplexity was for a model with 31 topics (mean perplexity = 917.64). This 31-topic model was found to be the best performing LDA model as it had the lowest average perplexity of all the models (see S1 Table). The β values for the 10 most probable words associated with each of the 31 LDA topics, and the range of γ values for the top 10 posts contributing to each of the 31 topics, are presented in S1 Fig and S2 Table, respectively. The average probability across all documents and the average and range of probabilities for the top 10 documents for each topic is presented in S3 Table. On inspection of the top 10 original posts related to each topic (i.e., with the highest γ values), 24 of the 31 LDA topics contained posts that met the inclusion criteria in terms of being consistent with our pre-specified definition of a parenting situation, and meaningfully reflecting the topic words (i.e., with the highest β values).
Parenting situations
Table 1 summarizes the LDA topic words, themes, and description of parenting situations for the 24 LDA topics that were included in the final analysis. The percentage of tokens contributing to each topic was relatively balanced, ranging from 2.6% (topic 31) to 4.1% (topic 2). Just eight of the 24 LDA topics included posts where parents were giving advice, either recounting their own recent experiences to illustrate a specific successful parenting moment that they hoped others might learn from (e.g., just found a good strategy for clearing their sick child’s congestion), or some parents posted with more generic advice (i.e., not specific to a recent parenting experience, but based on their accumulated parenting experience), such as providing advice on strategies for specific situations (e.g., toilet training advice). The remainder of the topics involved posts where the parent was seeking advice from other parents on the Reddit parenting forums, most commonly in the format of a parent describing a specific parenting situation and asking others for advice on how they might handle it.
Based on the manual text analysis of posts within the LDA topics, we identified 45 unique but broadly defined parenting situations. The most prevalent themes from LDA topics meeting our inclusion criteria involved parents managing parenting situations related to child sleep, sickness, toilet training, child food refusal or fussiness, children whining when they didn’t get what they wanted, gender stereotyping, managing multiple children/siblings, and managing children who are showing a regression in their behavior in relation to age. There were two very common higher-order themes, each identified in more than a third of the parenting situations, relating to (1) managing basic childcare situations, i.e., related to eating, sleeping, routines, sickness, toilet training; and (2) how to respond to child negative emotions and/or difficult behavior. Some topics were generated from parenting situations based on just one post e.g., Topic 31’s sole post was seeking advice on burping a baby. Other topics were generated from parenting situations based on a number of posts e.g., Topic 2 had multiple posts on child sleeping habits.
Parent and child characteristics
Table 2 summarizes the child ages and subreddit source for each of the included topic themes. The majority of the included posts (80%) referred to a child or children of infant or toddler age. Posts about children 4 years and older were focused on child use of technology, supporting children in gender non-stereotypical activities (e.g., sports, make-up), managing sibling conflict or the needs of multiple children at home, and using bibliotherapy to talk to children about change or potentially upsetting subjects. In relation to the source of posts, one third of the included posts were from the r/Daddit forum, while the remainder were from r/Mommit. The majority of the LDA topics included posts from both sources, meaning that most of the identified parenting situations were discussed by mothers and fathers online. The two most common higher-order themes (i.e., managing basic childcare situations and responding to child negative emotions and/or difficult behavior) were also reflected in both r/Mommit and r/Daddit posts. The identity (e.g., gender) of the person writing each post was not known, and is therefore not able to be described.
Whilst we focused our interpretation on topics that met our inclusion criteria, interested readers can find a summary of themes for posts not meeting the inclusion criteria for the current study in S4 Table. In summary, parents posted on parenting subreddits for a large number of reasons, including medical issues not related to being a parent; managing relationships with family members other than their children, such as the relationship with their partner; and managing a range of situations related to being a parent, but not specific to a parent-child interaction, including moving house, seeking advice around their own feelings and wellbeing, navigating special occasions and holidays, their child’s school, and managing issues related to pets and children.
Discussion
Principal results
The objective of the current study was to support the necessary first step in developing parenting interventions that are tailored to parents’ context, by providing a detailed understanding of the common parenting situations and issues that parents face day-to-day. In this study, we sought to identify the most common day-to-day parenting situations discussed online on the r/Daddit and r/Mommit subreddit forums to inform meaningful tailoring in parenting interventions. Using the innovative and increasingly popular machine learning approach, latent Dirichlet allocation (LDA) [33], we were able to exploit the incredibly rich source of person-centered parenting data available online, in order to identify parenting situations that are most applicable to parents day-to-day. The LDA topic modeling extracted 31 LDA topics, of which 24 met our inclusion criteria in terms of being related to a difficult parenting situation involving their child. From these, we identified 45 unique but broadly defined parenting situations involving a parenting issue or difficult interaction between a parent and their child aged 0–18 years.
Our study is the first we are aware of to systematically describe the most topical and common parenting situations that parents seek advice and support around. Over two-thirds of the LDA topics meeting our inclusion criteria for analysis related to two primary themes. First–managing basic childcare situations, i.e., related to eating, sleeping, routines, sickness, toilet training; and second–related to advice on how to respond to child negative emotions and/or difficult behavior. Although there is little in the way of published evidence documenting the specific parenting examples used in parenting interventions, it is the experience of the authors that these examples tend to relate to situations involving the second theme, i.e., related to managing child negative emotions and difficult behavior. Our results suggest that many parents are also very interested in how to manage children in day-to-day childcare tasks. The parent-child relationship is equally formed around management of these daily rhythms, as it is in the management of difficult child behavior or emotions. Thus, it seems appropriate that future parenting interventions could include content focused on parent-child interactions across the breadth of parenting situations described in our results.
The inclusion of posts from r/Daddit and r/Mommit meant that our results reflected perspectives from both mothers and fathers. Despite clear evidence that fathers are central in influencing child developmental outcomes [53, 54], including child mental health outcomes [19, 55], fathers are chronically underrepresented in parenting research and parenting interventions (<20% of attendees) [56]. A systematic review of fathers’ representation in observational parenting studies identified that just 10% of 667 parenting studies included results separately for fathers; 1% were focused solely on fathers compared to 36% focused solely on mothers [57]. Our study findings address this gap by describing topics discussed by mothers and fathers. Although we identified some differences in LDA topics discussed in each of the forums, on the whole, there was a high level of consistency in the themes raised in r/Daddit and r/Mommit. However, our findings suggest that parents raise different questions depending on the age of their child, suggesting that parenting interventions should tailor intervention content to be age-specific. Further, the vast majority of included posts (80%) related to infant or toddler aged children. These findings suggest that early childhood may be an important time for intervention when parents are particularly open to receiving support and advice.
We note that just 24 of the 31 LDA topics identified met our inclusion criteria for analysis as a parenting situation. The remaining posts traversed a wide range of themes, including managing family situations and relationships in the extended family context, parents’ own health concerns, and household-related issues. Parents increasingly use online tools in a multitude of ways to assist with parenting, including connecting through social media, assisting with managing family life, and providing multiple sources of online information [29]. Our data reflect that parents use Reddit to access support from other parents for a wide range of reasons. Although some of the LDA topics identified in the current study were not deemed to be immediately relevant in terms of tailoring parenting interventions, they may be useful for understanding how parents access support online.
Applications for tailoring parenting interventions
E-interventions, delivered online or via smartphone apps, offer potential for overcoming cost, time, and geographic barriers faced by traditional interventions [58]. However, results to-date have been disappointing. A systematic review showed that current technology-based parenting interventions are still under-servicing key groups, such as fathers, non-urban parents, and parents from a low socio-economic background [59]. For the most part, technology-based parenting interventions have not changed the format or content from traditional face-to-face, module-based approaches [58]. Tailoring in technology-based parenting interventions has been minimal to-date, despite evidence that that engagement is strongest when interventions are flexibly tailored to be maximally relevant to individual parents [58, 60]. Findings from the current study provide scope to address these limitations. We identify 45 of the most commonly discussed parenting situations on the parenting-specific forums of Reddit. Our results provide a detailed picture of the common scenarios that mothers and fathers face day-to-day, that could be applied to tailor resources in population-based parenting interventions.
Strengths and limitations
The use of LDA topic modeling and manual text analysis was both a strength and potential limitation of the current study. LDA offers a powerful data-driven method for analyzing large datasets, and may discern patterns in qualitative data that becomes infeasible to analyze with traditional qualitative coding approaches as data quantity increases. However, LDA lacks specific recommendations around best practice approaches in particular settings. For example, there is no single method for determining the most appropriate number of LDA topics to model within the data [32]. Further, decisions made in the data preparation steps to clean the data prior to running the LDA modeling have potential to introduce researcher bias and impact the results.
Our findings may also be limited by the scope offered in the Reddit parenting forums. For example, while widely used, not all parents use Reddit. Further, for Reddit users, some parents may be more likely to comment on others’ posts, rather than create an original post themselves. In both cases, the experiences of these parents will not be reflected in our results. There may also be bias in the subjects that parents raise for discussion on Reddit, for example, based on parents’ prior interpretation of what is acceptable within particular forums. In addition, some topics may be less likely to be identified by the LDA process, such as those related to sensitive or less common situations, or where a range of different words are used to refer to the same meaning, thus making it less likely to be identified as a topic by the LDA modelling. Further research efforts to augment publicly available posts with data directly obtained from Reddit users about their demographics and other parenting-related constructs may provide added context with which to appraise the potential generalizability of results obtained from online forum conversations.
Our results reflect data collected from the Reddit platform in 2020, but are likely to be generalizable to other online forums used by parents, such as Facebook and Instagram. There is emerging evidence investigating the way in which parents use other social media sites, including Facebook parenting groups [61, 62]. However, Reddit is uniquely amenable to topic modelling, given that all posts are publicly available, which is not the case with Facebook and Instagram. We expect that the way in which parents discuss parenting issues would be relatively consistent across platforms, but there is currently no evidence to assess this claim. This could be tested by future research investigating whether there are systematic differences between parent users of different platforms, such as demographic characteristics (e.g., parent user age, gender, country of residence, spoken language).
Conclusions
Our results support the use of LDA text mining for the purpose of understanding broad themes discussed in online parenting forums. We identified 45 unique parenting situations describing a wide range of parenting contexts, but most commonly related to basic childcare situations, i.e., related to eating, sleeping, routines, sickness, toilet training; or related to advice about how to respond to child negative emotions and/or difficult behavior. The current study was novel in analyzing parents’ own words to understand the most common day-to-day parenting issues experienced by parents. Internet forums represent a rich source of potentially unbiased data for researchers, offering a method for observing and analyzing naturally-occurring adult conversations online. These findings offer potential to tailor parenting interventions in a meaningful way, creating opportunities to develop content and resources that are directly relevant to parents’ lived experiences.
Supporting information
S1 Table. Mean perplexity values across 5-fold cross-validations for K-topic solutions.
https://doi.org/10.1371/journal.pone.0262529.s001
(DOCX)
S2 Table. Mean, standard deviation, and range of gamma values for the top 10 posts contributing to each topic.
https://doi.org/10.1371/journal.pone.0262529.s002
(DOCX)
S3 Table. Range and average document-topic-probabilities for the top ten documents for each topic.
https://doi.org/10.1371/journal.pone.0262529.s003
(DOCX)
S4 Table. Summary of themes from posts not meeting the study inclusion criteria.
https://doi.org/10.1371/journal.pone.0262529.s004
(DOCX)
S1 Fig. β values for the 10 most probable words associated with each of the 31 LDA topics.
https://doi.org/10.1371/journal.pone.0262529.s005
(TIF)
References
- 1.
Proposal Kalil A. 2: Addressing the Parenting Divide to Promote Early Childhood Development for Disadvantaged Children. Hamilton Project. Washington, DC: Brookings Institution; 2014.
- 2. Scott S. Parenting programmes for attachment and conduct problems. Psychiatry 2008 2008/09/01/;7(9):367–70. https://doi.org/10.1016/j.mppsy.2008.07.006.
- 3. Hackworth NJ, Matthews J, Westrupp EM, Nguyen C, Phan T, Scicluna A, et al. What Influences Parental Engagement in Early Intervention? Parent, Program and Community Predictors of Enrolment, Retention and Involvement. Prevention Science 2018:1–14.
- 4. van Aar J, Leijten P. Families Who Benefit and Families Who Do Not: Integrating Person- and Variable-Centered Analyses of Parenting Intervention Responses. JAACAP 2019 2019/02/11/. pmid:30768388
- 5. Winston FK, Puzino K, Romer D. Precision prevention: time to move beyond universal interventions. Injury Prevention 2016;22(2):87. pmid:26271260
- 6. Whittingham K, Sofronoff K, Sheffield J, Sanders MR. Behavioural Family Intervention with parents of children with ASD: What do they find useful in the parenting program Stepping Stones Triple P? Research in Autism Spectrum Disorders 2009;3(3):702–13.
- 7. Miller AL, Weston LE, Perryman J, Horwitz T, Franzen S, Cochran S. Parenting While Incarcerated: Tailoring the Strengthening Families Program for use with jailed mothers. Children and Youth Services Review 2014 2014/09/01/;44:163–70. pmid:26612963
- 8. Pickering JA, Sanders MR. Integrating Parents’ Views on Sibling Relationships to Tailor an Evidence-based Parenting Intervention for Sibling Conflict. Family Process 2017 2017/03/01;56(1):105–25. pmid:26333041
- 9. Yap MBH, Morgan AJ, Cairns K, Jorm AF, Hetrick SE, Merry S. Parents in prevention: A meta-analysis of randomized controlled trials of parenting interventions to prevent internalizing problems in children from birth to age 18. Clinical Psychology Review 2016 2016/12/01/;50:138–58. pmid:27969003
- 10. Yap MBH, Cardamone-Breen MC, Rapee RM, Lawrence KA, Mackinnon AJ, Mahtani S, et al. Medium-Term Effects of a Tailored Web-Based Parenting Intervention to Reduce Adolescent Risk of Depression and Anxiety: 12-Month Findings From a Randomized Controlled Trial. Journal of Medical Internet Research 2019 2019/08/15;21(8):e13628. pmid:31418422
- 11. Yap MBH, Mahtani S, Rapee RM, Nicolas C, Lawrence KA, Mackinnon A, et al. A Tailored Web-Based Intervention to Improve Parenting Risk and Protective Factors for Adolescent Depression and Anxiety Problems: Postintervention Findings From a Randomized Controlled Trial. Journal of Medical Internet Research 2018 2018/01/19;20(1):e17. pmid:29351895
- 12. Colmar S, Double K. Working Memory Interventions With Children: Classrooms or Computers? J Psychologists & Counsellors in Schools 2017;27(2):264. pmid:31844842
- 13.
World Health Organization UNCsF, World Bank Group. Nurturing care for early childhood development: a framework for helping children survive and thrive to transform health and human potential. Geneva: World Health Organization, 2018.
- 14. Vigo D, Thornicroft G, Atun R. Estimating the true global burden of mental illness. The Lancet Psychiatry 2016;3(2):171–8. pmid:26851330
- 15. Morris AS, Silk JS, Steinberg L, Myers SS, Robinson LR. The Role of the Family Context in the Development of Emotion Regulation. Social Development 2007 2007/05/01;16(2):361–88. pmid:19756175
- 16. Morris A, Criss M, Silk J, Houltberg B. The Impact of Parenting on Emotion Regulation During Childhood and Adolescence. Child Development Perspectives 2017;11(4):233–8.
- 17. Rijlaarsdam J, Tiemeier H, Hofman A, Jaddoe VW, Mackenbach JP, Verhulst FC, et al. Home environments of infants: relations with child development through age 3. J Epidemiol Community Health 2013;67(1):14–20. pmid:22766779
- 18. Eisenberg N, Cumberland A, Spinrad TL. Parental Socialization of Emotion. Psychological Inquiry 1998 1998/10/01;9(4):241–73. pmid:16865170
- 19. Giallo R, Cooklin A, Wade C, D’Esposito F, Nicholson JM. Fathers’ postnatal mental health and child well-being at age five: The mediating role of parenting behavior. Journal of Family Issues 2013;Published online.
- 20. Westrupp EM, Brown S, Woolhouse H, Gartland D, Nicholson JM. Repeated early-life exposure to inter-parental conflict increases risk of preadolescent mental health problems. European journal of pediatrics 2018;177(3):419–27. pmid:29273942
- 21. Enns J, Holmqvist M, Wener P, Halas G, Rothney J, Schultz A, et al. Mapping interventions that promote mental health in the general population: A scoping review of reviews. Preventive Medicine 2016 2016/06/01/;87:70–80. pmid:26896634
- 22.
Clancy E, Benstead M, Little K, Skvarc D, Westrupp E, Yap M, et al. Family Partnerships to Support Children and Young People’s Mental Health: An Evidence Check rapid review brokered by the Sax Institute for Be You. Sax Institute, 2019.
- 23. Mendez JL, Carpenter JL, LaForett DR, Cohen JS. Parental Engagement and Barriers to Participation in a Community-Based Preventive Intervention. American Journal of Community Psychology 2009 2009/09/01;44(1):1–14. pmid:19533328
- 24. Linardon J, Fuller-Tyszkiewicz M. Attrition and adherence in smartphone-delivered interventions for mental health problems: A systematic and meta-analytic review. Journal of consulting and clinical psychology 2020;88(1):1. pmid:31697093
- 25. Koerting J, Smith E, Knowles MM, Latter S, Elsey H, McCann DC, et al. Barriers to, and facilitators of, parenting programmes for childhood behaviour problems: a qualitative synthesis of studies of parents’ and professionals’ perceptions. European Child & Adolescent Psychiatry 2013 2013/11/01;22(11):653–70. pmid:23564207
- 26. Havighurst S, Wilson K, Harley A, Prior M, Kehoe C. Tuning in to Kids: Improving emotion socialization practices in parents of preschool children–findings from a community trial. J Child Psychol Psyc 2010;51(12):1342. pmid:20735794
- 27. Sanders MR, Kirby JN. Consumer Engagement and the Development, Evaluation, and Dissemination of Evidence-Based Parenting Programs. Behavior Therapy 2012 2012/06/01/;43(2):236–50. pmid:22440062
- 28. Hackworth N, Berthelsen D, Matthews J, Westrupp EM, Cann W, Ukoumunne O, et al. Impact of a brief group intervention to enhance parenting and the home learning environment for children aged 6–36 months: A cluster randomised controlled trial. Prevention Science 2017;18(3):337–49. pmid:28108927
- 29. Kildare C, Middlemiss W. Impact of parents mobile device use on parent-child interaction: A literature review. Computers in Human Behavior 2017 2017/10/01/;75:579–93. https://doi.org/10.1016/j.chb.2017.06.003.
- 30. Ammari T, Schoenebeck S, Romero DM, editors. Pseudonymous parents: Comparing parenting roles and identities on the Mommit and Daddit subreddits. Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems; 2018.
- 31. Teague SJ, Shatte ABR. Exploring the Transition to Fatherhood: Feasibility Study Using Social Media and Machine Learning. JMIR Pediatr Parent 2018 2018/11/27;1(2):e12371. pmid:31518298
- 32. Zou C. Analyzing research trends on drug safety using topic modeling. Expert opinion on drug safety 2018;17(6):629–36. pmid:29621918
- 33. Blei DM, Ng AY, Jordan MI. Latent dirichlet allocation. JMLR 2003;3(Jan):993–1022.
- 34. Joo S, Choi I, Choi N. Topic Analysis of the Research Domain in Knowledge Organization: A Latent Dirichlet Allocation Approach. KO KNOWLEDGE ORGANIZATION 2018;45(2):170–83.
- 35. Wang S-H, Ding Y, Zhao W, Huang Y-H, Perkins R, Zou W, et al. Text mining for identifying topics in the literatures about adolescent substance use and depression. BMC public health 2016;16(1):279. pmid:26993983
- 36. Hemmatian B, Sloman SJ, Cohen Priva U, Sloman SA. Think of the consequences: A decade of discourse about same-sex marriage. Behavior Research Methods 2019 2019/08/01;51(4):1565–85. pmid:30859479
- 37. Feldhege J, Moessner M, Bauer S. Who says what? Content and participation characteristics in an online depression community. Journal of Affective Disorders 2020 2020/02/15/;263:521–7. pmid:31780138
- 38.
Park A, Conway M, editors. Tracking health related discussions on Reddit for public health applications. AMIA Annual Symposium Proceedings; 2017: American Medical Informatics Association.
- 39. Chen AT, Zhu S-H, Conway M. What Online Communities Can Tell Us About Electronic Cigarettes and Hookah Use: A Study Using Text Mining and Visualization Techniques. J Med Internet Res 2015 2015/09/29;17(9):e220. pmid:26420469
- 40. Moessner M, Feldhege J, Wolf M, Bauer S. Analyzing big data in social media: Text and network analyses of an eating disorder forum. International Journal of Eating Disorders 2018 2018/07/01;51(7):656–67. pmid:29746710
- 41. Ruiz N, Witting A, Ahnert L, Piskernik B. Reflective functioning in fathers with young children born preterm and at term. Attachment & Human Development 2020 2020/01/02;22(1):32–45. pmid:30898032
- 42.
Silge J, Robinson D. Text mining with R: A tidy approach: " O’Reilly Media, Inc."; 2017. ISBN: 1491981628.
- 43. R Core Team. R: A language and environment for statistical computing. 2013.
- 44. Rivera I. RedditExtractoR: Reddit Data Extraction Toolkit. 2019.
- 45. Meyer D, Hornik K, Feinerer I. Text mining infrastructure in R. Journal of statistical software 2008;25(5):1–54.
- 46. Li Y, Rapkin B, Atkinson TM, Schofield E, Bochner BH. Leveraging Latent Dirichlet Allocation in processing free-text personal goals among patients undergoing bladder cancer surgery. Quality of Life Research 2019;28(6):1441–55. pmid:30798421
- 47. Griffiths TL, Steyvers M. Finding scientific topics. Proceedings of the National academy of Sciences 2004;101(suppl 1):5228–35. pmid:14872004
- 48. Bittermann A, Fischer A. How to identify hot topics in psychology using topic modeling. Zeitschrift für Psychologie 2018.
- 49. Hornik K, Grün B. topicmodels: An R package for fitting topic models. Journal of statistical software 2011;40(13):1–30.
- 50. Kosinski M, Wang Y, Lakkaraju H, Leskovec J. Mining big data to extract patterns and predict real-life outcomes. Psychological methods 2016;21(4):493. pmid:27918179
- 51. Bao Y, Datta A. Simultaneously discovering and quantifying risk types from textual risk disclosures. Management Science 2014;60(6):1371–91.
- 52.
Sievert C, Shirley K . LDAvis: Interactive visualization of topic models (Version 0.3. 2)[Software]. Retrieved from The Comprehensive R Archive Network: https://cran.r-project.org/web/packages.LDAvis/indexhtml 2015.
- 53. Quach J, Sarkadi A, Napiza N, Wake M, Loughman A, Goldfeld S. Do Fathers’ Home Reading Practices at Age 2 Predict Child Language and Literacy at Age 4? Academic Pediatrics 2018 2018/03/01/;18(2):179–87. pmid:29056402
- 54. Rominov H, Giallo R, Whelan TA. Fathers’ postnatal distress, parenting self-efficacy, later parenting behavior, and children’s emotional-behavioral functioning: A longitudinal study. Journal of Family Psychology 2016;30(8):907–17. pmid:27183189
- 55. Vahedi A, Krug I, Westrupp EM. Crossover of parents’ work-family conflict to family functioning and child mental health. Journal of Applied Developmental Psychology 2019;62:38–49.
- 56. Tully L, Collins DA, Piotrowska P, Mairet K, Hawes D, Moul C, et al. Examining practitioner competencies, organizational support and barriers to engaging fathers in parenting interventions. Child Psychiatry & Human Development 2018;49(1):109. pmid:28523378
- 57. Davison KK, Gicevic S, Aftosmes-Tobio A, Ganter C, Simon CL, Newlan S, et al. Fathers’ Representation in Observational Studies on Parenting and Childhood Obesity: A Systematic Review and Content Analysis. American Journal of Public Health 2016 2016/11/01;106(11):e14–e21. pmid:27631735
- 58. Westrupp EM, Youssef G, Fuller-Tyszkiewicz M, Macdonald JA, Havighurst S, Kehoe CE, et al. Using technology to tailor and personalise population level parenting interventions. Mental Health & Prevention 2020 2020/09/01/;19:200184. https://doi.org/10.1016/j.mhp.2020.200184.
- 59. Hansen A, Broomfield G, Yap MBH. A systematic review of technology-assisted parenting programs for mental health problems in youth aged 0–18 years: Applicability to underserved Australian communities. Australian Journal of Psychology 2019 2019/12/01;71(4):433–62.
- 60. Nahum-Shani I, Smith SN, Spring BJ, Collins LM, Witkiewitz K, Tewari A, et al. Just-in-time adaptive interventions (JITAIs) in mobile health: key components and design principles for ongoing health behavior support. ABM 2018;52(6):446–62. pmid:27663578
- 61.
Wellstead DA. Digitally-mediated mothering: An ethnography of health and parenting groups on Facebook [Doctorate in Philosophy Degree in Sociology]: University of Ottawa; 2020.
- 62. Epstein M, Oesterle S, Haggerty KP. Effectiveness of Facebook Groups to Boost Participation in a Parenting Intervention. Prevention Science 2019 2019/08/01;20(6):894–903. pmid:31124023