Figures
Abstract
Ubiquitous use of smartphones among youth poses significant challenges related to non-communicable diseases, including poor mental health. Although traditional survey measures can be used to assess smartphone use among youth, they are subject to recall bias. This study aims to compare self-reported smartphone use via retrospective modified traditional recall survey and prospective Ecological Momentary Assessments (EMAs) among youth. This study uses data from the Smart Platform, which engages with youth as citizen scientists. Youth (N = 77) aged 13–21 years in two urban jurisdictions in Canada (Regina and Saskatoon) engaged with our research team using a custom-built application via their own smartphones to report on a range of behaviours and outcomes on eight consecutive days. Youth reported smartphone use utilizing a traditional validated measure, which was modified to capture retrospective smartphone use on both weekdays and weekend days. In addition, daily EMAs were also time-triggered over a period of eight days to capture prospective smartphone use. Demographic, behavioural, and contextual factors were also collected. Data analyses included t-test and linear regression using Python statistical software. There was a significant difference between weekdays, weekends and overall smartphone use reported retrospectively and prospectively (p-value = <0.001), with youth reporting less smartphone use via EMAs. Overall retrospective smartphone use was significantly associated with not having a part-time job (β = 139.64, 95% confidence interval [CI] = 34.759, 244.519, p-value = 0.010) and having more than two friends who are physically active (β = -114.72, 95%[CI] = -208.872, -20.569, p-value = 0.018). However, prospective smartphone use reported via EMAs was not associated with any behavioural and contextual factors. The findings of this study have implications for appropriately understanding and monitoring smartphone use in the digital age among youth. EMAs can potentially minimize recall bias of smartphone use among youth, and other behaviours such as physical activity. More importantly, digital citizen science approaches that engage large populations of youth using their own smartphones can transform how we ethically monitor and mitigate the impact of excessive smartphone use.
Author summary
Use of ubiquitous digital devices, particularly smartphones, has experienced an exponential increase among youth, a phenomenon that continues to influence youth health. Although retrospective measures have been used to understand smartphone use among youth, they are prone to measurement and compliance biases. There has been a growing interest in using ecological momentary assessments (EMAs) to assess smartphone to minimize biases associated with retrospective measures. This study uses the Smart Framework, which integrates citizen science, community based participatory research and systems science to ethically engage with youth citizen scientists using their own smartphones to understand smartphone use behaviours–reported by the same cohort of youth using both retrospective and prospective measures. The findings show a significant difference between smartphone use reported through retrospective and prospective EMAs, with youth reporting more smartphone use via retrospective measures. Furthermore, there were differences in contextual and behavioural factors that were associated with smartphone use reported via retrospective and prospective measures. The findings have implications for appropriately understanding and monitoring smartphone use in the digital age among youth. More importantly, digital citizen science approaches that engage large populations of youth using their own smartphones can transform how we ethically monitor and mitigate the impact of excessive smartphone use.
Citation: Al-akshar S, Tolulope Ibrahim S, Katapally TR (2024) How can digital citizen science approaches improve ethical smartphone use surveillance among youth: Traditional surveys versus ecological momentary assessments. PLOS Digit Health 3(11): e0000448. https://doi.org/10.1371/journal.pdig.0000448
Editor: Harry Hochheiser, University of Pittsburgh School of Medicine, UNITED STATES OF AMERICA
Received: January 25, 2024; Accepted: September 8, 2024; Published: November 11, 2024
Copyright: © 2024 Al-akshar et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: The full dataset that supports the findings of this study, including sociodemographic and contextual factors and smartphone use measurements, can be found at the publicly available Figshare repository: https://figshare.com/articles/dataset/RetrtoVsPro_Dataset_xlsx/24969579?file=48153757.
Funding: This research was supported by the Saskatchewan Health Research Foundation (Establishment Grant and Patient-Oriented Research Leader Award to TRK) and the Canada Research Chairs Program (Canada Research Chair in Digital Health for Equity awarded to TRK). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist
Background
The prevalence of smartphone usage among the younger population has experienced a significant surge in recent years on a global scale, as evidenced by the fact that 95% of smartphone users fall within the 13–17 years [1,2]. Nonetheless, there is still ambiguity regarding how youth use their smartphones and the potential implications of using ubiquitous digital tools such as smartphones [3].
In understanding smartphone use among youth, thus far, traditional self-report measures have been predominantly used [4], which pose issues such as recall bias and measurement errors [5,6]. Moreover, traditional survey measures do not capture the full range of activities associated with smartphone use, including communication, e-learning, entertainment, and social media, among others [6].
Advanced population health measurement techniques such as ecological momentary assessments (EMAs), can potentially address measurement bias and capture the entire range of smartphone activities [7,8]. EMAs “capture brief, repeated assessments in natural environments with a high degree of ecological validity relative to laboratory-based investigations” [9]. EMAs are prospective measures that provide an advantage in assessing behaviours by capturing environmental context of the participants [10]. While traditional surveys are important in understanding behaviour retrospectively, EMAs have the advantage of minimizing recall bias and improving the validity of results [11]. Moreover, EMAs reduce the burden of responding to surveys and improve rates of compliance and feasibility for participants [12], as well as minimize social desirability bias [13].
Although current research examines screen-based behaviours among youth, including watching TV and playing video games, there is a scarcity of evidence focusing on smartphone use [14]. It is critical to appropriately understand smartphone use among youth to not only inform potential smartphone use recommendations [15], but also to determine appropriate use for digital health interventions [16]. In addition, currently no studies exist that compare retrospectively reported smartphone use using traditional survey measures and prospectively reported smartphone use using EMAs within the same cohort of youth. The objective of this study is to compare smartphone use reported via retrospective surveys and prospective EMAs by engaging with youth citizen scientists via their own smartphones. The study also investigates the demographic, behavioural, and contextual factors that are associated with smartphone use reported via retrospective surveys compared to prospective EMAs.
Methodology
Study design
This study is a part of the Smart Platform, which is a citizen science and digital epidemiological initiative for ethical population health surveillance, knowledge translation, and real-time interventions [17]. Smart Platform integrates community-based participatory research and digital citizen science to ethically obtain big data from citizen-owned smartphones [17]. Moreover, the study uses a combination of cross sectional and temporal longitudinal design [18].
The research team engaged with youth citizen scientists via their smartphones over the course of eight days through the Smart Platform smartphone custom-built application. Youth citizen scientists could download the application through the iOS or Android operating systems [18] Fig 1 illustrates the interfaces utilized by both citizen scientists and academic scientists within the Smart Platform. It highlights the flow of data from the citizen scientists during data collection to the analysis done by the academic scientists, the findings from which are in turn translated back to the citizen scientists through the smartphone app, emphasizing the central role of the Smart Platform in this engagement.
Recognizing the importance of accurate and timely data collection, the EMAs are designed to capture prospective smartphone use on a daily basis, hence the deployment was informed by the need to capture each day’s smartphone use (i.e., towards the end of the day) to ensure accurate measurement with minimal recall bias. These deployment decisions were again informed by the feedback and engagement with both the youth themselves and the educators in their schools. To complement this data, a modified traditional retrospective recall survey was deployed using a one-time triggered notification on day one, which also collected demographic characteristics, including gender, age, and socioeconomic status (Fig 2). The retrospective survey investigated the habits of youth citizen scientists’ smartphone use. Later, during a period of eight days, the app triggered daily EMAs to capture prospective smartphone use including weekdays and weekends (Fig 2). In addition, youth citizen scientists reported on their school environment, including available facilities and resources at their school, as well as the level of family and friends’ involvement and encouragement to perform physical activities [19].
Participants
To achieve 90% confidence level and a 5% margin of error, a sample size calculation resulted in the sample size to be at least 161. Regina Public and Catholic School Boards were contacted for recruitment of youth citizen scientists, and in-person recruitment sessions were initiated August 31st, 2018, until December 31st of the same year. As a result, a total of 436 youth citizen scientists were recruited from five schools (aged 13–21). During the recruitment sessions, researchers demonstrated how to use the smartphone application, and youth citizen scientists were able to download and join the study at any time during the recruitment period (August 31st -December 31st, 2018). In addition, although all citizen scientists received a one-week pass to a community fitness centre as an incentive for their participation in the Platform, an overwhelming majority (>95%) did not utilize the pass [7].
Inclusion criteria
All youth citizen scientists providing their data in this study were students enrolled in the participating schools, including students who were over 18 years of age as one of the schools had mature high school students (18–21). The key inclusion criteria for this study were: 1) participants provided valid data longitudinally via EMAs on at least one day 2) participants provided cross sectional data via retrospective surveys. Records with substantial missing data were excluded from the analysis to prevent bias and ensure the reliability of the results. Following the application of the inclusion criteria, 88 youth citizen scientists were included in the study. Furthermore, outliers were removed from the analysis. Subsequently, the Interquartile range (IQR) technique was implemented to identify outliers in the continuous data [20]. These outliers were removed from the dataset prior to final analyses. Consequently, this comprehensive cleaning process resulted in a refined dataset comprising 77 youth citizen scientists, enhancing the validity of the subsequent analyses and ensuring that the findings were based on robust and reliable data (See Fig 3).
Ethics
The Research Ethics Boards at the Universities of Regina and Saskatchewan approved the Smart Platform’s application for research ethics approval (REB # 2017–029). Written informed consent was provided to all youth citizen scientists through the application. However, youth citizen scientists between the ages of 13–16 years were required to provide written implied consent obtained from either their caregiver(s) or parent(s) before the scheduled recruitment sessions [19].
Measures
Dependent variables.
Dependent variables were mean values of smartphone use on weekdays, weekends, and overall retrospective and prospective (EMAs) per day. The retrospective survey questions were deployed on day one of engagement via a custom-built application, while EMAs were deployed daily (8:00 pm-11:30 pm) and were set to expire by 01:00 am.
The 9-questions Sedentary Behaviour Questionnaire Survey questions, which is a retrospective traditional data collection tool, was modified for digital deployment on citizen scientists’ smartphones [18]. The retrospective modified survey asked questions such as: “On a typical weekday during the school year, how much time do you spend on your smartphone for Internet surfing (e.g., Facebook, Snapchat, Instagram, YouTube, Reddit, reading news, etc.)?”. From youth responses, weekday mean minutes of retrospective smartphone use was derived. Further the retrospective survey asked: “On a typical weekend during the school year, how much time do you spend on your smartphone for internet surfing (e.g., Facebook, Snapchat, Instagram, YouTube, Reddit, reading news, etc.)?”. From youth responses, weekend mean minutes of retrospective smartphone use was derived. In order to obtain overall retrospective smartphone use, the sum of mean weekday and weekend smartphone use was derived and averaged.
To ascertain prospective smartphone use, EMA questions asked: “Which of the following did you do yesterday?” With response options to include: “Watched television”, “Internet surfing using desktop/laptop/gaming device/television screen”, “Used smartphone for internet surfing”, “Texted using a phone”, “Played games on smartphones”, “Listened to music while sitting”, “Played a musical instrument while sitting”, “Did arts and crafts while sitting”, and “Drove or sat in a car/bus.”, “How many minutes did you spend doing this activity?”, and “With whom did you do this activity?” From these responses, weekend mean minutes of prospective smartphone use was derived. To obtain overall prospective smartphone use, a sum of weekday mean minutes of prospective smartphone use and weekend mean minutes of prospective smartphone use was derived and averaged. Both retrospective and prospective overall, weekday, and weekend mean minutes of smartphone use were the primary dependent variables of this study.
Independent variables.
The independent variables encompassed Physical activity strength, school physical activity environment, and family and friends’ involvement in youth physical activity. Detailed information on all questions, categories, and dichotomized responses can be found in S1 Appendix.
Data and risk management
Data were encrypted before being saved on smartphones and before being sent to secure servers when a device established a Wi-Fi connection to protect confidentiality. The app’s permissions were controlled to avoid accessing any personal data on their smartphones (e.g., contact list or network sites visited). Media Access Control (MAC), a network data transfer policy based on a basic encryption method that cannot be reversed, was used for anonymization, and to secure the information of citizen scientists. During the process of obtaining informed consent, risks and privacy management alternatives were clearly communicated to the citizen scientists [19].
Data analysis
Characteristics of the youth citizen scientists were reported using descriptive statistics. Pearson correlation was used to assess at the association between smartphone use reported retrospectively and prospectively on weekdays and weekends. A paired sample t-test was conducted to explore if there exists a difference in mean minutes/day of retrospective smartphone use, and mean minutes/day of prospective smartphone use reported on weekday and weekend. Additionally, this study investigates if there exists a difference in mean minutes of smartphone use per day retrospectively and prospectively based on gender of youth citizen scientists. Multiple linear regression models were developed to explore the contextual and behavioural factors associated with retrospective and prospective smartphone use among youth citizen scientists. Statistical analyses were conducted using Python statistical software with a significance level of p < 0.05.
Results
Table 1. presents the results of the descriptive analysis conducted on the final dataset provided by 77 youth citizen scientists. Approximately 67.10% of the participants were female, and 64.47% did not have a part-time job. Additionally, only 35.06% of the youth reported participating in a sports team at their school, while around 37.66% reported engaging in muscle training activities for four days or more (Table 1).
There was a significant difference between overall (weekdays+weekend days) mean minutes of smartphone use/day reported retrospectively (218.28 minutes/day) and prospectively (53.50minutes/day) (Table 2). Similarly, youth also reported more smartphone use on both weekdays and weekend days retrospectively using the traditional surveys (214.01minutes/day; 211.50minutes/day), compared to smartphone use reported prospectively via EMAs (54.10minutes/day; 68.80minutes/day). This pattern continued among both females and males (Table 3). There was a significant difference between overall (weekdays+weekend days), weekdays, and weekends mean smartphone use reported retrospectively (240.14 minutes, 255.90 minutes, and 266.47 minutes) and prospectively (51.84 minutes, 50.38 minustes, and 57.13 minutes) among female youth citizen scientists (p<0.001). This was also observed in overall (weekdays+weekend days) and weekdays mean smartphone use reported retrospectively (144.20 minutes, 171.32 minutes) and prospectively (64.41 minutes, 61.89 minutes) among male youth citizen scientists (p<0.001). However, among male citizen scientists, there was no significant difference between weekend mean smartphone use reported retrospectively and prospectively.
After controlling for age, results of the multiple linear regression models exploring social and contextual factors associated with overall, weekday, and weekend smartphone use reported via retrospectively surveys and prospective EMAs are portrayed in tables 4, 5, and 6, respectively. Within the overall retrospective model (Table 4 –Model 1), youth citizen scientists who reported having a part-time job (β = 139.64, 95% confidence interval [CI] = 34.759, 244.519, p-value = 0.010) reported more smartphone use compared to youth citizen scientists who did not have part-time jobs. In contrast, youth citizen scientist who had more than two friends who are physically active (β = -114.72, 95%[CI] = -208.872, -20.569, p-value = 0.018) reported less smartphone use in comparison to youth who had less than two friends that were physically active. However, none of these relationships were found to be significant in the prospective EMA model (Table 4-Model 2).
In the weekday retrospective regression model (Table 5 –Model 3), youth who reported not having a part-time job (β = 108.5, 95%[CI] = 10.727, 206.264, p-value = 0.03) were significantly associated with more minutes of smartphone use compared to youth who had a part-time job. This association was not found to be significant in the prospective model (Table 5 –Model 4).
In the weekend retrospective model (Table 6 - Model 5), youth citizen scientists who did not have a part-time job (β = 127.28, 95%[CI] = 20.831, 233.730, p-value = 0.020) reported significantly greater smartphone use compared to youth who did not have a part-time job. Male youth citizen scientist reported significantly lower smartphone use (β = -121.44, 95%[CI] = -220.227, -22.654, p-value = 0.017). Similarly, youth who reported having more than two friends were found to be associated with less smartphone use (β = -140.850, 95%[CI] = -236.326, -45.374, p-value = 0.004) as compared to youth who did not report participating in school sports team. However, these significant associations were not found to be significant in the prospective EMA model (Table 6 –Model 6).
Discussion
The objective of this study was to compare smartphone use reported via retrospective surveys and prospective EMAs by engaging with youth citizen scientists via their own smartphones. The study also investigated the behavioural, and contextual factors that are associated with smartphone use reported via retrospective surveys and prospective EMAs. The primary findings of this study demonstrate that there is a significant difference in smartphone use reported retrospectively (via validated surveys) and prospectively (via EMAs). While evidence generally indicates that retrospective data collection is prone to bias irrespective of overestimation or under-estimation [21–23], to our knowledge, no research has been carried out to compare retrospective recall surveys and prospective EMAs to assess smartphone use within the same cohort of participants.
While there is some evidence of over-estimation of sedentary behaviours when reporting retrospectively [21], and discrepancies in reporting smartphone use between males and females [24], our study is the first digital epidemiological investigation that compared smartphone use reporting retrospectively and prospectively among the same cohort of youth. There is some evidence that individuals who are more socially engaged might over-estimate their smartphone use, while individuals who under-estimate their smartphone use may have lost track of time [22]. In general, evidence indicates that prospective measurement of behaviours using EMAs is less susceptible to recall bias [18,25].
Although the World Health Organization guidelines indicate that youth aged 15–18 should not spend more than two hours of screentime per day [26], current evidence indicates that youth across the world spend significantly more time than two hours/day on screens [27,28]. The uncontrolled screentime has detrimental effects on both physical and mental health leading to increased risk of non-communicable chronic diseases such as obesity, diabetes, heart diseases, reduced sleep quality as well as stress, anxiety, and depression [29]. Furthermore, the screentime guidelines do not specify the time that youth should spend on mobile devices, particularly smartphones, which most youth have access to in this digital age [30,31]. This gap in guidelines needs to be addressed, particularly because smartphones are the primary devices of day-to-day functioning, and excessive smartphone use is associated with poor youth health outcomes [5,15,32]
However, to understand associations between smartphone use and youth health outcomes, it is imperative to obtain valid and reliable data from the youth, which, again ironically is possible via smartphones themselves due to their near universal usage among youth [5,33]. This study utilized the Smart platform [19], a digital citizen science platform that engaged youth as citizen scientists to obtain both retrospective and prospective smartphone use via their own smartphones [7].
This approach also enabled our team to obtain relevant data on behavioral, contextual, and demographic factors to investigate the association of these variables with both retrospective and prospective smartphone use among youth. Moreover, as evidence indicates that smartphone use and screentime in general varies between weekdays and weekend days [5,32] this study explored the association of behavioural and contextual factors with overall (weekday+weekend day) youth smartphone use, as well as weekday and weekend day smartphone use reported by both retrospective surveys and prospective EMAs.
One consistent finding was that there were no significant associations between socio-demographic and contextual factors with overall, weekday, and weekend day smartphone use reported via EMAs.
However, retrospective models showed some common associations between sociodemographic and contextual factors with overall, weekday and weekend day smartphone use. Youth who reported that they did not have a part-time job also reported significantly more overall, weekday, and weekend day smartphone use in comparison with youth who had a part-time job—a finding that is consistent with some existing evidence [34], and potentially an indication that youth, due to the nature of part-time work they do, do not have access to smartphones consistently.
Likewise, a systemized review reported that having friends who are physically active is associated with increasing the level of physical activity of their peers and lowering sedentary behaviour [35]. This finding is consistent with the findings of our study, which also showed that youth who have more than two friends who are physically active reported lower smartphone use on weekends.
Irrespective of the direction of association of contextual and sociodemographic variables, there are some important aspects that must be highlighted in understanding smartphone use in general, and particularly among youth. First, all significant findings were depicted in the retrospective smartphone use reporting models, and no significant findings were depicted in the prospective smartphone use reporting (EMAs). This in itself is a major finding that emphasizes the rationale for conducting this study–it is critical that more accurate measures of reporting be standardized to understand smartphone use because retrospective self-reporting data collection tools are prone to bias and misclassification [15,36,37].
Second, it is imperative to appreciate the complexity of smartphone use, which includes various behaviours and motivations, such as social media use, gaming, and texting, among others, which have varying associations with health outcomes [38–41]. To capture these effectively and accurately, it is critical to move towards prospective measures such as EMAs which minimize recall bias, particularly when the reporting is complicated by the wide range of behaviours [42]. Objective measures provide accurate overall smartphone use estimates [7], however, capturing the variation in smartphone use ethically, while simultaneously preserving privacy can be challenging [43]. This challenge may arise from the potential extraction of personal and sensitive information from mobile device sensor data [44]. Extracting personal and sensitive information from mobile device sensor data may potentially also breach user privacy [45]. These challenges must be navigated carefully to ensure ethical standards are maintained. Moreover, objective measures can indeed provide a more accurate and detailed breakdown of smartphone use, including specific app usage. However, objective data does need to be triangulated with subjective information from citizens, which will enable validation of data [46]. The objective measures are ideal for capturing volume, type, and frequency of smartphone use if the privacy concerns can be mitigated [47].
Finally, the contextual and sociodemographic associations of smartphone use also have to be captured prospectively to minimize bias, while again, appreciating the complexity of smartphone access itself [12]. For instance, male youth citizen scientists reported less smartphone use compared to female youth citizen scientists, which is consistent with the findings of other studies [24].
Perhaps more importantly, the approaches we use to capture digital data ethically from citizens must be revisited. In scientific research settings, the power often lies with those who have knowledge such as researchers, which has been an obstacle for meaningful data collection, particularly if the data are sensitive and need to be obtained via citizen-owned devices [47]. Digital citizen science is an approach that can democratize science through engagement with citizens ethically and directly to obtain prospective big data [48–50]–an approach that was utilized while collecting data from youth in this study via their own smartphones [7,51–54].
Appropriate measurement of smartphone use among youth is critical to not only inform potential smartphone use recommendations [15], but to also determine the appropriate use for digital health interventions [16]. These interventions have the potential to address mental health illnesses at a reduced cost and improve access to resources [33].
Strengths and limitations
No studies have compared smartphone use among youth using validated retrospective traditional surveys and prospective EMAs. The strengths of this study include utilizing citizen science approaches, where youth used their own devices to engage with the researchers. The key limitation is that the smartphone use reported in this study does not delineate between the different types of smartphone use informed by varied motivations–social media, texting, gaming, among others. Another limitation is that data were collected during one season even though there is evidence that screentime and sedentary behaviours are influenced by changes in weather [55,56]. Additionally, failing to meet the required sample size is a significant limitation of this study. Nevertheless, the unique nature of this study sets a foundation for future investigations, encouraging further exploration and validation. Future studies should not only measure different types of smartphone use, but also aim to capture objective data to improve accuracy of reporting, while taking seasonality into consideration [57,58].
Conclusion
The findings of this study have implications for appropriately understanding and monitoring smartphone use in the digital age among youth. EMAs can potentially minimize recall bias of smartphone use among youth, and other behaviours. More importantly, digital citizen science approaches that engage large populations of youth using their own smartphones can transform how we ethically monitor and mitigate the impact of excessive smartphone use.
Supporting information
S1 Appendix. Description of Independent variables used in the study.
https://doi.org/10.1371/journal.pdig.0000448.s001
(DOCX)
References
- 1.
Jiang MA and J. Teens, Social Media and Technology 2018 [Internet]. Pew Research Center. 2018 [cited 2024 Jun 4]. Available from: https://www.pewresearch.org/internet/2018/05/31/teens-social-media-technology-2018/
- 2. Richter A, Adkins V, Selkie E. Youth Perspectives on the Recommended Age of Mobile Phone Adoption: Survey Study. JMIR Pediatr Parent. 2022;5:e40704. pmid:36315219
- 3. LeBlanc AG, Gunnell KE, Prince SA, Saunders TJ, Barnes JD, Chaput J-P. The Ubiquity of the Screen: An Overview of the Risks and Benefits of Screen Time in Our Modern World. Translational Journal of the American College of Sports Medicine. 2017;2:104.
- 4. Ryding FC, Kuss DJ. Passive objective measures in the assessment of problematic smartphone use: A systematic review. Addictive Behaviors Reports. 2020;11:100257. pmid:32467846
- 5. Brodersen K, Hammami N, Katapally TR. Is excessive smartphone use associated with weight status and self-rated health among youth? A smart platform study. BMC Public Health. 2023;23:234.
- 6. Hale L, Guan S. Screen time and sleep among school-aged children and adolescents: a systematic literature review. Sleep Med Rev. 2015;21:50–8. pmid:25193149
- 7. Katapally TR, Hammami N, Chu LM. A randomized community trial to advance digital epidemiological and mHealth citizen scientist compliance: A smart platform study. PLOS ONE. 2021;16:e0259486. pmid:34723987
- 8. Dunton GF. Ecological Momentary Assessment in Physical Activity Research. Exercise and Sport Sciences Reviews. 2017;45:48. pmid:27741022
- 9. Russell MA, Gajos JM. Annual Research Review: Ecological momentary assessment studies in child psychology and psychiatry. J Child Psychol Psychiatry. 2020;61:376–94. pmid:31997358
- 10. Perski O, Keller J, Kale D, Asare BY-A, Schneider V, Powell D, et al. Understanding health behaviours in context: A systematic review and meta-analysis of ecological momentary assessment studies of five key health behaviours. Health Psychol Rev. 16:576–601. pmid:35975950
- 11. Asselbergs J, Ruwaard J, Ejdys M, Schrader N, Sijbrandij M, Riper H. Mobile Phone-Based Unobtrusive Ecological Momentary Assessment of Day-to-Day Mood: An Explorative Study. Journal of Medical Internet Research. 2016;18:e5505. pmid:27025287
- 12. Romanzini CLP, Romanzini M, Batista MB, Barbosa CCL, Shigaki GB, Dunton G, et al. Methodology Used in Ecological Momentary Assessment Studies About Sedentary Behavior in Children, Adolescents, and Adults: Systematic Review Using the Checklist for Reporting Ecological Momentary Assessment Studies. Journal of Medical Internet Research. 2019;21:e11967. pmid:31094349
- 13. Katapally TR, Chu LM. Digital epidemiological and citizen science methodology to capture prospective physical activity in free-living conditions: a SMART Platform study. BMJ Open. 2020;10:e036787. pmid:32595163
- 14. Atkin AJ, Sharp SJ, Corder K, van Sluijs EMF. Prevalence and Correlates of Screen Time in Youth: An International Perspective. American Journal of Preventive Medicine. 2014;47:803–7. pmid:25241193
- 15. Brodersen K, Hammami N, Katapally TR. Smartphone Use and Mental Health among Youth: It Is Time to Develop Smartphone-Specific Screen Time Guidelines. Youth. 2022;2:23–38.
- 16. Katapally TR. Smart Indigenous Youth: The Smart Platform Policy Solution for Systems Integration to Address Indigenous Youth Mental Health. JMIR Pediatrics and Parenting. 2020;3:e21155. pmid:32975527
- 17. Katapally TR. The SMART Framework: Integration of Citizen Science, Community-Based Participatory Research, and Systems Science for Population Health Science in the Digital Age. JMIR mHealth and uHealth. 2019;7:e14056. pmid:31471963
- 18. Ibrahim ST, Hammami N, Katapally TR. Traditional surveys versus ecological momentary assessments: digital citizen science approaches to improve ethical physical activity surveillance among youth [Internet]. medRxiv; 2023 [cited 2023 Aug 7]. p. 2023.06.06.23291067. Available from: https://www.medrxiv.org/content/10.1101/2023.06.06.23291067v1
- 19. Katapally TR, Bhawra J, Leatherdale ST, Ferguson L, Longo J, Rainham D, et al. The SMART Study, a Mobile Health and Citizen Science Methodological Platform for Active Living Surveillance, Integrated Knowledge Translation, and Policy Interventions: Longitudinal Study. JMIR Public Health and Surveillance. 2018;4:e8953. pmid:29588267
- 20.
Vinutha HP, Poornima B, Sagar BM. Detection of Outliers Using Interquartile Range Technique from Intrusion Dataset. In: Satapathy SC, Tavares JMRS, Bhateja V, Mohanty JR, editors. Information and Decision Sciences. Singapore: Springer; 2018. p. 511–8.
- 21. Andorko ND, Rakhshan-Rouhakhtar P, Hinkle C, Mittal VA, McAllister M, DeVylder J, et al. Assessing validity of retrospective recall of physical activity in individuals with psychosis-like experiences. Psychiatry Research. 2019;273:211–7. pmid:30658204
- 22. Hodes LN, Thomas KGF. Smartphone Screen Time: Inaccuracy of self-reports and influence of psychological and contextual factors. Computers in Human Behavior. 2021;115:106616.
- 23. Wang X, Li Y, Fan H. The associations between screen time-based sedentary behavior and depression: a systematic review and meta-analysis. BMC Public Health. 2019;19:1524. pmid:31727052
- 24.
Andone I, Błaszkiewicz K, Eibes M, Trendafilov B, Montag C, Markowetz A. How age and gender affect smartphone usage. Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct [Internet]. New York, NY, USA: Association for Computing Machinery; 2016 [cited 2023 Sep 11]. p. 9–12. Available from: https://dl.acm.org/doi/10.1145/2968219.2971451
- 25. Degroote L, DeSmet A, De Bourdeaudhuij I, Van Dyck D, Crombez G. Content validity and methodological considerations in ecological momentary assessment studies on physical activity and sedentary behaviour: a systematic review. International Journal of Behavioral Nutrition and Physical Activity. 2020;17:35. pmid:32151251
- 26. Chaput J-P, Willumsen J, Bull F, Chou R, Ekelund U, Firth J, et al. 2020 WHO guidelines on physical activity and sedentary behaviour for children and adolescents aged 5–17 years: summary of the evidence. Int J Behav Nutr Phys Act. 2020;17:141.
- 27. Alosaimi FD, Alyahya H, Alshahwan H, Mahyijari NA, Shaik SA. Smartphone addiction among university students in Riyadh, Saudi Arabia. Saudi Med J. 2016;37:675–83. pmid:27279515
- 28. Kelly S, Stephens J, Hoying J, McGovern C, Melnyk BM, Militello L. A systematic review of mediators of physical activity, nutrition, and screen time in adolescents: Implications for future research and clinical practice. Nursing Outlook. 2017;65:530–48. pmid:28823500
- 29. Stiglic N, Viner RM. Effects of screentime on the health and well-being of children and adolescents: a systematic review of reviews. BMJ Open. 2019;9:e023191. pmid:30606703
- 30. Bull FC, Al-Ansari SS, Biddle S, Borodulin K, Buman MP, Cardon G, et al. World Health Organization 2020 guidelines on physical activity and sedentary behaviour. Br J Sports Med. 2020;54:1451–62. pmid:33239350
- 31. Sampasa-Kanyinga H, Colman I, Goldfield GS, Janssen I, Wang J, Podinic I, et al. Combinations of physical activity, sedentary time, and sleep duration and their associations with depressive symptoms and other mental health problems in children and adolescents: a systematic review. The International Journal of Behavioral Nutrition and Physical Activity [Internet]. 2020 [cited 2023 Nov 29];17. Available from: https://journals.scholarsportal.info/details/14795868/v17inone/nfp_copastcaaasr.xml pmid:32503638
- 32. Tang S, Werner-Seidler A, Torok M, Mackinnon AJ, Christensen H. The relationship between screen time and mental health in young people: A systematic review of longitudinal studies. Clinical Psychology Review. 2021;86:102021. pmid:33798997
- 33. Liverpool S, Mota CP, Sales CMD, Čuš A, Carletto S, Hancheva C, et al. Engaging Children and Young People in Digital Mental Health Interventions: Systematic Review of Modes of Delivery, Facilitators, and Barriers. J Med Internet Res. 2020;22:e16317. pmid:32442160
- 34.
Kalenkoski CM, Pabilonia SW. Time to Work or Time to Play: The Effect of Student Employment on Homework, Sleep, and Screen Time [Internet]. Rochester, NY; 2010 [cited 2023 Sep 12]. Available from: https://papers.ssrn.com/abstract=1530670
- 35. Sawka KJ, McCormack GR, Nettel-Aguirre A, Hawe P, Doyle-Baker PK. Friendship networks and physical activity and sedentary behavior among youth: a systematized review. Int J Behav Nutr Phys Act. 2013;10:130. pmid:24289113
- 36. Katapally TR, Chu LM. Methodology to Derive Objective Screen-State from Smartphones: A SMART Platform Study. International Journal of Environmental Research and Public Health. 2019;16:2275. pmid:31252617
- 37. Lee PH, Macfarlane DJ, Lam T, Stewart SM. Validity of the international physical activity questionnaire short form (IPAQ-SF): A systematic review. International Journal of Behavioral Nutrition and Physical Activity. 2011;8:115. pmid:22018588
- 38. Paulus FW, Ohmann S, von Gontard A, Popow C. Internet gaming disorder in children and adolescents: a systematic review. Developmental Medicine & Child Neurology. 2018;60:645–59. pmid:29633243
- 39. Kuss DJ, Griffiths MD. Internet gaming addiction: A systematic review of empirical research. International Journal of Mental Health and Addiction. 2012;10:278–96.
- 40. Hussain Z, Griffiths MD. Problematic Social Networking Site Use and Comorbid Psychiatric Disorders: A Systematic Review of Recent Large-Scale Studies. Frontiers in Psychiatry [Internet]. 2018 [cited 2023 Dec 19];9. Available from: https://journals.scholarsportal.info/details/16640640/v9inone/nfp_psnsuasrorls.xml pmid:30618866
- 41. Katapally TR, Laxer RE, Qian W, Leatherdale ST. Do school physical activity policies and programs have a role in decreasing multiple screen time behaviours among youth? Preventive Medicine. 2018;110:106–13. pmid:29197536
- 42. Katapally TR, Audur Sjofn T, Rachel L, Wei Q, Scott T. L. Original quantitative research The association of school connectedness and bullying involvement with multiple screen-time behaviours among youth in two Canadian provinces: a COMPASS study. Health Promot Chronic Dis Prev Can. 2018;38:368–79.
- 43. Lustgarten SD, Garrison YL, Sinnard MT, Flynn AW. Digital privacy in mental healthcare: current issues and recommendations for technology use. Current Opinion in Psychology. 2020;36:25–31. pmid:32361651
- 44. Delgado-SantosPaula StragapedeGiuseppe, TolosanaRuben GuestRichard, DeraviFarzin Vera-RodriguezRuben. A Survey of Privacy Vulnerabilities of Mobile Device Sensors. ACM Computing Surveys (CSUR) [Internet]. 2022 [cited 2024 Jun 4]; Available from: https://dl.acm.org/doi/10.1145/3510579
- 45.
Kröger J. Unexpected Inferences from Sensor Data: A Hidden Privacy Threat in the Internet of Things. In: Strous L, Cerf VG, editors. Internet of Things Information Processing in an Increasingly Connected World. Cham: Springer International Publishing; 2019. p. 147–59.
- 46. Noble H, Heale R. Triangulation in research, with examples. Evidence-Based Nursing. 2019;22:67–8. pmid:31201209
- 47. Straczkiewicz M, James P, Onnela J-P. A systematic review of smartphone-based human activity recognition methods for health research. npj Digit Med. 2021;4:1–15.
- 48. Groot B, Abma T. Ethics framework for citizen science and public and patient participation in research. BMC Medical Ethics. 2022;23:23. pmid:35282819
- 49. Kullenberg C, Kasperowski D. What Is Citizen Science?–A Scientometric Meta-Analysis. PLOS ONE. 2016;11:e0147152. pmid:26766577
- 50. Tauginienė L, Butkevičienė E, Vohland K, Heinisch B, Daskolia M, Suškevičs M, et al. Citizen science in the social sciences and humanities: the power of interdisciplinarity. Palgrave Commun. 2020;6:1–11.
- 51. Rosas LG, Rodriguez Espinosa P, Montes Jimenez F, King AC. The Role of Citizen Science in Promoting Health Equity. Annual Review of Public Health. 2022;43:215–34. pmid:34724389
- 52. Uhlhaas P, Torous J. Digital tools for youth mental health. npj Digit Med. 2019;2:1–3.
- 53. Walker S, Kannan P, Bhawra J, Foulds H, Katapally TR. The Impact of Culture, Identity and Intergenerational Connections on Indigenous Youth Mental Health: Qualitative Findings from a Longitudinal Digital Health Community Tria [Internet]. 2021 [cited 2023 Sep 12]. Available from: https://doi.org/10.21203/rs.3.rs-956256/v1
- 54. Tan Y-R, Agrawal A, Matsoso MP, Katz R, Davis SLM, Winkler AS, et al. A call for citizen science in pandemic preparedness and response: beyond data collection. BMJ Glob Health. 2022;7:e009389. pmid:35760438
- 55.
Nations U. Capacity-Building [Internet]. United Nations. United Nations; [cited 2023 Sep 12]. Available from: https://www.un.org/en/academic-impact/capacity-building
- 56. Katapally TR, Rainham D, Muhajarine N. The Influence of Weather Variation, Urban Design and Built Environment on Objectively Measured Sedentary Behaviour in Children. AIMS Public Health. 2016;3:663–81. pmid:29546188
- 57. Zheng C, Feng J, Huang W, Wong SH-S. Associations between weather conditions and physical activity and sedentary time in children and adolescents: A systematic review and meta-analysis. Health & Place. 2021;69:102546. pmid:33714181
- 58. Katapally TR, Rainham D, Muhajarine N. A methodology to leverage cross-sectional accelerometry to capture weather’s influence in active living research. Can J Public Health. 2016;107:e30–6. pmid:27348107