Master’s Thesis & Research Assistantship
Thesis, School of Engineering and Applied Science, University of Pennsylvania, 2021
My research is being supervised by Dr. Lyle Ungar Professor in Computer and Information Science at Penn Engineering and Psychology at the School of Arts & Sciences and Dr. Sharath Chandra Guntuku Professor in Computer and Information Science. Professor Lyle Ungar’s research group (World Well-Being Project) develops explainable machine learning, deep learning, and natural language processing methods for psychology and medical research. The World Well-Being Project (WWBP) founded by the Father of Positive Psychology, Dr. Martin EP Seligman, pioneers scientific techniques for measuring psychological well-being and physical health based on the analysis of language in social media. The World Well-Being Project is based out of the University of Pennsylvania’s Positive Psychology Center and Stony Brook University’s Human Language Analysis Lab.
In my ongoing master’s thesis I aim to compare the health and lifestyle of people before and after the pandemic hit the world. This involves studying the impact of public events (Covid-19) on the behavioral, social, and environmental determinants of health with special focus on risks associated with cardio-vascular disease (CVD) by leveraging diverse text data (Title of discussion, content of discussion and comments on discussion) available on different groups on Reddit (known as Subreddits).
Dual Objective
- Track and analyze the user engagement across CVD related subreddits (Diet, Physical Activities, Substance Use & Smoking) from January, 2019 to December, 2020
- Track and analyze how COVID-19 affect language associated with the behavioral, social, and environmental determinants of CVD related health behaviors
Deep Diving in the research objectives
Temporal Shifts: In my research, I seek answer to the question whether social isolation during the pandemic modified any former, trends in eating habits and fitness, frequency and variety of drug abuse, frequency and intensity of physical activities and frequency of smoking and vaping. I wish to uncover these shifts in trends for each broader group by comparing discussions happened in pre-pandemic cluster of subreddits with during pandemic cluster of subreddits. I also assess the influence of discussions happening in one subreddit over other subreddits using temporal topical correlation.
Drug/Smoking/Alcohol Transition:
Prospective mortality studies conducted in the 1960s and 1970s showed a clear increase in coronary heart disease mortality with an increase in the number of cigarettes smoked per day, regardless of the actual number (Doll and Peto 1976, USDHHS 1983).
(Klatsky 1996) concludes alcohol consumption of three or more drinks per day raises blood pressure and levels of triglycerides that are important cardiovascular risk factors.
(Li et al. 2020) concludes that patients with a history of cardiovascular metabolic diseases may face a greater risk of developing into the severe condition upon contraction of Covid-19.
(Leung et al., 2020; Russo et al., 2020; Zhang et al., 2020), provide evidence that vaping or consumption of tobacco increases the risk of infection and progression of Covid-19.
From (i) and (ii) we infer that smoking and alcohol increase the risk of cardio-vascular disease and mortality. From (iii) and (iv) we infer that having a history of cardiovascular disease or consuming tobacco, deteriorates the condition of patient upon contraction of Covid-19 and can be fatal. Thus, it is important to analyze whether the isolation during Covid-19 increased the consumption tobacco, alcohol and illicit substances or were people successful in quitting.
Execution/Procedure
- Mine the data from over 50 different subreddits that possibly resonate with the 4 broader groups (Diet, Physical Activities, Substance Use & Smoking) using the pushshift API
- Shortlist the subreddits based on number of posts, comments and members of subreddits
- Perform exploratory data analysis on the finalized 22 subreddits containing approximately 1 Million posts and 2.7 Million comments
- Leverage DLATK package for Python to identify latent topics present in the posts and comments through Latent Dirichlet Allocation (LDA; Blei et al., 2003)
- Perform temporal analysis on the topics generated to record inference
Differential Language Analysis ToolKit (DLATK)
DLATK is an end to end human text analysis package, specifically suited for social media and social scientific applications. It is written in Python 3 and developed by the World Well-Being Project (WWBP) at the University of Pennsylvania and Stony Brook University. It contains:
- feature extraction
- part-of-speech tagging
- correlation
- prediction and classification
- mediation
- dimensionality reduction and clustering
- wordcloud visualization
DLATK can utilize:
- Mallet for creating LDA topics
- Stanford Parser
- CMU’s TweetNLP
- pandas dataframe output