Research
The Computational Social Listening Lab utilizes machine learning, deep learning, and natural language processing methods to uncover insights about health attitudes, behaviors, and outcomes, with a particular focus on health disparities and mental health and wellbeing. This team has developed computational models to measure and understand topics as wide-ranging as life satisfaction, ADHD, misinformation exposure, COVID-19 symptoms, and friendship using large-scale user-generated text, image, and mobile sensor data.
Currently, the lab’s work focuses on global mental health, vaccine acceptance, and firearms safety. Priorities include:
-Digital mental health
-Cultural and racial heterogeneity in health behaviors and outcomes
-Developing precision public health messaging
Highlighted
All
2023
Language on Reddit Reveals Differential Mental Health Markers for Individuals posting in Immigration Communities
Proceedings of the 15th ACM Web Science Conference, 2023
A Cross-Modal Study of Pain Across Communities in the United States
Companion Proceedings of the ACM Web Conference 2023, (pp. 1050-1058), 2023
“That’s Interesting!”: Using Facebook Language to Predict Vocational Interests
Academy of Management Proceedings 2023 (1), 10905, 2023
Investigating Social Media to Evaluate Emergency Medicine Physicians’ Emotional Well-being During COVID-19
JAMA Network Open 6 (5), e2312708-e2312708, 2023
Different Affordances on Facebook and SMS Text Messaging Do Not Impede Generalization of Language-Based Predictive Models
Proceedings of the International AAAI Conference on Web and Social Media 17 …, 2023
Multilingual Language Models are not Multicultural: A Case Study in Emotion
arXiv preprint arXiv:2307.01370, 2023
Generative adversarial networks based skin lesion segmentation
Scientific Reports 13 (1), 13467, 2023
Historical patterns of rice farming explain modern-day language use in China and Japan more than modernization and urbanization
arXiv preprint arXiv:2308.15352, 2023
Detecting Histologic & Clinical Glioblastoma Patterns of Prognostic Relevance
arXiv preprint arXiv:2302.00669, 2023
Effect of integrating patient-generated digital data into mental health therapy: a randomized controlled trial
Psychiatric Services 74 (8), 876-879, 2023
Detecting Symptoms of Depression on Reddit
Proceedings of the 15th ACM Web Science Conference, 2023
Dear Pandemic: A topic modeling analysis of COVID-19 information needs among readers of an online science communication campaign
PloS one 18 (3), e0281773, 2023
Reddit language indicates changes associated with diet, physical activity, substance use, and smoking during COVID-19
Plos one 18 (2), e0280337, 2023
2022
Transformer-based quality assessment model for generalized user-generated multimedia audio content
Proc. Interspeech 2022, 674-678, 2022
Did that happen? predicting social media posts that are indicative of what happened in a scene: a case study of a TV show
European Language Resources Association, 2022
Myanmar Economic Monitor, January 2022: Contending with Constraints
World Bank, 2022
A Weakly-Supervised Iterative Graph-Based Approach to Retrieve COVID-19 Misinformation Topics
arXiv preprint arXiv:2205.09416, 2022
Characterizing Responses to COVID-19 Vaccine Promotion on TikTok
American Journal of Health Promotion, 08901171221141974, 2022
Head versus heart: social media reveals differential language of loneliness from depression
npj Mental Health Research 1 (1), 16, 2022
Patient experience and satisfaction in online reviews of obstetric care: observational study
JMIR Formative Research 6 (3), e28379, 2022
COVID-19 contact tracing app reviews reveal concerns and motivations around adoption
Plos one 17 (9), e0273222, 2022
WWBP-SQT-lite: Multi-level models and difference embeddings for moments of change identification in mental health forums
Proceedings of the Eighth Workshop on Computational Linguistics and Clinical …, 2022
Social media reveals urban-rural differences in stress across china
Proceedings of the International AAAI Conference on Web and Social Media 16 …, 2022
Stretching artifacts identification for quality assessment of 3D-synthesized views
IEEE Transactions on Image Processing 31, 1737-1750, 2022
Perceptually unimportant information reduction and Cosine similarity-based quality assessment of 3D-synthesized images
IEEE Transactions on Image Processing 31, 2027-2039, 2022
Understanding the expression of loneliness on Twitter across age groups and genders
Plos one 17 (9), e0273636, 2022
Twitter corpus of the# blacklivesmatter movement and counter protests: 2013 to 2021
Proceedings of the International AAAI Conference on Web and Social Media 16 …, 2022
2021
Localizing features with masking for satellite and debris classification
2021 IEEE International Conference on Image Processing Challenges (ICIPC), 16-20, 2021
Improving mood through community connection and resources using an interactive digital platform: development and usability study
JMIR Mental Health 8 (2), e25834, 2021
Analyzing online reviews of substance use disorder treatment facilities in the USA using machine learning
Journal of General Internal Medicine, 1-4, 2021
Well-Being Depends on Social Comparison: Hierarchical Models of Twitter Language Suggest That Richer Neighbors Make You Less Happy
Proceedings of the International AAAI Conference on Web and Social Media, 2021
Nonintrusive Perceptual Audio Quality Assessment for User-Generated Content Using Deep Learning
IEEE Transactions on Industrial Informatics 18 (11), 7780-7789, 2021
Social media language of healthcare super-utilizers
NPJ digital medicine 4 (1), 55, 2021
The rural–urban stress divide: Obtaining geographical insights through Twitter
Computers in Human Behavior 114, 106544, 2021
Understanding social support expressed in a COVID-19 online forum
Proceedings of the 12th International Workshop on Health Text Mining and …, 2021
Partisan differences in twitter language among US legislators during the COVID-19 pandemic: Cross-sectional study
Journal of medical Internet research 23 (6), e27300, 2021
Predicting cardiovascular risk using social media data: performance evaluation of machine-learning models
JMIR cardio 5 (1), e24473, 2021
Perceptual quality evaluation of hazy natural images
IEEE Transactions on Industrial Informatics 17 (12), 8046-8056, 2021
The role of digital health technologies in COVID-19 surveillance and recovery: a specific case of long haulers
International Review of Psychiatry 33 (4), 412-423, 2021
How Health Care Workers Wield Influence Through Twitter Hashtags: Retrospective Cross-sectional Study of the Gun Violence and COVID-19 Public Health Crises
JMIR Public Health and Surveillance 7 (1), e24562, 2021
Detecting Covid-19 and Community Acquired Pneumonia Using Chest CT Scan Images With Deep Learning
IEEE International Conference on Acoustics, Speech and Signal Processing …, 2021
Twitter discourse reveals geographical and temporal variation in concerns about COVID-19 vaccines in the United States
Vaccine 39 (30), 4034-4038, 2021
Characterizing COVID-19 content posted to TikTok: public sentiment and response during the first phase of the COVID-19 pandemic
Journal of Adolescent Health 69 (2), 234-241, 2021
The emotional and mental health impact of the murder of George Floyd on the US population
Proceedings of the National Academy of Sciences 118 (39), e2109139118, 2021
2020
Studying social media language changes associated with pregnancy status, trimester, and parity from medical records
Women's Health 16, 1745506520949392, 2020
Interactive Data Visualization with Python: Present your data as an effective and compelling story
Packt Publishing Ltd, 2020
Does Social Support Expressed in Post Titles Elicit Comments in Online Substance Use Recovery Forums?
arXiv preprint arXiv:2011.05103, 2020
Detecting Emerging Symptoms of COVID-19 using Context-based Twitter Embeddings
EMNLP COVID Workshop, 2020
Explaining the Trump Gap in Social Distancing Using COVID discourse
Proceedings of the 1st Workshop on NLP for COVID-19 (Part 2) at EMNLP 2020, 2020
Online reviews of specialized drug treatment facilities—identifying potential drivers of high and low patient satisfaction
Journal of general internal medicine 35, 1647-1653, 2020
Political depression? A big-data, multimethod investigation of Americans’ emotional response to the Trump presidency.
Journal of Experimental Psychology: General 149 (11), 2154, 2020
Studying politeness across cultures using English Twitter and Mandarin Weibo
Proceedings of the ACM on Human-Computer Interaction 4 (CSCW2), 1-15, 2020
Variability in Language used on Social Media Prior to Hospital Visits
Scientific Reports 10 (1), 2020
Examining the phenomenon of quarter-life crisis through artificial intelligence and the language of Twitter
Frontiers in Psychology 11, 341, 2020
Understanding weekly COVID-19 concerns through dynamic content-specific LDA topic modeling
Proceedings of the conference on empirical methods in natural language …, 2020
Public priorities and concerns regarding COVID-19 in an online discussion forum: longitudinal topic modeling
Journal of general internal medicine 35 (7), 2244-2247, 2020
Tracking mental health and symptom mentions on Twitter during COVID-19
Journal of general internal medicine 35, 2798-2800, 2020
2019
Machine learning for phone-based relationship estimation: the need to consider population heterogeneity
Proceedings of the ACM on interactive, mobile, wearable and ubiquitous …, 2019
Exploring (dis-) similarities in emoji-emotion association on twitter and weibo
Companion proceedings of the 2019 world wide web conference, 461-467, 2019
Patients’ willingness to share digital health and non-health data for research: a cross-sectional study
BMC Medical Informatics and Decision Making 19 (1), 1-8, 2019
Studying cultural differences in emoji usage across the east and the west
Proceedings of the International AAAI Conference on Web and Social Media 13 …, 2019
Language of ADHD in adults on social media
Journal of attention disorders 23 (12), 1475-1485, 2019
Studying expressions of loneliness in individuals using twitter: an observational study
BMJ open 9 (11), e030355, 2019
Evaluating the predictability of medical conditions from social media posts
PloS one 14 (6), e0215476, 2019
What twitter profile and posted images reveal about depression and anxiety
Proceedings of the international AAAI conference on web and social media 13 …, 2019
Suicide risk assessment with multi-level dual-context language and BERT
Proceedings of the sixth workshop on computational linguistics and clinical …, 2019
Understanding and measuring psychological stress using social media
Proceedings of the international AAAI conference on web and social media 13 …, 2019
2018
Current and future psychological health prediction using language and socio-demographics of children for the clpysch 2018 shared task
Proceedings of the Fifth Workshop on Computational Linguistics and Clinical …, 2018
Just noticeable difference for natural images using RMS contrast and feed-back mechanism
Neurocomputing 275, 366-376, 2018
Measuring individual video QoE: A survey, and proposal for future directions using social media
ACM Transactions on Multimedia Computing, Communications, and Applications …, 2018
To retweet or not to retweet: Understanding what features of cardiovascular tweets influence their retransmission
Journal of health communication 23 (12), 1026-1035, 2018
Cross-platform and cross-interaction study of user personality based on images on Twitter and Flickr
PloS one 13 (7), e0198660, 2018
A highly efficient blind image quality assessment metric of 3-D synthesized images using outlier detection
IEEE Transactions on Industrial Informatics 15 (7), 4120-4128, 2018
Facebook versus Twitter: Differences in self-disclosure and trait prediction
Proceedings of the International AAAI Conference on Web and Social Media 12 (1), 2018
2017
Controlling human perception of basic user traits
Proceedings of the 2017 conference on empirical methods in natural language …, 2017
Studying Personality through the Content of Posted and Liked Images on Twitter
ACM Web Science, 2017
B-SHOT: a binary 3D feature descriptor for fast Keypoint matching on 3D point clouds
Autonomous Robots 41 (7), 1501-1520, 2017
Detecting depression and mental illness on social media: an integrative review
Current Opinion in Behavioral Sciences 18, 43-49, 2017
2016
Personality, culture, and system factors-impact on affective response to multimedia
arXiv preprint arXiv:1606.06873, 2016
Personalizing User Interfaces for improving Quality of Experience in VoD Recommender Systems
Quality of Multimedia Experience, 2016
Understanding Deep Representations Learned in Modeling User `Likes'
IEEE Transactions on Image Processing, 2016
Maximum a posterior and perceptually motivated reconstruction algorithm: A generic framework
IEEE Transactions on Multimedia 19 (1), 93-106, 2016
Who likes What, and Why? Insights into Personality Modeling based on Image Likes
IEEE Transactions on Affective Computing, 2016
Do Personality and Culture Influence Perceived Video Quality and Enjoyment?
IEEE Transactions on Multimedia, 2016
Latent factor representations for cold-start video recommendation
Proceedings of the 10th ACM conference on recommender systems, 99-106, 2016
2015
Observation model based perceptually motivated bilateral filter for image reconstruction
2015 IEEE International Conference on Digital Signal Processing (DSP), 201-205, 2015
Evaluating visual and textual features for predicting user ‘likes’
2015 IEEE International Conference on Multimedia and Expo (ICME), 1-6, 2015
The CP-QAE-I: A video dataset for exploring the effect of personality and culture on perceived quality and affect in multimedia
2015 seventh international workshop on quality of multimedia experience …, 2015
Modelling human factors in perceptual multimedia quality: On the role of personality and culture
Proceedings of the 23rd ACM international conference on Multimedia, 481-490, 2015
Modelling the influence of personality and culture on affect and enjoyment in multimedia
2015 International Conference on Affective Computing and Intelligent …, 2015
Personality modeling based image recommendation
MultiMedia Modeling: 21st International Conference, MMM 2015, Sydney, NSW …, 2015
Do others perceive you as you want them to? Modeling personality based on selfies
Proceedings of the 1st international workshop on affect & sentiment in …, 2015
Optimisation of turning parameters by integrating genetic algorithm with support vector regression and artificial neural networks
The International Journal of Advanced Manufacturing Technology 77, 331-339, 2015
2014
Deep representations to model user likes
Asian Conference on Computer Vision, 3-18, 2014
Support vector regression based flow stress prediction in austenitic stainless steel 304
Procedia Materials Science 6, 368-375, 2014
Big data analytics framework for peer-to-peer botnet detection using random forests
Information Sciences 278, 488-497, 2014
2013
Packet Anonymization: Preserving Privacy for DPI in P2P Realm
Security and Privacy Symposium, 2013
Real-time peer-to-peer botnet detection framework based on bayesian regularized neural network
arXiv preprint arXiv:1307.7464, 2013