Multimodal sensing and machine learning to detect mental and social states
Official title: Novel Multimodal Neural, Physiological, and Behavioral Sensing and Machine Learning for Mental States
Run by University of Southern California · NCT07110688 · Data updated 2026-11-12
This project will test wearable skin sensors, a conversational virtual human, audiovisual emotion recognition, and machine-learning models to detect mental states in healthy adults and in adults with drug‑resistant epilepsy who already have intracranial EEG implants.
Quick facts
| Study type | Interventional |
|---|---|
| Ages | 18 Years and up |
| Sex | All |
| Enrollment | 90 (estimated) |
| Sponsor | University of Southern California Academic / other |
| Locations | 2 sites (Downey, California and 1 other locations) |
| Status | Recruiting |
| Started | August 1, 2024 |
| Main results expected | November 30, 2028 |
| Study ends | November 30, 2028 |
| Registry record updated | October 1, 2025 |
| Trial ID | NCT07110688 on ClinicalTrials.gov |
Is this trial a fit for you?
✓Likely a good fit
Ideal candidates are adults (≥18) who can give informed consent and either are healthy volunteers or have drug‑resistant epilepsy with already‑implanted intracranial EEG electrodes and can follow study instructions.
✕Probably not a fit
People under 18, patients without implanted iEEG, or individuals unable to consent or cooperate are unlikely to be eligible or to receive direct benefit from this protocol.
A plain-English reading of the study's rules. Only the study team can confirm whether you qualify.
What this trial studies
The program develops integrated hardware and software: a skin‑like wearable that measures physiological and biochemical signals, a conversational virtual human platform to evoke natural social responses, audiovisual affect recognition software, synchronization tools, and machine‑learning methods to model the combined data. Researchers will record responses during virtual social interactions and controlled challenges such as the cold pressor test in healthy volunteers and in patients who already have clinically implanted intracranial EEG (iEEG) electrodes. The iEEG recordings are from electrodes placed for clinical seizure localization and are unrelated to clinical care changes. The goal is to demonstrate that multimodal signals can be synchronized and modeled to reveal moment‑to‑moment mental and social states.
Why it matters
Potential benefit: If successful, these tools could enable more precise, real‑time detection of emotional and cognitive states and support development of wearable monitoring and brain‑based diagnostics.
How similar studies have gone: Components like affect recognition, wearable physiological sensing, and iEEG state decoding have shown promise in prior work, but combining these multimodal measures with virtual conversational platforms and biochemical skin sensors is relatively novel.
Who can join: the full rules
Show full inclusion / exclusion criteria
For the healthy population, all subjects over the age of 18 who are able and willing to give informed consent will be eligible. For the epilepsy population, inclusion criteria are: * Patients who suffer from drug-resistant epilepsy and already have intracranial EEG (iEEG) electrodes implanted based on clinical criteria for their standard seizure localization (unrelated to our study) will be eligible. Most patients are healthy adults outside of their epilepsy. * Subjects \>= 18 are only included in this study. * All patients with the above conditions and with already-implanted electrodes who are willing to participate and able to cooperate and follow research instructions will be recruited.
Where it's running
-
Rancho Los Amigos National Rehabilitation Center
Downey, California, United States Recruiting -
University of Southern California
Los Angeles, California, United States Recruiting
Study contacts
- Principal investigator: Maryam Shanechi, PhD — University of Southern California
Similar studies
Other studies for the same condition or treatment. Recruiting studies are listed first.
-
Stroke Volume–Based Fluid Resuscitation in Acute Pancreatitis
This trial tests whether adjusting IV fluids based on each patient’s stroke volume helps people with acute pancreatitis avoid fluid overload while staying well hydrated.
-
Social media messages and how they affect teens’ interest in non-combustible tobacco products
This study tests social media posts showing flavors and stealth use to see if they raise teens’ interest and likelihood to try non-combustible tobacco products.
-
Tactile Pre-Visit Imagery for Reducing Dental Anxiety in Young Children
This study tests whether a tactile pre-visit imagery booklet can reduce anxiety and improve behavior in 4- to 10-year-olds needing their first dental restoration.
-
Do a single nicotine pouch affect cigarette craving and brain response to smoking cues
This study tests whether a single 6 mg oral nicotine pouch can reduce craving and alter prefrontal brain responses to smoking cues in adults who smoke cigarettes.
-
Tirzepatide for Smoking Cessation in people who smoke and are overweight or obese
This study tests whether tirzepatide can help adults who smoke quit and manage weight better than placebo when combined with usual smoking-cessation support.
-
K-Savvy: Supporting Korean American Dementia Caregivers Online
A online program called K-Savvy helps Korean American caregivers of loved ones with dementia manage stress and depression.
How to take part
- Review the eligibility criteria above with your treating physician.
- Check the official listing on ClinicalTrials.gov for the latest contact details and recruitment status.
- Contact the study coordinator or principal investigator to ask for pre-screening. Pre-screening is free and never obligates you to enroll.