A cloud-based tool for tracking animal movements using deep learning
Official title: cloudSLEAP: Maximizing accessibility to deep learning-based motion capture
Funded at Salk Institute for Biological Studies · NIH-10643661 · Data updated 2026-11-12
This study is creating a new tool called cloudSLEAP that helps researchers easily track animal movements using regular videos, making it simpler and more affordable for anyone studying animal behavior and neuroscience.
Quick facts
| Grant type | NIH-funded research |
|---|---|
| Study type | NIH-funded research |
| Funding institution | Salk Institute for Biological Studies NIH-funded |
| Lab location | 1 site (La Jolla, UNITED STATES) |
| Project start | September 1, 2023 |
| Project end | August 31, 2026 |
| Funding year | 2023 |
| Award (this year) | $2,623,223 |
| NIH project number | 1RF1MH132653-01 |
| Project ID | NIH-10643661 on NIH RePORTER |
Who could benefit from this research
✓Could help
Ideal candidates for participation or benefit from this research include researchers and scientists studying animal behavior who require motion tracking tools.
✕Less likely to help
Patients who are not involved in animal behavior research or do not require motion capture technology may not receive any benefit from this research.
What this research studies
This research focuses on developing cloudSLEAP, a platform that utilizes deep learning to enable markerless motion capture of animals in natural settings. By allowing users to track body movements through standard videos without needing complex software or expensive hardware, cloudSLEAP aims to make this technology accessible to a wider audience. The platform will support various data formats and integrate with existing data standards to ensure that the outputs are standardized and easily shareable. This approach seeks to enhance the understanding of animal behavior and neuroscience by providing a user-friendly tool for researchers.
Why it matters
Potential benefit: If successful, this research could significantly enhance the accessibility of advanced motion capture technology for studying animal behavior.
How similar studies have gone: Other research has shown success with cloud-based tools for data analysis, indicating a promising potential for this novel approach.
Where this research is happening
-
Salk Institute for Biological Studies
La Jolla, United States Active
Researchers
- Principal investigator: Pereira, Talmo D. — Salk Institute for Biological Studies
- Study coordinator: Pereira, Talmo D.
Related research
Other NIH-funded projects on the same topics.
-
Integrative histo-genomic analysis to guide cancer risk and targeted therapies with interpretable AI
Researchers are developing an advanced AI-powered approach to map genetic and cellular patterns across breast and cervical cancers to help tailor treatments.
-
Predicting how antimalarial drug resistance spreads with AI
A powerful AI model will be built to forecast how resistance to antimalarial drugs might spread in Africa and beyond, helping clinicians and public health teams stay ahead of outbreaks.
-
Self-supervised deep learning for biological sequences
A deep learning project uses self-supervised methods to better understand biological sequences and related data, with the goal of advancing biology and medicine.
-
Mobile phone imaging and AI to screen oral cancers in low-resource settings
A low-cost mobile phone device with artificial intelligence is being developed to help frontline health workers screen for oral cancer early in low-resource areas.
-
Linking Genetic Variants to Real-Life Health Effects with Smart AI
A new AI-powered approach will predict how genetic differences affect health across multiple levels to help doctors understand diseases and tailor care.
-
Integrative AI tools to map protein sequences to structures and functions
A scientist team will develop advanced AI methods to better connect protein sequences, their 3D shapes, and how they work, using large biological data from sequencing and structures.
About this research
- This is an active NIH-funded research project — typically early-stage science, not a clinical trial accepting patient enrollment.
- Some NIH-funded labs run parallel clinical studies or seek volunteers for related work. To check, contact the principal investigator or institution listed above.
- For full project details, budget, and progress reports, visit the official NIH RePORTER page.