PROJECT LEAD : Mayank Kumar, Graduate Student, ECE
Dr. Ashok Veeraraghavan, Assistant Professor, ECE
Dr. Ashutosh Sabharwal, Professor, ECE
THE PROBLEM? Measuring and monitoring any patient's vital signs is essential for their care- in fact, all care first begins by collecting vital signs like heart rate and blood pressure. The current standard of care is based on monitoring devices that require contact - electrocardiograms, pulse-oximeter, blood pressure cuffs, and chest straps. However, contact-based methods have serious limitations for monitoring vital signs of neonates as they have extremely sensitive skin and most contact-based vital sign monitoring techniques result in skin abrasions, peeling and damage every time the leads or patches are removed. This results in potentially dangerous sites for infection increasing the mortality risk to the neonates.
OUR SOLUTION? We propose to use normal camera to measure the vital signs of a patient by simply recording video of their face in a non-contact manner. From the recorded video of the face, our algorithm, distancePPG, extracts pulse rate (PR), pulse rate variability (PRV) and breathing rate (BR). The algorithm is based on estimating tiny changes in skin color due to changes in blood volume underneath the skin surface (these changes are invisible to the naked eye, but can be captured by a camera).
Our algorithm, distancePPG (patent pending), achieves clinical grade accuracy for all skin tones, under low light conditions and can account for natural motion of subjects. It does so by intelligently combining skin color change signal from different regions of the visible skin in a manner that improves the overall signal strength. Our algorithm results in as much as 6dB of SNR improvement in harsh scenarios, rapidly expanding the scope, viability, reach and utility of CameraVitals as a replacement for traditional contact-based vital sign monitor.
Four basic steps in distancePPG: Step (i) Extract landmark points such as eyes, nose, mouth and face boundary from face image, Step (ii) Face is divided into seven regions, each region tracked over the video using computer vision tracker, Step (iii) Each tracked region is further divided into small regions of interest (ROI), Step (iv) DistancePPG computes the goodness metric associated with each ROI based only on the video recordings, and estimate camera-based PPG signal with much higher SNR (signal to noise ratio). For more details, please read our paper.
March, 2014 : DistancePPG version 1.0 algorithm tested on first 12 subjects having different skin tones, 2 subjects under different lighting conditions
April, 2014 : DistancePPG (v 1.0) received first prize in the Graduate-poster competition at Rice ECE Corporate Affiliates Day.
August, 2014 : DistancePPG version 2.0 with improved motion handling capability developed.
October, 2014 : DistancePPG (v 2.0) tested on subjects under different motion scenarios.
February 2015 : DistancePPG paper accepted in Biomedical Optics express
Mayank Kumar, Ashok Veeraraghavan, and Ashutosh Sabharwal, “DistancePPG: Robust non-contact vital signs monitoring using a camera,” Biomedical Opt. Express, Vol. 6 1565-1588 (2015) PDF (Patent Pending)
Sample distancePPG performance on a brown skin tone subject. DistancePPG works for all skin tones.
Sample distancePPG performance under motion scenario (talking). Performance deteriorates only when there is large motion or occlusion.
Sample distancePPG performance under low light scenario (less than 100 lux). Performance does not deteriorate.