To boost efficiency in typical households – where people forget to take wet clothes out of washing machines, retrieve hot food from microwaves and turn off dripping faucets – Cornell researchers have developed a single device that can track 17 types of appliances using vibrations.
The device, called VibroSense, uses lasers to capture subtle vibrations in walls, ceilings and floors, as well as a deep learning network that models the vibrometer’s data to create different signatures for each appliance – bringing researchers closer to a more efficient and integrated smart home.
Recognizing home activities can help computers better understand human behaviors and needs, with the hope of developing a better human-machine interface.
The research paper was published in the journal Proceedings of the Association for Computing Machinery on Interactive, Mobile, Wearable and Ubiquitous Technologies.
In order to have a smart home at this point, we would need each device to be smart, which is not realistic; or we would need to install separate sensors on each device or in each area.
In order to detect usage across an entire house, the researchers’ task was twofold: detect tiny vibrations using a laser Doppler vibrometer; and differentiate similar vibrations created by multiple devices by identifying the paths traveled by the vibrations from room to room.
The deep learning network was trained to distinguish different activities, partly by learning path signatures – the distinctive path vibrations followed through the house – as well as their distinct noises.
The device showed nearly 96% accuracy in identifying 17 different activities across five houses – including dripping faucets, an exhaust fan, an electric kettle, a refrigerator and a range hood. VibroSense could also distinguish five different stages of appliance usage with an average accuracy more than 97%.
In single-story houses, the laser was pointed at an interior wall at the center of the home. It was pointed at the ceiling in two-story homes.
The device is primarily useful in single-family houses, because in buildings it could pick up activities in neighboring apartments, presenting a potential privacy risk.
Among other uses, the system could help homes monitor energy usage and potentially help reduce consumption.
Since this system can detect both the occurrence of an indoor event, as well as the time of an event, it could be used to estimate electricity and water-usage rates, and provide energy-saving advice for homeowners.
It could also prevent water and electrical waste, as well as electrical failures such as short circuits in home appliances.
News Source: Cornell
