Creating smart buildings with privacy-first sensors
Gaining a better understanding of how people move through the spaces where they live and work could make those spaces safer and more sustainable. But no one wants cameras watching them 24/7.Two former Media Lab researchers think they have a solution. Their company, Butlr, offers places like skilled nursing facilities, offices, and senior living communities a way to understand how people are using buildings without compromising privacy. Butlr uses low-resolution thermal sensors and an analytics platform to help detect falls in elderly populations, save energy, and optimize spaces for work.âWe have this vision of using the right technology to understand peopleâs movements and behaviors in space,â says Jiani Zeng SM â20, who co-founded Butlr with former Media Lab research affiliate Honghao Deng. âSo many resources today go toward cameras and AI that take away peopleâs privacy. We believe we can make our environments safer, healthier, and more sustainable without violating privacy.âTo date, the company has sold more than 20,000 of its privacy-preserving sensors to senior living and skilled nursing facilities as well as businesses with large building footprints, including Verizon, Netflix, and Microsoft. In the future, Butlr hopes to enable more dynamic spaces that can understand and respond to the ways people use them.âSpace should be like a digital user interface: It should be multi-use and responsive to your needs,â Deng says. âIf the office has a big room with people working individually, it should automatically separate into smaller rooms, or lights and temperature should be adjusted to save energy.âBuilding intelligence, with privacyAs an undergraduate at Tianjin University in China, Deng joined the Media Labâs City Science Group as a visiting student in 2016. He went on to complete his masterâs at Harvard University, but he returned to the Media Lab as a research affiliate and led projects around what he calls responsive architecture: spaces that can understand their usersâ needs through non-camera sensors.âMy vision of the future of building environments emerged from the Media Lab,â Deng says. âThe real world is the largest user interface around us â itâs not the screens. We all live in a three-dimensional world and yet, unlike the digital world, this user interface doesnât yet understand our needs, let alone the critical situations when someone falls in a room. That could be life-saving.âZeng came to MIT as a masterâs student in the Integrated Design and Management program, which was run jointly out of the MIT Sloan School of Management and the School of Engineering. She also worked as a research assistant at the Media Lab and the Computer Science and Artificial Intelligence Lab (CSAIL).The pair met during a hackathon at the Media Lab and continued collaborating on various projects. During that time, they worked with MITâs Venture Mentoring Service (VMS) and the MIT I-Corps Program. When they graduated in 2019, they decided to start a company based on the idea of creating smart buildings with privacy-preserving sensors. Crucial early funding came from the Media Lab-affiliated E14 Fund.âI tell every single MIT founder they should have the E14 Fund in their cap table,â Deng says. âThey understand what it takes to go from an MIT student to a founder, and to transition from the âscientist brainâ to the âinventor brain.â We wouldnât be where we are today without MIT.âRay Stata â57, SM â58, the founder of Analog Devices, is also an investor in Butlr and serves as Butlrâs board director.âWe would love to give back to the MIT community once we become successful entrepreneurs like Ray, whose advice and mentoring has been invaluable,â Deng says.After launching, the founders had to find the right early customers for their real-time sensors, which can discern rough body shapes but no personally identifiable information. They interviewed hundreds of people before starting with owners of office spaces.âPeople have zero baseline data on whatâs happening in their workplace,â Deng says. âThatâs especially true since the Covid-19 pandemic made people hybrid, which has opened huge opportunities to cut the energy use of large office spaces. Sometimes, the only people in these buildings are the receptionist and the cleaner.âButlrâs multiyear, battery-powered sensors can track daily occupancy in each room and give other insights into space utilization that can be used to reduce energy use. For companies with a lot of office space, the opportunities are immense. One Butlr customer has 40 building leases. Deng says optimizing the HVAC controls based on usage could amount to millions of dollars saved.âWe can be like the Google Analytics for these spaces without any concerns in terms of privacy,â Deng says.The founders also knew the problem went well beyond office spaces.âIn skilled nursing facilities, instead of office spaces itâs individual rooms, all with people who may need the nurseâs help,â Deng says. âBut the nurses have no visibility into whatâs happening unless they physically enter the room.âAcute care environments and senior living facilities are another key market for Butlr. The companyâs platform can detect falls and instances when someone isnât getting out of bed to alert staff. The system integrates with nurse calling systems to alert staff when something is wrong.The ânerve cellsâ of the buildingButlr is continuing to develop analytics that give important insights into spaces. For instance, today the platform can use information around movement in elderly populations to help detect problems like urinary tract infections. Butlr also recently started a collaboration with Harvard Medical Schoolâs Beth Israel Deaconess Medical Center and the University of Massachusetts at Amherstâs Artificial Intelligence and Technology Center for Connected Care in Aging and Alzheimerâs Disease. Through the project, Butlr will try to detect changes in movement that could indicate declining cognitive or physical abilities. Those insights could be used to provide aging patients with more supervision.âIn the near term we are preventing falls, but the vision is when you look up in any buildings or homes, youâll see Butlr,â Deng says. âThis could allow older adults to age in place with dignity and privacy.âMore broadly, Butlrâs founders see their work as an important way to shape the future of AI technology, which is expected to be a growing part of everyoneâs lives.âWeâre the nerve cells in the building, not the eyes,â Deng says. âThatâs the future of AI we believe in: AI that can transform regular rooms into spaces that understand people and can use that understanding to do everything from making efficiency improvements to saving lives in senior care communities. Thatâs the right way to use this powerful technology.â More