More stories

  • in

    Sensing with purpose

    Fadel Adib never expected that science would get him into the White House, but in August 2015 the MIT graduate student found himself demonstrating his research to the president of the United States.

    Adib, fellow grad student Zachary Kabelac, and their advisor, Dina Katabi, showcased a wireless device that uses Wi-Fi signals to track an individual’s movements.

    As President Barack Obama looked on, Adib walked back and forth across the floor of the Oval Office, collapsed onto the carpet to demonstrate the device’s ability to monitor falls, and then sat still so Katabi could explain to the president how the device was measuring his breathing and heart rate.

    “Zach started laughing because he could see that my heart rate was 110 as I was demoing the device to the president. I was stressed about it, but it was so exciting. I had poured a lot of blood, sweat, and tears into that project,” Adib recalls.

    For Adib, the White House demo was an unexpected — and unforgettable — culmination of a research project he had launched four years earlier when he began his graduate training at MIT. Now, as a newly tenured associate professor in the Department of Electrical Engineering and Computer Science and the Media Lab, he keeps building off that work. Adib, the Doherty Chair of Ocean Utilization, seeks to develop wireless technology that can sense the physical world in ways that were not possible before.

    In his Signal Kinetics group, Adib and his students apply knowledge and creativity to global problems like climate change and access to health care. They are using wireless devices for contactless physiological sensing, such as measuring someone’s stress level using Wi-Fi signals. The team is also developing battery-free underwater cameras that could explore uncharted regions of the oceans, tracking pollution and the effects of climate change. And they are combining computer vision and radio frequency identification (RFID) technology to build robots that find hidden items, to streamline factory and warehouse operations and, ultimately, alleviate supply chain bottlenecks.

    While these areas may seem quite different, each time they launch a new project, the researchers uncover common threads that tie the disciplines together, Adib says.

    “When we operate in a new field, we get to learn. Every time you are at a new boundary, in a sense you are also like a kid, trying to understand these different languages, bring them together, and invent something,” he says.

    A science-minded child

    A love of learning has driven Adib since he was a young child growing up in Tripoli on the coast of Lebanon. He had been interested in math and science for as long as he could remember, and had boundless energy and insatiable curiosity as a child.

    “When my mother wanted me to slow down, she would give me a puzzle to solve,” he recalls.

    By the time Adib started college at the American University of Beirut, he knew he wanted to study computer engineering and had his sights set on MIT for graduate school.

    Seeking to kick-start his future studies, Adib reached out to several MIT faculty members to ask about summer internships. He received a response from the first person he contacted. Katabi, the Thuan and Nicole Pham Professor in the Department of Electrical Engineering and Computer Science (EECS), and a principal investigator in the Computer Science and Artificial Intelligence Laboratory (CSAIL) and the MIT Jameel Clinic, interviewed him and accepted him for a position. He immersed himself in the lab work and, as the end of summer approached, Katabi encouraged him to apply for grad school at MIT and join her lab.

    “To me, that was a shock because I felt this imposter syndrome. I thought I was moving like a turtle with my research, but I did not realize that with research itself, because you are at the boundary of human knowledge, you are expected to progress iteratively and slowly,” he says.

    As an MIT grad student, he began contributing to a number of projects. But his passion for invention pushed him to embark into unexplored territory. Adib had an idea: Could he use Wi-Fi to see through walls?

    “It was a crazy idea at the time, but my advisor let me work on it, even though it was not something the group had been working on at all before. We both thought it was an exciting idea,” he says.

    As Wi-Fi signals travel in space, a small part of the signal passes through walls — the same way light passes through windows — and is then reflected by whatever is on the other side. Adib wanted to use these signals to “see” what people on the other side of a wall were doing.

    Discovering new applications

    There were a lot of ups and downs (“I’d say many more downs than ups at the beginning”), but Adib made progress. First, he and his teammates were able to detect people on the other side of a wall, then they could determine their exact location. Almost by accident, he discovered that the device could be used to monitor someone’s breathing.

    “I remember we were nearing a deadline and my friend Zach and I were working on the device, using it to track people on the other side of the wall. I asked him to hold still, and then I started to see him appearing and disappearing over and over again. I thought, could this be his breathing?” Adib says.

    Eventually, they enabled their Wi-Fi device to monitor heart rate and other vital signs. The technology was spun out into a startup, which presented Adib with a conundrum once he finished his PhD — whether to join the startup or pursue a career in academia.

    He decided to become a professor because he wanted to dig deeper into the realm of invention. But after living through the winter of 2014-2015, when nearly 109 inches of snow fell on Boston (a record), Adib was ready for a change of scenery and a warmer climate. He applied to universities all over the United States, and while he had some tempting offers, Adib ultimately realized he didn’t want to leave MIT. He joined the MIT faculty as an assistant professor in 2016 and was named associate professor in 2020.

    “When I first came here as an intern, even though I was thousands of miles from Lebanon, I felt at home. And the reason for that was the people. This geekiness — this embrace of intellect — that is something I find to be beautiful about MIT,” he says.

    He’s thrilled to work with brilliant people who are also passionate about problem-solving. The members of his research group are diverse, and they each bring unique perspectives to the table, which Adib says is vital to encourage the intellectual back-and-forth that drives their work.

    Diving into a new project

    For Adib, research is exploration. Take his work on oceans, for instance. He wanted to make an impact on climate change, and after exploring the problem, he and his students decided to build a battery-free underwater camera.

    Adib learned that the ocean, which covers 70 percent of the planet, plays the single largest role in the Earth’s climate system. Yet more than 95 percent of it remains unexplored. That seemed like a problem the Signal Kinetics group could help solve, he says.

    But diving into this research area was no easy task. Adib studies Wi-Fi systems, but Wi-Fi does not work underwater. And it is difficult to recharge a battery once it is deployed in the ocean, making it hard to build an autonomous underwater robot that can do large-scale sensing.

    So, the team borrowed from other disciplines, building an underwater camera that uses acoustics to power its equipment and capture and transmit images.

    “We had to use piezoelectric materials, which come from materials science, to develop transducers, which come from oceanography, and then on top of that we had to marry these things with technology from RF known as backscatter,” he says. “The biggest challenge becomes getting these things to gel together. How do you decode these languages across fields?”

    It’s a challenge that continues to motivate Adib as he and his students tackle problems that are too big for one discipline.

    He’s excited by the possibility of using his undersea wireless imaging technology to explore distant planets. These same tools could also enhance aquaculture, which could help eradicate food insecurity, or support other emerging industries.

    To Adib, the possibilities seem endless.

    “With each project, we discover something new, and that opens up a whole new world to explore. The biggest driver of our work in the future will be what we think is impossible, but that we could make possible,” he says. More

  • in

    Nonabah Lane, Navajo educator and environmental sustainability specialist with numerous ties to MIT, dies at 46

    Nonabah Lane, a Navajo educator and environmental sustainability specialist with numerous MIT ties to MIT, passed away in October. She was 46.

    Lane had recently been an MIT Media Lab Director’s Fellow; MIT Solve 2019 Indigenous Communities Fellow; Department of Urban Studies and Planning guest lecturer and community partner; community partner with the PKG Public Service Center, Terrascope, and D-Lab; and a speaker at this year’s MIT Energy Week.

    Lane was a passionate sustainability specialist with experience spearheading successful environmental civic science projects focused in agriculture, water science, and energy. Committed to mitigating water pollutants and environmental hazards in tribal communities, she held extensive knowledge of environmental policy and Indigenous water rights. 

    Lane’s clans were Ta’neezahnii (Tangled People), born for Tł’izíłání (Manygoats People), and her maternal grandfathers are the Kiiyaa’aanii (Towering House People), and paternal grandfathers are Bįįh Bitoo’nii (Deer Spring People).

    Lane was a member of the Navajo Nation, Nenahnezad Chapter. At Navajo Power, she worked as the lead developer for solar and energy storage projects to benefit tribal communities on the Navajo Nation and other tribal nations in New Mexico. Prior to joining Navajo Power, Lane co-founded Navajo Ethno-Agriculture, a farm that teaches Navajo culture through traditional farming and bilingual education. Lane also launched a campaign to partner with local Navajo schools and tribal colleges to create their own water-testing capabilities and translate data into information to local farmers.

    “I had the opportunity to collaborate closely with Nonabah on a range of initiatives she was championing on energy, food, justice, water, Indigenous leadership, youth STEM, and more. She was innovative, entrepreneurial, inclusive, heartfelt, and positively impacted MIT on every visit to campus. She articulated important things that needed saying and expanded people’s thinking constantly. We will all miss her insights and teamwork,” says Megan Smith ’86, SM ’88, MIT Corporation life member; third U.S. chief technology officer and assistant to the president in the Office of Science and Technology Policy; and founder and CEO of shift7.

    In March 2019, Lane and her family — parents Gloria and Harry and brother Bruce — welcomed students and staff of the MIT Terrascope first-year learning community to their farm, where they taught unique, hands-on lessons about traditional Diné farming and spirituality. She then continued to collaborate with Terrascope, helping staff and students develop community-based work with partners in Navajo Nation. 

    Terrascope associate director and lecturer Ari Epstein says, “Nonabah was an inspiring person and a remarkable collaborator; she had a talent for connecting and communicating across disciplinary, organizational, and cultural differences, and she was generous with her expertise and knowledge. We will miss her very much.”

    Lane came to MIT in May 2019 for the MIT Solve Indigenous Communities Fellowship and Solve at MIT event, representing Navajo Ethno-Agriculture with her mother, Gloria Lane, and brother, Bruce Lane, and later serving as a Fellow Leadership Group member. 

    “Nonabah was an incredible individual who worked tirelessly to better all of her communities, whether it was back home on the Navajo Nation, here at MIT Solve, or supporting her family and friends,” says Alex Amouyel, executive director of MIT Solve. “More than that, Nonabah was a passionate mentor and caring friend of so many, carefully tending the next generation of Indigenous innovators, entrepreneurs, and change-makers. Her loss will be felt deeply by the MIT community, and her legacy of heartfelt service will not be forgotten.”

    She continued to be heavily involved across the MIT campus — named as a 2019 Media Lab Director’s Fellow, leading a workshop at the 2020 MIT Media Lab Festival of Learning on modernizing Navajo foods using traditional food science and cultural narrative, speaking at the 2022 MIT Energy Conference “Accelerating the Clean Energy Transition,” and taking part in the MIT Center for Bits and Atoms (CBA) innovation weekly co-working groups for Covid-response related innovations. 

    “My CBA colleagues and I enjoyed working with Nonabah on rapid-prototyping for the Covid response, on expanding access to digital fabrication, and on ambitious proposals for connecting emerging technology with Indigenous knowledge,” says Professor Neil Gershenfeld, director, MIT Center for Bits and Atoms.

    Nonabah also guest lectured for the MIT Department of Urban Studies and Planning’s Indigenous Environmental Planning class in Spring 2022. Professors Lawrence Susskind and Gabriella Carolini and teaching assistant Dení López led the class in cooperation with Elizabeth Rule, Chickasaw Nation member and professor at American University. 

    Carolini shares, on behalf of Susskind and the class, “During this time, our teaching team and students from a broad range of fields at MIT had the deep honor of learning from and with the inimitable Nonabah Lane. Nonabah was a dedicated and critical partner to our class, representing in this instance Navajo Power — but of course, also so much more. Her broad experiences and knowledge — working with fellow Navajo members on energy and agriculture sovereignty, as well as in advancing entrepreneurship and innovation — reflected the urgency Nonabah saw in meeting the challenges and opportunities for sustainable and equitable futures in Navajo nation and beyond. She was a pure life force, running on all fires, and brought to our class a dedicated drive to educate, learn, and extend our reference points beyond current knowledge frontiers.” 

    Three MIT students — junior Isabella Gandara, Alexander Gerszten ’22, and Paul Picciano MS ’22 — who worked closely with Lane on a project with Navajo Power, recalled how she shared herself with them in so many ways, through her truly exceptional work ethic, stories about herself and her family, and the care and thought that she put into her ventures. They noted there was always something new to feel inspired by when in her presence. 

    “The PKG Public Service Center mourns the passing of Nonabah Lane. Navajo Ethno-Agriculture is a valued PKG Center partner that offers MIT undergraduate students the opportunity to support community-led projects with the Diné Community on Navajo Nation. Nonabah inspired students to examine broad social and technical issues that impact Indigenous communities in Navajo Nation and beyond, in many cases leaving an indelible mark on their personal and professional paths,” says Jill S. Bassett, associate dean and director of the PKG Public Service Center.

    Lane was a Sequoyah Fellow of the American Indian Science and Engineering Society (AISES) and remained actively engaged in the AISES community by mentoring young people interested in the fields of science, engineering, agriculture, and energy. Over the years, Lane collaborated with leaders across tribal lands and beyond on projects related to agriculture, energy, sustainable chemicals, and finance. Lane had an enormous positive impact on many through her accomplishments and also the countless meaningful connections she helped to form among people in diverse fields.

    Donations may be made to a memorial fund organized by Navajo Power, PBC in honor of Nonabah Lane, in support of Navajo Ethno-Agriculture, the Native American nonprofit she co-founded and cared deeply for. More

  • in

    MIT Climate and Sustainability Consortium announces recipients of inaugural MCSC Seed Awards

    The MIT Climate and Sustainability Consortium (MCSC) has awarded 20 projects a total of $5 million over two years in its first-ever 2022 MCSC Seed Awards program. The winning projects are led by principal investigators across all five of MIT’s schools.

    The goal of the MCSC Seed Awards is to engage MIT researchers and link the economy-wide work of the consortium to ongoing and emerging climate and sustainability efforts across campus. The program offers further opportunity to build networks among the awarded projects to deepen the impact of each and ensure the total is greater than the sum of its parts.

    For example, to drive progress under the awards category Circularity and Materials, the MCSC can facilitate connections between the technologists at MIT who are developing recovery approaches for metals, plastics, and fiber; the urban planners who are uncovering barriers to reuse; and the engineers, who will look for efficiency opportunities in reverse supply chains.

    “The MCSC Seed Awards are designed to complement actions previously outlined in Fast Forward: MIT’s Climate Action Plan for the Decade and, more specifically, the Climate Grand Challenges,” says Anantha P. Chandrakasan, dean of the MIT School of Engineering, Vannevar Bush Professor of Electrical Engineering and Computer Science, and chair of the MIT Climate and Sustainability Consortium. “In collaboration with seed award recipients and MCSC industry members, we are eager to engage in interdisciplinary exploration and propel urgent advancements in climate and sustainability.” 

    By supporting MIT researchers with expertise in economics, infrastructure, community risk assessment, mobility, and alternative fuels, the MCSC will accelerate implementation of cross-disciplinary solutions in the awards category Decarbonized and Resilient Value Chains. Enhancing Natural Carbon Sinks and building connections to local communities will require associations across experts in ecosystem change, biodiversity, improved agricultural practice and engagement with farmers, all of which the consortium can begin to foster through the seed awards.

    “Funding opportunities across campus has been a top priority since launching the MCSC,” says Jeremy Gregory, MCSC executive director. “It is our honor to support innovative teams of MIT researchers through the inaugural 2022 MCSC Seed Awards program.”

    The winning projects are tightly aligned with the MCSC’s areas of focus, which were derived from a year of highly engaged collaborations with MCSC member companies. The projects apply across the member’s climate and sustainability goals.

    The MCSC’s 16 member companies span many industries, and since early 2021, have met with members of the MIT community to define focused problem statements for industry-specific challenges, identify meaningful partnerships and collaborations, and develop clear and scalable priorities. Outcomes from these collaborations laid the foundation for the focus areas, which have shaped the work of the MCSC. Specifically, the MCSC Industry Advisory Board engaged with MIT on key strategic directions, and played a critical role in the MCSC’s series of interactive events. These included virtual workshops hosted last summer, each on a specific topic that allowed companies to work with MIT and each other to align key assumptions, identify blind spots in corporate goal-setting, and leverage synergies between members, across industries. The work continued in follow-up sessions and an annual symposium.

    “We are excited to see how the seed award efforts will help our member companies reach or even exceed their ambitious climate targets, find new cross-sector links among each other, seek opportunities to lead, and ripple key lessons within their industry, while also deepening the Institute’s strong foundation in climate and sustainability research,” says Elsa Olivetti, the Esther and Harold E. Edgerton Associate Professor in Materials Science and Engineering and MCSC co-director.

    As the seed projects take shape, the MCSC will provide ongoing opportunities for awardees to engage with the Industry Advisory Board and technical teams from the MCSC member companies to learn more about the potential for linking efforts to support and accelerate their climate and sustainability goals. Awardees will also have the chance to engage with other members of the MCSC community, including its interdisciplinary Faculty Steering Committee.

    “One of our mantras in the MCSC is to ‘amplify and extend’ existing efforts across campus; we’re always looking for ways to connect the collaborative industry relationships we’re building and the work we’re doing with other efforts on campus,” notes Jeffrey Grossman, the Morton and Claire Goulder and Family Professor in Environmental Systems, head of the Department of Materials Science and Engineering, and MCSC co-director. “We feel the urgency as well as the potential, and we don’t want to miss opportunities to do more and go faster.”

    The MCSC Seed Awards complement the Climate Grand Challenges, a new initiative to mobilize the entire MIT research community around developing the bold, interdisciplinary solutions needed to address difficult, unsolved climate problems. The 27 finalist teams addressed four broad research themes, which align with the MCSC’s focus areas. From these finalist teams, five flagship projects were announced in April 2022.

    The parallels between MCSC’s focus areas and the Climate Grand Challenges themes underscore an important connection between the shared long-term research interests of industry and academia. The challenges that some of the world’s largest and most influential companies have identified are complementary to MIT’s ongoing research and innovation — highlighting the tremendous opportunity to develop breakthroughs and scalable solutions quickly and effectively. Special Presidential Envoy for Climate John Kerry underscored the importance of developing these scalable solutions, including critical new technology, during a conversation with MIT President L. Rafael Reif at MIT’s first Climate Grand Challenges showcase event last month.

    Both the MCSC Seed Awards and the Climate Grand Challenges are part of MIT’s larger commitment and initiative to combat climate change; this was underscored in “Fast Forward: MIT’s Climate Action Plan for the Decade,” which the Institute published in May 2021.

    The project titles and research leads for each of the 20 awardees listed below are categorized by MCSC focus area.

    Decarbonized and resilient value chains

    “Collaborative community mapping toolkit for resilience planning,” led by Miho Mazereeuw, associate professor of architecture and urbanism in the Department of Architecture and director of the Urban Risk Lab (a research lead on Climate Grand Challenges flagship project) and Nicholas de Monchaux, professor and department head in the Department of Architecture
    “CP4All: Fast and local climate projections with scientific machine learning — towards accessibility for all of humanity,” led by Chris Hill, principal research scientist in the Department of Earth, Atmospheric and Planetary Sciences and Dava Newman, director of the MIT Media Lab and the Apollo Program Professor in the Department of Aeronautics and Astronautics
    “Emissions reductions and productivity in U.S. manufacturing,” led by Mert Demirer, assistant professor of applied economics at the MIT Sloan School of Management and Jing Li, assistant professor and William Barton Rogers Career Development Chair of Energy Economics in the MIT Sloan School of Management
    “Logistics electrification through scalable and inter-operable charging infrastructure: operations, planning, and policy,” led by Alex Jacquillat, the 1942 Career Development Professor and assistant professor of operations research and statistics in the MIT Sloan School of Management
    “Powertrain and system design for LOHC-powered long-haul trucking,” led by William Green, the Hoyt Hottel Professor in Chemical Engineering in the Department of Chemical Engineering and postdoctoral officer, and Wai K. Cheng, professor in the Department of Mechanical Engineering and director of the Sloan Automotive Laboratory
    “Sustainable Separation and Purification of Biochemicals and Biofuels using Membranes,” led by John Lienhard, the Abdul Latif Jameel Professor of Water in the Department of Mechanical Engineering, director of the Abdul Latif Jameel Water and Food Systems Lab, and director of the Rohsenow Kendall Heat Transfer Laboratory; and Nicolas Hadjiconstantinou, professor in the Department of Mechanical Engineering, co-director of the Center for Computational Science and Engineering, associate director of the Center for Exascale Simulation of Materials in Extreme Environments, and graduate officer
    “Toolkit for assessing the vulnerability of industry infrastructure siting to climate change,” led by Michael Howland, assistant professor in the Department of Civil and Environmental Engineering

    Circularity and Materials

    “Colorimetric Sulfidation for Aluminum Recycling,” led by Antoine Allanore, associate professor of metallurgy in the Department of Materials Science and Engineering
    “Double Loop Circularity in Materials Design Demonstrated on Polyurethanes,” led by Brad Olsen, the Alexander and I. Michael Kasser (1960) Professor and graduate admissions co-chair in the Department of Chemical Engineering, and Kristala Prather, the Arthur Dehon Little Professor and department executive officer in the Department of Chemical Engineering
    “Engineering of a microbial consortium to degrade and valorize plastic waste,” led by Otto Cordero, associate professor in the Department of Civil and Environmental Engineering, and Desiree Plata, the Gilbert W. Winslow (1937) Career Development Professor in Civil Engineering and associate professor in the Department of Civil and Environmental Engineering
    “Fruit-peel-inspired, biodegradable packaging platform with multifunctional barrier properties,” led by Kripa Varanasi, professor in the Department of Mechanical Engineering
    “High Throughput Screening of Sustainable Polyesters for Fibers,” led by Gregory Rutledge, the Lammot du Pont Professor in the Department of Chemical Engineering, and Brad Olsen, Alexander and I. Michael Kasser (1960) Professor and graduate admissions co-chair in the Department of Chemical Engineering
    “Short-term and long-term efficiency gains in reverse supply chains,” led by Yossi Sheffi, the Elisha Gray II Professor of Engineering Systems, professor in the Department of Civil and Environmental Engineering, and director of the Center for Transportation and Logistics
    The costs and benefits of circularity in building construction, led by Siqi Zheng, the STL Champion Professor of Urban and Real Estate Sustainability at the MIT Center for Real Estate and Department of Urban Studies and Planning, faculty director of the MIT Center for Real Estate, and faculty director for the MIT Sustainable Urbanization Lab; and Randolph Kirchain, principal research scientist and co-director of MIT Concrete Sustainability Hub

    Natural carbon sinks

    “Carbon sequestration through sustainable practices by smallholder farmers,” led by Joann de Zegher, the Maurice F. Strong Career Development Professor and assistant professor of operations management in the MIT Sloan School of Management, and Karen Zheng the George M. Bunker Professor and associate professor of operations management in the MIT Sloan School of Management
    “Coatings to protect and enhance diverse microbes for improved soil health and crop yields,” led by Ariel Furst, the Raymond A. (1921) And Helen E. St. Laurent Career Development Professor of Chemical Engineering in the Department of Chemical Engineering, and Mary Gehring, associate professor of biology in the Department of Biology, core member of the Whitehead Institute for Biomedical Research, and graduate officer
    “ECO-LENS: Mainstreaming biodiversity data through AI,” led by John Fernández, professor of building technology in the Department of Architecture and director of MIT Environmental Solutions Initiative
    “Growing season length, productivity, and carbon balance of global ecosystems under climate change,” led by Charles Harvey, professor in the Department of Civil and Environmental Engineering, and César Terrer, assistant professor in the Department of Civil and Environmental Engineering

    Social dimensions and adaptation

    “Anthro-engineering decarbonization at the million-person scale,” led by Manduhai Buyandelger, professor in the Anthropology Section, and Michael Short, the Class of ’42 Associate Professor of Nuclear Science and Engineering in the Department of Nuclear Science and Engineering
    “Sustainable solutions for climate change adaptation: weaving traditional ecological knowledge and STEAM,” led by Janelle Knox-Hayes, the Lister Brothers Associate Professor of Economic Geography and Planning and head of the Environmental Policy and Planning Group in the Department of Urban Studies and Planning, and Miho Mazereeuw, associate professor of architecture and urbanism in the Department of Architecture and director of the Urban Risk Lab (a research lead on a Climate Grand Challenges flagship project) More

  • in

    Q&A: Climate Grand Challenges finalists on using data and science to forecast climate-related risk

    Note: This is the final article in a four-part interview series featuring the work of the 27 MIT Climate Grand Challenges finalist teams, which received a total of $2.7 million in startup funding to advance their projects. This month, the Institute will name a subset of the finalists as multiyear flagship projects.

    Advances in computation, artificial intelligence, robotics, and data science are enabling a new generation of observational tools and scientific modeling with the potential to produce timely, reliable, and quantitative analysis of future climate risks at a local scale. These projections can increase the accuracy and efficacy of early warning systems, improve emergency planning, and provide actionable information for climate mitigation and adaptation efforts, as human actions continue to change planetary conditions.

    In conversations prepared for MIT News, faculty from four Climate Grand Challenges teams with projects in the competition’s “Using data and science to forecast climate-related risk” category describe the promising new technologies that can help scientists understand the Earth’s climate system on a finer scale than ever before. (The other Climate Grand Challenges research themes include building equity and fairness into climate solutions, removing, managing, and storing greenhouse gases, and decarbonizing complex industries and processes.) The following responses have been edited for length and clarity.

    An observational system that can initiate a climate risk forecasting revolution

    Despite recent technological advances and massive volumes of data, climate forecasts remain highly uncertain. Gaps in observational capabilities create substantial challenges to predicting extreme weather events and establishing effective mitigation and adaptation strategies. R. John Hansman, the T. Wilson Professor of Aeronautics and Astronautics and director of the MIT International Center for Air Transportation, discusses the Stratospheric Airborne Climate Observatory System (SACOS) being developed together with Brent Minchew, the Cecil and Ida Green Career Development Professor in the Department of Earth, Atmospheric and Planetary Sciences (EAPS), and a team that includes researchers from MIT Lincoln Laboratory and Harvard University.

    Q: How does SACOS reduce uncertainty in climate risk forecasting?

    A: There is a critical need for higher spatial and temporal resolution observations of the climate system than are currently available through remote (satellite or airborne) and surface (in-situ) sensing. We are developing an ensemble of high-endurance, solar-powered aircraft with instrument systems capable of performing months-long climate observing missions that satellites or aircraft alone cannot fulfill. Summer months are ideal for SACOS operations, as many key climate phenomena are active and short night periods reduce the battery mass, vehicle size, and technical risks. These observations hold the potential to inform and predict, allowing emergency planners, policymakers, and the rest of society to better prepare for the changes to come.

    Q: Describe the types of observing missions where SACOS could provide critical improvements.

    A: The demise of the Antarctic Ice Sheet, which is leading to rising sea levels around the world and threatening the displacement of millions of people, is one example. Current sea level forecasts struggle to account for giant fissures that create massive icebergs and cause the Antarctic Ice Sheet to flow more rapidly into the ocean. SACOS can track these fissures to accurately forecast ice slippage and give impacted populations enough time to prepare or evacuate. Elsewhere, widespread droughts cause rampant wildfires and water shortages. SACOS has the ability to monitor soil moisture and humidity in critically dry regions to identify where and when wildfires and droughts are imminent. SACOS also offers the most effective method to measure, track, and predict local ozone depletion over North America, which has resulted in increasingly severe summer thunderstorms.

    Quantifying and managing the risks of sea-level rise

    Prevailing estimates of sea-level rise range from approximately 20 centimeters to 2 meters by the end of the century, with the associated costs on the order of trillions of dollars. The instability of certain portions of the world’s ice sheets creates vast uncertainties, complicating how the world prepares for and responds to these potential changes. EAPS Professor Brent Minchew is leading another Climate Grand Challenges finalist team working on an integrated, multidisciplinary effort to improve the scientific understanding of sea-level rise and provide actionable information and tools to manage the risks it poses.

    Q: What have been the most significant challenges to understanding the potential rates of sea-level rise?

    A: West Antarctica is one of the most remote, inaccessible, and hostile places on Earth — to people and equipment. Thus, opportunities to observe the collapse of the West Antarctic Ice Sheet, which contains enough ice to raise global sea levels by about 3 meters, are limited and current observations crudely resolved. It is essential that we understand how the floating edge of the ice sheets, often called ice shelves, fracture and collapse because they provide critical forces that govern the rate of ice mass loss and can stabilize the West Antarctic Ice Sheet.

    Q: How will your project advance what is currently known about sea-level rise?

    A: We aim to advance global-scale projections of sea-level rise through novel observational technologies and computational models of ice sheet change and to link those predictions to region- to neighborhood-scale estimates of costs and adaptation strategies. To do this, we propose two novel instruments: a first-of-its-kind drone that can fly for months at a time over Antarctica making continuous observations of critical areas and an airdropped seismometer and GPS bundle that can be deployed to vulnerable and hard-to-reach areas of the ice sheet. This technology will provide greater data quality and density and will observe the ice sheet at frequencies that are currently inaccessible — elements that are essential for understanding the physics governing the evolution of the ice sheet and sea-level rise.

    Changing flood risk for coastal communities in the developing world

    Globally, more than 600 million people live in low-elevation coastal areas that face an increasing risk of flooding from sea-level rise. This includes two-thirds of cities with populations of more than 5 million and regions that conduct the vast majority of global trade. Dara Entekhabi, the Bacardi and Stockholm Water Foundations Professor in the Department of Civil and Environmental Engineering and professor in the Department of Earth, Atmospheric, and Planetary Sciences, outlines an interdisciplinary partnership that leverages data and technology to guide short-term and chart long-term adaptation pathways with Miho Mazereeuw, associate professor of architecture and urbanism and director of the Urban Risk Lab in the School of Architecture and Planning, and Danielle Wood, assistant professor in the Program in Media Arts and Sciences and the Department of Aeronautics and Astronautics.

    Q: What is the key problem this program seeks to address?

    A: The accumulated heating of the Earth system due to fossil burning is largely absorbed by the oceans, and the stored heat expands the ocean volume leading to increased base height for tides. When the high tides inundate a city, the condition is referred to as “sunny day” flooding, but the saline waters corrode infrastructure and wreak havoc on daily routines. The danger ahead for many coastal cities in the developing world is the combination of increasing high tide intrusions, coupled with heavy precipitation storm events.

    Q: How will your proposed solutions impact flood risk management?

    A: We are producing detailed risk maps for coastal cities in developing countries using newly available, very high-resolution remote-sensing data from space-borne instruments, as well as historical tides records and regional storm characteristics. Using these datasets, we aim to produce street-by-street risk maps that provide local decision-makers and stakeholders with a way to estimate present and future flood risks. With the model of future tides and probabilistic precipitation events, we can forecast future inundation by a flooding event, decadal changes with various climate-change and sea-level rise projections, and an increase in the likelihood of sunny-day flooding. Working closely with local partners, we will develop toolkits to explore short-term emergency response, as well as long-term mitigation and adaptation techniques in six pilot locations in South and Southeast Asia, Africa, and South America.

    Ocean vital signs

    On average, every person on Earth generates fossil fuel emissions equivalent to an 8-pound bag of carbon, every day. Much of this is absorbed by the ocean, but there is wide variability in the estimates of oceanic absorption, which translates into differences of trillions of dollars in the required cost of mitigation. In the Department of Earth, Atmospheric and Planetary Sciences, Christopher Hill, a principal research engineer specializing in Earth and planetary computational science, works with Ryan Woosley, a principal research scientist focusing on the carbon cycle and ocean acidification. Hill explains that they hope to use artificial intelligence and machine learning to help resolve this uncertainty.

    Q: What is the current state of knowledge on air-sea interactions?

    A: Obtaining specific, accurate field measurements of critical physical, chemical, and biological exchanges between the ocean and the planet have historically entailed expensive science missions with large ship-based infrastructure that leave gaps in real-time data about significant ocean climate processes. Recent advances in highly scalable in-situ autonomous observing and navigation combined with airborne, remote sensing, and machine learning innovations have the potential to transform data gathering, provide more accurate information, and address fundamental scientific questions around air-sea interaction.

    Q: How will your approach accelerate real-time, autonomous surface ocean observing from an experimental research endeavor to a permanent and impactful solution?

    A: Our project seeks to demonstrate how a scalable surface ocean observing network can be launched and operated, and to illustrate how this can reduce uncertainties in estimates of air-sea carbon dioxide exchange. With an initial high-impact goal of substantially eliminating the vast uncertainties that plague our understanding of ocean uptake of carbon dioxide, we will gather critical measurements for improving extended weather and climate forecast models and reducing climate impact uncertainty. The results have the potential to more accurately identify trillions of dollars worth of economic activity. More

  • in

    Ocean vital signs

    Without the ocean, the climate crisis would be even worse than it is. Each year, the ocean absorbs billions of tons of carbon from the atmosphere, preventing warming that greenhouse gas would otherwise cause. Scientists estimate about 25 to 30 percent of all carbon released into the atmosphere by both human and natural sources is absorbed by the ocean.

    “But there’s a lot of uncertainty in that number,” says Ryan Woosley, a marine chemist and a principal research scientist in the Department of Earth, Atmospheric and Planetary Sciences (EAPS) at MIT. Different parts of the ocean take in different amounts of carbon depending on many factors, such as the season and the amount of mixing from storms. Current models of the carbon cycle don’t adequately capture this variation.

    To close the gap, Woosley and a team of other MIT scientists developed a research proposal for the MIT Climate Grand Challenges competition — an Institute-wide campaign to catalyze and fund innovative research addressing the climate crisis. The team’s proposal, “Ocean Vital Signs,” involves sending a fleet of sailing drones to cruise the oceans taking detailed measurements of how much carbon the ocean is really absorbing. Those data would be used to improve the precision of global carbon cycle models and improve researchers’ ability to verify emissions reductions claimed by countries.

    “If we start to enact mitigation strategies—either through removing CO2 from the atmosphere or reducing emissions — we need to know where CO2 is going in order to know how effective they are,” says Woosley. Without more precise models there’s no way to confirm whether observed carbon reductions were thanks to policy and people, or thanks to the ocean.

    “So that’s the trillion-dollar question,” says Woosley. “If countries are spending all this money to reduce emissions, is it enough to matter?”

    In February, the team’s Climate Grand Challenges proposal was named one of 27 finalists out of the almost 100 entries submitted. From among this list of finalists, MIT will announce in April the selection of five flagship projects to receive further funding and support.

    Woosley is leading the team along with Christopher Hill, a principal research engineer in EAPS. The team includes physical and chemical oceanographers, marine microbiologists, biogeochemists, and experts in computational modeling from across the department, in addition to collaborators from the Media Lab and the departments of Mathematics, Aeronautics and Astronautics, and Electrical Engineering and Computer Science.

    Today, data on the flux of carbon dioxide between the air and the oceans are collected in a piecemeal way. Research ships intermittently cruise out to gather data. Some commercial ships are also fitted with sensors. But these present a limited view of the entire ocean, and include biases. For instance, commercial ships usually avoid storms, which can increase the turnover of water exposed to the atmosphere and cause a substantial increase in the amount of carbon absorbed by the ocean.

    “It’s very difficult for us to get to it and measure that,” says Woosley. “But these drones can.”

    If funded, the team’s project would begin by deploying a few drones in a small area to test the technology. The wind-powered drones — made by a California-based company called Saildrone — would autonomously navigate through an area, collecting data on air-sea carbon dioxide flux continuously with solar-powered sensors. This would then scale up to more than 5,000 drone-days’ worth of observations, spread over five years, and in all five ocean basins.

    Those data would be used to feed neural networks to create more precise maps of how much carbon is absorbed by the oceans, shrinking the uncertainties involved in the models. These models would continue to be verified and improved by new data. “The better the models are, the more we can rely on them,” says Woosley. “But we will always need measurements to verify the models.”

    Improved carbon cycle models are relevant beyond climate warming as well. “CO2 is involved in so much of how the world works,” says Woosley. “We’re made of carbon, and all the other organisms and ecosystems are as well. What does the perturbation to the carbon cycle do to these ecosystems?”

    One of the best understood impacts is ocean acidification. Carbon absorbed by the ocean reacts to form an acid. A more acidic ocean can have dire impacts on marine organisms like coral and oysters, whose calcium carbonate shells and skeletons can dissolve in the lower pH. Since the Industrial Revolution, the ocean has become about 30 percent more acidic on average.

    “So while it’s great for us that the oceans have been taking up the CO2, it’s not great for the oceans,” says Woosley. “Knowing how this uptake affects the health of the ocean is important as well.” More

  • in

    Q&A: Climate Grand Challenges finalists on building equity and fairness into climate solutions

    Note: This is the first in a four-part interview series that will highlight the work of the Climate Grand Challenges finalists, ahead of the April announcement of several multiyear, flagship projects.

    The finalists in MIT’s first-ever Climate Grand Challenges competition each received $100,000 to develop bold, interdisciplinary research and innovation plans designed to attack some of the world’s most difficult and unresolved climate problems. The 27 teams are addressing four Grand Challenge problem areas: building equity and fairness into climate solutions; decarbonizing complex industries and processes; removing, managing, and storing greenhouse gases; and using data and science for improved climate risk forecasting.  

    In a conversation prepared for MIT News, faculty from three of the teams in the competition’s “Building equity and fairness into climate solutions” category share their thoughts on the need for inclusive solutions that prioritize disadvantaged and vulnerable populations, and discuss how they are working to accelerate their research to achieve the greatest impact. The following responses have been edited for length and clarity.

    The Equitable Resilience Framework

    Any effort to solve the most complex global climate problems must recognize the unequal burdens borne by different groups, communities, and societies — and should be equitable as well as effective. Janelle Knox-Hayes, associate professor in the Department of Urban Studies and Planning, leads a team that is developing processes and practices for equitable resilience, starting with a local pilot project in Boston over the next five years and extending to other cities and regions of the country. The Equitable Resilience Framework (ERF) is designed to create long-term economic, social, and environmental transformations by increasing the capacity of interconnected systems and communities to respond to a broad range of climate-related events. 

    Q: What is the problem you are trying to solve?

    A: Inequity is one of the severe impacts of climate change and resonates in both mitigation and adaptation efforts. It is important for climate strategies to address challenges of inequity and, if possible, to design strategies that enhance justice, equity, and inclusion, while also enhancing the efficacy of mitigation and adaptation efforts. Our framework offers a blueprint for how communities, cities, and regions can begin to undertake this work.

    Q: What are the most significant barriers that have impacted progress to date?

    A: There is considerable inertia in policymaking. Climate change requires a rethinking, not only of directives but pathways and techniques of policymaking. This is an obstacle and part of the reason our project was designed to scale up from local pilot projects. Another consideration is that the private sector can be more adaptive and nimble in its adoption of creative techniques. Working with the MIT Climate and Sustainability Consortium there may be ways in which we could modify the ERF to help companies address similar internal adaptation and resilience challenges.

    Protecting and enhancing natural carbon sinks

    Deforestation and forest degradation of strategic ecosystems in the Amazon, Central Africa, and Southeast Asia continue to reduce capacity to capture and store carbon through natural systems and threaten even the most aggressive decarbonization plans. John Fernandez, professor in the Department of Architecture and director of the Environmental Solutions Initiative, reflects on his work with Daniela Rus, professor of electrical engineering and computer science and director of the Computer Science and Artificial Intelligence Laboratory, and Joann de Zegher, assistant professor of Operations Management at MIT Sloan, to protect tropical forests by deploying a three-part solution that integrates targeted technology breakthroughs, deep community engagement, and innovative bioeconomic opportunities. 

    Q: Why is the problem you seek to address a “grand challenge”?

    A: We are trying to bring the latest technology to monitoring, assessing, and protecting tropical forests, as well as other carbon-rich and highly biodiverse ecosystems. This is a grand challenge because natural sinks around the world are threatening to release enormous quantities of stored carbon that could lead to runaway global warming. When combined with deep community engagement, particularly with indigenous and afro-descendant communities, this integrated approach promises to deliver substantially enhanced efficacy in conservation coupled to robust and sustainable local development.

    Q: What is known about this problem and what questions remain unanswered?

    A: Satellites, drones, and other technologies are acquiring more data about natural carbon sinks than ever before. The problem is well-described in certain locations such as the eastern Amazon, which has shifted from a net carbon sink to now a net positive carbon emitter. It is also well-known that indigenous peoples are the most effective stewards of the ecosystems that store the greatest amounts of carbon. One of the key questions that remains to be answered is determining the bioeconomy opportunities inherent within the natural wealth of tropical forests and other important ecosystems that are important to sustained protection and conservation.

    Reducing group-based disparities in climate adaptation

    Race, ethnicity, caste, religion, and nationality are often linked to vulnerability to the adverse effects of climate change, and if left unchecked, threaten to exacerbate long standing inequities. A team led by Evan Lieberman, professor of political science and director of the MIT Global Diversity Lab and MIT International Science and Technology Initiatives, Danielle Wood, assistant professor in the Program in Media Arts and Sciences and the Department of Aeronautics and Astronautics, and Siqi Zheng, professor of urban and real estate sustainability in the Center for Real Estate and the Department of Urban Studies and Planning, is seeking to  reduce ethnic and racial group-based disparities in the capacity of urban communities to adapt to the changing climate. Working with partners in nine coastal cities, they will measure the distribution of climate-related burdens and resiliency through satellites, a custom mobile app, and natural language processing of social media, to help design and test communication campaigns that provide accurate information about risks and remediation to impacted groups. 

    Q: How has this problem evolved?

    A: Group-based disparities continue to intensify within and across countries, owing in part to some randomness in the location of adverse climate events, as well as deep legacies of unequal human development. In turn, economically and politically privileged groups routinely hoard resources for adaptation. In a few cases — notably the United States, Brazil, and with respect to climate-related migrancy, in South Asia — there has been a great deal of research documenting the extent of such disparities. However, we lack common metrics, and for the most part, such disparities are only understood where key actors have politicized the underlying problems. In much of the world, relatively vulnerable and excluded groups may not even be fully aware of the nature of the challenges they face or the resources they require.

    Q: Who will benefit most from your research? 

    A: The greatest beneficiaries will be members of those vulnerable groups who lack the resources and infrastructure to withstand adverse climate shocks. We believe that it will be important to develop solutions such that relatively privileged groups do not perceive them as punitive or zero-sum, but rather as long-term solutions for collective benefit that are both sound and just. More

  • in

    Scientists and musicians tackle climate change together

    Audiences may travel long distances to see their favorite musical acts in concert or to attend large music festivals, which can add to their personal carbon footprint of emissions that are steadily warming the planet. But these same audiences, and the performers they follow, are often quite aware of the dangers of climate change and eager to contribute to ways of curbing those emissions.

    How should the industry reconcile these two perspectives, and how should it harness the enormous influence that musicians have on their fans to help promote action on climate change?

    That was the focus of a wide-ranging discussion on Monday hosted by MIT’s Environmental Solutions Initiative, titled “Artists and scientists together on climate solutions.” The event, which was held live at the Media Lab’s Bartos Theater and streamed online, featured John Fernandez, director of ESI; Dava Newman, director of the Media Lab; Tony McGuinness, a musician with the group Above and Beyond; and Anna Johnson, the sustainability and environment officer at Involved Group, an organization dedicated to embedding sustainability in business operations in the arts and culture fields.

    Fernandez pointed out in opening the discussion that when it comes to influencing people’s attitudes and behavior, changes tend to come about not just through information from a particular field, but rather from a whole culture. “We started thinking about how we might work with artists, how to have scientists and engineers, inventors, and designers working with artists on the challenges that we really need to face,” he said.

    Dealing with the climate change issue, he said, “is not about 2050 or 2100. This is about 2030. This is about this decade. This is about the next two or three years, really shifting that curve” to lowering the world’s greenhouse gas emissions. “It’s not going to be done just with science and engineering,” he added. “It’s got to be done with artists and business and everyone else. It’s not only ‘all of the above’ solutions, it’s ‘all of the above’ people, coming together to solve this problem.”

    Newman, who is also a professor in MIT’s Department of Aeronautics and Astronautics and has served as a NASA deputy administrator, said that while scientists and engineers can produce vast amounts of useful data that clearly demonstrate the dramatic changes the Earth’s climate is undergoing, communicating that information effectively is often a challenge for these specialists. “That data is just the data, but that doesn’t change the hearts and minds,” she said.

    “As scientists, having the data from our satellites, looking down, but also flying airplanes into the atmosphere, … we have the sensors, and then what can we do with it all? … How do we change human behavior? That’s the part I don’t know how to do,” Newman said. “I can have the technology, I can get precision measurements, I can study it, but really at the end of the day, we have to change human behavior, and that is so hard.”

    And that’s where the world of art and music can play a part, she said. “The best way that I know how to do it is with artistic experiences. You can have one moving experience and when you wake up tomorrow, maybe you’re going to do something a little different.” To help generate the compassion and empathy needed to affect behavior positively, she said, “that’s where we turn to the storytellers. We turn to the visionaries.”

    McGuinness, whose electronic music trio has performed for millions of people around the world, said that his own awareness of the urgency of the climate issue came from his passion for scuba diving, and the dramatic changes he has seen over the last two decades. In diving at a coral reef off Palau in the South Pacific, he returned to what had been a lush, brightly colored ecosystem, and found that “immediately when you put your face under the water, you’re looking at the surface of the moon. It was a horrible shock to see this.”

    After this and other similar diving experiences, he said, “I just came away shocked and stunned,” and realizing the kinds of underwater experiences he had enjoyed would no longer exist for his children. After reading more on the subject of global warming,  “that really sort of tipped me over the edge. And I was like, this is probably the most important thing for living beings now. And that’s sort of where I’ve remained ever since.”

    While his group Above and Beyond has performed one song specifically related to global warming, he doesn’t expect that to be the most impactful way of using their influence. Rather, they’re trying to lead by example, he said, by paying more attention to everything from the supply chains of the merchandise sold at concerts to the emissions generated by travel to the concerts. They’re also being selective about concert venues and making an effort to find performance spaces that are making a significant effort to curb their emissions.

    “If people start voting with their wallets,” McGuinness said, “and there are companies that are doing better than others and are doing the right thing, maybe it’ll catch on. I guess that’s what we can hope for.”

    Understanding these kinds of issues, involving supply chains, transportation, and facilities associated within the music industry, has been the focus of much of Johnson’s work, through the organization Involved Group, which has entered into a collaboration with MIT through the Environmental Solutions Initiative. “It’s these kinds of novel partnerships that have so much potential to catalyze the change that we need to see at an incredible pace,” she said. Already, her group has worked with MIT on mapping out where emissions occur throughout the various aspects of the music industry.

    At a recent music festival in London, she said, the group interviewed hundreds of participants, including audience members, band members, and the crew. “We explored people’s level of awareness of the issues around climate change and environmental degradation,” she said. “And what was really interesting was that there was clearly a lot of awareness of the issue across those different stakeholders, and what felt like a real, genuine level of concern and also of motivation, to want to deepen their understanding of what their contribution on a personal level really meant.”

    Working together across the boundaries of different disciplines and areas of expertise could be crucial to winning the battle against global warming, Newman said. “That’s usually how breakthroughs work,” she said. “If we’re really looking to have impact, it’s going to be from teams of people who are trained across the disciplines.” She pointed out that 90 percent of MIT students are also musicians: “It does go together!” she said. “I think going forward, we have to create new academia, new opportunities that are truly multidisciplinary.” More

  • in

    A robot that finds lost items

    A busy commuter is ready to walk out the door, only to realize they’ve misplaced their keys and must search through piles of stuff to find them. Rapidly sifting through clutter, they wish they could figure out which pile was hiding the keys.

    Researchers at MIT have created a robotic system that can do just that. The system, RFusion, is a robotic arm with a camera and radio frequency (RF) antenna attached to its gripper. It fuses signals from the antenna with visual input from the camera to locate and retrieve an item, even if the item is buried under a pile and completely out of view.

    The RFusion prototype the researchers developed relies on RFID tags, which are cheap, battery-less tags that can be stuck to an item and reflect signals sent by an antenna. Because RF signals can travel through most surfaces (like the mound of dirty laundry that may be obscuring the keys), RFusion is able to locate a tagged item within a pile.

    Using machine learning, the robotic arm automatically zeroes-in on the object’s exact location, moves the items on top of it, grasps the object, and verifies that it picked up the right thing. The camera, antenna, robotic arm, and AI are fully integrated, so RFusion can work in any environment without requiring a special set up.

    While finding lost keys is helpful, RFusion could have many broader applications in the future, like sorting through piles to fulfill orders in a warehouse, identifying and installing components in an auto manufacturing plant, or helping an elderly individual perform daily tasks in the home, though the current prototype isn’t quite fast enough yet for these uses.

    “This idea of being able to find items in a chaotic world is an open problem that we’ve been working on for a few years. Having robots that are able to search for things under a pile is a growing need in industry today. Right now, you can think of this as a Roomba on steroids, but in the near term, this could have a lot of applications in manufacturing and warehouse environments,” said senior author Fadel Adib, associate professor in the Department of Electrical Engineering and Computer Science and director of the Signal Kinetics group in the MIT Media Lab.

    Co-authors include research assistant Tara Boroushaki, the lead author; electrical engineering and computer science graduate student Isaac Perper; research associate Mergen Nachin; and Alberto Rodriguez, the Class of 1957 Associate Professor in the Department of Mechanical Engineering. The research will be presented at the Association for Computing Machinery Conference on Embedded Networked Senor Systems next month.

    Play video

    Sending signals

    RFusion begins searching for an object using its antenna, which bounces signals off the RFID tag (like sunlight being reflected off a mirror) to identify a spherical area in which the tag is located. It combines that sphere with the camera input, which narrows down the object’s location. For instance, the item can’t be located on an area of a table that is empty.

    But once the robot has a general idea of where the item is, it would need to swing its arm widely around the room taking additional measurements to come up with the exact location, which is slow and inefficient.

    The researchers used reinforcement learning to train a neural network that can optimize the robot’s trajectory to the object. In reinforcement learning, the algorithm is trained through trial and error with a reward system.

    “This is also how our brain learns. We get rewarded from our teachers, from our parents, from a computer game, etc. The same thing happens in reinforcement learning. We let the agent make mistakes or do something right and then we punish or reward the network. This is how the network learns something that is really hard for it to model,” Boroushaki explains.

    In the case of RFusion, the optimization algorithm was rewarded when it limited the number of moves it had to make to localize the item and the distance it had to travel to pick it up.

    Once the system identifies the exact right spot, the neural network uses combined RF and visual information to predict how the robotic arm should grasp the object, including the angle of the hand and the width of the gripper, and whether it must remove other items first. It also scans the item’s tag one last time to make sure it picked up the right object.

    Cutting through clutter

    The researchers tested RFusion in several different environments. They buried a keychain in a box full of clutter and hid a remote control under a pile of items on a couch.

    But if they fed all the camera data and RF measurements to the reinforcement learning algorithm, it would have overwhelmed the system. So, drawing on the method a GPS uses to consolidate data from satellites, they summarized the RF measurements and limited the visual data to the area right in front of the robot.

    Their approach worked well — RFusion had a 96 percent success rate when retrieving objects that were fully hidden under a pile.

    “Sometimes, if you only rely on RF measurements, there is going to be an outlier, and if you rely only on vision, there is sometimes going to be a mistake from the camera. But if you combine them, they are going to correct each other. That is what made the system so robust,” Boroushaki says.

    In the future, the researchers hope to increase the speed of the system so it can move smoothly, rather than stopping periodically to take measurements. This would enable RFusion to be deployed in a fast-paced manufacturing or warehouse setting.

    Beyond its potential industrial uses, a system like this could even be incorporated into future smart homes to assist people with any number of household tasks, Boroushaki says.

    “Every year, billions of RFID tags are used to identify objects in today’s complex supply chains, including clothing and lots of other consumer goods. The RFusion approach points the way to autonomous robots that can dig through a pile of mixed items and sort them out using the data stored in the RFID tags, much more efficiently than having to inspect each item individually, especially when the items look similar to a computer vision system,” says Matthew S. Reynolds, CoMotion Presidential Innovation Fellow and associate professor of electrical and computer engineering at the University of Washington, who was not involved in the research. “The RFusion approach is a great step forward for robotics operating in complex supply chains where identifying and ‘picking’ the right item quickly and accurately is the key to getting orders fulfilled on time and keeping demanding customers happy.”

    The research is sponsored by the National Science Foundation, a Sloan Research Fellowship, NTT DATA, Toppan, Toppan Forms, and the Abdul Latif Jameel Water and Food Systems Lab. More