More stories

  • in

    Imaging technique removes the effect of water in underwater scenes

    The ocean is teeming with life. But unless you get up close, much of the marine world can easily remain unseen. That’s because water itself can act as an effective cloak: Light that shines through the ocean can bend, scatter, and quickly fade as it travels through the dense medium of water and reflects off the persistent haze of ocean particles. This makes it extremely challenging to capture the true color of objects in the ocean without imaging them at close range.Now a team from MIT and the Woods Hole Oceanographic Institution (WHOI) has developed an image-analysis tool that cuts through the ocean’s optical effects and generates images of underwater environments that look as if the water had been drained away, revealing an ocean scene’s true colors. The team paired the color-correcting tool with a computational model that converts images of a scene into a three-dimensional underwater “world,” that can then be explored virtually.The researchers have dubbed the new tool “SeaSplat,” in reference to both its underwater application and a method known as 3D gaussian splatting (3DGS), which takes images of a scene and stitches them together to generate a complete, three-dimensional representation that can be viewed in detail, from any perspective.“With SeaSplat, it can model explicitly what the water is doing, and as a result it can in some ways remove the water, and produces better 3D models of an underwater scene,” says MIT graduate student Daniel Yang.The researchers applied SeaSplat to images of the sea floor taken by divers and underwater vehicles, in various locations including the U.S. Virgin Islands. The method generated 3D “worlds” from the images that were truer and more vivid and varied in color, compared to previous methods.The team says SeaSplat could help marine biologists monitor the health of certain ocean communities. For instance, as an underwater robot explores and takes pictures of a coral reef, SeaSplat would simultaneously process the images and render a true-color, 3D representation, that scientists could then virtually “fly” through, at their own pace and path, to inspect the underwater scene, for instance for signs of coral bleaching.“Bleaching looks white from close up, but could appear blue and hazy from far away, and you might not be able to detect it,” says Yogesh Girdhar, an associate scientist at WHOI. “Coral bleaching, and different coral species, could be easier to detect with SeaSplat imagery, to get the true colors in the ocean.”Girdhar and Yang will present a paper detailing SeaSplat at the IEEE International Conference on Robotics and Automation (ICRA). Their study co-author is John Leonard, professor of mechanical engineering at MIT.Aquatic opticsIn the ocean, the color and clarity of objects is distorted by the effects of light traveling through water. In recent years, researchers have developed color-correcting tools that aim to reproduce the true colors in the ocean. These efforts involved adapting tools that were developed originally for environments out of water, for instance to reveal the true color of features in foggy conditions. One recent work accurately reproduces true colors in the ocean, with an algorithm named “Sea-Thru,” though this method requires a huge amount of computational power, which makes its use in producing 3D scene models challenging.In parallel, others have made advances in 3D gaussian splatting, with tools that seamlessly stitch images of a scene together, and intelligently fill in any gaps to create a whole, 3D version of the scene. These 3D worlds enable “novel view synthesis,” meaning that someone can view the generated 3D scene, not just from the perspective of the original images, but from any angle and distance.But 3DGS has only successfully been applied to environments out of water. Efforts to adapt 3D reconstruction to underwater imagery have been hampered, mainly by two optical underwater effects: backscatter and attenuation. Backscatter occurs when light reflects off of tiny particles in the ocean, creating a veil-like haze. Attenuation is the phenomenon by which light of certain wavelengths attenuates, or fades with distance. In the ocean, for instance, red objects appear to fade more than blue objects when viewed from farther away.Out of water, the color of objects appears more or less the same regardless of the angle or distance from which they are viewed. In water, however, color can quickly change and fade depending on one’s perspective. When 3DGS methods attempt to stitch underwater images into a cohesive 3D whole, they are unable to resolve objects due to aquatic backscatter and attenuation effects that distort the color of objects at different angles.“One dream of underwater robotic vision that we have is: Imagine if you could remove all the water in the ocean. What would you see?” Leonard says.A model swimIn their new work, Yang and his colleagues developed a color-correcting algorithm that accounts for the optical effects of backscatter and attenuation. The algorithm determines the degree to which every pixel in an image must have been distorted by backscatter and attenuation effects, and then essentially takes away those aquatic effects, and computes what the pixel’s true color must be.Yang then worked the color-correcting algorithm into a 3D gaussian splatting model to create SeaSplat, which can quickly analyze underwater images of a scene and generate a true-color, 3D virtual version of the same scene that can be explored in detail from any angle and distance.The team applied SeaSplat to multiple underwater scenes, including images taken in the Red Sea, in the Carribean off the coast of Curaçao, and the Pacific Ocean, near Panama. These images, which the team took from a pre-existing dataset, represent a range of ocean locations and water conditions. They also tested SeaSplat on images taken by a remote-controlled underwater robot in the U.S. Virgin Islands.From the images of each ocean scene, SeaSplat generated a true-color 3D world that the researchers were able to virtually explore, for instance zooming in and out of a scene and viewing certain features from different perspectives. Even when viewing from different angles and distances, they found objects in every scene retained their true color, rather than fading as they would if viewed through the actual ocean.“Once it generates a 3D model, a scientist can just ‘swim’ through the model as though they are scuba-diving, and look at things in high detail, with real color,” Yang says.For now, the method requires hefty computing resources in the form of a desktop computer that would be too bulky to carry aboard an underwater robot. Still, SeaSplat could work for tethered operations, where a vehicle, tied to a ship, can explore and take images that can be sent up to a ship’s computer.“This is the first approach that can very quickly build high-quality 3D models with accurate colors, underwater, and it can create them and render them fast,” Girdhar says. “That will help to quantify biodiversity, and assess the health of coral reef and other marine communities.”This work was supported, in part, by the Investment in Science Fund at WHOI, and by the U.S. National Science Foundation. More

  • in

    How J-WAFS Solutions grants bring research to market

    For the Abdul Latif Jameel Water and Food Systems Lab (J-WAFS), 2025 marks a decade of translating groundbreaking research into tangible solutions for global challenges. Few examples illustrate that mission better than NONA Technologies. With support from a J-WAFS Solutions grant, MIT electrical engineering and biological engineering Professor Jongyoon Han and his team developed a portable desalination device that transforms seawater into clean drinking water without filters or high-pressure pumps. The device stands apart from traditional systems because conventional desalination technologies, like reverse osmosis, are energy-intensive, prone to fouling, and typically deployed at large, centralized plants. In contrast, the device developed in Han’s lab employs ion concentration polarization technology to remove salts and particles from seawater, producing potable water that exceeds World Health Organization standards. It is compact, solar-powered, and operable at the push of a button — making it an ideal solution for off-grid and disaster-stricken areas.This research laid the foundation for spinning out NONA Technologies along with co-founders Junghyo Yoon PhD ’21 from Han’s lab and Bruce Crawford MBA ’22, to commercialize the technology and address pressing water-scarcity issues worldwide. “This is really the culmination of a 10-year journey that I and my group have been on,” said Han in an earlier MIT News article. “We worked for years on the physics behind individual desalination processes, but pushing all those advances into a box, building a system, and demonstrating it in the ocean … that was a really meaningful and rewarding experience for me.” You can watch this video showcasing the device in action.Moving breakthrough research out of the lab and into the world is a well-known challenge. While traditional “seed” grants typically support early-stage research at Technology Readiness Level (TRL) 1-2, few funding sources exist to help academic teams navigate to the next phase of technology development. The J-WAFS Solutions Program is strategically designed to address this critical gap by supporting technologies in the high-risk, early-commercialization phase that is often neglected by traditional research, corporate, and venture funding. By supporting technologies at TRLs 3-5, the program increases the likelihood that promising innovations will survive beyond the university setting, advancing sufficiently to attract follow-on funding.Equally important, the program gives academic researchers the time, resources, and flexibility to de-risk their technology, explore customer need and potential real-world applications, and determine whether and how they want to pursue commercialization. For faculty-led teams like Han’s, the J-WAFS Solutions Program provided the critical financial runway and entrepreneurial guidance needed to refine the technology, test assumptions about market fit, and lay the foundation for a startup team. While still in the MIT innovation ecosystem, Nona secured over $200,000 in non-dilutive funding through competitions and accelerators, including the prestigious MIT delta v Educational Accelerator. These early wins laid the groundwork for further investment and technical advancement.Since spinning out of MIT, NONA has made major strides in both technology development and business viability. What started as a device capable of producing just over half-a-liter of clean drinking water per hour has evolved into a system that now delivers 10 times that capacity, at 5 liters per hour. The company successfully raised a $3.5 million seed round to advance its portable desalination device, and entered into a collaboration with the U.S. Army Natick Soldier Systems Center, where it co-developed early prototypes and began generating revenue while validating the technology. Most recently, NONA was awarded two SBIR Phase I grants totaling $575,000, one from the National Science Foundation and another from the National Institute of Environmental Health Sciences.Now operating out of Greentown Labs in Somerville, Massachusetts, NONA has grown to a dedicated team of five and is preparing to launch its nona5 product later this year, with a wait list of over 1,000 customers. It is also kicking off its first industrial pilot, marking a key step toward commercial scale-up. “Starting a business as a postdoc was challenging, especially with limited funding and industry knowledge,” says Yoon, who currently serves as CTO of NONA. “J-WAFS gave me the financial freedom to pursue my venture, and the mentorship pushed me to hit key milestones. Thanks to J-WAFS, I successfully transitioned from an academic researcher to an entrepreneur in the water industry.”NONA is one of several J-WAFS-funded technologies that have moved from the lab to market, part of a growing portfolio of water and food solutions advancing through MIT’s innovation pipeline. As J-WAFS marks a decade of catalyzing innovation in water and food, NONA exemplifies what is possible when mission-driven research is paired with targeted early-stage support and mentorship.To learn more or get involved in supporting startups through the J-WAFS Solutions Program, please contact [email protected]. More

  • in

    Startup helps farmers grow plant-based feed and fertilizer using wastewater

    Farmers today face a number of challenges, from supply chain stability to nutrient and waste management. But hanging over everything is the need to maintain profitability amid changing markets and increased uncertainty.Fyto, founded by former MIT staff member Jason Prapas, is offering a highly automated cultivation system to address several of farmers’ biggest problems at once.At the heart of Fyto’s system is Lemna, a genus of small aquatic plants otherwise known as duckweed. Most people have probably seen thick green mats of Lemna lying on top of ponds and swamps. But Lemna is also rich in protein and capable of doubling in biomass every two days. Fyto has built an automated cropping system that uses nitrogen-rich wastewater from dairy farms to grow Lemna in shallow pools on otherwise less productive farmland. On top of the pools, the company has built what it believes are the largest agricultural robots in the world, which monitor plant health and harvest the Lemna sustainably. The Lemna can then be used on farms as a high-protein cattle feed or fertilizer supplement.Fyto’s systems are designed to rely on minimal land, water, and labor while creating a more sustainable, profitable food system.“We developed from scratch a robotic system that takes the guesswork out of farming this crop,” says Prapas, who previously led the translational research program of MIT’s Tata Center. “It looks at the crop on a daily basis, takes inventory to know how many plants there are, how much should be harvested to have healthy growth the next day, can detect if the color is slightly off or there are nutrient deficiencies, and can suggest different interventions based on all that data.”From kiddie pools to cow farmsPrapas’ first job out of college was with an MIT spinout called Green Fuel that harvested algae to make biofuel. He went back to school for a master’s and then a PhD in mechanical engineering, but he continued working with startups. Following his PhD at Colorado State University, he co-founded Factor[e] Ventures to fund and incubate startups focused on improving energy access in emerging markets.Through that work, Prapas was introduced to MIT’s Tata Center for Technology and Design.“We were really interested in the new technologies being developed at the MIT Tata Center, and in funding new startups taking on some of these global climate challenges in emerging markets,” Prapas recalls. “The Tata Center was interested in making sure these technologies get put into practice rather than patented and put on a shelf somewhere. It was a good synergy.”One of the people Prapas got to know was Rob Stoner, the founding director of the Tata Center, who encouraged Prapas to get more directly involved with commercializing new technologies. In 2017, Prapas joined the Tata Center as the translational research director. During that time, Prapas worked with MIT students, faculty, and staff to test their inventions in the real world. Much of that work involved innovations in agriculture.“Farming is a fact of life for a lot of folks around the world — both subsistence farming but also producing food for the community and beyond,” Prapas says. “That has huge implications for water usage, electricity consumption, labor. For years, I’d been thinking about how we make farming a more attractive endeavor for people: How do we make it less back-breaking, more efficient, and more economical?”Between his work at MIT and Factor[e], Prapas visited hundreds of farms around the world, where he started to think about the lack of good choices for farming inputs like animal feed and fertilizers. The problem represented a business opportunity.Fyto began with kiddie pools. Prapas started growing aquatic plants in his backyard, using them as a fertilizer source for vegetables. The experience taught him how difficult it would be to train people to grow and harvest Lemna at large scales on farms.“I realized we’d have to invent both the farming method — the agronomy — and the equipment and processes to grow it at scale cost effectively,” Prapas explains.Prapas started discussing his ideas with others around 2019.“The MIT and Boston ecosystems are great for pitching somewhat crazy ideas to willing audiences and seeing what sticks,” Prapas says. “There’s an intangible benefit of being at MIT, where you just can’t help but think of bold ideas and try putting them into practice.”Prapas, who left MIT to lead Fyto in 2019, partnered with Valerie Peng ’17, SM ’19, then a graduate student at MIT who became his first hire.“Farmers work so hard, and I have so much respect for what they do,” says Peng, who serves as Fyto’s head of engineering. “People talk about the political divide, but there’s a lot of alignment around using less, doing more with what you have, and making our food systems more resilient to drought, supply chain disruptions, and everything else. There’s more in common with everyone than you’d expect.”A new farming methodLemna can produce much more protein per acre than soy, another common source of protein on farms, but it requires a lot of nitrogen to grow. Fortunately, many types of farmers, especially large dairy farmers, have abundant nitrogen sources in the waste streams that come from washing out cow manure.“These waste streams are a big problem: In California it’s believed to be one of the largest source of greenhouse gas emissions in the agriculture sector despite the fact that hundreds of crops are grown in California,” Prapas says.For the last few years, Fyto has run its systems in pilots on farms, trialing the crop as feed and fertilizer before delivering to its customers. The systems Fyto has deployed so far are about 50 feet wide, but it is actively commissioning its newest version that’s 160 feet wide. Eventually, Fyto plans to sell the systems directly to farmers.Fyto is currently awaiting California’s approval for use in feed, but Lemna has already been approved in Europe. Fyto has also been granted a fertilizer license on its plant-based fertilizer, with promising early results in trials, and plans to sell new fertilizer products this year.Although Fyto is focused on dairy farms for its early deployments, it has also grown Lemna using manure from chicken, and Prapas notes that even people like cheese producers have a nitrogen waste problem that Fyto could solve.“Think of us like a polishing step you could put on the end of any system that has an organic waste stream,” Prapas says. “In that situation, we’re interested in growing our crops on it. We’ve had very few things that the plant can’t grow on. Globally, we see this as a new farming method, and that means it’s got a lot of potential applications.” More