×ÔοÊÓÆµ

>

Neural-Augmented Kelvinlet for Real-Time Soft Tissue Deformation Modeling

Shahbazi, Ashkan; Pereira, Kyvia; Heiselman, Jon S.; Akbari, Elaheh; Benson, Annie C.; Seifi, Sepehr; Liu, Xinyuan; Johnston, Garrison Lawrence Horswill; Wu, Jie Ying; Simaan, Nabil; Miga, Michael; Kolouri, Soheil (2026).Ìý.ÌýProceedings of the AAAI Conference on Artificial Intelligence, 40(30), 25243–25251.

Accurately simulating how soft tissues (like organs) deform during surgery is important for applications such as surgical training, robotic surgery, and automated surgical systems. Traditional physics-based methods like the Finite Element Method (FEM) can model these deformations well, but they are often too slow for real-time use. Faster, neural network–based models can make quick predictions, but if they rely only on data and ignore physical laws, they may produce unrealistic results.

This study introduces a new hybrid approach that combines the speed of neural networks with built-in physics knowledge. Specifically, it incorporates Kelvinlets (mathematical solutions that describe how materials deform under force) as guiding principles, along with large datasets generated from FEM simulations. This allows the model to capture both simple and complex tissue behaviors while staying physically realistic.

The method can quickly and accurately predict how tissues deform when manipulated by surgical tools, including cases where multiple tools interact at once. Tests on simulated surgical tasks show that this approach produces more stable and realistic results than existing methods, while still running fast enough for real-time applications. Overall, the work demonstrates a promising way to build fast, reliable simulations for use in surgical AI and robotics.