Advanced searches left 3/3

3D Rendering - Arxiv

Summarized by Plex Scholar
Last Updated: 02 July 2022

* If you want to update the article please login/register

Neural Rendering for Stereo 3D Reconstruction of Deformable Tissues in Robotic Surgery

For several applications, such as intra-operative navigation and image-guided robotic surgery automation, the reconstruction of the soft tissues in robotic surgery from endoscopic stereo videos is vital. Soft tissue reconstruction is also a challenge in non-rigid deformations, tool occlusion, and poor 3D results from a single angle. Our approach outperforms the existing state-of-the-art reconstruction scheme for treating various complicated non-rigid deformations with experiments on DaVinci robotic surgery videos. This is the first work leveraging neural rendering for surgical scene 3D reconstruction with outstanding results as a result.

Source link: https://arxiv.org/abs/2206.15255v1


Learning to Infer 3D Shape Programs with Differentiable Renderer

We suggest an analytical yet flexible executor that is more accurate and precise in interpreting shape programs and more sample-driven, building on the previous plan of the emph3D shape programs' presentation alone with the accompanying neural generator and executor from citettian2019learning. These support the generator's learning when ground truth services are not available, and they could be particularly useful when new shape-program components are embedded either by human designers or -- in the case of library learning -- algorithms themselves.

Source link: https://arxiv.org/abs/2206.12675v1


Neural Rendering in a Room: Amodal 3D Understanding and Free-Viewpoint Rendering for the Closed Scene Composed of Pre-Captured Objects

We hereby present a novel approach to recreate such human perception capabilities based on a new model of a modal 3D scene understanding with neural rendering for a closed scene. We provide a panoramic view of the scene in various layouts on the web stage to accurately determine the correct 3D scene layout and produce a realistic free-viewpoint rendering. Our method uses compositional neural rendering techniques for data augmentation in offline training in order to bridge the domain gap between the offline and online stage. Our experiments show that our two-stage design provides robust 3D scene recognition and outperforms competing methods by a large margin, as well as showing that our realistic free-viewpoint rendering supports numerous applications, such as scene touring and editing.

Source link: https://arxiv.org/abs/2205.02714v1

* Please keep in mind that all text is summarized by machine, we do not bear any responsibility, and you should always check original source before taking any actions

* Please keep in mind that all text is summarized by machine, we do not bear any responsibility, and you should always check original source before taking any actions