A conference poster presenting SurroundSDF, a vision-centric framework for 3D scene understanding using Signed Distance Fields. It details the pipeline, Sandwich Eikonal formulation, and experimental results on the Occ3D-nuScenes dataset, comparing performance against methods like SIREN and LODE.
Paper title: SurroundSDF: Implicit 3D Scene Understanding Based on Signed Distance Field Abstract: A conference poster presenting SurroundSDF, a vision-centric framework for 3D scene understanding using Signed Distance Fields. It details the pipeline, Sandwich Eikonal formulation, and experimental results on the Occ3D-nuScenes dataset, comparing performance against methods like SIREN and LODE. Paper body (method & results): <!DOCTYPE html> <html lang="en"> <head> <meta content="text/html; charset=utf-8" http-equiv="content-type"/> <title>SurroundSDF: Implicit 3D Scene Understanding Based on Signed Distance Field</title> <!--Generated on Thu Mar 21 12:42:19 2024 by LaTeXML (version 0.8.7) http://dlmf.nist.gov/LaTeXML/.--> <meta content="width=device-width, initial-scale=1, shrink-to-fit=no" name="viewport"/> <link href="https://cdn.jsdelivr.net/npm/bootstrap@5.3.0/dist/css/bootstrap.min.css" rel="stylesheet" type="text/css"/> <link href="/static/browse/0.3.4/css/ar5iv_0.7.4.min.css" rel="stylesheet" type="text/css"/> <link href="/static/browse/0.3.4/css/latexml_styles.css" rel="stylesheet" type="text/css"/> <script src="https://cdn.jsdelivr.net/npm/bootstrap@5.3.0/dist/js/bootstrap.bundle.min.js"></script> <script src="https://cdnjs.cloudflare.com/ajax/libs/html2canvas/1.3.3/html2canvas.min.js"></script> <script src="/static/browse/0.3.4/js/addons.js"></script> <script src="/static/browse/0.3.4/js/feedbackOverlay.js"></script> <base href="/html/2403.14366v1/"/></head> <body> <nav class="ltx_page_navbar"> <nav class="ltx_TOC"> <ol class="ltx_toclist"> <li class="ltx_tocentry ltx_tocentry_section"><a class="ltx_ref" href="https://arxiv.org/html/2403.14366v1#S1" title="1 Introduction ‣ SurroundSDF: Implicit 3D Scene Understanding Based on Signed Distance Field"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref">1 </span>Introduction</span></a></li> <li class="ltx_tocentry ltx_tocentry_section"> <a class="ltx_ref" href="https://arxiv.org/html/2403.14366v1#S2" title="2 Related Work ‣ SurroundSDF: Implicit 3D Scene Understanding Based on Signed Distance Field"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref">2 </span>Related Work</span></a> <ol class="ltx_toclist ltx_toclist_section"> <li class="ltx_tocentry ltx_tocentry_paragraph"><a class="ltx_ref" href="https://arxiv.org/html/2403.14366v1#S2.SS0.SSS0.Px1" title="Occupancy Prediction ‣ 2 Related Work ‣ SurroundSDF: Implicit 3D Scene Understanding Based on Signed Distance Field"><span class="ltx_text ltx_ref_title">Occupancy Prediction</span></a></li> <li class="ltx_tocentry ltx_tocentry_paragraph"><a class="ltx_ref" href="https://arxiv.org/html/2403.14366v1#S2.SS0.SSS0.Px2" title="Implicit Scene Perception ‣ 2 Related Work ‣ SurroundSDF: Implicit 3D Scene Understanding Based on Signed Distance Field"><span class="ltx_text ltx_ref_title">Implicit Scene Perception</span></a></li> </ol> </li> <li class="ltx_tocentry ltx_tocentry_section"> <a class="ltx_ref" href="https://arxiv.org/html/2403.14366v1#S3" title="3 Formulation ‣ SurroundSDF: Implicit 3D Scene Understanding Based on Signed Distance Field"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref">3 </span>Formulation</span></a> <ol class="ltx_toclist ltx_toclist_section"> <li class="ltx_tocentry ltx_tocentry_subsection"><a class="ltx_ref" href="https://arxiv.org/html/2403.14366v1#S3.SS1" title="3.1 Eikonal-based SDF Constraints ‣ 3 Formulation ‣ SurroundSDF: Implicit 3D Scene Understanding Based on Signed Distance Field"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref">3.1 </span>Eikonal-based SDF Constraints</span></a></li> <li class="ltx_tocentry ltx_tocentry_subsection"><a class="ltx_ref" href="https://arxiv.org/html/2403.14366v1#S3.SS2" title="3.2 Sandwich Eikonal Formulation ‣ 3 Formulation ‣ SurroundSDF: Implicit 3D Scene Understanding Based on Signed Distance Field"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref">3.2 </span>Sandwich Eikonal Formulation</span></a></li> </ol> </li> <li class="ltx_tocentry ltx_tocentry_section"> <a class="ltx_ref" href="https://arxiv.org/html/2403.14366v1#S4" title="4 Method ‣ SurroundSDF: Implicit 3D Scene Understanding Based on Signed Distance Field"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref">4 </span>Method</span></a> <ol class="ltx_toclist ltx_toclist_section"> <li class="ltx_tocentry ltx_tocentry_subsection"><a class="ltx_ref" href="https://arxiv.org/html/2403.14366v1#S4.SS1" title="4.1 Architecture ‣ 4 Method ‣ SurroundSDF: Implicit 3D Scene Understanding Based on Signed Distance Field"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref">4.1 </span>Architecture</span></a></li> <li class="ltx_tocentry ltx_tocentry_subsection"> <a class="ltx_ref" href="https://arxiv.org/html/2403.14366v1#S4.SS2" title="4.2 Supervision ‣ 4 Method ‣ SurroundSDF: Implicit 3D Scene Understanding Based on Signed Distance Field"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref">4.2 </span>Supervision</span></a> <ol class="ltx_toclist ltx_toclist_subsection"> <li class="ltx_tocentry ltx_tocentry_paragraph"><a class="ltx_ref" href="https://arxiv.org/html/2403.14366v1#S4.SS2.SSS0.Px1" title="SDF Supervision ‣ 4.2 Supervision ‣ 4 Method ‣ SurroundSDF: Implicit 3D Scene Understanding Based on Signed Distance Field"><span class="ltx_text ltx_ref_title">SDF Supervision</span></a></li> <li class="ltx_tocentry ltx_tocentry_paragraph"><a class="ltx_ref" href="https://arxiv.org/html/2403.14366v1#S4.SS2.SSS0.Px2" title="Semantic Supervision ‣ 4.2 Supervision ‣ 4 Method ‣ SurroundSDF: Implicit 3D Scene Understanding Based on Signed Distance Field"><span class="ltx_text ltx_ref_title">Semantic Supervision</span></a></li> <li class="ltx_tocentry ltx_tocentry_paragraph"><a class="ltx_ref" href="https://arxiv.org/html/2403.14366v1#S4.SS2.SSS0.Px3" title="Joint Supervision ‣ 4.2 Supervision ‣ 4 Method ‣ SurroundSDF: Implicit 3D Scene Understanding Based on Signed Distance Field"><span class="ltx_text ltx_ref_title">Joint Supervision</span></a></li> </ol> </li> <li class="ltx_tocentry ltx_tocentry_subsection"> <a class="ltx_ref" href="https://arxiv.org/html/2403.14366v1#S4.SS3" title="4.3 Inference ‣ 4 Method ‣ SurroundSDF: Implicit 3D Scene Understanding Based on Signed Distance Field"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref">4.3 </span>Inference</span></a> <ol class="ltx_toclist ltx_toclist_subsection"> <li class="ltx_tocentry ltx_tocentry_paragraph"><a class="ltx_ref" href="https://arxiv.org/html/2403.14366v1#S4.SS3.SSS0.Px1" title="Semantic Mesh Generation ‣ 4.3 Inference ‣ 4 Method ‣ SurroundSDF: Implicit 3D Scene Understanding Based on Signed Distance Field"><span class="ltx_text ltx_ref_title">Semantic Mesh Generation</span></a></li> <li class="ltx_tocentry ltx_tocentry_paragraph"><a class="ltx_ref" href="https://arxiv.org/html/2403.14366v1#S4.SS3.SSS0.Px2" title="Occupancy Prediction ‣ 4.3 Inference ‣ 4 Method ‣ SurroundSDF: Implicit 3D Scene Understanding Based on Signed Distance Field"><span class="ltx_text ltx_ref_title">Occupancy Prediction</span></a></li> <li class="ltx_tocentry ltx_tocentry_paragraph"><a class="ltx_ref" href="https://arxiv.org/html/2403.14366v1#S4.SS3.SSS0.Px3" title="Semantic Scene Reconstruction ‣ 4.3 Inference ‣ 4 Method ‣ SurroundSDF: Implicit 3D Scene Understanding Based on Signed Distance Field"><span class="ltx_text ltx_ref_title">Semantic Scene Reconstruction</span></a></li> </ol> </li> </ol> </li> <li class="ltx_tocentry ltx_tocentry_section"> <a class="ltx_ref" href="https://arxiv.org/html/2403.14366v1#S5" title="5 Experiments ‣ SurroundSDF: Implicit 3D Scene Understanding Based on Signed Distance Field"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref">5 </span>Experiments</span></a> <ol class="ltx_toclist ltx_toclist_section"> <li class="ltx_tocentry ltx_tocentry_subsection"><a class="ltx_ref" href="https://arxiv.org/html/2403.14366v1#S5.SS1" title="5.1 Experimental Setup ‣ 5 Experiments ‣ SurroundSDF: Implicit 3D Scene Understanding Based on Signed Distance Field"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref">5.1 </span>Experimental Setup</span></a></li> <li class="ltx_tocentry ltx_tocentry_subsection"><a class="ltx_ref" href="https://arxiv.org/html/2403.14366v1#S5.SS2" title="5.2 3D Semantic Occupancy Prediction ‣ 5 Experiments ‣ SurroundSDF: Implicit 3D Scene Understanding Based on Signed Distance Field"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref">5.2 </span>3D Semantic Occupancy Prediction</span></a></li> <li class="ltx_tocentry ltx_tocentry_subsection"><a class="ltx_ref" href="https://arxiv.org/html/2403.14366v1#S5.SS3" title="5.3 3D Scene Reconstruction ‣ 5 Experiments ‣ SurroundSDF: Implicit 3D Scene Understanding Based on Signed Distance Field"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref">5.3 </span>3D Scene Reconstruction</span></a></li> <li class="ltx_tocentry ltx_tocentry_subsection"><a class="ltx_ref" href="https://arxiv.org/html/2403.14366v1#S5.SS4" title="5.4 Ablation Study ‣ 5 Experiments ‣ SurroundSDF: Implicit 3D Scene Understanding Based on Signed Distance Field"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref">5.4 </span>Ablation Study</span></a></li> <li class="ltx_tocentry ltx_tocentry_subsection"><a class="ltx_ref" href="https://arxiv.org/html/2403.14366v1#S5.SS5" title="5.5 Comparison of Visual Results ‣ 5 Experiments ‣ SurroundSDF: Implicit 3D Scene Understanding Based on Signed Distance Field"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref">5.5 </span>Comparison of Visual Results</span></a></li> </ol> </li> <li class="ltx_tocentry ltx_tocentry_section"><a class="ltx_ref" href="https://arxiv.org/html/2403.14366v1#S6" title="6 Conclusion ‣ SurroundSDF: Implicit 3D Scene Understanding Based on Signed Distance Field"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref">6 </span>Conclusion</span></a></li> </ol></nav> </nav> <div class="ltx_page_main"> <div class="ltx_page_content"> <div aria-label="Conversion errors have been found" class="package-alerts ltx_document" role="status"> <button aria-label="Dismiss alert" onclick="closePopup()"> <span aria-hidden="true"><svg aria-hidden="true" focusable="false" height="20" role="presentation" viewbox="0 0 44 44" width="20"> <path d="M0.549989 4.44999L4.44999 0.549988L43.45 39.55L39.55 43.45L0.549989 4.44999Z"></path> <path d="M39.55 0.549988L43.45 4.44999L4.44999 43.45L0.549988 39.55L39.55 0.549988Z"></path> </svg></span> </button> <p>HTML conversions <a href="https://info.dev.arxiv.org/about/accessibility_html_error_messages.html" target="_blank">sometimes display errors</a> due to content that did not convert correctly from the source. This paper uses the following packages that are not yet supported by the HTML conversion tool. Feedback on these issues are not necessary; they are known and are being worked on.</p> <ul arial-label="Unsupported packages used in this paper"> <li>failed: epic</li> </ul> <p>Authors: achieve the best HTML results from your LaTeX submissions by following these <a href="https://info.arxiv.org/help/submit_latex_best_practices.html" target="_blank">best practices</a>.</p> </div><div class="section" id="target-section">