Poster presenting ProciGen, a method for template-free reconstruction of human-object interaction using procedural generation and a Hierarchical Diffusion Model (HDM), evaluated on BEHAVE and InterCap datasets.
Paper title: Template Free Reconstruction of Human-object Interaction with Procedural Interaction Generation Abstract: Poster presenting ProciGen, a method for template-free reconstruction of human-object interaction using procedural generation and a Hierarchical Diffusion Model (HDM), evaluated on BEHAVE and InterCap datasets. Paper body (method & results): <!DOCTYPE html> <html lang="en"> <head> <meta content="text/html; charset=utf-8" http-equiv="content-type"/> <title>Template Free Reconstruction of Human-object Interaction with Procedural Interaction Generation</title> <!--Generated on Sat Dec 9 01:21:02 2023 by LaTeXML (version 0.8.7) http://dlmf.nist.gov/LaTeXML/.--> <meta content="width=device-width, initial-scale=1, shrink-to-fit=no" name="viewport"/> <link href="https://cdn.jsdelivr.net/npm/bootstrap@5.3.0/dist/css/bootstrap.min.css" rel="stylesheet" type="text/css"/> <link href="/static/browse/0.3.4/css/ar5iv_0.7.4.min.css" rel="stylesheet" type="text/css"/> <link href="/static/browse/0.3.4/css/latexml_styles.css" rel="stylesheet" type="text/css"/> <script src="https://cdn.jsdelivr.net/npm/bootstrap@5.3.0/dist/js/bootstrap.bundle.min.js"></script> <script src="https://cdnjs.cloudflare.com/ajax/libs/html2canvas/1.3.3/html2canvas.min.js"></script> <script src="/static/browse/0.3.4/js/addons.js"></script> <script src="/static/browse/0.3.4/js/feedbackOverlay.js"></script> <base href="/html/2312.07063v1/"/></head> <body> <nav class="ltx_page_navbar"> <nav class="ltx_TOC"> <ol class="ltx_toclist"> <li class="ltx_tocentry ltx_tocentry_section"><a class="ltx_ref" href="#S1" title="1 Introduction ‣ Template Free Reconstruction of Human-object Interaction with Procedural Interaction Generation"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref">1 </span>Introduction</span></a></li> <li class="ltx_tocentry ltx_tocentry_section"><a class="ltx_ref" href="#S2" title="2 Related Work ‣ Template Free Reconstruction of Human-object Interaction with Procedural Interaction Generation"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref"><span class="ltx_text ltx_font_medium">2</span> </span>Related Work</span></a></li> <li class="ltx_tocentry ltx_tocentry_section"> <a class="ltx_ref" href="#S3" title="3 Method ‣ Template Free Reconstruction of Human-object Interaction with Procedural Interaction Generation"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref"><span class="ltx_text ltx_font_medium">3</span> </span>Method</span></a> <ol class="ltx_toclist ltx_toclist_section"> <li class="ltx_tocentry ltx_tocentry_subsection"> <a class="ltx_ref" href="#S3.SS1" title="3.1 ProciGen: Procedural Interaction Generation ‣ 3 Method ‣ Template Free Reconstruction of Human-object Interaction with Procedural Interaction Generation"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref"><span class="ltx_text ltx_font_medium">3.1</span> </span>ProciGen: Procedural Interaction Generation</span></a> <ol class="ltx_toclist ltx_toclist_subsection"> <li class="ltx_tocentry ltx_tocentry_subsubsection"><a class="ltx_ref" href="#S3.SS1.SSS1" title="3.1.1 Dense Semantic Correspondence ‣ 3.1 ProciGen: Procedural Interaction Generation ‣ 3 Method ‣ Template Free Reconstruction of Human-object Interaction with Procedural Interaction Generation"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref"><span class="ltx_text ltx_font_medium">3.1.1</span> </span>Dense Semantic Correspondence</span></a></li> <li class="ltx_tocentry ltx_tocentry_subsubsection"><a class="ltx_ref" href="#S3.SS1.SSS2" title="3.1.2 Contact Transfer ‣ 3.1 ProciGen: Procedural Interaction Generation ‣ 3 Method ‣ Template Free Reconstruction of Human-object Interaction with Procedural Interaction Generation"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref"><span class="ltx_text ltx_font_medium">3.1.2</span> </span>Contact Transfer</span></a></li> <li class="ltx_tocentry ltx_tocentry_subsubsection"><a class="ltx_ref" href="#S3.SS1.SSS3" title="3.1.3 Contact-based Joint Optimization ‣ 3.1 ProciGen: Procedural Interaction Generation ‣ 3 Method ‣ Template Free Reconstruction of Human-object Interaction with Procedural Interaction Generation"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref"><span class="ltx_text ltx_font_medium">3.1.3</span> </span>Contact-based Joint Optimization</span></a></li> <li class="ltx_tocentry ltx_tocentry_subsubsection"> <a class="ltx_ref" href="#S3.SS1.SSS4" title="3.1.4 Dataset Rendering ‣ 3.1 ProciGen: Procedural Interaction Generation ‣ 3 Method ‣ Template Free Reconstruction of Human-object Interaction with Procedural Interaction Generation"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref"><span class="ltx_text ltx_font_medium">3.1.4</span> </span>Dataset Rendering</span></a> <ol class="ltx_toclist ltx_toclist_subsubsection"> <li class="ltx_tocentry ltx_tocentry_paragraph"><a class="ltx_ref" href="#S3.SS1.SSS4.Px1" title="Method Scalability. ‣ 3.1.4 Dataset Rendering ‣ 3.1 ProciGen: Procedural Interaction Generation ‣ 3 Method ‣ Template Free Reconstruction of Human-object Interaction with Procedural Interaction Generation"><span class="ltx_text ltx_ref_title">Method Scalability.</span></a></li> </ol> </li> </ol> </li> <li class="ltx_tocentry ltx_tocentry_subsection"> <a class="ltx_ref" href="#S3.SS2" title="3.2 HDM: Hierarchical Diffusion Model ‣ 3 Method ‣ Template Free Reconstruction of Human-object Interaction with Procedural Interaction Generation"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref"><span class="ltx_text ltx_font_medium">3.2</span> </span>HDM: Hierarchical Diffusion Model</span></a> <ol class="ltx_toclist ltx_toclist_subsection"> <li class="ltx_tocentry ltx_tocentry_subsubsection"><a class="ltx_ref" href="#S3.SS2.SSS1" title="3.2.1 Preliminaries ‣ 3.2 HDM: Hierarchical Diffusion Model ‣ 3 Method ‣ Template Free Reconstruction of Human-object Interaction with Procedural Interaction Generation"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref"><span class="ltx_text ltx_font_medium">3.2.1</span> </span>Preliminaries</span></a></li> <li class="ltx_tocentry ltx_tocentry_subsubsection"><a class="ltx_ref" href="#S3.SS2.SSS2" title="3.2.2 Joint Human-object Diffusion ‣ 3.2 HDM: Hierarchical Diffusion Model ‣ 3 Method ‣ Template Free Reconstruction of Human-object Interaction with Procedural Interaction Generation"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref"><span class="ltx_text ltx_font_medium">3.2.2</span> </span>Joint Human-object Diffusion</span></a></li> <li class="ltx_tocentry ltx_tocentry_subsubsection"><a class="ltx_ref" href="#S3.SS2.SSS3" title="3.2.3 Hierarchical Diffusion for Interaction ‣ 3.2 HDM: Hierarchical Diffusion Model ‣ 3 Method ‣ Template Free Reconstruction of Human-object Interaction with Procedural Interaction Generation"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref"><span class="ltx_text ltx_font_medium">3.2.3</span> </span>Hierarchical Diffusion for Interaction</span></a></li> </ol> </li> </ol> </li> <li class="ltx_tocentry ltx_tocentry_section"> <a class="ltx_ref" href="#S4" title="4 Experiments ‣ Template Free Reconstruction of Human-object Interaction with Procedural Interaction Generation"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref"><span class="ltx_text ltx_font_medium">4</span> </span>Experiments</span></a> <ol class="ltx_toclist ltx_toclist_section"> <li class="ltx_tocentry ltx_tocentry_subsection"><a class="ltx_ref" href="#S4.SS1" title="4.1 Reconstruction on BEHAVE and InterCap ‣ 4 Experiments ‣ Template Free Reconstruction of Human-object Interaction with Procedural Interaction Generation"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref"><span class="ltx_text ltx_font_medium">4.1</span> </span>Reconstruction on BEHAVE and InterCap</span></a></li> <li class="ltx_tocentry ltx_tocentry_subsection"><a class="ltx_ref" href="#S4.SS2" title="4.2 Contribution of our ProciGen and HDM ‣ 4 Experiments ‣ Template Free Reconstruction of Human-object Interaction with Procedural Interaction Generation"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref"><span class="ltx_text ltx_font_medium">4.2</span> </span>Contribution of our ProciGen and HDM</span></a></li> <li class="ltx_tocentry ltx_tocentry_subsection"><a class="ltx_ref" href="#S4.SS3" title="4.3 Generalization Performance ‣ 4 Experiments ‣ Template Free Reconstruction of Human-object Interaction with Procedural Interaction Generation"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref"><span class="ltx_text ltx_font_medium">4.3</span> </span>Generalization Performance</span></a></li> <li class="ltx_tocentry ltx_tocentry_subsection"><a class="ltx_ref" href="#S4.SS4" title="4.4 Ablating the Hierarchical Diffusion Model ‣ 4 Experiments ‣ Template Free Reconstruction of Human-object Interaction with Procedural Interaction Generation"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref"><span class="ltx_text ltx_font_medium">4.4</span> </span>Ablating the Hierarchical Diffusion Model</span></a></li> </ol> </li> <li class="ltx_tocentry ltx_tocentry_section"><a class="ltx_ref" href="#S5" title="5 Conclusion ‣ Template Free Reconstruction of Human-object Interaction with Procedural Interaction Generation"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref"><span class="ltx_text ltx_font_medium">5</span> </span>Conclusion</span></a></li> <li class="ltx_tocentry ltx_tocentry_appendix"> <a class="ltx_ref" href="#A1" title="Appendix A Implementation Details ‣ Template Free Reconstruction of Human-object Interaction with Procedural Interaction Generation"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref"><span class="ltx_text" style="font-size:144%;">A</span> </span><span class="ltx_text ltx_font_bold" style="font-size:144%;">Implementation Details</span></span></a> <ol class="ltx_toclist ltx_toclist_appendix"> <li class="ltx_tocentry ltx_tocentry_subsection"><a class="ltx_ref" href="#A1.SS1" title="A.1 ProciGen Data Generation ‣ Appendix A Implementation Details ‣ Template Free Reconstruction of Human-object Interaction with Procedural Interaction Generation"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref"><span class="ltx_text ltx_font_medium">A.1</span> </span>ProciGen Data Generation</span></a></li> <li class="ltx_tocentry ltx_tocentry_subsection"><a class="ltx_ref" href="#A1.SS2" title="A.2 HDM: Hierarachical Diffusion Model ‣ Appendix A Implementation Details ‣ Template Free Reconstruction of Human-object Interaction with Procedural Interaction Generation"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref"><span class="ltx_text ltx_font_medium">A.2</span> </span>HDM: Hierarachical Diffusion Model</span></a></li> <li class="ltx_tocentry ltx_tocentry_subsection"><a class="ltx_ref" href="#A1.SS3" title="A.3 Dataset statistics ‣ Appendix A Implementation Details ‣ Template Free Reconstruction of Human-object Interaction with Procedural Interaction Generation"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref"><span class="ltx_text ltx_font_medium">A.3</