MeshRet Skinned Motion Retargeting — Poster
This poster presents MeshRet, a method for skinned motion retargeting using Dense Mesh Interaction (DMI) fields and Semantically Consistent Sensors (SCS). It demonstrates superior contact preservation and reduced interpenetration compared to baselines like PMnet and R2ET through qualitative and quantitative evaluations on the ScanRet dataset.
Paper context
Paper title: Skinned Motion Retargeting with Dense Geometric Interaction Perception Abstract: This poster presents MeshRet, a method for skinned motion retargeting using Dense Mesh Interaction (DMI) fields and Semantically Consistent Sensors (SCS). It demonstrates superior contact preservation and reduced interpenetration compared to baselines like PMnet and R2ET through qualitative and quantitative evaluations on the ScanRet dataset. Paper body (method & results): <!DOCTYPE html> <html lang="en"> <head> <meta content="text/html; charset=utf-8" http-equiv="content-type"/> <title>Skinned Motion Retargeting with Dense Geometric Interaction Perception</title> <!--Generated on Mon Oct 28 12:57:02 2024 by LaTeXML (version 0.8.8) http://dlmf.nist.gov/LaTeXML/.--> <meta content="width=device-width, initial-scale=1, shrink-to-fit=no" name="viewport"/> <link href="https://cdn.jsdelivr.net/npm/bootstrap@5.3.0/dist/css/bootstrap.min.css" rel="stylesheet" type="text/css"/> <link href="/static/browse/0.3.4/css/ar5iv.0.7.9.min.css" rel="stylesheet" type="text/css"/> <link href="/static/browse/0.3.4/css/ar5iv-fonts.0.7.9.min.css" rel="stylesheet" type="text/css"/> <link href="/static/browse/0.3.4/css/latexml_styles.css" rel="stylesheet" type="text/css"/> <script src="https://cdn.jsdelivr.net/npm/bootstrap@5.3.0/dist/js/bootstrap.bundle.min.js"></script> <script src="https://cdnjs.cloudflare.com/ajax/libs/html2canvas/1.3.3/html2canvas.min.js"></script> <script src="/static/browse/0.3.4/js/addons_new.js"></script> <script src="/static/browse/0.3.4/js/feedbackOverlay.js"></script> <base href="/html/2410.20986v1/"/></head> <body> <nav class="ltx_page_navbar"> <nav class="ltx_TOC"> <ol class="ltx_toclist"> <li class="ltx_tocentry ltx_tocentry_section"><a class="ltx_ref" href="https://arxiv.org/html/2410.20986v1#S1" title="In Skinned Motion Retargeting with Dense Geometric Interaction Perception"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref">1 </span>Introduction</span></a></li> <li class="ltx_tocentry ltx_tocentry_section"> <a class="ltx_ref" href="https://arxiv.org/html/2410.20986v1#S2" title="In Skinned Motion Retargeting with Dense Geometric Interaction Perception"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref">2 </span>Related Work</span></a> <ol class="ltx_toclist ltx_toclist_section"> <li class="ltx_tocentry ltx_tocentry_paragraph"><a class="ltx_ref" href="https://arxiv.org/html/2410.20986v1#S2.SS0.SSS0.Px1" title="In 2 Related Work ‣ Skinned Motion Retargeting with Dense Geometric Interaction Perception"><span class="ltx_text ltx_ref_title">Skeletal motion retargeting</span></a></li> <li class="ltx_tocentry ltx_tocentry_paragraph"><a class="ltx_ref" href="https://arxiv.org/html/2410.20986v1#S2.SS0.SSS0.Px2" title="In 2 Related Work ‣ Skinned Motion Retargeting with Dense Geometric Interaction Perception"><span class="ltx_text ltx_ref_title">Geometry-aware motion retargeting</span></a></li> </ol> </li> <li class="ltx_tocentry ltx_tocentry_section"> <a class="ltx_ref" href="https://arxiv.org/html/2410.20986v1#S3" title="In Skinned Motion Retargeting with Dense Geometric Interaction Perception"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref">3 </span>Method</span></a> <ol class="ltx_toclist ltx_toclist_section"> <li class="ltx_tocentry ltx_tocentry_subsection"> <a class="ltx_ref" href="https://arxiv.org/html/2410.20986v1#S3.SS1" title="In 3 Method ‣ Skinned Motion Retargeting with Dense Geometric Interaction Perception"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref">3.1 </span>Overview</span></a> <ol class="ltx_toclist ltx_toclist_subsection"> <li class="ltx_tocentry ltx_tocentry_paragraph"><a class="ltx_ref" href="https://arxiv.org/html/2410.20986v1#S3.SS1.SSS0.Px1" title="In 3.1 Overview ‣ 3 Method ‣ Skinned Motion Retargeting with Dense Geometric Interaction Perception"><span class="ltx_text ltx_ref_title">Motion & geometry representations</span></a></li> <li class="ltx_tocentry ltx_tocentry_paragraph"><a class="ltx_ref" href="https://arxiv.org/html/2410.20986v1#S3.SS1.SSS0.Px2" title="In 3.1 Overview ‣ 3 Method ‣ Skinned Motion Retargeting with Dense Geometric Interaction Perception"><span class="ltx_text ltx_ref_title">Task definition</span></a></li> </ol> </li> <li class="ltx_tocentry ltx_tocentry_subsection"><a class="ltx_ref" href="https://arxiv.org/html/2410.20986v1#S3.SS2" title="In 3 Method ‣ Skinned Motion Retargeting with Dense Geometric Interaction Perception"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref">3.2 </span>Semantically consistent sensors</span></a></li> <li class="ltx_tocentry ltx_tocentry_subsection"> <a class="ltx_ref" href="https://arxiv.org/html/2410.20986v1#S3.SS3" title="In 3 Method ‣ Skinned Motion Retargeting with Dense Geometric Interaction Perception"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref">3.3 </span>Dense mesh interaction field</span></a> <ol class="ltx_toclist ltx_toclist_subsection"> <li class="ltx_tocentry ltx_tocentry_paragraph"><a class="ltx_ref" href="https://arxiv.org/html/2410.20986v1#S3.SS3.SSS0.Px1" title="In 3.3 Dense mesh interaction field ‣ 3 Method ‣ Skinned Motion Retargeting with Dense Geometric Interaction Perception"><span class="ltx_text ltx_ref_title">Sensor forward kinematics</span></a></li> <li class="ltx_tocentry ltx_tocentry_paragraph"><a class="ltx_ref" href="https://arxiv.org/html/2410.20986v1#S3.SS3.SSS0.Px2" title="In 3.3 Dense mesh interaction field ‣ 3 Method ‣ Skinned Motion Retargeting with Dense Geometric Interaction Perception"><span class="ltx_text ltx_ref_title">Pairwise interaction feature</span></a></li> </ol> </li> <li class="ltx_tocentry ltx_tocentry_subsection"><a class="ltx_ref" href="https://arxiv.org/html/2410.20986v1#S3.SS4" title="In 3 Method ‣ Skinned Motion Retargeting with Dense Geometric Interaction Perception"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref">3.4 </span>Geometry interaction-aware motion retargeting</span></a></li> </ol> </li> <li class="ltx_tocentry ltx_tocentry_section"> <a class="ltx_ref" href="https://arxiv.org/html/2410.20986v1#S4" title="In Skinned Motion Retargeting with Dense Geometric Interaction Perception"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref">4 </span>Experiments</span></a> <ol class="ltx_toclist ltx_toclist_section"> <li class="ltx_tocentry ltx_tocentry_subsection"> <a class="ltx_ref" href="https://arxiv.org/html/2410.20986v1#S4.SS1" title="In 4 Experiments ‣ Skinned Motion Retargeting with Dense Geometric Interaction Perception"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref">4.1 </span>Settings</span></a> <ol class="ltx_toclist ltx_toclist_subsection"> <li class="ltx_tocentry ltx_tocentry_paragraph"><a class="ltx_ref" href="https://arxiv.org/html/2410.20986v1#S4.SS1.SSS0.Px1" title="In 4.1 Settings ‣ 4 Experiments ‣ Skinned Motion Retargeting with Dense Geometric Interaction Perception"><span class="ltx_text ltx_ref_title">Datasets</span></a></li> <li class="ltx_tocentry ltx_tocentry_paragraph"><a class="ltx_ref" href="https://arxiv.org/html/2410.20986v1#S4.SS1.SSS0.Px2" title="In 4.1 Settings ‣ 4 Experiments ‣ Skinned Motion Retargeting with Dense Geometric Interaction Perception"><span class="ltx_text ltx_ref_title">Implementation details</span></a></li> <li class="ltx_tocentry ltx_tocentry_paragraph"><a class="ltx_ref" href="https://arxiv.org/html/2410.20986v1#S4.SS1.SSS0.Px3" title="In 4.1 Settings ‣ 4 Experiments ‣ Skinned Motion Retargeting with Dense Geometric Interaction Perception"><span class="ltx_text ltx_ref_title">Evaluation metrics</span></a></li> </ol> </li> <li class="ltx_tocentry ltx_tocentry_subsection"> <a class="ltx_ref" href="https://arxiv.org/html/2410.20986v1#S4.SS2" title="In 4 Experiments ‣ Skinned Motion Retargeting with Dense Geometric Interaction Perception"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref">4.2 </span>Comparison with state-of-the-arts</span></a> <ol class="ltx_toclist ltx_toclist_subsection"> <li class="ltx_tocentry ltx_tocentry_paragraph"><a class="ltx_ref" href="https://arxiv.org/html/2410.20986v1#S4.SS2.SSS0.Px1" title="In 4.2 Comparison with state-of-the-arts ‣ 4 Experiments ‣ Skinned Motion Retargeting with Dense Geometric Interaction Perception"><span class="ltx_text ltx_ref_title">Qualitative results</span></a></li> <li class="ltx_tocentry ltx_tocentry_paragraph"><a class="ltx_ref" href="https://arxiv.org/html/2410.20986v1#S4.SS2.SSS0.Px2" title="In 4.2 Comparison with state-of-the-arts ‣ 4 Experiments ‣ Skinned Motion Retargeting with Dense Geometric Interaction Perception"><span class="ltx_text ltx_ref_title">Quantitative results</span></a></li> </ol> </li> <li class="ltx_tocentry ltx_tocentry_subsection"><a class="ltx_ref" href="https://arxiv.org/html/2410.20986v1#S4.SS3" title="In 4 Experiments ‣ Skinned Motion Retargeting with Dense Geometric Interaction Perception"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref">4.3 </span>Ablation Studies</span></a></li> <li class="ltx_tocentry ltx_tocentry_subsection"><a class="ltx_ref" href="https://arxiv.org/html/2410.20986v1#S4.SS4" title="In 4 Experiments ‣ Skinned Motion Retargeting with Dense Geometric Interaction Perception"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref">4.4 </span>User study</span></a></li> </ol> </li> <li class="ltx_tocentry ltx_tocentry_section"> <a class="ltx_ref" href="https://arxiv.org/html/2410.20986v1#S5" title="In Skinned Motion Retargeting with Dense Geometric Interaction Perception"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref">5 </span>Conclusion</span></a> <ol class="ltx_toclist ltx_toclist_section"> <li class="ltx_tocentry ltx_tocentry_paragraph"><a class="ltx_ref" href="https://arxiv.org/html/2410.20986v1#S5.SS0.SSS0.Px1" title="In 5 Conclusion ‣ Skinned Motion Retargeting with Dense Geometric Interaction Perception"><span class="ltx_text ltx_ref_title">Limitations</span></a></li> </ol> </li> <li class="ltx_tocentry ltx_tocentry_appendix"> <a class="ltx_ref" href="https://arxiv.org/html/2410.20986v1#A1" title="In Skinned Motion Retargeting with Dense Geometric Interaction Perception"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref">A </span>Dataset Details</span></a> <ol class="ltx_toclist ltx_toclist_appendix"> <li class="ltx_tocentry ltx_tocentry_paragraph"><a class="ltx_ref" href="https://arxiv.org/html/2410.20986v1#A1.SS0.SSS0.Px1" title="In Appendix A Dataset Details ‣ Skinned Motion Retargeting with Dense Geometric Interaction Perception"><span class="ltx_text ltx_ref_title"><span class="ltx_text ltx_font_italic">ScanRet</span> details</span></a></li> <li class="ltx_tocentry ltx_tocentry_paragraph"><a class="ltx_ref" href="https://arxiv.org/html/2410.20986v1#A1.SS0.SSS0.Px2" title="In Appendix A Dataset Details ‣ Skinned Motion Retargeting with Dense Geometric Interaction Perception"><span class="ltx_text ltx_ref_title">Data splits</span></a></li> </ol> </li> <li class="ltx_tocentry ltx_tocentry_appendix"><a class="ltx_ref" href="https://arxiv.org/html/2410.20986v1#A2" title="In Skinned Motion Retargeting with Dense Geometric Interaction Perception"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref">B </span>Evaluation metric details</span></a></li> <li
