Neural Diffusion for Syntax-Tree Synthesis — Poster
A conference poster presenting a neural diffusion model for program synthesis on syntax trees. It details the architecture, diffusion process, and results on inverse graphics tasks like CSG2D and TinySVG, comparing against baselines.
Paper context
Paper title: Diffusion On Syntax Trees For Program Synthesis Abstract: A conference poster presenting a neural diffusion model for program synthesis on syntax trees. It details the architecture, diffusion process, and results on inverse graphics tasks like CSG2D and TinySVG, comparing against baselines. Paper body (method & results): <!DOCTYPE html> <html lang="en"> <head> <meta content="text/html; charset=utf-8" http-equiv="content-type"/> <title>Diffusion On Syntax Trees For Program Synthesis</title> <!--Generated on Thu May 30 22:27:53 2024 by LaTeXML (version 0.8.8) http://dlmf.nist.gov/LaTeXML/.--> <meta content="width=device-width, initial-scale=1, shrink-to-fit=no" name="viewport"/> <link href="https://cdn.jsdelivr.net/npm/bootstrap@5.3.0/dist/css/bootstrap.min.css" rel="stylesheet" type="text/css"/> <link href="/static/browse/0.3.4/css/ar5iv.0.7.9.min.css" rel="stylesheet" type="text/css"/> <link href="/static/browse/0.3.4/css/ar5iv-fonts.0.7.9.min.css" rel="stylesheet" type="text/css"/> <link href="/static/browse/0.3.4/css/latexml_styles.css" rel="stylesheet" type="text/css"/> <script src="https://cdn.jsdelivr.net/npm/bootstrap@5.3.0/dist/js/bootstrap.bundle.min.js"></script> <script src="https://cdnjs.cloudflare.com/ajax/libs/html2canvas/1.3.3/html2canvas.min.js"></script> <script src="/static/browse/0.3.4/js/addons_new.js"></script> <script src="/static/browse/0.3.4/js/feedbackOverlay.js"></script> <base href="/html/2405.20519v1/"/></head> <body> <nav class="ltx_page_navbar"> <nav class="ltx_TOC"> <ol class="ltx_toclist"> <li class="ltx_tocentry ltx_tocentry_section"><a class="ltx_ref" href="https://arxiv.org/html/2405.20519v1#S1" title="In Diffusion On Syntax Trees For Program Synthesis"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref">1 </span>Introduction</span></a></li> <li class="ltx_tocentry ltx_tocentry_section"> <a class="ltx_ref" href="https://arxiv.org/html/2405.20519v1#S2" title="In Diffusion On Syntax Trees For Program Synthesis"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref">2 </span>Background & Related Work</span></a> <ol class="ltx_toclist ltx_toclist_section"> <li class="ltx_tocentry ltx_tocentry_paragraph"><a class="ltx_ref" href="https://arxiv.org/html/2405.20519v1#S2.SS0.SSS0.Px1" title="In 2 Background & Related Work ‣ Diffusion On Syntax Trees For Program Synthesis"><span class="ltx_text ltx_ref_title">Neural program synthesis</span></a></li> <li class="ltx_tocentry ltx_tocentry_paragraph"><a class="ltx_ref" href="https://arxiv.org/html/2405.20519v1#S2.SS0.SSS0.Px2" title="In 2 Background & Related Work ‣ Diffusion On Syntax Trees For Program Synthesis"><span class="ltx_text ltx_ref_title">Neural diffusion</span></a></li> <li class="ltx_tocentry ltx_tocentry_paragraph"><a class="ltx_ref" href="https://arxiv.org/html/2405.20519v1#S2.SS0.SSS0.Px3" title="In 2 Background & Related Work ‣ Diffusion On Syntax Trees For Program Synthesis"><span class="ltx_text ltx_ref_title">Diffusion for discrete data</span></a></li> <li class="ltx_tocentry ltx_tocentry_paragraph"><a class="ltx_ref" href="https://arxiv.org/html/2405.20519v1#S2.SS0.SSS0.Px4" title="In 2 Background & Related Work ‣ Diffusion On Syntax Trees For Program Synthesis"><span class="ltx_text ltx_ref_title">Diffusion for code generation</span></a></li> <li class="ltx_tocentry ltx_tocentry_paragraph"><a class="ltx_ref" href="https://arxiv.org/html/2405.20519v1#S2.SS0.SSS0.Px5" title="In 2 Background & Related Work ‣ Diffusion On Syntax Trees For Program Synthesis"><span class="ltx_text ltx_ref_title">Program synthesis for inverse graphics</span></a></li> </ol> </li> <li class="ltx_tocentry ltx_tocentry_section"> <a class="ltx_ref" href="https://arxiv.org/html/2405.20519v1#S3" title="In Diffusion On Syntax Trees For Program Synthesis"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref">3 </span>Method</span></a> <ol class="ltx_toclist ltx_toclist_section"> <li class="ltx_tocentry ltx_tocentry_subsection"><a class="ltx_ref" href="https://arxiv.org/html/2405.20519v1#S3.SS1" title="In 3 Method ‣ Diffusion On Syntax Trees For Program Synthesis"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref">3.1 </span>Sampling Small Mutations</span></a></li> <li class="ltx_tocentry ltx_tocentry_subsection"> <a class="ltx_ref" href="https://arxiv.org/html/2405.20519v1#S3.SS2" title="In 3 Method ‣ Diffusion On Syntax Trees For Program Synthesis"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref">3.2 </span>Policy</span></a> <ol class="ltx_toclist ltx_toclist_subsection"> <li class="ltx_tocentry ltx_tocentry_subsubsection"><a class="ltx_ref" href="https://arxiv.org/html/2405.20519v1#S3.SS2.SSS1" title="In 3.2 Policy ‣ 3 Method ‣ Diffusion On Syntax Trees For Program Synthesis"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref">3.2.1 </span>Forward Process</span></a></li> <li class="ltx_tocentry ltx_tocentry_subsubsection"><a class="ltx_ref" href="https://arxiv.org/html/2405.20519v1#S3.SS2.SSS2" title="In 3.2 Policy ‣ 3 Method ‣ Diffusion On Syntax Trees For Program Synthesis"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref">3.2.2 </span>Reverse Mutation Paths</span></a></li> </ol> </li> <li class="ltx_tocentry ltx_tocentry_subsection"><a class="ltx_ref" href="https://arxiv.org/html/2405.20519v1#S3.SS3" title="In 3 Method ‣ Diffusion On Syntax Trees For Program Synthesis"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref">3.3 </span>Value Network & Search</span></a></li> <li class="ltx_tocentry ltx_tocentry_subsection"><a class="ltx_ref" href="https://arxiv.org/html/2405.20519v1#S3.SS4" title="In 3 Method ‣ Diffusion On Syntax Trees For Program Synthesis"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref">3.4 </span>Architecture</span></a></li> </ol> </li> <li class="ltx_tocentry ltx_tocentry_section"> <a class="ltx_ref" href="https://arxiv.org/html/2405.20519v1#S4" title="In Diffusion On Syntax Trees For Program Synthesis"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref">4 </span>Experiments</span></a> <ol class="ltx_toclist ltx_toclist_section"> <li class="ltx_tocentry ltx_tocentry_subsection"> <a class="ltx_ref" href="https://arxiv.org/html/2405.20519v1#S4.SS1" title="In 4 Experiments ‣ Diffusion On Syntax Trees For Program Synthesis"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref">4.1 </span>Environments</span></a> <ol class="ltx_toclist ltx_toclist_subsection"> <li class="ltx_tocentry ltx_tocentry_paragraph"><a class="ltx_ref" href="https://arxiv.org/html/2405.20519v1#S4.SS1.SSS0.Px1" title="In 4.1 Environments ‣ 4 Experiments ‣ Diffusion On Syntax Trees For Program Synthesis"><span class="ltx_text ltx_ref_title">CSG2D</span></a></li> <li class="ltx_tocentry ltx_tocentry_paragraph"><a class="ltx_ref" href="https://arxiv.org/html/2405.20519v1#S4.SS1.SSS0.Px2" title="In 4.1 Environments ‣ 4 Experiments ‣ Diffusion On Syntax Trees For Program Synthesis"><span class="ltx_text ltx_ref_title">TinySVG</span></a></li> </ol> </li> <li class="ltx_tocentry ltx_tocentry_subsection"> <a class="ltx_ref" href="https://arxiv.org/html/2405.20519v1#S4.SS2" title="In 4 Experiments ‣ Diffusion On Syntax Trees For Program Synthesis"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref">4.2 </span>Baselines</span></a> <ol class="ltx_toclist ltx_toclist_subsection"> <li class="ltx_tocentry ltx_tocentry_paragraph"><a class="ltx_ref" href="https://arxiv.org/html/2405.20519v1#S4.SS2.SSS0.Px1" title="In 4.2 Baselines ‣ 4 Experiments ‣ Diffusion On Syntax Trees For Program Synthesis"><span class="ltx_text ltx_ref_title">CSGNet</span></a></li> <li class="ltx_tocentry ltx_tocentry_paragraph"><a class="ltx_ref" href="https://arxiv.org/html/2405.20519v1#S4.SS2.SSS0.Px2" title="In 4.2 Baselines ‣ 4 Experiments ‣ Diffusion On Syntax Trees For Program Synthesis"><span class="ltx_text ltx_ref_title">REPL Flow</span></a></li> <li class="ltx_tocentry ltx_tocentry_paragraph"><a class="ltx_ref" href="https://arxiv.org/html/2405.20519v1#S4.SS2.SSS0.Px3" title="In 4.2 Baselines ‣ 4 Experiments ‣ Diffusion On Syntax Trees For Program Synthesis"><span class="ltx_text ltx_ref_title">Test tasks</span></a></li> <li class="ltx_tocentry ltx_tocentry_paragraph"><a class="ltx_ref" href="https://arxiv.org/html/2405.20519v1#S4.SS2.SSS0.Px4" title="In 4.2 Baselines ‣ 4 Experiments ‣ Diffusion On Syntax Trees For Program Synthesis"><span class="ltx_text ltx_ref_title">Evaluation</span></a></li> </ol> </li> <li class="ltx_tocentry ltx_tocentry_subsection"><a class="ltx_ref" href="https://arxiv.org/html/2405.20519v1#S4.SS3" title="In 4 Experiments ‣ Diffusion On Syntax Trees For Program Synthesis"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref">4.3 </span>Ablations</span></a></li> </ol> </li> <li class="ltx_tocentry ltx_tocentry_section"> <a class="ltx_ref" href="https://arxiv.org/html/2405.20519v1#S5" title="In Diffusion On Syntax Trees For Program Synthesis"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref">5 </span>Conclusion</span></a> <ol class="ltx_toclist ltx_toclist_section"> <li class="ltx_tocentry ltx_tocentry_paragraph"><a class="ltx_ref" href="https://arxiv.org/html/2405.20519v1#S5.SS0.SSS0.Px1" title="In 5 Conclusion ‣ Diffusion On Syntax Trees For Program Synthesis"><span class="ltx_text ltx_ref_title">Limitations</span></a></li> <li class="ltx_tocentry ltx_tocentry_paragraph"><a class="ltx_ref" href="https://arxiv.org/html/2405.20519v1#S5.SS0.SSS0.Px2" title="In 5 Conclusion ‣ Diffusion On Syntax Trees For Program Synthesis"><span class="ltx_text ltx_ref_title">Future Work</span></a></li> <li class="ltx_tocentry ltx_tocentry_paragraph"><a class="ltx_ref" href="https://arxiv.org/html/2405.20519v1#S5.SS0.SSS0.Px3" title="In 5 Conclusion ‣ Diffusion On Syntax Trees For Program Synthesis"><span class="ltx_text ltx_ref_title">Impact</span></a></li> </ol> </li> <li class="ltx_tocentry ltx_tocentry_appendix"><a class="ltx_ref" href="https://arxiv.org/html/2405.20519v1#A1" title="In Diffusion On Syntax Trees For Program Synthesis"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref">A </span>Mutation Algorithm</span></a></li> <li class="ltx_tocentry ltx_tocentry_appendix"> <a class="ltx_ref" href="https://arxiv.org/html/2405.20519v1#A2" title="In Diffusion On Syntax Trees For Program Synthesis"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref">B </span>Context-Free Grammars</span></a> <ol class="ltx_toclist ltx_toclist_appendix"> <li class="ltx_tocentry ltx_tocentry_subsection"><a class="ltx_ref" href="https://arxiv.org/html/2405.20519v1#A2.SS1" title="In Appendix B Context-Free Grammars ‣ Diffusion On Syntax Trees For Program Synthesis"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref">B.1 </span>CSG2D</span></a></li> <li class="ltx_tocentry ltx_tocentry_subsection"><a class="ltx_ref" href="https://arxiv.org/html/2405.20519v1#A2.SS2" title="In Appendix B Context-Free Grammars ‣ Diffusion On Syntax Trees For Program Synthesis"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref">B.2 </span>TinySVG</span></a></
