MindBridge: Cross-Subject Brain Decoding Poster
A conference poster presenting MindBridge, a framework for cross-subject brain decoding. It details the motivation, method architecture involving CLIP and diffusion models, and results showing fMRI synthesis and image reconstruction across different subjects and data scenarios.
Paper context
Paper title: MindBridge: A Cross-Subject Brain Decoding Framework Abstract: A conference poster presenting MindBridge, a framework for cross-subject brain decoding. It details the motivation, method architecture involving CLIP and diffusion models, and results showing fMRI synthesis and image reconstruction across different subjects and data scenarios. Paper body (method & results): <!DOCTYPE html> <html lang="en"> <head> <meta content="text/html; charset=utf-8" http-equiv="content-type"/> <title>MindBridge: A Cross-Subject Brain Decoding Framework</title> <!--Generated on Thu Apr 11 15:36:18 2024 by LaTeXML (version 0.8.7) http://dlmf.nist.gov/LaTeXML/.--> <meta content="width=device-width, initial-scale=1, shrink-to-fit=no" name="viewport"/> <link href="https://cdn.jsdelivr.net/npm/bootstrap@5.3.0/dist/css/bootstrap.min.css" rel="stylesheet" type="text/css"/> <link href="/static/browse/0.3.4/css/ar5iv_0.7.4.min.css" rel="stylesheet" type="text/css"/> <link href="/static/browse/0.3.4/css/latexml_styles.css" rel="stylesheet" type="text/css"/> <script src="https://cdn.jsdelivr.net/npm/bootstrap@5.3.0/dist/js/bootstrap.bundle.min.js"></script> <script src="https://cdnjs.cloudflare.com/ajax/libs/html2canvas/1.3.3/html2canvas.min.js"></script> <script src="/static/browse/0.3.4/js/addons.js"></script> <script src="/static/browse/0.3.4/js/feedbackOverlay.js"></script> <base href="/html/2404.07850v1/"/></head> <body> <nav class="ltx_page_navbar"> <nav class="ltx_TOC"> <ol class="ltx_toclist"> <li class="ltx_tocentry ltx_tocentry_section"><a class="ltx_ref" href="https://arxiv.org/html/2404.07850v1#S1" title="1 Introduction ‣ MindBridge: A Cross-Subject Brain Decoding Framework"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref">1 </span>Introduction</span></a></li> <li class="ltx_tocentry ltx_tocentry_section"> <a class="ltx_ref" href="https://arxiv.org/html/2404.07850v1#S2" title="2 Related Work ‣ MindBridge: A Cross-Subject Brain Decoding Framework"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref">2 </span>Related Work</span></a> <ol class="ltx_toclist ltx_toclist_section"> <li class="ltx_tocentry ltx_tocentry_subsection"><a class="ltx_ref" href="https://arxiv.org/html/2404.07850v1#S2.SS1" title="2.1 Brain Decoding ‣ 2 Related Work ‣ MindBridge: A Cross-Subject Brain Decoding Framework"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref">2.1 </span>Brain Decoding</span></a></li> <li class="ltx_tocentry ltx_tocentry_subsection"><a class="ltx_ref" href="https://arxiv.org/html/2404.07850v1#S2.SS2" title="2.2 Diffusion Models ‣ 2 Related Work ‣ MindBridge: A Cross-Subject Brain Decoding Framework"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref">2.2 </span>Diffusion Models</span></a></li> </ol> </li> <li class="ltx_tocentry ltx_tocentry_section"> <a class="ltx_ref" href="https://arxiv.org/html/2404.07850v1#S3" title="3 MindBridge ‣ MindBridge: A Cross-Subject Brain Decoding Framework"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref">3 </span>MindBridge</span></a> <ol class="ltx_toclist ltx_toclist_section"> <li class="ltx_tocentry ltx_tocentry_subsection"><a class="ltx_ref" href="https://arxiv.org/html/2404.07850v1#S3.SS1" title="3.1 Data Elaboration ‣ 3 MindBridge ‣ MindBridge: A Cross-Subject Brain Decoding Framework"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref">3.1 </span>Data Elaboration</span></a></li> <li class="ltx_tocentry ltx_tocentry_subsection"><a class="ltx_ref" href="https://arxiv.org/html/2404.07850v1#S3.SS2" title="3.2 Cross-Subject Brain Decoding ‣ 3 MindBridge ‣ MindBridge: A Cross-Subject Brain Decoding Framework"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref">3.2 </span>Cross-Subject Brain Decoding</span></a></li> <li class="ltx_tocentry ltx_tocentry_subsection"><a class="ltx_ref" href="https://arxiv.org/html/2404.07850v1#S3.SS3" title="3.3 New-Subject Adaptation ‣ 3 MindBridge ‣ MindBridge: A Cross-Subject Brain Decoding Framework"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref">3.3 </span>New-Subject Adaptation</span></a></li> </ol> </li> <li class="ltx_tocentry ltx_tocentry_section"> <a class="ltx_ref" href="https://arxiv.org/html/2404.07850v1#S4" title="4 Experiments and Analysis ‣ MindBridge: A Cross-Subject Brain Decoding Framework"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref">4 </span>Experiments and Analysis</span></a> <ol class="ltx_toclist ltx_toclist_section"> <li class="ltx_tocentry ltx_tocentry_subsection"><a class="ltx_ref" href="https://arxiv.org/html/2404.07850v1#S4.SS1" title="4.1 Cross-Subject Brain Decoding ‣ 4 Experiments and Analysis ‣ MindBridge: A Cross-Subject Brain Decoding Framework"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref">4.1 </span>Cross-Subject Brain Decoding</span></a></li> <li class="ltx_tocentry ltx_tocentry_subsection"><a class="ltx_ref" href="https://arxiv.org/html/2404.07850v1#S4.SS2" title="4.2 New Subject Adaptation ‣ 4 Experiments and Analysis ‣ MindBridge: A Cross-Subject Brain Decoding Framework"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref">4.2 </span>New Subject Adaptation</span></a></li> <li class="ltx_tocentry ltx_tocentry_subsection"><a class="ltx_ref" href="https://arxiv.org/html/2404.07850v1#S4.SS3" title="4.3 Novel fMRI Synthesis ‣ 4 Experiments and Analysis ‣ MindBridge: A Cross-Subject Brain Decoding Framework"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref">4.3 </span>Novel fMRI Synthesis</span></a></li> <li class="ltx_tocentry ltx_tocentry_subsection"><a class="ltx_ref" href="https://arxiv.org/html/2404.07850v1#S4.SS4" title="4.4 Ablation Study ‣ 4 Experiments and Analysis ‣ MindBridge: A Cross-Subject Brain Decoding Framework"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref">4.4 </span>Ablation Study</span></a></li> </ol> </li> <li class="ltx_tocentry ltx_tocentry_section"><a class="ltx_ref" href="https://arxiv.org/html/2404.07850v1#S5" title="5 Discussion ‣ MindBridge: A Cross-Subject Brain Decoding Framework"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref">5 </span>Discussion</span></a></li> <li class="ltx_tocentry ltx_tocentry_section"><a class="ltx_ref" href="https://arxiv.org/html/2404.07850v1#S6" title="6 Conclusion ‣ MindBridge: A Cross-Subject Brain Decoding Framework"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref">6 </span>Conclusion</span></a></li> <li class="ltx_tocentry ltx_tocentry_section"><a class="ltx_ref" href="https://arxiv.org/html/2404.07850v1#S7" title="7 Acknowledgement ‣ MindBridge: A Cross-Subject Brain Decoding Framework"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref">7 </span>Acknowledgement</span></a></li> <li class="ltx_tocentry ltx_tocentry_section"><a class="ltx_ref" href="https://arxiv.org/html/2404.07850v1#S1a" title="A More Dataset Information ‣ MindBridge: A Cross-Subject Brain Decoding Framework"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref">A </span>More Dataset Information</span></a></li> <li class="ltx_tocentry ltx_tocentry_section"><a class="ltx_ref" href="https://arxiv.org/html/2404.07850v1#S2a" title="B Implementation Details ‣ MindBridge: A Cross-Subject Brain Decoding Framework"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref">B </span>Implementation Details</span></a></li> <li class="ltx_tocentry ltx_tocentry_section"><a class="ltx_ref" href="https://arxiv.org/html/2404.07850v1#S3a" title="C More Reconstruction Results ‣ MindBridge: A Cross-Subject Brain Decoding Framework"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref">C </span>More Reconstruction Results</span></a></li> <li class="ltx_tocentry ltx_tocentry_section"><a class="ltx_ref" href="https://arxiv.org/html/2404.07850v1#S4a" title="D Architecture of MindBridge ‣ MindBridge: A Cross-Subject Brain Decoding Framework"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref">D </span>Architecture of MindBridge</span></a></li> <li class="ltx_tocentry ltx_tocentry_section"><a class="ltx_ref" href="https://arxiv.org/html/2404.07850v1#S5a" title="E More Results for New Subject Adaptation ‣ MindBridge: A Cross-Subject Brain Decoding Framework"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref">E </span>More Results for New Subject Adaptation</span></a></li> <li class="ltx_tocentry ltx_tocentry_section"><a class="ltx_ref" href="https://arxiv.org/html/2404.07850v1#S6a" title="F Effect of Text-Image Ratio ‣ MindBridge: A Cross-Subject Brain Decoding Framework"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref">F </span>Effect of Text-Image Ratio</span></a></li> <li class="ltx_tocentry ltx_tocentry_section"><a class="ltx_ref" href="https://arxiv.org/html/2404.07850v1#S7a" title="G Ethic and Social Impact ‣ MindBridge: A Cross-Subject Brain Decoding Framework"><span class="ltx_text ltx_ref_title"><span class="ltx_tag ltx_tag_ref">G </span>Ethic and Social Impact</span></a></li> </ol></nav> </nav> <div class="ltx_page_main"> <div class="ltx_page_content"> <div aria-label="Conversion errors have been found" class="package-alerts ltx_document" role="status"> <button aria-label="Dismiss alert" onclick="closePopup()"> <span aria-hidden="true"><svg aria-hidden="true" focusable="false" height="20" role="presentation" viewbox="0 0 44 44" width="20"> <path d="M0.549989 4.44999L4.44999 0.549988L43.45 39.55L39.55 43.45L0.549989 4.44999Z"></path> <path d="M39.55 0.549988L43.45 4.44999L4.44999 43.45L0.549988 39.55L39.55 0.549988Z"></path> </svg></span> </button> <p>HTML conversions <a href="https://info.dev.arxiv.org/about/accessibility_html_error_messages.html" target="_blank">sometimes display errors</a> due to content that did not convert correctly from the source. This paper uses the following packages that are not yet supported by the HTML conversion tool. Feedback on these issues are not necessary; they are known and are being worked on.</p> <ul arial-label="Unsupported packages used in this paper"> <li>failed: epic</li> </ul> <p>Authors: achieve the best HTML results from your LaTeX submissions by following these <a href="https://info.arxiv.org/help/submit_latex_best_practices.html" target="_blank">best practices</a>.</p> </div><div class="section" id="target-section"><div id="license-tr">License: CC BY-NC-SA 4.0</div><div id="watermark-tr">arXiv:2404.07850v1 [cs.CV] 11 Apr 2024</div></div> <script> function closePopup() { document.querySelector('.package-alerts').style.display = 'none'; } </script> <article class="ltx_document ltx_authors_1line ltx_pruned_first"> <h1 class="ltx_title ltx_centering ltx_title_document">MindBridge: A Cross-Subject Brain Decoding Framework</h1> <div class="ltx_authors"> <span class="ltx_creator ltx_centering ltx_role_author"> <span class="ltx_personname">Shizun Wang Songhua Liu Zhenxiong Tan Xinchao Wang<math alttext="{}^{\dagger}" class="ltx_Math" display="inline" id="id1.1.m1.1"><semantics id="id1.1.m1.1a"><msup id="id1.1.m1.1.1" xref="id1.1.m1.1.1.cmml"><mi id="id1.1.m1.1.1a" xref="id1.1.m1.1.1.cmml"></mi><mo id="id1.1.m1.1.1.1" xref="id1.1.m1.1.1.1.
