<div class="infoblock">

<p style="margin-left: 8px;"> News 🎉 </p>

<ul class="list"><div class="container"><li class="item">Sep. 2024 - Start Ph.D. journey at University of California, San Diego.</li></div></ul>

<ul class="list"><div class="container"><li class="item">Aug. 2023 - Fair Network Pruning gets accepted by ICCV 2023.</li></div></ul>

<ul class="list"><div class="container"><li class="item">Mar. 2023 - Efficient Dataset Distillation gets accepted by CVPR 2023 as Highlight.</li></div></ul>

<div class="media">

<div class="media-body">

<div class="container">

<div class="pull-left" style="margin-right: 10px;"><img class="resized" src="./assets/paper/distillation.png"></div>

LLaVA-MoD: Making LLaVA Tiny via MoE Knowledge Distillation <br>

<p style="color:rgb(165, 164, 164); margin-bottom: 0px;">Fangxun Shu*, Yue Liao*, Le Zhuo*, Chenning Xu*, <strong>Lei Zhang*</strong>, Guanghao Zhang*, Haonan Shi*,<br>

<p style="color:rgb(165, 164, 164); margin-bottom: 0px;">Long Chen, Tao Zhong, Wanggui He, Siming Fu, Haoyuan Li, Si Liu, Hongsheng Li <br>

<a target="_blank" href="https://arxiv.org/abs/2408.15881">arXiv</a> /

<a target="_blank" href="https://github.com/shufangxun/LLaVA-MoD">code</a>

</div>