You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: README.md
+1-1Lines changed: 1 addition & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -20,6 +20,6 @@ Latest examples 👇🏻
20
20
| VLM Fine-tuning |[QLoRA/Fine-tune IDEFICS3 or SmolVLM on VQAv2](https://github.com/merveenoyan/smol-vision/blob/main/Smol_VLM_FT.ipynb)| QLoRA/Full Fine-tune IDEFICS3 or SmolVLM on VQAv2 dataset |
21
21
| VLM Fine-tuning (Script) |[QLoRA Fine-tune IDEFICS3 on VQAv2](https://github.com/merveenoyan/smol-vision/blob/main/smolvlm.py)| QLoRA/Full Fine-tune IDEFICS3 or SmolVLM on VQAv2 dataset |
22
22
| Multimodal RAG |[Multimodal RAG using ColPali and Qwen2-VL](https://github.com/merveenoyan/smol-vision/blob/main/ColPali_%2B_Qwen2_VL.ipynb)| Learn to retrieve documents and pipeline to RAG without hefty document processing using ColPali through Byaldi and do the generation with Qwen2-VL |
23
-
| Multimodal Retriever Fine-tuning |[Fine-tune ColPali for Multimodal RAG]([https://github.com/merveenoyan/smol-vision/blob/main/ColPali_%2B_Qwen2_VL.ipynb](https://github.com/merveenoyan/smol-vision/blob/main/Finetune_ColPali.ipynb))| Learn to apply contrastive fine-tuning on ColPali to customize it for your own multimodal document RAG use case |
23
+
| Multimodal Retriever Fine-tuning |[Fine-tune ColPali for Multimodal RAG](https://github.com/merveenoyan/smol-vision/blob/main/Finetune_ColPali.ipynb)| Learn to apply contrastive fine-tuning on ColPali to customize it for your own multimodal document RAG use case |
24
24
| Speed-up/Memory Optimization | Vision language model serving using TGI (SOON) | Explore speed-ups and memory improvements for vision-language model serving with text-generation inference |
25
25
| Quantization/Optimum/ORT | All levels of quantization and graph optimizations for Image Segmentation using Optimum (SOON) | End-to-end model optimization using Optimum |
0 commit comments