Projects

This page contains all the projects I have done during my learning process. I hope you can find something useful here. HAPPY LEARNING😁😁!!!
cover
Qwen3-VL Inference
Large Language Model Multi-Modality Fine-Tuning
Built a Qwen3-VL model from scratch in PyTorch, loaded the 14B (224x224) model, fine-tuned it with LoRA for specific tasks, and developed a Gradio app to showcase its capabilities.
Qwen3-VL PyTorch LoRA DeepStack M-RoPE
Yuyang Zhang
Level: Intermediate
⏱ 15 hours
cover
PaliGemma Inference and LoRA Fine Tuning
Large Language Model Multi-Modality Fine-Tuning
This project involves modeling a multi-modal large language model called PaliGemma, which integrates vision and language tasks. First we perform inference using the pre-trained PaliGemma model. Then, we fine-tune the model using LoRA (Low-Rank Adaptation) for specific applications, for example Receipt OCR Extraction. By the end, will implement a Gradio web interface to demonstrate the fine-tuned model's capabilities.
LoRA PyTorch Gradio Grouped Query Attention RoPE KV Cache
Yuyang Zhang
Level: Entry
⏱ 8 hours
No matching items
Back to top