You May Also Enjoy

VLM Nemotron-Nano-VL-8B support

July 02 2025

I started working on this a month ago since Nemotron-Nano-VL-8B-V1 released. I thought it would be a good choice for me to add a model from scratch, and get ...

Weight loading in vLLM

June 27 2025

Fixed a weight loading error. It was reporting There is no module or parameter named sth at weight loading. It took me couple of days to root cause this issu...