You May Also Enjoy
VLM Nemotron-Nano-VL-8B support
July 02 2025
I started working on this a month ago since Nemotron-Nano-VL-8B-V1 released. I thought it would be a good choice for me to add a model from scratch, and get ...
Preprocessing config in vLLM
June 30 2025
Here are preprocessing related code in vLLM
Weight loading in vLLM
June 27 2025
Fixed a weight loading error. It was reporting There is no module or parameter named sth at weight loading. It took me couple of days to root cause this issu...
ECS Deployment Details
June 24 2025
Add Dynamo example into ECS, couple of pitfalls