PSA: If you use Ollama, remember to set the context size (/set parameter num_ctx XYZ). The default is 2048 and silently truncates any excess.

On OpenWebUI you can do this on the model settings page.

2025-03-08 13:50 EST

Want new articles in your email inbox?