llm_context_benchmarks

@geldeki @coldniko I have the same box. I run IQ_S with 128k context in the and get roughly 100-130ts consistently even with full context. From the screenshot I see the context stays low? Did you try it when going over the 32k context and expert swaps ? Did you try github.com/ivanfioravanti/llm_context_benchmarks/… ? I run 115 TS and 3500 average prefill. If I use open code I hit 150 ts decode constantly.

@FilthyWeeb42069 You rock! llm context benchmark maybe up to 64K context with any model just to see the difference. ivanfioravanti/llm_context_benchmarks

Is it me or LM Studio cannot handle large context files? I noticed some files were giving and error and not loading, others just loading 3 Lines... So I tried to test it, dragged and dropped this text file for context benchmarks: github.com/ivanfioravanti/llm_context_benchmarks/… to a qwen3.8-flash-next with the context set to 262144 and enough memory. And i get: >Chosen context injection strategy: 'retrieval'. Retrieval is optimal for the size of content provided No relevant citations found for user query Done predicting Then the model proceeds to "User asked me to summarize this file... but there is no file..." blah blah blah Even using a smaller model, it seems LM Studio cannot chew large context files. 64k context txt file works though. Anyone experienced this. im using the default rag v1, with 10 threshold.