Spaces:

matthoffner
/

serp-chat

Paused

matthoffner commited on May 18, 2023

Commit

fce5d3f

1 Parent(s): 090e312

Update llm.py

Files changed (1) hide show

llm.py CHANGED Viewed

@@ -186,7 +186,7 @@ def ask_ai(
         -20000
     )
     llm = LlamaCpp(model_path=model_path,
-        n_ctx=300,
         use_mlock=True,
         n_parts=-1,
         temperature=temprature,

         -20000
     )
     llm = LlamaCpp(model_path=model_path,
+        n_ctx=512,
         use_mlock=True,
         n_parts=-1,
         temperature=temprature,