You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
## Possible Improvements and prototype ideas (during GSoC)
21
21
22
+
-[ ] Note that one of the current challenges is that the LLM is slow since there's so much to process, so we don't want to wait for one response to ask for another. We currently rely on stateless prompt and it should be the way it is.
23
+
-[ ] Evaluate other llm runtimes than ollama like ONNX for size
22
24
-[ ] OCR doesn't work well on different colors and some scenarios.
23
25
-[ ] LLaMA 3.1 isn't accurate enough, evaluate more models
24
26
-[ ] Duplicate handling in topic classification is a bit too strict.
25
27
-[ ] Consider shifting knowledge generation fully to TypeScript?
26
-
-[ ] Note that one of the current challenges is that the LLM is slow since there's so much to process, so we don't want to wait for one response to ask for another. We currently rely on stateless prompt and it should be the way it is.
27
-
-[ ] Evaluate other llm runtimes than ollama like ONNX for size
28
28
-[ ] Allow user to choose and download model using GUI
29
29
-[ ] Expand to exams other than GATE.
30
30
-[ ] Shift to asynchronous operations where viable.
0 commit comments