[API] Memory leak & Abort #1899
Replies: 7 comments
-
Beta Was this translation helpful? Give feedback.
-
You sent a link to an entire git repo - we won't be able to easily help you with that. Could you explain how you are using GPT4All and provide a minimal example that causes the crash if possible? |
Beta Was this translation helpful? Give feedback.
-
Is there a reason you're not using the nodejs bindings instead of the python api via a child process? |
Beta Was this translation helpful? Give feedback.
-
sorry.. i changed commit .. here is that problem commit and I made new branch problem. you can easily found in this branch I also tried use nodejs binding but It is not working correctly. I think it is because I do not have enough knowledge. follow the problem branch and go to Server Error
Error: No native build was found for platform=darwin arch=arm64 runtime=node abi=115 uv=1 armv=8 libc=glibc node=20.10.0 webpack=true
loaded from: /Users/test/goinfree/map_project_ai/.next/server
This error happened while generating the page. Any console logs will be displayed in the terminal window.
Call Stack
load.resolve.load.path
node_modules/node-gyp-build/node-gyp-build.js (60:8)
... |
Beta Was this translation helpful? Give feedback.
-
I'm not sure if tinyllama works with gpt4all. Could you try your project with one of the models in the Model Explorer on the homepage? |
Beta Was this translation helpful? Give feedback.
-
In addition, you might need to manually move the gpt4all binaries somewhere else. There have been a few issues like that |
Beta Was this translation helpful? Give feedback.
-
It works using 'tinyllama-1.1b-chat-v1.0.Q5_K_M.gguf' model https://github.com/liebespaar93/gpt4all/tree/main/test hmm.. |
Beta Was this translation helpful? Give feedback.
-
System Info
I using mac OS sonoma 14.1.2 (m1)
Information
Reproduction
here is my code in kyoulee tree
link : https://github.com/liebespaar93/map_project_ai/tree/kyoulee
I try 3 times of this code but I can't figure it out
i help U setting how can fall in bug
download llm model
info : https://huggingface.co/TheBloke/TinyLlama-1.1B-Chat-v1.0-GGUF
model : tinyllama-1.1b-chat-v1.0.Q5_K_M.gguf
try versel dev
than U can See this message
after api isn't work
something wrong in versel...
Expected behavior
Beta Was this translation helpful? Give feedback.
All reactions