By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Dynamic loadexamples

time=2024-02-22T15:43:18.086+08:00 level=INFO source=images.go:710 msg="total blobs: 11" time=2024-02-22T15:43:18.117+08:00 level=INFO source=images.go:717 msg="total unused blobs removed: 0" time=2024-02-22T15:43:18.120+08:00 level=INFO source=routes.go:1019 msg="Listening on 127.0.0.1:11434 (version 0.1.26)" time=2024-02-22T15:43:18.120+08:00 level=INFO source=payload_common.go:107 msg="Extracting dynamic libraries..." time=2024-02-22T15:43:18.274+08:00 level=INFO source=payload_common.go:146 msg="Dynamic LLM libraries [cpu_avx cpu_avx2 cpu cuda_v11.3]" [GIN] 2024/02/22 - 15:43:18 | 200 | 0s | 127.0.0.1 | HEAD "/" [GIN] 2024/02/22 - 15:43:18 | 200 | 2.1738ms | 127.0.0.1 | POST "/api/show" [GIN] 2024/02/22 - 15:43:18 | 200 | 1.6371ms | 127.0.0.1 | POST "/api/show" time=2024-02-22T15:43:18.996+08:00 level=INFO source=gpu.go:94 msg="Detecting GPU type" time=2024-02-22T15:43:18.996+08:00 level=INFO source=gpu.go:265 msg="Searching for GPU management library nvml.dll" time=2024-02-22T15:43:19.003+08:00 level=INFO source=gpu.go:311 msg="Discovered GPU libraries: [c:\Windows\System32\nvml.dll C:\Windows\system32\nvml.dll]" time=2024-02-22T15:43:19.019+08:00 level=INFO source=gpu.go:99 msg="Nvidia GPU detected" time=2024-02-22T15:43:19.019+08:00 level=INFO source=cpu_common.go:11 msg="CPU has AVX2" time=2024-02-22T15:43:19.034+08:00 level=INFO source=gpu.go:146 msg="CUDA Compute Capability detected: 6.1" time=2024-02-22T15:43:19.034+08:00 level=INFO source=cpu_common.go:11 msg="CPU has AVX2" time=2024-02-22T15:43:19.034+08:00 level=INFO source=gpu.go:146 msg="CUDA Compute Capability detected: 6.1" time=2024-02-22T15:43:19.034+08:00 level=INFO source=cpu_common.go:11 msg="CPU has AVX2" time=2024-02-22T15:43:19.034+08:00 level=INFO source=dyn_ext_server.go:385 msg="Updating PATH to C:\Users\葫芦娃\AppData\Local\Temp\ollama3325263888\cuda_v11.3;C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0\;C:\Windows\System32\OpenSSH\;C:\Program Files (x86)\NVIDIA Corporation\PhysX\Common;C:\Program Files\NVIDIA Corporation\NVIDIA NvDLISR;C:\Program Files (x86)\NetSarang\Xshell 7\;C:\Program Files (x86)\NetSarang\Xftp 7\;C:\Program Files\dotnet\;C:\Program Files\Git\cmd;C:\Users\葫芦娃\AppData\Local\Microsoft\WindowsApps;C:\Program Files\Bandizip\;F:\Microsoft VS Code\bin;C:\ffmpeg-2024-02-15-git-a2cfd6062c-full_build\bin;;C:\Users\葫芦娃\AppData\Local\Programs\Ollama" time=2024-02-22T15:43:19.035+08:00 level=WARN source=llm.go:162 msg="Failed to load dynamic library C:\Users\葫芦娃\AppData\Local\Temp\ollama3325263888\cuda_v11.3\ext_server.dll Unable to load dynamic library: Unable to load dynamic server library: \xd5Ҳ\xbb\xb5\xbdָ\xb6\xa8\xb5\xc4ģ\xbf顣\r\n" time=2024-02-22T15:43:19.035+08:00 level=INFO source=dyn_ext_server.go:385 msg="Updating PATH to C:\Users\葫芦娃\AppData\Local\Temp\ollama3325263888\cpu_avx2;C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0\;C:\Windows\System32\OpenSSH\;C:\Program Files (x86)\NVIDIA Corporation\PhysX\Common;C:\Program Files\NVIDIA Corporation\NVIDIA NvDLISR;C:\Program Files (x86)\NetSarang\Xshell 7\;C:\Program Files (x86)\NetSarang\Xftp 7\;C:\Program Files\dotnet\;C:\Program Files\Git\cmd;C:\Users\葫芦娃\AppData\Local\Microsoft\WindowsApps;C:\Program Files\Bandizip\;F:\Microsoft VS Code\bin;C:\ffmpeg-2024-02-15-git-a2cfd6062c-full_build\bin;;C:\Users\葫芦娃\AppData\Local\Programs\Ollama;C:\Users\葫芦娃\AppData\Local\Programs\Ollama" time=2024-02-22T15:43:19.035+08:00 level=WARN source=llm.go:162 msg="Failed to load dynamic library C:\Users\葫芦娃\AppData\Local\Temp\ollama3325263888\cpu_avx2\ext_server.dll Unable to load dynamic library: Unable to load dynamic server library: \xd5Ҳ\xbb\xb5\xbdָ\xb6\xa8\xb5\xc4ģ\xbf顣\r\n" [GIN] 2024/02/22 - 15:43:19 | 500 | 671.9922ms | 127.0.0.1 | POST "/api/chat"

What isdynamicloading in structures

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Staticloadvsdynamic load

Ivana Gorana Kovačića 24c, 18000 Niš, Srbija | +381 (0)18 576-423 | +381 (0)18 576-362 | GPS: S: 43.331858 I: 21.92472 (S: 43˚19’911“ I: 21˚55’483“)