ollama 运行只调用CPU 不用GPU

malatang · December 6, 2024, 12:25pm

如题，求问大佬如何让模型运行起来的时候是用GPU而不是CPU呀

设备是 i5-13600KF 3.50 GHz
显卡是 RTX 4080 SUPER 32.0 GB

一般能带动多大的本地模型

kuluoxiaohuamc · December 6, 2024, 12:32pm

不知道，建议检查驱动

stevessr · December 6, 2024, 12:33pm

github.com

ollama/ollama/blob/main/docs/gpu.md

# GPU
## Nvidia
Ollama supports Nvidia GPUs with compute capability 5.0+.

Check your compute compatibility to see if your card is supported:
[https://developer.nvidia.com/cuda-gpus](https://developer.nvidia.com/cuda-gpus)

| Compute Capability | Family              | Cards                                                                                                       |
| ------------------ | ------------------- | ----------------------------------------------------------------------------------------------------------- |
| 9.0                | NVIDIA              | `H100`                                                                                                      |
| 8.9                | GeForce RTX 40xx    | `RTX 4090` `RTX 4080 SUPER` `RTX 4080` `RTX 4070 Ti SUPER` `RTX 4070 Ti` `RTX 4070 SUPER` `RTX 4070` `RTX 4060 Ti` `RTX 4060`  |
|                    | NVIDIA Professional | `L4` `L40` `RTX 6000`                                                                                       |
| 8.6                | GeForce RTX 30xx    | `RTX 3090 Ti` `RTX 3090` `RTX 3080 Ti` `RTX 3080` `RTX 3070 Ti` `RTX 3070` `RTX 3060 Ti` `RTX 3060` `RTX 3050 Ti` `RTX 3050`   |
|                    | NVIDIA Professional | `A40` `RTX A6000` `RTX A5000` `RTX A4000` `RTX A3000` `RTX A2000` `A10` `A16` `A2`                          |
| 8.0                | NVIDIA              | `A100` `A30`                                                                                                |
| 7.5                | GeForce GTX/RTX     | `GTX 1650 Ti` `TITAN RTX` `RTX 2080 Ti` `RTX 2080` `RTX 2070` `RTX 2060`                                    |
|                    | NVIDIA Professional | `T4` `RTX 5000` `RTX 4000` `RTX 3000` `T2000` `T1200` `T1000` `T600` `T500`                                 |
|                    | Quadro              | `RTX 8000` `RTX 6000` `RTX 5000` `RTX 4000`                                                                 |
| 7.0                | NVIDIA              | `TITAN V` `V100` `Quadro GV100`                                                                             |
| 6.1                | NVIDIA TITAN        | `TITAN Xp` `TITAN X`                                                                                        |

This file has been truncated. show original

github.com

ollama/ollama/blob/main/docs/troubleshooting.md

# How to troubleshoot issues

Sometimes Ollama may not perform as expected. One of the best ways to figure out what happened is to take a look at the logs. Find the logs on **Mac** by running the command:

```shell
cat ~/.ollama/logs/server.log
```

On **Linux** systems with systemd, the logs can be found with this command:

```shell
journalctl -u ollama --no-pager
```

When you run Ollama in a **container**, the logs go to stdout/stderr in the container:

```shell
docker logs <container-name>
```
(Use `docker ps` to find the container name)

此文件已被截断。显示原始文件

Topic		Replies	Views
请教佬友们，关于 ollama 的。开发调优人工智能 , 快问快答 , 配置优化	35	576	December 8, 2024
哪有家的GPU云资源便宜好用？开发调优人工智能 , 快问快答 , 软件开发	10	608	November 14, 2024
老黄有哪些好用的非推理模型可以白嫖api 开发调优快问快答	0	79	April 27, 2025
CPU占用率个位数matlab仿真却跑不快开发调优快问快答	0	66	April 15, 2025
FLOPS指的是单精度还是双精度? 开发调优快问快答	13	410	December 8, 2024

ollama 运行只调用CPU 不用GPU

Related topics