[AI小白]为什么我本地部署的OLLAMA的phi3跑的是CPU啊

squidfly · November 23, 2024, 7:44am

企业微信截图_17323476902555
自己利用ollama本地部署了一个phi3的模型，但是用了发现怎么跑的是cpu，gpu压根不动，是为啥？

remoteman · November 23, 2024, 7:46am

驱动打好了吗？

Chat · November 23, 2024, 7:48am

参数设置 cuda了吗？

squidfly · November 23, 2024, 8:05am

突然反应过来用的是i卡，难道不支持？我看下github 的issuse

squidfly · November 23, 2024, 8:13am

Add support for Intel Arc GPUs · Issue #1590 · ollama/ollama · GitHub 看了下好像得自己编译ollama，我换个n卡试试看

obrook · November 23, 2024, 1:53pm

你可以看看这个，记得里面有参数设置是用cpu还是gpu

stevessr · November 23, 2024, 1:56pm

github.com

ollama/ollama/blob/main/docs/gpu.md

# GPU
## Nvidia
Ollama supports Nvidia GPUs with compute capability 5.0+.

Check your compute compatibility to see if your card is supported:
[https://developer.nvidia.com/cuda-gpus](https://developer.nvidia.com/cuda-gpus)

| Compute Capability | Family              | Cards                                                                                                       |
| ------------------ | ------------------- | ----------------------------------------------------------------------------------------------------------- |
| 9.0                | NVIDIA              | `H100`                                                                                                      |
| 8.9                | GeForce RTX 40xx    | `RTX 4090` `RTX 4080 SUPER` `RTX 4080` `RTX 4070 Ti SUPER` `RTX 4070 Ti` `RTX 4070 SUPER` `RTX 4070` `RTX 4060 Ti` `RTX 4060`  |
|                    | NVIDIA Professional | `L4` `L40` `RTX 6000`                                                                                       |
| 8.6                | GeForce RTX 30xx    | `RTX 3090 Ti` `RTX 3090` `RTX 3080 Ti` `RTX 3080` `RTX 3070 Ti` `RTX 3070` `RTX 3060 Ti` `RTX 3060` `RTX 3050 Ti` `RTX 3050`   |
|                    | NVIDIA Professional | `A40` `RTX A6000` `RTX A5000` `RTX A4000` `RTX A3000` `RTX A2000` `A10` `A16` `A2`                          |
| 8.0                | NVIDIA              | `A100` `A30`                                                                                                |
| 7.5                | GeForce GTX/RTX     | `GTX 1650 Ti` `TITAN RTX` `RTX 2080 Ti` `RTX 2080` `RTX 2070` `RTX 2060`                                    |
|                    | NVIDIA Professional | `T4` `RTX 5000` `RTX 4000` `RTX 3000` `T2000` `T1200` `T1000` `T600` `T500`                                 |
|                    | Quadro              | `RTX 8000` `RTX 6000` `RTX 5000` `RTX 4000`                                                                 |
| 7.0                | NVIDIA              | `TITAN V` `V100` `Quadro GV100`                                                                             |
| 6.1                | NVIDIA TITAN        | `TITAN Xp` `TITAN X`                                                                                        |

This file has been truncated. show original

github.com

ollama/ollama/blob/main/docs/faq.md

# FAQ

## How can I upgrade Ollama?

Ollama on macOS and Windows will automatically download updates. Click on the taskbar or menubar item and then click "Restart to update" to apply the update. Updates can also be installed by downloading the latest version [manually](https://ollama.com/download/).

On Linux, re-run the install script:

```shell
curl -fsSL https://ollama.com/install.sh | sh
```

## How can I view the logs?

Review the [Troubleshooting](./troubleshooting.md) docs for more about using logs.

## Is my GPU compatible with Ollama?

Please refer to the [GPU docs](./gpu.md).

This file has been truncated. show original

Topic		Replies	Views
请教佬友们，关于 ollama 的。开发调优人工智能 , 快问快答 , 配置优化	35	553	December 8, 2024
沉浸式翻译配置Ollama 资源荟萃人工智能	101	7404	January 16, 2025
使用 Deepseek 加持沉浸式翻译，效果棒极了。资源荟萃 DeepSeek , 沉浸式翻译	122	5161	March 8, 2025
10秒，优雅的部署本地大模型ollama+openwebui 资源荟萃人工智能	31	2790	December 9, 2024
3分钟，拥有你的本地大模型-Ollama！【Windows篇小白向】资源荟萃人工智能	79	5857	November 14, 2024

[AI小白]为什么我本地部署的OLLAMA的phi3跑的是CPU啊

Related topics