← Back to Models
Phi-2
Phi-2 is a 2.7 billion-parameter language model from Microsoft. Despite its small size, it demonstrates remarkable performance, excelling at common sense, language understanding, and logical reasoning. It was trained on 'textbook-quality' data.
phi-2
2.7B parameters
Base
Pull this model
Use the following command with the HoML CLI:
homl pull phi-2:baseResource Requirements
| Quantization | Disk Space | GPU Memory |
|---|---|---|
| FP16 | 5.5 GB | 8 GB |
phi-2-8bit
2.7B parameters
Base
Pull this model
Use the following command with the HoML CLI:
homl pull phi-2:base-8bitResource Requirements
| Quantization | Disk Space | GPU Memory |
|---|---|---|
| 8-bit | 2.96 GB | 4 GB |
phi-2-4bit
2.7B parameters
Base
Pull this model
Use the following command with the HoML CLI:
homl pull phi-2:base-4bitResource Requirements
| Quantization | Disk Space | GPU Memory |
|---|---|---|
| 4-bit | 1.74 GB | 2 GB |