Setting the file. One moment.
Subchapter 33.1
references/customize-guides.mdMarkdown3 KBView on GitHub
Reference for:
models/deploy-model/customize/SKILL.md
Table of Contents: Selection Guides ·
| SKU | Best For | Cost | Availability |
|---|---|---|---|
| GlobalStandard | Production, high availability | Medium | Multi-region |
| Standard | Development, testing | Low | Single region |
| ProvisionedManaged | High-volume, predictable workloads | Fixed (PTU) | Reserved capacity |
| DataZoneStandard | Data residency requirements | Medium | Specific zones |
Decision Tree:
Do you need guaranteed throughput?
├─ Yes → ProvisionedManaged (PTU)
└─ No → Do you need high availability?
├─ Yes → GlobalStandard
└─ No → StandardFor TPM-based SKUs (GlobalStandard, Standard):
| Workload | Recommended Capacity |
|---|---|
| Development/Testing | 1K - 5K TPM |
| Small Production | 5K - 20K TPM |
| Medium Production | 20K - 100K TPM |
| Large Production | 100K+ TPM |
For PTU-based SKUs (ProvisionedManaged):
Use the PTU calculator based on:
Capacity Planning Tips:
| Policy | Filtering Level | Use Case |
|---|---|---|
| Microsoft.DefaultV2 | Balanced | Most applications |
| Microsoft.Prompt-Shield | Enhanced | Security-sensitive apps |
| Custom | Configurable | Specific requirements |
Recommendation: Start with Microsoft.DefaultV2 and adjust based on application needs.
What is PTU?
PTU Calculator:
Estimated PTU = (Input TPM × 0.001) + (Output TPM × 0.002) + (Requests/min × 0.1)
Example:
- Input: 10,000 tokens/min
- Output: 5,000 tokens/min
- Requests: 100/min
PTU = (10,000 × 0.001) + (5,000 × 0.002) + (100 × 0.1)
= 10 + 10 + 10
= 30 PTUPTU Deployment:
az cognitiveservices account deployment create \
--name <account-name> \
--resource-group <resource-group> \
--deployment-name <deployment-name> \
--model-name <model-name> \
--model-version <version> \
--model-format "OpenAI" \
--sku-name "ProvisionedManaged" \
--sku-capacity 100 # PTU unitsSpillover Workflow:
Best Practices:
What is Priority Processing?
When to Use: