#6260 [Docs] Explain DFlash2 selection during Metal setup

open · @ViktorBystrov72 · 0 commentaires · Sur GitHub

Setup & installModels & quantsDocumentation

Description

## Problem and result

The macOS source setup guide presents DFlash2 as specific to the two tuned Unsloth packs. Auto also selects the stock DFlash2 drafter for Q2_0 and IQ3_XXS. On a streaming Mac, setup also announces one token per step when it skips MTP, even though it can still prepare DFlash2.

The guide now describes the stock and tuned options, the IQ3_S choice, and the MTP fallback. Setup reports when it skips MTP and keeps the download warning accurate when DFlash2 is unavailable.

## Related discussion

Fixes #6174.

## Approach

Describe the MTP layer that setup prepares separately from the drafter the server can select at startup. Link the DFlash2 notice in its new repository location.

## Validation

macOS 26.6.2 arm64, Python 3.12.13, commit `3773be4`.

**Passed**

- `python -B tools/check --only docs` passed all six documentation checks.
- `python -B -m unittest tools.test_setup_mac -q` from `terminal/` passed 45 tests.
- A Python probe with a stubbed download verified the five documented model choices, the stock or tuned selection, and the 96 GB MTP threshold for streaming models.

**Failed**

None.

**Not run**

A full source install with model weights. The setup tests and the drafter probe use local fixtures.

Sur le site

Liens install, modèles, releases.