16 GB · RTX 4080
files too big
118.13 GB short
My measured card; usable free memory is not verified.
Steven Kramp / @SelfHostedSI · Local AI lab
File size only: 134.13 GB (display rounded to 0.01 GB); not run yet.
Download this model's data (JSON)134.13 GB (display rounded to 0.01 GB)
134,132,893,991 bytes across 28 files for this variant.
Source: Hugging Face file listing. Retrieved . Sum of the root .safetensors files plus model.safetensors.index.json; tokenizer and config files excluded.
Hugging Face listings can change. These are dated file-size records; a revision hash was not retained. Download size does not prove that a runtime can load the model.
Subtract this variant's recorded file size from each memory budget; the remainder is the upper bound for context and other overhead.
Decimal: 1 GB = 1,000,000,000 bytes; 1 TB = 1,000 GB. These are arithmetic comparison budgets, not verified usable hardware capacities. The answer can change with GB/GiB: 512 GiB = 549,755,813,888 bytes. The measured RTX 4080 has 16 GB VRAM; every other device name only labels a comparison budget.
files too big
118.13 GB short
My measured card; usable free memory is not verified.
files too big
110.13 GB short
Comparison budget; not measured.
files too big
102.13 GB short
Comparison budget; not measured.
files too big; files fit at 128 GiB
6.13 GB short
Comparison budget; I do not own one. Usable free memory is lower and not verified.
files fit on paper
121.87 GB left
One Mac Studio M5 Ultra, or the sum of two DGX Sparks (two memories, not one pool). Not measured.
files fit on paper
377.87 GB left
Planned; not delivered.
files fit on paper
865.87 GB left
Across two planned machines; not one shared memory pool.
GB values are rounded to 0.01 GB for display; “left” is what remains for context, runtime and the operating system. Exact bytes are in this model's data (JSON).
Budget minus model files leaves an upper bound for context, runtime buffers and the operating system; no context length or runtime compatibility is promised. Exactly filling a budget leaves no room for context, so the answer is “no room for context on paper”; files larger than the budget are “files too big”.
Two Mac Studio machines, 512 GB each; not delivered. Two DGX Sparks are likewise two memories, not one pool. A model split across two machines needs a compatible runtime and must fit each machine's allocation. This table is arithmetic, not a cluster test.
Append-only run history · oldest first
Output tokens/s, time to first token, measured context window, power and € per million tokens: not measured yet. No Mac measurements yet.
The JSON is an extract of approved measurement fields. Internal paths and operational notes are excluded. New runs append here; the model URL stays the same.