Guides
Practical write-ups on running a large model on your own machine: what the numbers mean, which card fits, and what to do when it is slow.
Concepts
- vram-vs-ram: Local AI Memory Guide
Learn why VRAM matters for local LLMs. Stratat uses RAM for large models. See how to check your hardware and optimize your Stratat client setup.
Comparisons
- AMD Radeon RX 7900 XTX vs RX 6900 XT: Which GPU Wins for Local AI?
Compare AMD RX 7900 XTX and RX 6900 XT for local inference. We analyze VRAM, bandwidth, and cost-per-token to determine the best value for Stratat.
Hardware
- RTX 4090 IQ2-XS Local Inference Benchmarks
Analyze RTX 4090 performance with IQ2-XS quantization. Review VRAM usage, throughput, power draw, and running costs for local AI models.
- RTX 4090 iQ3-S Quantization: Performance and VRAM Analysis
Discover how the RTX 4090 handles iQ3-S quantization with 24GB VRAM. We analyze 4000 TPS reading speed and 550W power draw for local AI inference.
- rtx4090-coder: Local LLM Performance on RTX 4090
Analyze the RTX 4090's capacity for the coder quantization. Review VRAM fit, token throughput, and power draw to determine if this setup fits your local AI workflow.
Local setup
- comcast-bandwidth: How Local Limits Impact Your Stratat Model Performance
Explore how Comcast bandwidth caps and latency affect running large AI models locally with Stratat. Learn to optimize your connection for better inference speeds.
- Dorm-room-limits: local AI constraints
Navigate dorm network limits and power caps for local AI. Use Stratat to run models offline, respecting school rules and electrical safety without external dependencies.
- apartment-power-budget: Managing Local AI Electricity Costs
Learn how to calculate the real kWh cost of running local AI models in your apartment. Use Strata to optimize your power budget and avoid bill shocks.
Workflows
- How to Batch Process Data with Stratat Local AI
Learn to batch-process large datasets using Stratat's local engine. This guide covers setup, cost analysis using $0.17/kWh electricity rates, and optimization for privacy.
- How to Calculate Local AI Cost vs Cloud API for Stratat
Learn to calculate the true cost of running large language models locally with Stratat. Compare energy usage against cloud API pricing to decide.
- How to Backup Local AI Models for Stratat
Learn how to back up your Stratat engine models locally. Preserve your data, ensure privacy, and maintain offline access without relying on cloud services.
Troubleshooting
- Fix context-truncated error in Stratat local AI
Resolve the context-truncated error in Stratat by managing context windows and optimizing input sizes to prevent local AI model failures.
- amd-fallback Troubleshooting Guide for Stratat Desktop App
Resolve amd-fallback errors in Stratat by verifying local GPU availability and model compatibility. Step-by-step diagnostic guide for Windows and macOS users.