Virtual Memory
Training large models on commodity hardware relies on virtual memory to supplement VRAM. This virtual memory can be configured directly on the training host, or in isolation via hypervisors or containers.
Training large models on commodity hardware relies on virtual memory to supplement VRAM. This virtual memory can be configured directly on the training host, or in isolation via hypervisors or containers.