AI: Image to video in local: Difference between revisions

From A Technological Wiki
Jump to navigation Jump to search
No edit summary
No edit summary
 
(3 intermediate revisions by the same user not shown)
Line 1: Line 1:
= Basic concepts =
TODO: create from text to video
 
== checkpoint ==
A checkpoint is the original format for saving all model weights and configuration.
 
=== noise level checkpoints ===
For WAN model, there are high and low are different checkpoints of the WAN model that are designed to handle different noise levels or phases in the diffusion process (start from noise and gradually refine into frames).
 
* A “high noise” model checkpoint is used for the '''earlier, high-noise phase''' of the generation process: when the latent is still very noisy, you need the model to do large corrections, heavy denoising, broad scene layout, motion establishment.
 
* A “low noise” model checkpoint is used for the '''later phase''', when the latent is already mostly refined and only fine-details, motion smoothing and subtle transitions remain.
 
== GGUF ==
GGUF is a file format for large language models (LLMs) that optimizes them for consumer hardware by allowing them to be compressed and run efficiently on standard CPUs. They are converted and quantized versions of large diffusion or language models.
 
== Safetensor ==
A safetensor is a small adapter that modify the main model’s weights at runtime (like LoRAs). It is a secure and fast file format for storing tensors, particularly large tensors like neural network weights.
 
== Quantification (Q) ==
If a model is quantified it is a '''compressed''' version of the original model where the numbers are stored with fewer bits (less precision). It saves memory and runs faster, at the cost of some quality.
 
The '''higher''' '''number''' of the quantification is, '''lower quality''' the result will have and '''lower memory''' requirements will have.
 
== Floating point (fp) ==
It is a way of storing real numbers (like 3.14159) with '''high precision'''. Used for model weights and calculations.
 
The '''higher number''' of fp is, '''higher quality''' will have the result and '''higher memory''' requirements will have.
::
::
 
[[Category:AI: Generate media locally]]
[[Category:IT Resources]]

Latest revision as of 22:15, 2 November 2025

TODO: create from text to video