Not working on Runpod machines? #170
Description
Hi! I tried to get a Wan2.2 workflow with both big fp16 models to work on Runpod on an A40 48GB VRAM machine with 50GB RAM. I tried to get it running on the machine, but it just doesn't work, no matter what settings I use. It seems that in Runpod all the models are first loaded into RAM and only then into VRAM, and 50GB of RAM is probably not enough for that. The RAM goes up to 100% and then the machine is dead, no matter what settings I use.
On my private PC with Windows 11, RTX3090 with 24GB VRAM and 64GB RAM it worked without any problems.