I run one one a laptop like 3B slow . Thinking of aiming at getting something to run 12B. Think I can steal the setup at work for rebuilding it locally and use myself. What are your setup for running 12 tb , is it vram that’s the bottleneck ? Can I budget down everything else and just get a good gpu? Also are there any recommendation for true jailbreaked AI , that I can tweak myself without built in censoring or safety guards?
I run one one a laptop like 3B slow . Thinking of aiming at getting something to run 12B. Think I can steal the setup at work for rebuilding it locally and use myself. What are your setup for running 12 tb , is it vram that’s the bottleneck ? Can I budget down everything else and just get a good gpu? Also are there any recommendation for true jailbreaked AI , that I can tweak myself without built in censoring or safety guards?