#training
3pages tagged with "training"
programming
- cpu transformer training on zen 4 with avx512-bf16— measured throughput, thread scaling, and blas packaging pitfalls when training small transformer encoders on amd zen 4 cpus
- small encoder training throughput on consumer gpus— measured training throughput for 5m and 21m parameter transformer encoders across rtx 5070 ti, 4070 ti super, 4060 ti, and zen 4 cpus