wiki #pretraining #pretraining 1 page tagged with "pretraining" models mimelens: small encoders for content-type detection on any byte window — pretrained byte-level and bpe BERT encoders that classify file content from a 4 kb chunk anywhere inside a file — including a single 1.4 kb udp packet. back to wiki