This is the GeneralTinyBERTv2(4layer-312dim) ported to Huggingface transformers.
Browse all Feature Extraction models →