Show HN: 2.4x faster baai/bge-M3

huggingface.co

1 points by monatis 5 hours ago

We published a a distilled version of baai/bge-m3 with 8 layers. It provides 2.4x higher throughput with Pearson Cosine = 0.9691 and Spearman Cosine = 0.965. It quickly became our default embedder model for all our projects.