← Back to Scratch Pad

OpenAI GPT3 Text Embeddings?

OpenAI GPT-3 Text Embeddings - Really a new state-of-the-art in dense text embeddings? | by Nils Reimers | Medium

• similarity model perform poorly compared to roberta-large-v1
• text search models perform well
• embeddings are slow and expensive - the embedding are exremely high-dimensional (Davinci has 12288 dimensions!)
• easy api to fetch embeddings; huggingface apis are easy enough as well.