Back to all Bounties
Earn 1,530 ($15.30)
due 1 year ago
Canceled
example for openai Customizing_embeddings cookbook with HF transformer models
matthewgard1
Details
Applications
1
Discussion
Bounty Description
Problem Description
want an example repl for training/demonstration purposes(not production), using HF transformers https://huggingface.co/sentence-transformers
based on the Customizing_embeddings approach from https://github.com/openai/openai-cookbook/blob/main/examples/Customizing_embeddings.ipynb
no openai embeddings should be used! only HF, ex:
model = SentenceTransformer('all-MiniLM-L6-v2')
model = SentenceTransformer('thenlper/gte-small')
model = SentenceTransformer('baai/bge-base-en-v1.5')
Acceptance Criteria
- can run through process without errors
- no openai usage
- csv and cached embedings stored local fs