Problem Description

I need someone to deploy models for me

Must be deployed optimally in terms of cold start & inference:

• load weights from network/disk storage instead of remote
• use the optimal GPU & memory allocation
  etc.

---

Example:
https://huggingface.co/huihui-ai/Qwen2.5-Coder-32B-Instruct-abliterated

If anyone can deploy this - to ANY host - with <10 seconds cold start to inference-complete time they immediately get $200

---

Happy to pay $200 per model deployed for other models as well

And I can share code of previous deployments e.g. to Runpod

Acceptance Criteria

Deploy model(s) to the best-cold start severless host

Bonus if you can find a host better than Runpod in terms of cost:cold start time

Technical Details

Link to Project