Skip to content
Sign upLog in

Community

#gpt2
RESOURCES
TheDrone7
Replit Reps
TheDrone7
Replit Creates
jeff
Cycles Feedback
TheDrone7
Welcome to Replit Community [+ Rules]
TheDrone7
EVENTS
TOP TAGS
#games
#apps
#python
#javascript
#html
#fun
#game
#simple
#python3
#java
#cpp
#bash
TBUk
TBUk
published a Repl
3 months ago
0
GPT-2 Inference and Finetuning Template
GPT-2 Inference and Finetuning TemplateThis was an attempt to make something for the template jam, but unfortunately because Replit doesn’t provide more than a measly 4gb of ram, it can’t finetune. You can still run pretrained versions of GPT-2, but that makes it practically useless. I am now working on something else for the jam, that is a lot harder but much more possible.
#machinelearning
#gpt2
#failed
bigminiboss
bigminiboss
what are you making? :)3 months ago
WaterZ69
WaterZ69
yeah "measly" is right this is one of the big reasons I don't do templatejam lol I was gonna submit a huge improvement on another template (in collaboration with the author of the original) and it was running so slowly it would be much much better on 8 or even 6gb (i tested on my home server that has 12gb and tried allocating different amounts of ram. sure enough, 6 was a huge improvement over 4 and 8 was basically maxxed out 10 and 12 made no difference)3 months ago