Saturday 7 September 2019

Set the number of iterations gpt-2

I'm fine tunning a gpt-2 model following this tutorial:

https://medium.com/@ngwaifoong92/beginners-guide-to-retrain-gpt-2-117m-to-generate-custom-text-content-8bb5363d8b7f

With is associated GitHub repository:

https://github.com/nshepperd/gpt-2

I have been able to replicate the examples, my issue is that I'm not fiding a parameter to set the number of iterations. Basically the training script shows a sample every 100 iterations and save a model version every 1000 iterations. But I'm not finding a parameter to train it for say, 5000 iterations and then close it.

The script for training is here: https://github.com/nshepperd/gpt-2/blob/finetuning/train.py



from Set the number of iterations gpt-2

No comments:

Post a Comment