Update README.md

README.md

@@ -30,4 +30,14 @@ model-index:
     metrics:
       - type: "perplexity"        # Required. Example: wer. Use metric id from https://hf.co/metrics
         value: "46.69"      # Required. Example: 20.90
----
+---
+
+GPT-2 model in luxembourgish language, trained on 636.8 MB of text data, consisting of RTL.lu news articles, comments, parlament speeches, the luxembourgish Wikipedia, Newscrawl, Webcrawl and subtitles.
+The training took place on a 32 GB Nvidia Tesla V100
+with an initial learning rate of 5e-5
+with Batch size 4
+for 109 hours
+for 30 epochs
+
+
+See the GPT2 model card for considerations on limitations and bias. See the GPT2 documentation for details on GPT2.