End of training

README.md

@@ -1,18 +1,18 @@
 ---
+license: apache-2.0
 base_model: facebook/wav2vec2-base
+tags:
+- generated_from_trainer
 datasets:
 - vivos
-license: apache-2.0
 metrics:
 - wer
-tags:
-- generated_from_trainer
 model-index:
 - name: wav2vec2-vivos
   results:
   - task:
-      type: automatic-speech-recognition
       name: Automatic Speech Recognition
+      type: automatic-speech-recognition
     dataset:
       name: vivos
       type: vivos
@@ -20,9 +20,9 @@ model-index:
       split: None
       args: default
     metrics:
-    - type: wer
-      value: 0.2558154859967051
-      name: Wer
+    - name: Wer
+      type: wer
+      value: 0.23636599442318915
 ---
 
 <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -32,8 +32,8 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [facebook/wav2vec2-base](https://huggingface.co/facebook/wav2vec2-base) on the vivos dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.4738
-- Wer: 0.2558
+- Loss: 0.4755
+- Wer: 0.2364
 
 ## Model description
 
@@ -59,8 +59,8 @@ The following hyperparameters were used during training:
 - gradient_accumulation_steps: 4
 - total_train_batch_size: 128
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
-- lr_scheduler_type: cosine
-- lr_scheduler_warmup_ratio: 0.3
+- lr_scheduler_type: linear
+- lr_scheduler_warmup_ratio: 0.2
 - num_epochs: 20
 - mixed_precision_training: Native AMP
 
@@ -68,16 +68,16 @@ The following hyperparameters were used during training:
 
 | Training Loss | Epoch | Step | Validation Loss | Wer    |
 |:-------------:|:-----:|:----:|:---------------:|:------:|
-| 7.0257        | 2.0   | 146  | 4.2455          | 1.0    |
-| 3.4764        | 4.0   | 292  | 3.6224          | 1.0    |
-| 3.4259        | 6.0   | 438  | 3.5189          | 1.0    |
-| 2.6095        | 8.0   | 584  | 1.1439          | 0.7013 |
-| 0.7018        | 10.0  | 730  | 0.6253          | 0.3943 |
-| 0.3858        | 12.0  | 876  | 0.5361          | 0.3155 |
-| 0.2738        | 14.0  | 1022 | 0.4801          | 0.2824 |
-| 0.2449        | 16.0  | 1168 | 0.4826          | 0.2624 |
-| 0.1784        | 18.0  | 1314 | 0.4749          | 0.2572 |
-| 0.1684        | 20.0  | 1460 | 0.4738          | 0.2558 |
+| 1.349         | 2.0   | 146  | 0.9904          | 0.6088 |
+| 0.718         | 4.0   | 292  | 0.6959          | 0.4630 |
+| 0.4692        | 6.0   | 438  | 0.5304          | 0.3414 |
+| 0.3385        | 8.0   | 584  | 0.5078          | 0.3216 |
+| 0.2627        | 10.0  | 730  | 0.4659          | 0.2788 |
+| 0.2033        | 12.0  | 876  | 0.4751          | 0.2656 |
+| 0.1699        | 14.0  | 1022 | 0.4659          | 0.2519 |
+| 0.1688        | 16.0  | 1168 | 0.4662          | 0.2394 |
+| 0.1269        | 18.0  | 1314 | 0.4707          | 0.2375 |
+| 0.1162        | 20.0  | 1460 | 0.4755          | 0.2364 |
 
 
 ### Framework versions