Evillain/RelentlessPursuit-12b-exp-05

merge

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the Model Stock merge method using allura-org/MN-12b-RP-Ink as a base.

Models Merged

The following models were included in the merge:

• anthracite-org/magnum-v4-12b
• nbeerbower/Lyra4-Gutenberg-12B
• VongolaChouko/Starcannon-Unleashed-12B-v1.0

Configuration

The following YAML configuration was used to produce this model:

merge_method: model_stock
base_model: allura-org/MN-12b-RP-Ink
models:
  - model: allura-org/MN-12b-RP-Ink
  - model: VongolaChouko/Starcannon-Unleashed-12B-v1.0
  - model: anthracite-org/magnum-v4-12b
  - model: nbeerbower/Lyra4-Gutenberg-12B
parameters:
  int8_mask: true
dtype: bfloat16
tokenizer_source: base