Bielik-4.5B-v3.0-Instruct-MLX

MLX format conversion of speakleash/Bielik-4.5B-v3.0-Instruct for Apple Silicon.

Model Description

Bielik-4.5B-v3.0-Instruct is a Polish instruction-tuned language model based on the Qwen architecture, trained by SpeakLeash. This is the full-precision (bfloat16) MLX conversion optimized for Apple Silicon Macs.

Usage

from mlx_lm import load, generate

model, tokenizer = load("czlonkowski/Bielik-4.5B-v3.0-Instruct-MLX")
response = generate(model, tokenizer, prompt="Wyjaśnij czym jest uczenie maszynowe.", max_tokens=200)
print(response)

Or via CLI:

mlx_lm.generate --model czlonkowski/Bielik-4.5B-v3.0-Instruct-MLX --prompt "Wyjaśnij czym jest uczenie maszynowe."

Model Details

• Base Model: speakleash/Bielik-4.5B-v3.0-Instruct
• Format: MLX (Apple Silicon optimized)
• Precision: bfloat16 (full precision)
• Parameters: 4.5B
• Type: Instruction-tuned

Related Models

• czlonkowski/Bielik-4.5B-v3.0-Instruct-MLX-4bit - 4-bit quantized version

License

Please refer to the original model's license at speakleash/Bielik-4.5B-v3.0-Instruct.