DDRO-Reference-Policies (SFT)
Collection
Step-2 SFT reference policies (ฯ_ref) used to initialize DDRO (MS MARCO / NQ; PQ and Title+URL DocIDs); use these for fair comparisons/ablations.
โข
4 items
โข
Updated
DDRO Step-2 SFT Reference Policy โ NQ + PQ
This repository contains the Step 2 (SFT) checkpoint used as the reference policy (ฯ_ref) / initialization for the DDRO training stage from Lightweight and Direct Document Relevance Optimization for Generative Information Retrieval.
What this is
- Stage: Step 2 / supervised fine-tuning (SFT)
- Role in DDRO: reference policy (ฯ_ref)
Corresponding final DDRO model
- Post-DDRO (Step 3) checkpoint:
kiyam/ddro-nq-pq
How to load
from transformers import AutoTokenizer, AutoModelForSeq2SeqLM
repo = "kiyam/ddro-nq-pq-sft"
tok = AutoTokenizer.from_pretrained(repo)
model = AutoModelForSeq2SeqLM.from_pretrained(repo)
Intended use
Research and reproducibility. Please cite the DDRO paper if you use this checkpoint.
- Downloads last month
- 1