softmax_pdf_floor

rwkvzip::coders::ac

Function softmax_pdf_floor 

Source 
pub fn softmax_pdf_floor(logits: &[f32], vocab_size: usize) -> Vec<f64>
Expand description

Compute softmax PDF with probability floor.

§Arguments

  • logits - Raw logits from the model
  • vocab_size - Size of the vocabulary (256 for byte-level)

§Returns

Probability distribution with floor applied, normalized to sum to 1.