ProfilerSink

rwkvzip::rwkv7

Trait ProfilerSink 

Source 
pub trait ProfilerSink {
    // Provided methods
    fn begin_token(&mut self) { ... }
    fn record_attention(&mut self, _layer: usize, _duration: Duration) { ... }
    fn record_ffn(&mut self, _layer: usize, _duration: Duration) { ... }
}
Expand description

Sink trait used by the model to surface per-layer timings without committing to a particular profiler implementation.

Provided Methods§

Source

fn begin_token(&mut self)

Source

fn record_attention(&mut self, _layer: usize, _duration: Duration)

Source

fn record_ffn(&mut self, _layer: usize, _duration: Duration)

Implementors§