4 commits

Author	SHA1	Message	Date
Niko	7e46c91cbd	Add docs to get_token and its unchecked variant	2025-08-13 00:53:44 -07:00
Niko	e34533731c	Add docs to no_speech_probability	2025-08-13 00:53:31 -07:00
Niko	a840bdaa8b	Remove unnecessary error handling	2025-08-13 00:52:38 -07:00
Niko	15e70ffd07	Refactor the entire token/segment usage ... This was spurred by noticing a trivial case of UB in the original code: all one needed was an out-of-bounds index on any of several methods with tokens or segment indexes on the state to cause UB. I took this opportunity to consolidate methods into Rust structs that verify their index before use.	2025-08-02 18:45:42 -07:00