sync/ports
1
0
Fork 0
mirror of https://git.freebsd.org/ports.git synced 2025-05-07 11:20:46 -04:00
Code Issues Projects Releases Packages Wiki Activity Actions
ports/textproc/py-tiktoken/pkg-descr
Po-Chuan Hsieh 6c34be9ab1
textproc/py-tiktoken: Add py-tiktoken 0.4.0 
tiktoken is a fast BPE tokeniser for use with OpenAI's models.
2023-08-22 01:01:58 +08:00

1 line
63 B
Text
Raw Blame History

tiktoken is a fast BPE tokeniser for use with OpenAI's models.
Reference in a new issue View git blame Copy permalink