Skip to content
Sections
>> Trisquel >> Packages >> ecne-updates >> python >> python3-tiktoken
[  ecne  ] [  ecne-updates  ] [  xolotl  ]
[ Source: tiktoken  ]

Package: python3-tiktoken (0.6.0-2)

fast BPE tokeniser for use with OpenAI's models

A fast Byte pair encoding tokeniser for use with OpenAI's models.

Other Packages Related to python3-tiktoken

  • depends
  • recommends
  • suggests
  • dep: libc6 (>= 2.34)
    GNU C Library: Shared libraries
    also a virtual package provided by libc6-udeb
  • dep: libgcc-s1 (>= 4.2)
    GCC support library
  • dep: python3
    interactive high-level object-oriented language (default python3 version)
    dep: python3 (<< 3.13)
    dep: python3 (>= 3.11~)
  • dep: python3-regex
    alternative regular expression module (Python 3)
  • dep: python3-requests
    elegant and simple HTTP library for Python3, built for human beings

Download python3-tiktoken

Download for all available architectures
Architecture Package Size Installed Size Files
amd64 903.2 kB5100 kB [list of files]