Search results

Finish implementation of MLC_ENABLE_SENTENCEPIECE_TOKENIZER

Status: Open.

#84 In mlc-ai/tokenizers-cpp;

· WilliamTambellini opened on Jul 28, 2025

Upgrade to official sentencepiece 0.2

Status: Open.

#83 In mlc-ai/tokenizers-cpp;

· WilliamTambellini opened on Jul 22, 2025

Call for a new release (0.1.2?)

Status: Open.

#82 In mlc-ai/tokenizers-cpp;

· WilliamTambellini opened on Jul 17, 2025

Add support for generating dynamic library

Status: Open.

#74 In mlc-ai/tokenizers-cpp;

· PARTHSQL opened on Jun 11, 2025

rustc E0308 error when compiling version v.0.1.0

Status: Open.

#72 In mlc-ai/tokenizers-cpp;

· gaokao123 opened on May 28, 2025

Does it support Wordpiece tokenizer?

Status: Open.

#71 In mlc-ai/tokenizers-cpp;

· yangxudong opened on May 19, 2025

Android Cross Compile Error! (error: linker <code>cc</code> not found)

Status: Open.

#63 In mlc-ai/tokenizers-cpp;

· huangzhengxiang opened on Feb 28, 2025

Problem using #include "tokenizers_c.h"

Status: Open.

#61 In mlc-ai/tokenizers-cpp;

· doogunwo opened on Feb 13, 2025

Sentence piece llama2 its not printing space

Status: Open.

#58 In mlc-ai/tokenizers-cpp;

· naveenmittal04 opened on Feb 3, 2025

How to build in android platform?

Status: Open.

#56 In mlc-ai/tokenizers-cpp;

· jixiedaima opened on Jan 16, 2025

link error in tokenizers_c.lib

Status: Open.

#54 In mlc-ai/tokenizers-cpp;

· Caio-lima-santos opened on Jan 7, 2025

Building for size

Status: Open.

#51 In mlc-ai/tokenizers-cpp;

· stellaraccident opened on Nov 26, 2024