Search results

transformers-CFG incompatible with gemma-3: causes tokenizer and model vocab size mismatch

Status: Open.

#127 In epfl-dlab/transformers-CFG;

· GeorgeDeac opened on Apr 9, 2025

Tokenizers not model-agnostic

Status: Open.

#122 In epfl-dlab/transformers-CFG;

· urroxyz opened on Mar 9, 2025

Json grammar doesn't allow array

Status: Open.

#102 In epfl-dlab/transformers-CFG;

· Saibo-creator opened on Oct 1, 2024

look into the memory leak

good first issueGood for newcomersGood for newcomers

Status: Open.

#87 In epfl-dlab/transformers-CFG;

· Saibo-creator opened on Aug 27, 2024

Bus error when running single string as input on MacOS

Status: Open.

#84 In epfl-dlab/transformers-CFG;

· Saibo-creator opened on Aug 27, 2024

remove legacy TokenTrie

Status: Open.

#67 In epfl-dlab/transformers-CFG;

· Saibo-creator opened on Jul 6, 2024

Parser doesn't seem to support left recursion

won't fix

Status: Open.

#60 In epfl-dlab/transformers-CFG;

· clache547 opened on Jun 18, 2024

UnicodeDecodeError: 'charmap' codec can't decode byte 0x81

Status: Open.

#52 In epfl-dlab/transformers-CFG;

· dhananjaybhandiwad opened on Jun 6, 2024

Refactor Request: Grammar should be put as string in the example scripts to help run directly

Status: Open.

#48 In epfl-dlab/transformers-CFG;

· Saibo-creator opened on Jun 4, 2024

Prefix Space with Llama Tokenizer

Status: Open.

#40 In epfl-dlab/transformers-CFG;

· Yuxing0610 opened on Apr 25, 2024

ValueError: All stacks are empty, so the only token accepted is EOS(2), but got 0

Status: Open.

#37 In epfl-dlab/transformers-CFG;

· Saibo-creator opened on Apr 19, 2024

colab demo for <code>tcfg</code>

simple

Status: Open.

#32 In epfl-dlab/transformers-CFG;

· Saibo-creator opened on Apr 13, 2024