Skip to content

[P0] Additional intervention arguments are not saved correctly, e.g. add_bias #82

Open
@frankaging

Description

@frankaging

Descriptions:

For customizable interventions, people might want to save the interventions with their customized arguments. For instance, the dropout ratio, the activation function type or whether to add a special bias term to any projection matrix. Currently, these additional arguments are not saved.

The main change will be done in pyvene tracked by this parent PR: stanfordnlp/pyvene#157. After the parent PR is checked in, we should also verify pyreft works with updated pyvene library.

Metadata

Metadata

Assignees

Labels

bugSomething isn't working

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions