Skip to content

Integration test for small transformer from scratch #1276

Open
@mattdangerw

Description

@mattdangerw

As discussed on #1270, we might want to add a small integration test that builds a transformer from scratch using our blocks and runs a small amount of training on it.

We would want to assert that our loss is finite and decreasing.

Metadata

Metadata

Assignees

No one assigned

    Labels

    infrateam-createdIssues created by Keras Hub team as part of development roadmap.type:featureNew feature or request

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions