Skip to content

Change default full-state checkpoint behavior to 'overwrite' #387

@JamesKunstle

Description

@JamesKunstle

Currently, we keep all full-state checkpoints and hf_format checkpoints. This uses a lot of storage for the sake of resumeability. Instead, we could have the same outcome behavior if we only kept the most recent full-state checkpoint. Keeping all checkpoints could be additional configuration.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions