Skip to content

Skywork 团队有兴趣推出一个 7B 的蒸馏版本以支持推测采样和低资源设备推理吗? #49

@tq-xyy

Description

@tq-xyy

如题,据我所知,隔壁 CausalLM/7B 已经搞了,他们用的知识蒸馏的方法。

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions