safetensors_rust.SafetensorError: Error while deserializing header: InvalidHeaderDeserialization

#7
by alxemade - opened

safetensors_rust.SafetensorError: Error while deserializing header: InvalidHeaderDeserialization。

model = AutoModel.from_pretrained(
    path,
    torch_dtype=torch.bfloat16,
    low_cpu_mem_usage=True,
    use_flash_attn=True,
    trust_remote_code=True).eval().cuda()

Sign up or log in to comment