NoneType object has no attribute set_input_shape

[cpken]

更新了今天（2025-01-10）最新的代码与模型（CosyVoice2-0.5B），我运行的是多线程方式。

import multiprocessing as mp
from cosyvoice.cli.cosyvoice import CosyVoice, CosyVoice2

def worker_process():
···
    model_id = "pretrained_models/CosyVoice2-0.5B"
    CosyVoiceModel = CosyVoice2(model_id, load_jit=False, load_trt=True, fp16=True)
····

processes = []
    for _ in range(3):
        p = mp.Process(target=worker_process)
        p.start()
        processes.append(p)

    for p in processes:
        p.join()

在运行 CosyVoiceModel.inference_cross_lingual(tts_text, prompt_speech_16k) 后报错如下

<class 'AttributeError'>:'NoneType' object has no attribute 'set_input_shape'

感谢。

[aluminumbox]

改成了在线导出tensorrt模型，先启动一个线程，导出成功后，再启动其他线程

[cpken]

解决方案

import threading
import multiprocessing as mp
from funasr import AutoModel
from cosyvoice.cli.cosyvoice import CosyVoice, CosyVoice2
import asyncio
import os
from loguru import logger

async def main(pid, logger):
    pass

def export_tensorrt_model():
    """导出 TensorRT 模型的代码"""
    global SenseVoiceModel
    global CosyVoiceModel
    SenseVoiceModel = AutoModel()
    CosyVoiceModel = CosyVoice2(model_id, load_jit=False, load_trt=False, fp16=False)

def worker_process():
    # 启动一个线程来导出 TensorRT 模型
    export_thread = threading.Thread(target=export_tensorrt_model)
    export_thread.start()
    export_thread.join()  # 等待导出完成
    asyncio.run(main(os.getpid(), logger))


if __name__ == "__main__":
    processes = []
    for _ in range(SUB_PROCESS):
        p = mp.Process(target=worker_process)
        p.start()
        processes.append(p)

    for p in processes:
        p.join()

但是我如果这样子写，依然会报错

CosyVoiceModel = CosyVoice2(model_id, load_jit=False, load_trt=True, fp16=False)

不加载 load_trt 不会报错：

CosyVoiceModel = CosyVoice2(model_id, load_jit=False, load_trt=False, fp16=True)

[cpken]

改成了在线导出tensorrt模型，先启动一个线程，导出成功后，再启动其他线程

尝试改了代码，是 load_trt=True 的问题导致的，并且我在测试的时候，多线程没有一次成功的。

<class 'AttributeError'>:'NoneType' object has no attribute 'set_input_shape'