modelbox单元报错 RuntimeError: ACL stream synchronize failed, error code:507035

[2023-12-25 15:46:14,442][ INFO][         infer.py:129 ] 【batch_process】 get input list of length 47
[2023-12-25 15:46:14,450][ INFO][session_context.cc:44  ] session context finish se id:eaab5992-1fde-422c-a337-3a45c9927f8b
EH9999: Inner Error!
        rtStreamSynchronizeWithTimeout execute failed, reason=[vector core exception][FUNC:FuncErrorReason][FILE:error_message_manage.cc][LINE:50]
EH9999  synchronize stream failed, runtime result = 507035[FUNC:ReportCallError][FILE:log_inner.cpp][LINE:161]
        TraceBack (most recent call last):

EH9999: Inner Error!
        rtStreamSynchronizeWithTimeout execute failed, reason=[vector core exception][FUNC:FuncErrorReason][FILE:error_message_manage.cc][LINE:50]
EH9999  synchronize stream failed, runtime result = 507035[FUNC:ReportCallError][FILE:log_inner.cpp][LINE:161]
        TraceBack (most recent call last):

[2023-12-25 15:46:14,453][ INFO][session_context.cc:40  ] session context start se id:4b0f0929-8047-4594-8688-cc25009f8a89
[2023-12-25 15:46:14,456][ INFO][session_context.cc:40  ] session context start se id:222e7b22-cb48-4502-9748-98d48f32317f
Traceback (most recent call last):
  File "/root/projects/model_infer/src/flowunit/infer/infer.py", line 108, in process
    self.batch_process(in_data, out_data)
  File "/root/projects/model_infer/src/flowunit/infer/infer.py", line 143, in batch_process
    text_feats = self.do_infer(texts)
  File "/root/projects/model_infer/src/flowunit/infer/infer.py", line 119, in do_infer
    tokens = tokens.to(self.device)
  File "/usr/local/lib/python3.7/site-packages/transformers/tokenization_utils_base.py", line 772, in to
    self.data = {k: v.to(device=device) for k, v in self.data.items()}
  File "/usr/local/lib/python3.7/site-packages/transformers/tokenization_utils_base.py", line 772, in <dictcomp>
    self.data = {k: v.to(device=device) for k, v in self.data.items()}
  File "/usr/local/lib64/python3.7/site-packages/torch_npu/utils/device_guard.py", line 45, in wrapper
    return func(*args, **kwargs)
  File "/usr/local/lib64/python3.7/site-packages/torch_npu/utils/tensor_methods.py", line 88, in _to
    return torch_npu._C.to(self, *args, **kwargs)
RuntimeError: ACL stream synchronize failed, error code:50703

华为npu错误码