.Net After updating to .5, Phi3.5Mini outputs some meaningless characters

[strikene]

Window11 24H2Ltsc .netCore 8 cuda Model:Phi-3.5-mini-instruct-onnx\cuda\cuda-int4-awq-block-128

We have a sample dialog to test the output.

in 0.4
Phi3.5 output
"I dont know"

In 0.5.2

Code

In 0.5.2 Qwen2 It will also output some meaningless exclamation points，
Qwen2 Model Qwen2-1.5B

We made the conversion with reference to the link parameter Int4 Cuda
Qwen2 output