[Inference] Fix multibatch inference

[DrownFish19]

Before submitting

• Lint code. If there are lint issues, please format the code first.

# Install and register `pre-commit` in the project folder
pip install pre-commit && pre-commit install

# Process previous code files separately
pre-commit run --file XXXX.py

• Add test cases into tests folder. If there are codecov issues, please add tests cases first.

PR types

Bug fixes

PR changes

Others

Description

Fix multibatch infra for Qwen2

[paddle-bot]

Thanks for your contribution!

[ZHUI]

LGTM