Optimized batch processing in eval_model() with parallel execution#612

Open

pramod-lp wants to merge 1 commit intodeepseek-ai:mainfrom pramod-lp:dev-Optimized-batch-processing

+11-9

Commits on Jan 29, 2025

Optimized batch processing in eval_model() with parallel execution- Replaced sequential loop with ThreadPoolExecutor for parallel execution.- Applied changes in (line 70) and (line 110).- Improved …
pramod-lp
committed