Update evaluation and inference code to handle other precisions and models

Update evaluation and inference code to handle other precisions and models #470