Temperature for Mistral 7B (DirectML model) doesn't seem to apply in Bulk Run

[SteveJSteiner]

1. Load the Mistral 7B (DirectML model) (In this case it was loaded onto a 4090RTX .. plenty of room)
2. Click Bulk run
3. Use Load Sample Dataset
4. Run bulk run
5. Change the temperature to 0
6. Re-run bulk run ... nothing changes
7. Change the temperature to 1.5
8. re-run the bulk run ... nothing changes.

Expected: A difference in temperature should cause at least minor wording changes in the output.

[microsoft-github-policy-service]

Thank you for contacting us! Any issue or feedback from you is quite important to us. We will do our best to fully respond to your issue as soon as possible. Sometimes additional investigations may be needed, we will usually get back to you within 2 days by adding comments to this issue. Please stay tuned.

[swatDong]

@jiaxuwu2021 - could you or anyone please take a look on this DML model issue? Is temperature applied to local models?

[jiaxuwu2021]

FYI @vortex-captain

[vortex-captain]

The fix will be shipped with next release.