Skip to content

Commit

Permalink
Update mlperf.conf
Browse files Browse the repository at this point in the history
Modifying the min queries constraint for the Offline scenario.
  • Loading branch information
arjunsuresh authored and pgmpablo157321 committed Dec 12, 2023
1 parent 74c88df commit b4b71ee
Showing 1 changed file with 12 additions and 3 deletions.
15 changes: 12 additions & 3 deletions mlperf.conf
Original file line number Diff line number Diff line change
Expand Up @@ -57,10 +57,19 @@ gptj.Server.target_latency = 20000

*.Offline.target_latency_percentile = 90
*.Offline.min_duration = 600000

# In Offline scenario, we always have one query. But LoadGen maps this to
# min_sample_count internally in Offline scenario, so set this to 24576 since
# the rule requires that Offline scenario run for at least 24576 samples.
*.Offline.min_query_count = 24576
# min_sample_count internally in Offline scenario. If the dataset size is larger
# than 24576 we limit the min_query_count to 24576 and otherwise we use
# the dataset size as the limit

resnet50.Offline.min_query_count = 24576
retinanet.Offline.min_query_count = 24576
dlrm-v2.Offline.min_query_count = 24576
bert.Offline.min_query_count = 10833
gptj.Offline.min_query_count = 13368
rnnt.Offline.min_query_count = 2513
3d-unet.Offline.min_query_count = 43

# These fields should be defined and overridden by user.conf.
*.SingleStream.target_latency = 10
Expand Down

0 comments on commit b4b71ee

Please sign in to comment.