Skip to content

Commit

Permalink
Merge pull request #303 from mlcommons/arjunsuresh-patch-2
Browse files Browse the repository at this point in the history
Update inference_rules.adoc | Add rule specific to RGAT
  • Loading branch information
mrmhodak authored Dec 10, 2024
2 parents 679e15d + f400723 commit daef2a6
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion inference_rules.adoc
Original file line number Diff line number Diff line change
Expand Up @@ -757,7 +757,7 @@ The following techniques are disallowed:
downsampling inputs and kernels for the first convolution.

* Techniques that only improve performance when there are identical
samples in a query. For example, sorting samples in SSD.
samples in a query. For example, sorting samples in SSD and R-GAT.

* Speculative decoding for auto-generative language models (i.e. using a smaller model to predict the next token for the reference model).

Expand Down

0 comments on commit daef2a6

Please sign in to comment.