Skip to content

Commit

Permalink
Update readme
Browse files Browse the repository at this point in the history
  • Loading branch information
EricLBuehler committed Mar 6, 2024
1 parent 8464027 commit fb5d9fa
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -73,7 +73,7 @@ Rust uses a feature flag system during build to implement compile-time build opt
which may be specified using the `--features` command.
1) `cuda`
2) `metal`
3) `flash-attn`
3) `flash-attn`: Be sure to pass `--use_flash_attn`

## Preparing the X-LoRA Ordering File
The X-LoRA ordering JSON file contains 2 parts. The first is the order of the adapters and the second, the layer ordering. The layer ordering has been automatically generated and should not be manipulated as it controls the application of scalings. However the order of adapter should be replaced by an array of strings of adapter names corresponding to the order the adapters were specified during training.
Expand Down

0 comments on commit fb5d9fa

Please sign in to comment.