New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Make the transformer model run on upmem #24

Draft

ge0mk wants to merge 1 commit into tud-ccc:main from ge0mk:transformer

Collaborator

ge0mk commented Oct 14, 2024 •

edited

Loading

Todos:

Fix reduction result gather on upmem (can't copy less than 8 bytes) either
- with padding (need to remove padding in upmemrt_dpu_gather) or
- by doing multiple reductions per tasklet to generate enough results to fill 8 bytes
remove the generated files in the samples directory when everything works (they are for debugging & easy testing on the upmem machine)

ge0mk force-pushed the transformer branch 11 times, most recently from c2337c1 to b6a626b Compare

October 20, 2024 23:27

ge0mk force-pushed the transformer branch 3 times, most recently from 82f6c46 to 5483b45 Compare

November 25, 2024 11:38


          make the transformer model run on upmem (wip)

6443aa6

ge0mk force-pushed the transformer branch from 5483b45 to 6443aa6 Compare

November 25, 2024 12:15

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet