Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Only send changed files to graders #33

Open
Tracked by #7
lainets opened this issue Apr 18, 2023 · 0 comments
Open
Tracked by #7

Only send changed files to graders #33

lainets opened this issue Apr 18, 2023 · 0 comments
Labels
enhancement New feature or request

Comments

@lainets
Copy link
Contributor

lainets commented Apr 18, 2023

Instead of sending all files to graders after an update, detect which files have changed and only send those.

Requires:

  1. Asking the grader what version(s) of the course it has to make sure git manager comparing the files against the same version.
  2. Support for querying the course version(s) and only uploading the changed files on the MOOC-grader

The change detection can be easily done using rsync, as it can be made to output a list of changed files. However, there is a problem order of operations problem: we do not want to move the files to store before we know that the graders will accept the config but we need to rsync before sending the configs to see which files have changed. We could rsync beforehand anyway and just delete the stored version (and copy the published version back as a base for rsync later) if a grader doesn't approve it. Rsync probably also has a dryrun option but this could be pretty slow. Another option is to send configs to the grader first, then rsync and then send any additional changed files but this would complicate the process quite a bit.

@lainets lainets added the enhancement New feature or request label Aug 29, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant