Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add new data set #10

Open
jsappl opened this issue May 17, 2024 · 0 comments
Open

Add new data set #10

jsappl opened this issue May 17, 2024 · 0 comments
Assignees
@elendorial

Comments

@jsappl
Copy link
Owner

jsappl commented May 17, 2024 •
edited
Loading

track with dvc, also implement new PyTorch data set and loader for it

https://www.kaggle.com/datasets/zurutech/stand-small-problems?resource=download
jsappl added a commit that referenced this issue May 17, 2024
@jsappl
feat: dvc track zipped raw data #10
42aea78
jsappl added a commit that referenced this issue May 17, 2024
@jsappl
feat: init dvc.yaml for MLOps pipeline #10
51dbfb1
jsappl added a commit that referenced this issue May 17, 2024
@jsappl
feat: repro unzip data stage in pipeline #10
bcd45f2
jsappl added a commit that referenced this issue May 17, 2024
@jsappl
feat: StAnD PyTorch data set #10
c401d3c
jsappl added a commit that referenced this issue May 17, 2024
@jsappl
refactor: dont push unzipped samples to remote #10
bf270f6 
not necessary to push 101k samples since whole archive.zip file is
already cached and on remote as well
@elendorial elendorial self-assigned this May 22, 2024
jsappl added a commit that referenced this issue May 22, 2024
@jsappl
refactor: add solution and rhs to data set #10
7ec7e41
jsappl added a commit that referenced this issue May 22, 2024
@jsappl
refactor: skip hash for extraced files #10
b245d28 
unnecessary since slows down `git` and hash of `archive.zip` is tracked
anyways
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@elendorial elendorial

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@elendorial @jsappl