Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[EPIC] V1 #28

Open
wants to merge 83 commits into
base: master
Choose a base branch
from
Open

[EPIC] V1 #28

wants to merge 83 commits into from

Conversation

dawsbot
Copy link
Owner

@dawsbot dawsbot commented Mar 25, 2024

No description provided.

dawsbot and others added 27 commits February 5, 2024 10:01
* fix error parsing and add dynamic hostname generation\n\nadded error-parse.ts which contains a function taking in any js Error type and displays a user readable error that goes a little more in depth.\nin puppeteer-fetch-all.ts i imported the hostname function from the os library in js and put it in place for the static '127.0.0.1' previously used in openBrowser()

* revert readme.md

* revert readme

* Move from puppeteer to playwright

---------

Co-authored-by: dawsbot <[email protected]>
…n\nadded .env file that contains user log in info to automatically sign user in and await any recaptchas.\n\nbroke limit of records for each token for easier scraping and capped max records to 3000
…ss.\n\nadded automated testing in puppeteer-fetch-all.js confirmLength() to show any labels that are not being pulled correctly.\nalso ran tests to optimize scraping speed by reducing sleep periods
@dawsbot dawsbot mentioned this pull request Mar 25, 2024
* sqlite init

* Chunk all inserts

* Rename accounts repository and make address search

* Add account repository tests

* Enforce zod types stricter for db and ignore invalid addresses

* Add more account selectors

* Add db building into precommit hooks

* bun update

* force eth address to be valid eth address

* update db

* sqlite
#95)

* 📓 feat: added loadAllTokensFromFS() and updated the address api so it will search accounts & tokens for addresses

* insert tokens to sqlite

* add new types and sqlite3

---------

Co-authored-by: dawsbot <[email protected]>
* move to sqlite source of truth

* Use native bun test runner

* more cleanup

* no more vitest

* Remove your database

* Bump deps

* bump more deps

* Remove extra csv duplicates

* Add latest sqlite

* Add back data

* new csv

* Strict csv orodering

* make csv and json files

* Delete markdown magic

* Remove old data
* Add endpoint to fetch all labels

* unit test labels endpoint
* remove all browser related code

* Uninstall playwright

* pull most of etherscan full tokens

* cleanup

---------

Co-authored-by: Kyle w <[email protected]>
* [ REVIEW ] - draft api search with custom params

* add search by symbol to tokens

* fix variable names

* remove console logs

* add unit tests

* fix case sensetivity for search and remove console logs

* add elysia query typing
fix broken tests

---------

Co-authored-by: Kyle w <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants