Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support for files/pipes as input instead of just text #58

Open
jkutlusan opened this issue Apr 8, 2021 · 0 comments
Open

Support for files/pipes as input instead of just text #58

jkutlusan opened this issue Apr 8, 2021 · 0 comments

Comments

@jkutlusan
Copy link

I would like to process large files which contain JSON objects separated by CRLF.

I would like to start iterating over the objects, as processed by jq, before reading the whole file into memory. As far as I understand, the command-line form of jq produces results in this case as the data is piped in from stdin, and not only when the pipe has been closed.

Would this be possible to implement in jq.py by giving an open file, a TextInputWrapper, or maybe a file name? Am I wrong about jq not processing the whole file before producing results in this case? If it is not possible to implement, what are the barriers to this?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant