Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Utilise multithreading #6

Open
aelzenaar opened this issue Jul 19, 2023 · 2 comments
Open

Utilise multithreading #6

aelzenaar opened this issue Jul 19, 2023 · 2 comments
Labels
enhancement New feature or request

Comments

@aelzenaar
Copy link
Owner

Use the power of dask and/or pandas to parallelise limit set computations.
@aelzenaar aelzenaar added this to the 0.0.99 milestone Jul 19, 2023
@aelzenaar
Copy link
Owner Author

Change *cayley_graph_mc to do every count in parallel and change coloured_limit_set_mc back to using the free_ variant, c.f. d4d6608

@aelzenaar
Copy link
Owner Author

Currently blocked by mpmath/mpmath#380 unless I can come up with a workaround for mpmath matrices not being pickleable. Perhaps converting to numpy arrays (but maybe this is too slow for the speed boost we would get)... we already need to pass the whole class GroupCache into each child process so even if I get it working it might be too much of a memory drain anyway.

@aelzenaar aelzenaar removed this from the v0.0.99 milestone Aug 7, 2023
aelzenaar added a commit that referenced this issue Aug 7, 2023
@aelzenaar
Prototype multiprocessing support
479f072 
We are blocked by issues with mpmath described in #6.
@aelzenaar aelzenaar added the enhancement New feature or request label Aug 7, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@aelzenaar