Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

memmap support #4

Open
j6k4m8 opened this issue May 21, 2018 · 1 comment
Open

memmap support #4

j6k4m8 opened this issue May 21, 2018 · 1 comment

Comments

@j6k4m8
Copy link
Owner

j6k4m8 commented May 21, 2018 

jque("path/to/data.json", memmap=True)

Should leave the data on disk and lazy-load as needed to save on RAM usage.

Only works with filepath load option.
@j6k4m8 j6k4m8 mentioned this issue May 21, 2018
Closed
@j6k4m8
Copy link
Owner Author

j6k4m8 commented Sep 20, 2020

I thiiiiiink I want to replace this with dask dataframe support, and offload the swappery to dask. This also gets parallelism for free, which is cute...

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@j6k4m8