Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

live update on hdfstores in blaze server #53

Open
hhuuggoo opened this issue Jan 30, 2015 · 1 comment
Open

live update on hdfstores in blaze server #53

hhuuggoo opened this issue Jan 30, 2015 · 1 comment
Milestone

Comments

@hhuuggoo
Copy link

@mrocklin @jreback

I would like to augment the blaze server so that if someone updates an hdfstore, the blaze server can do compute on the updated file.

Here is my plan, I'd like your feedback on it

  • subclass hdfstore such that if timestamps change, the pytables file handle will be reopened if it's stale
  • add an entry to resource to return this subclass

(maybe we call it livehdfstore?)

The other option is to look for a kwarg in the resource call (live=True?) and dispatch based on that to either the original hdfstore, or the subclass?

@mrocklin
Copy link
Member

I like this solution because it doesn't require any special casing within blaze or into code. One can create a new resource function externally with either the new protocol or with the old protocol and a slightly higher priority.

@cpcloud cpcloud modified the milestones: 0.3.1, 0.3.2 Mar 6, 2015
@cpcloud cpcloud modified the milestone: 0.3.2 Mar 19, 2015
@cpcloud cpcloud modified the milestone: Someday Jun 22, 2015
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants