Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Gh-3322: Cache updates for federated POC #3323

Open
wants to merge 10 commits into
base: develop
Choose a base branch
from

Conversation

tb06904
Copy link
Member

@tb06904 tb06904 commented Oct 16, 2024

Few updates to how the federated store uses the cache. This allows users to specify a custom cache name for the graph cache which would enable sharing of graphs between federated stores.

This also addresses the handling of operations that technically could be handled by a federated store or by a sub graph. The overall logic has been simplified so that if an operation has graph IDs specified (or excluded) it will be assumed the operation should be run on those sub graphs.

This change has the added benefit of meaning mixing operations in the same chain e.g. for sub graphs or not, is handled seamlessly.

Related issue

@tb06904 tb06904 added enhancement Improvement to existing functionality/feature federated-store Specific to/touches the federated-store module labels Oct 16, 2024
@tb06904 tb06904 linked an issue Oct 16, 2024 that may be closed by this pull request
@tb06904 tb06904 added this to the 2.4.0 milestone Oct 16, 2024
Copy link

codecov bot commented Oct 17, 2024

Codecov Report

Attention: Patch coverage is 78.72340% with 10 lines in your changes missing coverage. Please review.

Project coverage is 67.95%. Comparing base (c8f0732) to head (330e2b3).

Files with missing lines Patch % Lines
...imple/operation/handler/SeparateOutputHandler.java 62.50% 5 Missing and 1 partial ⚠️
...v/gchq/gaffer/federated/simple/FederatedStore.java 86.66% 0 Missing and 2 partials ⚠️
...mple/operation/handler/EitherOperationHandler.java 83.33% 0 Missing and 2 partials ⚠️
Additional details and impacted files
@@              Coverage Diff              @@
##             develop    #3323      +/-   ##
=============================================
+ Coverage      67.90%   67.95%   +0.04%     
- Complexity      2596     2597       +1     
=============================================
  Files            953      955       +2     
  Lines          30498    30530      +32     
  Branches        3363     3369       +6     
=============================================
+ Hits           20710    20746      +36     
+ Misses          8312     8306       -6     
- Partials        1476     1478       +2     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

cn337131
cn337131 previously approved these changes Oct 21, 2024
p29876
p29876 previously approved these changes Oct 22, 2024
@tb06904 tb06904 dismissed stale reviews from p29876 and cn337131 via 70a9148 October 22, 2024 15:18
p29876
p29876 previously approved these changes Oct 22, 2024
cn337131
cn337131 previously approved these changes Oct 22, 2024
@tb06904 tb06904 dismissed stale reviews from cn337131 and p29876 via 330e2b3 October 22, 2024 16:15
Copy link

sonarcloud bot commented Oct 22, 2024

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement Improvement to existing functionality/feature federated-store Specific to/touches the federated-store module
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Update cache configuration federated POC
4 participants