Skip to content

Release v0.6.0
Compare
Choose a tag to compare
@lidongze0629 lidongze0629 released this 06 Aug 09:17
· 1903 commits to main since this release
v0.6.0
d0a7daf

We are glad to announce the release of GraphScope 0.6.0

This major release integrates a new graph interactive engine GAIA, which supports efficient parallel execution and bounded-memory execution for gremlin queries. More technical details of GAIA can refer to our published blog. Note that currently the integration of GAIA with GraphScope is experimental, and is not recommended for production use yet!

In addition, this release improves the experience of local deployment on macOS, Ubuntu, and CentOS, and adds more graph analytics algorithms.

We highlight the following improvements included in this release:

  1. Integrate GAIA, a graph interactive query engine, into GraphScope. Currently, it has supported the following features/functions:

    • Dynamic memory management for arbitrary graph traversal with ensuring bounded use of memory.
    • Automatic and adaptive strategy for optimizing Gremlin traversals, such as hybrid DFS/BFS traversal to balance parallelism and memory usage.
    • Early-stop optimization for Gremlin (limit, nested conditional, etc.) to minimize wasted computation.
    • Improvement of performance and scalability. (A new LDBC Social Network Benchmark will be released around year-end).
    • Support both Vineyard and the new persistent graph store.

  2. Lazy evaluation support for graph interactive engine and graph learning engine.

  3. A script supporting local deployment on macOS, Ubuntu, and CentOS.

  4. Add more graph analytics algorithms as built-in applications.

Commits

  • [032ed99]: Reorganize the scripts for GIE launching (#581) (Weibin Zeng)
  • [eb71eef]: Add glossory to analytics_engine.rst (#657) (Siyuan Zhang)
  • [1d0632a]: Add unit tests for gnn store ffi. (#654) (GoldenLeaves)
  • [1af190b]: Add gremlin test (#644) (tianliplus)
  • [a383bbc]: Upgrade to vineyard v0.2.6. (#655) (Tao He)
  • [e2987fa]: Open CI of Vineyard X [Maxgraph + GAIA] (#633) (Siyuan Zhang)
  • [36d7bc4]: [Bug Fix] Fix bugs in CI of GAIA on Vineyard (#652) (BingqingLyu)
  • [4fe934a]: Fix broken hadoop link (#651) (tianliplus)
  • [59703c8]: fix (#648) (tianliplus)
  • [b2363f2]: Fix bugs of negative vertex id (#640) (BingqingLyu)
  • [007a7a1]: Store ffi for GNN (#638) (tianliplus)
  • [2393760]: Open GraphScope Store GAIA test (#597) (Siyuan Zhang)
  • [1998c81]: Fix data load (#627) (tianliplus)
  • [b114ce2]: [Bug Fix]: add u128 in Primitive in Object (#628) (BingqingLyu)
  • [b264c4c]: [Bug Fix]: fix bug in path().count() (#629) (BingqingLyu)
  • [c4a7720]: bug fix (#615) (tianliplus)
  • [d546038]: [script] Add scripts for starting GAIA on vineyard (#604) (BingqingLyu)
  • [d902f12]: remove pb gen (#601) (tianliplus)
  • [1f62da3]: [script] Start GAIA executor on Vineyard (#600) (BingqingLyu)
  • [b3b3a87]: [networkx] Implement is_simple_path app in GraphScope (#471) (MJY-HUST)
  • [576d8b8]: [Bug Fix] GAIA executor with vineyard (#598) (BingqingLyu)
  • [e47915f]: add additional pegasus config for benchmark (#587) (shirly121)
  • [90ac841]: [GAIA & Store Adapter] Support parallel scan in GAIA, and adapt to v2 and vineyard respectively (#592) (BingqingLyu)
  • [fefffbd]: [GAIA] Start GAIA executor with vineyard store (#595) (BingqingLyu)
  • [99aca1c]: Update deploy_local.sh: add CentOS support and more robust (#562) (Weibin Zeng)
  • [19f7d0b]: add vineyard adaptor (#590) (shirly121)
  • [d1e935e]: Add config matrix for testing with/without GAIA in CI (#572) (Siyuan Zhang)
  • [8b06008]: divide store (#579) (tianliplus)
  • [3de9a7a]: Add gaia compiler adaptor into V2 to fix dependency issue (#576) (shirly121)
  • [ec4caff]: Fix session.close for local test (#573) (DongZe Li)
  • [e84765f]: Fix local CI by catching exception in sess.close (#571) (DongZe Li)
  • [0a7cd8f]: [store_adapter] Adapt Partitioner for vineyard on Read Path (#560) (BingqingLyu)
  • [6ff99b5]: Lazy mode support for GIE/GLE engine (#513) (DongZe Li)
  • [076268d]: Create CODE_OF_CONDUCT.md (#567) (Jingbo Xu)
  • [66bdc55]: Realtime write server impl (#557) (tianliplus)
  • [a8c5d12]: Use the same etcd prefix when launching vineyard from multiple engines. (#559) (Tao He)
  • [685965e]: Install the inplace vineyard-io as well. (#558) (Tao He)
  • [9fdb14f]: Simplify local ci with matrix.os (#556) (Weibin Zeng)
  • [ff23d9a]: Add CI test for GAIA compiler (#552) (shirly121)
  • [76cbcee]: Revise deploy_local.sh and update local ci with deploy_local.sh (#555) (Weibin Zeng)
  • [626a105]: Fix edge result (#549) (shirly121)
  • [26436e9]: [WIP] Realtime write api (#553) (tianliplus)
  • [d2ab259]: Fix macOS ci: change to llvm 8 (#554) (Weibin Zeng)
  • [1f7588a]: Fix gss test bugs (#548) (shirly121)
  • [85432f6]: Unify rpc api (#547) (shirly121)
  • [338da43]: add realtime_write proto (#546) (tianliplus)
  • [ca65eda]: implement GraphStoreService api for maxgraph && add snapshot (#537) (shirly121)
  • [e28c441]: checkin store v2 interface (#543) (tianliplus)
  • [e280e59]: Revise the prepare_env.sh, more standard and user-friendly (#534) (Weibin Zeng)
  • [1f30e04]: Add a local deploy and test ci on MacOS (#512) (Weibin Zeng)
  • [af99e5b]: use gremlin api in 3.4.2 to be compatible with maxgraph (#540) (shirly121)
  • [101ab6f]: Unified Query Params for compatible with different storages (#527) (BingqingLyu)
  • [68c4cfb]: Initialize job compiler in adapter for starting engine service (#530) (BingqingLyu)
  • [3571ca4]: Separate the pytest in ci to avoid OOM (#529) (Weibin Zeng)
  • [55adea9]: [GAIA] Add storage adapter for graphscope store (#521) (BingqingLyu)
  • [ae6b8c5]: [NetworkX] add node_boundary and edge boundary app (#468) (Weibin Zeng)
  • [33a4328]: [store_adapter] refine some codes in store adapter (#519) (BingqingLyu)
  • [6fba7ca]: Doc: sections in alphabetic order. (#520) (Tao He)
  • [7660da5]: Add extra params for compatible with different storages (#508) (BingqingLyu)
  • [73e05ba]: fix reverse edge in realtime write (#510) (tianliplus)
  • [7e21a25]: Fixes the copy_class hack for argmap in networkx. (#511) (Tao He)
  • [f1da6ae]: Use a higher version git (#506) (Siyuan Zhang)
  • [d297b6b]: Set decorator>=5.0.5 since it's old version(4.4.2) may not compatible with NetworkX latest release (#507) (Weibin Zeng)
  • [8cc4f26]: Add examples for output context (#505) (Siyuan Zhang)
  • [bb9d192]: Typo: we actually use BUILD_PROGRESS rather than DOCKER_BUILD_PROGRESS. (Tao He)
  • [af373da]: fix gremlin-test for mg (#489) (tianliplus)
  • [df2cc02]: Script support local deployment in MacOS (#464) (Weibin Zeng)
  • [266ccca]: Set grpc max message length options in coordinator server side (#478) (DongZe Li)
  • [16c7766]: fix store bug (#477) (tianliplus)
  • [e35c717]: Fix string oid graph transformation bug (#467) (Weibin Zeng)
  • [c3203ac]: fix gaia server lifecycle (#474) (tianliplus)
  • [5508e6b]: Upgrade vineyard to v0.2.5 (#466) (Tao He)
  • [e0395fb]: Polymorphic ContextDAGNode to guide selector for user (#461) (DongZe Li)
  • [ba47539]: Gaia server async start (#463) (tianliplus)
  • [42575b1]: Fix bug in directed graph transformation between graphscope and nx (#454) (Weibin Zeng)
  • [7bb5a8d]: Add instructions for mount volume in mac (#457) (Siyuan Zhang)
  • [809842a]: integrate gaia to persistent store (#440) (tianliplus)
  • [6eecccd]: add mininum properties in graph/vertex step for new graph store api (#455) (shirly121)
  • [d4eac09]: Add pagerank in NetworkX version (#435) (Weibin Zeng)
  • [e76c81d]: Support with keyword in session (#451) (Siyuan Zhang)
  • [9e99de7]: add support of property name to id in logic plan (#446) (shirly121)
  • [3d42337]: [gremlin_core] remove get_partition_num() in Partitioner and refine s… (#449) (BingqingLyu)
  • [ab02736]: Fix building config for graphscope-jupyter extensions (#450) (Moyee)
  • [aa7f81d]: add interface (#448) (tianliplus)
  • [fd536d4]: add SimpleServerDetector (#438) (tianliplus)
  • [0ad8b42]: Refine gen source (#427) (BingqingLyu)
  • [675d6ad]: [graphscope] add mapping of partition id to server id in GraphPartitionManager (#431) (BingqingLyu)
  • [85ecfe9]: return address for jna (#433) (tianliplus)
  • [efb0728]: Add unload graph/app test cases for lazy mode execution (#428) (DongZe Li)
  • [f3a4850]: Set locale to utf8 (#425) (Siyuan Zhang)
  • [9009984]: Local CI: use latest vineyard (v0.2.4). (#423) (Tao He)
  • [8690da0]: refactor jna (#419) (tianliplus)
  • [6a24fa3]: Support prop_id in GAIA runtime (#421) (BingqingLyu)
  • [959c38f]: fix gremlin test case (#416) (tianliplus)
  • [a92ebe9]: refine bulk load (#413) (tianliplus)
  • [40b744f]: Add k-hop for example and benchmark (#407) (bmmcq)
  • [5686805]: Use app-version as default tag instead of latest in graphscope-store charts (#406) (Siyuan Zhang)
Assets 2
Loading