Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Question] 如何提升snapshot压缩/解压效率 #2116

Closed
1 task done
wuchaojing opened this issue Feb 22, 2023 · 1 comment · Fixed by #2136
Closed
1 task done

[Question] 如何提升snapshot压缩/解压效率 #2116

wuchaojing opened this issue Feb 22, 2023 · 1 comment · Fixed by #2136
Labels

Comments

@wuchaojing
Copy link
Contributor

Problem Type (问题类型)

performence (性能优化)

Before submit

  • 我已经确认现有的 IssuesFAQ 中没有相同 / 重复问题

Environment (环境信息)

  • Server Version: v1.0.0
  • Backend: RocksDB x nodes, HDD or SSD
  • OS: xx CPUs, xx G RAM, Centos 7.x
  • Data Size: xx vertices, xx edges

Your Question (问题描述)

raft模式,且开启snapshot功能,发现每次执行snapshot的时候耗时都很长
2023-02-22 00:56:26 [store-snapshot-executor2] [INFO] o.a.h.b.s.r.StoreSnapshotFile - Compressed dir '/xxx/snapshot_rocksdb_data' to '/xxx/raft-log/snapshot/temp/snapshot_rocksdb_data.zip', took 1575.661 seconds

数据大小15G左右,耗时近半小时(解压同)。

有没有什么办法可以提高snapshot的效率吗,线上数据量几百G,snapshot的时间估计无法接受了。

Vertex/Edge example (问题点 / 边数据举例)

No response

Schema [VertexLabel, EdgeLabel, IndexLabel] (元数据结构)

No response

@github-actions
Copy link

github-actions bot commented Mar 9, 2023

Due to the lack of activity, the current issue is marked as stale and will be closed after 20 days, any update will remove the stale label

@imbajin imbajin linked a pull request Mar 31, 2023 that will close this issue
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants