-
Notifications
You must be signed in to change notification settings - Fork 9
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merge master about 6.6(7ec73fd) #262
Merge master about 6.6(7ec73fd) #262
Conversation
ref tikv#12876 Signed-off-by: Wenbo Zhang <[email protected]> Signed-off-by: Zwb <[email protected]> Co-authored-by: Ti Chi Robot <[email protected]>
ref tikv#12842 a few panic fix 1) update_approximate_raft_log_size may run into divid by zero error 2) appy_delete may have None write_batch 3) StoreMeta::set_region may run into region corruption error if it's destroyed and re-created. 4) TabletSnapManager's snapshot size calculation may throw Other error. Signed-off-by: qi.xu <[email protected]> Signed-off-by: Jay Lee <[email protected]> Co-authored-by: qi.xu <[email protected]> Co-authored-by: Jay Lee <[email protected]> Co-authored-by: Ti Chi Robot <[email protected]>
…13995) ref tikv#12842 Whenever timeout, the peer will check for unapplied logs whether there are pending conf change and trigger heavy reads. So we wait till most logs are applied before ticking. It also fix following issues: - PersistenceListener is not installed - implementation of persisted_apply_index is wrong - parse tablet name is wrong Signed-off-by: Jay Lee <[email protected]>
ref tikv#12842 Signed-off-by: bufferflies <[email protected]>
close tikv#13997 Support to use evict_entry_cache when restart node. Signed-off-by: tabokie <[email protected]> Signed-off-by: hongyunyan <[email protected]> Signed-off-by: Xinye Tao <[email protected]> Signed-off-by: Jay Lee <[email protected]> Signed-off-by: Wenbo Zhang <[email protected]> Signed-off-by: Zwb <[email protected]> Co-authored-by: Xinye Tao <[email protected]> Co-authored-by: Jay <[email protected]> Co-authored-by: Zwb <[email protected]> Co-authored-by: Ti Chi Robot <[email protected]>
ref tikv#12842 The API is supposed to be used with `append` but nowhere can we find the clue. This PR merges `cut_logs` and `append` to reduce confusion and mistakes. Signed-off-by: Jay Lee <[email protected]> Co-authored-by: Ti Chi Robot <[email protected]>
ref tikv#12842 Publish tablet in apply thread is unsafe. This PR moves the operation to raftstore. It also fixes the issues that applying two splits at a time can cause panic. It also makes sure cache will be cleared after tablet is published. Signed-off-by: Jay Lee <[email protected]>
ref tikv#12842 These two are helpers to utilize the static KV pairs in logger. In the past, we use `logger.list()` to try to format the configured KV pairs, but it will not work as values are omitted. Signed-off-by: Jay Lee <[email protected]> Co-authored-by: Ti Chi Robot <[email protected]>
ref tikv#13730 Introduce priority-based channel Signed-off-by: Connor1996 <[email protected]> Co-authored-by: Ti Chi Robot <[email protected]>
ref tikv#12842 When the tablet contains dirty data right after split, generating snapshot may just a waste. On the other hand, split usually happens on all peers, so delay it a bit actually makes all peers more likely to be initialized by split. So this PR rejects generating snapshot when it detects it still has dirty data. Signed-off-by: Jay Lee <[email protected]> Co-authored-by: Ti Chi Robot <[email protected]>
ref tikv#12842 Signed-off-by: Jay Lee <[email protected]>
ref tikv#12842 1. store heartbeat should add snapshot and kv engine used size Signed-off-by: bufferflies <[email protected]> Co-authored-by: Xinye Tao <[email protected]>
close tikv#13977 Signed-off-by: tabokie <[email protected]>
ref tikv#12842 Make apply adaptive to reduce high tail latency. Signed-off-by: Jay Lee <[email protected]> Co-authored-by: Ti Chi Robot <[email protected]>
ref tikv#12842 - add water metrics - fix potential panic when destroying a peer - fix incorrect store size Signed-off-by: Jay Lee <[email protected]>
* util: Fix incorrect memory capacity Signed-off-by: Wish <[email protected]> * Fix lints Signed-off-by: Wish <[email protected]> * Check capacity with /proc/meminfo Signed-off-by: Wish <[email protected]> Signed-off-by: Wish <[email protected]>
* hotfix kvproto for global config Signed-off-by: husharp <[email protected]> * make format happy Signed-off-by: husharp <[email protected]> Signed-off-by: husharp <[email protected]> Co-authored-by: Ti Chi Robot <[email protected]>
ref tikv#13730 Signed-off-by: glorv <[email protected]>
…ock request (tikv#14037) close tikv#14038, close pingcap/tidb#40114 Fixes the problem that when handling repeated acquire_pessimistic_lock requests is recevied, should_not_exist is ignored. TiKV provides idempotency for these RPC requests, but for acquire_pessimistic_lock, it ignored the possibility that the client may expect a pessimistic_rollback between two acquire_pessimistic_lock request on the same key. In this case the second request may come from another statement and carries `should_not_exist` that wasn't set in the previously finished pessimistic lock request. If the first request successfully acquired the lock and the pessimistic_rollback failed, TiKV may return a sucessful response, making the client believe that the key doesn't exist before. In some rare cases, this has risk to cause data inconsistency. Signed-off-by: MyonKeminta <[email protected]> Co-authored-by: Ti Chi Robot <[email protected]>
ref tikv#12842 This PR fixes several bugs and metrics: - Now waterfall timer will be reset in before_write, the goal is to solve the confusion that stall writes can pollute the whole waterfall metrics. - Perf context is changed not to be associated with engine instance. Perf context is thread local and instance independent under the hook. - Fix flushed index advance failure due to suspicious flush. - Support print long uncommitted logs and fix incorrect commit time Signed-off-by: Jay Lee <[email protected]> Co-authored-by: Ti Chi Robot <[email protected]>
ref tikv#12842 Move transaction related code to txn_ext.rs. Fix the bug that snapshot doesn't set term and extra_op. Signed-off-by: Jay Lee <[email protected]>
ref tikv#12842 1) add snapshot apply metrics 2) disable bloomfilter for raftkv-v2 for now until a proper ratio is found 3) disable rocksdb write stall for raftkv-v2 until the tablet flow control is fully verified. Signed-off-by: Qi Xu <[email protected]> Co-authored-by: Qi Xu <[email protected]>
ref tikv#12876 fix witness raft log gc panic and refactor Signed-off-by: Wenbo Zhang <[email protected]> Co-authored-by: Xinye Tao <[email protected]>
ref tikv#12999 copr: support handling keyspace request Signed-off-by: iosmanthus <[email protected]>
ref tikv#13730 Support priority-based scheduling for the scheduler worker pool. Signed-off-by: Connor1996 <[email protected]> Co-authored-by: Xinye Tao <[email protected]>
ref tikv#11312 Fix `make docker`. Signed-off-by: tabokie <[email protected]>
close tikv#14063 make sure kvproto compatibility Signed-off-by: husharp <[email protected]>
ref tikv#12842 Signed-off-by: tabokie <[email protected]>
close tikv#14071 Log backup would aware TLS certifications changing. Signed-off-by: hillium <[email protected]>
close tikv#14069 Signed-off-by: YangKeao <[email protected]> Co-authored-by: Ti Chi Robot <[email protected]>
* support switch witness ref tikv#12876 Signed-off-by: Wenbo Zhang <[email protected]> * add switch witness api for test_pd_client ref tikv#12876 Signed-off-by: Wenbo Zhang <[email protected]> * pd heartbeat resp support switch witness ref tikv#12876 Signed-off-by: Wenbo Zhang <[email protected]> * update region epoch ref tikv#12876 Signed-off-by: Wenbo Zhang <[email protected]> * fix write apply state race ref tikv#12876 Signed-off-by: Wenbo Zhang <[email protected]> * remove unnecessary code ref tikv#12876 Signed-off-by: Wenbo Zhang <[email protected]> * add back test_witness_conf_change ref tikv#12876 Signed-off-by: Wenbo Zhang <[email protected]> * add some tests ref tikv#12876 Signed-off-by: Wenbo Zhang <[email protected]> * avoid test failures ref tikv#12876 Signed-off-by: Wenbo Zhang <[email protected]> * address comments ref tikv#12876 Signed-off-by: Wenbo Zhang <[email protected]> * address comments ref tikv#12876 Signed-off-by: Wenbo Zhang <[email protected]> * address comments ref tikv#12876 Signed-off-by: Wenbo Zhang <[email protected]> * address comments ref tikv#12876 Signed-off-by: Wenbo Zhang <[email protected]> * a few refactor ref tikv#12876 Signed-off-by: Wenbo Zhang <[email protected]> * add witness election priority and address comments ref tikv#12876 Signed-off-by: Wenbo Zhang <[email protected]> * clean code ref tikv#12876 Signed-off-by: Wenbo Zhang <[email protected]> * address comments ref tikv#12876 Signed-off-by: Wenbo Zhang <[email protected]> * address comments ref tikv#12876 Signed-off-by: Wenbo Zhang <[email protected]> * fix tests failed caused by cfg ref tikv#12876 Signed-off-by: Wenbo Zhang <[email protected]> * fix test failed caused by mistake modify ref tikv#12876 Signed-off-by: Wenbo Zhang <[email protected]> * adjust priority after snapshot persisted ref tikv#12876 Signed-off-by: Wenbo Zhang <[email protected]> * address comments ref tikv#12876 Signed-off-by: Wenbo Zhang <[email protected]> * notify pd after switch witness as region changed ref tikv#12876 Signed-off-by: Wenbo Zhang <[email protected]> * define a new backoff error for witness ref tikv#12876 Signed-off-by: Wenbo Zhang <[email protected]> * fix panic caused by applygap ref tikv#12876 Signed-off-by: Wenbo Zhang <[email protected]> * forbid transfer leader to non-witness waiting data ref tikv#12876 Signed-off-by: Wenbo Zhang <[email protected]> * update kvproto ref tikv#12876 Signed-off-by: Wenbo Zhang <[email protected]> * fix two panics ref tikv#12876 Signed-off-by: Wenbo Zhang <[email protected]> * retry request snapshot ref tikv#12876 Signed-off-by: Wenbo Zhang <[email protected]> * retry to request snaphost after term change ref tikv#12876 Signed-off-by: Wenbo Zhang <[email protected]> * update kvproto comment ref tikv#12876 Signed-off-by: Wenbo Zhang <[email protected]> Signed-off-by: Wenbo Zhang <[email protected]> Signed-off-by: Zwb <[email protected]> Co-authored-by: Xinye Tao <[email protected]>
close tikv#13983 - add etcd mock for pd - add service for resource group Signed-off-by: husharp <[email protected]> Co-authored-by: Ti Chi Robot <[email protected]>
ref tikv#13730 Support priority-based scheduling for the apply batch system. Signed-off-by: Connor1996 <[email protected]>
|
close tikv#13586, close tikv#13752, ref tikv#14017 Signed-off-by: Andrei Dragus <[email protected]>
…#14087) close tikv#14086 PD_REQUEST_HISTOGRAM_VEC can be changed to use static metrics to improve performance. Signed-off-by: husharp <[email protected]> Co-authored-by: Ti Chi Robot <[email protected]>
Signed-off-by: CalvinNeo <[email protected]>
ref tikv#13936 Signed-off-by: Zhi Qi <[email protected]>
…ikv#14088) close tikv#14045 - Store the flashback `start_ts` in region meta. - Allow the read request with a smaller ts during flashback. Signed-off-by: JmPotato <[email protected]> Co-authored-by: Ti Chi Robot <[email protected]>
…ata. (tikv#14046) ref tikv#12999 import: sst_importer support download SST and rewrite into keyspace data. Signed-off-by: iosmanthus <[email protected]>
What problem does this PR solve?
Issue Number: close #xxx
Problem Summary:
This PR is to adopt Flashback fix:
Origin 453b9df.
What is changed and how it works?
Check List
Tests
Side effects
Documentation
Release note