Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fail to add unique key using global sort in large data #59725

Closed
CbcWestwolf opened this issue Feb 25, 2025 · 0 comments · Fixed by #59613
Closed

Fail to add unique key using global sort in large data #59725

CbcWestwolf opened this issue Feb 25, 2025 · 0 comments · Fixed by #59613
Labels
affects-8.1 This bug affects the 8.1.x(LTS) versions. affects-8.5 This bug affects the 8.5.x(LTS) versions. component/ddl This issue is related to DDL of TiDB. severity/major type/bug The issue is confirmed as a bug.

Comments

@CbcWestwolf
Copy link
Member

Bug Report

Please answer these questions before submitting your issue. Thanks!

1. Minimal reproduce step (Required)

Add unique key using global sort in large data

2. What did you expect to see? (Required)

Succeed

3. What did you see instead (Required)

[2025/02/18 10:05:47.292 +00:00] [ERROR] [task_executor.go:344] ["run subtask failed"] [task-id=30001] [task-type=backfill] [error="insufficient bytes to decode value"] [errorVerbose="insufficient bytes to decode value
github.com/pingcap/tidb/pkg/lightning/common.DupDetectKeyAdapter.Decode
    /workspace/source/tidb/pkg/lightning/common/key_adapter.go:91
github.com/pingcap/tidb/pkg/lightning/backend/external.(*Engine).GetRegionSplitKeys
    /workspace/source/tidb/pkg/lightning/backend/external/engine.go:470
github.com/pingcap/tidb/pkg/lightning/backend/local.getRegionSplitKeys
    /workspace/source/tidb/pkg/lightning/backend/local/local.go:885
github.com/pingcap/tidb/pkg/lightning/backend/local.(*Backend).ImportEngine
    /workspace/source/tidb/pkg/lightning/backend/local/local.go:1327
github.com/pingcap/tidb/pkg/ddl.(*cloudImportExecutor).RunSubtask
    /workspace/source/tidb/pkg/ddl/backfilling_import_cloud.go:145
github.com/pingcap/tidb/pkg/disttask/framework/taskexecutor.(*BaseTaskExecutor).runSubtask.func1
    /workspace/source/tidb/pkg/disttask/framework/taskexecutor/task_executor.go:460
github.com/pingcap/tidb/pkg/disttask/framework/taskexecutor.(*BaseTaskExecutor).runSubtask
    /workspace/source/tidb/pkg/disttask/framework/taskexecutor/task_executor.go:461
github.com/pingcap/tidb/pkg/disttask/framework/taskexecutor.(*BaseTaskExecutor).Run
    /workspace/source/tidb/pkg/disttask/framework/taskexecutor/task_executor.go:339
github.com/pingcap/tidb/pkg/disttask/framework/taskexecutor.(*Manager).startTaskExecutor.func2
    /workspace/source/tidb/pkg/disttask/framework/taskexecutor/manager.go:377
github.com/pingcap/tidb/pkg/util.(*WaitGroupWrapper).RunWithLog.func1
    /workspace/source/tidb/pkg/util/wait_group_wrapper.go:181
runtime.goexit
    /root/go/pkg/mod/golang.org/[email protected]/src/runtime/asm_amd64.s:1700"]

4. What is your TiDB version? (Required)

master

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
affects-8.1 This bug affects the 8.1.x(LTS) versions. affects-8.5 This bug affects the 8.5.x(LTS) versions. component/ddl This issue is related to DDL of TiDB. severity/major type/bug The issue is confirmed as a bug.
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant