test: add semhash tests for data deduplication

[User235514]

Description

• Add tests for single dataset deduplication
• Add tests for cross-dataset deduplication
• Add tests for multi-column dataset deduplication
• Add tests for custom encoders and pandas integration
• Ensure that the semhash dependency is added to the project.
• Note: I was unable to successfully add semhash through Poetry when submitting this code, so the reviewer will need to add it manually.

Motivation and Context

close #1444

Types of changes

• Bug fix (non-breaking change which fixes an issue)
• New feature (non-breaking change which adds core functionality)
• Breaking change (fix or feature that would cause existing functionality to change)
• Documentation (update in the documentation)
• Example (update in the folder of example)

Checklist

• I have read the CONTRIBUTION guide. (required)
• My change requires a change to the documentation.
• I have updated the tests accordingly. (required for a bug fix or a new feature)
• I have updated the documentation accordingly.

[Wendong-Fan]

hey @User235514 , thanks for the contribution! Seem this PR only contains the test code, we need the core functionality code to check the test, could you also update this part?