how to prevent duplicate downloads from kemono?

[tryoutuser]

are there ways to record or log downloaded files from kemono.party to prevent duplication?

example :

you can see different filenames in my screenshot but it was for the same content

i asked shino the owner, he said "if gallery-dl has an option to use kemono's hashnames"

is that possible? if yes how? can you give me config example?

[rautamiekka]

Did you actually look at the files to see if they look the same ? The names make me believe some, like _06_, were modified later, which might make the earlier one obsolete/inferior.

The archive config option is important to have, anyway.

[tryoutuser]

yes i did. it was for identical the very same content. no single bytes difference either.

[enduser420]

if you dont want to change the filename format, you can use hash as the archive value to prevent redownloads
#2811, #2886

[tryoutuser]

@enduser420 now another problem. how to clean up sqlite3 database for files/posts that we have deleted?

[enduser420]

you can use something like DB Browser for SQLite to manually clean up the entries

[tryoutuser]

it's screwed. i only put {hash} to store into the db.

[tryoutuser]

what's the best string to use?
{service}_{user}_{id}_{hash}.{extension} or {service}_{user}_{id}_{num}_{hash}.{extension}

[enduser420]

what's the best string to use?

{service}_{user}_{id}_{hash}