dedupe repositories

Trending repositories tagged dedupe, ranked by trending score. Updated daily.

  1. 1
    restic/restic

    Fast, secure, efficient backup program

    GitHub · Go · 37,319 stars · 1,988 forks · +32 stars in 24 hours · Trending score 3.12

  2. 2
    curlewlabs-com/apfs-dedupe

    Safe APFS clone deduplication for macOS — fclones detection + a windowless, ACL-complete apply

    GitHub · Shell · 8 stars · 1 forks · 0 stars in 24 hours · Trending score 0.47

  3. 3
    kdeldycke/mail-deduplicate

    📧 CLI to deduplicate mails from mail boxes

    GitHub · Python · 203 stars · 47 forks · 0 stars in 24 hours · Trending score 0.46

  4. 4
    maxkhim/laravel-storage-dedupler

    Laravel package to prevent file duplications

    GitHub · PHP · 58 stars · 3 forks · 0 stars in 24 hours · Trending score 0.39

  5. 5
    Senzing/awesome

    Curated list of awesome software and resources for Senzing, The First Real-Time AI for Entity Resolution.

    GitHub · Python · 67 stars · 3 forks · 0 stars in 24 hours · Trending score 0.00

  6. 6
    zayne-labs/callapi

    A lightweight fetching library packed with essential features - retries, interceptors, request deduplication and much more, all while still retaining a similar API surface with regular Fetch.

    GitHub · TypeScript · 64 stars · 7 forks · 0 stars in 24 hours · Trending score 0.00

  7. 7
    zinggAI/zingg

    Scalable master data management, identity resolution, entity resolution, and deduplication using ML

    GitHub · Java · 1,256 stars · 178 forks · 0 stars in 24 hours · Trending score 0.00

  8. 8
    jRimbault/yadf

    Yet Another Dupes Finder

    GitHub · Rust · 69 stars · 1 forks · 0 stars in 24 hours · Trending score 0.00

  9. 9
    ViceAssembly/dataset-forge

    Published: 2026-10-18

    GitHub · C# · 19 stars · 3 forks · 0 stars in 24 hours · Trending score 0.00

  10. 10
    dedupeio/csvdedupe

    :id: Command line tool for deduplicating CSV files

    GitHub · Python · 433 stars · 80 forks · −1 stars in 24 hours · Trending score -0.00