sudo apt install sqlite3
sudo apt install libsqlite3-dev

git clone https://github.com/rektbuildr/shafs.git
cd shafs
./build.sh

sudo make install

git clone https://github.com/rektbuildr/shafs.git
cd shafs
mkdir -p m4
autoreconf --install
./configure
make
sudo make install    

shafs [-v] <src_dr> <sqlite_file>

shafs -v /usr/lib ~/usrlib_hashed.db

$ shafs ~/ebooks/ ~/ebooks.db
$ sqlite3 ~/ebooks.db
sqlite> select filepath, count(*) as duplicates from shafs group by filehash having duplicates > 0 order by duplicates desc;

sqlite> select * from shafs order by filesize desc;

See Also

Bitcoin vs. Bitcoin Cash : Two coins with matches, playing in gasoline [Nov 2017]
“The nuclear arms race is like two sworn enemies standing waist deep in gasoline, one with three matches, the other with five.” – Carl Sagan Cryptocurrencies are in a strategic inflection point. The big investors behind Bitcoin Cash have decided to take on BTC after their, in hindsight strategic, 2X retreat. Will it Work? Carl […] Bitcoin: The mother of all cryptocurrencies
On January 12 2009, an individual, or group, using the pseudonym Satoshi Nakamoto, announced that the first Bitcoin transaction had taken place. Ten Bitcoins had been magically transferred between Satoshi and cryptography legend Hal Finney. It was the beginning of a revolution which, to this day, promises to change how humankind deals with money, finance […] ELI5 Sponge Functions for cryptocurrency development [Hash functions]
If you’ve been following the development of IOTA, and other cryptocurrencies, then you’ve probably heard the term “cryptographic sponge function“, or simply sponge function? You didn’t? Then surely you’ve heard about hash functions, right? Hashing functions are one kind of sponge function! What exactly do hashing functions do? And why are they called sponge functions? […]