Hashed based duplication detection