Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
github-commits-diff-dedup-pjjs-april – Dataset by bigcode | AlphaNeural AI
You can deploy this model and start earning money today!
bigcode
/
github-commits-diff-dedup-pjjs-april
like
0
100K<n<1M
parquet
text
datasets
dask
mlcroissant
polars
us
Views
No views yet
Model card
Files and Versions
Community
API
Deduplicated Commits
Deduplicated based on diff: content = '\n'.join(difflib.unified_diff( old_content.splitlines(keepends=True), new_content.splitlines(keepends=True), n=5 ))
Parameters:
Minimum ngram size: 5 MinHash ngram size: 5 MinHash threshold: 0.8