eBay's TSV Utilities: Command line tools for large, tabular data files. Filtering, statistics, sampling, joins and more.

Remove duplicates from MASSIVE wordlist, without sorting it (for dictionnary-based password cracking)

Return an array free of duplicate values. Very fast implementation.

A Python API client library for Cisco's Application Policy Infrastructure Controller Enterprise Module (APIC-EM) Northbound APIs.

No dups, no doubts

An unique name, domain and brand generator

A command-line tool for deduplicating entries in a file or stream.

Solutions and related tutorials for the Linux Shell - Bash, text processing, Arrays in Bash, Grep Sed Awk Challenges on HackerRank

anewer appends lines from stdin to a file if they don't already exist in the file. This is a rust version of https://github.com/tomnomnom/anew

Package uniq provides primitives for getting the first unique elements of (aka deduplicate) your existing sorted sort.Interface.

An extensible, GUI-based file search and processing tool for Windows written in C# and WPF, with out-of-the-box functionality similar to grepWin and dnGrep

quick uniq command

sublime-uniq is a plugin for sublime

💨Array extra methods : uniq, sum, contain, flatt

A uniq for URL integrated with query string result.

Solutions to linux shell problems on hackerrank-BASH , TEXT PROCESSING , ARRAYS IN BASH , GREP SED AWK

Flake ID generator yields k-ordered, conflict-free ids in a distributed environment in Go

a unix 'uniq' command with extra features like user-specified delimiters, select first of last line of a collated group, match on a field, and update counts within a previous uniq output.

Sort, uniq, reverse, and randomize data

Quickly compare data across separate columns

A multi-threaded version of GNU uniq in C++.

A command-line tool for deduplicating entries in a file or stream with constant memory usage

Erlang version of uniq(1).

Strip an array of all duplicate entries, including complex objects

jellyfish wrapper to extract unique kmers in fasta file compared to background set

Simple uniq implementation in Rust that doesn't require sorting

Unique for array based on next.

row oriented to column oriented

Wordlist / text uniquifier which ignores trailing whitespace and cr/lf mismaches.

slice相关工具