How to delete duplicate lines in file in unix?

Question

I can delete duplicate lines in files using below commands: 1) sort -u and uniq commands. is that possible using sed or awk ?

Accepted Answer

There's a "famous" awk idiom:

```
awk '!seen[$0]++' file
```

It has to keep the unique lines in memory, but it preserves the file order.

Solution