Thus spake Jay Kline (list at slushpupie.com):

> Its been a while since I have needed this, but I need to sort some files, and 
> remove duplicate line entries.  I thought sort had that functionality built 
> in, but in searching the man pages it dosnt seem to.  The problem is I have 
> to do this on different systems and dont want to write custom scripts, as 
> there are too many different systems to distribute anything like that.  I 
> would not mind typing a simple 1-2 line script, but I was sure there was some 
> standard unix utility that does this.  Anyone know it?

The command you want is 'uniq'.

$ sort file1 file2 | uniq

Rob