headers
Karl Springer | 4 Nov 2011 22:09
Favicon

Remove duplicate lines

Have a regular task where I take a list of email addresses
and change alpha characters to lower case, sort, and remove 
duplicate lines.  When my XP Pro machine mother board crashed, I 
moved to Win 7 Pro, 64 bit, machine.  One result is that the 
batch script I was using no longer worked because I was using 
the  venerable RPSORT, a 16-bit program.  Anyone know of an 
equivalent 32-bit version?

While I can sort using MS' SORT, it has no provision to remove 
duplicate lines.  When I did a Google search to use SED, I 
became overwhelmed.  Help.

Thanks,

Karl

------------------------------------

To Post a message, send it to:   batchworld@...

To Unsubscribe, send a blank message to:
batchworld-unsubscribe@...! Groups Links

<*> To visit your group on the web, go to:
    http://groups.yahoo.com/group/batchworld/

<*> Your email settings:
    Individual Email | Traditional

<*> To change settings online go to:
(Continue reading)

Permalink | Reply |
headers
foxidrive | 5 Nov 2011 06:04

Re: Remove duplicate lines

On 5/11/2011 08:09, Karl Springer wrote:
> Have a regular task where I take a list of email addresses
> and change alpha characters to lower case, sort, and remove
> duplicate lines.  When my XP Pro machine mother board crashed, I
> moved to Win 7 Pro, 64 bit, machine.  One result is that the
> batch script I was using no longer worked because I was using
> the  venerable RPSORT, a 16-bit program.  Anyone know of an
> equivalent 32-bit version?
>
> While I can sort using MS' SORT, it has no provision to remove
> duplicate lines.  When I did a Google search to use SED, I
> became overwhelmed.  Help.
>
> Thanks,
>
> Karl

I had this squirreled away.

:: alphanumeric characters 'only'
:: the input file "file.txt" is sorted before processing.
 <at> echo off
sort <file.txt >file2.txt
set a=
set b=
type nul>fileout.txt
for /f "delims=" %%a in (file2.txt) do call :next "%%a"
del file2.txt
set a=
set b=
(Continue reading)

Permalink | Reply |
headers
Bill Z | 5 Nov 2011 18:07
Picon

Re: Remove duplicate lines

foxidrive:

Please ask the current moderator to add 
you as an additional moderator.

One anonymous moderator for this group is 
bouncing and the other one has only posted 
1 message in the last 4 years, so there is 
no way to tell if he, or she, is still 
interested. 

Without you, this useful group would be 
in jeopardy.

------------

http://groups.yahoo.com/group/batchworld/message/3776
Does anyone know what happened to the original 
owner of this group, "Gord Braun" <gordbraun <at> ...> ,
who suddenly stopped posting mesages in Sep 2003 ?

Bill Zardus
Delaware County, PA

--- In batchworld@..., 
foxidrive <foxidrive <at> ...> wrote:
> 
> I had this squirreled away.
> 
>
(Continue reading)

Permalink | Reply |
headers
Karl Springer | 5 Nov 2011 06:43
Favicon

Re: Remove duplicate lines

On 4 Nov 2011 at 14:09 -0700, Karl Springer wrote, at least in 
part:

> ...  When my XP Pro machine mother board crashed, I moved
> to Win 7 Pro, 64 bit, machine.  One result is that the
> batch script I was using no longer worked because I was
> using the  venerable RPSORT, a 16-bit program.  Anyone know
> of an equivalent 32-bit version?  

Found a near equivalent, CMSORT (donationware),
<http://www.chmaas.handshake.de/delphi/freeware/cmsort/cmsort.htm>.

Karl

------------------------------------

To Post a message, send it to:   batchworld@...

To Unsubscribe, send a blank message to:
batchworld-unsubscribe@...! Groups Links

<*> To visit your group on the web, go to:
    http://groups.yahoo.com/group/batchworld/

<*> Your email settings:
    Individual Email | Traditional

<*> To change settings online go to:
    http://groups.yahoo.com/group/batchworld/join
    (Yahoo! ID required)
(Continue reading)

Permalink | Reply |

Gmane