Q: About Line Duplication In Logs

[splizapp]

how do you remove the duplicate line in logs or in / password.txt(1gb)
what tool do i use and how. thanks

 

[risingstar99]

maybe you can use online tools,, google is your friend buddy

 

[gesof80489@ukbo]

you can use notepad++ to remove duplicate lines

 

[gesof80489@ukbo]

or use linux -> cat filename |sort |uniq >> newfilename

 

[gesof80489@ukbo]

in notepad++ go to Edit ->Line operation -> Remove duplicate lines

it might take 4-5 min