Request A Short Analysis Of Rockyou2024.Txt

rockyou24 · Jul 7, 2024

A short analysis of RockYou2024.txt, it seems it is full of non-password entries. Cleaned it up and posted the results here. It can be cleaned further by the way, there are a lot of other lines that are suspect to being hashes and not passwords. But after a day of filtering I wanted to post the results. Maybe in the future I will post more results.
Magnet link to cleaned up file: magnet:?xt=urn:btih:c3f4883743653094a3cab5055c9f34bb46ea1349&dn=A%20Short%20Analysis%20Of%20Rockyou2024

Very long Magnetlink with Trackers to speed thing up here:

magnet:?xt=urn:btih:c3f4883743653094a3cab5055c9f34bb46ea1349&dn=A%20Short%20Analysis%20Of%20Rockyou2024&tr=udp%3A%2F%2Ftracker.opentrackr.org%3A1337%2Fannounce&tr=udp%3A%2F%2Fopen.demonii.com%3A1337%2Fannounce&tr=https%3A%2F%2Ftracker.tamersunion.org%3A443%2Fannounce&tr=udp%3A%2F%2Fopen.u-p.pw%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.torrent.eu.org%3A451%2Fannounce&tr=udp%3A%2F%2Ftracker.0x7c0.com%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.tryhackx.org%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.tiny-vps.com%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.theoks.net%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.dler.org%3A6969%2Fannounce&tr=udp%3A%2F%2Fretracker.lanta.me%3A2710%2Fannounce&tr=udp%3A%2F%2Foh.fuuuuuck.com%3A6969%2Fannounce&tr=udp%3A%2F%2Fmoonburrow.club%3A6969%2Fannounce&tr=udp%3A%2F%2Fexplodie.org%3A6969%2Fannounce&tr=https%3A%2F%2Ftracker.loligirl.cn%3A443%2Fannounce&tr=udp%3A%2F%2Ftracker.dump.cl%3A6969%2Fannounce&tr=udp%3A%2F%2Fretracker01-msk-virt.corbina.net%3A80%2Fannounce

Bare downloaded file

Resulting file:	rockyou2024.txt (155978020956 bytes)
Example:	n.a.
Filter program:	None
Resulting lines:	9948575739 lines

Cleaning the file from obvious cruft like binary information and duplicates.
Running strings to exclude non-string values, they are most likely not accepted as password input and as such not valid in this file.

Resulting file:	rockyou2024.strings.txt (155044377185 bytes)
Example:	n.a. (cannot display in document)
Filter program:	string (without parameters)
Resulting lines:	9946381679 lines
Reduction in lines:	2194060 lines

Running sort uniq to exclude duplicates:

Resulting file:	rockyou2024.strings.sort.uniq.txt (149434657706 bytes)
Example:	n.a.
Filter program:	sort \| uniq (without parameters)
Resulting lines:	9408671894 lines
Reduction in lines:	537709785 lines

Cleaning the file from bare non-reversible hashes which are very unlikely to be user entered passwords but just extracted data from data-fields, used to store the hash. They might be useful to run Hashcat on, but they are not bare passwords and do not belong in this file.

Bcrypt hashes

Resulting file:	rockyou2024.strings.sort.uniq.brypt.txt(140343047682 bytes)
Example:	$2a$05$LhayLxezLhK1LhWvKxCyLOj0j1u.Kj0jZ0pEmm134uzrQlFvQJLF6 $2a$10$m0nAAMG_sYDUhPEmAtY9E41EB7ucBG9 (this seems to be a truncated bcrypt hash? Probably some copy/export defunct.)
Filter program:	grep -v -Ea ^'\$2[axyb]\$.{34}'
Resulting lines:	9254219417 lines
Reduction in lines:	154452477 lines

PHP hashes

Resulting file:	rockyou2024.strings.sort.uniq.bcrypt.php.txt (139903955270 bytes)
Example:	$H$984478476IagS59wHZvyQMArzfx58u. $H$9AN61OLpYXDcjio5ayC4TD8dmmTCOA1 $P$984478476IagS59wHZvyQMArzfx58u.
Filter program:	grep -v -Ea ^'\$[H,P]\$[0-9,a-z,A-Z].{30}'
Resulting lines:	9241674220 lines
Reduction in lines:	12545197 lines

MD5crypt hashes

Resulting file:	rockyou2024.strings.sort.uniq.bcrypt.php.md5.txt (139895722954 bytes)
Example:	$1$28772684$iEwNOgGugqO9.bIz5sk8k/
Filter program:	grep -v -Ea ^'\$[1]\$[0-9,a-z,A-Z].{30}'
Resulting lines:	9241439016 lines
Reduction in lines:	235204 lines

sha256crypt hashes

Resulting file:	rockyou2024.strings.sort.uniq.bcrypt.php.md5.sha256.txt (139812179906 bytes)
Example:	$5$rounds=7500$j4BJmp8ssgZ7GNHY$p9m40zXnNWmBNcF4iG38g2Q9STsi0.jwaexvl9TiNV4
Filter program:	grep -v -Ea ^'\$[0-9]\$rounds.{66}'
Resulting lines:	9240569727 lines
Reduction in lines:	869289 lines

argon2d hashes

Resulting file:	rockyou2024.strings.sort.uniq.bcrypt.php.md5.sha256.argon.txt (139796662358 bytes)
Example:	$argon2d$v=19$m=16383,t=2,p=4$ZZwAV9Mc/6qtZPQUD3Bd0Q$hKGQtB6/3mYr9Jk1oT9yWttZ39FXOuaRz3iDTKhxxw0
Filter program:	grep -v -Ea ^'\$argon2d\$.{87}'
Resulting lines:	9240409753 lines
Reduction in lines:	159974 lines

Remnant hashes assorted

Resulting file:	rockyou2024.strings.sort.uniq.bcrypt.php.md5.sha256.argon.remnants.txt (139784514348 bytes)
Example:	$6$sxkpZ6zd$OrhMD8QRa9bOC5xrk.t2175uB6d13DU2eKtvyJ9UIlV05MWxtU0/wAPVFYciQavIP9KOFHFgQHDgwrYs2LBkw0 $5$ZWtoYXR5bzExQGdt$1PXVV.xCQJPKIUYUPN5wslXKqHAtK8OXxvNnnpKkUq8
Filter program:	grep -v -Ea ^'\$[0-9]\$.{8}'
Resulting lines:	9240152418 lines
Reduction in lines:	257335 lines

bee777 · Jul 11, 2024

leakdb said:
i think download just the 34 gb archive and use `xz -dc file.xz | grep YourPassword` to use it without extracting it or use `mkfifo` to crack directly without extracting.. use google or chatgpt..

Wow, interesting adwise. Actually, I was worried about extra archive, it was smth else, 'coz it started downloading itself at deep night, when I was sleeping. It was more than 300 Gb entirely and I deleted it. But i definitely should learn to use archives without extrating, I'll have a try, thanks.

leakdb · Jul 11, 2024

bee777 said:
Wow, interesting adwise. Actually, I was worried about extra archive, it was smth else, 'coz it started downloading itself at deep night, when I was sleeping. It was more than 300 Gb entirely and I deleted it. But i definitely should learn to use archives without extrating, I'll have a try, thanks.

more advice

you can use split to split the file into chunks or use awk sed to filter the output more specifically to .txt or .gz etc.. ,
if you are using windows use 'git bash'. use chatgpt to learn more.
if you have downloaded a database in csv format in .txt file you can import it to the sqlite database file and index one or more fields to speed up the searches.

rockyou24 · Jul 11, 2024

leakdb said:
more advice
you can use split to split the file into chunks or use awk sed to filter the output more specifically to .txt or .gz etc.. ,
if you are using windows use 'git bash'. use chatgpt to learn more.
if you have downloaded a database in csv format in .txt file you can import it to the sqlite database file and index one or more fields to speed up the searches.

Yes I used xz because it has very nice compression AND you can pipe the output to stdout to parse with grep et. al. (Zip cannot do this easily) It slows it a bit down, but it is worth it. I still do not get the "cosan" meaning, I do not know what is meant by that. Is someone poisoning the torrent with additional files? These files should fail after a hash verification done by your bittorrent client.... and yes you can choose to download a single archive if you want.

btw. after further exploring the files, there is so much garbage I doubt the usefulness even of the files I created.... I'll leave the torrent up, but I personally will not use the file in the future I think.

PS. Do not use bash on windows..... install linux and learn a thing or two.

bee777 · Jul 11, 2024

rockyou24 said:
PS. Do not use bash on windows..... install linux and learn a thing or two.

Tell me pls, why we shouldn't use Windows?

rockyou24 · Jul 11, 2024

bee777 said:
Tell me pls, why we shouldn't use Windows?

Oh you can use whatever you want, no problem. But I find Linux way more comfortable and...

You must be logged in to see this link.

And it only got worse.... but I am not discussing this further here, it is about rockyou2024.txt....

leakdb · Jul 12, 2024

rockyou24 said:
Yes I used xz because it has very nice compression AND you can pipe the output to stdout to parse with grep et. al. (Zip cannot do this easily) It slows it a bit down, but it is worth it. I still do not get the "cosan" meaning, I do not know what is meant by that. Is someone poisoning the torrent with additional files? These files should fail after a hash verification done by your bittorrent client.... and yes you can choose to download a single archive if you want.

btw. after further exploring the files, there is so much garbage I doubt the usefulness even of the files I created.... I'll leave the torrent up, but I personally will not use the file in the future I think.

PS. Do not use bash on windows..... install linux and learn a thing or two.

yes, i even saw some ascii art in the begining i guess.
Can you please clean it more it will be helpful for us all..

And Thanks for already cleaning it that much..

leakdb · Jul 12, 2024

bee777 said:
Tell me pls, why we shouldn't use Windows?

These all are linux built-in tools actually which he used to clean it up. You can learn many things, which will make a real power user. you can't do much on windows. And spys on you on top of that.

itzwaleedh · Jul 15, 2024

I am kinda new to this please explain to me if possible
so what dose the raw file contain ? and what dose yours contain ?
what program should I use after downloading so I can search in the file and find whatever email I want
also do you mean that the original raw file is not useful for people with low knowledge of dev stuff
simple all I want is a file that I can search in and find email and its password

thank you for your effort

JeRM · Jul 18, 2024

rockyou24 said:
A short analysis of RockYou2024.txt, it seems it is full of non-password entries. Cleaned it up and posted the results here. It can be cleaned further by the way, there are a lot of other lines that are suspect to being hashes and not passwords. But after a day of filtering I wanted to post the results. Maybe in the future I will post more results.
Magnet link to cleaned up file: magnet:?xt=urn:btih:c3f4883743653094a3cab5055c9f34bb46ea1349&dn=A%20Short%20Analysis%20Of%20Rockyou2024

Very long Magnetlink with Trackers to speed thing up here:

magnet:?xt=urn:btih:c3f4883743653094a3cab5055c9f34bb46ea1349&dn=A%20Short%20Analysis%20Of%20Rockyou2024&tr=udp%3A%2F%2Ftracker.opentrackr.org%3A1337%2Fannounce&tr=udp%3A%2F%2Fopen.demonii.com%3A1337%2Fannounce&tr=https%3A%2F%2Ftracker.tamersunion.org%3A443%2Fannounce&tr=udp%3A%2F%2Fopen.u-p.pw%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.torrent.eu.org%3A451%2Fannounce&tr=udp%3A%2F%2Ftracker.0x7c0.com%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.tryhackx.org%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.tiny-vps.com%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.theoks.net%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.dler.org%3A6969%2Fannounce&tr=udp%3A%2F%2Fretracker.lanta.me%3A2710%2Fannounce&tr=udp%3A%2F%2Foh.fuuuuuck.com%3A6969%2Fannounce&tr=udp%3A%2F%2Fmoonburrow.club%3A6969%2Fannounce&tr=udp%3A%2F%2Fexplodie.org%3A6969%2Fannounce&tr=https%3A%2F%2Ftracker.loligirl.cn%3A443%2Fannounce&tr=udp%3A%2F%2Ftracker.dump.cl%3A6969%2Fannounce&tr=udp%3A%2F%2Fretracker01-msk-virt.corbina.net%3A80%2Fannounce

Bare downloaded file

Resulting file: rockyou2024.txt (155978020956 bytes)
Example: n.a.
Filter program: None
Resulting lines: 9948575739 lines

Cleaning the file from obvious cruft like binary information and duplicates.
Running strings to exclude non-string values, they are most likely not accepted as password input and as such not valid in this file.

Resulting file: rockyou2024.strings.txt (155044377185 bytes)
Example: n.a. (cannot display in document)
Filter program: string (without parameters)
Resulting lines: 9946381679 lines
Reduction in lines: 2194060 lines

Running sort uniq to exclude duplicates:

Resulting file: rockyou2024.strings.sort.uniq.txt (149434657706 bytes)
Example: n.a.
Filter program: sort | uniq (without parameters)
Resulting lines: 9408671894 lines
Reduction in lines: 537709785 lines

Cleaning the file from bare non-reversible hashes which are very unlikely to be user entered passwords but just extracted data from data-fields, used to store the hash. They might be useful to run Hashcat on, but they are not bare passwords and do not belong in this file.

Bcrypt hashes

Resulting file: rockyou2024.strings.sort.uniq.brypt.txt(140343047682 bytes)
Example: $2a$05$LhayLxezLhK1LhWvKxCyLOj0j1u.Kj0jZ0pEmm134uzrQlFvQJLF6
$2a$10$m0nAAMG_sYDUhPEmAtY9E41EB7ucBG9 (this seems to be a truncated bcrypt hash? Probably some copy/export defunct.)
Filter program: grep -v -Ea ^'\$2[axyb]\$.{34}'
Resulting lines: 9254219417 lines
Reduction in lines: 154452477 lines

PHP hashes

Resulting file: rockyou2024.strings.sort.uniq.bcrypt.php.txt (139903955270 bytes)
Example: $H$984478476IagS59wHZvyQMArzfx58u.
$H$9AN61OLpYXDcjio5ayC4TD8dmmTCOA1
$P$984478476IagS59wHZvyQMArzfx58u.
Filter program: grep -v -Ea ^'\$[H,P]\$[0-9,a-z,A-Z].{30}'
Resulting lines: 9241674220 lines
Reduction in lines: 12545197 lines

MD5crypt hashes

Resulting file: rockyou2024.strings.sort.uniq.bcrypt.php.md5.txt (139895722954 bytes)
Example: $1$28772684$iEwNOgGugqO9.bIz5sk8k/
Filter program: grep -v -Ea ^'\$[1]\$[0-9,a-z,A-Z].{30}'
Resulting lines: 9241439016 lines
Reduction in lines: 235204 lines

sha256crypt hashes

Resulting file: rockyou2024.strings.sort.uniq.bcrypt.php.md5.sha256.txt
(139812179906 bytes)
Example: $5$rounds=7500$j4BJmp8ssgZ7GNHY$p9m40zXnNWmBNcF4iG38g2Q9STsi0.jwaexvl9TiNV4
Filter program: grep -v -Ea ^'\$[0-9]\$rounds.{66}'
Resulting lines: 9240569727 lines
Reduction in lines: 869289 lines

argon2d hashes

Resulting file: rockyou2024.strings.sort.uniq.bcrypt.php.md5.sha256.argon.txt (139796662358 bytes)
Example: $argon2d$v=19$m=16383,t=2,p=4$ZZwAV9Mc/6qtZPQUD3Bd0Q$hKGQtB6/3mYr9Jk1oT9yWttZ39FXOuaRz3iDTKhxxw0
Filter program: grep -v -Ea ^'\$argon2d\$.{87}'
Resulting lines: 9240409753 lines
Reduction in lines: 159974 lines

Remnant hashes assorted

Resulting file: rockyou2024.strings.sort.uniq.bcrypt.php.md5.sha256.argon.remnants.txt (139784514348 bytes)
Example: $6$sxkpZ6zd$OrhMD8QRa9bOC5xrk.t2175uB6d13DU2eKtvyJ9UIlV05MWxtU0/wAPVFYciQavIP9KOFHFgQHDgwrYs2LBkw0
$5$ZWtoYXR5bzExQGdt$1PXVV.xCQJPKIUYUPN5wslXKqHAtK8OXxvNnnpKkUq8
Filter program: grep -v -Ea ^'\$[0-9]\$.{8}'
Resulting lines: 9240152418 lines
Reduction in lines: 257335 lines

Really need forum members to download and seed the heck out of this cleaned up version! For now, I'll just keep using the original file I possess.

JeRM · Jul 18, 2024

Successfully downloaded. I'll be seeding for others. I'll report back if this pans out in my favor for brute forcing an old document I need access too.