Forum Kurallarını Okumak İçin Lütfen Tıklayınız .

A Short Analysis Of Rockyou2024.Txt Request 

Request A Short Analysis Of Rockyou2024.Txt
Joined
Jul 7, 2024
Messages
0
Reaction score
18
#CR
2
A short analysis of RockYou2024.txt, it seems it is full of non-password entries. Cleaned it up and posted the results here. It can be cleaned further by the way, there are a lot of other lines that are suspect to being hashes and not passwords. But after a day of filtering I wanted to post the results. Maybe in the future I will post more results.
Magnet link to cleaned up file: magnet:?xt=urn:btih:c3f4883743653094a3cab5055c9f34bb46ea1349&dn=A%20Short%20Analysis%20Of%20Rockyou2024

Very long Magnetlink with Trackers to speed thing up here:

magnet:?xt=urn:btih:c3f4883743653094a3cab5055c9f34bb46ea1349&dn=A%20Short%20Analysis%20Of%20Rockyou2024&tr=udp%3A%2F%2Ftracker.opentrackr.org%3A1337%2Fannounce&tr=udp%3A%2F%2Fopen.demonii.com%3A1337%2Fannounce&tr=https%3A%2F%2Ftracker.tamersunion.org%3A443%2Fannounce&tr=udp%3A%2F%2Fopen.u-p.pw%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.torrent.eu.org%3A451%2Fannounce&tr=udp%3A%2F%2Ftracker.0x7c0.com%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.tryhackx.org%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.tiny-vps.com%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.theoks.net%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.dler.org%3A6969%2Fannounce&tr=udp%3A%2F%2Fretracker.lanta.me%3A2710%2Fannounce&tr=udp%3A%2F%2Foh.fuuuuuck.com%3A6969%2Fannounce&tr=udp%3A%2F%2Fmoonburrow.club%3A6969%2Fannounce&tr=udp%3A%2F%2Fexplodie.org%3A6969%2Fannounce&tr=https%3A%2F%2Ftracker.loligirl.cn%3A443%2Fannounce&tr=udp%3A%2F%2Ftracker.dump.cl%3A6969%2Fannounce&tr=udp%3A%2F%2Fretracker01-msk-virt.corbina.net%3A80%2Fannounce


Bare downloaded file

Resulting file:rockyou2024.txt (155978020956 bytes)
Example:n.a.
Filter program:None
Resulting lines:9948575739 lines

Cleaning the file from obvious cruft like binary information and duplicates.
Running strings to exclude non-string values, they are most likely not accepted as password input and as such not valid in this file.

Resulting file:rockyou2024.strings.txt (155044377185 bytes)
Example:n.a. (cannot display in document)
Filter program:string (without parameters)
Resulting lines:9946381679 lines
Reduction in lines:2194060 lines

Running sort uniq to exclude duplicates:

Resulting file:rockyou2024.strings.sort.uniq.txt (149434657706 bytes)
Example:n.a.
Filter program:sort | uniq (without parameters)
Resulting lines:9408671894 lines
Reduction in lines:537709785 lines


Cleaning the file from bare non-reversible hashes which are very unlikely to be user entered passwords but just extracted data from data-fields, used to store the hash. They might be useful to run Hashcat on, but they are not bare passwords and do not belong in this file.

Bcrypt hashes
Resulting file:rockyou2024.strings.sort.uniq.brypt.txt(140343047682 bytes)
Example:$2a$05$LhayLxezLhK1LhWvKxCyLOj0j1u.Kj0jZ0pEmm134uzrQlFvQJLF6
$2a$10$m0nAAMG_sYDUhPEmAtY9E41EB7ucBG9 (this seems to be a truncated bcrypt hash? Probably some copy/export defunct.)
Filter program:grep -v -Ea ^'\$2[axyb]\$.{34}'
Resulting lines:9254219417 lines
Reduction in lines:154452477 lines

PHP hashes
Resulting file:rockyou2024.strings.sort.uniq.bcrypt.php.txt (139903955270 bytes)
Example:$H$984478476IagS59wHZvyQMArzfx58u.
$H$9AN61OLpYXDcjio5ayC4TD8dmmTCOA1
$P$984478476IagS59wHZvyQMArzfx58u.
Filter program:grep -v -Ea ^'\$[H,P]\$[0-9,a-z,A-Z].{30}'
Resulting lines:9241674220 lines
Reduction in lines:12545197 lines

MD5crypt hashes
Resulting file:rockyou2024.strings.sort.uniq.bcrypt.php.md5.txt (139895722954 bytes)
Example:$1$28772684$iEwNOgGugqO9.bIz5sk8k/
Filter program:grep -v -Ea ^'\$[1]\$[0-9,a-z,A-Z].{30}'
Resulting lines:9241439016 lines
Reduction in lines:235204 lines


sha256crypt hashes
Resulting file:rockyou2024.strings.sort.uniq.bcrypt.php.md5.sha256.txt
(139812179906 bytes)
Example:$5$rounds=7500$j4BJmp8ssgZ7GNHY$p9m40zXnNWmBNcF4iG38g2Q9STsi0.jwaexvl9TiNV4
Filter program:grep -v -Ea ^'\$[0-9]\$rounds.{66}'
Resulting lines:9240569727 lines
Reduction in lines:869289 lines

argon2d hashes
Resulting file:rockyou2024.strings.sort.uniq.bcrypt.php.md5.sha256.argon.txt (139796662358 bytes)
Example:$argon2d$v=19$m=16383,t=2,p=4$ZZwAV9Mc/6qtZPQUD3Bd0Q$hKGQtB6/3mYr9Jk1oT9yWttZ39FXOuaRz3iDTKhxxw0
Filter program:grep -v -Ea ^'\$argon2d\$.{87}'
Resulting lines:9240409753 lines
Reduction in lines:159974 lines

Remnant hashes assorted
Resulting file:rockyou2024.strings.sort.uniq.bcrypt.php.md5.sha256.argon.remnants.txt (139784514348 bytes)
Example:$6$sxkpZ6zd$OrhMD8QRa9bOC5xrk.t2175uB6d13DU2eKtvyJ9UIlV05MWxtU0/wAPVFYciQavIP9KOFHFgQHDgwrYs2LBkw0
$5$ZWtoYXR5bzExQGdt$1PXVV.xCQJPKIUYUPN5wslXKqHAtK8OXxvNnnpKkUq8
Filter program:grep -v -Ea ^'\$[0-9]\$.{8}'
Resulting lines:9240152418 lines
Reduction in lines:257335 lines
 
Last edited:
Well done. I'm a little surprised though that the original file was not cleaned up prior to being uploaded and shared by user ObamaCare.
 
A short analysis of RockYou2024.txt, it seems it is full of non-password entries. Cleaned it up and posted the results here. It can be cleaned further by the way, there are a lot of other lines that are suspect to being hashes and not passwords. But after a day of filtering I wanted to post the results. Maybe in the future I will post more results.
Magnet link to cleaned up file: magnet:?xt=urn:btih:c3f4883743653094a3cab5055c9f34bb46ea1349&dn=A%20Short%20Analysis%20Of%20Rockyou2024

Very long Magnetlink with Trackers to speed thing up here:

magnet:?xt=urn:btih:c3f4883743653094a3cab5055c9f34bb46ea1349&dn=A%20Short%20Analysis%20Of%20Rockyou2024&tr=udp%3A%2F%2Ftracker.opentrackr.org%3A1337%2Fannounce&tr=udp%3A%2F%2Fopen.demonii.com%3A1337%2Fannounce&tr=https%3A%2F%2Ftracker.tamersunion.org%3A443%2Fannounce&tr=udp%3A%2F%2Fopen.u-p.pw%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.torrent.eu.org%3A451%2Fannounce&tr=udp%3A%2F%2Ftracker.0x7c0.com%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.tryhackx.org%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.tiny-vps.com%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.theoks.net%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.dler.org%3A6969%2Fannounce&tr=udp%3A%2F%2Fretracker.lanta.me%3A2710%2Fannounce&tr=udp%3A%2F%2Foh.fuuuuuck.com%3A6969%2Fannounce&tr=udp%3A%2F%2Fmoonburrow.club%3A6969%2Fannounce&tr=udp%3A%2F%2Fexplodie.org%3A6969%2Fannounce&tr=https%3A%2F%2Ftracker.loligirl.cn%3A443%2Fannounce&tr=udp%3A%2F%2Ftracker.dump.cl%3A6969%2Fannounce&tr=udp%3A%2F%2Fretracker01-msk-virt.corbina.net%3A80%2Fannounce


Bare downloaded file

Resulting file:rockyou2024.txt (155978020956 bytes)
Example:n.a.
Filter program:None
Resulting lines:9948575739 lines

Cleaning the file from obvious cruft like binary information and duplicates.
Running strings to exclude non-string values, they are most likely not accepted as password input and as such not valid in this file.

Resulting file:rockyou2024.strings.txt (155044377185 bytes)
Example:n.a. (cannot display in document)
Filter program:string (without parameters)
Resulting lines:9946381679 lines
Reduction in lines:2194060 lines

Running sort uniq to exclude duplicates:

Resulting file:rockyou2024.strings.sort.uniq.txt (149434657706 bytes)
Example:n.a.
Filter program:sort | uniq (without parameters)
Resulting lines:9408671894 lines
Reduction in lines:537709785 lines


Cleaning the file from bare non-reversible hashes which are very unlikely to be user entered passwords but just extracted data from data-fields, used to store the hash. They might be useful to run Hashcat on, but they are not bare passwords and do not belong in this file.

Bcrypt hashes
Resulting file:rockyou2024.strings.sort.uniq.brypt.txt(140343047682 bytes)
Example:$2a$05$LhayLxezLhK1LhWvKxCyLOj0j1u.Kj0jZ0pEmm134uzrQlFvQJLF6
$2a$10$m0nAAMG_sYDUhPEmAtY9E41EB7ucBG9 (this seems to be a truncated bcrypt hash? Probably some copy/export defunct.)
Filter program:grep -v -Ea ^'\$2[axyb]\$.{34}'
Resulting lines:9254219417 lines
Reduction in lines:154452477 lines

PHP hashes
Resulting file:rockyou2024.strings.sort.uniq.bcrypt.php.txt (139903955270 bytes)
Example:$H$984478476IagS59wHZvyQMArzfx58u.
$H$9AN61OLpYXDcjio5ayC4TD8dmmTCOA1
$P$984478476IagS59wHZvyQMArzfx58u.
Filter program:grep -v -Ea ^'\$[H,P]\$[0-9,a-z,A-Z].{30}'
Resulting lines:9241674220 lines
Reduction in lines:12545197 lines

MD5crypt hashes
Resulting file:rockyou2024.strings.sort.uniq.bcrypt.php.md5.txt (139895722954 bytes)
Example:$1$28772684$iEwNOgGugqO9.bIz5sk8k/
Filter program:grep -v -Ea ^'\$[1]\$[0-9,a-z,A-Z].{30}'
Resulting lines:9241439016 lines
Reduction in lines:235204 lines


sha256crypt hashes
Resulting file:rockyou2024.strings.sort.uniq.bcrypt.php.md5.sha256.txt
(139812179906 bytes)
Example:$5$rounds=7500$j4BJmp8ssgZ7GNHY$p9m40zXnNWmBNcF4iG38g2Q9STsi0.jwaexvl9TiNV4
Filter program:grep -v -Ea ^'\$[0-9]\$rounds.{66}'
Resulting lines:9240569727 lines
Reduction in lines:869289 lines

argon2d hashes
Resulting file:rockyou2024.strings.sort.uniq.bcrypt.php.md5.sha256.argon.txt (139796662358 bytes)
Example:$argon2d$v=19$m=16383,t=2,p=4$ZZwAV9Mc/6qtZPQUD3Bd0Q$hKGQtB6/3mYr9Jk1oT9yWttZ39FXOuaRz3iDTKhxxw0
Filter program:grep -v -Ea ^'\$argon2d\$.{87}'
Resulting lines:9240409753 lines
Reduction in lines:159974 lines

Remnant hashes assorted
Resulting file:rockyou2024.strings.sort.uniq.bcrypt.php.md5.sha256.argon.remnants.txt (139784514348 bytes)
Example:$6$sxkpZ6zd$OrhMD8QRa9bOC5xrk.t2175uB6d13DU2eKtvyJ9UIlV05MWxtU0/wAPVFYciQavIP9KOFHFgQHDgwrYs2LBkw0
$5$ZWtoYXR5bzExQGdt$1PXVV.xCQJPKIUYUPN5wslXKqHAtK8OXxvNnnpKkUq8
Filter program:grep -v -Ea ^'\$[0-9]\$.{8}'
Resulting lines:9240152418 lines
Reduction in lines:257335 lines
Hey the original user ObamaCare has deleted his rockyou2024.txt file. I wanna know where to access it. And how is it humanly possible to scour through 9 billion passwords? Can we search for the exact one that we want with a search bar? In CyberNews website, the program searches results for the particular email address and finds THE ONE amongst billions of passwords. Can the same program be employed to this file as well?
 
the total text: 9948575903
the text separators are 0x0a and 0x0d 0x0a
the max text length: 16777254
40367 lines text have ctrl char
25266 lines text have tab char
16991 lines text begin with tab char
6821 lines text ended with tab char
4489492 lines text have space char
11788 lines text begin with space char
81211 lines text ended with space char
5455320 lines text have extended ASCII char
671729385 lines text are digits only
460572 lines text are special char only
2024747875 lines text English char only
196 lines text longer than 4096
133 lines text 1 char
9301 lines text 2 char
109286 lines text 3 char
786709 lines text 4 char
14870605 lines text 5 char
524863968 lines text 6 char
437115571 lines text 7 char
1275585278 lines text 8 char
1430478838 lines text 9 char
1367831865 lines text 10 char
1033073294 lines text 11 char
838212380 lines text 12 char
612559083 lines text 13 char
439314093 lines text 14 char
326391452 lines text 15 char
 
Last edited:
this is great work, after looking through the raw myself, as you noted there was a BUNCH of chaff. thanks for doing all the legwork
 
Hey guys, a question to all - what is the weight of the entire sharing?
It started to download a heavy archive Cosan as well, and I don't have enough space in my comp, was it included as well?
 
Great. Is this the final magnet above ?
Question: What hardware specs are required to do operations on this large file ?
like you did strings, sort | uniq etc..
and how much time it took approx. per operation? just curious..

Seed guys..
 
Last edited:
Hey guys, a question to all - what is the weight of the entire sharing?
It started to download a heavy archive Cosan as well, and I don't have enough space in my comp, was it included as well?
Cosan? I do not get that. The magnet link contains two archives. The strings sort uniq one and the further cleaned one. So you can compare. 76 GB in total.

Oh and extra PDF with results, but that is 300k.
 
Great. Is this the final magnet above ?
Yes it is. If you find other filter regex for egrep, then post here, so everyone can refine these file more.
Question: What hardware specs are required to do operations on this large file ?
like you did strings, sort | uniq etc..
and how much time it took approx. per operation? just curious..
The strings, sort and uniq programs are single threaded. So CPU cores are not that important. Used: AMD Ryzen 9 5900HX. 16GB DDR4 (not very fast it is older laptop)
More important is storage. Use FAST storage NVME SSD with high throughput is best. During sorting it will store AL LOT of temporary files. Oh and set temporary directory to someplace with enough storage otherwise it will use /tmp/ by default. /tmp is mosty small partition.

All the work, took a up 6 hours. (including searching testing regexp etc. so this is not raw computing time)
Seed guys..
Yes I agree. Nice that it is appreciated.
 
Specopssoft made their own analysis. Came to same conclusion, three days later WITH A TEAM?? :rolleyes:
You do not have permission to view link Log in or register now.


And here I am with laptop and 6 hours time, same conclusion. Theirs has more specified results, but that would have taken me to much time,
Conclusion: File is full of Gunk/Cruft/Shit
 
Specopssoft made their own analysis. Came to same conclusion, three days later WITH A TEAM?? :rolleyes:
You do not have permission to view link Log in or register now.


And here I am with laptop and 6 hours time, same conclusion. Theirs has more specified results, but that would have taken me to much time,
Conclusion: File is full of Gunk/Cruft/Shit
Maybe they took yours' ? ;) Why don't you want to make a hide there, even "like" or a couple of messages can be condition. The thing is, your link is seen to eberyoe just with google search. I
 
Cosan? I do not get that. The magnet link contains two archives. The strings sort uniq one and the further cleaned one. So you can compare. 76 GB in total.

Oh and extra PDF with results, but that is 300k.
Thanks for clarifying, so, I deleted Cosan, and left only your archives. Thanks again for sharing.
 

Users who are viewing this thread

Home Register
Top Bottom