rsmangler-1.5+git20190724.1.e85da7d/README.md0000644000000000000000000001176113516016005015670 0ustar 00000000000000RSMangler: Take a wordlist and mangle it ======================================== Copyright(c) 2017, Robin Wood https://digi.ninja Version 1.5 RSMangler will take a wordlist and perform various manipulations on it similar to those done by John the Ripper with a few extras. The main new feature is permutations mode which takes each word in the list and combines it with the others to produce all possible permutations (not combinations, order matters). For example the words freds, fresh, fish will produce the following list: ``` freds fresh fish fredsfresh fredsfish freshfreds freshfish fishfreds fishfresh fredsfreshfish fredsfishfresh freshfredsfish freshfishfreds fishfredsfresh fishfreshfreds ``` It also creates an acronym from the words in order, for example the terms ``` proactive security management ``` would give the acronym "psm". This acronym is then added to the list of terms used in the rest of the mangling. Each of these new words is then subject to the other mangles, because of this I strongly recommend with permutations mode enabled (default) you use a very small wordlist, 3 start words create a final list containing 5345 words and 5 start words creates a list containing 108557. As a test we tried it with a few hundred words and gave up when the process memory usage hit 3G. If you try to use a file with more than 5 words you will get a warning and the option to abort. Other mangles include adding the numbers 1 to 123 to the start and end, 01 to 09 to the start and end, various case manipulations, leet speak, word reversal, ed and ing on the end and doubling words up. New mangles in 1.1 are adding all years between 1990 and this year to the start and end and adding sys, admin, pw and pwd to the start and end. The initial wordlist can either be specified as a file or can be piped in through STDIN. Output goes to STDOUT (screen) by default but can be sent to a file through the --output parameter. By default, the script does not output any duplicate mangled words. Prior to version 1.5, this was done by caching all the mangled words in memory and, before sending the words to screen, using the uniq function to strip any duplicates. This caused the app to use up a lot of memory as it had to store potentially thousands of strings before finally running the output. At a sugestion by Thomas d'Otreppe, the app now generates a CRC32 of each word and, if it has not seen the value before, sends it to be output and stores the CRC. If it has seen it, then it just drops the word. This allows the mangled words to be output as soon as they are generated while keeping memory usage to a minimum as it only requires the storage of a single integer per word rather than a full string. The option to remove duplicates can also be disabled, this makes for faster output and removes memory usage. Installation ============ Just make the script executable, it doesn't rely on any gems or anything external. Usage ===== Note, all mangle options are ON by default, these parameters turn them OFF. ``` rsmangler.rb [OPTION] --help, -h: show help --file, -f: the input file, use - for STDIN --perms, -p: permutate all the words --double, -d: double each word --reverse, -r: reverser the word --leet, -t: l33t speak the word --full-leet, -T: all posibilities l33t --capital, -c: capitalise the word --upper, -u: uppercase the word --lower, -l: lowercase the word --swap, -s: swap the case of the word --ed, -e: add ed to the end of the word --ing, -i: add ing to the end of the word --punctuation: add common punctuation to the end of the word --pna: add 01 - 09 to the end of the word --pnb: add 01 - 09 to the beginning of the word --na: add 1 - 123 to the end of the word --nb: add 1 - 123 to the beginning of the word --years: add all years from 1990 to current year to start and end --acronym: create an acronym based on all the words entered in order and add to word list --common: add the following words to start and end: admin, sys, pw, pwd --force: don't give the warning about list length --allow-duplicates - allow duplicates in the output list ``` Change Log ========== - 28.09.2017 - v1.5 - Stopped caching output in memory - Added the option to allow duplicate in output - Uses less memory - Added the option to output to file - Improved the leet conversions - 23.10.2012 - v1.4 - Added full leetspeak option, thanks Felipe Molina (@felmoltor) - Added Support for ruby 1.9.x - 24.08.2010 - v1.1 - Added three new mangles - years, acronym, and common. - 13.07.2010 - v1.0 - Initial release Licence ======= This project released under the Creative Commons Attribution-Share Alike 2.0 UK: England & Wales ( http://creativecommons.org/licenses/by-sa/2.0/uk/ ) Credits ======= - Thanks to Thomas d'Otreppe for helping bring the project back to life after 5 years of neglect. - Thanks to Felipe Molina for the initial l33t speak functions. - Credit to Gavin Watson who had the original idea for this project. Bugs, Comments, Feedback ======================== Feel free to get in touch, robin@digi.ninja rsmangler-1.5+git20190724.1.e85da7d/rsmangler.rb0000755000000000000000000002234713516016005016735 0ustar 00000000000000#!/usr/bin/env ruby #encoding: UTF-8 # == RSMangler: Take a wordlist and mangle it # # RSMangler will take a wordlist and perform various manipulations on it similar to # those done by John the Ripper with a few extras, the main one being permutations mode # which takes each word in the list and combines it with the others to produce all # possible permutations (not combinations, order matters). # # See the README for full information # # Original Author:: Robin Wood (robin@digi.ninja) # Version:: 1.5 alpha # Copyright:: Copyright(c) 2017 Robin Wood - https://digi.ninja # Licence:: Creative Commons Attribution-Share Alike 2.0 # # Changes: # 1.5 alpha - Working on writing straight to disk rather than to STDOUT # 1.4 - Added full leetspeak option, thanks Felipe Molina (@felmoltor) # require 'date' require 'getoptlong' require 'zlib' # The left hand character is what you are looking for # and the right hand array is the one you are replacing it # with leet_swap = { 's' => ['$', 'z'], 'e' => ['3'], 'a' => ['4', '@'], 'o' => ['0'], 'i' => ['1', '!'], 'l' => ['1', '!'], 't' => ['7'], 'b' => ['8'], 'z' => ['2'], } # Common words to append and prepend if --common is allowed common_words = [ 'pw', 'pwd', 'admin', 'sys' ] opts = GetoptLong.new( ['--help', '-h', GetoptLong::NO_ARGUMENT], ['--file', '-f', GetoptLong::REQUIRED_ARGUMENT], ['--output', '-o', GetoptLong::REQUIRED_ARGUMENT], ['--min', '-m', GetoptLong::REQUIRED_ARGUMENT], ['--max', '-x', GetoptLong::REQUIRED_ARGUMENT], ['--perms', '-p', GetoptLong::NO_ARGUMENT], ['--double', '-d', GetoptLong::NO_ARGUMENT], ['--reverse', '-r', GetoptLong::NO_ARGUMENT], ['--leet', '-t', GetoptLong::NO_ARGUMENT], ['--full-leet', '-T', GetoptLong::NO_ARGUMENT], ['--capital', '-c', GetoptLong::NO_ARGUMENT], ['--upper', '-u', GetoptLong::NO_ARGUMENT], ['--lower', '-l', GetoptLong::NO_ARGUMENT], ['--swap', '-s', GetoptLong::NO_ARGUMENT], ['--ed', '-e', GetoptLong::NO_ARGUMENT], ['--ing', '-i', GetoptLong::NO_ARGUMENT], ['--punctuation', GetoptLong::NO_ARGUMENT], ['--years', '-y', GetoptLong::NO_ARGUMENT], ['--acronym', '-a', GetoptLong::NO_ARGUMENT], ['--common', '-C', GetoptLong::NO_ARGUMENT], ['--pnb', GetoptLong::NO_ARGUMENT], ['--pna', GetoptLong::NO_ARGUMENT], ['--nb', GetoptLong::NO_ARGUMENT], ['--na', GetoptLong::NO_ARGUMENT], ['--force', GetoptLong::NO_ARGUMENT], ['--space', GetoptLong::NO_ARGUMENT], ['--allow-duplicates', GetoptLong::NO_ARGUMENT], ['-v', GetoptLong::NO_ARGUMENT] ) def good_call puts puts 'Good call, either reduce the size of your word list or use the --perms option to disable permutations' puts exit end def leet_variations (str, swap) swap_all = Hash.new { |_,k| [k] }.merge(swap) arr = swap_all.values_at(*str.chars) arr.shift.product(*arr).map(&:join) end # Display the usage def usage puts 'rsmangler v 1.5 Robin Wood (robin@digi.ninja) Basic usage: ./rsmangler.rb --file wordlist.txt To pass the initial words in on standard in do: cat wordlist.txt | ./rsmangler.rb To send the output to a file: ./rsmangler.rb --file wordlist.txt --output mangled.txt All options are ON by default, these parameters turn them OFF Usage: rsmangler.rb [OPTION] --help, -h: show help --file, -f: the input file, use - for STDIN --output, -o: the output file, use - for STDOUT --max, -x: maximum word length --min, -m: minimum word length --perms, -p: permutate all the words --double, -d: double each word --reverse, -r: reverser the word --leet, -t: l33t speak the word --full-leet, -T: all posibilities l33t --capital, -c: capitalise the word --upper, -u: uppercase the word --lower, -l: lowercase the word --swap, -s: swap the case of the word --ed, -e: add ed to the end of the word --ing, -i: add ing to the end of the word --punctuation: add common punctuation to the end of the word --years, -y: add all years from 1990 to current year to start and end --acronym, -a: create an acronym based on all the words entered in order and add to word list --common, -C: add the following words to start and end: admin, sys, pw, pwd --pna: add 01 - 09 to the end of the word --pnb: add 01 - 09 to the beginning of the word --na: add 1 - 123 to the end of the word --nb: add 1 - 123 to the beginning of the word --force: don\'t check output size --space: add spaces between words --allow-duplicates: allow duplicates in the output list ' exit end # The uniq_crcs array contains a crc of all words previously written, # this should prevent duplicates being written out to the file def puts_if_allowed(word) if not @max_length.nil? or not @min_length.nil? if not @min_length.nil? if word.length < @min_length return end end if not @max_length.nil? if word.length > @max_length return end end end if @deduplicate crc = Zlib::crc32(word) if not @uniq_crcs.include?(crc) @uniq_crcs << crc @output_handle.puts(word) end else @output_handle.puts(word) end @output_handle.flush end verbose = false leet = true full_leet = true perms = true double = true reverse = true capital = true upper = true lower = true swap = true ed = true ing = true punctuation = true years = true acronym = true common = true pna = true pnb = true na = true nb = true force = false space = false input_file_handle = nil @min_length = nil @max_length = nil @deduplicate = true @output_handle = STDOUT @uniq_crcs = [] @debug = false begin opts.each do |opt, arg| case opt when '--help' usage when '--output' if arg == '-' @output_handle = STDOUT else begin @output_handle = File.new(arg, 'w') rescue Errno::EACCES puts "Could not create the output file" exit end end when '--file' if arg == '-' input_file_handle = STDIN else if File.exist? arg input_file_handle = File.new(arg, 'r') else puts 'The specified file does not exist' exit end end when '--allow-duplicates' @deduplicate = false when '--max' @max_length = arg.to_i when '--min' @min_length = arg.to_i when '--leet' leet = false when '--full-leet' full_leet = false when '--perms' perms = false when '--double' double = false when '--reverse' reverse = false when '--capital' capital = false when '--upper' upper = false when '--lower' lower = false when '--swap' swap = false when '--ed' ed = false when '--ing' ing = false when '--common' common = false when '--acronym' acronym = false when '--years' years = false when '--punctuation' punctuation = false when '--pna' pna = false when '--pnb' pnb = false when '--na' na = false when '--nb' nb = false when '--space' space = true when '--force' force = true when '-v' verbose = true end end rescue => e puts e usage exit end if input_file_handle.nil? puts 'No input file specified' puts usage exit end file_words = [] puts "Loading in the list" if @debug while (word = input_file_handle.gets) word = word.chomp! next if word.empty? file_words << word end input_file_handle.close if !force and perms and file_words.length > 5 puts '5 words in a start list creates a dictionary of nearly 100,000 words.' puts 'You have ' + file_words.length.to_s + ' words in your list, are you sure you wish to continue?' puts 'Hit ctrl-c to abort' puts interrupted = false trap('INT') { interrupted = true } 5.downto(1) do |i| print i.to_s + ' ' STDOUT.flush sleep 1 good_call if interrupted end good_call if interrupted end wordlist = [] if perms puts "Generating the permutations" if @debug for i in (1..file_words.length) file_words.permutation(i) do |c| perm = c.join wordlist << perm puts_if_allowed(perm) end end else wordlist = file_words end puts "Permutations generated" if @debug acro = nil if acronym puts "Generating the acronyms" if @debug acro = '' file_words.each do |c| acro += c[0, 1] end puts_if_allowed(acro) wordlist << acro end puts "Doing the mangling" if @debug wordlist.each do |x| results = [] results << x + x if double results << x.reverse if reverse results << x.capitalize if capital results << x.downcase if lower results << x.upcase if upper results << x.swapcase if swap results << x + 'ed' if ed results << x + 'ing' if ing if common common_words.each do |word| results << word + x results << x + word end end if full_leet leetarr = leet_variations(x, leet_swap) leetarr.each do |leetvar| results << leetvar end else # Only look at doing this if full leet is not enabled # Have to clone it otherwise the assignment is done # by reference and the gsub! updates both x and all_swapped all_swapped = x.clone if leet leet_swap.each_pair do |find, rep| all_swapped.gsub!(/#{find}/, rep) results << x.gsub(/#{find}/, rep) end results << all_swapped end end if punctuation for i in ('!@$%^&*()'.scan(/./)) results << x + i.to_s end end if years for i in (1990..2020) results << i.to_s + x results << x + i.to_s end end if pna || pnb for i in (1..9) results << '0' + i.to_s + x if pnb results << x + '0' + i.to_s if pna end end if na || nb for i in (1..123) results << i.to_s + x if nb results << x + i.to_s if na end end results.uniq! results.each do |res| puts_if_allowed(res) end end