Justin Bollinger fcfe6890f6 feat: add memory pre-checks and optimize PassGPT training for large wordlists ...

Training previously loaded entire wordlists into RAM and tokenized all at
once, causing OOM on large files like rockyou.txt. This adds memory
estimation, lazy dataset loading, and training optimizations.

- Add _get_available_memory_mb() for cross-platform RAM detection
- Add _estimate_training_memory_mb() to predict peak usage before loading
- Replace bulk tokenization with LazyPasswordDataset (file offset index + on-the-fly tokenization)
- Add --max-lines flag to limit training to first N lines
- Add --memory-limit flag to auto-tune --max-lines based on available RAM
- Enable gradient checkpointing and gradient accumulation (steps=4)
- Enable fp16 on CUDA devices

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

2026-02-18 10:47:44 -05:00

..

__init__.py

major refactor and version change to 2.0

2026-01-26 13:32:37 -05:00

conftest.py

major refactor and version change to 2.0

2026-01-26 13:32:37 -05:00

run_checks.py

major refactor and version change to 2.0

2026-01-26 13:32:37 -05:00

test_api.py

lots of refactoring around the menues and building out test cases

2026-02-05 13:52:06 -05:00

test_asset_path_separation.py

fix: separate hcatPath (hashcat dir) from hate_path (asset dir)

2026-02-12 20:23:12 -05:00

test_cli_menus.py

test: update CLI menu test strings to match recent changes

2026-02-06 09:39:07 -05:00

test_cli_weakpass.py

lots of refactoring around the menues and building out test cases

2026-02-05 13:52:06 -05:00

test_dependencies.py

lots of refactoring around the menues and building out test cases

2026-02-05 13:52:06 -05:00

test_docker_script_install.py

lots of refactoring around the menues and building out test cases

2026-02-05 13:52:06 -05:00

test_e2e_local_install.py

lots of refactoring around the menues and building out test cases

2026-02-05 13:52:06 -05:00

test_fingerprint_expander_and_hybrid.py

Apply ruff formatting fixes

2026-02-09 20:08:51 -05:00

test_hashcat_rules.py

updated loopback logic and added testing

2026-02-06 14:37:37 -05:00

test_hashmob_connectivity.py

lots of refactoring around the menues and building out test cases

2026-02-05 13:52:06 -05:00

test_hashview_cli_subcommands_subprocess.py

fix: overhaul Hashview download flow and fix hashcat --show stderr pollution

2026-02-13 19:11:51 -05:00

test_hashview_cli_subcommands.py

fix: overhaul Hashview download flow and fix hashcat --show stderr pollution

2026-02-13 19:11:51 -05:00

test_hashview.py

fix: resolve Hashview wordlist downloads to configured directory

2026-02-17 11:05:23 -05:00

test_installed_tool_execution.py

lots of refactoring around the menues and building out test cases

2026-02-05 13:52:06 -05:00

test_invalid_hcatpath.py

fix: separate hcatPath (hashcat dir) from hate_path (asset dir)

2026-02-12 20:23:12 -05:00

test_ntlm_preprocessing_edge_cases.py

test: add comprehensive pwdump filter pipeline and edge case tests

2026-02-17 12:53:20 -05:00

test_ntlm_preprocessing.py

feat: add computer account filtering for NetNTLM hash types (5500/5600)

2026-02-17 13:23:36 -05:00

test_omen_attack.py

feat: add startup version check, fix PassGPT MPS/output issues, hide menu without ML deps

2026-02-18 09:32:40 -05:00

test_passgpt_attack.py

feat: add memory pre-checks and optimize PassGPT training for large wordlists

2026-02-18 10:47:44 -05:00

test_pipal_integration.py

lots of refactoring around the menues and building out test cases

2026-02-05 13:52:06 -05:00

test_pipal.py

lots of refactoring around the menues and building out test cases

2026-02-05 13:52:06 -05:00

test_pull_ollama_model.py

fix: add missing rulesDirectory mock in ollama 404 retry test

2026-02-13 22:25:48 -05:00

test_submodule_hashcat_utils.py

lots of refactoring around the menues and building out test cases

2026-02-05 13:52:06 -05:00

test_ui_menu_options.py

feat: add PassGPT attack (#17) - GPT-2 based ML password generator

2026-02-18 08:41:22 -05:00

test_upload_cracked_hashes.py

lots of refactoring around the menues and building out test cases

2026-02-05 13:52:06 -05:00

test_upload_wordlist.py

lots of refactoring around the menues and building out test cases

2026-02-05 13:52:06 -05:00

test_utils.py

Apply ruff formatting fixes

2026-02-09 20:08:51 -05:00

test_uv_tool_install_dryrun.py

lots of refactoring around the menues and building out test cases

2026-02-05 13:52:06 -05:00

test_version_check.py

feat: add startup version check, fix PassGPT MPS/output issues, hide menu without ML deps

2026-02-18 09:32:40 -05:00