Commit Graph

1002 Commits

Author SHA1 Message Date
Willi Ballenthin 2c12cbb485 tests: add data-driven test fixtures for rule matcher (#2987) 2026-06-11 13:42:29 +02:00
Willi Ballenthin 8a18bd0e54 tests: add more granular ELF OS detection tests, data-driven (#3098)
to better support ports of this logic to other languages/runtimes
2026-06-11 10:18:14 +02:00
Willi Ballenthin ccf3a87e83 tests: add snapshot tests for feature extraction (#3069)
Introduces data-driven snapshot tests that regenerate capa freeze files
for a curated set of samples in the tests/data submodule and compare the
bytes against committed fixtures under tests/fixtures/freezes/. Any
change that perturbs feature extraction surfaces as a test failure with
a feature-count delta and a truncated unified diff.
2026-06-09 23:28:49 +02:00
lakshit verma adffa80e8f ida: show addresses for file level features in rulegen (#3009)
* ida: show addresses for file level features in rulegen

* ida(ai): remove redundant `int` conversion

Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

---------

Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Moritz <mr-tz@users.noreply.github.com>
2026-06-05 11:32:46 +02:00
Ange Albertini 7f458f1844 updated Changelog (RVA deprecation) 2026-05-28 13:23:28 +00:00
Capa Bot 7e00d2882e Sync capa rules submodule 2026-05-21 07:02:20 +00:00
Capa Bot c4e272ae75 Sync capa rules submodule 2026-05-20 09:08:30 +00:00
Capa Bot 1fd598e259 Sync capa rules submodule 2026-05-20 07:09:28 +00:00
Mike Hunhoff a98fd8240e fix duplicate rule candidate evaluation in optimized matching engine (#3080)
* fix duplicate rule candidate evaluation in optimized matching engine

* update CHANGELOG

* update comments
2026-05-18 17:40:55 -06:00
Mike Hunhoff ced180ddbc perf: optimize all_zeros using fast bytes comparison (#3078)
* perf: optimize all_zeros using fast bytes comparison
2026-05-18 10:20:10 +02:00
Mike Hunhoff db0e1536ce incorrect bytes() constructor usage in buf_filled_with (#3077) 2026-05-16 13:14:24 +02:00
Mike Hunhoff bbe050437b remove redundant code related to cli loading (#3076)
* remove unnecessary os_ argument from capa.loader.collect_metadata

* remove redundant limitation check in main.py

* update CHANGELOG

* Update CHANGELOG.md
2026-05-15 15:20:46 -06:00
Capa Bot 7e06ba0ffe Sync capa rules submodule 2026-05-15 19:12:21 +00:00
Capa Bot d889085aad Sync capa rules submodule 2026-05-15 18:22:47 +00:00
Capa Bot cb5f56a02c Sync capa rules submodule 2026-05-15 14:06:20 +00:00
Capa Bot 5e8d8ac994 Sync capa rules submodule 2026-05-15 10:32:59 +00:00
Willi Ballenthin 2cd07666bf changelog 2026-05-11 11:14:28 +02:00
Willi Ballenthin 8fca21f808 linter: validate dynamic example offsets
closes #3058
2026-05-08 17:58:07 +02:00
Willi Ballenthin 555bbdecda fix: guard getByteDef against None for unmapped addresses in viv insn extractor 2026-05-08 17:58:07 +02:00
Willi Ballenthin c8d47085ee fix: remove unused imports from cache-ruleset.py, detect-binexport2-capabilities.py, show-capabilities-by-function.py
Removes capa.engine, capa.helpers, capa.features, and capa.features.insn
imports that were never referenced in each script. Adds missing capa.loader
import to show-capabilities-by-function.py which was already being used.
2026-05-08 17:58:07 +02:00
Willi Ballenthin 7a8a0acaa9 fix: remove dead except ValueError clause in capa2sarif.py so JSONDecodeError is caught correctly
json.JSONDecodeError is a subclass of ValueError, so the broader except ValueError
was shadowing the more specific handler, making it unreachable. Keep only the
specific except json.JSONDecodeError handler.
2026-05-08 17:58:07 +02:00
Willi Ballenthin 7d8714098c fix: dedent bulk-process.py main() body so explicit argv is used
The entire main() body was indented inside `if argv is None:`, causing
main() to silently return None when called with an explicit argv list.

Closes SURF-90.
2026-05-08 17:58:07 +02:00
Willi Ballenthin a938c87fa4 fix: guard statistics calls in compare-backends.py against empty duration lists
When all runs for a backend fail, durations_by_backend[backend] is empty,
causing StatisticsError from statistics.quantiles (needs >= 2 points) and
statistics.mean (needs >= 1 point). Print placeholder messages instead.
2026-05-08 17:58:07 +02:00
Willi Ballenthin 604fae3519 fix: replace zipfile with pyzipper in minimize_vmray_results.py so output archive is AES-encrypted
zipfile.ZipFile.setpassword() only affects reads; writing encrypted entries requires pyzipper with WZ_AES encryption. Add pyzipper to scripts optional dependencies.
2026-05-08 17:58:07 +02:00
Willi Ballenthin e474e477f1 fix: assign yara_strings/yara_condition to empty string when Some has cmin=0 to prevent UnboundLocalError 2026-05-08 17:58:07 +02:00
Willi Ballenthin ae4c2ec82d fix: parenthesize s_type checks in capa2yara so kid.name guard applies to And/Or/Not uniformly
Without parentheses, Python's operator precedence caused `kid.name != "Some"`
to only guard the `Not` branch; `And` and `Or` kids named `"Some"` would
bypass the Some-handling block and enter recursive convert_rule unguarded.
2026-05-08 17:58:07 +02:00
Willi Ballenthin fc7f0533d7 fix: correct operator precedence in FeatureRegexRegistryControlSetMatchIncomplete
The `or "currentcontrolset" in pat` branch triggered the lint for any
regex containing "currentcontrolset", even unrelated paths like
HKLM\Software\CurrentControlSet that don't need the system\\ fix.

Fix by requiring "system\\\\" in both branches of the condition.
2026-05-08 17:58:07 +02:00
Willi Ballenthin 861f3b8619 fix: FeatureRegexRegistryControlSetMatchIncomplete checks all Regex features
Dedent `return False` out of the `for` loop body so the method examines
every Regex feature instead of short-circuiting after the first one.
2026-05-08 17:58:07 +02:00
Willi Ballenthin bfa09f817b fix: guard MissingStaticScope and MissingDynamicScope against absent scopes dict
When rule.meta lacks a "scopes" key, rule.meta.get("scopes") returns None
and "static"/"dynamic" not in None raises TypeError, crashing lint_rule.
Add isinstance(scopes, dict) guard so both checks return False (no violation)
when scopes is absent, letting MissingScopes report the real problem.
2026-05-08 17:58:07 +02:00
Willi Ballenthin c5ae9be3e1 fix: MissingExampleOffset lint reads scopes.static instead of obsolete scope key
The check was reading rule.meta.get("scope") which no longer exists in the
current schema (replaced by scopes.static/scopes.dynamic), causing the lint
to never fire for function/basic-block rules missing example offsets.
2026-05-08 17:58:07 +02:00
Willi Ballenthin 4da1addfb3 fix: invert scope filter in import-to-ida.py so function-scope rules are annotated
The condition was skipping FUNCTION-scope rules instead of keeping them,
causing the script to never annotate any functions. Invert to match the
correct logic in import-to-bn.py.
2026-05-08 17:58:07 +02:00
Willi Ballenthin 74010ba03f fix: remove dead string literal in test_detect_duplicate_features
The triple-quoted string at lines 230-239 was never assigned and contained
an incomplete sentence ("The scripts"). Deleted entirely as the surrounding
code is self-explanatory.
2026-05-08 17:58:07 +02:00
Willi Ballenthin f93e342e74 fix: remove duplicate Rule.from_yaml call in test_scope_instruction_description 2026-05-08 17:58:07 +02:00
Willi Ballenthin ad538f7ac3 fix: remove unused imports from test_freeze_dynamic.py
Remove capa.helpers, capa.features.basicblock (never referenced), and
redundant bare capa.features.extractors.base_extractor (covered by the
from-import on the next line).

Closes SURF-78
2026-05-08 17:58:07 +02:00
Willi Ballenthin cb1951dd90 fix: correct test_json_meta loop to iterate list of function dicts and use correct serialized address format for matched_basic_blocks assertion 2026-05-08 17:58:07 +02:00
Willi Ballenthin f11c99d0e4 fix: remove unreachable StaticAnalysis assert in assert_meta and cover dynamic proto path
Removes the bare `assert isinstance(meta.analysis, rd.StaticAnalysis)` that
blocked dynamic ResultDocument from being validated, removes the incorrect
direct list comparison in assert_dynamic_analyis, and adds dynamic_a0000a6_rd
to test_doc_to_pb2 so the dynamic proto serialization path is exercised.
2026-05-08 17:58:07 +02:00
Willi Ballenthin 8952151c97 fix: correct self-comparison sa.max == sa.max to sa.max == sb.max in test_proto
RangeStatement.max was compared against itself, so a protobuf round-trip
that corrupted the max field would pass undetected. Fix to compare against
the protobuf counterpart sb.max.
2026-05-08 17:58:07 +02:00
Willi Ballenthin 5776bad371 fix: guard parse_node against missing "type" key to avoid TypeError crash
When "type" is absent from node_data, node_data.get(None) returns None
and "description" in None raises TypeError. Guard with early returns.

Closes SURF-73
2026-05-08 17:58:07 +02:00
Willi Ballenthin 5e3cf87f25 fix: allocate feat_dict per feature in parse_json to avoid shared-reference aliasing
Previously, a single feat_dict was allocated before the inner loop and
the same object reference was appended on every iteration, causing all
sub-match entries to be identical by the end of the loop.

Closes SURF-72
2026-05-08 17:58:07 +02:00
Willi Ballenthin f5383da728 fix: add missing capa.features.extractors.elf import to ghidra and ida helpers
Without this import, any ELF analysis via the Ghidra or IDA plugin raises
AttributeError: module 'capa.features.extractors' has no attribute 'elf'.
2026-05-08 17:58:07 +02:00
Willi Ballenthin 7406e75f96 fix: remove dead view_tab_rulegen assignment from CapaExplorerForm
self.view_tab_rulegen = None was assigned but never read or reassigned anywhere in the codebase. All other attributes in the same block are type-annotated declarations; this one was an actual assignment with no purpose.
2026-05-08 17:58:07 +02:00
Willi Ballenthin ce8cecc059 fix: remove dead reset_query method from CapaExplorerSearchProxyModel
The method delegated to set_query("") but had zero callers; existing
call sites in form.py already call set_query directly.
2026-05-08 17:58:07 +02:00
Willi Ballenthin 3538f8b85f fix: remove unused imports of capa.rules and capa.engine from view.py
Neither module was referenced anywhere in the file; removing them reduces
noise and eliminates unnecessary module load overhead.
2026-05-08 17:58:07 +02:00
Willi Ballenthin ba57a98194 fix: remove unused imports from capa/ida/plugin/form.py
capa.main, capa.render.json, and capa.features.extractors.ida.extractor
were imported but never referenced in the file, adding unnecessary
startup cost.
2026-05-08 17:58:07 +02:00
Willi Ballenthin 42ed5a4086 fix: remove dead trim_function_name from form.py that was never called 2026-05-08 17:58:07 +02:00
Willi Ballenthin f8429009e5 fix: replace get_file_md5/sha256 with version-aware shims in IDA helpers
Remove get_file_md5 and get_file_sha256 (which used different underlying
IDA APIs and duplicated normalization logic) and replace all call sites with
the existing retrieve_input_file_md5/sha256 shims that already handle
IDA <9 vs >=9 return-type differences consistently.
2026-05-08 17:58:07 +02:00
Willi Ballenthin 2eb2cb2e49 fix: rename dragEventEnter to dragEnterEvent in CapaExplorerRulegenEditor
Qt dispatches drag-enter events to dragEnterEvent; the misspelled method
dragEventEnter was dead code and its super() call would raise AttributeError
if ever reached.
2026-05-08 17:58:07 +02:00
Willi Ballenthin 1f6b9082a4 fix: guard against None in lessThan else-branch to prevent AttributeError when sorting empty cells 2026-05-08 17:58:07 +02:00
Willi Ballenthin 7f58fa097a fix: add explicit import capa.loader in ida plugin form.py
capa.loader.compute_layout was called without capa.loader being explicitly
imported; it worked only via capa.main's transitive import. Adding the
explicit import prevents a future AttributeError if import order changes.
2026-05-08 17:58:07 +02:00
Willi Ballenthin 412e6ad725 fix: initialize f=None before try in load_capa_function_results to prevent UnboundLocalError
If idaapi.get_func() raises before assignment, the except handler previously
referenced the unbound variable f, causing a secondary UnboundLocalError that
masked the original exception. Also handles the case where get_func() returns
None by falling back to idaapi.get_screen_ea() in the error log.
2026-05-08 17:58:07 +02:00