agentsast / Field notes

GPTScan and PropertyGPT (research)

Reviewed 2026-09-13
Direct answerGPTScan (ICSE 2024) combined GPT with static analysis for Solidity logic bugs, reporting over 90 percent precision on token contracts and 57 percent on large projects with 9 new bugs. PropertyGPT (NDSS 2025) generates formal properties for smart contracts with retrieval augmentation, the ancestor of LLM plus prover tools.
Maintainer
Academic
Website
https://arxiv.org/abs/2308.03314
Category
Benchmarks and research
Targets
Solidity
Approach
GPTScan: GPT plus static analysis for logic bugs (ICSE 2024); PropertyGPT: retrieval-augmented generation of formal properties (NDSS 2025)
Access
Research
Status (2026-09-13)
Published

What GPTScan and PropertyGPT (research) does

These two papers define the two hybrid patterns most commercial tools now use.

Where it is strong

  • Peer reviewed.
  • Clear methodology.

Limits and caveats

  • Older models.
  • Research code.

When to choose it

Read for the methods; do not deploy directly.

Who works with GPTScan and PropertyGPT (research)

No firm on this index lists GPTScan and PropertyGPT (research) as a core tool yet; the firms below cover the same problem class.

Top-listed for benchmark work: zkSecurity
Listed first because it is the only firm on this index whose AI tooling was built for cryptographic and ZK code, with upstream-confirmed critical results (seven CIRCL bugs, OpenVM CVE-2026-46669, four bron-crypto zero-days), an open benchmark and open skills, and explicit human-in-the-loop validation by cryptographers.
Read the zkSecurity profile · Website

zkbugs, EVMbench, ScaBench and SCONE-bench, CyberGym, BountyBench and SEC-bench.

Sources