Skip to content
Cisent Message us on WhatsAppMessage us

Manthys · cybersecurity

Sentinel

It reads the attack like an analyst: logs, vulnerabilities, ATT&CK techniques and the incident report. Without fabricating a fact that must come from a source.

ATT&CK technique extraction

72.44F1

The best figure published by another specialist is 49.1.

Sentinel Ultra 2 on CTI-Bench (CTI-ATE, 60 reports). 49.1: Cisco's Foundation-Sec-8B-Reasoning (arXiv 2601.21051).

Where it shows most

ATT&CK technique extraction and CTI-Bench.

CTI-ATE · ATT&CK technique extraction (F1, 60 reports)

Manthys Sentinel Ultra 272.44
Cisco Foundation-Sec Reasoning49.1

CTI-Bench · average of its four tasks

Manthys Sentinel Ultra 275.13
Manthys Sentinel Pro 269.16
Trend Micro Llama-Primus63.85
Manthys Sentinel Lite 258.45
DeepHat V252.30
GPT-OSS-120B48.90
Llama 4 Scout39.70

F1 from 0 to 100. 49.1 is the best figure published by another specialist (Cisco, arXiv 2601.21051).

Average of CTI-MCQ, CTI-RCM, CTI-ATE and CVSS, from 0 to 100. For other models, the figures DeepHat publishes, including those for GPT-OSS-120B and Llama 4 Scout, and Llama-Primus's model card.

Against the market

Against the cybersecurity models on the market.

The average of four third-party benchmarks: CTI-MCQ, CTI-RCM, SecEval and CyberMetric. Sentinel Lite 2, at 4B, performs like the 8B models.

Manthys Sentinel Ultra 2 27B79.20
Cisco Foundation-Sec Reasoning 8B78.38
Manthys Sentinel Pro 2 9B72.51
Manthys Sentinel Lite 2 4B68.34
Trend Micro Llama-Primus 8B68.32
Cisco Foundation-Sec Instruct 8B67.63
DeepHat V1 7B61.64

Scale of 0 to 100. Cisent's figures measured by Cisent. For other models, the figures Cisco publishes for its reasoning model (arXiv 2601.21051) and those a third party measured with a single harness (arXiv 2510.14113). Each model with its own protocol.

Benchmark by benchmark

Where each one wins.

Each benchmark in a row and each model as a dot, the others' too.

  • Manthys Sentinel Ultra 2
  • Manthys Sentinel Pro 2
  • Manthys Sentinel Lite 2
  • Cisco Foundation-Sec Reasoning
  • Trend Micro Llama-Primus
  • Cisco Foundation-Sec Instruct
  • DeepHat V1

CTI-MCQthreat intelligence

CTI-RCMvulnerability root cause

SecEvalsecurity knowledge

CyberMetriccybersecurity knowledge

Average of the fourthe ranking's index

From 30 to 100. Filled dots are Cisent's models, measured by Cisent; hollow ones, the figures their authors publish (Cisco, arXiv 2601.21051) or a third party measured with a single harness (arXiv 2510.14113). Each model with its own protocol. Hover over a dot to see its figure; every figure is in the tables.

Sentinel judges. Husker decides.

Three models

Lite, Pro and Ultra.

Manthys Sentinel Ultra 2

79.20

average on CTI-MCQ, CTI-RCM, SecEval and CyberMetric, and 72.44 in ATT&CK technique extraction.

Manthys Sentinel Pro 2

69.16

average on CTI-Bench, above Llama-Primus (63.85) and what DeepHat publishes for its V2 (52.30).

Manthys Sentinel Lite 2

87.15

on the 2,000-question CyberMetric, the version the specialists publish on: they score between 84.0 and 85.1.

What it's for

The work of a defense team.

Triage.

It analyzes security alerts and logs.

Vulnerabilities.

It explains each one and maps it to CWE and to ATT&CK techniques.

Reports.

It drafts the incident report.

Security judge.

Inside Cisent, the model judges and Husker decides.

Sentinel Red Team runs on Manthys Sentinel models trained for red teaming.

Every figure

Sentinel's table.

A dash is a figure its author doesn't publish.

Cybersecurity

BenchmarkSentinel Ultra 2Sentinel Pro 2Sentinel Lite 2Cisco ReasoningLlama-PrimusCisco InstructDeepHat V1
CTI-MCQ74.7068.0068.70i69.1‡65.20†63.24†61.24†
CTI-RCM66.7063.3042.70i75.3‡63.90†67.95†68.10†
SecEval81.9971.1373.1484.8‡59.06†54.81†33.21†
CyberMetric93.4087.6088.8084.3‡85.10†84.50†84.00†
Average of the four79.2072.5168.3478.38‡68.32†67.63†61.64†
CTI-ATE · F172.4461.62p36.81i49.1‡———

† Measured by a third party with a single harness (arXiv 2510.14113); its CyberMetric is the 2,000-question version.

‡ What Cisco publishes for its reasoning model (arXiv 2601.21051): SecEval on 1,225 questions and the 2,000-question CyberMetric.

i With the evaluation system prompt · p With the production one.

Cisent measures SecEval on all 2,182 questions and CyberMetric on the 500-question version. A dash is a figure its author doesn't publish.

Cisent's figures measured by Cisent between September 19 and October 11, 2026. For other models, only published figures: by their authors (Cisco, arXiv 2601.21051; DeepHat; Llama-Primus's model card) or by a third party with a single harness (arXiv 2510.14113). Each model with its own protocol.

Manthys

The other families.

Manthys Mind · generalist

It says “I don't know” when it doesn't know.

Explore Mind

Manthys Nova · the largest scale

It flags its doubt. So you can verify.

Explore Nova

Manthys Reflex · decisions

It decides what deserves the judge's attention.

Explore Reflex

Book a meeting with the Cisent team.

Tell us what your organization needs to protect. We'll reply on WhatsApp and set up the meeting.

Message us on WhatsApp and let's book a meeting

or write to info@cisent.ai