Ercin Dedeoglu PRO

Ercin

AI & ML interests

AI Architect. Sovereign LLM, RAG and agentic AI for regulated banking. LLM red teaming before go-live: open scorer + checklist. ercin.info

Recent Activity

updated a Space about 9 hours ago

Ercin/llm-red-teaming-banking-severity-scorer

commentedon a paper about 11 hours ago

Identically Trained Language Models Break on Different Jailbreaks

commentedon a paper 1 day ago

Policy Is Not Capability: Some Safety Benchmarks Measure Which Definition of "Unsafe" You Trained On

View all activity

Organizations

updated a Space about 9 hours ago

LLM Red Teaming for Banking Severity Scorer

🏦

Score LLM red team findings for UAE bank go-live

commented a paper about 11 hours ago

Identically Trained Language Models Break on Different Jailbreaks

Paper • 2610.34074 • Published 5 days ago •

commented a paper 1 day ago

Policy Is Not Capability: Some Safety Benchmarks Measure Which Definition of "Unsafe" You Trained On

Paper • 2610.25060 • Published 12 days ago • 18 •

commented a paper 2 days ago

Policy Is Not Capability: Some Safety Benchmarks Measure Which Definition of "Unsafe" You Trained On

Paper • 2610.25060 • Published 12 days ago • 18 •

posted an update 3 days ago

Post

BIG news for UAE banks. The CBUAE Guidance Note on AI names Large Language Models in its GenAI definition. The CBUAE Rulebook says it was "Issued on 11/2/2026".

Clause 2(b) says "LFIs should not employ AI models that they have no control over." Clause 6(f) asks for "the clear and immediate ability, with human intervention, to cease use". That is a real kill switch. Tested.

The word "agent" never appears in the note. But the UAE Cabinet announced a framework "aiming to transform 50% of UAE Government sectors and services within two years to Agentic AI". Agents are coming. Govern them FIRST.

I mapped ten clauses a GenAI or agent team will touch, with the note's own words and a checklist for Monday:
https://huggingface.co/blog/Ercin/cbuae-ai-guidance-note-generative-ai

Which clause is hardest for your bank to evidence today?

commented a paper 3 days ago

FinRED: An Expert-Guided Benchmark Generation and Evaluation Framework for Financial LLM Red-Teaming

Paper • 2606.19887 • Published 18 days ago •

commented a paper 4 days ago

Risk-Adjusted Harm Scoring for Automated Red Teaming for LLMs in Financial Services

Paper • 2603.10807 • Published Aug 31 •

posted an update 4 days ago

Post

Look. Most bank LLM red team reports are a list of "jailbreaks found". Binary. Useless for a go-live call. WRONG!

So I built the fix. Open. Free.

The LLM Red Teaming for Banking Severity Scorer: nine harm categories (seven mapped to the OWASP LLM Top 10 2025), a severity ladder and five go/no-go gates. Open Criticals at go-live? NO launch. Period.

Now there are 60 synthetic findings for three invented bank LLM systems in the same schema, so you can watch the gates fire BEFORE your real findings touch it. No attack prompts. No model calls. No real bank data.

English finding with no Arabic test in the same category? Flagged. High finding with no named owner? Fails the gate. Tough. Fair.

Try it, break it, tell me which gate is wrong:
Ercin/llm-red-teaming-banking-severity-scorer
Ercin/synthetic-llm-red-teaming-findings-banking