# Overview

Benchmark results for **Neocortex Mark 1** (`mk1`). All benchmarks compare Neocortex against other memory and RAG methods.

## Why Benchmarks Matter

Memory systems are only as good as the answers they help produce. These benchmarks test Neocortex across four dimensions: retrieval quality, temporal reasoning, needle-in-a-haystack recall, and real-world decision-making.

## Methods Compared

| Method            | Type                                               |
| ----------------- | -------------------------------------------------- |
| **neocortex\_v1** | GraphRAG with time-decay and interaction weighting |
| fastgraphrag      | Graph-based RAG                                    |
| e2graphrag        | Graph-based RAG                                    |
| gemini\_vdb       | Vector database (Gemini embeddings)                |
| mem0              | Memory layer                                       |
| supermemory       | Memory layer                                       |
| scratchpad        | Simple key-value store                             |
| directfeed        | Raw context window (no retrieval)                  |

## Evaluation Infrastructure

* **Judge model**: GPT-4o
* **RAGAS version**: 0.4.x
* **Chunking**: 1,200 tokens with 200-token overlap
* **Embedding model**: text-embedding-3-small
* **LLM for methods**: gpt-4o-mini

## Summary Results

| Benchmark                                                                         | What It Measures        | Neocortex Headline                  |
| --------------------------------------------------------------------------------- | ----------------------- | ----------------------------------- |
| [RAGAS](https://tinyhumans.gitbook.io/neocortex/benchmarks/ragas)                 | Retrieval quality       | **0.97** Answer Relevancy           |
| [TemporalBench](https://tinyhumans.gitbook.io/neocortex/benchmarks/temporalbench) | Temporal reasoning      | **100%** recency accuracy           |
| [BABILong](https://tinyhumans.gitbook.io/neocortex/benchmarks/babilong)           | Needle in a haystack    | **Only method** to retrieve needles |
| [Vending-Bench](https://tinyhumans.gitbook.io/neocortex/benchmarks/vending-bench) | Agentic decision-making | **\~$295** cumulative P\&L          |

<figure><img src="broken-reference" alt=""><figcaption></figcaption></figure>
