Selection over volume
Does a short, relevant memory set outperform a much larger context full of weakly related material?
MEMORY FOR SMALL LANGUAGE MODELS
Mnemosyne investigates the space between model capacity and the information system around it.
A smaller, task-specific context.
Does selection help?
THE RESEARCH BET
A small language model cannot become a large model by being given more text. But the right facts, previous decisions, examples and constraints may change the task it is being asked to solve. We are measuring exactly where that helps.
CORE QUESTION
Not “does RAG work?” A more specific question: what is the trade-off between internal parameter capacity and external contextual capacity for a real task?
THE STUDY DESIGN
BASELINE → MEMORY CONDITIONS → COMPARISONDoes a short, relevant memory set outperform a much larger context full of weakly related material?
Which tasks improve through context, and which still require capability that only model scale provides?
Where can a smaller system retain enough quality to make the trade-off in cost and latency worthwhile?
EXPERIMENTAL PROTOCOL
Prompt + parameters only.
Change selection, structure and amount of context.
Compare quality, cost and response time on the same work.
WHAT WE WILL NOT CLAIM
Mnemosyne is not built to declare that small models replace larger ones. The useful outcome is a map of the conditions where memory helps, where it fails, and what the system costs when it does.
See the rest of the lab ↗Interested in the research?
Talk to the Mnemosyne team. ↗