Memory testing
How can I test cross-conversation AI memory?
Use a harmless, fictional preference and a new conversation to check whether relevant context carries over. Record whether a memory was saved, whether memory is enabled and whether the answer is accurate. One answer is not a reliability benchmark.
A repeatable demonstration
This is a test procedure, not a completed product evaluation or a measured success rate. Use your own test account and fictional information.
- Enable memory and record the app version and test date.
- In one conversation, state a preference such as preferring museums to shopping on trips.
- Allow processing time and inspect whether the preference appears in saved memories.
- Start a new chat and ask for a day-trip plan without repeating the preference.
- Check whether the answer uses the preference appropriately and avoids inventing personal details.
Compare the switch settings
Turn memory off on the test account and repeat in a new conversation. Existing entries are not deleted by switching it off. Custom instructions and the current message may also affect answers, so record those conditions. Do not clear real personal data just to run a test.
Record more than the best answer
- Track memory formation, use and accuracy separately.
- Repeat with several harmless preferences and new conversations.
- Keep failures and original answers so omissions can be reproduced.
Updated September 17, 2026