By modifying a classical neural network, we introduced a new model inspired by biology which shows improved memory performance. It helps modeling brain processes and may eventually improve AI-based language tools such as ChatGPT.