Systems and methods, and computer-readable media bearing instructions for carrying out methods of capturing notes from passive recording of an ongoing content stream and annotating the note with a category are presented. Passive recording comprises temporarily recording the most recent content of the ongoing content stream. An ongoing content stream is passively recorded in a passive recording buffer. The passive recording buffer is configured to store a limited amount of recorded content corresponding to the most recently recorded content of the ongoing content stream. Upon indication by the user, a note is generated from the recorded content in the passive recording, annotated with a category, and stored in a note file for the user.