Despite utilizing both notes and lecture audio during lectures or online learning, learners experienced the inconvenience of having to repeatedly search through the entire lecture during the review phase to find the context in which specific note content was explained. Existing audio summarization methods merely condensed the lecture, often providing results that were disconnected from the structure of the notes actually written by the learner. Based on this awareness of the problem, we planned this project to implement a learning assistance AI agent that analyzes lecture audio and notes (PDF) together to reconnect lecture content based on the flow of the notes.

Despite utilizing both notes and lecture audio during lectures or online learning, learners experienced the inconvenience of having to repeatedly search through the entire lecture during the review phase to find the context in which specific note content was explained. Existing audio summarization methods merely condensed the lecture, often providing results that were disconnected from the structure of the notes actually written by the learner. Based on this awareness of the problem, we planned this project to implement a learning assistance AI agent that analyzes lecture audio and notes (PDF) together to reconnect lecture content based on the flow of the notes.