VIRTUAL EDUCATIONAL EXPERIENCE WITH 3D SOUND SPATIALIZATION

Abstract

The present invention discloses a multiple-choice-question based quiz platform facilitating the generation, development, delivery, and management of educational tests with interactive participation by students in terms of visual and audio guidance. The system utilizes 3D virtual sound spatialization and the movement and orientation of a mobile computing device to enhance the learning experience of users. Each quiz question and answer choice is associated with a certain orientation of the mobile device and a 3D virtual sound of a certain direction. By completing quizzes in this immersive 3D virtual sound environment, the user enhances his or her learning experience by making learning fun, and enhances his or her memory and retention of the learning content.

Claims

1. A method for doing a multiple-choice quiz using a mobile computing device and 3D virtual sound, the method compromising: displaying the question and answer choices on the screen of the mobile device, where the answer choices will change based on the heading or orientation of the device; reading the question and answer choices out aloud using 3D virtual sound, based on the heading of the mobile device; answering the question by clicking a button displayed on the screen of the mobile device, based on the heading of the device; providing feedback to the user through audio from the mobile device.

2. The method of claim 1, wherein displaying the question and answer choices on the screen of the mobile device, where the answer choices will change based on the heading or orientation of the device, an example implementation is displaying answer choice A when the mobile device is heading towards north, displaying answer choice B when the mobile device is heading towards west, displaying answer choice C when the mobile device is heading towards south, displaying answer choice D when the mobile device is heading towards east.

3. The method of claim 1, wherein reading the question and answer choices out aloud using 3D virtual sound, based on the heading of the mobile device, an example implementation is reading the question out aloud using 3D virtual sound so that the user feels that the sound is from up above, reading answer choice A so that the user feels that the sound is from his front, reading answer choice B so that the user feels that the sound is from his left, reading answer choice C so that the user feels that the sound is from his behind, reading answer choice D so that the user feels that the sound is from his right.

4. The method of claim 1, wherein answering the question by clicking a button displayed on the screen of the mobile device, based on the heading of the device, an example implementation is the button for correct answer choice A will appear on the screen only when the mobile device is heading towards north, the button for correct answer choice B will appear on the screen only when the mobile device is heading towards west, the button for correct answer choice C will appear on the screen only when the mobile device is heading towards south, the button for correct answer choice D will appear on the screen only when the mobile device is heading towards east.

5. The method of claim 1, wherein providing feedback to the user through audio from the mobile device, an example implementation is when the user answered the question correctly, he will hear a pleasant 3D virtual sound “yes, you answered correctly!” from up above; when the user answered the question incorrectly, he will hear a unpleasant 3D virtual sound “no, your answer was wrong!” from down below.

6. A system for creating and running quizzes using 3D virtual sound, comprising of: sound recording system for recording quiz questions and answer choices; sound editing and analysis system for analyzing and editing the sound recordings; integrated development environment, or IDE, to create quiz content and combine 3D virtual sound effect onto a mobile computing device; mobile computing device such as a smart phone or tablet that has gyroscope sensors and can detect the heading or orientation of the device; listening device connected to the mobile computing device to allow user access to 3D virtual sound effects; through sound editing system and IDE, associate the 3D virtual sound of the quiz question to up above direction, down below direction, or any other direction such as north, sound, west, east, so that the user feels that the sound is coining from that direction; through sound editing system and IDE, associate the 3D virtual sound of the quiz answer choice A to the front of the user while allowing the screen to display answer choice A only when the mobile device is heading towards north; through sound editing system and IDE, associate the 3D virtual sound of the quiz answer choice B to the left of the user while allowing the screen to display answer choice B only when the mobile device is heading towards west; through sound editing system and IDE, associate the 3D virtual sound of the quiz answer choice C to the behind of the user while allowing the screen to display answer choice C only when the mobile device is heading towards south; through sound editing system and IDE, associate the 3D virtual sound of the quiz answer choice D to the right of the user while allowing the screen to display answer choice D only when the mobile device is heading towards east; through sound editing system and IDE, associate the 3D virtual sound of the feedback to user's answer, such as “yes, you are correct”, or “no, you are wrong”, to a direction from up above, or down below, or from any other directions, with different tones.

7. The system in claim 6, wherein there are four answer choices A, B, C, D associated with four directions of north, west, south, east; but the system is not limited to these four answer choices. For example, there can be eight answer choices associated with eight directions of north, northwest, west, southwest, south, southeast, east, northeast.

8. The system in claim 6, wherein the sound recording system can include a Sennheiser ME 67 shotgun microphone, Sound Devices MM-1 Portable Preamp, and a K-Tec Avalon KE-89cc pole used to extend the microphone, or similar equipments from other manufacturers.

9. The system in claim 6, wherein the sound editing and analysis system can include a Sonic Visualizer for creating spectrogram to analyze sound waveforms, frequency ranges, and volume, and Audacity for editing sound, or other similar systems from other vendors.

10. The system in claim 6, wherein the integrated development environment to create quiz content and combine 3D virtual sound effect onto a mobile computing device can include XCode and Swift for iOS programming, or other similar systems from other mobile computing platforms.

Description

DETAILED DESCRIPTION

[0025] Detailed descriptions of the preferred embodiment are provided herein. It is to be understood, however, that the present invention may be embodied in various forms. Therefore, specific details disclosed herein are not to be interpreted as limiting, but rather as a basis for the claims and as a representative basis for teaching one skilled in the art to employ the present invention in virtually any appropriately detailed system, structure or manner.

[0026] One aspect of the present application is to leverage the wide availability of 3D virtual sound capability and gyroscope sensors in modern personal mobile devices in education. The virtual reality audio is an integral part of immersive educational experience, and sensors allows users to move and be active while learning. The proposed application combines both to provide an interactive environment for students to learn in.

[0027] The proposed application is intended to create an open platform which can support a diverse community of students and faculty, who can create their own content on the platform and customize the learning experience. The application includes physical activity as research proves that it maximizes memory and retention of the knowledge learned among student.

[0028] As per preferred embodiment of the invention the system provides the user a simple interface which allows them to practice quizzing for students to be able to advance their knowledge of a subject and prepare for future examinations.

[0029] The system as per its further embodiments allows teachers and educators to design and upload their specific content in their respective subject field. Therefore, their students will be able to leverage the unique virtual sound and motion based immersive learning experience provided by the system.

[0030] The system includes a mobile computing device, a pair of stereo headphones connected to the mobile device, and a mobile application software, or app, running on the mobile device. Multiple quizzes corresponding to different subjects are included in the app. Each quiz can be part of a subject (e.g. “Physics” or “Spanish”). A quiz can be accessed by either clicking and entering the quiz directly through a list or by choosing and entering a subject and then clicking the quiz from the list of quizzes belonging to that subject. Upon clicking a quiz, a page of information about the quiz is shown, with an image describing the quiz, a detailed text description, and a play button. When the play button is pressed, the quiz is entered and the first question of the quiz is displayed.

[0031] In a quiz, the mobile device can be rotated so that it faces different bearings of a compass (i.e. north, south, east, west). In a single question, the question is always shown on the device's screen regardless of device bearing. Upon entering a question, a voice recording that reads the question is played. In a single question, the total of 360° will be split evenly into the number of answer choices, such that each answer choice corresponds to a range of angles (e.g. 0°-90° for one of four answer choices). The answer choice corresponding to the current device bearing is shown on the device's screen. When the device is rotated enough such that the answer choice changes, a voice recording that reads the new answer choice is played. If the user is wearing headphones, the voice recording is perceived to be coining from the direction of the new answer choice. Said direction being the center of the angle the answer choice is valid for.

[0032] There is an evaluation button shown on the screen for each question. When the button is pressed, the answer choice that is currently being shown is evaluated and a new view will be shown, hiding the question and answer choice and showing the question and the correct answer choice. If the user-selected answer choice is evaluated to be correct, the background of the new view will turn green and many voice recordings of praises will be played at random. If the user-selected answer choice is evaluated to be incorrect, the background of the new view will turn red and many voice recordings of disapproval will be played at random.

[0033] The new view also has a “cancel” button. When the cancel button is pressed, the view is dismissed and a new question appears. If the question is the last question of the quiz, the summary information of how the user performed in answering the quiz is shown instead.

[0034] While the present invention has been particularly described in conjunction with a specific preferred embodiment, it is evident that many alternatives, modifications and variations will be apparent to those skilled in the art in light of the present description. It is therefore contemplated that the appended claims will embrace any such alternatives, modifications and variations as falling within the true scope and spirit of the present invention.