CONTENT DELIVERY SYSTEM FOR INTERACTIVE EDUCATIONAL INSTRUCTION

Abstract

Systems and methods for interactive content delivery are disclosed. In some embodiments, the systems and methods provide an interactive content delivery system for medical instruction, integrating high-fidelity, realistic three-dimensional models of the human anatomy into the curriculum. The interactive content delivery system may operate in any of several instructional modes, selectable by a student user, and may operate on any number of devices with any of several user input mechanisms, such as by touch screen, virtual reality headsets, or augmented reality headsets. The interactive content delivery system may provide testing of a user's learning through any of several testing modes.

Claims

1. A method of delivering interactive educational instruction comprising: receiving instructional content; creating a content container; loading the instructional content into the content container; importing one or more 3D models associated with at least a portion of the instructional content; dynamically populating an application; and providing the application to a user.

2. The method of claim 1, further comprising the step of importing one or more animations associated with at least a portion of the instructional content.

3. The method of claim 1, wherein the instructional content comprises chapters and quizzes.

4. The method of claim 1, wherein the instructional content is associated with medical educational content.

5. The method of claim 1, wherein the application is provided to the user by way of a mobile electronic device.

6. The method of claim 1, wherein the application is provided to the user by one of a virtual reality interface and an augmented reality interface.

7. The method of claim 1, wherein the user may interact with the application in at least one of two modes, the two modes comprising a lecture mode and an interactive mode.

8. The method of claim 1, wherein the application is configured to record testing analytics resulting from user interaction with the application.

9. The method of claim 1, wherein the application is configured to test a user learning comprehension in at least one of three testing modes, the three testing modes comprising select the answer mode, multiple choice mode, and drag and drop mode.

10. The method of claim 1, further comprising the step of registering a user account.

11. The method of claim 1, wherein the application comprises a learning management system configured to record testing analytics resulting from user interaction with the application.

12. A system to deliver interactive medical educational content to a user, the system comprising a computer-readable medium configured to: register a user account; receive medical educational content; create a content container; load the medical educational content into the content container, the medical educational content comprising chapters and quizzes; import a plurality of 3D models associated with at least a portion of the medical educational content; dynamically populate an application; and provide the application to a user.

13. The system of claim 12, wherein the user interacts with the application through a touch-screen of an electronic device.

14. The system of claim 12, wherein the chapters include one or more of text displays, images, voice over audio, and video presentations.

15. The system of claim 12, wherein the application is provided to the user by one of a virtual reality interface and an augmented reality interface.

16. The system of claim 12, further comprising the step of importing a plurality of animations associated with at least a portion of the instructional content.

17. The system of claim 12, wherein the application is configured to present information to the user in at least two different languages.

18. A non-transitory computer readable medium having stored thereon computer-executable instructions, the computer executable instructions causing a processor of a device to execute a method of delivering interactive educational instruction comprising: receiving instructional content; creating a content container; loading the instructional content into the content container; importing 3D models associated with at least a portion of the instructional content; importing one or more animations associated with at least a portion of the instructional content; dynamically populating an application; and providing the application to a user.

19. The medium of claim 18, wherein: the instructional content comprises chapters and quizzes, the chapters including one or more of text displays, images, voice over audio, and video presentations; and the application is provided to the user by one of a virtual reality interface and an augmented reality interface.

20. The medium of claim 18, wherein the application comprises a learning management system configured to record testing analytics resulting from user interaction with the application.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

[0046] The disclosure will be readily understood by the following detailed description in conjunction with the accompanying drawings, wherein like reference numerals designate like elements. The elements of the drawings are not necessarily to scale relative to each other. Identical reference numerals have been used, where possible, to designate identical features that are common to the figures.

[0047] FIG. 1 shows an overview of a software architecture for a system for interactive content delivery according to embodiments of the present disclosure;

[0048] FIG. 2 shows a flow diagram of the chapter presentation process for the interactive content delivery system of FIG. 1, according to embodiments of the present disclosure;

[0049] FIG. 3 shows a flow diagram of the content creation process for the interactive content delivery system of FIG. 1, according to embodiments of the present disclosure;

[0050] FIG. 4 shows an overview of a particular application of the interactive content delivery system of FIG. 1, the application involving the physiology of the eye, according to embodiments of the present disclosure;

[0051] FIG. 5 shows additional detail of the chapter definition portion of FIG. 4, according to embodiments of the present disclosure; and

[0052] FIG. 6 shows a flowchart of a method of use for the interactive content delivery system of FIG. 4, according to embodiments of the present disclosure.

[0053] It should be understood that the proportions and dimensions (either relative or absolute) of the various features and elements (and collections and groupings thereof) and the boundaries, separations, and positional relationships presented there between, are provided in the accompanying figures merely to facilitate an understanding of the various embodiments described herein and, accordingly, may not necessarily be presented or illustrated to scale, and are not intended to indicate any preference or requirement for an illustrated embodiment to the exclusion of embodiments described with reference thereto.

DETAILED DESCRIPTION

[0054] Systems and methods for interactive content delivery, such as for educational instruction, are disclosed. In particular, interactive content delivery systems and methods for medical educational instruction are disclosed, such systems and methods integrating high-fidelity, realistic 3D models of the human anatomy into the curriculum.

[0055] The interactive content delivery system may operate in any of several instructional modes, selectable by the student user, and may operate on any number of devices with any of several user input mechanisms, such as by touch screen, virtual reality headsets, or augmented reality headsets. The interactive content delivery system may provide testing of a user's learning through any of several testing modes.

[0056] The disclosed interactive content delivery system may more rapidly create custom curriculum content by building component chapters of instruction by dynamically populating chapter content. Such an approach allows content to be created in a parallel fashion, rather than by the traditional one-by-one sequential fashion.

[0057] Various embodiments of the system for interactive content delivery (also referenced as simply the system) and various embodiments of methods of use of the system for interactive content delivery (also referenced as the method) will now be described with respect to FIGS. 1-6.

[0058] FIG. 1 shows an overview of a software architecture for a system 100 for interactive content delivery. Generally, the system 100 comprises software modules (aka software elements or software components) of launch application 110, choose language 120, login 140, select chapter 150, present chapter 160, complete quiz 170, and show final screen 190. From a functional perspective, after a particular application is launched (that is, one of 112, 114, 116, as described below), a language is selected (by way of choose language 120) and an option to engage online or offline are entered. Next, selection and presentation of a chapter (of instruction) are executed (by way of select chapter 150), and an optional quiz chapter (at element 171), is executed.

[0059] Note that the system 100 is hardware agnostic. Stated another way, the system 100 may be implemented on any number of commercially available hardware platforms, to include PC/Mac, mobile platforms (e.g. iPhone, Android), virtual reality (e.g. Vive, Oculus), and augmented reality (e.g. iPhone, Android, Meta).

[0060] The launch application 110 module queries a user to select from one of three applications: a V/R application 112, an A/R application 114, and a PC/Mac/Mobile application 116.

[0061] The user is also queried to select a language for instruction by way of the choose language module 120, e.g. English, Chinese, etc. The language selection ensures that the correct text and audio content are used while running the application. Furthermore, a user selects between engaging, or playing, online or offline, by way of play online 131 module and play offline 133 modules, respectively. The application uses an online connection to store activity data and/or test results for a given user. In some embodiments, activity data and/or test results may be provided to a Learning Record Store (LRS) or Learning Management System (LMS). If offline play is chosen, activity data and test results are stored locally on the remotely-running device.

[0062] In the event a user selects to play online (by way of element 131), the login module 140 is activated. The login module 140 performs any of several functions. For example, the user may supply an account name and password, wherein such credentials are transmitted to a web server for validation via, for example, HTTP protocol. If the server cannot verify the supplied credentials or the server is offline, then the user will receive an error message. If the user supplies valid credentials, then the user will transition to a table of contents screen where the user may choose a chapter to begin instruction.

[0063] The select chapter 150 module populates and presents a table of contents screen, after a user has successfully logged in or selected offline play. A configuration file detailing the number of chapters, chapter titles, and brief descriptions of the content of each chapter, is accessed. The user may select a specific chapter from the table of contents, or the user may start from the beginning with chapter one.

[0064] The present chapter 160 module is described in greater detail below with respect to FIG. 2 below.

[0065] An optional complete quiz module 170 may be engaged by a user, wherein quiz questions regarding the chapter content may be considered. Upon entering the quiz scene, the data is fetched and loaded (See description regarding element 214 in FIG. 2, and description regarding FIG. 3). In one embodiment, once the scene has loaded, the user will have three choices; 1) answer the question, 2) skip the questions and receive an incorrect grade, and 3) quit the quiz and receive an incorrect grade for the remaining questions. When answering a question, the answer may be reviewed and determined as correct or incorrect, and that data will be saved. The location of data storage is determined by user login type, i.e. whether or not the user logged in or is currently offline. Offline users' data will be stored locally on the remote (aka local) device in use; online users who logged in will have data stored on a database, such as an LRS/LMS database for data visualization. Note that when exiting a quiz, the same scenario occurs wherein offline users save data to the remote device and logged in users save data to a database.

[0066] When a user has completed all questions of the quiz (as managed by element 170), a user selects to quit the quiz, the quiz ends, and quiz results will be presented. After a user has finished viewing results, the user may continue to another chapter, as new chapters are available (see element 181). That is, additional instructional chapters may be considered at chapters remaining 181 query. If a user completes all chapters or elects to end instruction, the show final screen 190 module is executed. After completing all chapters and quizzes the user may be routed to the final screen that displays results. The results will show each of the questions and whether answered correctly or incorrectly, as well as a GPA across the entire application. Once all the data have been gathered, the data may be displayed in any number of ways, such as on a scrollable window across a table for each quiz, with the GPA on the final screen.

[0067] FIG. 2 shows a flow diagram of the chapter presentation process 200 for the interactive content delivery system 100 of FIG. 1. Generally, FIG. 2 provides additional detail as to the present chapter 160 module of FIG. 1.

[0068] The start chapter presentation 210 module receives input from a user to begin instruction on a selected chapter. The load presentation slides and audio 214 element loads content associated with the selected chapter. Any previously loaded chapter data are first cleared from the system 100 and replaced with the current chapter's content. The chapter content may include but is not limited to text displays, images, voice over audio, and video presentations. Text information is provided by show slide text 220 module and is displayed in slide format (e.g., similar to Microsoft Powerpoint). Play slide audio 224 module presents corresponding voice over audio concurrently with the slide presentation. A presentation will continue in this manner until there are no additional slides to present (as shown by query at module 225), at which point the content for the next chapter will be loaded and displayed. If there are no chapters remaining (as determined by query at module 227), then a final screen is displayed via show final screen 228 module. The final screen may display, e.g., a user's quiz results. (Note that the above description was with regard to operating the system 100 in lecture mode aka presentation mode rather than interactive mode.)

[0069] The interactive mode selected 221 query receives input from a user as to switching to interactive mode. Such a switch is available at any point during a chapter presentation. In interactive mode, a user may interact with the displayed model, for example. The chapter presentation may pause the presentation at module 232 and execute the enable interactive model components 234 module and the interact with model 236 module. A user may switch back to presentation mode by way of query module 237. If a user selects to switch to presentation mode from interactive mode (by way of module 237), the disable interactive model components 238 module, and the resume presentation 240 module, are executed.

[0070] Note that at load presentation slides & audio 214 module, a specific content container is fetched (see description with respect to FIG. 3 below). Using data from the content container, the system 100 (and the system 200) determines if the current scene is a Chapter or a Quiz, and then proceeds to populate the correct UI with text from the specified content container. In a Quiz, the data populating includes loading the quiz cards with the correct questions. In a Chapter, the data populating includes populating the sidebar with each section of content for that particular chapter. Any remaining data from the container are then loaded into the scene and placed in the correct location; this includes the loading of the 3D assets and the loading of voice over into an Audio Source.

[0071] FIG. 3 shows a flow diagram of the content creation process 300 for the interactive content delivery system 100 of FIG. 1.

[0072] The creation of a content container to load data into chapters and quizzes begins with the create empty content container 310 module wherein an empty container, which serves as a template for content, is created. A user selects a language for the content via the choose language 320 module. Also, a user selects whether the content to be created is a chapter 326 or a quiz 328.

[0073] If the content is for a chapter 326, then a set of five modules (330, 340, 350, 360, and 370) are executed. Specifically, the define chapter number and title 330 module establishes a chapter number, which determines when in the application that particular chapter will appear and the title for the chapter. The module 340 provides a three-dimensional model and defines interactable components. The module 350 provides associated voice over audio. At module 360, three-dimensional models are defined that are compatible with the particular chapter. At module 370, sections within a chapter are defined and text is created for each section.

[0074] If the user selects (at element 331) quiz 328 for the content, then at module 380 questions and answers for the quiz are created and provided.

[0075] At module 390, the content created (aka imported) for the container is reviewed. The review may include, for example, ensuring that the selectable parts of the model and the animations that particular model will show are interoperable. The content container is saved by way of module 392.

[0076] Note that the system 300 allows content containers to be rapidly developed, wherein prototype applications and client demonstrations, for example, may be created much faster than is conventionally possible. The disclosed system and method of content creation, for use in the disclosed content delivery system, dynamically populates content from the containers across the application.

[0077] In one embodiment, a collection of internal C# scripts that control all of the 3D content are utilized. This embodiment uses Unity3D and scripts that animate and position all the 3D models and associated information dynamically.

[0078] In one embodiment of the content delivery system, application activity data is provided to an LMS/LRS endpoint. A connection to the endpoint is established using a set of credentials prior to any data being sent. The credentials may be supplied by the user or pre-configured within the application using a public key combined with a secret key. A statement is created which details data such as the party that performed the activity, what the activity was, and how the activity was performed. A statement may also include scoring information when pertaining to quiz or test results. A specific API (in one embodiment, an Experience API), is used to generate the statements and to send the statements to LMS/LRS endpoints.

[0079] FIGS. 4 and 5 describe a particular application of the interactive content delivery system of FIG. 1, the application involving the physiology of the eye. FIG. 5 provides further details of a particular aspect of FIG. 4. Generally, the application of FIGS. 4-5 is an educational training application designed for mobile devices.

[0080] With attention to FIG. 4, an overview of the physiology of the eye (TPOTE) system 400, herein referred to as TPOTE system or simply as the application, is provided. Generally, the TPOTE system 400 comprises a core module 410, a chapters module 420, and a testing module 430. The core module 410 interacts in a two-way manner with the chapter module 420. The chapter module 420 outputs in a unidirectional manner with the testing module 430.

[0081] Note that any or all of the capabilities of the TPOTE system 400 may be applied or used in any of the embodiments of the interactive content delivery system.

[0082] The core module 430 is responsible for the entry into the application, unity scene control, system quality settings, and language choice. The core module 410 comprises platform manager 412, quality manager 414, and XAPI manager 416.

[0083] The platform manager 412 issues commands for logging into and out of the XAPI manager 416. The platform manager 412 also updates the XAPI manager 416 and manages chapter progression and choice. Furthermore, the platform manager 412 handles scene management and loading. In one embodiment, the platform manager 412 is a singleton. The term singleton means a software design pattern that restricts creating object instances such that only one reference of the object exists.

[0084] The quality manager 414 sets quality level based on predetermined minspecs. The term minspec or the phrase minimum specifications means the minimum system hardware or mobile device requirements needed to efficiently run software and may describe minimum and recommended requirements to execute a software system without error. In one embodiment, the quality manager 414 is a singleton.

[0085] XAPI manager 416 provides handling connections to the remote LRS, querying LRS data, sending xAPI statements, and the like. In one embodiment, the XAPI manager 416 is a singleton.

[0086] The chapters module 420 provides the main content and focus of the application, and where a user spends the majority of time. Chapters mainly consist of data, but also handle several types of input in varying states. In a typical chapter the user will have the ability to, for example: listen to and watch a lesson, pause a lesson, switch between linear and interactive modes during a chapter, and change to any other chapter at any time (as described above with respect to FIG. 2). The chapters module 420 comprises content manager 422 and chapter definition 424.

[0087] The content manager 422 serves as the principal director and controller of content in a particular chapter and maintains and organizes objects of the chapter definition 424. Also, the content manager 422 handles two modes during a particular chapter: linear (aka lecture) mode and interactive mode (as previously described with respect to FIG. 2). In one embodiment, the content manager 422 is a singleton.

[0088] The chapter definition 424 is a data holder that contains all the data required by the content manager 422 to present a full chapter. The chapter definition 424 module is described in more detail below with respect to FIG. 5.

[0089] Note that editing of pre-existing chapters is performed by editing the chapter definition 422 on chapter prefabs, wherein each language has a unique prefab per chapter. The term prefab or the phrase Unity Prefab refers to a system that allows one to create, configure, and store a GameObject complete with all its components, property values, and child GameObjects as a reusable Unity Asset; the Prefab Asset acts as a template from which one can create new Prefab instances over and over in the Scene and then simply change a subset of settings to make each copied Prefab unique.

[0090] Also, note that to add a chapter, one must first create a new empty Game Object and insert a chapter definition script therein. The chapter definition needs to then be filled with the information for the new chapter. Other resources must be created and provided, e.g. the interactive model used during the chapter, the animations, the voice over audio clips, etc. After a new chapter prefab has been created, one will need to select the proper platform manager game object and add the newly created chapter prefab to the proper prefab (e.g. an English Prefab or a Chinese Prefab).

[0091] The testing module 430 poses questions and tasks for users to answer and accomplish, the questions and tasks are based on material presented in a chapter. The testing module 430 also presents a result interface wherein a user may evaluate quiz performance. The testing module comprises a quiz manager 432. The quiz manager executes the presenting and answering of quiz questions, as well as the results screen.

[0092] The testing module 430 may record and/or track any of the following types of data: [0093] (FOV) Field of View. What the user sees in a virtual world [0094] Time spent on each chapter [0095] Time spent on each section [0096] Time spent on each quiz question [0097] If retaking a quiz, we can show the difference between quiz scores [0098] How many times they have completed a chapter [0099] How many times they selected a part of a model (this could be per model or for all models) [0100] How many times they picked up a 3D model [0101] Total time in the application

[0102] Alternatively, or additionally, the above data may be recorded and/or tracked by an LMS in communication with the TPOTE system.

[0103] With attention to FIG. 5, additional detail regarding the chapter definition 424 module of FIG. 4 is described. The chapter definition 424 module comprises chapter data 510. The chapter data 510 comprises one or more chapter sections 512. In FIG. 5, the chapter data 510 includes four chapter sections 512.

[0104] An example of chapter data 510 are as follows: [0105] Chapter No.: Chapter number Title: Title for this chapter. [0106] Summary: A summary of what content will be gone over in this chapter. [0107] Type: Type of chapter this is with two options: PRESENTATION or QUIZ [0108] Voice Over Clip: Intro/Title soundclip which will be the first audio played upon entering the chapter. [0109] Scene To Load: Which scene to load for this chapter. [0110] Interactive Model: Default model to be used on non-mobile builds. [0111] High Spec Model: Model to be used with high spec quality setting on mobile. [0112] Low Spec Model: Model to be used with low spec quality setting on mobile. [0113] Initial Rotation: Initial rotation for the interactive model in the chapter. [0114] Rotation Point: Name of the GameObject which holds the transform for the desired rotation point of the interactive model. [0115] Highlight Color: NOT USED [0116] Lock Axis: NOT USED [0117] Constraints: NOT USED [0118] Initial Camera Z: Camera distance to the interactive model when the chapter begins. [0119] Depth of Field: Set the camera target by name [0120] Sections[ ]: An array of ChapterSection objects. [0121] Linear Highlights[ ]: NOT USED [0122] Linear Animations[ ]: List of animations to play on the interactive model when entering linear mode. [0123] Linear Mode Camera Offset: Distance to pull the camera when entering linear mode. [0124] Interactive Labels[ ]: List of ChapterHighlight objects which define interactive points of information during interactive mode. [0125] Interactive Highlights[ ]: List of ChapterHighlightObject objects which define the GameObject in the scene and its visibility. [0126] Interactive Animations[ ]: List of animations to play on the interactive model when entering Interactive mode. [0127] Interactive DOF: Set the camera target by name for interactive mode I [0128] Interactive Rotation: Initial rotation for the interactive model when entering interactive mode. [0129] Quiz Questions[ ]: List of QuizQuestion objects which define a question, voice clip and answer. [0130] Quiz Highlights[ ]: List of ChapterHighlightObject objects which define the question answer objects. [0131] Quiz Animations[ ]: List of animations to play on the interactive model when entering Quiz mode. [0132] Quiz Selectables[ ]: NOT USED

[0133] With attention to FIG. 6, a method of use 600 for the interactive content delivery system of FIG. 1 is provided. The flowchart or process diagram of FIG. 6 starts at step 604 and ends at step 644. Some aspects of the method of use 600 will reference elements or components of the above FIGS. 1-5. The steps of method 600 are notionally followed in increasing numerical sequence, although, in some embodiments, some steps may be omitted, some steps added, and the steps may follow other than increasing numerical order.

[0134] Generally, the intended goal for a normal user experience when traversing the method 600 is to absorb knowledge from watching and interacting with the presentation in each chapter. A user may switch from linear to interactive mode so as to interact with the presented model, thereby obtaining more information on the material. The user thus acquires the knowledge required to satisfactorily complete a quiz chapter after all other chapters have been completed.

[0135] After beginning at step 604, the method 600 proceeds to step 608, wherein the application is entered. Step 608 is similar to the launch application 110 module of FIG. 1. After completion of step 608, the method 600 continues to step 612, wherein a language is selected. Step 612 is similar to the choose language 120 module of FIG. 1. After completion of step 612, the method 600 proceeds to step 616, wherein a chapter is selected. Step 616 is similar to the select chapter 150 module of FIG. 1. After completion of step 616, the method 600 proceeds to step 620.

[0136] At step 620, the user listens and watches the selected presentation. Step 620 is generally similar to the activities described above with respect to FIG. 2. After completion of step 620, the method 600 proceeds to step 624, wherein the user may enter interactive mode and interact with targeted areas (aka hot spots) to gain additional information and/or understanding. The features of step 624 are similar to the components of interactive mode described with respect to FIG. 2, e.g. elements 232, 234, 236, and 238. After completion of step 624, the method 600 continues to step 628, wherein the user continues to a next chapter. After competing step 624, the user is queried as to if the user is at a quiz chapter. If the reply is No, the method 600 continues to step 620. If the reply is Yes, the method continues to step 636.

[0137] At step 636, the quiz is completed. Step 636 is similar to module 170 of FIG. 1. After completing step 636, the method 600 continues to step 640, wherein the quiz results are reviewed. The quiz results may be presented on a final screen, as described in element 190 of FIG. 1 or element 228 of FIG. 2. After completing step 640, the method 600 ends at step 644.

[0138] Note that the user, when executing the method 600, has available three principal modes of operation: linear mode, interactive mode, and testing mode. In linear mode, a user may, for example, select a pause button to enter interactive mode, and may select a chapter map to open a chapter selector. In interactive mode, a user may, for example, zoom in and out of the interactive model, select any of several points of interest and interactable models to trigger effects, may select a play button to enter linear mode, and may select a chapter map to open a chapter selector. In test mode, a user may, for example, select various models and buttons to answer questions of a quiz and progress through the quiz.