CONFIRMATION DEVICE, CONFIRMATION SYSTEM, CONFIRMATION METHOD, AND RECORDING MEDIUM
20230099736 ยท 2023-03-30
Assignee
Inventors
Cpc classification
G09B7/06
PHYSICS
International classification
G09B7/06
PHYSICS
Abstract
To achieve higher speed of deriving information that shows the selection status of options while also saving space and reducing communication cost, this confirmation device is provided with: a target display processing means for presentation of options on an image for target that is viewed by targets for whom an actor who performs confirmation performs confirmation; an acquisition processing means that acquires video information presenting video of the target observing the options; and a first presentation processing means that derives first selection status information that shows the status of the selection of the options by each target on the basis of the line of sight of the target derived from the video information and provides the actor with the first selection status information.
Claims
1. A confirmation device comprising one or more memories storing instructions and one or more processors configured to execute the instructions to: cause display of options on an image for object person that is an image to be looked at by object persons being persons for whom confirmation by an actor who performs confirmation is conducted; acquire image information representing an image of the object person gazing at the options; derive, from a sight line of each of the object persons that is derived from the image information, first selection status information being information indicating a status of selection of the options that the object person selects; and provide the first selection status information for the actor.
2. The confirmation device according to claim 1, wherein the one or more processors are configured to execute the instructions to cause display of a question for the options on the image for object person at a time of displaying the options or before the options are displayed.
3. The confirmation device according to claim 2, wherein the first selection status information is first degree-status-information indicating a degree to which the option is a correct answer to the question.
4. The confirmation device according to claim 1, wherein the first selection status information is a percentage of correct answers indicating a rate that an answer is a correct answer of a question.
5. The confirmation device according to claim 4, wherein the one or more processors are configured to execute the instructions to cause display of the question on the image for object person.
6. The confirmation device according to claim 1, wherein the one or more processors are configured to execute the instructions to cause display of information prompting the gazing on the image for object person, after the options are displayed, and, after the information prompting the gazing is displayed, perform the acquisition.
7. The confirmation device according to claim 1, wherein the image information is still image information.
8. The confirmation device according to claim 1, wherein the image information is moving image information.
9. The confirmation device according to claim 8, wherein the one or more processors are configured to execute the instructions to derive the first selection status information, by using the moving image information, from the options at which the object persons perform the gazing for a first time or longer.
10. The confirmation device according to claim 1, wherein the one or more processors are configured to execute the instructions to cause display of the first selection status information on an image for actor that is an image to be looked at by the actor.
11. The confirmation device according to claim 1, wherein the one or more processors are configured to execute the instructions to provide, for the actor, second selection status information being information indicating a status of the selection of a plurality of the options for each of the object persons.
12. The confirmation device according to claim 1, wherein the one or more processors are configured to execute the instructions to identify each of the object persons.
13. The confirmation device according to claim 12, wherein the identification is performed by using face authentication on a face image of each of the object persons being included in the image.
14. The confirmation device according to claim 1, wherein the actor is a teacher, and the object person is a student.
15. The confirmation device according to claim 1, wherein the actor is a lecturer, and the object person is a listener.
16. A confirmation system comprising: the confirmation device according to claim 1, and at least any one of: a display device for object person that displays the image for object person; a display device for actor that displays the first selection status information on an image for actor that is an image to be looked at by the actor; and an image input device that inputs the image information to the confirmation device.
17. A confirmation method comprising: causing display of options on an image for object person that is an image to be looked at by object persons being persons for whom confirmation by an actor who performs confirmation is conducted; acquiring image information representing an image of the object person gazing at the options; deriving, from a sight line of each of the object persons that is derived from the image information, first selection status information being information indicating a status of selection of the options that the object person selects; and providing the first selection status information for the actor.
18. A non-transitory computer-readable recording medium recording a confirmation program causing a computer to execute: processing of causing display of options on an image for object person that is an image to be looked at by object persons being persons for whom confirmation by an actor who performs confirmation is conducted; processing of acquiring image information representing an image of the object person gazing at the options; and processing of deriving, from a sight line of each of the object persons that is derived from the image information, first selection status information being information indicating a status of selection of the options that the object person selects, and of providing the first selection status information for the actor.
Description
BRIEF DESCRIPTION OF DRAWINGS
[0013]
[0014]
[0015]
[0016]
[0017]
[0018]
[0019]
[0020]
EXAMPLE EMBODIMENT
[0021] A confirmation system according to the present example embodiment displays a content of a question and options of answers to the question on a screen or the like, and derives a rate of students and the like who select a correct answer, based on sight lines of the students and the like. Thereby, a confirmation device according to the present example embodiment can immediately derive a percentage of correct answers, without using a wired terminal, a smartphone, or the like. Therefore, the confirmation system according to the present example embodiment can achieve a balance among an increase in speed of deriving a percentage of correct answers, space-saving, and a reduction in communication cost.
<Configuration and Operation>
[0022]
[0023] The confirmation system 500 includes a terminal 100, an image input device 200, a display-device-for-student 301, and a display-device-for-teacher 302. The terminal 100 includes a processing unit 101, an input unit 102, and a storage unit 103. Herein, the terminal 100 is, for example, operated by a teacher. Further, the image input device 200 is a camera and the like that capture an image of all students. Further, the display-device-for-student 301 includes a screen that all the students can look at the same time. Further, the display-device-for-teacher 302 includes a screen that the teacher looks at, and is placed beside the teacher.
[0024] Further,
[0025] When conducting a test for students, as an operation A1 in
[0026] In response to the operation A1, the terminal 100 causes, as an operation A2, the display-device-for-student 301 in
[0027] The student looks at the display and, as an operation A3, considers an answer to the displayed question.
[0028] When the time limit being input in the operation A1 has elapsed since the display in the operation A2 is started, the terminal 100 performs an operation A4. The operation A4 causes the display-device-for-student 301 to perform an image instructing that the student gaze at an option that the student has selected among the options displayed on the display-device-for-student 301. The display is performed by the processing unit 101 in
[0029] In response to the display in A4, the student starts, as an operation A5, gazing at the option that the student selects.
[0030] After that, the terminal 100 causes the image input device 200 in
[0031] Image information of the image captured by the image input device 200 is input to the terminal 100 via an interface 111 in
[0032] Next, the terminal 100 derives, as an operation A7, a total number of sight lines of the students and the number of sight lines directed to a correct option, from the image acquired in the operation A6. Herein, the total number of sight lines is, for example, half of the number of eyes of the students present in the image.
[0033] Further, in order to derive the number of sight lines gazing at the correct option, for example, first, a direction of a sight line of each of the students is derived from an image of eyes of each of the students. A method of deriving a direction of a sight line from shapes of eyes is well known, and is disclosed, for example, in PTL 2.
[0034] Further, the terminal 100 is assumed to preliminarily hold information indicating a position of eyes (or a face) of each of the students at a time of gazing, in the storage unit 103 in
[0035] In that case, the terminal 100 derives the number of sight lines of which a position on a displayed screen, which is derived from a sight line of each of the students in the image and a position of eyes of each of the students, is in a position of the correct option on the displayed screen, and can thereby derive the number of sight lines gazing at the correct option.
[0036] Then, as an operation A8, the terminal 100 derives a percentage of correct answers, by dividing the number of sight lines directed to the correct option derived in the operation A7 by the total number of sight lines of the students.
[0037] Then, as an operation A9, the terminal 100 causes the display-device-for-teacher 302 in
[0038] Then, as an operation A10, the teacher confirms the percentage of correct answers that is displayed on the screen of the display-device-for-teacher 302. The teacher and the like recognize a degree of understanding of the students from the displayed percentage of correct answers, and can reflect the degree of understanding in a subsequent class.
[0039] Note that the operations A1 to A8 in
[0040] Herein, a supplementary description of the configuration in
[0041] The storage unit 103 preliminarily holds a program and information necessary for the processing unit 101 to operate. Further, the storage unit 103 stores information that is instructed by the processing unit 101. Further, the storage unit 103 transmits the information instructed by the processing unit 101 to an instructed configuration.
[0042] The terminal 100 is, for example, a computer. Further, the processing unit 101 is, for example, a central processing unit of the computer.
[0043] The image input device 200 performs image capturing in accordance with instruction information that is transmitted from the terminal 100 via the interface 111, and transmits image information acquired from the image capturing to the terminal 100. Each of the display-device-for-student 301 and the display-device-for-teacher displays an image in accordance with control information transmitted from the terminal 100.
[0044] Next, specific examples of the operations in
[0045]
[0046] Further, in
[0047] Further, the image input device 200 in
[0048] Further, the display-device-for-teacher 302 in
[0049] The screen 311 in
[0050] Note that, the remaining time 386 is a remaining time until the time limit that is displayed in the operation A2 has elapsed.
[0051]
[0052] The operations A6 to A9 in
[0053] Further, each of the students 402 gazes at any one of the options 381 to 384, which is selected by the student. Each arrow illustrated in
[0054] The terminal 100 causes, in the operation A9, the display 302a to display the percentage of correct answers derived in the operations A7 and A8 in
[0055]
[0056] The processing unit 101 starts processing in
[0057] The processing unit 101 first determines, as processing in S101, whether a question and the like are input from the input unit 102. Herein, the question and the like are at least information including the question. The processing unit 101 performs processing in S102 when a determination result of the processing in S101 is yes. Meanwhile, the processing unit 101 performs the processing in S101 again when the determination result of the processing in S101 is no.
[0058] When performing the processing in S102, the processing unit 101 causes, as the processing in S102, the display-device-for-student 301 to display the question and the like being input in the processing in S101. Then, the processing unit 101 determines, as processing in S103, whether a time T1 has elapsed. The time T1 is a waiting time from when the processing in S102 is performed to when processing in S104 is performed, and is preliminarily set.
[0059] The processing unit 101 performs the processing in S104 when a determination result of the processing in S103 is yes. Meanwhile, the processing unit 101 performs the processing in S103 again when the determination result of the processing in S103 is no. When performing the processing in S104, the processing unit 101 causes, as the processing in S104, the display-device-for-student 301 to display the above-described gazing instruction information for an option.
[0060] Then, the processing unit 101 determines, as processing in S105, whether a time T2 has elapsed. The time T2 is a waiting time from when the processing in S104 is performed to when processing in S106 is performed, and is preliminarily set.
[0061] The processing unit 101 performs the processing in S106 when a determination result of the processing in S105 is yes. Meanwhile, the processing unit 101 performs the processing in S105 again when the determination result of the processing in S105 is no. When performing the processing in S106, the processing unit 101 causes, as the processing in S106, the image input device 200 to capture an image of students and to transmit acquired image information.
[0062] Then, the processing unit 101 derives a total number of sight lines of the students and the number of sight lines that are directed to a correct option, based on the image information transmitted from the image input device 200. Then, as processing in S108, the processing unit 101 derives a percentage of correct answers and causes the storage unit 103 to store the derived percentage of correct answers.
[0063] Then, the processing unit 101 determines, as processing in S109, whether to cause the display-device-for-teacher 302 to display at this point all the percentages of correct answers that are stored in the storage unit 103 from a start to date. The processing unit 101 performs the determination, based on input information to the input unit 102, for example. The processing unit 101 performs processing in S110 when a determination result of the processing in S109 is yes. Meanwhile, the processing unit 101 performs the processing in S101 again when the determination result of the processing in S109 is no (for example, when it is desired not to display the percentage of correct answers yet at this point and to collectively display the percentages of correct answers later).
[0064] When performing the processing in S110, the processing unit 101 causes, as the processing in S110, the display-device-for-teacher 302 to display the percentage of correct answers, which is stored in the storage unit 103. Then, the processing unit 101 ends the processing in
[0065] It is presumed in the processing in
[0066]
[0067] Next to the processing in S104 in
[0068] Then, the processing unit 101 identifies, as processing in S123, by using the moving image information, an option that a student at each position in the moving image gazes at for a time T3 or longer. Then, as processing in S124, the processing unit 101 determines, for the student at each position, whether the option identified in the processing in S123 is a correct answer, and causes the storage unit 103 to store information indicating whether the option is the correct answer.
[0069] Next, as processing in S125, the processing unit 101 derives a percentage of correct answers for the question being input in the processing in S101, associates the derived percentage of correct answers with identification information of the question, and causes the storage unit 103 to store the percentage of correct answers.
[0070] Then, the processing unit 101 determines, as processing in S127, whether to display percentages of correct answers for each of all questions that have been stored in the storage unit 103 from a start until now. The processing unit 101 performs the determination by, for example, determining whether a predetermined input information is input via the input unit 102.
[0071] The processing unit 101 performs processing in S128 when a determination result of the processing in S127 is yes. Meanwhile, the processing unit 101 performs the processing in S101 in
[0072] When performing the processing in S128, the processing unit 101 causes, as the processing in S128, the display-device-for-teacher 302 to display all combinations of identification information of a question and a percentage of correct answers, which are stored in the storage unit 103 after the processing in
[0073] In the above-described example, a case in which the processing unit 101 does not perform personal identification of each of the students has been described. However, the processing unit 101 may identify each of the students and may derive, for each of the students, a percentage of correct answers.
[0074] Such identification of each of the students is possible when, for example, the processing unit 101 is in an environment in which a seating chart preliminarily stored in the storage unit 103 can be used, the students are seated according to the seating chart, and further, there is association information between faces (eyes) in an image to be acquired and the seating chart.
[0075] Alternatively, even when seating positions of the students are not fixed, such identification of each of the students can be achieved by identifying each of the students by using a well-known face authentication technology.
[0076] An example of a processing flow of identifying each of the students is, for example, acquired by replacing the processing in S105 to S110 in
[0077] Processing in S121 in
[0078] Processing in S123 to S125 to be subsequently performed is the same as the processing in S123 to S125 in
[0079] Next to the processing in S125, the processing unit 101 aggregates information indicating whether each question is correctly answered by each of the students, which is previously stored in the storage unit 103, derives, for each of the students, a percentage of correct answers, and causes the storage unit 103 to store the percentage of correctly answered questions.
[0080] Processing in S127 and S128, which is performed thereafter, is the same as the processing in S127 and S128 in
[0081] Next to the processing in S127 and S128 in
Advantageous Effect
[0082] In the confirmation system according to the present example embodiment, a question content and options of the answers are displayed on the display-device-for-student, and a rate of sight lines directed to a correct option is displayed to the teacher, as a percentage of correct answers. Thereby, the confirmation system according to the present example embodiment makes it possible to immediately provide the percentage of correct answers to the teacher without using a wired terminal or a wireless terminal such as a smartphone. Therefore, the confirmation device according to the present example embodiment can achieve a balance among an increase in speed of deriving a percentage of correct answers, space-saving, and a reduction in communication cost.
[0083] Note that, in the above-described example, for ease of understanding, description has been made on a case in which the confirmation system is a system for a teacher to conduct a test for students. However, the confirmation device according to the example embodiment may be any other device as long as the device has an object person select an option displayed on a screen, and acquires selection status information indicating a status of the selection using a sight line of the object person. Such acquisition of selection status information includes, for example, acquisition of selection status information that is performed in order to confirm a degree of understanding or for a questionnaire, which is conducted during a performance. When acquisition of selection status information is performed for a questionnaire, and the like, there may be no correct answer, or there may be no question to begin with. When a question does not exist, the confirmation device according to the example embodiment causes a screen for object person to display options, but does not cause the screen for object person to display a question. Herein, the object person is an object person of the questionnaire or a listener of a lecture. Further, even in a case in which a question exists, such as a survey, the question may not be displayed on the screen for object person and may be provided to the object person by voice and the like. Further, the question may be presented to the object person by a person such as a lecturer. Also in those cases, the confirmation device according to the present example embodiment does not display the question on the screen for object person. Further, the confirmation device according to the present example embodiment may display a question on the screen for object person before or after options are displayed.
[0084] Further, provision of the above-described percentage of correct answers to an actor who conducts confirmation such as testing may be performed by the confirmation device according to the example embodiment by using information other than an image, such as voice.
[0085] Further, information to be provided to the actor does not have to be the percentage of correct answers and may be the selection status information, which is information indicating a status of option selection.
[0086]
[0087] The display-for-object-person processing unit 101ax causes display of options on an image for object person, which is an image to be looked at by object persons being persons for whom confirmation by an actor who implements the confirmation is conducted. The acquisition processing unit 101bx acquires image information representing an image of the object person gazing at the options. The first provision processing unit 101cx derives, from a sight line of each of the object persons which is derived from the image information, first selection status information, which is information indicating a status of the selection of the options that the object person selects, and provides the first selection status information to the actor.
[0088] The confirmation device 101x causes display of options on the image for object person. Further, the confirmation device 101x derives, from a sight line of each of the object persons which is derived from an acquired image of the object persons gazing at the question and the option, first selection status information being information indicating a status of the selection of the options that the object person selects, and provides the derived first selection status information to the actor. Thereby, the confirmation device 101x makes it possible to immediately provide the first selection status information to a teacher without using a wired terminal or a wireless terminal such as a smartphone. Therefore, the confirmation device 101x can achieve a balance among an increase in speed of deriving information indicating a status of the selection of the options, space-saving, and a reduction in communication cost.
[0089] Therefore, by the above-described configuration, the confirmation device 101x achieves the advantageous effect described in the section of
Advantageous Effects of Invention
[0090] Further, the entirety or a part of the example embodiment may also be described as the supplementary notes below, but is not limited thereto.
(Supplementary Note 1)
[0091] A confirmation device comprising:
[0092] a display-for-object-person processing means for causing display of options on an image for object person that is an image to be looked at by object persons being persons for whom confirmation by an actor who performs confirmation is conducted;
[0093] an acquisition processing means for acquiring image information representing an image of the object person gazing at the options; and
[0094] a first provision processing means for deriving, from a sight line of each of the object persons that is derived from the image information, first selection status information being information indicating a status of selection of the options that the object person selects, and for providing the first selection status information for the actor.
(Supplementary Note 2)
[0095] The confirmation device according to supplementary note 1, wherein the display-for-object-person processing means causes the display-for-object-person processing means to display a question for the options at a time of displaying the options or before the options are displayed.
(Supplementary Note 3)
[0096] The confirmation device according to supplementary note 2, wherein the first selection status information is first degree-status-information indicating a degree to which the option is a correct answer to the question.
(Supplementary Note 4)
[0097] The confirmation device according to supplementary note 1, wherein the first selection status information is a percentage of correct answers indicating a probability that an answer is a correct answer of a question.
(Supplementary Note 5)
[0098] The confirmation device according to supplementary note 4, wherein the display-for-object-person processing means causes display of the question on the image for object person.
(Supplementary Note 6)
[0099] The confirmation device according to any one of supplementary notes 1 to 5, wherein
[0100] the display-for-object-person processing means causes display of information prompting the gazing on the image for object person, after the options are displayed, and
[0101] after the information prompting the gazing is displayed, the acquisition processing means performs the acquisition.
(Supplementary Note 7)
[0102] The confirmation device according to any one of supplementary notes 1 to 6, wherein the image information is still image information.
(Supplementary Note 8)
[0103] The confirmation device according to any one of supplementary notes 1 to 7, wherein the image information is moving image information.
(Supplementary Note 9)
[0104] The confirmation device according to supplementary note 8, wherein the first provision processing means derives the first selection status information, by using the moving image information, from the options at which the object persons perform the gazing for a first time or longer.
(Supplementary Note 10)
[0105] The confirmation device according to any one of supplementary notes 1 to 9, wherein the first provision processing means causes display of the first selection status information on an image for actor that is an image to be looked at by the actor.
(Supplementary Note 11)
[0106] The confirmation device according to any one of supplementary notes 1 to 10, further comprising a second provision processing means for providing, for the actor, second selection status information being information indicating a status of the selection of a plurality of the question options for each of the object persons.
(Supplementary Note 12)
[0107] The confirmation device according to any one of supplementary notes 1 to 11, further comprising an identification processing means for identifying each of the object persons.
(Supplementary Note 13)
[0108] The confirmation device according to supplementary note 12, wherein the identification is performed by using face authentication on a face image of each of the object persons being included in the image.
(Supplementary Note 14)
[0109] The confirmation device according to any one of supplementary notes 1 to 13, wherein the actor is a teacher, and the object person is a student.
(Supplementary Note 15)
[0110] The confirmation device according to any one of supplementary notes 1 to 14, wherein the actor is a performer, and the object person is a listener.
(Supplementary Note 16)
[0111] A confirmation system comprising:
[0112] the confirmation device according to any one of supplementary notes 1 to 15; and
[0113] at least any one of:
[0114] a display device for object person that displays the image for object person; a display device for actor that displays the first selection status information on an image for actor that is an image to be looked at by the actor; and an image input device that inputs the image information to the confirmation device.
(Supplementary Note 17)
[0115] A confirmation method comprising:
[0116] causing display of options on an image for object person that is an image to be looked at by object persons being persons for whom confirmation by an actor who performs confirmation is conducted;
[0117] acquiring image information representing an image of the object person gazing at the options;
[0118] deriving, from a sight line of each of the object persons that is derived from the image information, first selection status information being information indicating a status of selection of the options that the object person selects; and
[0119] providing the first selection status information for the actor.
(Supplementary Note 18)
[0120] A recording medium recording a confirmation program causing a computer to execute:
[0121] processing of causing display of options on an image for object person that is an image to be looked at by object persons being persons for whom confirmation by an actor who performs confirmation is conducted; processing of acquiring image information representing an image of the object person gazing at the options; and
[0122] processing of deriving, from a sight line of each of the object persons that is derived from the image information, first selection status information being information indicating a status of selection of the options that the object person selects, and of providing the first selection status information for the actor.
[0123] Note that, the actor in the above-described supplementary notes is, for example, the teacher in
[0124] Further, the question is, for example, the question 371 in
[0125] Further, the acquisition processing unit is, for example, a part of the processing unit 101 in
[0126] Further, the confirmation device is, for example, the terminal 100 in
[0127] Further, the image for actor is, for example, an image that is displayed on the display 302a in
[0128] Further, the identification processing unit is, for example, the processing unit 101 in
[0129] While the invention has been particularly shown and described with reference to exemplary embodiments thereof, the invention is not limited to these embodiments. It will be understood by those of ordinary skill in the art that various changes in form and details may be made therein without departing from the spirit and scope of the present invention as defined by the claims.
REFERENCE SIGNS LIST
[0130] 100 Terminal [0131] 101 Processing unit [0132] 101ax Display-for-object-person processing unit [0133] 101bx Acquisition processing unit [0134] 101cx First provision processing unit [0135] 101x Confirmation device [0136] 102 Input unit [0137] 103 Storage unit [0138] 111, 112, 113 Interface [0139] 200 Image input device [0140] 201 Camera [0141] 301 Display device for student [0142] 301a Projector [0143] 302 Display device for teacher [0144] 302a Display [0145] 311 Screen [0146] 371 Question [0147] 381, 382, 383, 384 Option [0148] 386 Remaining time [0149] 391 Gazing instruction information [0150] 401 Teacher [0151] 402 Student [0152] 500 Confirmation system