A non-transitory computer-readable recording medium stores a question collection creating program for causing a computer to execute a process including: determining a criterion based on a difference between a correct answer rate of at least one machine learning model for a plurality of questions and a correct answer rate of a learner for the plurality of questions; selecting, from among the plurality of questions, one or a plurality of questions with which the correct answer rate of the at least one machine learning model becomes a value that corresponds to the criterion; and outputting the one or the plurality of selected questions as a question collection for the learner.

A non-transitory computer-readable recording medium stores a question collection creating program for causing a computer to execute a process including: determining a criterion based on a difference between a correct answer rate of at least one machine learning model for a plurality of questions and a correct answer rate of a learner for the plurality of questions; selecting, from among the plurality of questions, one or a plurality of questions with which the correct answer rate of the at least one machine learning model becomes a value that corresponds to the criterion; and outputting the one or the plurality of selected questions as a question collection for the learner.

A scoring apparatus includes an acquisition unit that acquire an image that is read from a recording medium having an answer column, an instruction unit that provides an instruction to perform a determination on at least one of a correct answer and an incorrect answer from correct answer information related to the recording medium and answer information included in the image acquired by the acquisition unit, a receiving unit that receives determination end information indicating that the determination has ended and determination results on each answer column that has undergone the determination, a notification unit that performs a notification of the determination end information received by the receiving unit, and a controller that performs control to display, before the notification unit has performed the notification, the determination results on the answer column that has undergone the determination.

A scoring apparatus includes an acquisition unit that acquire an image that is read from a recording medium having an answer column, an instruction unit that provides an instruction to perform a determination on at least one of a correct answer and an incorrect answer from correct answer information related to the recording medium and answer information included in the image acquired by the acquisition unit, a receiving unit that receives determination end information indicating that the determination has ended and determination results on each answer column that has undergone the determination, a notification unit that performs a notification of the determination end information received by the receiving unit, and a controller that performs control to display, before the notification unit has performed the notification, the determination results on the answer column that has undergone the determination.

A learning system includes signal transmitters disposed respectively at different areas, a portable electronic device, and a server storing various question banks associated respectively with pre-stored location data sets. An operation method of the learning system includes each signal transmitter broadcasting a location identifying data set, the portable electronic device transmitting a question request to the server upon receipt of the location identifying data set, the server transmitting to the portable electronic device a question in the question bank associated with the pre-stored location data set that conforms with the location identifying data set, and the portable electronic device outputting the question.

A learning system includes signal transmitters disposed respectively at different areas, a portable electronic device, and a server storing various question banks associated respectively with pre-stored location data sets. An operation method of the learning system includes each signal transmitter broadcasting a location identifying data set, the portable electronic device transmitting a question request to the server upon receipt of the location identifying data set, the server transmitting to the portable electronic device a question in the question bank associated with the pre-stored location data set that conforms with the location identifying data set, and the portable electronic device outputting the question.

Concept map assessment includes receiving a first concept map from a learner and preparing an assessment of the first concept map for a learner based on at least one of: an amount of edge differences and an amount of path differences between the first concept map and a second concept map, a similarity detection system to detect similarity in text between the first concept map, the second concept map and learning content, and peer-review of the first concept map by other learners and reviews of the peer-reviews by the learner of other learners' first concept maps.

Concept map assessment includes receiving a first concept map from a learner and preparing an assessment of the first concept map for a learner based on at least one of: an amount of edge differences and an amount of path differences between the first concept map and a second concept map, a similarity detection system to detect similarity in text between the first concept map, the second concept map and learning content, and peer-review of the first concept map by other learners and reviews of the peer-reviews by the learner of other learners' first concept maps.

An information processing apparatus is configured to display, on a display device, in a first display form, a first query including a question and a plurality of choices that are answers to the question, obtain behavior information indicating a behavior of a user when the user answers the first query in the first display form, determine a first confidence level of the user for the first query in the first display form and a reliability of the first confidence level, when the reliability is less than a threshold value, display the first query on the display device in a second display form, and determine a second confidence level of the user for the first query based on a first answer of the user to the first query in the first display form and a second answer of the user to the first query in the second display form.

An information processing apparatus is configured to display, on a display device, in a first display form, a first query including a question and a plurality of choices that are answers to the question, obtain behavior information indicating a behavior of a user when the user answers the first query in the first display form, determine a first confidence level of the user for the first query in the first display form and a reliability of the first confidence level, when the reliability is less than a threshold value, display the first query on the display device in a second display form, and determine a second confidence level of the user for the first query based on a first answer of the user to the first query in the first display form and a second answer of the user to the first query in the second display form.