Aspects of the present invention relate to providing assistance to medical professionals during the performance of medical procedures through the use of technologies facilitated through a head-worn computer.

The present invention concerns a method for an artificial neural network to confirm the recognition of handwritten characters produced by a user. The method comprising: training the artificial neural network with a training data set comprising a first set of characters; collecting handwritten characters of a second set of characters produced by the user; and analysing the collected characters of the second set of characters by using the artificial neural network to obtain a first set of probability values comprising character specific probability values for the collected characters, each character specific probability value indicating the probability that the collected character has been correctly interpreted. The analysis considers at least the manner how the collected characters are handwritten and the appearance of the collected characters to obtain the character specific probability values. The invention also relates to a corresponding data processing apparatus.

A writing interaction method, a smart interactive display device and a writing interaction system are provided. The writing interaction method includes: detecting a first touch event of one or more smart pens and acquiring one or more corresponding identifiers of the one or more smart pens (S100); generating handwriting according to the first touch event (S102A), and determining whether the generated handwriting corresponds to multiple smart pens of the smart pens according to the identifiers of the smart pens (S102B); under a condition that the handwriting corresponds to the multiple smart pens, generating multiple non-overlapping writing regions, wherein the multiple writing regions are in one-to-one correspondence with the multiple smart pens, each writing region covers handwriting of a corresponding smart pen, and each writing region only responds to a touch event of the corresponding smart pen for generating handwriting (S104).

A method includes receiving sensor data from one or more sensors that corresponds to a location of a stylus device and determining that a tip of the stylus device is in contact with a physical surface based on the sensor data. While in contact, the method includes determining a new location of the tip of the stylus device based on the location data, mitigating a tracking error of the determined new location of the tip of the stylus device by translating the new location from a 3D space domain to a 2D space domain that corresponds to the physical surface and adjusting the new location based on a comparison of the new location and historical locations. The stylus device can further ascertain surface characteristics through sensor data and simulate surface characteristics via haptic feedback effects.

A method of outputting digital ink data includes: detecting one or more pieces of stroke data; judging whether the one or more pieces of stroke data form a complete unit of semantics; in a case that the one or more pieces of the stroke data form the complete unit of semantics, aggregating the one or more pieces of stroke data into one message; and outputting the aggregated one or more pieces of stroke data together in the one message.

Provided are an ink data generation apparatus, an ink data generation method, and an ink data generation program that are capable of improving ease of handling ink data when or after metadata is generated. An ink data generation apparatus performs a determination as to an inclusion relation between a first set and a second set by comparing stroke elements of first set data and stroke elements of second set data using the first set data and the second set data. The ink data generation apparatus generates first metadata for the first set described in a form that varies in accordance with a result of the determination.

Provided is a work record extraction device that can correctly select a drawing element corresponding to handwriting even if there is a handwriting deviation when position coordinates are collated between handwritten data overwritten on drawing data by manual input and a drawing element on the drawing data. The work record extraction device according to the invention sets, around a drawing element, a boundary area including at least a part of the drawing element, determines whether handwritten data passes through at least a part of the boundary area, and determines that the handwritten data passes through the drawing element in a case where the handwritten data passes through at least a part of the boundary area.

One variation of a method includes accessing a print file including a set of vector coordinates defining motion of a writing instrument on a surface for printing a string in a typeface corresponding to a user handwriting profile. The method further includes, during a print period: manipulating the writing instrument on the surface according to the set of vector coordinates to generate a printed copy of the string; regulating pressure applied by the writing instrument to the surface according to a pressure profile; and accessing a feed of images of the surface. The method further includes, during the print period: detecting a character defect of a defect type in a set of printed characters, in the printed copy, based on features extracted from an image in the feed of images; selecting a recovery mode configured to mitigate the defect type; and updating the pressure profile according to the recovery mode.

Provided are an ink data generation apparatus, an ink data generation method, and an ink data generation program that are capable of improving ease of handling ink data when or after metadata is generated. An ink data generation apparatus performs a determination as to an inclusion relation between a first set and a second set by comparing stroke elements of first set data and stroke elements of second set data using the first set data and the second set data. The ink data generation apparatus generates first metadata for the first set described in a form that varies in accordance with a result of the determination.

A display apparatus includes circuitry that displays, on a screen, a table including one or more table elements; receives handwritten data input on the screen by a user operation; and selects, based on the handwritten data, at least one table element of the table. The table element is a row or a column of the table.