INFORMATION PROCESSING APPARATUS, INFORMATION PROCESSING METHOD, AND INFORMATION PROCESSING PROGRAM

Abstract

A plurality of training data in which range information indicating a range in which a first region and a second region including at least a part of the first region are present is added to each of a plurality of training images each including the first region and the second region are acquired. For each pixel of the training image, a probability that the pixel is a portion of the first region that is not included in the second region is calculated by using an estimation model. A probability sum, which is a sum of the probabilities, is calculated for each of the plurality of training images. The estimation model is trained such that the probability sum calculated for each of training images in which the first region has the portion that is not included in the second region is increased and the probability sum calculated for each of training images in which the first region does not have the portion that is not included in the second region is zero.

Claims

1. An information processing apparatus comprising: at least one processor, wherein the processor acquires a plurality of training data in which range information indicating a range in which a first region and a second region including at least a part of the first region are present is added to each of a plurality of training images each including the first region and the second region, calculates, for each pixel of the training image, a probability that the pixel is a portion of the first region that is not included in the second region by using an estimation model, calculates a probability sum, which is a sum of the probabilities, for each of the plurality of training images, and trains the estimation model such that the probability sum calculated for each of training images in which the first region has the portion that is not included in the second region is increased and the probability sum calculated for each of training images in which the first region does not have the portion that is not included in the second region is zero.

2. The information processing apparatus according to claim 1, wherein the processor trains the estimation model such that a loss is reduced, the loss including, as one of elements, an evaluation value in which a first average value, which is an average value of the probability sum calculated for each of the training images in which the first region has the portion that is not included in the second region, is included in a denominator and a second average value, which is an average value of the probability sum calculated for each of the training images in which the first region does not have the portion that is not included in the second region, is included in a numerator.

3. The information processing apparatus according to claim 2, wherein, in a case in which the evaluation value is E1, the first average value is A1, the second average value is A2, and predetermined constants are α and β, Expression (I) is satisfied
E1=(A2+α)/(A1+A2+β)  (I).

4. The information processing apparatus according to claim 1, wherein the estimation model calculates, for each pixel of the training image, a probability P.sub.a that the pixel is the first region and a probability P.sub.b that the pixel is the second region to calculate P.sub.a×(1−P.sub.b) as the probability that the pixel is the portion of the first region that is not included in the second region.

5. The information processing apparatus according to claim 1, wherein the training image is a medical image, and the first region is a lesion region and the second region is a biological tissue region including at least a part of the lesion region.

6. The information processing apparatus according to claim 1, wherein the processor acquires a target image including the first region and the second region, specifies at least one of the first region, the second region, or the portion of the first region that is not included in the second region by using the estimation model, and performs control of displaying the specified region or portion in a discriminable manner.

7. The information processing apparatus according to claim 1, wherein, instead of the probability sum, the number of pixels in which the probability that the pixel is the portion of the first region that is not included in the second region is equal to or larger than a threshold value is used.

8. An information processing method executed by at least one processor provided in an information processing apparatus, the method comprising: acquiring a plurality of training data in which range information indicating a range in which a first region and a second region including at least a part of the first region are present is added to each of a plurality of training images each including the first region and the second region; calculating, for each pixel of the training image, a probability that the pixel is a portion of the first region that is not included in the second region by using an estimation model; calculating a probability sum, which is a sum of the probabilities, for each of the plurality of training images; and training the estimation model such that the probability sum calculated for each of training images in which the first region has the portion that is not included in the second region is increased and the probability sum calculated for each of training images in which the first region does not have the portion that is not included in the second region is zero.

9. A non-transitory computer-readable storage medium storing an information processing program causing at least one processor provided in an information processing apparatus to execute a process comprising: acquiring a plurality of training data in which range information indicating a range in which a first region and a second region including at least a part of the first region are present is added to each of a plurality of training images each including the first region and the second region; calculating, for each pixel of the training image, a probability that the pixel is a portion of the first region that is not included in the second region by using an estimation model; calculating a probability sum, which is a sum of the probabilities, for each of the plurality of training images; and training the estimation model such that the probability sum calculated for each of training images in which the first region has the portion that is not included in the second region is increased and the probability sum calculated for each of training images in which the first region does not have the portion that is not included in the second region is zero.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

[0020] Exemplary embodiments according to the technique of the present disclosure will be described in detail based on the following figures, wherein:

[0021] FIG. 1A is a diagram showing a case in which a plurality of regions have a complete inclusion relationship;

[0022] FIG. 1B is a diagram showing a case in which the plurality of regions have a partial inclusion relationship;

[0023] FIG. 2A is a tomographic image showing a case of rectal cancer;

[0024] FIG. 2B is a tomographic image showing a case of the rectal cancer;

[0025] FIG. 3 is a diagram showing an example of a functional configuration of an information processing apparatus according to an embodiment of the disclosed technology in a learning phase;

[0026] FIG. 4 is a diagram showing an example of training data according to the embodiment of the disclosed technology;

[0027] FIG. 5 is a diagram showing an example of a functional configuration of the information processing apparatus according to the embodiment of the disclosed technology in an operation phase;

[0028] FIG. 6 is a diagram showing an example of display control in the information processing apparatus according to the embodiment of the disclosed technology;

[0029] FIG. 7 is a diagram showing an example of a hardware configuration of the information processing apparatus according to the embodiment of the disclosed technology;

[0030] FIG. 8 is a flowchart showing an example of a flow of learning processing according to the embodiment of the disclosed technology; and

[0031] FIG. 9 is a flowchart showing an example of a flow of image recognition processing according to the embodiment of the disclosed technology.

DETAILED DESCRIPTION

[0032] Hereinafter, an example of an embodiment of the disclosed technology will be described with reference to the drawings. It should be noted that the same or equivalent components and portions in the respective drawings are denoted by the same reference numerals, and the overlapping description will be omitted as appropriate.

[0033] FIG. 3 is a diagram showing an example of a functional configuration of an information processing apparatus 10 according to the embodiment of the disclosed technology in a learning phase. In the learning phase, the information processing apparatus 10 performs processing of training the estimation model 30 by machine learning. The information processing apparatus 10 trains the estimation model 30 such that the estimation model 30 appropriately performs the segmentation of a plurality of regions included in an image which is a processing target (hereinafter, referred to as a target image) while appropriately specifying the inclusion relationship between the plurality of regions. The information processing apparatus 10 comprises an acquisition unit 11, a learning unit 12, and a storage unit 43. A plurality of training data 20 and the estimation model 30 are stored in the storage unit 43.

[0034] The acquisition unit 11 acquires the plurality of training data 20 stored in the storage unit 43. FIG. 4 is a diagram showing an example of the training data 20. The training data 20 is data in which range information 22 indicating a range in which each region is present is added as a correct answer mask to a training image 21 including a plurality of regions having a complete inclusion relationship or a partial inclusion relationship.

[0035] FIG. 4 shows a case in which a tomographic image showing a case of rectal cancer, which is a medical image, is used as the training image 21. The training image 21 includes a cancer region 201, a muscularis propria region 202, and a mesorectum region 203. The cancer region 201 and the muscularis propria region 202 have the complete inclusion relationship or the partial inclusion relationship. It should be noted that the cancer region 201 is an example of a first region according to the disclosed technology, and the muscularis propria region 202 is an example of a second region according to the disclosed technology.

[0036] The training data 20 is data in which range information 22A indicating a range in which the cancer region 201 is present, range information 22B indicating a range in which the muscularis propria region 202 is present, and range information 22C indicating a range in which the mesorectum region 203 is present are added as the correct answer masks to the training image 21. In a case in which the inclusion relationship between the cancer region 201 and the muscularis propria region 202 included in the training image 21 is the complete inclusion relationship, the entire range in which the cancer region is present indicated by the range information 22A is included in the range in which the muscularis propria region indicated by the range information 22B is present. On the other hand, in a case in which the inclusion relationship between the cancer region 201 and the muscularis propria region 202 included in the training image 21 is the partial inclusion relationship, a part of the range in which the cancer region is present indicated by the range information 22A is not included in the range in which the muscularis propria region indicated by the range information 22B is present. In addition, in the training image 21, both of these regions are assigned as correct answers to each pixel of a portion of the cancer region 201 that is included in the muscularis propria region 202.

[0037] The training data 20 includes both the training image 21 including a plurality of regions having the complete inclusion relationship and the training image 21 including a plurality of regions having the partial inclusion relationship.

[0038] The learning unit 12 trains the estimation model 30 using the training data 20 acquired by the acquisition unit 11. The estimation model 30 is a mathematical model constructed to perform the segmentation on a pixel (voxel or pixel) unit for the target image including the plurality of regions. The estimation model 30 performs the segmentation on the plurality of regions included in the target image while specifying the inclusion relationship. That is, the estimation model 30 assigns the plurality of regions to the pixels of a portion in which a certain region is included in the other region. The estimation model 30 may constitute a neural network, for example.

[0039] The learning unit 12 calculates, for each pixel of the training image 21, a probability P.sub.x that the pixel is a portion of the cancer region 201 that is not included in the muscularis propria region 202 by using the estimation model 30. The portion of the cancer region 201 that is not included in the muscularis propria region 202 is a cancer region that has invaded the mesorectum region 203 or a cancer region that has invaded further to the outside beyond the mesorectum region 203. The learning unit 12 calculates the probability P.sub.x, for example, as follows.

[0040] The learning unit 12 inputs the training image 21 acquired by the acquisition unit 11 to the estimation model 30. The estimation model 30 performs the segmentation for each pixel on the input training image 21. Specifically, the estimation model 30 calculates, for each pixel of the training image 21, a probability P.sub.a that the pixel is the cancer region 201 and the probability P.sub.b that the pixel is the muscularis propria region 202. Further, the estimation model 30 calculates, for each pixel of the training image 21, P.sub.a×(1−P.sub.b) as a probability P.sub.x in which the pixel is the portion of the cancer region 201 that is not included in the muscularis propria region 202 (portion of the cancer region that has invaded the mesorectum region). That is, the probability P.sub.x is calculated as the probability that the pixel is the cancer region 201 and is not the muscularis propria region 202. The estimation model 30 calculates the probabilities P.sub.a, P.sub.b, and P.sub.x for each pixel of each of a plurality of training images 21.

[0041] The learning unit 12 calculates a probability sum ΣP.sub.x, which is the sum of the probability P.sub.x, for each of the plurality of training images 21. The probability sum ΣP.sub.x is a value corresponding to the volume (or area) of the portion of the cancer region 201 that is not included in the muscularis propria region 202 (portion of the cancer region that has invaded the mesorectum region) in the training image 21. In a case in which the estimation model 30 is ideal, the probability sum ΣP.sub.x calculated for the training image 21 in which the inclusion relationship between the cancer region 201 and the muscularis propria region 202 is the partial inclusion relationship should be a relatively large value, which is larger than zero. In addition, the probability sum ΣP.sub.x calculated for the training image 21 in which the inclusion relationship between the cancer region 201 and the muscularis propria region 202 is the complete inclusion relationship should be zero. Therefore, the learning unit 12 trains the estimation model 30 such that the probability sum ΣP.sub.x calculated for each training image 21 in which the inclusion relationship between the cancer region 201 and the muscularis propria region 202 is the partial inclusion relationship is a relatively large value, which is larger than zero and the probability sum ΣP.sub.x calculated for the training image 21 in which the inclusion relationship between the cancer region 201 and the muscularis propria region 202 is the complete inclusion relationship is zero.

[0042] Specifically, the learning unit 12 trains the estimation model 30 such that a loss L including, as one of the elements, an evaluation value E1 represented by Expression (1) is reduced. In Expression (1), A1 is an average value of the probability sum ΣP.sub.x calculated for each training image 21 in which the inclusion relationship between the cancer region 201 and the muscularis propria region 202 is the partial inclusion relationship, A2 is an average value of the probability sum ΣP.sub.x calculated for each training image 21 in which the inclusion relationship between the cancer region 201 and the muscularis propria region 202 is the complete inclusion relationship, and α and β are constants. α and β may be the same value. As the average value A1, a value, which is obtained by dividing a total value of the probability sum ΣP.sub.x calculated for each training image 21 in which the inclusion relationship between the cancer region 201 and the muscularis propria region 202 is the partial inclusion relationship by the number of these images, can be used. As the average value A2, a value, which is obtained by dividing a total value of the probability sum ΣP.sub.x calculated for each training image 21 in which the inclusion relationship between the cancer region 201 and the muscularis propria region 202 is the complete inclusion relationship by the number of these images, can be used. It should be noted that the average value A1 is an example of a first average value according to the disclosed technology, and the average value A2 is an example of a second average value according to the disclosed technology.

E1=(A2+α)/(A1+A2+β)  (1)

[0043] Expression (2) is an example of the loss L including the evaluation value E1 represented by Expression (1), as one of the elements. In Expression (2), an evaluation value E2 is another element of the loss L, W1 is a weight constant with respect to the evaluation value E1, and W2 is a weight constant with respect to the evaluation value E2. The evaluation value E1 mainly plays a role of improving the estimation accuracy of the inclusion relationship between the regions, and the evaluation value E2 mainly plays a role of improving the segmentation accuracy.

L=E1×W1+E2×W2  (2)

[0044] Expression (3) is an example of the evaluation value E2. As shown in Expression (3), soft dice loss can be used as the evaluation value E2. In Expression (3), G.sub.a is a correct answer value for each pixel based on the range information 22A, 1 is added to the pixel that is the cancer region 201, and 0 is added to the pixel that is not the cancer region 201. P.sub.a is a probability that the pixel is the cancer region 201, which is calculated by the estimation model 30. G.sub.b is a correct answer value for each pixel based on the range information 22B, 1 is added to the pixel that is the muscularis propria region 202, and 0 is added to the pixel that is not the muscularis propria region 202. P.sub.b is a probability that the pixel is the muscularis propria region 202, which is calculated by the estimation model 30. G.sub.c is a correct answer value for each pixel based on the range information 22C, 1 is added to the pixel that is the mesorectum region 203, and 0 is added to the pixel that is not the mesorectum region 203. P.sub.c is a probability that the pixel is the mesorectum region 203, which is calculated by the estimation model 30. γ, δ, and ε are weight constants for each class (cancer region 201, muscularis propria region 202, and mesorectum region 203), respectively. It should be noted that the evaluation value E2 is not limited to the soft dice loss represented by Expression (3), and other values that contribute to the improvement of the segmentation accuracy can also be used.

[00001]$\begin{array}{cc}E2=1-\frac{2}{\gamma +\delta +\epsilon }\left(\frac{.Math.\left(G_a*P_a\right)}{.Math.G_a+.Math.P_a}\times \gamma +\frac{.Math.\left(G_b*P_b\right)}{.Math.G_b+.Math.P_b}\times \delta +\frac{.Math.\left(G_c*P_c\right)}{.Math.G_c+.Math.P_c}\times \epsilon \right)& \left(3\right)\end{array}$

[0045] Whether the inclusion relationship between the cancer region 201 and the muscularis propria region 202 included in the training image 21 is the complete inclusion relationship or the partial inclusion relationship can be grasped by the range information 22A and 22B as the correct answer mask added to the training image 21. In a case in which the estimation model 30 is ideal, the average value A1 should be a relatively large value, which is larger than zero, and the average value A2 should be zero. Therefore, by training the estimation model 30 such that the loss L is reduced, the loss L including, as one of elements, the evaluation value E1 in which the average value A1 is included in a denominator and the average value A2 is included in a numerator, the estimation model 30 that appropriately performs the segmentation of the cancer region 201 and the muscularis propria region 202 while appropriately specifying the inclusion relationship between these regions can be constructed.

[0046] FIG. 5 is a diagram showing an example of a functional configuration of the information processing apparatus 10 in an operation phase. In the operation phase, the information processing apparatus 10 operates the trained estimation model 30 to perform the segmentation for the plurality of regions included in the target image. The information processing apparatus 10 includes an acquisition unit 13, a specifying unit 14, and a display control unit 15.

[0047] The acquisition unit 13 acquires the target image including the plurality of regions that are the targets of the segmentation. Hereinafter, as an example, a case will be described in which the target image is the tomographic image similar to the training image 21 shown in FIG. 4, the cancer region, the muscularis propria region, and the mesorectum region are included in the target image, and the segmentation is performed for each of these regions.

[0048] The specifying unit 14 inputs the target image acquired by the acquisition unit 13 to the trained estimation model 30. The estimation model 30 performs the segmentation for each pixel of the target image. Specifically, the estimation model 30 calculates, for each pixel of the target image, the probability P.sub.a that the pixel is the cancer region and the probability P.sub.b that the pixel is the muscularis propria region. Further, the estimation model 30 calculates, for each pixel of the target image, P.sub.a×(1−P.sub.b) as the probability P.sub.x in which the pixel is the portion of the cancer region that is not included in the muscularis propria region (portion of the cancer region that has invaded the mesorectum region).

[0049] The specifying unit 14 specifies the region consisting of pixels in which the probability P.sub.a is equal to or larger than a predetermined threshold value as the cancer region, and specifies the region consisting of pixels in which the probability P.sub.b is equal to or larger than the predetermined threshold value as the muscularis propria region. In addition, the specifying unit 14 specifies a region consisting of pixels in which the probability P.sub.x(=P.sub.a×(1−P.sub.b)) is equal to or larger than the predetermined threshold value as the portion of the cancer region that is not included in the muscularis propria region (portion of the cancer region that has invaded the mesorectum region).

[0050] The display control unit 15 performs control of displaying each region specified by the specifying unit 14 in a discriminable manner. For example, as shown in FIG. 6, the display control unit 15 performs control of displaying color-coded label images indicating ranges in which the cancer region, the muscularis propria region, and the portion of the cancer region that is not included in the muscularis propria region (portion of the cancer region that has invaded the mesorectum region) are present, respectively, in a manner of being superimposed on the target image. It should be noted that the specifying unit 14 may specify at least one of the cancer region, the muscularis propria region, or the portion that is not included in the muscularis propria region of the cancer region. In this case, the display control unit 15 performs control of displaying the region or portion specified by the specifying unit 14 in a discriminable manner.

[0051] FIG. 7 is a diagram showing an example of a hardware configuration of the information processing apparatus 10. The information processing apparatus 10 comprises a central processing unit (CPU) 41, a memory 42 as a transitory storage area, and a non-volatile storage unit 43. In addition, the information processing apparatus 10 comprises a display unit 44 configured by a display device, such as a liquid crystal display, and an input unit 45 configured by an input device, such as a keyboard and a mouse. The CPU 41, the memory 42, the storage unit 43, the display unit 44, and the input unit 45 are connected to each other via a bus 46.

[0052] The storage unit 43 is realized by, for example, a non-volatile storage medium, such as a hard disk drive (HDD), a solid state drive (SSD), or a flash memory. The storage unit 43 stores the training data 20, the estimation model 30, a learning program 51, and an image recognition program 52. The CPU 41 loads the learning program 51 and the image recognition program 52 in the memory 42 and then executes the learning program 51 and the image recognition program 52. The CPU 41 executes the learning program 51, so that the CPU 41 functions as the acquisition unit 11 and the learning unit 12. In addition, the CPU 41 executes the image recognition program 52, so that the CPU 41 functions as the acquisition unit 13, the specifying unit 14, and the display control unit 15. The CPU 41 is an example of a processor according to the disclosed technology.

[0053] FIG. 8 is a flowchart showing an example of a flow of learning processing executed by the CPU 41 executing the learning program 51. For example, the CPU 41 executes the learning program 51 in a case in which a user inputs an execution instruction of the learning processing via the input unit 45 in the learning phase.

[0054] In step S1, the acquisition unit 11 acquires the plurality of training data 20 stored in the storage unit 43.

[0055] In step S2, the learning unit 12 calculates, for each pixel of each of the plurality of training images 21, the probability P.sub.a that the pixel is the cancer region 201, the probability P.sub.b that the pixel is the muscularis propria region 202, and the probability P.sub.x(=P.sub.a×(1−P.sub.b)) that the pixel is the portion of the cancer region 201 that is not included in the muscularis propria region 202 (portion of the cancer region that has invaded the mesorectum region) by using the estimation model 30.

[0056] In step S3, the learning unit 12 calculates the probability sum ΣP.sub.x for each of the plurality of training images 21.

[0057] In step S4, the learning unit 12 calculates the loss L including, as one of the elements, the evaluation value E1 represented by Expression (1) based on the probability sum ΣP.sub.x calculated in step S3. As the loss L, for example, a value represented by Expression (2) can be used, and as the evaluation value E2, for example, a value represented by Expression (3) can be used.

[0058] In step S5, the learning unit 12 trains the estimation model 30 such that the loss L calculated in step S4 is minimized. The estimation model 30 is optimized by repeatedly executing the processing of steps S1 to S5 while exchanging the sets of the training data 20 to be used.

[0059] FIG. 9 is a flowchart showing an example of a flow of image recognition processing executed by the CPU 41 executing the image recognition program 52. For example, the CPU 41 executes the image recognition program 52 in a case in which the user inputs an execution instruction of the image recognition processing via the input unit 45 in the operation phase.

[0060] In step S11, the acquisition unit 13 acquires the target image. In step S12, the specifying unit 14 calculates, for each pixel of the target image, the probability P.sub.a that the pixel is the cancer region, the probability P.sub.b that the pixel is the muscularis propria region, and the probability P.sub.x(=P.sub.a×(1−P.sub.b)) that the pixel is the portion of the cancer region that is not included in the muscularis propria region (the cancer region that has invaded the mesorectum region) by using the trained estimation model 30.

[0061] In step S13, the specifying unit 14 specifies the region consisting of pixels in which the probability P.sub.a is equal to or larger than the predetermined threshold value as the cancer region, and specifies the region consisting of pixels in which the probability P.sub.b is equal to or larger than the predetermined threshold value as the muscularis propria region. In addition, the specifying unit 14 specifies the region consisting of pixels in which the probability P.sub.x (=P.sub.a×(1−P.sub.b)) is equal to or larger than the predetermined threshold value as the portion of the cancer region that is not included in the muscularis propria region (portion of the cancer region that has invaded the mesorectum region).

[0062] In step S14, the display control unit 15 performs control of displaying each region specified in step S13 in a discriminable manner. As shown in FIG. 6, the display control unit 15 performs, on the display unit 44, control of displaying the color-coded label images indicating ranges in which the cancer region, the muscularis propria region, and the portion of the cancer region that is not included in the muscularis propria region (portion of the cancer region that has invaded the mesorectum region) are present, respectively, in a manner of being superimposed on the target image.

[0063] As described above, the information processing apparatus 10 according to the embodiment of the disclosed technology acquires the plurality of training data 20 in which the range information 22A and 22B indicating the ranges in which the first region and the second region are present are added to each of the plurality of training images 21 each including the first region (for example, the cancer region) and the second region (for example, the muscularis propria region) that includes at least a part of the first region in the learning phase in which the estimation model 30 is trained. The information processing apparatus 10 calculates, for each pixel of the training image 21, the probability P.sub.x (=P.sub.a×(1−P.sub.b)) that the pixel is the portion of the first region that is not included in the second region (for example, the portion of the cancer region that has invaded the mesorectum region) by using the estimation model 30. The information processing apparatus 10 calculates the probability sum ΣP.sub.x, which is the sum of the probability P.sub.x, for each of the plurality of training images 21. The information processing apparatus 10 trains the estimation model 30 such that the probability sum ΣP.sub.x calculated for each training image 21 in which the first region has the portion that is not included in the second region (that is, the inclusion relationship between the first region and the second region is the partial inclusion relationship) is increased and the probability sum ΣP.sub.x calculated for each training image 21 in which the first region does not have the portion that is not included in the second region (that is, the inclusion relationship between the first region and the second region is the complete inclusion relationship) is zero.

[0064] The information processing apparatus 10 trains the estimation model 30 as described above, so that the estimation model 30 can appropriately perform the segmentation while appropriately specifying the inclusion relationship for the plurality of regions included in the target image. In particular, by using the evaluation value E1 including the element of the probability P.sub.x, it is possible to improve the specificity (probability of correctly determining a case not having the partial inclusion relationship as being not having the partial inclusion relationship).

[0065] In addition, in the operation phase in which the trained estimation model 30 is operated, the information processing apparatus 10 according to the embodiment of the disclosed technology acquires the target image including the first region and the second region, specifies at least one of the first region, the second region, or the portion of the first region that is not included in the second region by using the trained estimation model 30, and performs control of displaying the specified region or portion in a discriminable manner. As a result, it is possible to visualize, for example, the presence or absence of invasion of the cancer region into the peripheral tissues and the invasion range.

[0066] It should be noted that, in the above description, the case has been described in which the segmentation is performed on the cancer region and the muscularis propria region included in the medical image, but the disclosed technology can also be applied to a case in which the segmentation is performed on the lesion region other than the cancer region and the biological tissue region other than the muscularis propria region. In addition, the case has been described in which the target image is the medical image, but the disclosed technology is not limited to this. For example, the disclosed technology can also be applied to a case in which the segmentation is performed on a plurality of regions included in a microscopic image, an inspection image used in an inspection step of a production line, or the like.

[0067] In addition, a case has been described in which the evaluation value calculated based on the probability sum ΣP.sub.x is used as the evaluation value used for training the estimation model 30, but the disclosed technology is not limited to this aspect. It is also possible to use the number of pixels N in which the probability P.sub.x is equal to or larger than the threshold value, instead of the probability sum ΣP.sub.x. Similar to the probability sum ΣP.sub.x, the number of pixels N is the value corresponding to the volume (or area) of the portion of the cancer region 201 that is not included in the muscularis propria region 202 (portion of the cancer region that has invaded the mesorectum region). In a case in which the number of pixels N is used, the learning unit 12 trains the estimation model 30 such that the loss L including, as one of the elements, the evaluation value E1′ represented by Expression (4) is reduced. In Expression (4), N1 is an average value of the number of pixels N calculated for each training image 21 in which the inclusion relationship between the cancer region 201 and the muscularis propria region 202 is the partial inclusion relationship, N2 is an average value of the number of pixels N calculated for each training image 21 in which the inclusion relationship between the cancer region 201 and the muscularis propria region 202 is the complete inclusion relationship, and α and β are constants. α and β may be the same value.

E1′=(N2+α)/(N1+N2+β)  (4)

[0068] In the embodiment described above, various processors shown below can be used as the hardware structure of processing units that execute various types of processing, such as the acquisition unit 11, the learning unit 12, the acquisition unit 13, the specifying unit 14, and the display control unit 15. The various processors include, as described above, in addition to the CPU, which is a general-purpose processor which executes software (program) and functions as various processing units, a programmable logic device (PLD) which is a processor whose circuit configuration can be changed after manufacture, such as an FPGA, and a dedicated electric circuit which is a processor having a circuit configuration which is designed for exclusive use in order to execute specific processing, such as an application specific integrated circuit (ASIC).

[0069] One processing unit may be configured by one of the various processors or may be configured by a combination of two or more processors of the same type or different types (for example, a combination of a plurality of FPGAs or a combination of a CPU and an FPGA). In addition, a plurality of processing units may be configured by one processor.

[0070] A first example of the configuration in which the plurality of processing units are configured by one processor is a form in which one processor is configured by a combination of one or more CPUs and software and the processor functions as the plurality of processing units, as represented by the computer, such as a client and a server. Second, as represented by a system on chip (SoC) or the like, there is a form of using a processor that realizes the function of the entire system including the plurality of processing units by one integrated circuit (IC) chip. As described above, various processing units are configured by one or more of the various processors as the hardware structure.

[0071] Further, more specifically, an electric circuit (circuitry) obtained by combining circuit elements, such as semiconductor elements, can be used as the hardware structure of the various processors.

[0072] In addition, in the embodiment described above, an aspect has been described in which the learning program 51 and the image recognition program 52 are stored (installed) in the storage unit 43 in advance, but the disclosed technology is not limited to this. The learning program 51 and the image recognition program 52 may be provided in a form of being recorded in a recording medium, such as a compact disc read only memory (CD-ROM), a digital versatile disc read only memory (DVD-ROM), and a universal serial bus (USB) memory. In addition, a form may be adopted in which the learning program 51 and the image recognition program 52 are downloaded from an external device via the network.

[0073] It should be noted that the disclosure of JP2020-163871 filed on Sep. 29, 2020 is incorporated in the present specification in its entirety by reference. In addition, all documents, patent applications, and technical standards described in the present specification are incorporated herein by reference to the same extent as in a case in which each document, each patent application, and each technical standard are specifically and individually described by being incorporated in the present specification by reference.