Image processing apparatus, program and image processing method
11437001 · 2022-09-06
Assignee
Inventors
- Yuji Haruki (Ishikawa, JP)
- Ikumi Arai (Ishikawa, JP)
- Naoaki Hirata (Ishikawa, JP)
- Yoichi Ueda (Ishikawa, JP)
- Tomoharu Yachikami (Ishikawa, JP)
Cpc classification
A61B6/00
HUMAN NECESSITIES
G09G2340/045
PHYSICS
H04N1/387
ELECTRICITY
G06T3/40
PHYSICS
H04N1/00
ELECTRICITY
International classification
G06T3/40
PHYSICS
Abstract
Provided are an image processing apparatus, a program and an image processing method capable of avoiding interference with the function of another program. An image processing apparatus includes a position information detection unit configured to detect position information indicating a position on a display, a region position setting unit configured to set the position of the region of interest on the display based on the position information, and an image processing unit configured to perform image process on at least one image among an image inside of the region of interest and an image outside of the region of interest. The region position setting unit, when the position information is changed with the image process, sets the position of the region of interest based on the position information immediately before the change.
Claims
1. An image processing apparatus comprising: a position information detection unit; a region position setting unit; a position information changing unit; and an image processing unit; wherein the position information detection unit is configured to detect position information indicating a position on a display, the region position setting unit is configured to set a position of a region of interest on the display based on the position information, the image processing unit is configured to perform image processing on at least one image among an image inside of the region of interest and an image outside of the region of interest, the image processing performed by the image processing unit includes at least one of first and second image processing, the first processing is a processing for enhancing a gradation of the image, the second processing is a processing for enlarging the image, the position information changing unit is configured to change the position information to a predetermined position when the image processing is performed, the position information is specified by a pointer position of a pointer displayed on the display; and the region position setting unit sets, even if the position information is changed to the predetermined position with the image processing, the position of the region of interest after the position information is changed to the position of the region of interest immediately before the position information is changed.
2. The image processing apparatus of claim 1, wherein the region position setting unit sets a position associated with the pointer position as the position of the region of interest.
3. The image processing apparatus of claim 1, wherein the image processing unit is configured to enlarge the region of interest when performing the image process.
4. The image processing apparatus of claim 3, wherein the image processing unit is configured to perform the enlargement of the region of interest while maintaining the relative position of the region of interest in the entire image displayed on the display.
5. The image processing apparatus of claim 1, wherein the image processing unit is configured to move the region of interest when performing the image process.
6. The image processing apparatus of claim 5, wherein the image processing unit is configured to perform the movement of the region of interest while maintaining the relative position of the region of interest in the entire image displayed on the display.
7. The image processing apparatus of claim 1, wherein the image processing unit performs image process to maintain the image quality of at least one image among an image inside of the region of interest and an image outside of the region of interest.
8. The image processing apparatus of claim 1, wherein the image processing unit is configured to hide the region of interest when performing the image process.
9. A computer readable non-transitory recording medium storing a program for causing a computer to function as: a position information detection unit configured to detect position information indicating a position on a display; a region position setting unit configured to set a position of a region of interest on the display based on the position information; and an image processing unit configured to perform image processing on at least one image among an image inside of the region of interest and an image outside the region of interest; a position information changing unit configured to change the position information to a predetermined position when the image processing is performed; wherein the image processing performed by the image processing unit includes at least one of first and second image processing, the first processing is a processing for enhancing a gradation of the image, the second processing is a processing for enlarging the image, the position information is specified by a pointer position of a pointer displayed on the display; and the region position setting unit sets, even if the position information is changed to the predetermined position with the image processing, the position of the region of interest after the position information is changed to the position of the region of interest immediately before the position information is changed.
10. An image process method comprising: a position information detection step of detecting, by a position information detection unit, position information indicating a position on a display; a region position setting step of setting, by a region position setting unit, a position of a region of interest on the display based on the position information; and an image processing step of performing, by an image processing unit, image processing on at least one image among an image inside of the region of interest and an image outside of the region of interest; a position information changing step of changing the position information to a predetermined position when the image processing is performed; and wherein the image processing performed by the image processing unit includes at least one of first and second image processing, the first processing is a processing for enhancing a gradation of the image, the second processing is a processing for enlarging the image, the position information is specified by a pointer position of a pointer displayed on the display; and in region position setting step, the region position setting unit sets, even if the position information is changed to the predetermined position with the image processing, the position of the region of interest after the position information is changed to the position of the region of interest immediately before the position information is changed.
Description
(1)
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11)
(12)
DESCRIPTION OF EMBODIMENTS
(13) Hereinafter, embodiments of the present invention will be described using the drawings. The various features shown in the embodiments described below can be combined with one another.
1. First Embodiment
(14) As shown in
(15) <Image Processing Apparatus 1>
(16) As shown in
(17) The position information detection unit 11 detects position information indicating the position on the display 40. In the present embodiment, the position information is specified by a pointer position PP of a pointer displayed on the display 40. Here, the pointer can be moved to any position by a user operating the operation unit 30. In the present embodiment, the position corresponding to the tip of the pointer specifies the coordinates of position information.
(18) When the position information is changed with the image processing by the image processing unit 16, the region position setting unit 12 sets the position of a region of interest ROI on the display 40 based on the position information immediately before the change. Here, the region of interest ROI is a region which is highlighted in the image displayed on the display 40 and is set by operating the operation unit 30.
(19) The position information changing unit 13 changes the position information to a predetermined position when the image processing is performed. Then, while the image process is performed, that is, even when the position information is changed, the position immediately before the change is set as the position of the region of interest ROI. This is a specification of the image display program 22 and is performed in consideration of the relationship with other processes.
(20) The region mode switching unit 14 switches the display mode of the region of interest ROI. The display mode of the region of interest ROI will be described later with reference to
(21) The image processing unit 16 performs image process on at least one image among an image inside of the region of interest and an image outside of the region of interest ROI. For example, the image processing unit 16 performs image process for enhancing the gradation of the image in the region of interest ROI and image process suitable for grayscale to improve the visibility of the region of interest ROI. Also, conversely, the image processing unit 16 may perform process to lower the gradation of the image outside of the region of interest ROI and image process not suitable for grayscale to relatively improve the visibility of the region of interest ROI. The image processing unit 16 can also perform image process on images both inside and outside of the region of interest ROI. Further, the image processing unit 16 may enlarge the image in the region of interest ROI and display the enlarged image overlapped on the image outside of the region of interest ROI.
(22) The region of interest setting program 21 realizes a function of the image processing apparatus 1 for setting the region of interest ROI. Control of the region of interest ROI is realized by the cooperation of the region of interest setting program 21, the position information detection unit 11, the region position setting unit 12, the region mode switching unit 14, the region of interest changing unit 15 and the image processing unit 16.
(23) The image display program 22 realizes a function for controlling the image processing apparatus 1 and displaying a predetermined image on the display 40. In the present embodiment, the image display program 22 is a viewer for displaying a predetermined document. Further, the image display program 22 corresponds to a program for changing the pointer position to a predetermined position when the pointer is not displayed. When the image display program 22 cooperates with the position information changing unit 13 and the image processing unit 16, the image process by the image processing unit 16 and the display function by the image display program 22 may interfere with each other. Such interference will be described later using
(24) The position information storage unit 23 stores the position information. In the present embodiment, the position information storage unit 23 stores the pointer position PP operated by the operation unit 30. Such storage may be performed every predetermined time or every predetermined movement amount of the pointer.
(25) <Region of Interest ROI>
(26) Next, the region of interest ROI will be described using
(27) These display modes can be switched by the region mode switching unit 14. Here, the height of the band in
(28)
(29) <Control of ROI>
(30) Next, control of the region of interest ROI will be described with reference to
Comparative Example 1
(31) As shown in
(32) In this state, it is assumed that the gradation of the entire image shown in
(33) Thereafter, when pressing the command “shift+control+up arrow” by the keyboard is finished, the pointer is redisplayed as shown in
(34) On the other hand, in the image processing apparatus 1 according to an embodiment of the present invention, such problem is solved. In the example of
(35) As shown in
(36) In this state, it is assumed that the operation to increase the gradation of the entire image shown in
(37) Then, when the pointer is not displayed, the region position setting unit 12 is configured to set the pointer position PP immediately before the pointer becomes not displayed as the position information of the region of interest ROI when the pointer is not displayed. This is also a feature of the present embodiment. Therefore, even if the pointer position PP is changed while the pointer is not displayed, the region position setting unit 12 can set the pointer position PP immediately before the pointer becomes not displayed as the position of the region of interest ROI when the pointer is not displayed.
(38) Thereafter, when the operation of changing the gradation is completed, the pointer is redisplayed as shown in
(39) As described above, in the present embodiment, when the pointer is not displayed, the region of interest ROI is not set based on the current position information of the pointer, but is set based on the position information immediately before the pointer becomes not displayed. For this reason, even when using the image display program 22 which is designed to move the region of interest ROI to another position when the pointer is not displayed, it is suppressed that the region of interest ROI is unintentionally changed.
(40) Next, other image process on an image in the region of interest ROI will be described using
(41) When the pointer is not displayed, the region position setting unit 12 sets the pointer position PP immediately before the pointer becomes not displayed as the position information of the region of interest ROI when the pointer is not displayed. In addition, the region of interest ROI is enlarged when the pointer is not displayed. Here, in the present embodiment, the enlargement ratio is assumed to be double. Then, the size of the region of interest ROI is enlarged double in accordance with the enlargement ratio (double) of the image. Such enlargement is performed by the region of interest changing unit 15. Thereby, all or most of the images included in the region of interest ROI before enlargement become included in the region of interest ROI after enlargement. Further, the enlargement is controlled so that the image included in the region of interest ROI before the enlargement become as close as possible to the center of the display 40. Such control is realized by using known pattern matching or feature vectors. Therefore, it is possible to omit the procedure of the user operating the operation unit 30 for changing the size of the region of interest ROI.
(42) Thereafter, when the command that “control” is pressed on the keyboard with mouse operation is finished, the pointer is redisplayed as shown in
(43) On the other hand, in the example of
(44) In the examples of
(45) These processes can be combined with one another. For example, as shown in
(46) Next, process in the case that a plurality of regions of interest ROI is set will be described. As shown in
(47) By the various processes described above, interference between the function of the image display program 22 and the region of interest setting program 21 is avoided. Further, before and after image process by the image processing unit 16, the position of the region of interest ROI can be fixed or moved to a preferable position, and the region of interest ROI can be enlarged as needed.
(48) <Region of Interest ROI when Executing P by P Function>
(49) Next, the region of interest ROI at the time of execution of the P by P function will be described using
2. Second Embodiment
(50) An image processing apparatus 1 according to the second embodiment of the present invention will be described with reference to
(51) The main unit 1A includes a communication unit 50 in addition to the units which are included in the first embodiment. The communication unit 50 transmits and receives various data to and from the display unit 1B or another information processing apparatus. The communication unit 50 is an arbitrary I/O device. The display unit 1B is, for example, a monitor, and includes a display 40, a control unit 100, a communication unit 500, and an image processing unit 16. The control unit 100 corresponds to the control unit 10 in the main unit 1A, and the communication unit 500 corresponds to the communication unit 50 in the main unit 1A. Also, the image processing unit 16 is provided in at least one of the main unit 1A or the display unit 1B. In the present embodiment, the image processing unit 16 is provided in the display unit 1B.
(52) In the second embodiment, the communication unit 50 of the main unit 1A and the communication unit 500 of the display unit 1B are configured to communicate information with each other. Further, image data is transmitted from the communication unit 50 to the communication unit 500.
(53) The communication unit 50 transmits the position information (pointer position PP) of the region of interest ROI to the communication unit 500. Then, the image processing unit 16 performs highlighting process on the image in the region of interest ROI based on the position information (pointer position PP).
(54) If the image processing unit 16 is provided in the main unit 1A, the communication unit 50 transmits the image data after highlighting process to the communication unit 500 of the display unit 1B in addition to the position information (pointer position PP) of the region of interest ROI.
Another Embodiment
(55) As mentioned above, although various embodiments were described, the image processing apparatus 1 according to this invention is not limited to these.
(56) In the above description, the aspect in which the pointer is not displayed during execution of the image process has been described, but the present invention is not limited to this. For example, if the touch panel in which the pointer is not displayed is used as the display 40, the position of the region of interest ROI is set by the touch operation by the user. Then, if image process is performed on at least one image among an image inside of the region of interest and an image outside of the region of interest ROI, for example, by swipe operation or the like, and the position information is changed with image process, the position of the region of interest ROI may be set based on the position information immediately before the change. In another example, it is assumed that the finger of the user has left the touch panel after the position of the region of interest ROI is set by the touch operation. In this case, although the position information detection unit 11 does not detect the position information, the image processing apparatus 1 may store the position information detected just before. And if the image process is performed in this state, the position information stored just before is changed with the image process. At this time, the position of the region of interest ROI may be set based on the position information immediately before the change.
(57) Further, the display mode may be switchable to display an image conforming an image quality “DICOM” or “CAL1.” which is a standard established in the medical image field. In this case, the image quality of the region of interest ROI may be maintained when the pointer is redisplayed after not being displayed. That is, before and after the image process by the image processing unit 16, the display mode of the image quality in the region of interest ROI is maintained.
(58) Further, the image processing unit 16 can be configured to hide the region of interest ROI when the pointer is not displayed. At this time, if necessary, the region of interest ROI may be redisplayed when the pointer is redisplayed, and the region of interest ROI may be enlarged or moved at the same time.
(59) Further, when the position information is changed with the image process, the position information may be in a predetermined range from the pointer position PP immediately before the change, instead of the position information immediately before the change. Also, the pointer position PP at a predetermined time before the pointer becomes not displayed may be used. For example, the position information stored immediately before in the storage unit 20 or the position information stored two or three times before may be used. Further, among the pointer positions PP within a predetermined time before becoming not displayed, the pointer position PP that stays for the longest time may be used.
(60) Further, the enlargement operation of the image may be performed based simply on the center of the image displayed on the display 40.
(61) Further, the present invention can also be provided as a computer readable non-transitory recording medium in which the functions of the image processing apparatus 1 are implemented. In addition, programs for realizing these functions can be distributed via the Internet or the like. In addition, the respective units constituting the image processing apparatus 1, the main unit 1A, and the display unit 1B may be included in the same casing or may be distributed and arranged in a plurality of casings.
(62) Further image processing method may be provided. The image processing method includes a position information detection step of detecting, by a position information detection unit, position information indicating a position on a display, a region position setting step of setting, by a region position setting unit, the position of the region of interest on the display based on the position information, and an image processing step of performing, by an image processing unit, image process on at least one image among an image inside of the region of interest and an image outside of the region of interest. The region position setting unit, when the position information is changed with the image process, sets the position of the region of interest based on the position information immediately before the change.
(63) Further, a shortcut for switching display or non-display of the region of interest ROI may be assigned. In this case, the control unit 10 may determine whether the image display program 22 doesn't use the same shortcut. 1: image processing apparatus 1A: main unit 1B: display unit 10, 100: control unit 11: position information detection unit 12: region position setting unit 13: position information changing unit 14: region mode switching unit 15: region of interest changing unit 16: image processing unit 20: storage unit 21: region of interest setting program 22: image display program 23: position information storage unit 30: operation unit 40: display 50, 500: communication unit