Image display device

Abstract

An image display device acquires data representing a status of a temperature distribution of a machining machine based on information on machining and generates a temperature distribution image from the acquired data. Further, a three-dimensional machining simulation representing a status of machining is performed to generate a three-dimensional simulation animation and a projection image is generated from the three-dimensional simulation animation. Then, an image obtained by synthesizing the temperature distribution image and the projection image is generated and displayed.

Claims

1. An image display device to display a temperature distribution of a machine, comprising a processor configured to: acquire machining information relating to machining performed by the machine; generate a three-dimensional simulation animation by performing a three-dimensional machining simulation representing a machining status of the machine on the basis of the machining information; acquire temperature distribution data representing a status of a temperature distribution of the machine; generate a temperature distribution image on the basis of the temperature distribution data; generate an image obtained by synthesizing the temperature distribution image and a projection image generated from the three-dimensional simulation animation; and display the generated image.

2. The image display device according to claim 1, wherein the temperature distribution data represents a temperature distribution when the machine is viewed from a predetermined viewpoint, and the processor generates an image obtained by synthesizing the temperature distribution image and a projection image when the three-dimensional simulation animation is viewed from the viewpoint.

3. The image display device according to claim 1, wherein the temperature distribution data is acquired by a thermography attached to the machine.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

(1) FIG. 1 is a schematic functional block diagram of an image display device according to an embodiment of the invention;

(2) FIG. 2 is a diagram illustrating a general outline of projecting a coordinate of a three-dimensional object to a two-dimensional coordinate in the invention;

(3) FIG. 3 is another diagram illustrating a general outline of projecting a coordinate of a three-dimensional object to a two-dimensional coordinate in the invention;

(4) FIG. 4 is a diagram illustrating an example in a case where the general outline of projecting the coordinate of the three-dimensional object to the two-dimensional coordinate illustrated in FIG. 2 is applied to a machine coordinate system of a machine tool;

(5) FIG. 5 is a diagram illustrating an example of images synthesized when starting machining;

(6) FIG. 6 is a diagram illustrating an operation of superimposing a temperature distribution image and a projection image of a three-dimensional simulation animation;

(7) FIGS. 7A and 7B are diagrams illustrating an image display example of the image display device according to the embodiment of the invention;

(8) FIG. 8 is a diagram illustrating an example of a case where a technology of the invention is applied to lathe machining; and

(9) FIGS. 9A and 9B are diagrams illustrating an image display example inside a machining chamber of prior art.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

(10) FIG. 1 is a schematic functional block diagram of an image display device according to an embodiment of the invention.

(11) An image display device 100 of the embodiment displays a temperature distribution in a machining chamber including the vicinity of a machining contact point between a tool and a workpiece when the workpiece is machined by a machine tool 1 including a thermography 2. The image display device 100 includes a machining information input unit 10, a temperature distribution data input unit 20, a simulation animation generation unit 30, a temperature distribution image generation unit 40, an image synthesis unit 50, and an image display unit 60.

(12) The machining information input unit 10 is connected to a control unit (not illustrated) of the machine tool 1 and acquires machining information representing a machining status of the machine tool 1. The machining information input unit 10 acquires information necessary for a three-dimensional simulation performed by the simulation animation generation unit 30 as machining information from the control unit of the machine tool 1 every predetermined period. For example, the machining information acquired by the machining information input unit 10 may include information relating to a block of a machining program executed from now on by the control unit of the machine tool 1 or may include information representing a current coordinate position and a movement direction of the tool, the workpiece, and other facilities inside the machining chamber.

(13) The temperature distribution data input unit 20 acquires temperature distribution data on the inside of the machining chamber of the machine tool 1 detected by the thermography (the thermal image measurement device) 2 attached to the machine tool 1 every predetermined period. As the thermography 2 used to acquire the temperature distribution data by the temperature distribution data input unit 20, a general thermography may be used. The thermography 2 may be configured to change a gaze point (a center point of a range in which the thermography 2 detects the temperature distribution) in accordance with the operation of a user using an operation panel of the machine tool 1. Information such as an installation position coordinate value (a machine coordinate value or the like) of the thermography 2, a gaze point coordinate value (a machine coordinate value or the like), and a focal distance may be set by the user through an operation input unit (not illustrated) of the image display device 100 or may be acquired from the control unit of the machine tool 1.

(14) The simulation animation generation unit 30 generates a three-dimensional simulation animation representing the states of the workpiece and the tool inside the machining chamber (the machining space) by performing a three-dimensional simulation of the machining performed by the machine tool 1 on the basis of the machining information acquired by the machining information input unit 10 every predetermined period. The simulation animation generation unit 30 generates the three-dimensional simulation animation by using, for example, three-dimensional models for the tool, the workpiece, or other facilities stored in a memory (not illustrated) in advance. In order to generate the three-dimensional simulation animation by the simulation animation generation unit 30, for example, a general machining simulation method (for example, see Japanese Patent Application Laid-Open No. 10-10220 or Japanese Patent Application Laid-Open No. 11-119818) which has been publicly known may be used.

(15) The temperature distribution image generation unit 40 generates an image (an isothermal image or the like) representing a temperature distribution in the vicinity of the gaze point on the basis of the temperature distribution data on the inside of the machining chamber of the machine tool 1, acquired by the temperature distribution data input unit 20.

(16) The image synthesis unit 50 synthesizes an image in which the temperature distribution image generated by the temperature distribution image generation unit 40 is superimposed on the three-dimensional simulation animation of the inside of the machining chamber of the machine tool 1 generated by the simulation animation generation unit 30. The image synthesis unit 50 synthesizes an image in which the temperature distribution image generated by the temperature distribution image generation unit 40 is superimposed on the image obtained when the three-dimensional simulation animation generated by the simulation animation generation unit 30 is viewed from the viewpoint corresponding to the installation position of the thermography 2. The image synthesis unit 50 synthesizes the images every predetermined period by accompanying the progression of the machining performed by the machine tool 1.

(17) Then, the image synthesized by the image synthesis unit 50 is displayed on the image display unit 60 such as a liquid crystal display device by accompanying the progression of the machining performed by the machine tool 1.

(18) Hereinafter, a general outline of projecting the coordinate of the three-dimensional object to the two-dimensional coordinate will be described with reference to FIGS. 2 and 3.

(19) As illustrated in FIG. 2, a space in which a three-dimensional object is installed is expressed by an origin O and a coordinate system (a world coordinate system) Xw-Yw-Zw, a point of view from which the three-dimensional object is viewed is set as V (Vx, Vy, Vz), and a coordinate system using the viewpoint V as an origin is set as a viewpoint coordinate system Xv-Yv-Zv. Further, a point (a gaze point) for determining an angle by which the three-dimensional object is viewed is set as R (Rx, Ry, Rz) and a coordinate system using the gaze point R as an origin is set as a gaze point coordinate system Xr-Yr-Zr. Furthermore, when it is assumed that a projection plane is located at a position moved from the viewpoint V toward the gaze point R by a distance f, a center point of a projection plane when viewing the gaze point R from the viewpoint V is set as P (Px, Py, Pz) and a coordinate system using the projection plane center point P as an origin is set as a projection plane center point coordinate system Xp-Yp. Further, for ease explanation, in an example illustrated in FIG. 2, the world coordinate system and the gaze point coordinate system have a relation in which the directions indicated by the X axis, the Y axis, and the Z axis are the same as each other.

(20) In such setting, the points of the world coordinate system are converted into the viewpoint coordinate system. This conversion can be performed, for example, according to the following steps.

(21) Step 1: the world coordinate system and the gaze point coordinate system are moved in parallel so that both origins overlap each other.

(22) Step 2: the gaze point coordinate system and the viewpoint coordinate system are moved in parallel so that both of the origins thereof overlap each other.

(23) Step 3: the world coordinate system and the viewpoint coordinate system are rotated so that both of the Z axes thereof overlap each other.

(24) Next, a relation between the coordinate S (Sx, Sy) as viewed from the viewpoint coordinate system of the three-dimensional object and a coordinate T (Tx, Tz) on the projection plane when the coordinate S is viewed from the viewpoint coordinate system can be expressed by the following expression (1) on the basis of the similarity between a general outline of perspective projection illustrated in FIG. 3 and a triangle. In addition, the general outline diagram illustrated in FIG. 3 is expressed on the plane Xv-Zv of the viewpoint coordinate system, but can be expressed in the same way even on the plane Yv-Zv.
S.sub.z:f=S.sub.x:T.sub.x
S.sub.z:f=S.sub.y:T.sub.y(1)

(25) Thus, the coordinate T (Tx, Tz) on projection plane corresponding to the coordinate S (Sx, Sy) as viewed from the viewpoint coordinate system can be expressed by the following expression (2).

(26) $\begin{array}{cc}{T}_x=f\frac{S_x}{S_z}{T}_y=f\frac{S_y}{S_z}& \left(2\right)\end{array}$

(27) Thus, parameters necessary for projecting the coordinate of the three-dimensional object to the two-dimensional coordinate can be summarized as below.

(28) Parameter 1: origin O of the world coordinate system

(29) Parameter 2: viewpoint V as viewed from world coordinate system

(30) Parameter 3: gaze point R as viewed from world coordinate system

(31) Parameter 4: distance f between viewpoint V and projection plane center point P

(32) Parameter 5: coordinate S (Sx, Sy, Sz) of three-dimensional object as viewed from viewpoint coordinate system.

(33) On the assumption that the machine coordinate system of the machine tool 1 is set as the above-described world coordinate system, the coordinate (the position of the infrared lens) of the thermography 2 is set as the viewpoint V, the center point of the range of detecting the temperature distribution by the thermography 2 is set as the gaze point R, and the focal distance of the thermography 2 is set as f, the image synthesis unit 50 converts each of the coordinate points S (Sx, Sy, Sz) of the three-dimensional space of the three-dimensional simulation animation of the inside of the machining chamber of the machine tool 1 generated by the simulation animation generation unit 30 into the coordinate on the temperature distribution image (the projection plane) generated by the temperature distribution image generation unit 40, thereby synthesizing an image in which the temperature distribution image generated by the temperature distribution image generation unit 40 is superimposed on the three-dimensional simulation animation of the inside of the machining chamber of the machine tool 1 generated by the simulation animation generation unit 30.

(34) Hereinafter, a step in which the image display device 100 of the embodiment with the above-described configuration synthesizes and displays the images of the inside of the machining chamber of the machine tool 1 will be described.

(35) First, as a general preparation before machining, an NC program is created by defining a workpiece coordinate system through the operation of the control unit (generally, a numerical controller) of the machine tool 1. In general, the workpiece coordinate serves as the coordinate of a machining point between the tool and the workpiece and, in the NC program, the tool movement amount or the like is instructed by using the workpiece coordinate system.

(36) The image synthesis unit 50 converts the coordinate system or points as described above in order to project the tool, the workpiece, or other facilities (the three-dimensional objects) inside the machining chamber on the projection plane on the basis of the setting values set by the user or the setting values acquired from the control unit of the machine tool 1.

(37) FIG. 4 is a diagram illustrating a case where a general outline of projecting the coordinate of the three-dimensional object to the two-dimensional coordinate described with reference to FIG. 2 is applied to the coordinate system of the actual machine tool 1 and the thermography 2. Further, an example of FIG. 4 illustrates milling. In FIG. 4, Reference Numeral 3 indicates the tool and Reference Numeral 4 indicates the workpiece.

(38) Since the origin M of the machine coordinate system, among the parameters necessary for synthesizing the images by the image synthesis unit 50, is determined by the control unit of the machine tool 1, the origin may be acquired from the control unit.

(39) Further, since the position V (Vx, Vy, Vz) of the infrared lens of the thermography 2 as viewed from the machine coordinate system is determined by the installation position of the thermography 2 as viewed from the machine coordinate system, the position V may be acquired from the installation position of the thermography 2 in case where the position V is set by the control unit of the machine tool 1. In other cases, the user may set the position V by operating the image display device 100.

(40) The gaze point R as viewed from the machine coordinate system can be set to an intersection point between the workpiece surface and the line perpendicular to the projection plane from the position V of the infrared lens of the thermography 2. In addition, since the coordinate of the workpiece as viewed from the machine coordinate system can be obtained from the workpiece shape information, the coordinate of the workpiece may be acquired from the workpiece shape information in case where the coordinate is set by the control unit of the machine tool 1. In other cases, the user may set the coordinate by operating the image display device 100.

(41) Since the focal distance f of the infrared lens of the thermography 2 is determined depending on the characteristics of the infrared lens of the thermography 2 in use, the focal distance may be acquired from the characteristics of the infrared lens in case where the focal distance can be acquired from the thermography 2. In other cases, the user may set the focal distance by operating the image display device 100.

(42) Since the coordinates S of the points of the tool, the workpiece, or other facilities inside the machining chamber as viewed from the coordinate system of the position V of the infrared lens of the thermography can be acquired from the execution result of the three-dimensional simulation of the machining in the machine tool 1, performed by the simulation animation generation unit 30 on the basis of the machining information, the coordinate S can be obtained by converting the coordinate of the world coordinate system of each point in the virtual space in the three-dimensional simulation into the viewpoint coordinate system according to the above-described method.

(43) FIG. 5 is an example of an image formed by projecting the three-dimensional simulation animation generated by the simulation animation generation unit 30 on the projection plane in the image synthesis unit 50 at the time of starting the machining.

(44) Next, when the machining of the workpiece 4 is started by the machine tool using the tool 3, the machining information input unit 10 acquires the machining information from the control unit of the machine tool 1 every predetermined period and the temperature distribution data input unit 20 acquires the temperature distribution data from the thermography 2 every predetermined period. The temperature distribution data acquired from the thermography 2 by the temperature distribution data input unit 20 includes the coordinate value (Tx, Ty) (corresponding to the coordinate value on a projection plane coordinate system) in the range of the temperature distribution data acquired by the thermography 2 and the temperature Tt measured at the coordinate indicated by the coordinate value, and acquires the data items T1 (T1x, T1y, T1t), T2 (T2x, T2y, T2t), . . . , Tn (Tnx, Tny, Tnt) of a plurality of points (generally, thousand points) on the plane photographed by the thermography 2 in each acquiring operation.

(45) The simulation animation generation unit 30 generates the three-dimensional simulation animation by performing the three-dimensional simulation on the basis of the machining information acquired by the machining information input unit 10.

(46) Further, the temperature distribution image generation unit 40 generates the temperature distribution image on the basis of the temperature distribution data acquired by the temperature distribution data input unit 20. The temperature distribution image generation unit 40 generates, for example, an isothermal image on the basis of the acquired temperature distribution data. The isothermal image which is generated by the temperature distribution image generation unit 40 is generated by plotting the temperature distribution data on the plane and connecting the same temperature values. The temperature distribution image generation unit 40 colors the isothermal lines with different colors in order to easily and visually check the temperature distribution of the isothermal on the isothermal image.

(47) Then, as illustrated in FIG. 6, the image synthesis unit 50 superimposes the isothermal image generated by the temperature distribution image generation unit 40 on the projection image obtained by projecting the machining simulation animation on the projection plane in a manner such that the center point T of the temperature distribution image, generated on the basis of the temperature distribution data acquired from the thermography 2, matches the projection plane center point P of the three-dimensional simulation animation, thereby synthesizing these two images.

(48) FIGS. 7A and 7B are examples of images displayed on the image display unit 60 of the image display device 100 of the embodiment. By using publicly known image synthesizing and image processing technologies, the image synthesis unit 50 can superimpose a translucent temperature distribution image on a three-dimensional simulation animation, as illustrated in FIG. 7A or can superimpose a temperature distribution image on an image emphasizing the outline of the tool 3, the workpiece 4, or other facilities inside the machining chamber in the three-dimensional simulation animation as illustrated in FIG. 7B.

(49) Although the embodiment of the invention has been described so far, the invention is not limited only to the examples of the above-described embodiment and can be implemented in various forms by appropriate modifications.

(50) For example, in the above-described, an example of milling has been described, but as illustrated in FIG. 8, the method of the present invention can be also applied to lathe machining. Further, the invention can be also applied to other industrial machines.

(51) Further, in the above-described embodiment, an example has been described in which the thermography is used as the sensor for acquiring the temperature distribution data, but any sensor capable of measuring the temperature distribution as viewed from a predetermined viewpoint may be used.