Method and system for digitally modeling an industrial space in virtual reality

Abstract

A method for digitally modeling an industrial space, the industrial space including a plurality of pieces of equipment (E3) disposed in an industrial building (B), the modeling method including a step of three-dimensionally digitizing the industrial space so as to obtain a web (NAP) defining meshes representing the outer envelope of the industrial space with all of its pieces of equipment (E3), a step of real-time segmenting the web (NAP) in a virtual environment by a user during which: a bounding box (F) is positioned to bound at least one piece of equipment to be segmented (E3), and the points of the web (NAP), belonging to the volume of the bounding box (F), are associated so as to form a virtual object (OBJ).

Claims

1. A method for digitally modeling an industrial space, the industrial space comprising a plurality of pieces of equipment disposed in an industrial building, the method comprising: three-dimensionally digitizing the industrial space to obtain a web comprising a plurality of points defining meshes representing an outer envelope of the industrial space with said plurality of pieces of equipment; and real-time segmenting the web in a virtual environment with which a user interacts, comprising obtaining a bounding box positioned by the user in the virtual environment to bound at least one piece of equipment of said plurality of pieces of equipment, wherein said at least one piece of equipment is to be segmented; and, associating points of said plurality of points within the bounding box to form a virtual object, wherein said virtual object corresponds to all or a part of a single piece of equipment of said plurality of pieces of equipment; or two or more of pieces of equipment of said plurality of pieces of equipment that are associated together.

2. The method according to claim 1 further comprising extracting the points associated with the virtual object from the web in a database.

3. The method according to claim 2 further comprising selecting a plurality of virtual objects from the database in said virtual environment so as to model a new organization of the pieces of equipment of the industrial space.

4. The method according to claim 1 wherein the bounding box is in a convex shape defining a closed volume.

5. The method according to claim 1 wherein the bounding box is defined by a closed contour drawn by the user in the virtual environment; and, a directrix.

6. The method according to claim 1 further comprising calculating scalar products between a point to be tested of the plurality of points and the points of the plurality of points within the bounding box in order to determine whether the point to be tested belongs to the bounding box.

7. The method according to claim 1 wherein said three-dimensionally digitizing the industrial space is performed by one or both of photogrammetry and lasergrammetry.

8. The method according to claim 2 further comprising when a boundary mesh of said meshes comprises at least one object point associated with the virtual object and at least one non-object point not associated with the virtual object, dividing the boundary mesh into a plurality of sub-meshes at least one of which comprises said at least one object point and does not comprise said at least one non-object point.

9. The method according to claim 8 wherein the plurality of sub-meshes are defined from points of intersection of the boundary mesh with the bounding box.

10. The method according to claim 1 wherein said real-time segmenting the web further comprises displaying a view of the web of the industrial space in at least one virtual reality headset used by said user; and, obtaining input from at least one control member used by said user to move in the virtual environment and to position the bounding box.

11. A system for digitally modeling an industrial space, the industrial space comprising a plurality of pieces of equipment disposed in an industrial building, the system comprising: a digitization system for three-dimensionally digitizing the industrial space to obtain a web comprising a plurality of points defining meshes representing an outer envelope of the industrial space with said plurality of pieces of equipment; and a segmentation system for real-time segmenting the web in a virtual environment with which a user interacts, wherein the segmentation system is configured to obtain a bounding box positioned by the user in the virtual environment to bound at least one piece of equipment of said plurality of pieces of equipment, wherein said at least one piece of equipment is to be segmented; and, associate points of said plurality of points within the bounding box to form a virtual object, wherein said virtual object corresponds to all or a part of a single piece of equipment of said plurality of pieces of equipment; or two or more of pieces of equipment of said plurality of pieces of equipment that are associated together.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

(1) Embodiments of the invention will be better understood upon reading the following description, which is given by way of example, with reference to the following figures, which are given as non-limiting examples, in which identical references are given to similar objects.

(2) FIG. 1 is a schematic representation of a building comprising an industrial space having a plurality of pieces of equipment disposed on the ground.

(3) FIG. 2 is a schematic representation of a web of points defining the industrial space.

(4) FIG. 3 is a schematic representation of a user in a virtual environment in which the web of points comprising a piece of equipment is displayed.

(5) FIG. 4 is a schematic representation of a first embodiment of a bounding box for the equipment of FIG. 3.

(6) FIG. 5 is a schematic representation of a second embodiment of a bounding box for the equipment of FIG. 3.

(7) FIG. 6 is a schematic representation of a determination of a virtual object from the bounding box for the equipment of FIG. 3.

(8) FIG. 7 is a schematic representation of a step of determining whether a point on the web belongs to the bounding box.

(9) FIG. 8 is a representation of the schematic web following extraction of the virtual object.

(10) FIG. 9 is a representation of the web following a remeshing step.

(11) FIG. 10 is a close-up schematic representation of a boundary mesh of the web for a predetermined bounding box.

(12) FIG. 11 is a close-up schematic representation of a division of the boundary mesh of FIG. 10 into a plurality of sub-meshes.

(13) FIG. 12 is a close-up schematic representation of two different segmentations of a set of two pieces of equipment belonging to the web.

(14) It should be noted that the figures set out embodiments of the invention in detail to implement the embodiments of the invention, said figures of course being able to be used to better define embodiments of the invention if necessary.

DETAILED DESCRIPTION OF THE INVENTION

(15) With reference to FIG. 1, an embodiment of the invention relates to a method of computer-aided digital modeling of an industrial space 1 of a building B, in particular, of a production line.

(16) The industrial space 1 comprises a plurality of pieces of equipment E1-E7 disposed in an industrial building B. As illustrated in FIG. 1, there are schematically represented 7 pieces of equipment E1-E7 that are positioned on the ground S in the industrial building B.

(17) In this example, some pieces of equipment E1-E5 are positioned independently while others are adjoined (pieces of equipment E6-E7). In this example, for the sake of clarity and brevity, the pieces of equipment E1-E7 are represented as blocks, but in practice they have different and complex shapes, which makes their digital modeling with CAD software time-consuming and costly.

(18) According to at least one embodiment of the invention, the modeling method comprises a step of three-dimensionally digitizing the industrial space 1 so as to obtain a web NAP comprising a plurality of points defining meshes representing the outer envelope of the industrial space 1 with all its pieces of equipment E1-E7.

(19) A three-dimensional digitizing step by a three-dimensional digitizing system is known to those skilled in the art. It can be implemented especially by a method of photogrammetry or lasergrammetry (laser remote sensing), known to those skilled in the art under its designation Lidar. By virtue of this step, a web NAP representing the industrial space 1 with all its pieces of equipment E1-E7 is obtained. As illustrated in FIG. 2, the pieces of equipment E1-E7 are represented as a cloud of meshed points. Such a web NAP does not allow the pieces of equipment E1-E7 to be distinguished from each other or the pieces of equipment E1-E7 with the ground S.

(20) The web NAP comprises points that are connected in such a way as to form triangular meshes.

(21) At least one embodiment of the invention is remarkable in that it comprises a step of real-time segmenting the web NAP in a virtual environment by a user, in particular, by the end user who desires to model the industrial space from virtual objects.

(22) It is not very relevant to entrust the segmentation of an industrial space 1 to an external third party who does not know the nature and function of the pieces of equipment E1-E7, which lengthens the duration and increases the cost of digital modeling. At least one embodiment of the invention intends to give the end user the possibility of segmenting the web NAP by himself/herself in order to obtain the desired granularity to digitally model the industrial space 1. As it will be set forth hereafter, he/she can choose to define a virtual object corresponding to a single equipment, to a plurality of pieces of equipment associated together or to only part of a piece of equipment. The freedom offered is total and the end user does not require any external assistance.

(23) This segmentation step is carried out in a virtual environment by means of a segmentation system 2 (FIG. 3) which comprises a virtual reality headset 20 and a control member 21 connected to a calculator 22 in which the web NAP of the industrial space 1 is stored.

(24) Still referring to FIG. 3, the user (not shown) is equipped with the virtual reality headset 20 in order to be able to view the web NAP of the industrial space 1 and with the control member 21 so as to allow moving in the virtual environment according to different positions, different angles and different magnifications with respect to said web NAP. The control member 21 further allows the segmentation to be performed as it will be performed later. The segmentation is performed in real-time in the virtual environment.

(25) An example of segmenting the equipment E3 to extract it from the web NAP will be set forth with reference to FIGS. 3 to 6.

(26) During the segmentation step, with reference to FIG. 4, a bounding box F1 is positioned by the user in the virtual environment to bound at least one piece of equipment to be segmented, in this example, the equipment E3. By bounding box, it is meant a convex shape defining a closed volume.

(27) The bounding box F1 defines a volume to be tested in which the equipment to be segmented is located. Advantageously, in the virtual environment, the user can accurately position and size the bounding box F1 so that it approximates the volume of the equipment to be segmented. Segmentation in the virtual environment is thus relevant.

(28) As illustrated in FIG. 4, the bounding box F1 is in the form of a block the envelope of which is positioned to bound the points of the web NAP belonging to the equipment E3 that the user desires to segment.

(29) Advantageously, the user has a user interface, accessible via his/her control member 21 and his/her virtual reality headset 21, so as to choose the most adapted bounding box from a set of bounding boxes (tile, sphere, ogive, capsule, etc.). Preferably, the bounding boxes that can be chosen are diverse and adapted to the technical field of the industrial space 1 to be modeled. For the sake of clarity and brevity, a bounding box will be generally referred to as F.

(30) Advantageously, the user can position, orient and size the bounding box F precisely in the virtual environment in order to segment the equipment the structure and function of which he/she knows in an accurate and realistic way.

(31) In a preferred embodiment, with reference to FIG. 5, the bounding box F2 is in the form of a cylinder having a closed contour C and a directrix D. Preferably, the user draws in the virtual environment, using his/her virtual reality headset 20 and the control member 21, a closed contour C on the ground S that substantially intimately follows the shape of the equipment to be segmented. The user then defines a generally vertical directrix D, as well as a length of directrix D to define the bounding box F2. Such a closed contour C is precisely made and allows for relevant segmentation.

(32) Once the bounding box F is defined (tile, cylindrical or other), the points of the web NAP, belonging to the volume of the bounding box F, are associated in order to form a virtual object OBJ. The virtual object OBJ can then be referenced in a database DB as illustrated in FIG. 6 so that it can be positioned/duplicated in another virtual test environment or in the same virtual environment. In this example, the user associates the virtual object OBJ with at least one piece of metadata, for example, an “E3 equipment” name. The database DB is preferably stored on the calculator 22. By virtue of the bounding box F, a virtual object OBJ having a complex shape perfectly representative of the equipment E3 can advantageously be obtained.

(33) Several methods can be implemented to determine the points of the web NAP that belong to the volume of the bounding box F. A first method aims at comparing the three-dimensional position of each point P of the web NAP to the volume of the bounding box F. Such a method is efficient but requires a significant computing power.

(34) Preferably, the web NAP and the bounding box F each have a transformation matrix. This matrix allows the conversion of meshes from the associated local reference frame to the overall reference frame of the environment. Its purpose is to be able to compare meshes of the web NAP with meshes of the bounding box F.

(35) Alternatively, it is provided to test the points of the point cloud in a local frame of reference, in particular, the one in which the user moves in the virtual environment. To this end, a step of calculating scalar products between the points to be tested P.sub.TEST of the web NAP and points P1.sub.F3, P2.sub.F3 of a bounding box F3 is performed. In this example, with reference to FIG. 7, a bounding box F3 is represented as a sphere, but of course it could be different.

(36) To check whether a point P.sub.TEST of the web NAP belongs to the bounding box F3, a normal vector N1 is defined from a first point P1.sub.F3 of the bounding box F3 and a direction vector M1 starting from said first point P1.sub.F3 of the bounding box F3 towards the point to be tested P.sub.TEST of the web NAP. A scalar product is made between the normal vector N1 and the direction vector M1 which has preferably been previously normalized.

(37) If the scalar product is negative, the point to be tested P.sub.TEST belongs to the bounding box F3 and is associated with the virtual object OBJ. Conversely, if the scalar product is zero or positive, the point to be tested P.sub.TEST is excluded from the virtual object. This method by scalar calculation is faster and does not require a change of frame of reference which is computationally expensive. The determination of a virtual object OBJ can be conveniently and quickly performed in real-time by a user locally moving in a virtual environment.

(38) Preferably, during the segmentation step, the points belonging to the virtual object OBJ are extracted from the web NAP in order to define a new purified web. In practice, the user can thus extract all the pieces of equipment in order to obtain a web NAP representing the industrial building B, in particular, its ground S.

(39) As illustrated in FIG. 8, after extraction of the virtual object OBJ corresponding to the equipment E3, the web NAP has a hole T. In order to form a continuous web NAP, a new meshing is preferably made from the unextracted points as illustrated in FIG. 9.

(40) In order to allow an accurate clean extraction of the virtual object OBJ, a step of dividing the boundary meshes of the virtual object OBJ is conducted.

(41) With reference to FIG. 10, upon extracting the points of the virtual object OBJ, some meshes M1, called boundary meshes M1, comprise at least one object point P.sub.OBJ (a vertex) belonging to the virtual object OBJ and at least one non-object point (vertex) P.sub.NOBJ not belonging to the object OBJ. Each boundary mesh M1 thus comprises at least one connection segment S1, S2 connecting an object point P.sub.OBJ and a non-object point P.sub.NOBJ. As illustrated in FIG. 10, the bounding box F cuts the bounding mesh M1 in two and passes through two segments S1, S2 at two points of intersection I1, I2.

(42) With reference to FIG. 11, the method comprises a step of dividing the boundary mesh M1 into a plurality of sub-meshes M11, M12, M13, at least one of which exclusively belongs to the bounding box F. In this example, two sub-meshes M12, M13 exclusively belonging to the bounding box are formed.

(43) In this embodiment, the points of intersection I1, I2 are defined as points of the web NAP and used to remesh, in real-time, the boundary mesh L1 in order to define a plurality of new triangular meshes M11, M12, M13. As illustrated in FIG. 11, the meshes M12, M13 belong to the bounding box and are integrated into the virtual object OBJ, which will improve accuracy and sharpness of said virtual object OBJ that can thus be better apprehended by the user.

(44) By virtue of at least one embodiment of the invention, the user can extract virtual objects OBJ from the web NAP with the granularity that he/she/she desires by choosing the most adapted bounding box F. As an example, with reference to FIG. 12 representing the web NAP integrating two pieces of equipment E6-E7 which are adjoined. The user can define a single bounding box F67 to define a single virtual object OBJ67 or two bounding boxes F6, F7 to define two virtual objects OBJ6, OBJ7 that are distinct from each other. Advantageously, a user can form a virtual object comprising several independent pieces of equipment that are always associated together, which provides significant time saving.

(45) By virtue of at least one embodiment of the invention, the database DB forms a library for the user in which all the virtual objects OBJ that he/she desires to reorganize in the industrial space 1 are listed. Each virtual object OBJ has its exact shape without having been redrawn by a computer, which saves time and improves perception of the virtual objects in comparison with objects that would have been roughly drawn.

(46) Advantageously, the segmentation system 2 also allows the user to place virtual objects OBJ according to the position of his/her choice in order to be able to imagine the industrial space 2 corresponding to his/her constraints and desires. The same virtual object OBJ can be reused several times from the library thus obtained.