SYSTEM AND METHOD FOR MEASURING A FORCE EXERTED ON A BODY, AND FOR CHARACTERIZING THE RIGIDITY OF A BODY USING SUCH A DEVICE
20230148864 · 2023-05-18
Inventors
Cpc classification
A61B5/0053
HUMAN NECESSITIES
A61B5/442
HUMAN NECESSITIES
A61B5/0033
HUMAN NECESSITIES
A61B2576/00
HUMAN NECESSITIES
A61B2560/0431
HUMAN NECESSITIES
International classification
Abstract
A device for measuring a force exerted on a body comprises a flexible rod having a proximal end and a distal end intended to come into contact with the body and to apply a force tending to deform the body near a point of contact. The measuring device also comprises an image capturing device, which is rigidly attached to the proximal end and oriented toward the distal end of the flexible rod, for providing at least one depth map of the body near the distal end of the flexible rod. The device may be used to perform a method of measuring the force exerted on the body and a method of characterizing the rigidity of a body
Claims
1. A measuring system for measuring a force exerted on a body; the measuring system comprising a measuring device and calculation means, the measuring device comprising: a flexible rod having a proximal end and a distal end configured to contact the body and to apply a force tending to deform the body near a point of contact, the flexible rod configured to bend as soon as it applies a force by the distal end of the flexible rod to the body; and an image capturing device secured to the proximal end and oriented toward the distal end of the flexible rod to provide at least one depth map of the body near the distal end of the flexible rod and the distal end; and wherein the calculation means are configured to determine, using the depth map of the distal end of the rod, a force exerted on the body by the distal end of the flexible rod.
2. The system of claim 1, wherein the flexible rod is configured to apply a force between 0.1 N and 10 N.
3. The system of claim 2, wherein the measuring device comprises a switch to actuate the image capturing device.
4. The system of claim 3, further comprising a gripping handle secured to the image capturing device and to the flexible rod.
5. The system of claim 4, wherein the switch is in the form of a trigger.
6. The system of claim 5, wherein the calculation means comprise a transmission unit and a remote calculation device, the transmission unit being configured to exchange data with the remote calculation device.
7. The system of claim 1, wherein the calculation means comprise a calculation unit configured to process the depth map.
8. The system of claim 1, wherein the image capturing device also provides a digital image of the body near the distal end of the flexible rod.
9. The system of claim 1, wherein the distal end comprises a tip having a color identifiable in an image provided by the image capturing device.
10. The system of claim 1, wherein the distal end comprises a tip having a shape identifiable on a map provided by the image capturing device.
11. A method for measuring a force exerted on a body, the method comprising: providing a measuring system for measuring the force exerted on the body, the measuring system comprising a measuring device and calculation means, the measuring device including: a flexible rod having a proximal end and a distal end configured to contact the body and to apply a force tending to deform the body near a point of contact, the flexible rod configured to bend as soon as it applies a force by the distal end of the flexible rod to the body; and an image capturing device secured to the proximal end and oriented toward the distal end of the flexible rod to provide at least one depth map of the body near the distal end of the flexible rod, and the distal end; and wherein the calculation means are configured to determine, using the depth map of the distal end of the rod, a force exerted on the body by the distal end of the flexible rod; contacting the body with the distal end of the rod at a point of contact and applying a force tending to deform the body near the point of contact; acquiring, at a measurement instant, at least one depth map while applying the force tending to deform the body near the point of contact; and processing the depth map to establish the force exerted on the body.
12. The method of claim 11, wherein the processing the depth map comprises locating the distal end of the rod in the depth map and providing coordinates of the distal end in a coordinate system associated with the measuring device.
13. The method of claim 11, further comprising calibrating the measuring device prior to acquiring the at least one depth map.
14. A method for characterizing a rigidity of a body, comprising: performing a measuring method according to claim 11; and acquiring, during the measuring method, a plurality of depth maps at successive measurement instants.
15. The method of claim 14, further comprising readjusting the plurality of depth maps.
16. The method of claim 16, further comprising providing the body with readjusting markers configured to allow the plurality of depth maps to be readjusted.
17. The system of claim 1, wherein the measuring device comprises a switch to actuate the image capturing device.
18. The system of claim 1, further comprising a gripping handle secured to the image capturing device and to the flexible rod.
19. The system of claim 1, wherein the measuring device comprises a trigger on a handle, the trigger configured to actuate the image capturing device.
20. The system of claim 1, wherein the calculation means comprise a transmission unit and a remote calculation device, the transmission unit being configured to exchange data with the remote calculation device.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0037] Other features and advantages of the present disclosure will become apparent from the following detailed description of example embodiments of the present disclosure, which is provided with reference to the accompanying figures, in which:
[0038]
[0039]
[0040]
[0041]
DETAILED DESCRIPTION
System for Measuring the Force Exerted on a Body
[0042] In the example shown in
[0043] For safety reasons, as well as to avoid damaging the body at the point of contact, it is possible to provide the distal end 2b with a protective tip. This may have a contact surface, that is to say, a surface intended to come into contact with the body, that is flat or rounded so as to ensure this protective function, but without being too large to preserve the pointed nature of the contact that forms between the distal end 2b of the flexible rod 2 and the body being tested.
[0044] By way of example, the protective tip may correspond to a plastic sphere embedded on the distal end 2b of the flexible rod, and having a diameter of the order of a few millimeters, for example, comprised between 2 mm and 5 mm. As will be detailed later in this presentation, the shape of the tip and/or its color can also be chosen to be easily identified on a depth map or an image that is acquired during use of the measuring device 1.
[0045] As has already been mentioned, the rod 2 makes it possible to transmit a force applied to the measuring device 1 and to apply this force to the body. This rod 2 is flexible, that is to say, the reaction force that is applied to the distal end 2b of the rod 2 when the latter is in forced contact with the body tends to deform it, for example, by bending. To a certain extent, the flexibility of the rod 2 makes it possible to make the displacement of the distal end 2b of the rod independent of the displacement of the head 1b of the measuring device 1 on which it is fixed. The component material of the flexible rod 2 and its shape are chosen so that, in the range of forces that it is desired to apply to the body, the rod 2 can deform elastically. When the body is a human body, this force can be between 0.1 N and 10 N.
[0046] It is thus possible to provide for the rod 2 to be formed of a metal or of a plastic. It may also have a bend or be curved (as shown in
[0047] Continuing the description of
[0048] Regardless of how these two elements are secured to each other, the image capturing device 4 is oriented toward the distal end 2b of the flexible rod 2. In other words, the orientation of the image capturing device 4 is such that the distal end 2b of the flexible rod 2 is in its field of vision, that is to say, in the area of the space that the sensor(s) of the image capturing device 4 perceives. As mentioned above, the measuring device 1 can be configured so that, at rest, the distal end 2b is placed in the center, or near the center, of this field of vision.
[0049] When the measuring device 1 applies a force to the body being tested (as will be presented in connection with the description of
[0050] According to the present disclosure, the image capturing device 4 is provided with a sensor capable of providing a depth map. The sensor performs the measurement in a plane, called “image plane,” which is provided with a coordinate system (x,y) referred to as “coordinate system of the image capturing device” in the remainder of this description. This coordinate system can be increased by a depth direction z, perpendicular to the image plane, in order to form a complete coordinate system (x, y, z). Since the image capturing device 4 is secured, without any degree of freedom, to the head 1b of the measuring device 1, the coordinate system of the image capturing device also forms a coordinate system linked to the measuring device 1.
[0051] The depth map provided by the image capturing device 4 can take the form of a scatter chart whose coordinates are established in the complete coordinate system (x, y, z). The map may alternatively be in the form of an image comprising elements of the image plane of the sensor respectively associated with points of the imaged scene, each element of the image plane also being associated with distance information separating this plane of the image capturing device 4 from the point of the scene in question.
[0052] Advantageously, but without this forming an essential feature of the present disclosure, the image capturing device 4 can also provide a digital image of its field of vision. To this end, the image capturing device 4 may have an optic, or any other means, making it possible to take an image of the deformed surface of the body being tested as well as of the distal end 2b of the rod 2. The focal distance of the optic can be chosen according to the extent of the desired field of vision and therefore the extent of the imaged surface of the body being tested. A depth of field can advantageously be chosen that is sufficient for it to comprise the distal end 2b of the flexible rod 2 for the entire range of forces applicable on the body, and therefore for the entire bending range of the rod 2.
[0053] For the sake of clarity, it is recalled that a digital image is defined by image elements, referred to as “pixels,” that carry at least one digital value of light intensity of gray levels or of color. Pixels are usually arranged in the form of a matrix, in rows and columns. Such a digital image can, however, be recorded in the image capturing device 4, and be transmitted in another form, for example, a compressed form, but in all cases the image can be manipulated to represent an image composed of pixels arranged in a matrix.
[0054] When the image capturing device 4 combines both distance information and color or light intensity information, this device can be formed, for example, by an RGB-D camera, a description of which is found in documents US20070216894 and US7433024. In addition to the traditional image sensor, for example, allowing determination for each pixel of a radiation intensity value in the red, green and blue range, an RGB-D camera also projects infrared radiation whose reflection is captured by an infrared image sensor. The measured radiation is processed to determine the distance separating the sensor from any objects placed in the field of vision, according to, for example, the technology described in the aforementioned documents. The infrared sensor and the image sensor are calibrated together, so that it is possible to associate depth information with intensity information for each pixel.
[0055] It should be noted that the data from the image capturing device 4, according to the present disclosure, are provided in any format, which is not limited to that of a digital image whose pixels are augmented with depth information. This data can also be presented, for example, as already mentioned, in a scatter chart format. In such a format, each point of the scatter chart is represented by its coordinates in the complete coordinate system (x, y, z), possibly enhanced by color information.
[0056] Whatever the format in which the data established by the image capturing device 4 are conditioned, they will be referred to by the terms “images” for the data relating to the intensity of the visible radiation perceived on the image plane of the image sensor, and by “depth map” for the data relating to the distance separating the objects of the scene from the image capturing device 4. And these data are identified in the same coordinate system associated with the image capturing device 4, and therefore with the measuring device 1.
[0057] The image capturing device 4 can make it possible to take a succession of images and depth maps, for example, every 20 ms, to constitute an animated sequence. When the measuring device 1 is used to actually analyze the deformation of a body, the image capturing device 4 provides data that can be represented in the form of an animated sequence of the deformation of this body, and comprises both images and successive depth maps of the deformation.
[0058] To initiate the capture of an image and/or a map, or of a sequence of such images and such maps, the measuring device 1 can be provided with a switch 5 that can be actuated by the operator. The operator can manually actuate, for example, the switch and trigger the capture(s), while he moves the measuring device 1 toward the body being tested and applies a force to this body, tending to deform it. At the end of this step, one then has an animated sequence of images and a depth map imaging the deformation of the body. These images of course comprise the distal end 2b of the flexible rod 2, which is placed at all times in the field of vision of the image capturing device 4.
[0059] For practical reasons, provision may be made for the switch 5 to take the form of a trigger placed on the gripping handle 1a of the measuring device 1, as shown in
[0060] The data produced by the image capturing device 4, digital images and depth maps or any other data produced from this information, can be communicated to the calculation means. The calculation means can in this respect comprise a remote calculation device to be exploited there and a transmission unit. For this purpose, the measuring device 1 can comprise a transmission unit 6 connected to the image capturing device 4. This transmission unit 6 can take the form of a simple connector making it possible to plug in a connecting cable between the measuring device 1 and the calculation device. It may alternatively be a more complex electronic circuit making it possible to condition the data before transmitting them, for example, using a wireless link, to the calculation device. The transmission unit can also make it possible to configure and/or operate, from the remote calculation device, the image capturing device 4 and more generally the measuring device 1.
[0061] The calculation means can also comprise a calculation unit secured to the measuring device 1. The calculation unit can comprise, for example, a microcontroller, a graphics chip, an FPGA, specifically configured to carry out processing operations on the data supplied by the image capturing device 4, before these processed data are transmitted to the remote calculation devices.
[0062] These processing operations can correspond to simple formatting of the images and of the depth maps provided by the image capturing device 4, for example, to provide them in the form of a scatter chart of colored points as mentioned above, or to reduce the resolution thereof, or else to extract richer information therefrom, such as, for example, the force exerted by the flexible rod 2 on the body being tested that is the subject of the measuring method, the description of which follows.
[0063]
[0064] In
[0065] In
[0066] It is noted that, knowing the distance separating the distal end 2b from the measuring device 1, it is possible to unequivocally determine the force applied by the rod 2 (and therefore by the measuring device 1) on this body 3.
[0067] In the illustration of
[0068] In this general approach, it is noted that it is possible to determine all the components of the force applied to the body 3 by the measuring device 1 from the position of the distal end 2b of the rod 2 in the coordinate system linked to the measuring device 1.
[0069] In certain simple cases, the relationship linking the position of the distal end 2b to this force can be formulated explicitly, based on, for example, the dimension of the rod 2 and/or stiffness coefficients. More generally, though, this relationship can be established by a prior calibration step during which the measuring device 1 is applied to a force sensor pre-calibrated according to 3 components (known as a “tri-axis” sensor).
[0070] For example, the sensor can be carried by a rigid plate that can be moved in a controlled manner in 3 orthogonal directions. The measuring device 1 is fixedly arranged opposite the plate and in line with the force sensor so that the distal end 2b of the flexible rod 2 comes into contact with this sensor. A battery of measurements is then taken by moving the rigid plate in the 3 possible directions so as to collect: [0071] the components fx, fy, fz of the force applied by the flexible rod 2 to the sensor, and such that these components are provided by the sensor; [0072] the coordinates (x, y, z) of the distal end 2b of the rod 2 in the coordinate system linked to the image capturing device 4. These coordinates can be recorded manually from the depth map provided by this device 4 or by digital processing of this map, as will be explained in another part of this description.
[0073] In this way, it is possible to collect pairs of measurements {(x, y, z); (fx, fy, fz)} connecting the position (x, y, z) of the distal end 2b of the rod 2 to the components fx, fy, fz of the force applied by this rod 2. These pairs of measurements can be used to determine, by interpolation, the components of the force applied by the measuring device 1 to the body for any position of the distal end 2b in a coordinate system linked to the measuring device 1 (such as that associated with the image capturing device 4).
[0074] In other words, in a measuring device 1 according to the present disclosure, the position of the distal end 2b of the rod 2 with respect to a reference point of the measuring device 1 can be connected unequivocally to the components of the force applied by this device 1 to a body 3.
[0075] This characteristic of the measuring device 1 is exploited in order to provide a method for measuring the force exerted on a body 3 that is particularly simple to implement, which is the subject of the following section of this description.
Method for Measuring the Force Exerted on a Body
[0076] The measuring method comprises a first step of applying a measuring device 1, as described previously, to a body 3 being tested. As already mentioned, during this step, the measuring device 1 is brought closer to the body 3 so as to bring the distal end 2b of the flexible rod 2 into forced contact on this body 3. A force is therefore exerted on the body 3, this force tending to deform the body 3 at and near the point of contact. The flexible rod 2 is also deformed. This step can be implemented by an operator or, alternatively, by an automated system, such as a robot arm whose end would be equipped with the measuring device 1.
[0077] Once the forced contact of the measuring device 1 on the body 3 has been established, the device 1 can be moved away from the body 3 and the method can be interrupted, or repeated at an identical or different point of contact.
[0078] The measuring method also comprises an acquisition step during which at least one depth map is acquired, at a measurement instant, using the image capturing device 4. As already mentioned, a plurality of maps will preferably be acquired at successive measurement instants, so as to collect an animated sequence of the deformation of the body 3 being tested caused by the forces exerted by the measuring device 1 over time.
[0079] The acquisition step can be triggered and interrupted by the switch 5 or by the trigger of the measuring device 1 operated by the operator during the application step. Alternatively, the acquisition can be triggered by the remote calculation device to which the measuring device 1 can be connected, in particular, when the latter forms part of an automated measuring system.
[0080] Regardless of how the acquisition step is triggered, it will be ensured that it is temporally included in or overlapping the step of applying the measuring device 1 so that it is possible to proceed to the acquisition of at least one depth map of the body while the flexible rod is in forced contact with this body.
[0081] When the image capturing device 4 allows it, this acquisition step also carries out the acquisition of digital images of the body 3 simultaneously with the acquisition of the depth maps.
[0082] The data acquired during this step can be stored in a buffer memory of the image capturing device 4 or of the measuring device 1. They can be processed by the calculation unit and/or transmitted to the remote calculation device with a view to being processed there via the transmission unit 6 to which the image capturing device 4 is directly or indirectly connected.
[0083] Whether these data are processed locally or by the remote calculation device, a measuring method according to the present disclosure comprises a step of processing these data (at least one depth map and, optionally, at least one digital image) aimed at establishing the force exerted by the measuring device 1 on the body 3, at the measurement instant.
[0084] To this end, the processing step comprises a first sub-step aimed at locating, via a digital processing technique, the distal end 2b of the flexible rod 2 in the depth map or, when the latter is available, in the digital image. This sub-step can be facilitated by the presence of a protective tip having a specific shape, making it possible to clearly distinguish its outline in the depth map. This location sub-step can comprise conventional digital processing in the field of computer vision and can be implemented, for example, by a neural network. At the end of execution, this sub-step provides the coordinates, in the coordinate system (x, y, z) associated with the image capturing device 4, of the distal end 2b of the rod 2.
[0085] When this processing is done on the digital image, the tip can be chosen to also have a specific color, thus facilitating its location in the image. The location of the tip can very simply be expressed in the form of the column and row ranks of a pixel of the image. The rows of the pixel and the depth map are then used to determine the coordinates, in the coordinate system (x, y, z) associated with the image capturing device 4, of the distal end 2b of the rod 2.
[0086] If the depth map has a lower resolution than that of the image, this sub-step may comprise or correspond to the search for the point of the depth map closest to the coordinates identified in the previous sub-step, in order to take consistent information from the depth map.
[0087] In all cases, and regardless of the processing implemented during this sub-step, the outcome of this sub-step is provided with the coordinates, in the coordinate system (x, y, z) associated with the image capturing device 4, of the distal end 2b of the rod 2, at the measurement instant. When several successive measurements are carried out, a list of these coordinates is available.
[0088] In a second sub-step of the processing step, the position of the distal end 2b of the rod 2 at the measurement instant is converted into a force. To perform this conversion, the function or the calibration table of the flexible rod 2 is used, associating the position of the distal end 2b with an applied force. As seen previously, this function or this table may have been developed in a calibration step, prior to the steps making up the measuring method itself.
[0089]
[0090] To simplify the illustration, the body 3 being tested here has a single dimension, and an image of this body is therefore composed of pixels x1 to xn arranged in a line along an axis X that forms the coordinate system of the image capturing device 4. Each pixel xi is, in this example, associated with a measurement of red color intensity, provided by an image sensor of the image capturing device 4, and with a depth measurement z, provided by, for example, a device with an infrared image sensor.
[0091] In the illustrated example, it is considered that the body 3 has an exposed surface essentially of blue color, which contrasts well with the red tip of the flexible rod 2 and which facilitates the identification of this tip in the image.
[0092] The illustration of
[0093] The first location sub-step is facilitated by the choice of the very distinct color of the distal end 2b of the rod 2 in comparison with that of the body 3, so that in the image composed of pixels associated with an intensity of red color, it is easy to locate the pixel x0 whose intensity in the red is well marked with respect to the other pixels that are in turn linked with the body 3 being tested, here blue in color. In practice, algorithms from the field of computer vision can be implemented to identify the distal end 2b of the rod 2 in the image, and to choose a pixel representative of the position of this end in the image.
[0094] Knowing the pixel x0 (or more generally the coordinates in the coordinate system associated with the image capturing device 4) corresponding to the distal end 2b, it is easy to use the depth map to determine the measured distance d0 associated with this pixel, from the depth map shown in
[0095] It will be noted that the information provided by the depth map, here, for each pixel of the digital image, the distance separating the exposed surface of the body 3 from the image capturing device 4, is the combination of two phenomena: the deformation of the body 3, which tends to move its surface away from the measuring device 1, and the deformation of the rod 2, which tends to bring the measuring device 1 closer to the body 3. However, the estimate of the force applied depends only on this last distance (or more precisely on the position (x, y, z) of the distal end 2b of the rod 2 with respect to the measuring device 1), so that the method can estimate this force unequivocally.
Method for Characterizing the Rigidity of a Body
[0096] To be complete, however, it should be noted that the information provided by a single measurement (i.e., a depth map and, possibly, a digital image) is not sufficient on its own to characterize the rigidity of the body 3 being tested at the point of contact.
[0097] It is first recalled that the rigidity of a body can be characterized in multiple ways. It can be represented by, for example, the deformation distance of the body at the point of contact, according to the force applied, for example, of increasing intensities or of different orientations. The term “deformation distance” denotes the distance D between the point of contact when no force is applied and this point of contact when a determined force is applied by the measuring device 1, as made visible in
[0098] Alternatively, this deformation can be characterized and represented by a deformation profile (for example, established from the points (xi, zi) of the depth map, to take the example of
[0099] Irrespective of how the rigidity of the body 3 is characterized, it is based on the availability of a plurality of depth maps, making it possible to evaluate the deformation of the body 3 for at least two different applied forces. Advantageously, there is a first map corresponding to the natural shape of the body 3 (in the absence of application of any force) and at least one second map corresponding to the shape of the body 3 when the measuring device 1 applies at least one determined force, according to its 3 components fx, fy, fz.
[0100] By way of example,
[0101] This same
[0102] It is observed in
[0103] Thus, during a characterization method according to the present disclosure, the deformation profiles of the body 3 established using the first map and the second depth map (or this first and second map directly) are readjusted with respect to each other. More generally, all the depth maps C1, C2 that have been acquired during the method are readjusted with respect to each other. In this way, the profiles produced by the image capturing device 4 carried by the head 1b of the measuring device 1 are readjusted with respect to each other.
[0104] This readjusting step can include digitally trying to make the non-deformed zones of the depth maps C1, C2 match one another, respectively, for example, at least one peripheral zone Z of
[0105] To facilitate this step of readjusting the depth maps, it is possible to provide the body 3 with visual markers, referred to as readjusting markers, that can be identified in the digital images provided by the image capturing device 4. These markers can be useful, in particular, for detecting a deformation presenting a rotational component of the body 3, which would not be detectable on the depth maps.
[0106] Once the depth maps have been readjusted with respect to each other, it is possible to characterize the rigidity of the body 3, for example, by identifying the deformation distance D or the deformation profile (which appears on the depth maps of
[0107] Of course, the present disclosure is not limited to the embodiment described, and it is possible to add alternative embodiments without departing from the scope of the invention as defined by the claims.
[0108] In particular, the system and the measuring and characterization methods that have just been described can be used to characterize the rigidity of a body of any kind. It may be, in particular, a human body, but this particular disclosure is not limiting. It can also be any object of which it is desired, for example, to characterize the rigidity.
[0109] The device and the method can find numerous practical applications, for example, for developing a digital model of the characterized object, this model making it possible to represent or simulate the deformation of an object or of a body when the latter is subjected to external forces.