FRICTION-BASED TACTILE SENSOR FOR MEASURING GRIP SECURITY

Abstract

A system for assessing grip security, the system comprising: a contact surface having at least a first contact surface region and a second contact surface region, the first contact surface region being configured to resist slip less than the second contact surface region, a sensor for detecting slip in the first contact region.

Claims

1-37. (canceled)

38. A system for assessing grip security, the system comprising: a contact surface having at least a first contact surface region and a second contact surface region, the first contact surface region being configured to resist slip less than the second contact surface region, a sensor for detecting slip in the first contact surface region, wherein the contact surface comprises a plurality of protrusions extending from a base surface, the protrusions in the first contact surface region extending away from the base surface a distance less than the protrusions in the second contact surface region.

39. A system as claimed in claim 38, wherein the protrusions are deformable.

40. A system as claimed in claim 38, wherein protrusions are configured to move independently of one another.

41. A system as claimed in claim 38, wherein the uncompressed distance from the base surface of protrusions in the first contact region is less than that of protrusions in the second contact region.

42. A system as claimed in claim 38, wherein the protrusions are configured such that in use under a consistent grip pressure the normal force on a protrusion in the first contact region is less than that on a protrusion in the second contact region.

43. A system as claimed in claim 38, wherein each protrusion comprises an internal cavity that extends from the base surface towards a distal end of the protrusion.

44. A system as claimed in claim 43, wherein a sensor is positioned behind the base surface at a location adjacent each cavity.

45. A system as claimed in claim 38, wherein the sensor is adapted to detect incipient slip.

46. A system as claimed in claim 44, wherein an aperture having a smaller diameter than the cavity is located between the sensor and the cavity.

47. A system as claimed in claim 46 wherein the sensor comprises a quadrant photodiode configured to detect light emanating from LEDs positioned on a cavity side of the base surface within a given protrusion, reflecting from a reflector located at or near the distal end of the cavity and travelling through the aperture to the sensor.

48. A system as claimed in claim 38 wherein the contact surface comprises a plurality of protrusions extending from a base surface, the protrusions each having an internal cavity, and wherein the sensor comprises a CCD array, the system being configured such that the CCD array detects light emanating from the base surface into the cavity, reflecting from a reflector located at the distal end of the cavity, and travelling through an aperture in the base surface to the sensor.

49. A system as claimed in claim 38 wherein the contact surface comprises a plurality of protrusions extending from a base surface, the protrusions having an internal cavity, and wherein the sensor comprises a CMOS light-sensitive array, the system being configured such that the CMOS light-sensitive array detects light emanating from the base surface into the cavity, reflecting from a reflector located at the distal end of the cavity, and travelling through an aperture in the base surface to the sensor.

50. A method for assessing grip security, the method comprising detecting slip at a contact surface, wherein the contact surface has at least a first contact surface region and a second contact surface region, the first contact surface region being configured to resist slip less than the second contact surface region, wherein the contact surface comprises a plurality of protrusions extending from a base surface, the protrusions in the first contact region extending away from the base surface a distance less than the protrusions in the second contact region.

51. A method as claimed in claim 50, wherein the protrusions are positioned to extend from the base surface and form an array of protrusions.

52. A method as claimed in claim 50, wherein the uncompressed height from the base surface of a protrusion in the first contact region is shorter than that of a protrusion in the second contact region.

53. A method as claimed in claim 50, wherein the protrusions are configured such that the normal force experienced by a protrusion in the first contact region is less than that of a protrusion in the second contact region.

54. A method as claimed in claim 50, wherein each protrusion is associated with a sensor configured to detect light emanating from the base surface into the cavity, reflecting from a reflector located at the distal end of the cavity, and travelling through an aperture in the base surface to the sensor.

55. A method as claimed in claim 50, wherein the sensor comprises a means for detecting incipient slip.

56. A method as claimed in claim 50, wherein a rate at which slip events are detected by the sensor indicates a level of urgency with which a corrective action is required or a magnitude of force required for a corrective action.

57. A method of estimating friction at a contact surface, the method comprising providing a plurality of protrusions extending from a base surface to a tip, measuring displacement of the tip in three dimensions, estimating forces applied to the tip in three dimensions at the moment of slip.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

[0041] Embodiments will now be described by way of example only, with reference to the accompanying drawings in which

[0042] FIG. 1A is a cross-sectional view of an embodiment of a contact surface of the disclosure;

[0043] FIG. 1B is a cross-sectional view of the embodiment of FIG. 1 in a compressed condition;

[0044] FIG. 1C is a cross-sectional view of the embodiment of FIG. 1 in a compressed condition;

[0045] FIG. 2 is a perspective view of a contact surface of the disclosure;

[0046] FIG. 3 is a perspective cross-sectional view of a contact surface of the disclosure;

[0047] FIG. 4 is a cross-sectional view of an embodiment of the contact surface integrated with a sensor system as per the disclosure;

[0048] FIG. 5 shows fabrication of a prototype of one embodiment of the disclosure, showing both mould and resultant silicon profile;

[0049] FIG. 6 shows a test rig for testing at least one embodiment of the disclosure;

[0050] FIG. 7 shows a single frame of video captured during the testing procedure;

[0051] FIGS. 8A-8C provide a graphical view of tangential-to-normal force ratio at which each pillar slips at each normal force level. FIG. 8A shows the high friction surface, FIG. 8B shows the base friction surface and FIG. 8C shows the low friction surface;

[0052] FIGS. 9A-9C provide a graphical representation of detection of displacement and force using one embodiment of the disclosure. FIG. 9A provides a reference pillar tip displacement, FIG. 9C provides a reference force data and FIG. 9B shows the optical sensor data output;

[0053] FIG. 10 shows detection of vibration response using an embodiment of the disclosure.

DETAILED DESCRIPTION

[0054] In the following detailed description, reference is made to accompanying drawings which form a part of the detailed description. The illustrative embodiments described in the detailed description, depicted in the drawings and defined in the claims, are not intended to be limiting. Other embodiments may be utilised and other changes may be made without departing from the spirit or scope of the subject matter presented. It will be readily understood that the aspects of the present disclosure, as generally described herein and illustrated in the drawings can be arranged, substituted, combined, separated and designed in a wide variety of different configurations, all of which are contemplated in this disclosure.

[0055] In FIG. 1, disclosed is a system for assessing grip security, the system comprising a contact surface 10 having at least a first contact surface region 12 and a second contact surface region 14. In the illustrated form, the contact surface is in the form of a plurality of protrusions 16 extending from a base surface. In FIG. 1 only two protrusions 16 are shown, however it will be clear to the person skilled in the art that the contact surface may comprise a plurality of protrusions 16 extending from the base surface 18. The protrusions 16 are in the form of elongate pillars having an attachment end 19 engaged with or integral with the base surface 18 and extending to a tip 20 having, in some embodiments, a hemispherical end profile. In the illustrated form the elongate pillars have similar cross-sectional dimensions and different lengths of extension from the base surface. In this illustrated form, the variation in distance the protrusion extends from the base surface defines the first contact surface region 12 and the second contact surface region 14. Specifically, the first contact surface region is configured to resist slip less than the second contact surface region. In the illustrated form, only two elongated protrusions are shown, having different heights relative to one another.

[0056] FIG. 1 is a simplified model of a possible embodiment, whereby a longer central protrusion or pillar, with height l.sub.C, is surrounded by eight shorter outer pillars, each with height l.sub.O. Alternative embodiments include multiple pillars of varying heights.

[0057] FIG. 1A illustrates two protrusions 16 when uncompressed, each protrusion being in the form of a pillar and having equal diameters, D, but different heights, l.sub.C and l.sub.O.

[0058] In FIG. 1B, the device 10 is illustrated in contact with a flat surface 24 such as the surface of an object which is being grasped. In this figure, both pillars are compressed by a gross normal force F.sub.N to the same final height, resulting in a different normal (compression) force on each pillar.

[0059] FIG. 1C illustrates the addition of a tangential force that acts by shearing the flat surface 24 that the sensor is in contact with, with each of the protrusions 16 also thereby experiencing a tangential force. When no protrusions are slipping against the surface, and assuming that the pillars cannot bend appreciably, they all experience the same tangential force, and the sum of the tangential forces is equal to the gross tangential force, F.sub.T.

[0060] In some embodiments of the disclosure, the movement of individual protrusions 16 may be independent of one another. The independent or partially independent movement of at least two protrusions in the form of pillars 16 is advantageous in that it enables the measurement of the relative movement on the contact surface which may occur only at differing levels across the contact surface 10.

[0061] In some embodiments of the disclosure, the contact surface 10 is fabricated primarily from silicone.

[0062] As shown in FIG. 1C, the protrusions 16 of the first surface contact area 12 are under a smaller normal force than is the longer protrusion 16 of the second surface contact area 14. In some forms, the assumption is made that the coefficient of static friction is the same for each protrusion; the outer protrusions of the first contact surface region 12 of the embodiment shown in FIG. 2 will slip at a smaller gross tangential force than the central protrusion 16 of the second contact surface region.

[0063] If the spring constant (k) and diameter (D) of a single protrusion are known, and the tangential and normal force are measured at the moment of slip of the shorter protrusions, then it is possible to predict the ratio of gross tangential to normal force at which the longer protrusion will slip. The coefficient of static friction is thus an estimation of the ratio of the tangential force to normal force at the moment of slip for the longer protrusion. In some forms the gross force across the device is measured and apportioned to the protrusions, assuming the material is linear elastic. In some not illustrated forms the force can be individually detected for protrusions or groups of protrusions.

[0064] Ideally, since the protrusion is not slipping, it should be deflecting at the same velocity as the surface against which it is compressed. By contrast, when the protrusion slips, the deflection velocity should trend towards 0 mm/s. In practice, due to bending of the protrusion or pillar, the moment of slip was determined as the moment when the deflection velocity of a shorter protrusion decreases to 20% of the deflection velocity of the longest protrusion, conditional on the deflection velocity of the longest protrusion being sufficiently large.

[0065] With more protrusions and more height differences, a larger range of frictions and normal forces may be accommodated for, and more warnings are possible to prevent loss of the object as the tangential force increases. The rate at which warnings are signalled, as well as the number of warnings, could indicate the urgency with which corrective action is required. Furthermore, with each warning, more information about the contact interface can be known.

[0066] Both with and without continuous normal and tangential force monitoring, the disclosed device can advantageously be used to improve dexterous manipulation in robotic and prosthetic grippers. Without continuous monitoring, the rate at which warnings are signalled, as well as the number of warnings, could still indicate the urgency with which corrective action is required as well as the magnitude of the corrective action. With continuous force monitoring, it may be possible to also determine the coefficient of static friction, and grip corrections would be more informed. Regardless of the type of monitoring, it is possible for a warning to be issued when incipient slip is detected.

[0067] In some embodiments of the device, the contact surface 12 is planar such that the relative compression of each protrusion can be determined.

[0068] The system in some forms further comprises a sensor, or sensor system, adapted to measure the slip at the first contact region 12 to detect incipient slip. The sensor may be in various forms.

[0069] As shown in FIG. 2, the contact surface may comprise a base surface 18 with a plurality of protrusions extending therefrom. In some forms the contact surface further comprises a lower support surface 41 and an upper support surface 40. In some forms the upper support surface includes a plurality of apertures through which the protrusions may extend. In some forms the lower surface 41 may include support or cavities for supporting sensors or other system parts.

[0070] In some embodiments of the device, such as is illustrated in FIGS. 3 and 4, an illuminated reflector 31, aperture 32 and light sensor 33 form a pinhole camera configuration 30, allowing the three-dimensional deflection of the illuminated reflector 31 to be measured. This deflection correlates with the three-dimensional deflection of the tip of the protrusion 16. A pinhole camera configuration 30 is one where light from a source 34 passing through an aperture 32 projects an inverted image of the source onto a screen or sensor 33 below. The light source 34 is shone up a cavity 35 inside each protrusion 16 so as to reflect off a reflector 31 at the distal end of the cavity 35, and back through the pinhole aperture 32 onto a sensor 33 mounted some appropriate distance from the pinhole aperture 32, behind the base surface 18.

[0071] In some embodiments of the device, the light source 34 originates from a small circular disk, wherein a circular light spot will be projected. By monitoring the position of the light spot, the sensor 33 is able to detect the three-dimensional position of the source 34 relative to the aperture 32. In some embodiments the light spot enlarges when the protrusion is compressed meaning deformation along an axis normal to the base can be measured.

[0072] The device further allows measurement of change or deformation in three dimensions, that is, in the x and y axis of a tangent plane of the base surface and the z axis which extends normal to the base surface at the point a given protrusion extends from the surface.

[0073] Visual representation of change or deformation in all three axes allows the three-dimensional displacement applied to the protrusion or the tip of the protrusion to be measured. This three-dimensional visual representation of displacement comprises visual representations of the movement of the light spot to demonstrate angular movement of the protrusion in the x-y plane tangential to the base surface and visual representation of movement in the z-axis normal to the base surface through a change in the size of the light spot. This visual representation allows forces applied to the protrusion to be determined in all three dimensions. This measurement of three-dimensional force also allows estimation of friction when slippage occurs.

[0074] In some forms, the system detects slip when one or more protrusions no longer move at the same speed as other protrusions in the array. In some forms the system detects slip through vibration. In some forms, after detection of slip, the system reviews the ratio of tangential to normal force at the moment of slip to allow an estimate of the coefficient of friction.

[0075] Moreover, measurement of forces in three dimensions allows the array of protrusions to estimate torque because the x-y deflection or curl of force around the z axis can be sensed. This estimation of torque allows for increased grip security as the grip force can be increased to account for increasing torque as appropriate.

[0076] Measurement of three-dimensional displacement with a high bandwidth and very high spatial resolution allows sensing of vibration in the protrusions. Sensing vibration provides an alert relating to slip events. Alternatively, sensing vibration provides a means of sensing texture and an ability to distinguish between textures. Additionally, the sensing of vibration may lead to transduction of voice or music or other sound from a vibrating surface.

[0077] In some embodiments of the device, a cavity 35 inside the protrusion may contain a reflector disk 31 lit by LEDs 34 and the aperture 32.

[0078] In some embodiments of the device, the cavity 35 has a conical shape.

[0079] In some embodiments of the device, a sensor 33 in the form of a quadrant photodiode that sits below the aperture 32 may detect the position and/or size of the projected light spot relayed from the reflector 31. In such an embodiment, calculation of the light spot position correlates with the position of the tip of the protrusion in the x-y plane tangential to the base surface. This calculation uses a relatively simple formula whereby each axis is calculated by subtracting the difference between sensor halves and normalizing against the total received light. Similarly, the light spot size correlates with the position of the tip of the protrusion along the z-axis normal to the base surface which correlates with compression or release along the z-axis normal to the base surface. Calculation of the position of the tip along the z-axis can be simply calculated by measuring the intensity of light falling on the photodiodes. The simplicity of these calculation makes the design suitable for a microprocessor, even with large arrays of sensors.

[0080] In some embodiments of the device, a pinhole camera configuration 30 is capable of measuring the direction and magnitude of protrusion 16 deflection in two dimensions by examining the relative proportions of light illuminating each of the four quadrants of the photodiode sensor 33; as the protrusion 16 deflects the direction of the light beam shining through the pinhole aperture 32 will change. For smaller scale embodiments of the device, the photodiode sensor 33 could be replaced with a CCD or CMOS light-sensitive array. Variations and modifications may be made to the parts previously described without departing from the spirit or ambit of the disclosure.

EXAMPLES

[0081] In some illustrated embodiments, estimating forces on the protrusions or pillars may be performed as follows. It is assumed that the material behaves as a linear elastic according to Hooke's Law. It is noted that the gross normal force F.sub.N is the sum of the normal forces acting on each pillar.

[0082] In the case of a single central pillar, surrounded by eight outer pillars, this means:

F.sub.NC=kl.sub.C, (1a)

F.sub.NO=kl.sub.O=k(l.sub.Cd)=F.sub.NCkd, and(1b)

F.sub.N=F.sub.NC+8F.sub.NO=9kl.sub.C8kd,(1c)

where k is the spring constant of the elastic material of the pillars. Therefore:

[00001]$\begin{array}{cc}{F}_{\mathrm{NC}}=\frac{F_N}{9}+\frac{8.Math.\mathrm{kd}}{9},\mathrm{and}& \left(2.Math.a\right)\\ F_{\mathrm{NO}}=\frac{F_N}{9}-\frac{\mathrm{kd}}{9}.& \left(2.Math.b\right)\end{array}$

[0083] When a tangential force is also applied to the sensor by shearing the surface that is in contact, each of the pillars also experiences a tangential force (see FIG. 1C). When all pillars are stuck to the surface (not slipping), and assuming that (i) the compressive strain on the pillars is small relative to their height, (ii) the difference in height between the longer and shorter pillars is also small relative to height, and (iii) the pillars do not bend appreciably relative to their height, then they all experience approximately the same tangential force, and the sum of these tangential forces is equal to the gross tangential force, F.sub.T. In the case of a single central pillar, surrounded by eight outer pillars, this means:

F.sub.TC=F.sub.TO, and(3a)

F.sub.T=F.sub.TC+8F.sub.TO=9F.sub.TO,(3b)

where F.sub.TC is the tangential force on the central pillar and F.sub.TO is the tangential force on one of the outer pillars.

[0084] Because the outer pillars are under a smaller normal force, and .sub.s is the same for each pillar, the outer pillars will slip at a smaller gross tangential force than the central pillar. The outer pillars will start to slip when:

F.sub.TO>.sub.sF.sub.NO.(4)

[0085] This occurs when the gross tangential force is:

[00002]$\begin{array}{cc}{F}_T^{\mathrm{sO}}=9.Math.F_{\mathrm{TO}}>9.Math.{}_s.Math.F_{\mathrm{NO}}=9.Math.{}_s\left(\frac{F_N^{\mathrm{SO}}}{9}-\frac{\mathrm{kd}}{9}\right)={}_s\left(F_N^{\mathrm{SO}}-\mathrm{kd}\right).& \left(5\right)\end{array}$

[0086] While the outer pillars are slipping and the central pillar is still stuck, the outer pillars are contributing a limited amount of tangential force to the gross tangential force, due to the coefficient of kinetic friction (.sub.k):

F.sub.TO=.sub.kF.sub.NO, (6a)

and the central pillar will start to slip when:

F.sub.TC>.sub.sF.sub.NC.(6b)

This occurs when the gross tangential force is:

[00003]$\begin{array}{cc}{F}_T^{\mathrm{sC}}=F_{\mathrm{TC}}+8.Math.F_{\mathrm{TO}}>{}_s.Math.F_{\mathrm{NC}}+8.Math.{}_k.Math.F_{\mathrm{NO}}=\frac{{}_s}{9}.Math.\left(F_N^{\mathrm{sC}}+8.Math.\mathrm{kd}\right)+\frac{8.Math.{}_k}{9}.Math.\left(F_N^{\mathrm{sC}}-\mathrm{kd}\right).& \left(7\right)\end{array}$

[0087] Now, .sub.s is always greater than or equal to .sub.k, however, if it is assumed that .sub.s=.sub.k, then Eq. (7) can be simplified to:

F.sub.T.sup.sC=.sub.sF.sub.N.sup.sC.(8)

Combining equation (5) and (8) gives:

.sub.s=F.sub.T.sup.sC/F.sub.N.sup.sC=F.sub.T.sup.sO/(F.sub.N.sup.sOkd),(9)

meaning, if k and d are known, and the gross tangential and normal force are measured at the moment of slip of the outer pillars (F.sub.T.sup.sO and F.sub.N.sup.sO, respectively), it is possible to predict the ratio of gross tangential-to-normal force at which the central pillar will slip; that is, it is possible to estimate the coefficient of static friction by sensing when the outer pillars slip and then examining the forces at that time.

[0088] In some forms the diameter of the base of the sensor (from which the pillars emanate) Dtotal=80 mm with a thickness of 3 mm, and each of the cylindrical pillars had a diameter of D=10 mm and a hemispherical ending, with approximately 15 mm centre to centre spacing. Hemispherical ends were chosen, as flat ends with sharp edges would cause large compressive forces to grow on the edge of the pillar contact area before it would slip. In this embodiment of the sensor (as with the simple model above), eight outer pillars surround a single central pillar, in a 33 grid arrangement. The height of the central pillar was l.sub.C=15 mm, and the height of outer pillars was l.sub.O=14 mm; i.e., the height difference between the central pillar and the outer pillars is d=1 mm. To fabricate this prototype, silicone was cast into a 3D printed ABS plastic mould.

[0089] The mould was printed in thermoplastic using a 3D Printer. To smooth the 3D print lines on the surface of the mould, it was suspended over an acetone vapour bath for 3 hours at room temperature. FIGS. 5A and 5B show the mould before and after the acetone vapour bath, respectively.

[0090] A two-component, skin-safe silicone with low viscosity for easy flowing, and short curing period was used as the material for the prototype. The two components were mixed in equal parts as per the manufacturer instructions and the casting was performed in a single pouring. Degassing procedures were not required, however the silicone was poured from a height to allow better control of the pouring stream, and the mould was shaken gently to remove any bubbles present in the silicone. The silicone was de-moulded after curing (see FIG. 5C-5E). FIG. 5C shows a silicone prototype, top view; FIG. 5D shows the prototype with mounting support; FIG. 5E shows the silicone prototype, side view.

[0091] To validate the operation of the prototype, a number of experiments were performed to apply normal and tangential forces to the prototype. To perform these test procedures, a test rig was used, comprising of an XYZ-stage, a 3D force/torque sensor, the prototype, a transparent acrylic surface, and a camera. The test rig and test procedures are described below.

[0092] FIG. 6 shows an exemplary test rig for testing a prototype of at least one embodiment of the disclosure. The figure shows XYZ-stage labelled A, acrylic surface labelled B, prototype labelled C, 3D force/torque sensor labelled D, platform for video capture labelled E, and support frame labelled F.

[0093] The XYZ-stage shown in FIG. 6 consisting of three translation stages (M-605.1DD, Physik Instrumente (PI) GmbH & Co. KG, Karlsruhe, Germany) was used to bring a transparent acrylic surface into contact with the prototype and then shear the acrylic surface across the surface of the prototype. Each of the stages have a travel range of 25 mm with a maximum velocity of 50 mm.Math.s.sup.1, and accuracy of 0.1 m with step sizes down to 0.3 m. Compressing produces a normal force acting on the pillars and shearing of the surface while in contact with the object to be gripped produces tangential forces on each of the pillars.

[0094] A 3D force/torque sensor (Mini40, SI-80-4, ATI Industrial Automation, Apex, N.C., USA) was mounted between the prototype and a support frame (see FIG. 6D). The forces and torques acting on the prototype were sampled at 1 kHz with a PowerLab 16/35 data acquisition unit (AD Instruments, Bella Vista, NSW, Australia).

[0095] Video of the prototype in contact with the transparent acrylic surface was captured with the native video recording app of a 16 GB iPhone 6 (model A1586). The iPhone was placed on a platform such that the pillars are viewed through the transparent acrylic surface from (approximately 100 mm) directly below with the center pillar positioned in the middle of the image. The iPhone was connected to a MacBook Pro running QuickTime Player 10.4 to record the iPhone screen in .MOV format with 1334750 pixel resolution at 59.97 fps (frames.Math.s.sup.1). Camera calibration was performed using the MATLAB (R2014b, Mathworks, Natick, Mass., USA) Camera Calibration App. The lens distortion coefficients (radial and tangential) were calculated and at the edges of the sensor (beyond the maximum deflection of any of the pillars) the distortion was no greater than 1.1 pixels, which corresponds to approximately 0.12 mm. By comparison, the tracking dots on the pillars measure approximately 5 pixels in diameter. Since this distortion has the effect of biasing the measurement of pillar deflection, the effect on the results is only to change the time point at which the pillars are determined to have slipped relative to the stage; however, determining this event time is much more dependent on the slip detection rule used.

[0096] A small hole was created with a pin at the central point of the selected pillars, which was filled with black ink to form a reliable marker for tracking during video analysis. Furthermore, a black and white checkerboard pattern comprising of a row of three 10 mm squares was attached to the acrylic surface to provide a reference point for tracking the position of the surface as well as to provide a reference for the spatial unit conversion (pixels to mm) which was reasonable due to the negligible lens distortion.

[0097] The XYZ-stage is programmed to move vertically towards the prototype to a predetermined position that results in the desired normal force (0.5 N for measuring s, and 5, 7.5, 10, 12.5 and 15 N for analysing the pillar slipping behavioursee below) at a velocity of 2.5 mm.Math.s.sup.1. The XYZ-stage holds that position for 1.5 s, then moves laterally at a velocity of 2.5 mm.Math.s.sup.1 for a total of 15 mm. The stage then moves vertically away from the prototype back to the starting height, thus unloading the forces, then moves laterally to return to the starting position.

[0098] By recording the XYZ-stage position that results in the desired normal force (5, 7.5, 10, 12.5, and 15 N), the spring constant can be calculated according to Hooke's Law. Since, at these normal force levels, all nine of the sensor pillars are compressed against the acrylic surface, the spring constant k is equal to 1/9th of the gradient of the line defined by stage position versus normal force.

[0099] To ensure that the three surfaces used for testing had different values of s and that the s of each surface remained consistent throughout the testing, it was necessary to measure the s. The s was measured by performing the protocol above at a normal force of 0.5 Nat this normal force, only the central pillar makes contact with the surface. The friction was measured before and after testing the pillar behaviour for each combination of frictional condition and testing normal force (see below).

[0100] The behaviour of the sensor was tested at five different normal force levels: 5, 7.5, 10, 12.5 and 15 N. The XYZ-stage was programmed to apply the normal and tangential forces as described above. At the same time, the force/torque signals from the ATI sensor were recorded and video was captured of the pillars in contact with acrylic surface.

[0101] Three surfaces were used with different frictional properties: (i) acrylic cleaned with ethanol (base friction condition), (ii) acrylic covered in olive oil (low friction condition), and (iii) acrylic coated with a thin layer of soap that has been allowed to dry (high friction condition).

[0102] For each combination of normal force (5, 7.5, 10, 12.5 and 15 N) and surface (acrylic: coated with oil, cleaned with alcohol, coated with soap), the following testing was performed: test friction at 0.5 N (once), test pillar behaviour at desired normal force (five times), test friction at 0.5 N (once).

[0103] To remove any high-frequency noise in the force signals, a 2nd-order low-pass Butterworth filter with a cut-off frequency of 10 Hz was applied.

[0104] The recorded videos were used to monitor the deflections of the central pillar and one of the eight outer pillars of the prototype during lateral movement of the acrylic surface. The Kanade-Lucas-Tomasi algorithm was used to perform point tracking in MATLAB (Mathworks, Natick, Mass., USA). Three points were tracked throughout the video recording: (i) the centre of the central pillar, (ii) the centre of one outer pillarthis was chosen as the pillar directly leading the central pillar in the direction of shearingand (iii) a point on the reference grid (to monitor the position of the acrylic surface).

[0105] The result of point-tracking gives the deflection of the central and outer pillars relative to the position of the acrylic surface, and subsequently, relative to the undeflected position of each pillar. A single frame of the video tracking and the pillar deflection is shown in FIG. 4. A 5 Hz 2nd-order low-pass Butterworth filter was then applied to remove tracking jitter from the deflection data.

[0106] Synchronisation of the filtered force/torque and deflection signals were required since the original data were recorded on two different devices. At the end of each stimulus, the XYZ-stage accelerated in the negative Z-direction (normal to the pillars) to retract the acrylic surface away from the sensor, in order to unload the normal force. This results in a large acceleration in the measured normal force as well as the calculated central pillar deflection as the tangential bending force is suddenly removed. The large negative peaks in the second derivatives with respect to time of the filtered normal force and the central pillar deflection were used to synchronise the force and deflection data.

[0107] Ideally, since the stage is moving at a velocity of 2.5 mm.Math.s.sup.1, if the pillar is stuck (not slipping), it too should be deflecting at a velocity of 2.5 mm.Math.s.sup.1 at its tip, and when the pillar slips, the deflection velocity should become 0 mm.Math.s.sup.1. This however is not the case in practice and due to bending of the pillar, the pillar first appears to move at the same velocity as the stage, however this velocity decreases slowly as the pillar appears to roll at the contact point. The moment of slip was therefore heuristically determined as the moment when the deflection velocity of the pillar (i.e., the first derivative of the deflection position with respect to time) decreased to 5% of the stage velocity (i.e. when the deflection velocity of the pillar first drops to below 0.125 mm.Math.s.sup.1)this is close to zero, but above the level of frame-to-frame noise of the pillar deflection velocity. In this work to prove the principle of operation of the prototype, this threshold was sufficient for identifying the moment of slip, however, in other real situations the detection algorithm will certainly need to be more complex/robust. In some forms, each protrusion may be instrumented internally using the light and pinhole method described above to measure its deflection and vibration of the protrusion. In some forms this may means the slip event will be less ambiguous.

[0108] The ratio of the tangential force to normal force at the moment of slip (as determined by the video analysis) of the central pillar (the only pillar in contact at 0.5 N of normal force) was taken to be an estimate of .sub.s.

[0109] The principle of operation of the sensor is that the outer (shorter) pillar should slip under a smaller tangential force compared to the central (taller) pillar. To determine whether this is satisfied, the tangential and normal forces at the moment of slip of the outer and central pillars respectively, were determined for comparison. A prediction of .sub.s=F.sub.T.sup.sC/F.sub.N.sup.sC (Eq. (9)) was also calculated from the measured tangential and normal forces when the outer pillar slips (F.sub.T.sup.sO and F.sub.N.sup.sO, respectively) and a comparison was made to the measured F.sub.T.sup.sC/F.sub.N.sup.sC which are measured some time later when the central pillar finally slips.

Results

[0110] The stage positions (mm) for each of the normal forces (N) were used to calculate the spring constant, k, of the sensor pillars. The spring constant k, is the gradient of the line of best fit divided the number of pillars: k=1.174 N/mm.

[0111] It was observed that when the acrylic plate begins to shear (at approximately 2.4 s), there is a decrease in the normal force. This is expected as the XYZ-stage is programmed to remain at the same height while shearing the acrylic surface, and the pillars of the sensor bend, meaning that the effective height of the sensor decreases slightly. The .sub.s was taken as the ratio of tangential force to normal force at the moment the central pillar slips.

[0112] Referring to FIG. 7, shown is a single frame of video captured during the testing procedure. The red cross is the original position of the marker; the blue cross is the current position of the marker which moves with the acrylic plate. The values highlighted in yellow are the deflections (mm) of the marker (top), the central pillar (middle), and the outer pillar to the left of the central pillar (bottom).

[0113] Referring to FIG. 8, shown is a graphical view of tangential-to-normal force ratio at which each pillar slips at each normal force level for the A) high, B) base, and C) low friction surfaces. Markers are the mean values and error bars extend to SD. Dashed horizontal line indicates s measured at 0.5 N normal force.

[0114] As shown in FIGS. 9 A through 9C, the optical sensor is able to measure displacement of the protrusions and force on the protrusions. In the graphical representations, FIG. 9A provides reference displacement. The XY coordinates are obtained by tracking a dot which is stained on the tip of one pillar with a video camera from above. We bring a clear sheet of thick Perspex into contact with the pillar tip using a robotic stage and move it around to cause an XYZ displacement. The robotic stage tells us the Z coordinate.

[0115] FIG. 9C shows the reference force. This is obtained using a commercial 3-axis force sensor.

[0116] FIG. 9B shows measurement of the displacement and force using four photodiodes after some simple pre-processing. If there are four photodiodes arranged in a quadrant pattern as shown,

P Q

R S

[0117] Then the intensity of light they sense can be pre-processed as follows to get the middle plot.

Z=P+Q+R+S (i.e., sum of all)

X=[(P+R)(Q+S)]/Z (i.e., left minus right, normalised)

Y=[(P+Q)(R+S)]/Z (i.e., top minus bottom, normalised)

[0118] Finally two mapping functions are learned to map the values measuring displacement and force shown in FIG. 9B to either: the values in FIG. 9A showing the reference displacement in three dimensions, or the values in FIG. 9C showing the reference forces in three dimensions.

[0119] As shown in FIG. 10, the sensors can detect vibration. In this example the protrusion tip was in contact with a shaker which vibrates along a single axis. The attached image shows the results of a test where a 10 micron (0.01 mm) vibration at 330 Hz was applied in the Z axis of the pillar (i.e., compressing the pillar). The dotted red trace indicates the displacement of the shaker while the blue trace indicated the response of the photodiode sensor; this sensor response value shown in the blue trace was obtained using the calculation Z=P+Q+R+S, and is expressed in volts.

[0120] In the claims which follow and in the preceding description of the invention, except where the context requires otherwise due to express language or necessary implication, the word comprise or variations such as comprises or comprising is used in an inclusive sense; i.e., to specify the presence of the stated features but not to preclude the presence or addition of further features in various embodiments of the invention.