A MONITORING SYSTEM FOR USE ON A VEHICLE
20180244187 ยท 2018-08-30
Inventors
- Giovanni STRANO (Whitley, Coventry, GB)
- Jeremy Greenwood (Whitley, Coventry, GB)
- Nicholas O'DONNELL (Whitley, Coventry, GB)
Cpc classification
G06V20/59
PHYSICS
B60R2300/8006
PERFORMING OPERATIONS; TRANSPORTING
B60R1/29
PERFORMING OPERATIONS; TRANSPORTING
International classification
H04N7/18
ELECTRICITY
Abstract
A monitoring system for a cargo holding area (12) of a vehicle (10) comprises a pressure sensing device (22) locatable within the cargo holding area (12), in use, and configured to provide a pressure output indicative of the pressure applied by cargo (17) within the cargo holding area (12) to determine a state of the cargo; a determination module (42) for determining one or more comparison states of the cargo (17); a comparator module (44) configured to compare the state of the cargo with the one or more comparison states of the cargo (17) and to determine whether there is a correspondence between them; and a notification module (46) configured to provide a notification to a user of the vehicle (10) that the cargo (17) is in an unacceptable state in dependence on the result of the comparison, for example if the pressure output does not correspond to the one or more comparison states.
Claims
1. A monitoring system for monitoring a cargo holding area associated with a vehicle during transit, the system comprising: a pressure sensing device locatable within the cargo holding area, in use, and configured to provide live load data output indicative of pressure applied to the pressure sensing device by cargo within the cargo holding area; a determination module for outputting one or more predetermined load pattern states of the cargo; a comparator module configured to compare the live load data output with the one or more predetermined load pattern states of the cargo and to determine whether there is a correspondence therebetween; and a notification module configured to output a notification that the cargo is in an unacceptable state in dependence on a result of determining whether there is a correspondence between the live load data output and the one or more predetermined load pattern states.
2. The monitoring system as claimed in claim 1, wherein the notification module is configured to output the notification that the cargo is in an unacceptable state if the live load data output does not correspond to the one or more predetermined load pattern states.
3. The monitoring system as claimed in claim 1, wherein the pressure sensing device is configured for mounting on a floor of the cargo holding area.
4. The monitoring system as claimed in claim 3, wherein the pressure sensing device comprises a pressure sensitive mat upon which the cargo is placed, wherein the pressure sensitive mat comprises a two dimensional array of pressure sensitive devices, and wherein the live load data output of the pressure sensing device is in the form of a two dimensional pressure map for comparison with one or more two-dimensional pressure maps representing the predetermined load pattern states of the cargo.
5. (canceled)
6. The monitoring system as claimed in claim 1, wherein the determination module includes a learning module for updating the predetermined load pattern states based on the live load data output of the pressure sensing device during prior periods for which the state of the cargo is acceptable.
7. The monitoring system as claimed in claim 6, wherein the prior periods are user-selectable periods when a user determines that the state of the cargo is acceptable.
8. (canceled)
9. The monitoring system as claimed in claim 1, comprising an output to a visual display, wherein the notification module is configured to output the notification via the output to the visual display.
10. (canceled)
11. The monitoring system as claimed in claim 9, wherein the monitoring system comprises an image capture device for capturing image data from the cargo holding area, and wherein the notification module is configured to provide captured image data to the visual display only in the event that the cargo is determined to be in an unacceptable state.
12. (canceled)
13. The monitoring system as claimed in claim 1, further comprising a human machine (HMI) interface configured to permit user inputs relating to the type of cargo to be transported within the cargo holding area.
14. (canceled)
15. The monitoring system as claimed in claim 1, further comprising a movement sensor for determining movement of the cargo holding area, wherein the determination module is configured to receive a movement output from the movement sensor and to adjust the one or more predetermined load pattern states of the cargo in response to the movement output.
16. (canceled)
17. The monitoring system as claimed in claim 1, wherein the comparator module is configured to compare the live load data output from the pressure sensing device with a pressure threshold representative of pressure applied to one or more points on the pressure sensing device or with one or more predetermined load pattern states of the cargo in the form of a frequency of change of pressure applied to one or more selected locations on the pressure sensing device, thereby to determine whether there is a correspondence with the one or more predetermined load pattern states of the cargo.
18-19. (canceled)
20. A method of monitoring a cargo holding area associated with a vehicle during transit, the method comprising: sensing pressure applied by cargo within the cargo-holding area and providing live load data output indicative of the pressure applied by the cargo within the cargo holding area; determining whether the live load data output corresponds to one or more predetermined load pattern states of the cargo; and outputting a notification that the cargo is in an unacceptable state in dependence of the result of the comparison.
21. The method as claimed in claim 20, further comprising providing the notification if the live load data output does not correspond to the one or more predetermined load pattern states.
22. The method as claimed in claim 20, further comprising determining a type of cargo to be transported within the cargo holding area.
23. The method as claimed in claim 20, further comprising updating the predetermined load pattern states based on the pressure applied by the cargo within the cargo holding area during periods prior to determining whether the live load data output corresponds to one or more predetermined load pattern states of the cargo, the periods prior to determining whether the live load data output corresponds to one or more predetermined load pattern states of the cargo optionally being user-selectable periods when a user determines that the state of the cargo is acceptable.
24. The method as claimed in claim 20, further comprising receiving a movement output from a movement sensor indicating movement of the cargo holding area and adjusting the one or more predetermined load pattern states of the cargo in response to the movement output.
25. The method as claimed in claim 20, further comprising comparing the pressure applied by cargo in the cargo holding area with a pressure threshold or with one or more predetermined load pattern states of the cargo in the form of a frequency of change of pressure applied to determine whether there is a correspondence with the one or more predetermined load pattern states of the cargo.
26. (canceled)
27. A computer program product comprising a non-transitory computer readable medium including computer readable program code, wherein the computer readable program code when executed causes a processor to implement the method of claim 20.
28. A vehicle comprising the monitoring system of claim 1, the vehicle having an associated cargo holding area including a floor carrying the pressure sensing device.
29. A vehicle as claimed in claim 28, wherein the associated cargo holding area is a horsebox.
30-32. (canceled)
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0035] One or more embodiments of the invention will now be described, by way of example only, with reference to the accompanying drawings, in which:
[0036]
[0037]
[0038]
[0039]
[0040]
DETAILED DESCRIPTION
[0041] Referring to
[0042] It should be noted at this stage that the accompanying
[0043] Referring specifically to
[0044] The vehicle 10 includes a computer system 18 which is arranged to monitor (i.e. receive data signals related to) a number of vehicle parameters in order to control various vehicle settings. The computer system 18 may form an integral part of the vehicle 10 at the time of purchase and consist solely of hardware carried on the vehicle 10, in which case the skilled person will appreciate that aspects of the computer system 18 may be spatially distributed throughout the vehicle 10, including in the trailer 12. The skilled person will also appreciate that the computer system 18 may in full or in part be provided by a device that is carried on-board the vehicle 10, such as the user's personal device 20 (e.g. a tablet or mobile phone). With this in mind, various elements of the invention may be embodied in an application running on the vehicle user's personal mobile device 20. In addition, the computer system 18 may be provided fully or in part at a location remote from the vehicle 10 and vehicle systems may communicate wirelessly with those aspects of the computer system 18 that are provided remotely, as will be apparent from the following description.
[0045] In the context of the invention, the role of the computer system 18 is to provide a notification to the vehicle user indicating whether the status of the horse 17 within the trailer 12 is acceptable. As will be discussed in more detail later, many factors may be taken into consideration when defining what constitutes an acceptable state of the horse 17 within the trailer 12.
[0046] To provide an indication of the state of the horse within the trailer 12, the monitoring system comprises a pressure sensing device 22 mounted on the floor of the trailer. The pressure sensing device 22 includes a pressure mat 23 comprising an integrated array of pressure sensors arranged in a two-dimensional plane extending across the floor of the trailer 12. The pressure sensing device 22 provides an output in the form of a pressure map which correlates the output of each individual pressure sensor of the pressure mat 23 with the position of that pressure sensor within the array. Thus, the output of the pressure sensing device 22 indicates the pressure exerted on the floor of the trailer 12 as a function of position in a two-dimensional array.
[0047] The pressure mat 23 may extend across substantially the whole floor area in the trailer 12, or in other embodiments may extend across only a selected portion of the floor of the trailer 12 depending on the expected positioning of the horse 17 on the floor.
[0048] The monitoring system is also provided with an inertial measurement unit (IMU) 24 or movement sensor which measures the movement of the trailer 12. The IMU 24 provides the computer system 18 with a signal indicating, for example, the velocity, acceleration and orientation of the trailer 12, the pitch, yaw and/or the roll or any other parameter(s) relating to the movement of the trailer 12.
[0049] The monitoring system also includes an image capture device 26 including a camera mounted within the cargo holding area of the trailer 12. The camera captures images from within the trailer 12 and provides these images to the vehicle computer 18 via a wired or wireless data signal.
[0050] Referring also to
[0051] The pressure mat 23 may consist of any suitable number of individual pressure sensors in the array, depending on the floor space on which the mat 23 is to be positioned. The spatial density of the pressure sensors defines the spatial resolution of the output pressure map and the resolution of the individual pressure sensors defines the pressure resolution of the output pressure map. For example, each pressure sensor may function in a binary on/off manner, i.e. providing a positive signal when the applied pressure is above a certain threshold. Alternatively, the sensors may have higher resolution which allows the pressure exerted on the floor of the trailer 12 to be evaluated more precisely by providing a graded scale pressure map (e.g. with different colours representing different applied pressures) of the floor area of the trailer 12. the output from the pressure mat 23 is referred to as the load data output. The outputs from the pressure sensing array derived from the rows and columns of the array are provided to the computer system 18. One suitable pressure mat is a Tekscan? pressure mat which is suitable for medical applications, such as foot function and gait analysis.
[0052] Having described the general arrangement of the monitoring system, further details of an embodiment of the invention will now be described with reference to
[0053] The pressure sensing device 22, the IMU 24 and the image capture device 26 are all mounted in or on the vehicle trailer 12 as described previously. The monitoring system includes a human machine interface (HMI) 28 mounted within the vehicle cabin. The HMI 28 includes a display means, typically in the form of an LCD display screen, and an audio system, both of which may be used to communicate information from the vehicle computer 18 to the vehicle user about various vehicle settings or attributes. The HMI 28 is also configured to allow the user to set user preferences relating to the vehicle 10. For this purpose, the HMI 28 is provided with a user input interface. The system also includes a data store 40, a determination module 42 for processing data signals to determine acceptable states, also referred to as comparator states, of cargo within the trailer 12, a comparator module 44 and a notification module 46, all represented by functional blocks in
[0054] A set of instructions could be provided which, when executed, cause said processing unit(s) to implement the techniques described herein (including the method(s) described below). The set of instructions may be embedded in one or more electronic processors, or alternatively, the set of instructions could be provided as software to be executed by one or more electronic processor(s). For example, a first function may be implemented in software run on one or more electronic processors, and one or more other functions may also be implemented in software run on or more electronic processors, optionally the same one or more processors as the first controller. It will be appreciated, however, that other arrangements are also useful, and therefore, the present invention is not intended to be limited to any particular arrangement. In any event, the set of instructions described above may be embedded in a computer-readable storage medium (e.g., a non-transitory storage medium) that may comprise any mechanism for storing information in a form readable by a machine or electronic processors/computational device, including, without limitation: a magnetic storage medium (e.g., floppy diskette); optical storage medium (e.g., CD-ROM); magneto optical storage medium; read only memory (ROM); random access memory (RAM); erasable programmable memory (e.g., EPROM ad EEPROM); flash memory; or electrical or other types of medium for storing such information/instructions.
[0055] That is to say, the functional architecture illustrated in
[0056] The determination module 42 receives input signals from the data store 40 and the IMU 24. The role of the determination module 42 is to output a signal indicating the set of acceptable states of the cargo within the trailer 12 based on the input signals from the data store 40 and the IMU 24. The acceptable states of the cargo are stored in the data store 40, while the determination module 42 adjusts the acceptable states based on the output from the IMU 24 so that the acceptable states take account of any background trailer movement, as will be described in further detail later. The determination module 42 includes a sub-module in the form of a learning module which takes into account prior learnt behaviour of the system, as is also described further below.
[0057] The comparator module 44 receives input signals from the pressure sensing device 22 and the determination module 42 so as to determine if the state of cargo within the trailer 12 is acceptable. In order to do this, the comparator module 44 performs one or more algorithms to compare the state of cargo within the trailer 12, as indicated by the pressure map output of the pressure sensing device 22, with a set of acceptable states, as indicated by the output of the determination module 42. The comparator module 44 then provides an output indicating whether the state of the cargo within the trailer 12 is acceptable.
[0058] The output of the comparator module 44 is provided to the notification module 46. If the output of the comparator module 44 indicates that the state of the cargo within the trailer 12 is unacceptable, then the notification module 46 outputs a signal to the HMI 28, to notify the vehicle user that there is a problem. In this embodiment, the notification includes the display of live video feed information from the image capture device 26 via the display screen of the HMI 28, allowing the vehicle user to observe any cargo within the trailer 12.
[0059] In another configuration the determination module 42 may be arranged to determine a set of unacceptable states of the cargo, so that the comparison steps are comparing the load data output from the pressure mat 23 with states of the cargo which are deemed unacceptable, rather than comparing with states that are deemed acceptable. In this embodiment it will be appreciated that the subsequent logic steps just need to be inverted.
[0060] Having described the components of the monitoring system in more detail, a method that may be performed by the system described above will now described with reference to
[0061] At initial step 50, the pressure exerted across the floor of the trailer 12 is measured by the pressure sensing device 22 to determine the state of the cargo within the trailer 12.
[0062] At step 52, a check is made regarding whether the user wishes to view the load data output from the pressure sensing device 22, so as to make a determination of the state of the cargo within the trailer 12. If the user does not request to view the load data from the pressure sensing device 22, a check is made at step 54 about whether or not there has been a change in the latest load data output from the pressure sensing device 22 compared to the previous load data output. If there has been no change then the routine returns to the initial step 50, and the next load data output is input at the start of the sequence.
[0063] If there is a change to the load data output compared to the previous load data output, a determination is made in the determination module 42 about whether the load data output corresponds to one of the acceptable states of the cargo. At step 56, the acceptable states of the cargo within the trailer 12 are determined. The acceptable states may be pre-determined, or may be based on a learning algorithm (step 58) which monitors the behaviour of the cargo and updates the acceptable states over time as data regarding the behaviour is accumulated, as will be explained in more detail later.
[0064] At step 60, the comparator module 44 compares the output signal of the pressure sensing device 22 with the output from the determination module 42. At step 62 the comparator determines if the state of the cargo within the trailer 12 is acceptable, i.e. if the state of the cargo corresponds to one of the determined acceptable states of the cargo.
[0065] If the comparator module 44 determines that the state of the cargo within the trailer 12 is unacceptable, then at step 64 the notification module 46 notifies the vehicle user by providing a warning notification to the HMI 28. The warning notification may include the display of live image data from the image capture device 26 via the display screen of the HMI 28. Alternatively, the warning notification may be the display of load data on the display screen of the HMI 28. In other embodiments an audible warning notification may be provided to the vehicle user.
[0066] In the embodiment described with reference to
[0067] In another embodiment of the invention, the notification module 46 is configured to determine whether it is safe to display the image capture device data to the vehicle user. The notification module 46 may be configured to prevent image capture device data being displayed to the vehicle user if the vehicle is in transit and the computer system 18 determines that the vehicle is changing lanes, for example.
[0068] As discussed previously, at step 52, the user may be presented with an option, via the user input interface of the HMI 28, to view the load data output of the pressure sensing device 22 on the display screen on request, rather than waiting for an unacceptable state of the cargo to be determined. If the user requests to view the load data at step 52, then at step 66 a signal is sent to the notification module 46 to transmit load data from the pressure sensing device 22 to the HMI display screen so that the user can view the load data output. Typically this takes the form of a load pattern representative of the pattern of pressure applied to the two dimensional area of the pressure mat 23.
[0069] If, at step 68, the user then requests that the image capture device data is viewed, a signal is sent to the image capture device 26 at step 70 to transmit the image capture device data to the HMI display screen also. Therefore, live image data from the image capture device may be displayed continuously to the vehicle user.
[0070] In another embodiment, when the comparator module 44 determines that the state of the cargo within the trailer 12 is unacceptable, the HMI 28 provides a signal, for example an audible signal, which prompts the vehicle user to consult the HMI display screen. This advantageously allows the user to monitor any cargo in the trailer 12 throughout an entire journey, but they need only pay close attention to the visual display of the HMI 28 when they are alerted by the audible warning notification.
[0071] If no request to view the image capture device data is received at step 68, the process loops back to the start so that load data is only transferred to the display until such time as the user requests to view image capture device data unless an unacceptable state of the cargo is determined which leads to the automatic transfer of image capture device data.
[0072] As mentioned above, in determining the acceptable states of the trailer 12, the determination module 42 may take into account various factors depending on the sophistication of the monitoring system. Some examples will now be described by way of illustration.
[0073] As part of the comparison step, the comparator module 44 may receive pre-determined acceptable load pattern states from the data store 40 for comparison with the monitored load pattern states from the pressure sensing device 23. The pre-determined acceptable states are determined prior to use of the vehicle 10 and may typically be loaded onto the data store 40 at the point of manufacture, or may be downloadable to the data store 40 when the user is performing an initial configuration of the vehicle 10. A means may be provided for the user to select appropriate pre-determined states prior to use of the vehicle 10, for example depending on the size or weight of the horse 17 being transported.
[0074] One example of an acceptable state may be when the location of the centre of gravity of the cargo is acceptable, i.e. when the centre of gravity of the cargo gives an acceptable nose weight resulting in a stable trailer. To determine if the state of the trailer corresponds to an acceptable centre of gravity state, the centre of gravity of the cargo can be calculated from the load pattern output, for example by integrating the load data with respect to distance from the centre of gravity of the trailer, and compared to a set of acceptable centre of gravity locations.
[0075] Another example of an acceptable state may be when the weight of the horse 17 is evenly distributed across the pressure sensing mat 23, which indicates the horse 17 has adopted a natural and comfortable stance and there is no sign of distress. Another acceptable state may be represented by all four hooves of the horse 17 exerting a pressure above a certain threshold on the pressure sensing mat 23 to indicate that the horse 17 has all four hooves firmly on the ground. This is because in an unacceptable state a horse 17 may raise one or even two hooves from the floor, in which case the load pattern would only indicate three or two points at which hoof pressure is applied. Another acceptable state may require that all four of the hoof positions experience an approximately equal pressure being applied.
[0076] In another embodiment of the invention (not shown), the comparison step may be based on the frequency of movement of the horse 17, rather than on the magnitude of the pressure being applied by the hooves to the mat 23. For example, for a given horse 17 it may be expected (acceptable) that in a given period there are a certain number of shifts in the load pattern as the horse 17 shifts its hooves. If, at the comparison step, it is determined that there are a greater number of shifts in the load pattern within a given period than would be expected/acceptable for the selected horse then the status of the trailer 12 is determined to be unacceptable and the vehicle user is alerted at step 58.
[0077] A further embodiment of the invention (not shown) takes account of the natural sway of the vehicle trailer 12 by adjusting the thresholds on the load pattern above which an unacceptable state is identified in response to the detected movement of the trailer 12. The IMU 24 is configured to determine the background motion of the trailer 12 for this purpose. The determination module 42 is configured to adjust or compensate the acceptable states to take into account the effect of this background movement as determined by the IMU 24. For example, if the trailer 12 is swaying more vigorously, this will have an impact on the load pattern measured by the IMU 24 as in such situations the horse 17 is likely to have more active hoof movement to steady itself, whereas if trailer sway is minimal the horse 17 is likely to adopt a more steady stance so that the magnitude of pressure applied across the mat 23 is lower. In other words, in situations where trailer sway is relatively high, an unacceptable state for the horse 17 would be identified by a load pattern which has a higher maximum pressure threshold than for minimal sway conditions.
[0078] Trailer sway may also be accounted for by adjusting the nature of the comparison between the acceptable states and the monitored load pattern. So, for example, in high sway conditions it may be less appropriate to look at the frequency of hoof movement in the load pattern, as under such conditions it would be expected that hoof movement would be relatively high. Instead, under high sway conditions it may be more appropriate to look at the maximum pressure that is detected in the load pattern, even if using a fixed maximum threshold level for all sway conditions.
[0079] In another embodiment, the acceptable states stored in the data store 40 may be based at least in part on the output of the pressure sensing device 22 during a period prior to the comparison step. So, for example, the system may be operable in a learning mode during which data is recorded by the monitoring system and the user initiates the storing of the data when the load pattern shows that the horse 17 is not distressed and is in a comfortable position/state. Once several acceptable states have been recorded in this way for a specific horse 17, the system is operable in the monitoring mode, as described above, with the acceptable states in the data store 40, to be used in the comparison step, being those which the user has recorded as being acceptable. The advantage of this is that the user, who has familiarity with the horse 17 being transported and the characteristics of the horse, is a good judge of those features of behaviour which could be deemed acceptable/unacceptable.
[0080] The system may be provided with a selection module 27 which forms part of the user input interface of the HMI 28. The selection module 27 allows the user to select the horse 17 which is being transported, for example from a list of different horse names which have been input previously. In this way, when in the learning mode, different acceptable state profiles may be built up for different horses, depending on the horse 17 being transported. When the system is operated in a monitoring mode, the user initially selects the name of the horse 17 being transported which consequently causes the relevant set of acceptable states to be selected in the data store 40 for comparison with the live load data output during transit.
[0081] The monitoring system of the invention is suitable for use whilst the vehicle 10 is in transit, and the horse 17 is being transported from one location to another. However, there are also circumstances in which it is necessary for the horse 17 to be left in the trailer 12 while the user leaves the vehicle 10. In this case, the system may be configured to provide the notification to the user wirelessly via a remote device 20, such as a mobile telephone or a tablet. The method described with reference to
[0082] The invention is not limited to the transportation of horses, nor indeed livestock, and is applicable in general to the transportation of any cargo, especially where that cargo is not immediately visible to the driver of the vehicle. For example, the monitoring system may be used to monitor the transportation of vehicles on a vehicle transporter, or to removal vans transporting furniture or large objects. In any case, the system is operable in a learning mode whereby the user of the vehicle can pre-store acceptable states for a specific type of cargo, which can then be selected for use in the monitoring mode at a later time.
[0083] In general, for cargo other than livestock, the acceptable state of the cargo may be defined as a state in which the cargo within the cargo holding area will not cause danger for the vehicle user or damage to the cargo or the vehicle. The threshold on the load pattern which is deemed to be an acceptable maximum pressure threshold may be adjustable by the user depending on the nature of the cargo being transported. So, for example, for more fragile cargo, such as glass objects or expensive furniture, the acceptable maximum pressure threshold may be lower. The selection module 27 may be configured to allow the user to select the appropriate maximum pressure threshold level depending on the nature of the cargo being transported. In another embodiment, the system includes a cargo determination module so that once the cargo is loaded, a determination of the size and/or weight and/or standing pressure applied by the cargo to the pressure mat 23 is used to determine the nature of the cargo being transported. For example, in a furniture delivery vehicle, such indicators may be used to distinguish between large, heavy objects with a steady footprint, and relatively lightweight, unsteady objects with a small footprint objects, such as lamps and smaller furniture. The acceptable states of the cargo within the cargo holding area may be defined by acceptable variations in the centre of gravity of the cargo from an initial centre of gravity determination. These acceptable variations may be determined according to the nature of the cargo.
[0084] It will be appreciated by a person skilled in the art that the invention could be modified to take many alternative forms without departing from the scope of the appended claims.