Vehicle imaging system and method

Abstract

The present disclosure relates to a vehicle imaging system (1). More particularly, the present disclosure relates to a video data transmitter (3) for use with a vehicle (V). The video data transmitter (3) comprises a camera (5) for generating video data (D.sub.V). An image processor (15) is configured to process the video data (D.sub.V) and a transmitter (14) is provided to transmit the processed video data (D.sub.VP) to a video data receiver (2). The image processor (15) is configured to process the video data (D.sub.V) in dependence on one or more operating parameter of the vehicle (V). The present disclosure also relates to a video data receiver (2); and to a method of controlling transmission of video data (D.sub.V).

Claims

1. A video data transmitter for use with a vehicle, the video data transmitter comprising: a camera for generating video data; an image processor configured to process the video data; a receiver for receiving one or more control signal from a video data receiver to control processing of the video data prior to transmission, the one or more control signal being generated in dependence on a reference speed of the vehicle and in dependence on an available bandwidth of video data transmission; and a transmitter for transmitting the processed video data to the video data receiver which is remote from the video data transmitter; wherein the image processor is configured to modify a response time of the video data in dependence on the one or more control signal received from the video data receiver such that modifying the response time of the video data is performed in dependence on both the reference speed of the vehicle and the available bandwidth; wherein the image processor is configured to modify the video data to provide a longer response time when the vehicle is reversing; wherein the image processor is further configured to modify the response time in dependence on a hitch angle of the trailer.

2. The video data transmitter as claimed in claim 1, wherein processing the video data further comprises reducing a size of the video data to enable transmission within the available bandwidth.

3. The video data transmitter as claimed in claim 1, wherein processing the video data further comprises discarding a portion of the video data in dependence on the reference speed of the vehicle or compressing the video data in dependence on the reference speed of the vehicle.

4. The video data transmitter as claimed in claim 1, wherein the image processor is configured to: modify the video data to provide a shorter response time when the vehicle reference speed is greater than or equal to an upper speed threshold; modify the video data to provide a longer response time when the vehicle reference speed is no more than a lower speed threshold; and modify the video data to provide an intermediate response time when the vehicle reference speed is greater than the lower speed threshold and less than the upper speed threshold.

5. The video data transmitter as claimed in claim 1, wherein the image processor is configured to analyse the video data to determine the reference speed of the vehicle.

6. A trailer for coupling to a vehicle, wherein the trailer comprises the video data transmitter of claim 1.

7. A video data receiver for a vehicle, the video data receiver comprising: a processor configured to receive a reference speed of the vehicle and to modify a response time of the video data in dependence on the reference speed of the vehicle, wherein the processor is configured to modify the video data to provide a longer response time when the vehicle is reversing; a receiver for receiving processed video data transmitted wirelessly from one or more video data transmitter, the one or more video data transmitter being remote from the receiver; and a transmitter for transmitting a control signal to the one or more video data transmitter; wherein the processor is configured to generate the control signal in dependence on the reference speed of the vehicle and in dependence on an available bandwidth of video data transmission to control modification of the response time of the video data prior to transmission; wherein the processor is further configured to modify the response time in dependence on a hitch angle of the trailer.

8. A vehicle comprising the video data receiver of claim 7.

9. A method of controlling transmission of video data from a video data transmitter to a video data receiver disposed in a vehicle, the method comprising: receiving one or more control signal from the video data receiver to control processing of the video data prior to transmission, the one or more control signal being generated in dependence on a reference speed of the vehicle and in dependence on an available bandwidth of video data transmission; generating video data; processing the video data comprising modifying a response time of the video data; and transmitting the processed video data wirelessly to the video data receiver which is remote from the transmitter; wherein the video data is processed in dependence on the one or more control signal received from the video data receiver such that the modifying of the response time of the video data is performed in dependence on the reference speed of the vehicle and the available bandwidth, wherein the processing includes modifying the video data to provide a longer response time when the vehicle is reversing, wherein the processing further includes modifying the response time in dependence on a hitch angle of the trailer.

10. The method as claimed in claim 9, wherein processing the video data further comprises reducing a size of the video data to enable transmission within the available bandwidth.

11. The method as claimed in claim 9, wherein processing the video data further comprises discarding a portion of the video data in dependence on the reference speed of the vehicle, or compressing the video data in dependence on the reference speed of the vehicle.

12. The method as claimed in claim 9, further comprising: modifying the video data to provide a shorter response time, when the vehicle reference speed is greater than or equal to an upper speed threshold; modifying the video data to provide a longer response time when the vehicle reference speed is no more than a lower speed threshold; and modifying the video data to provide an intermediate response time when the vehicle reference speed is greater than the lower speed threshold and less than the upper speed threshold.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

(1) One or more embodiments of the present invention will now be described, by way of example only, with reference to the accompanying figures, in which:

(2) FIG. 1 illustrates schematically a vehicle and a trailer incorporating a vehicle imaging system in accordance with an embodiment of the present invention; and

(3) FIG. 2 illustrates schematically the vehicle imaging system shown in FIG. 1.

DETAILED DESCRIPTION

(4) A vehicle imaging system 1 in accordance with an embodiment of the present invention will now be described with reference to FIGS. 1 and 2. The vehicle imaging system 1 has particular application in a vehicle V towing a trailer T (referred to in combination as a rig). The vehicle V in the present embodiment is an automobile or a utility vehicle. However, it will be appreciated that the vehicle imaging system 1 may be incorporated into other types of vehicle, such as a tractor unit and a trailer.

(5) The terms “front” and “rear” are used herein in their conventional sense when defining the relative position of features on the vehicle V and the trailer T. The terms “rear-facing” and “rear-view” are used herein to refer to a position or orientation which is in a direction towards the back of the vehicle V or the trailer T.

(6) As shown in FIG. 2, the vehicle imaging system 1 comprises a video data receiver 2, a video data transmitter 3, and a display screen 4. The video data transmitter 3 comprises a camera 5, typically in the form of an optical video camera 5, which generates video data D.sub.V for transmission to the video data receiver 2. In use, the video data receiver 2 and the video data transmitter 3 are remote from each other and the video data D.sub.V is transmitted wirelessly. The video data D.sub.V is digital video data which is encoded by the video data transmitter 3 for transmission; and decoded by the video data receiver 2 for output to the display screen 4.

(7) The video image is displayed on the display screen 4 at least substantially in real-time. As described herein, the video data receiver 2 is configured to output a control signal S.sub.1 to control the transmission of the video data D.sub.V. The control signal S.sub.1 is generated in dependence on one or more operating parameter of the vehicle V and/or an operating mode of the vehicle V. The video data transmitter 3 processes the video data D.sub.V to control the transmission bit-rate in dependence on the control signal S.sub.1. In order to vary the bandwidth required for the transmission, the video data transmitter 3 may modify the video data D.sub.V to alter one or more characteristic of the video image output to the display screen 4. Alternatively, or in addition, the video data transmitter 3 may implement a compression algorithm to compress the video data D.sub.V. The video data transmitter 3 processes the video data D.sub.V prior to transmission (known as source coding). The vehicle imaging system 1 may thereby compensate for signal attenuation and/or multipath distortion which would otherwise prevent or delay the transmission of the video data D.sub.V at full quality.

(8) The video data receiver 2 is disposed in the vehicle V and comprises a central processing unit 6 and a radio frequency (RF) transceiver 7. The central processing unit 6 comprises at least one electronic processor 8 coupled to system memory 9. The electronic processor 8 is configured to execute a set of software instructions held in the system memory 9. The transceiver 7 is connected to a vehicle-mounted antenna 10 for transmitting and receiving RF signals. The electronic processor 8 is configured to generate the control signal S.sub.1 in dependence on one or more operating parameter of the vehicle V and/or an operating mode of the vehicle. The electronic processor 8 is coupled to a vehicle communication bus 11, such as a vehicle CAN bus, and monitors the operating parameters of the vehicle V. In the present embodiment the electronic processor 8 is configured to read a vehicle reference velocity V.sub.REF published to the vehicle communication bus 11. The vehicle reference velocity V.sub.REF is generated in conventional manner in dependence on a wheel speed signal generated by one or more rotational speed sensor 12. The control signal S.sub.1 is output to the transceiver 7 and transmitted to the video data transmitter 3 to control the transmission of the video data D.sub.V. It will be appreciated that the control signal S.sub.1 may be generated in dependence on other operating parameters. For example, the electronic processor 8 may generate the control signal S.sub.1 in dependence on a vehicle yaw angle or a rate of change of the vehicle yaw angle. The yaw angle may be measured directly by an on-board accelerometer; or measured indirectly by a steering angle.

(9) The video data transmitter 3 in the present embodiment is mounted to the trailer T. The camera 5 is disposed in a rear-facing orientation at the rear of the trailer T. The camera 5 is coupled to a remote control unit 13 and a remote transceiver 14. The camera 5 is operable to generate video data D.sub.V of a region behind the trailer T. The remote transceiver 14 transmits (streams) the video data D.sub.V to the video data receiver 2 using a suitable wireless communication standard, such as Wi-Fi®. The remote control unit 13 comprises at least one image processor 15 coupled to local memory 16. The remote transceiver 14 comprises a remote antenna 17 which is mounted to the trailer T in the present embodiment. The image processor 15 is configured to process the video data D.sub.V prior to transmission (i.e. at source). The image processor 15 thereby functions as a digital video codec to encode the video data D.sub.V prior to transmission. The image processor 15 may modify the video data D.sub.V to change the resolution of the image (i.e. the number of pixels making up the image); and/or a colour content (or colour depth) of the image; and/or a response time (latency) of the image; and/or a frame rate of the image. The image processor 15 may modify the video data D.sub.V at source by discarding some of the video data D.sub.V in dependence on the one or more dynamic operating parameter of the vehicle V. The image processor 15 outputs processed video data D.sub.VP which may have a smaller size than the source video data D.sub.V. By modifying the video data D.sub.V, the remote control unit 13 may reduce the quantity of data transmitted to the video data receiver 2. The processed video data D.sub.VP may be transmitted within the available bandwidth. The type and/or extent of processing performed by the image processor 15 is controlled by the control signal S.sub.1. The characteristics of the video image displayed on the display screen 4 are thereby modified in dependence on the operating parameters of the vehicle V.

(10) Alternatively, or in addition, the image processor 15 may implement a compression algorithm to compress the video data D.sub.V prior to transmission. The compression of the video data D.sub.V may increase the response time (i.e. increased latency) of the imaging system 1. Thus, the compression performed on the video data D.sub.V may also be controlled in dependence on one or more operating parameter of the vehicle V. The image processor 15 may adjust a compression factor applied by the compression algorithm to compress the video data D.sub.V in dependence on the control signal S.sub.1. The image processor 15 may perform high data compression when a high framerate is required but a low image quality (typically a low image resolution) is acceptable. The image processor 15 may perform low data compression when a low framerate is acceptable but high image quality (typically a high image resolution) is required. The processed video data D.sub.VP is output by the image processor 15.

(11) The processing of the video data D.sub.V by the image processor 15 is performed in dependence on the vehicle operating mode and notably the vehicle reference speed V.sub.REF. The degree of reduction of the response time, resolution and colour content will be balanced according to the operating mode and speed. The control signal S.sub.1 is generated to ensure that the display characteristics of the video image reflect the dynamic operation of the vehicle. The operation of the image processor 15 in dependence on the control signal S.sub.1 in different vehicle operating scenarios will now be described.

(12) The image processor 15 processes the video data D.sub.V to provide a longer response time (increased latency) and a lower frame rate when the vehicle reference speed V.sub.REF is below a lower speed threshold. The image processor 15 may also maintain a high colour content and a high resolution of the video data D.sub.V. The lower speed threshold may be defined to correspond to a scenario when the vehicle V and the trailer T are travelling at a relatively low speed. The lower speed threshold may be predefined, for example as 20 mph (approximately 30 km/h). This functionality may also be implemented when the vehicle V is reversing. In this operating mode when the vehicle is reversing, the system may transmit high-quality images with a relatively low frame rate, as it may be preferable to provide a driver with a clear view of the area behind the trailer but, as the vehicle will be moving at a relatively low speed, a low update rate may be acceptable.

(13) The image processor 15 processes the video data D.sub.V to provide a shorter response time (reduced latency) and a higher frame rate when the vehicle reference speed V.sub.REF is above an upper speed threshold. The image processor 15 may maintain a medium colour content and lower the resolution of the video data D.sub.V. The upper speed threshold may be predefined, for example as 60 mph (approximately 100 km/h).

(14) When the vehicle V and the trailer T are travelling at a moderate speed, the image processor 15 processes the video data D.sub.V to provide an intermediate (medium) response time, an intermediate (medium) frame rate, a relatively high colour content and a relatively low image resolution. The moderate speed may be predefined, for example when the vehicle reference speed is above the lower speed threshold and below the upper speed threshold. In the present embodiment this corresponds to a vehicle reference speed V.sub.REF greater than 20 mph (approximately 30 km/h) and less than 60 mph (approximately 100 km/h).

(15) In use, the camera 5 outputs the source video data D.sub.V to the image processor 15. The image processor 15 outputs processed video data D.sub.VP which is transmitted to the video data receiver 2. The video data receiver 2 decodes the processed video data D.sub.VP and outputs a video signal to the display screen 4. The video image is displayed to provide the vehicle driver of a substantially real-time view of the region behind the trailer T.

(16) A further embodiment will now be described. This embodiment is a development of the embodiment described above and like reference numerals are used for like features. The imaging system 1 comprises a video data receiver 2 and a video data transmitter 3. The video data transmitter 3 is modified in this arrangement such that the image processor 15 is configured to analyse the video data D.sub.V to determine one or more dynamic operating parameters of the vehicle V. The image processor 15 may identify one or more element represented by the video data D.sub.V. The image processor 15 may track movement of said element(s) over a period of time to determine one or more operating parameter of the vehicle V. By way of example, the image processor 15 may estimate the speed at which the vehicle is travelling and output an estimated vehicle reference speed V.sub.REF to the image processor 15. The image processor 15 processes the video data D.sub.V in dependence on the one or more operating parameter determined by the image processor 15. The processing of the video data D.sub.V corresponds to that described above in the previous embodiment. It will be appreciated that in this embodiment it is not necessary for the video data receiver 2 to transmit the control signal S.sub.1 to the video data transmitter 3.

(17) It will be appreciated that various changes and modifications may be made to the imaging system 1 described herein without departing from the scope of the present invention.

(18) The control signal S.sub.1 may comprise said one or more vehicle operating parameter. Thus, the video data receiver 2 may be configured to transmit the one or more vehicle operating parameter to the video data transmitter 3. The image processor 15 may process the video data D.sub.V directly in dependence on the one or more received vehicle operating parameter.

(19) A further operating mode of the vehicle may comprise the vehicle being stationary and locked, in a sleep mode, and appropriate vehicle parameters identifying this mode may be transmitted to the video data transmitter 3. In this mode, the video data transmitter may obtain high-quality images, that is the video data D.sub.V has a high colour content and a high resolution, at relatively long time intervals, for example once per second, and transmit the video data to the video data receiver. In this mode, the system 1 will act as a security system, for example acquiring clear images of people approaching the vehicle or trailer.

(20) In another operating mode, the vehicle may be parked but not in a sleep mode. In this operating mode, the video data transmitter may continue to transmit video data from the camera to the video data receiver, to enable a driver or operator to monitor the area behind the trailer, for example to observe loading or unloading of the trailer.

(21) The vehicle parameters or vehicle operating mode may relate to any other parameter or circumstance, such as detecting off-road operation, whether automatically or through user selection of an off-road driving mode.

(22) In the embodiments described herein, the video data D.sub.V is processed in dependence on one or more vehicle operating parameter. The video data receiver 2 may provide feedback to the video data transmitter 3 relating to signal strength and/or signal attenuation. For example, the video data receiver 2 and the video data transmitter 3 may communicate with each other to determine the available bandwidth. Ideally, the available bandwidth enables the system to capture high-quality images at the full available rate from the camera. However, where the bandwidth available falls, the system 1 selects a suitable compromise between image quality and image rate depending on the vehicle operating mode and vehicle operating parameter. The available bandwidth may be determined using any suitable method, which may be inherently provided in the transceivers 7, 14. This may comprise detecting signal strength, as is known for wifi systems, or detecting an error rate in transmitted data, or in any other suitable manner. In this arrangement, the image processor 15 may process the video data D.sub.V in dependence on said one or more vehicle operating parameter and also the available bandwidth.

(23) The vehicle imaging system 1 described herein may be calibrated in dependence on additional factors, such as the relative positions of the video data receiver 2 and the video data transmitter 3. The relative positions may be estimated, for example based on a length of the trailer T. Alternatively, the relative positions may be determined, for example using triangulation techniques to determine the position of the data transmitter 3. A calibration process may be performed initially or periodically to check signal integrity. The vehicle imaging system 1 may be configured to compensate for a poor signal, for example by reducing the image resolution. Other checks may be made, for example of ambient light levels, so that, in low light levels, a longer exposure time at the camera may be required and consequently a lower frame rate imposed on the system 1.

(24) The method and apparatus according to the present invention have been described herein with reference to video data D.sub.V generated by the camera 5. It will be appreciated that the method and apparatus may also be applied to audio data generated by a microphone.