Panoramic View System for a Vehicle

Abstract

A panoramic view system for a vehicle includes at least one real camera (2) for capturing an image of the surroundings of the vehicle from non-centered position, a virtual camera (7), an image processing unit, and a display unit which is configured to represent, in a projected manner, the image captured by the real camera (2) and at least one geometric form (11 to 13) as an overlay over the captured image. The image processing unit is configured to project the captured image onto a first plane (9) perpendicular to the real camera (2) such that perspective distortions in the captured image resulting from the non-centered position of the real camera (2) are distortion-corrected, and to project the at least one geometric form (11 to 13) onto a second plane (10) perpendicular to the virtual camera (7) such that the at least one geometric form (11 to 13) is represented in an undistorted manner on the display unit (4). The image processing unit is configured to find an affine transformation (T) between the first plane (9) and the second plane (10) by a delta transformation between the real camera (2) and the virtual camera (7), and to apply the affine transformation (T) to the first plane (9) which contains the projected and distortion-corrected captured image (8) such that a modified representation (8) of the distortion-corrected captured image (8) is aligned with the at least one undistorted geometric form (11 to 13) in the second plane (10).

Claims

1. A panoramic view system for a vehicle, the panoramic view system comprising at least one real camera configured to capture an image of surroundings of the vehicle from a non-centered position, a virtual camera, an image processing unit, and a display unit, wherein the display unit is configured to represent, in a projected manner, the image captured by the real camera, and at least one geometric form as an overlay over the image captured by the real camera, and wherein the image processing unit is configured: to project the image captured by the real camera onto a first plane that is perpendicular to the real camera so that perspective distortions in the image captured by the real camera resulting from the non-centered position of the real camera are distortion-corrected, to project the at least one geometric form onto a second plane that is perpendicular to the virtual camera so that the at least one geometric form is represented in an undistorted manner on the display unit, to find an affine transformation between the first plane and the second plane by a delta transformation between the real camera and the virtual camera, and to apply the affine transformation to the first plane that contains the projected and distortion-corrected image captured by the real camera so that a modified representation of the distortion-corrected image captured by the real camera is aligned with the at least one undistorted geometric form in the second plane.

2. A vehicle comprising a vehicle body and the panoramic view system according to claim 1, wherein the real camera is mounted non-centrally on the vehicle body.

3. A method of representing a panoramic view of surroundings of a vehicle, the method comprising the steps: capturing an image of the surroundings of the vehicle with a real camera from a non-centered position, projecting the image captured by the real camera onto a first plane that is perpendicular to the real camera so that perspective distortions in the image captured by the real camera resulting from the non-centered position of the real camera are distortion-corrected in a projected representation of the image on a display unit, projecting at least one geometric form as an overlay onto a second plane that is perpendicular to the virtual camera so that the at least one geometric form is represented in an undistorted manner on the display unit, finding an affine transformation between the first plane and the second plane by a delta transformation between the real camera and the virtual camera, and applying the affine transformation to the first plane that contains the projected and distortion-corrected image captured by the real camera so that a modified representation of the distortion-corrected image captured by the real camera is aligned with the at least one undistorted geometric form in the second plane.

4. A program element which, when executed on a processor, instructs the processor to perform the method according to claim 3.

5. A computer-readable medium, on which is stored the program element according to claim 4.

Description

[0018] Embodiment examples of the invention are explained in greater detail below with reference to the schematic drawing, wherein:

[0019] FIG. 1 shows a side view of a vehicle having one embodiment example of a panoramic view system according to the invention,

[0020] FIG. 2 shows a considerably simplified top view of the vehicle in accordance with FIG. 1, and

[0021] FIG. 3 shows a fundamental representation of a possible mode of Operation of the panoramic view system in accordance with FIG. 1.

[0022] FIGS. 1 and 2 show a vehicle 1 in the form of a motor vehicle. The vehicle 1 comprises at least one digital physical or real camera 2, an image processing unit 3 and a display unit 4 in the form of a monitor within the vehicle 1 in a field of vision of a user who is not shown. The image processing unit 3 is communicatively connected to the real camera 2 and to the display unit 4 such that the real camera 2 can transmit image data representing captured images to the image processing unit 3 which can, in turn, process the received image data and can transfer the processed image data to the display unit 4. Alternatively, the image processing unit 3 can also be integrated into the real camera 2 or the display unit 4.

[0023] The vehicle 1 is moving on a road 5 and the real camera 2 is mounted on the vehicle 1 in such a way that the real camera 2 can capture images of a region ahead 6 in the external surroundings of the vehicle 1. As can be seen from FIG. 2, the real camera 2 is mounted non-centrally on the vehicle 1. In FIG. 2, a longitudinal axis L of the vehicle 1 is represented, wherein the real camera 2 is mounted laterally offset next to the longitudinal axis L of the vehicle 1 on the vehicle 1. Furthermore, FIG. 2 shows that the real camera 2 can be mounted on the vehicle obliquely, i.e. not parallel to the longitudinal axis L of the vehicle 1. The real camera 2, the image processing unit 3 and the display unit 4 together form the panoramic view system of the vehicle 1, wherein the image processing unit 3 additionally produces a virtual camera 7 which does not exist.

[0024] FIG. 3 shows how an image of the surroundings 6 of the vehicle 1 captured by the real camera 2 can be processed, in order to be represented on the display unit 4 of the vehicle 1 in an all-round image of the vehicle 1. The image captured by the real camera 2 contains multiple objects, wherein one of these objects 8 is represented considerably schematically in FIG. 3. The object 8 can be, for example, a bumper of a further vehicle (not represented) in the region ahead of the vehicle 1. Although the mode of operation of the panoramic view system is explained below with reference to the object 8, these explanations equally apply to the remaining objects (not shown) which are contained in the image captured by the real camera 2.

[0025] The image captured by the real camera 2 having the object 8 is projected onto a first surface or plane 9 which is perpendicular to the real camera 2 such that perspective distortions in the image captured by the real camera 2 resulting from the non-centered position of the real camera 2 are distortion-corrected. In this way, a first modified representation 8 of the object 8 is created within the first plane 9. The image contents of the first plane 9 are not represented on the display unit 4 of the vehicle 1, but rather the image contents of a second plane 10 which is explained below.

[0026] The image processing unit 3 projects at least one geometric form 11 to 13 as an overlay onto the second plane 10 which is perpendicular to the virtual camera 7 such that the second plane 10 having the at least one geometric form 11 to 13 is represented in an undistorted manner on the display unit 4 of the vehicle 1. Three geometric forms which describe a planned trajectory of the vehicle 1 are shown by way of example in FIG. 3.

[0027] Furthermore, the image processing unit 3 finds an affine transformation T between the first plane 9 and the second plane 10 by means of a delta transformation between the real camera 2 and the virtual camera 7, and applies the found affine transformation T to the first plane 9 which contains the first modified representation 8 of the object 8. In this way, a second modified representation 8 of the object 8 is created within the second plane 10, wherein this second modified representation 8 is aligned with the at least one undistorted geometric form 11 to 13 in the second plane 10. The second plane having the modified representation 8 of the object 8 and the geometric forms 11 to 13 is represented on the display unit 4.