SYSTEM CONFIGURED TO SELECT A PORTION OF A VIRTUAL SCENARIO DURING THE MOVEMENT OF A VEHICLE WITHIN A GEOGRAPHICAL AREA OF INTEREST
20230116134 · 2023-04-13
Inventors
- Guido Ernesto FARACO (Ferentino, IT)
- Giorgio CAPACI (Ferentino, IT)
- Augusto Alfonso Maria ANGELETTI LATINI (Ferentino, IT)
- Lorenzo RAFFI (Ferentino, IT)
Cpc classification
G01C21/3679
PHYSICS
G01C21/365
PHYSICS
H04N21/41422
ELECTRICITY
G01S19/47
PHYSICS
G01C21/183
PHYSICS
International classification
Abstract
The present invention relates to a system (1) configured to select a portion of a virtual scenario (S1v,S2v) during the movement of a vehicle (V) within a geographical area of interest (A). Said system (1) is capable of obtaining information associated with the vehicle (V) regarding the position, the rotation with respect to the x, y, z axes of a reference system associated with the vehicle itself, as well as the heading, and applying this information to a virtual geographical area (Av) associated with said geographical area of interest (A), so that each movement of the vehicle (V) in the geographical area of interest (A) corresponds to a respective movement in the virtual geographical area (Av). In this way, the viewing of a virtual scenario (S1V, S2V) changes according to the movement of the vehicle. The present invention relates also to a vehicle (V) comprising said system, as well as to a method for selecting a portion of a virtual scenario during the movement of a vehicle (V) within a geographical area of interest (A) by means of said system.
Claims
1. System configured to select a portion of a virtual scenario (S1v, S2v) during the movement of a vehicle (V) within a geographical area of interest (A), wherein said virtual scenario (S1v, S2v) comprises a 3D graphic content or a 3D graphic content in combination with an audio content, said system comprising: at least one inertial measurement unit (2), to be install on said vehicle (V), comprising: an accelerometer (22) to acquire in each time instant t a respective triad of values associated with linear accelerations A.sub.X,A.sub.Y,A.sub.Z along the x, y, z axes, a magnetometer (23) to measure at each time instant t the values of a respective vector m=[m.sub.x,m.sub.y,m.sub.z] associated with the terrestrial magnetic field strength along the x,y,z axes, at least one geolocation device (3), to be install on said vehicle (V), to obtain at each time instant t the geographical coordinates LAT.sub.V, LONG.sub.V in terms of latitude and longitude values associated with said vehicle (V), storage means (4) in which the following data are stored: said geographical area of interest (A), where each point of said geographical area of interest (A) is associated with a value of latitude and a value of longitude, and a Cartesian plane x.sub.A,y.sub.A is associated with said geographical area of interest (A), so that each point of said geographical area of interest (A) corresponds to a respective point on said Cartesian plane x.sub.A,y.sub.A, the position of a first point (P1) identified by first Cartesian coordinates x.sub.P.sub.
LAT.sub.DIF=LAT.sub.P1−LAT.sub.P2
LONG.sub.DIF=LONG.sub.P1−LONG.sub.P2
X.sub.DIF=X.sub.P1.sup.x.sup.
Y.sub.DIF=Y.sub.P1.sup.y.sup.
2. System according to the previous claim, wherein said logic control unit (5) is configured to generate a frame associated with said selected portion by means of a 3D rendering engine.
3. System according to any one of the previous claims, characterized in that said pitch angle θ, said roll angle γ and said heading ϕ are calculated by means of the following formulas:
4. System according to the previous claim, characterized in that the logic control unit (5) is configured to obtain the horizontal component m.sub.x.sup.l along the x axis and the horizontal component m.sub.z.sup.l along the z axis of said terrestrial magnetic field strength by means of the following formula:
5. System according to any one of the previous claims, characterized in that said geographical area of interest (A) has the shape of a rectangle or square, in that said first point (P1) and said second point (P2) are arranged at a respective vertex of said rectangle or of said square and said vertices are arranged along a diagonal of said rectangle or of said square.
6. System according to any one of the previous claims, characterized in that said at least one inertial measurement unit (2) comprises a gyroscope (21) for acquiring at each time instant t a respective triad of values associated with the angular velocities ω.sub.X,ω.sub.Y,ω.sub.Z along the x,y,z axes, in that said logic control unit (5) is configured to: acquire at each time instant t from said inertial measurement unit (2) the values of each triad of angular velocities ω.sub.X,ω.sub.Y,ω.sub.Z along the x, y, y axes, create a respective state vector X.sub.k1=[q.sub.1,w.sub.1], X.sub.k2=[q.sub.2,w.sub.2], X.sub.k3=[q.sub.3,w.sub.3], . . . X.sub.kn=[q.sub.n,w.sub.n] in each time instant t.sub.1, t.sub.2 . . . t.sub.n, where q.sub.1=[q.sub.w1, q.sub.x1,q.sub.y1, q.sub.z1], q.sub.2=[q.sub.w2, q.sub.x2, q.sub.y2, q.sub.z2], q.sub.3=[q.sub.w3,q.sub.x3,q.sub.y3,q.sub.z3] . . . q.sub.n=[q.sub.wn, q.sub.xn, q.sub.yn, q.sub.zn] are respective quaternions in respective time instants t.sub.1, t.sub.2, t.sub.3 . . . t.sub.n, each of which is obtained from said pitch angle θ, said roll angle γ and from said heading ϕ in a respective time instant t.sub.1, t.sub.2, t.sub.3 . . . t.sub.n, w.sub.1=[w.sub.x1, w.sub.y1, w.sub.z1], w.sub.2=[w.sub.x2, w.sub.y2, w.sub.z2] . . . w.sub.3=[w.sub.x3,w.sub.y3,w.sub.z3] . . . w.sub.n=[w.sub.xn,w.sub.yn,w.sub.zn] are respective triads of angular velocities in respective time instants t.sub.1, t.sub.2, t.sub.3 . . . t.sub.n, where the information associated with said pitch angle θ, said roll angle γ and said heading ϕ are contained in each quaternion q.sub.1,q.sub.2 . . . q.sub.n.
7. System according to the previous claim, characterized in that each quaternion from the quaternion q.sub.2 at the time instant t.sub.2 to the quaternion q.sub.n at the time instant t.sub.n is obtained by applying an extended Kalman filter to the quaternion at the previous time instant:
q.sub.2=q.sub.1′=[q.sub.w1′,q.sub.x1′,q.sub.y1′,q.sub.z1′],
q.sub.3=q.sub.2′
. . .
q.sub.n=q.sub.n-1′
8. System according to any one of the previous claims, characterized in that said logic control unit (5) is configured to verify whether the geographical coordinates LATV,LONGV of said vehicle (V) are contained in said geographical area of interest (A), and calculate the Cartesian coordinates with respect to the Cartesian plane xA,yA only if the geographical coordinates LATV,LONGV associated with said vehicle (V) are contained in the geographical area of interest (A).
9. System according to any one of the previous claims, characterized in that said geolocation device (3) is a GNSS receiver.
10. Vehicle (V) comprising a system according to any of the previous claims, wherein said vehicle (V) comprises at least one displaying device (D) for displaying said virtual scenario (S1v, S2v).
11. Vehicle (V) according to the previous claim, characterized in that said vehicle (V) is provided with one or more windows (W) and said at least one display device (D) is arranged inside said vehicle (V) so as to face at least one portion of one of said window (W).
12. Vehicle (V) according to the previous claim, characterized in that said at least one displaying device (D) comprises a display made of a transparent material, in that said vehicle (V) comprises filtering means (L) to filter a percentage of light radiation with respect to a light radiation coming from the external environment and incident on one or more windows (W), arranged between said one or more windows and said at least one display device (D).
13. Vehicle (V) according to the previous claim, characterized in that said percentage of light radiation is between 80% and 100%.
14. Vehicle (V) according to claim 12 or 13, characterized in that said display made of a transparent material is a transparent OLED display.
15. Vehicle (V) according to any one of claims 12-14, characterized in that said filtering means (L) comprise a respective blackout curtain for each window (W).
16. Method for selecting a portion of a virtual scenario (S1v, S2v) during the movement of a vehicle (V) within a geographical area of interest (A), through a system according to any one of the claims 1-9, said method comprising the following steps: A) acquiring at each time instant t the values of each triad of linear accelerations A.sub.X,A.sub.Y,A.sub.Z, as well as the values of each vector m=[m.sub.x, m.sub.y, m.sub.z] associated with the terrestrial magnetic field strength, B) calculating a pitch angle θ and a roll angle γ associated with said vehicle (V) on the basis of said values associated to the linear accelerations A.sub.X,A.sub.Y,A.sub.Z, as well as a heading ϕ, expressed in terms of angle, on the basis of horizontal components of said terrestrial magnetic field strength, C) acquiring at each time instant t the geographical coordinates LAT.sub.V,LONG.sub.V associated with said vehicle (V), D) calculating the Cartesian coordinates identifying the position of said vehicle (V) with respect to the Cartesian plane x.sub.A,y.sub.A by means of the following formulas:
17. Method according to the previous claim, wherein the method comprises the following step: G) generating a frame associated with said selected portion by means of a 3D rendering engine.
18. Computer program comprising instructions which, when the program is executed by a computer, cause the computer to carry out the steps of the method according to claim 16 or 17.
19. Computer-readable storage medium comprising instructions which, when executed by a computer cause the computer to carry out the steps of the method according to claim 16 o 17.
Description
ATTACHED FIGURE LIST
[0047] The present invention will be now described, for illustrative, but not limitative purposes, according to its embodiment, making particular reference to the enclosed figures, wherein:
[0048]
[0049]
[0050]
[0051]
[0052]
[0053]
[0054]
DETAILED DESCRIPTION OF THE INVENTION
[0055] With reference to Figures, a system 1 configured to select a portion of a virtual scenario during the movement of a vehicle V within a geographical area of interest A.
[0056] In the embodiment being disclosed, said virtual scenario is associated to a real scenario in said geographical area of interest.
[0057] In other words, in the embodiment being disclosed, the virtual scenario is a 3D modelling of the real scenario surrounding the vehicle.
[0058] However, said virtual scenario can be a 3D modelling of any “environment” which is not connected to the real scenario surrounding the vehicle V.
[0059] The geographical area of interest A is established before the system is used.
[0060] Consequently, the real scenario contained in said geographical area of interest is known: routes, square, monuments, churches, fountains, obelisk, etc.
[0061] Thus, the routes, the squares, the monuments, the churches, the fountains, the obelisk, etc. present in said geographical area of interest are the elements that constitute or are included in said real scenario.
[0062] The virtual scenario is a 3D modelling of the real scenario and can comprise each element being part of said real scenario.
[0063] More particularly, said virtual scenario can comprise or consist of a 3D graphic content or a 3D graphic content associated to each element being part of the real scenario.
[0064] Furthermore, such 3D modelling can be in combination with an audio content.
[0065] Said system 1 is installable on said vehicle V and a reference system x,y,z is associated with said vehicle V.
[0066] In the example being disclosed, the x axis and the y axis define the plane on which said vehicle V moves.
[0067] Furthermore, in the example being disclosed, said vehicle V is a minibus.
[0068] As shown in
LAT.sub.DIF=LAT.sub.P1−LAT.sub.P2
LONG.sub.DIF=LONG.sub.P1−LONG.sub.P2
X.sub.DIF=X.sub.P1.sup.x.sup.
Y.sub.DIF=y.sub.P1.sup.y.sup.
[0081] Regarding to the values associated with the linear accelerations A.sub.X,A.sub.Y,A.sub.Z along the x,y,z axes and to the vector m=[m.sub.x, m.sub.y, m.sub.z] associated with the terrestrial magnetic field strength along the x,y,z axes, the values of said linear accelerations and the values of said terrestrial magnetic field strength are measured with respect to the reference system x,y,z associated with the vehicle V on which the system is installed.
[0082] As will be explained in detail below, said geographical area of interest A has the shape of a quadrilateral, preferable the shape of a rectangle or a square, and said first point P1 and said second point P2 are arranged at a respective vertex of said rectangle or said square and said vertices are arranged along a diagonal of said rectangle or said square.
[0083] Furthermore, in the embodiment being disclosed, said geolocation device 3 is a GNSS receiver
[0084] From a time point of view, said virtual geographical area A.sub.V and said virtual scenario have been stored a priori, i.e. before that the system is used.
[0085] In particular, said virtual geographical area A.sub.V and said virtual scenario have been created and modelled respectively on a geographical area of interest A (that can be travelled by the vehicle V) and a real scenario present within said geographical area of interest A, on the basis of one or more path that said vehicle V can travel within said geographical area of interest A and on the basis of the movement direction of said vehicle V within each of said paths.
[0086] The creation and modelling of a virtual geographical area takes into account that vehicle V can change its path within the geographical area of interest and/or that its movement direction can change (for example due to a pothole or if the vehicle accidentally gets on a sidewalk), so that a respective movement in the virtual geographical area can correspond to each possible movement of the vehicle in the geographical area of interest.
[0087] The creation and the modelling of a virtual geographical area A.sub.V and a virtual scenario are not object of the present patent application, but the technical solution object of such patent application is focused on the possibility to offer the user on a vehicle to observe a virtual scenario (preferable associated with a real scenario) with the same observation point with which observes the real scenario surrounding the vehicle moving within a geographical area of interest A, depending on the movement of said vehicle.
[0088]
[0089] In the example being disclosed, said geographical area of interest A has a first path T1 and a second path T2, each of which is indicated by a respective dashed arrow.
[0090] The first path T1 is defined by a first trajectory in which the vehicle V turns right with respect to its movement direction.
[0091] The second path T2 is defined by a second trajectory in which the vehicle V go substantially ahead with respect to its movement direction.
[0092] The real scenario present in said geographical area of interest comprises a first statue S1 and a second statue s2, arranged along the first path T1.
[0093] Each of said statues S1,S2 is devoid of some parts.
[0094]
[0095] In the example being disclosed, the virtual scenario is associated with the real scenario.
[0096] In other words, the virtual environment in which the vehicle is a 3D reproduction of the real environment in which the vehicle moves. However, as already said, the virtual environment can be any virtual environment, also a virtual fantasy environment, and then not necessarily connected to the real environment.
[0097] The virtual scenario (associated with the real scenario above mentioned) comprises a first virtual statue S1v and a second virtual statue S2v, each of which is respectively the reproduction of the first statue S1 and the second statue S2 in their entirety, so that a user can see the statues as they originally were, as the vehicle V passes in correspondence with said first statue S1 and said second statue S2
[0098] However, although not shown in Figures, the geographical area of interest A can have any size and any number of paths. Said geographical area of interest A can be a predetermined zone of a town or of a region, etc. The real scenario can comprise any monument or any building (for example a church, a museum, etc.) or more generally any element (for example a fountain, an obelisk).
[0099] As said above, the virtual scenario is any virtual content (that can be an example of a 3D graphic content with or without an audio content) that can be referred to said monument or to said building or to said element present in said geographical area of interest A, without departing from the scope of invention.
[0100] For example, said virtual content can be created to allow a user to imagine a precise historical period in which said monument or said building or said element assumed relevance, so as to given value to said monument or said building or said element.
[0101] In the example being described, the vehicle V travels along a first road (near which the first statue S1 is located) along a direction defined by a straight line, turns right and takes a second road (near which said second statue S2 is located), then following a direction defined by a further straight line (
[0102] Furthermore, returning to
[0109] In particular, said logic control unit 5 is configured to generate a graphic image or frame associated with the selected portion of said virtual scenario, by means of a 3D rendering engine.
[0110] Said graphic image or frame is generated in real time by said 3D rendering engine.
[0111] Said graphic image or frame is generated starting from said selected portion and will contain the information on the position of the vehicle (i.e. the Cartesian coordinates P.sub.Vx.sup.x.sup.
[0112] Consequently, such graphic image or frame will be seen by the user on the vehicle with the same observation point with which the same user would observe the real scenario around the vehicle.
[0113] As already said, the geographical area of interest A is defined a priori, i.e. before that system is used, and is parameter that the logic control unit 5 receives as input together with said first point P1 and said second point P2.
[0114] Such geographical area of interest A has the shape of a quadrilateral, which can preferably be a rectangle or a square, and said first point P1 and said second point P2 have been chosen in such a way as to be at the vertices of said rectangle or square, and in particular along a diagonal of said rectangle or square.
[0115] The geographical area of interest A is also delimited by a third point P3 and a fourth point P4.
[0116] The third point P3 has the coordinate on the x axis of the Cartesian plane x.sub.A,y.sub.A equal to the coordinate on the x.sub.A axis of the second point P2 and the coordinate on the y.sub.A axis of the Cartesian plane x.sub.A,y.sub.A equal to the coordinate on the y.sub.A axis of the first point P1.
[0117] The fourth point P4 has the coordinate on the x.sub.A axis of the Cartesian plane x.sub.A,y.sub.A equal to the coordinate on the x.sub.A axis of the first point P1 and the coordinate on the y.sub.A axis of the Cartesian plane x.sub.A,y.sub.A equal to the coordinate on the y.sub.A axis of the second point P2.
[0118] However, the position of said third point P3 and the position of said fourth point P4 are not necessary for the purpose of calculating the Cartesian coordinates of the vehicle V with respect to the Cartesian plane x.sub.A,y.sub.A.
[0119] The fact that a Cartesian reference system, i.e. a Cartesian plane x.sub.A,y.sub.A, is associated to the geographical area of interest A allows each point of said geographical area of interest A to be identified not only by means of the latitude and longitude values with respect to said geographical area of interest but also by means of the Cartesian coordinate with respect to said Cartesian plane x.sub.A,y.sub.A.
[0120] Consequently, the position of the first point P1 is identified by means of the Cartesian coordinates x.sub.P1.sup.x.sup.
[0121] Starting from the values of latitude and longitude and from the Cartesian coordinates of the first point P1 and the second point P2, the logic control unit 5 can calculate the values above mentioned: a first difference value LAT.sub.DIF, a second difference value LONG.sub.DIF, a third difference value X.sub.DIF and a fourth difference value Y.sub.DIF.
[0122] Starting from the linear accelerations A.sub.X,A.sub.Y,A.sub.Z sent by the inertial measurement unit 2, the logic control unit 5 can calculate the pitch angle θ and the roll angle γ of the vehicle V. The pitch angle θ, the roll angle γ and heading ϕ can be calculated by means of the following formulas:
[0131] With reference to the heading ϕ, the logic control unit 5 can calculate a vector m.sup.l=[m.sub.x.sup.l, m.sub.y.sup.l, m.sub.z.sup.l] associated with the horizontal component of the of the terrestrial magnetic field strength (defined by the horizontal components of the of said terrestrial magnetic field strength along the x,y,z axes) starting from the vector m associated with the terrestrial magnetic field strength, i.e. by the values of terrestrial magnetic field strength along the x,y,z axes.
[0132] The vector m.sup.l=[m.sub.x.sup.l, m.sub.y.sup.l, m.sub.z.sup.l] associated with said horizontal component can be calculated by means the following formula:
[0133] The logic control unit 5 can calculate the heading ϕ of the vehicle V by the values of the horizontal component m.sub.x.sup.l along the x axis and the horizontal component mi, along the z axis (obtained by means of the formula mentioned above).
[0134] The term “heading” means the direction of movement of the vehicle V.
[0135] It is preferable that the logic control unit 5, after receiving the values of the geographical coordinates LAT.sub.V,LONG.sub.V of the vehicle V (expressed in terms of values of latitude and longitude and sent by the geolocation device) is configured to: [0136] verify whether the geographical coordinates LAT.sub.V,LONG.sub.V are contained in said geographical area of interest (A), [0137] calculate the Cartesian coordinates with respect to the Cartesian plane x.sub.A,y.sub.A only if the geographical coordinates LAT.sub.V,LONG.sub.V are contained in the geographical area of interest A.
[0138] If the vehicle V is within the geographical area of interest A, the logic control unit 5 calculates the Cartesian coordinates of the vehicle V with respect to the Cartesian plane x.sub.A,y.sub.A otherwise if the vehicle V is not within the geographical area of interest A, the logic control unit 5 can be configured to send a message to indicate that the vehicle V is not within the geographical area of interest and no virtual scenario is displayed.
[0139] The Cartesian coordinates P.sub.Vx.sup.x.sup.
[0140] The term “apply” means to use the Cartesian coordinates and the information associated to the angles above mentioned in the virtual geographical area A.sub.V to follow the movements of the vehicle V within the virtual geographical area itself.
[0141] In other words, said Cartesian coordinates and said information associated to the angles above mentioned to a virtual vehicle (associated with the vehicle V) that moves in the virtual geographical area A.sub.V in the same way with which the vehicle V moves in the geographical area of interest A.
[0142] The virtual vehicle has the same position, the same rotation (i.e. the same pitch angle and he same roll angle) and the same heading as the vehicle V.
[0143] In this way, the virtual vehicle “follows” each movement of the vehicle and the viewing of the virtual scenario (in the specific case associated with the real scenario surrounding the vehicle) changes depending on the movement of the vehicle V.
[0144] In other words, the observation point of a person (on a vehicle V) observing a real scenario is the same observation point with which the virtual scenario is viewed.
[0145] The vehicle V is a real vehicle that moves within said geographical area of interest A and the real scenario contained in said geographical area of interest can comprise or be constituted of monuments, fountains, churches, buildings, squares, villas, etc.
[0146] The virtual vehicle is an element moving within a virtual geographical area A.sub.V created and modelled on the basis of the geographical area of interest A.
[0147] In the embodiment being disclosed, the virtual scenario is created and modelled on the basis of the real scenario contained in the geographical area of interest A (although, as said above such a virtual scenario can be any one 3D graphic content, also a 3D fantasy graphic content).
[0148] For example if the vehicle V gets on a sidewalk due to a hole the vehicle has a sussultatory movement, the viewing of the real scenario would change for a time interval and consequently the viewing of the virtual scenario associated with it would change.
[0149] With reference to the system above disclosed, it is preferable that the information associated with the pitch angle θ, to the roll angle γ and the heading ϕ are contained in a quaternion.
[0150] The quaternion is a four-dimensional complex number used to represent the orientation and rotation of three-dimensional objects and basically behaves like a four-component rotation matrix.
[0151] However, compared to a rotation matrix, the quaternion is numerically more stable and more efficient.
[0152] To this end it is preferable that said inertial measurement unit 2 comprises a gyroscope 21 for acquiring at each time instant t a respective triad of values associated with the angular velocities ω.sub.X,ω.sub.Y,ω.sub.Z along the axes x,y,z,
in that the logic control unit 5 is connected to said gyroscope 21 and configured to: [0153] acquire at each time instant t from said inertial measurement unit 2 the values of each triad of angular velocities ω.sub.X,ω.sub.Y,ω.sub.Z along the x,y,z axes, [0154] create a respective state vector X.sub.k1=q.sub.1,w.sub.1, X.sub.k2=[q.sub.2,w.sub.2], X.sub.k3=[q.sub.3,w.sub.3], . . . X.sub.kn=[q.sub.n,w.sub.n] at each time instant t.sub.1, t.sub.2 . . . t.sub.n, where q.sub.1=[q.sub.w1,q.sub.x1,q.sub.y1,q.sub.z1], q.sub.2=[q.sub.w2,q.sub.x2,q.sub.y2,q.sub.z2], q.sub.3=[q.sub.w3,q.sub.x3,q.sub.y3,q.sub.z3] . . . q.sub.n=[q.sub.wn,q.sub.xn,q.sub.yn,q.sub.zn] are respective quaternions in respective time instants t.sub.1, t.sub.2, t.sub.3 . . . t.sub.n, each of which is obtained from said pitch angle θ, said roll angle γ and from said heading ϕ at a respective time instant t.sub.1,t.sub.2, t.sub.3 . . . t.sub.n, e w.sub.1=[w.sub.x1,w.sub.y1,w.sub.z1], w.sub.2=[w.sub.x2,w.sub.y2,w.sub.z2], w.sub.3=[w.sub.x3,w.sub.y3,w.sub.z3] . . . w.sub.n=[w.sub.xn,w.sub.yn,w.sub.zn] are respective triads of angular velocities at respective time instants t.sub.1, t.sub.2, t.sub.3 . . . t.sub.n.
[0155] It is furthermore preferable that each quaternion from quaternion q.sub.2 at the time instant t.sub.2 to quaternion q.sub.n at time instant t.sub.n is obtained by applying an extended Kalman filter to quaternion at the previous time instant:
q.sub.2=q.sub.1′=[q.sub.w1′,q.sub.x1′,q.sub.y1′,q.sub.z1′],
q.sub.3=q.sub.2′
. . .
q.sub.n=q.sub.n-1′
[0156] In particular, the pitch angle θ, the roll angle γ and the heading ϕ allow to calculate a quaternion e q.sub.1=[q.sub.w,q.sub.x,q.sub.y,q.sub.z].
[0157] Said quaternion q.sub.1 together with the values of the angular velocities ω.sub.x,ω.sub.y,ω.sub.z along x,y,z axes at a first time instant t.sub.1 form a first state vector X.sub.k1.
[0158] After obtaining the first state vector X.sub.k1, the logic control unit 5 filters said first state vector X.sub.k1 by means of an extended Kalman filter to obtain a matrix comprises a further quaternion that is a filtered quaternion q.sub.2=q.sub.1′=[q.sub.w1′,q.sub.x1′,q.sub.y1′,q.sub.z1′] from which it is possible to obtain information about orientation and rotation of the vehicle V with respect to the planes defined by the x,y,z axes (i.e. the xy plane, the xz plane, the yz plane).
[0159] Advantageously, the application of the extended Kalman filter serves to remove the noise of which the information about orientation and rotation of the vehicle V with respect to the x,y,z axes are affected.
[0160] For each time instant t.sub.2, t.sub.3 . . . t.sub.n subsequent to the first time instant t.sub.1, is created a respective state vector X.sub.k2,X.sub.k3, . . . X.sub.kn comprising a respective quaternion q.sub.2,q.sub.3, . . . q.sub.n, in which each quaternion is a quaternion filtered by means of the extended Kalman filter, and a respective triad of angular velocities w.sub.2=[w.sub.2x,w.sub.2y,w.sub.2z], w.sub.3=[w.sub.3x,w.sub.3y,w.sub.3z] . . . w.sub.n=[w.sub.xn,w.sub.yn,w.sub.zn].
[0161] In other words, each state vector X.sub.k2,X.sub.k3, . . . X.sub.kn is filtered to obtain a respective matrix comprising a respective quaternion filtered q.sub.2,q.sub.3, . . . q.sub.n that is used in the subsequent state vector, i.e. the state vector created at the subsequent time instant.
[0162] Hence, the quaternion q.sub.2 present in the second state vector X.sub.k2 is the quaternion that has been obtained by applying the extended Kalman filter to the first state vector X.sub.k1.
[0163] The quaternion q.sub.3 present in the third state vector X.sub.k3 is the quaternion that has been obtained by applying the extended Kalman filter to the second state vector X.sub.k2.
[0164] The quaternion q.sub.4 present in the fourth state vector X.sub.k4 is the quaternion that has been obtained by applying the extended Kalman filter to third state vector X.sub.k3, and so on.
[0165] With reference to the system 1 above disclosed, in the embodiment being disclosed, said inertial measurement unit 2, said geolocation device 3, said storage means 4 and said logic control unit 5 are installed on the vehicle V.
[0166] However, said inertial measurement unit 2 and said geolocation device 3 can be installed on the vehicle V and said storage means 4 and said logic control unit 5 can be arranged outside of the vehicle V, without departing from the scope of the invention.
[0167] The present invention relates also to a vehicle V comprising the system above disclosed.
[0168] In other words, the system 1 above disclosed is installed ion the vehicle V.
[0169] The position of the vehicle V, the orientation and a possible rotation in a geographical area of interest A are data that are associated with a virtual vehicle that is associated with said vehicle V and moves in a virtual geographical area Av associated with said geographical area of interest.
[0170] In this way, said virtual vehicle “follows” the movements of said vehicle V and a user observes a dynamic virtual scenario changing over time depending on the movement of the vehicle V in the geographical area of interest with an observation point that is the same observation point with which the user would observe the rea scenario
[0171] In the embodiments being disclosed, the vehicle V is provided with one or more windows W and at least one displaying device D for displaying a virtual scenario.
[0172] Said displaying device D is arranged inside said vehicle V so as to be facing a window W or at least a portion of one of said windows W.
[0173] Said displaying device D can be fixed or coupled with the roof or the floor of the vehicle V by means of connecting means of known type.
[0174] In the embodiment being disclosed, said displaying device D is coupled with the floor of the vehicle V by means of a connecting road.
[0175] As shown in
[0176] Each displaying device has a first surface or front surface, arranged at a first distance from the window, and a second surface or rear surface, arranged at a second distance from the window, less than said first distance.
[0177] However, depending on the size of the windows V of the vehicle V and the size of the displaying device D, it is possible that more displaying devices D face a respective portion of a same window W, without departing from the scope of the aim invention.
[0178] In the embodiment being disclosed, said displaying device D comprises a display made of a transparent material, preferably a transparent OLED display.
[0179] In this case, through the transparent OLED display, the user is able to observe a real scenario outside the vehicle and, when the system is in use, a virtual scenario.
[0180] In the embodiment being disclosed, the virtual scenario is overlapped to the real scenario, since the virtual scenario is associated to the real scenario.
[0181] Furthermore, in the embodiment being disclosed, said vehicle V comprises filtering means L for filtering a percentage of light radiation with respect to the light radiation coming from the external environment and incident on one or more windows W, so as to avoid that a significant amount of light radiation enters the vehicle V through one or more windows W.
[0182] It is preferably that said filtering means L are configured to filter a percentage of light radiation between 80% and 100%.
[0183] In this way, only a modest percentage of light radiation can reach the displaying device D, so as not to cause a discomfort to the viewing of the virtual content by an observer.
[0184] When the percentage of light radiation filtered by the filtering means is equal to 100% the light radiation does not reach the displaying device.
[0185] In the embodiment being disclosed, said filtering means L comprise a blackout curtain for each window W.
[0186] In the embodiment being disclosed, said blackout curtain is in fireproof PVC material.
[0187] When the displaying device D is not in use, the blackout curtain is lifted with respect to the window, as shown in
[0188] The observer can observe the second statue S2 along the first path T1 through the window W of the vehicle V.
[0189] When the displaying device D is in use the blackout curtain is lowered with respect the window to allow the viewing of a virtual scenario on said displaying device D, as shown in
[0190] The observer can observe the second virtual statue S2v (that, as said, is the reproduction of the second statue S2 in its entirety) displayed on a displaying device D.
[0191] The blackout curtain can be operated by manually or motorized.
[0192] In the case of a manual drive, the lifting and lowering of said blackout curtain can be simple manual operations.
[0193] If the blackout curtain is motorized, a user can lift and lower such curtain by means of a switch.
[0194] However, although not shown in Figures, it is not necessary that the displaying device D is made of a transparent material nor the presence of filtering means L.
[0195] In fact, when the display device D is not a display made of a transparent material (for example the display device is a display provided with a non-transparent rear panel), the presence of filtering means L is not necessary, as a possible percentage of light radiation which affects the window and subsequently the rear surface of the display does not cause any discomfort to the viewing of the virtual scenario.
[0196] As already said, in the example being disclosed, said vehicle V is a minibus.
[0197] However, said vehicle V can be a car or a coach or a bus or a tram or a train or any vehicle provided with one or more windows, without departing from the scope of the invention.
[0198] The present invention relates also to a method for associating a virtual scenario to a real scenario during the moving of a vehicle V within a geographical area of interest A, through the system above disclosed.
[0199] Said method comprises the following steps:
A) acquiring at each time instant t the values of each triad of linear accelerations A.sub.X,A.sub.Y,A.sub.Z, as well as the values of each vector m=[m.sub.x,m.sub.y,m.sub.z] associated with the terrestrial magnetic field strength,
B) calculating a pitch angle θ and a roll angle γ associated with said vehicle V on the basis of said values associated to the linear accelerations A.sub.X,A.sub.Y,A.sub.Z, as well as a heading ϕ, expressed in terms of angle, on the basis of horizontal components of said terrestrial magnetic field strength,
C) acquiring at each time instant t the geographical coordinates LAT.sub.V,LONG.sub.V associated with said vehicle V,
D) calculating the Cartesian coordinates identifying the position of said vehicle V with respect to the Cartesian plane x.sub.A,y.sub.A by means of the following formulas:
E) applying said Cartesian coordinates P.sub.Vx.sup.x.sup.
F) selecting a portion of said virtual scenario stored in said storage means 4, on the basis of said Cartesian coordinates P.sub.Vx.sup.x.sup.
[0200] Said method comprises also the following step:
G) generating a frame associated with said selected portion by means of a 3D rendering engine.
[0201] Furthermore, the step A of the method can comprise the following sub-step:
A1) acquiring at each time instant t a respective triad of angular velocities ω.sub.X,ω.sub.Y,ω.sub.Z along the x, y, y axes, and the step B of the method can comprise the following sub-step:
B1) creating a respective state vector X.sub.k1=[q.sub.1,w.sub.1], X.sub.k2=[q.sub.2,w.sub.2], X.sub.k3=[q.sub.3,w.sub.3], . . . X.sub.kn=[q.sub.n,W.sub.n] in each time instant t.sub.1, t.sub.2 . . . t.sub.n, where
q.sub.1=[q.sub.w1,q.sub.x1,q.sub.y1,q.sub.z1], q.sub.2=[q.sub.w2,q.sub.x2,q.sub.y2,q.sub.z2], q.sub.3=[q.sub.w3,q.sub.x3,q.sub.y3,q.sub.z3] . . . q.sub.n=[q.sub.wn,q.sub.xn,q.sub.yn,q.sub.zn] are respective quaternions in respective time instants t.sub.1,t.sub.2,t.sub.3 . . . t.sub.n, each of which is obtained from said pitch angle θ, from said roll angle γ and from said heading ϕ in a respective time instant t.sub.1, t.sub.2, t.sub.3 . . . t.sub.n, w.sub.1=[w.sub.x1,w.sub.y1,w.sub.z1], w.sub.2=[w.sub.x2,w.sub.y2,w.sub.z2], w.sub.3=[w.sub.x3,w.sub.y3,w.sub.z3] . . . w.sub.n=[w.sub.xnw.sub.yn,w.sub.zn] are respective triads of angular velocities in respective time instants t.sub.1,t.sub.2,t.sub.3 . . . t.sub.n.
[0202] In this case, the information associated with said pitch angle θ, said roll angle γ and said heading ϕ are contained in each quaternion q.sub.1,q.sub.2 . . . q.sub.n.
[0203] In particular, it is preferable that each quaternion from the quaternion q.sub.2 at the time instant t.sub.2 to the quaternion q.sub.n at the time instant t.sub.n is obtained by applying an extended Kalman filter to the quaternion at the previous time instant:
q.sub.2=q.sub.1′=[q.sub.w1′,q.sub.x1′,q.sub.y1′,q.sub.z1′],
q.sub.3=q.sub.2′
. . .
q.sub.n=q.sub.n-1′
[0204] With reference to the pitch angle θ, to the roll angle γ and the heading ϕ above mentioned, said pitch angle θ, said roll angle γ and said heading ϕ can be calculated by means of the following formulas:
[0213] The horizontal component m.sub.x.sup.l along the x axis and the horizontal component m.sub.z.sup.l along the z axis of said terrestrial magnetic field strength are calculated by means of the following formula:
[0214] Furthermore, said method can comprise a step of verifying if the geographical coordinates LAT.sub.V,LONG.sub.V of said vehicle V are contained in said geographical area of interest A and the step of calculating the Cartesian coordinates that identify the position of said vehicle V with respect to the Cartesian plane x.sub.A,y.sub.A can only be performed if the geographical coordinates LAT.sub.V,LONG.sub.V associated with said vehicle V are contained in the geographical area of interest A.
[0215] Furthermore, the present invention relates to a computer program comprising instructions which, when the program is executed by a computer, cause the computer to carry out the steps of said method
[0216] The present invention relate also to a computer-readable storage medium comprising instructions which, when executed by a computer, cause the computer to carry out the steps of said method.
Advantages
[0217] Advantageously, by means of the system object of the invention it is possible to obtain information on the vehicle V which moves within a geographical area of interest A (such as the position, the rotation with respect to the axes of a reference system associated with the vehicle and the heading), and associate such information with a virtual vehicle moving in a virtual geographical area A.sub.V associated with said geographical area of interest A, so that the observation point with which the person on board the vehicle observes said virtual scenario is the same observation point with which the same person observes the real scenario.
[0218] A further advantage is given by the fact that said system offers the user a dynamic and immersive viewing, as the user can immerse himself in the viewing of a virtual scenario that changes according to the movement of the vehicle in the geographical area of interest.
[0219] The present invention has been described for illustrative, but not limitative purposes, according to its preferred embodiment, but it is to be understood that variations and/or modifications can be carried out by a skilled in the art, without departing from the scope thereof, as defined according to enclosed claims.