STEREOSCOPIC DISPLAY DEVICE AND DISPLAY METHOD THEREOF

Abstract

A stereoscopic display device and a display method thereof are provided. The stereoscopic display device includes a display panel, a lens array, an image sensor, and a processing circuit. The display panel displays a three-dimensional image. The lens array is disposed on a transmission path of the three-dimensional image. The image sensor acquires a sensed image of a viewing field of the display panel. The processing circuit is coupled to the lens array and the image sensor. The processing circuit calculates an actual eye position of a user in the viewing field according to reference coordinates of a reference position in the sensed image and eye coordinates of the user in the sensed image. The processing circuit adjusts a liquid crystal rotation angle of the lens array according to the actual eye position, so that a viewing position of the three-dimensional image matches the actual eye position.

Claims

1. A stereoscopic display device, comprising: a display panel configured to display a three-dimensional image; a lens array disposed on a transmission path of the three-dimensional image; an image sensor configured to acquire a sensed image of a viewing field of the display panel; and a processing circuit coupled to the lens array and the image sensor, wherein the processing circuit calculates an actual eye position of a user in the viewing field according to reference coordinates of a reference position in the sensed image and eye coordinates of the user in the sensed image, adjusts a liquid crystal rotation angle of the lens array according to the actual eye position to change a direction of light refraction, so that a viewing position of the three-dimensional image is moved from a default viewing position corresponding to the reference coordinates in the viewing field to the actual eye position.

2. The stereoscopic display device of claim 1, wherein the reference position comprises a center position of the sensed image.

3. The stereoscopic display device of claim 1, wherein the processing circuit calculates a spatial transformation matrix according to the reference coordinates and the default viewing position corresponding to the reference coordinates in the viewing field.

4. The stereoscopic display device of claim 1, wherein the processing circuit converts the eye coordinates to the actual eye position using a spatial transformation matrix.

5. The stereoscopic display device of claim 1, wherein the processing circuit calculates a rotation matrix according to the default viewing position corresponding to the reference coordinates in the viewing field and the actual eye position, and calculates the liquid crystal rotation angle according to the rotation matrix.

6. The stereoscopic display device of claim 1, further comprising: a depth sensor configured to sense a depth information from the display panel to the user in the viewing field, wherein the processing circuit calculates the default viewing position corresponding to the reference coordinates in the viewing field using the depth information and the reference coordinates.

7. The stereoscopic display device of claim 1, wherein the lens array comprises a first lens array and a second lens array respectively corresponding to a left eye and a right eye of the user, and the processing circuit adjusts the liquid crystal rotation angle of the first lens array and the liquid crystal rotation angle of the second lens array according to the actual eye position and a compensation vector.

8. The stereoscopic display device of claim 7, wherein the compensation vector is related to a horizontal resolution of the display panel.

9. A display method of a stereoscopic display device, comprising: displaying a three-dimensional image via a display panel of the stereoscopic display device; disposing a lens array of the stereoscopic display device on a transmission path of the three-dimensional image; acquiring a sensed image of a viewing field of the display panel via an image sensor of the stereoscopic display device; calculating an actual eye position of a user in the viewing field according to reference coordinates of a reference position in the sensed image and eye coordinates of the user in the sensed image via a processing circuit of the stereoscopic display device; and adjusting a liquid crystal rotation angle of the lens array according to the actual eye position via the processing circuit to change a direction of light refraction, so that a viewing position of the three-dimensional image is moved from a default viewing position corresponding to the reference coordinates in the viewing field to the actual eye position.

10. The display method of claim 9, wherein the reference position comprises a center position of the sensed image.

11. The display method of claim 9, further comprising: calculating a spatial transformation matrix according to the reference coordinates and the default viewing position corresponding to the reference coordinates in the viewing field via the processing circuit.

12. The display method of claim 9, further comprising: converting the eye coordinates to the actual eye position using a spatial transformation matrix via the processing circuit.

13. The display method of claim 9, further comprising: calculating a rotation matrix according to the default viewing position corresponding to the reference coordinates in the viewing field and the actual eye position via the processing circuit; and calculating the liquid crystal rotation angle according to the rotation matrix via the processing circuit.

14. The display method of claim 9, further comprising: sensing a depth information from the display panel to the user in the viewing field via a depth sensor of the stereoscopic display device; and calculating the default viewing position corresponding to the reference coordinates in the viewing field using the depth information and the reference coordinates via the processing circuit.

15. The display method of claim 9, wherein the lens array comprises a first lens array and a second lens array respectively corresponding to a left eye and a right eye of the user, and the display method further comprises: adjusting the liquid crystal rotation angle of the first lens array and the liquid crystal rotation angle of the second lens array according to the actual eye position and a compensation vector via the processing circuit.

16. The display method of claim 15, wherein the compensation vector is related to a horizontal resolution of the display panel.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

[0010] The accompanying drawings are included to provide a further understanding of the invention, and are incorporated in and constitute a part of this specification. The drawings illustrate embodiments of the invention and, together with the description, serve to explain the principles of the invention.

[0011] FIG. 1 is a schematic diagram of a use situation of a stereoscopic display device according to an embodiment of the invention.

[0012] FIG. 2 is a schematic diagram of a circuit block of a stereoscopic display device according to an embodiment of the invention.

[0013] FIG. 3 is a flowchart of a display method of a stereoscopic display device according to an embodiment of the invention.

[0014] FIG. 4 is a schematic diagram of a sensing situation of a stereoscopic display device according to an embodiment of the invention.

[0015] FIG. 5 is a schematic diagram illustrating the y-z plane of the sensing situation shown in FIG. 4 according to an embodiment of the invention.

[0016] FIG. 6 is a schematic diagram illustrating a partial optical path of the stereoscopic display device shown in FIG. 1 and FIG. 2 according to an embodiment of the invention.

[0017] FIG. 7 is a schematic diagram of the hardware architecture of a stereoscopic display device according to another embodiment of the invention.

[0018] FIG. 8 is a schematic diagram of a portion of the structure of a stereoscopic display device according to an embodiment of the invention.

DESCRIPTION OF THE EMBODIMENTS

[0019] The term “coupled to (or connected to)” used in the entire text of the specification of the present application (including claims) may refer to any direct or indirect connecting means. For example, if the text describes a first device is coupled to (or connected to) a second device, then it should be understood that the first device may be directly connected to the second device, or the first device may be indirectly connected to the second device via other devices or certain connecting means. Terms such as “first” and “second” mentioned in the entire specification of the present application (including the claims) are used to name the elements or to distinguish different embodiments or ranges, and are not used to restrict the upper or lower limits of the number of elements, nor are they used to limit the order of the elements. Moreover, when applicable, elements/components/steps having the same reference numerals in figures and embodiments represent the same or similar parts. Elements/components/steps having the same reference numerals or having the same terminology in different embodiments may be cross-referenced.

[0020] FIG. 1 is a schematic diagram of a use situation of a stereoscopic display device 100 according to an embodiment of the invention. FIG. 2 is a schematic diagram of a circuit block of the stereoscopic display device 100 according to an embodiment of the invention. Please refer to FIG. 1 and FIG. 2. In the embodiment shown in FIG. 1 and FIG. 2, the stereoscopic display device 100 includes a display panel 110, a lens array 120, an image sensor 130, and a processing circuit 140. The processing circuit 140 is coupled to the lens array 120 and the image sensor 130. According to actual application, the type of the display panel 110 may be a liquid crystal display (LCD), a light-emitting diode (LED) display, a field-emission display (FED), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED) display, a flexible display, a transparent light-emitting diode display, or other display units that provide display functions.

[0021] The display panel 110 may display a three-dimensional video I1 to a viewing field FD. The lens array 120 is disposed on a transmission path of the three-dimensional image I1. In some embodiments, the lens array 120 may be directly in contact with or attached to the display panel 110 to simplify manufacturing process or optimize optical effect, and the present embodiment is not limited in this regard.

[0022] According to design requirements, the related functions of the processing circuit 140 may be implemented as hardware using a hardware description language such as Verilog HDL or VHDL or other suitable programming languages. For example, the related functions of the processing circuit 140 may be implemented in one or a plurality of microcontrollers, microprocessors, application-specific integrated circuits (ASICs), digital signal processors (DSPs), field-programmable gate arrays (FPGAs), and/or various logic blocks, modules, and circuits in other processing units. In software form and/or firmware form, the related functions of the processing circuit 140 may be implemented as programming codes. For example, the above may be implemented using a general programming language (such as C, C++, or a combination language) or other suitable programming languages. The programming code may be recorded/stored in a “non-transitory computer-readable medium”. Examples include read-only memory (ROM), tape, disk, card, semiconductor memory, programmable logic circuit, and/or storage device. A central processing unit (CPU), a microcontroller, or a microprocessor may read and execute the programming codes from the non-transitory computer-readable medium to achieve a related function. The storage unit 130 is, for example, any type of random-access memory (RAM), read-only memory (ROM), flash memory, hard disk drive, other similar devices, or a combination of the devices.

[0023] FIG. 3 is a schematic flowchart of a display method of a stereoscopic display device according to an embodiment of the invention. For the stereoscopic display device 100 shown in FIG. 1 and FIG. 2, reference may be made to the related description of FIG. 3. Please refer to all of FIG. 1, FIG. 2, and FIG. 3. In step S210, the display panel 110 may display the three-dimensional image I1 to project the three-dimensional image I1 to the viewing field FD. In step S220, the lens array 120 of the stereoscopic display device 100 may be disposed on the transmission path of the three-dimensional image I1.

[0024] Specifically, the viewing field FD shown in FIG. 1 includes a default viewing position X.sub.F and an actual eye position X.sub.E of a user. The actual eye position X.sub.E may be the same as or different from the default viewing position X.sub.F. It should be mentioned that, in the present embodiment, each lens in the lens array 120 is filled with liquid crystal, wherein the liquid crystal rotation angle may be controlled to change the focusing characteristics of the lens, thereby changing the angle of refraction of light passing through the lens. In the present embodiment, assuming that the liquid crystal rotation angle of the lens array 120 is the preset initial angle, the viewing position (ideal position) of the three-dimensional image I1 displayed by the display panel 110 is the default viewing position X.sub.F in the viewing field FD. According to actual design, in some embodiments, the default viewing position X.sub.F may be located on the normal vector at the center of the display panel 110, but is not limited thereto in other embodiments.

[0025] In step S230, the image sensor 130 may acquire a sensed image I2 of the viewing field FD of the display panel 110 and transmit the sensed image I2 to the processing circuit 140. In step S240, the processing circuit 140 may identify the sensed image I2 to obtain the eye coordinates of the user in the sensed image I2. The default viewing position X.sub.F in the viewing field FD corresponds to the reference position in the sensed image I2. In the present embodiment, it is assumed that the reference position in the sensed image I2 includes the center position of the sensed image I2. However, in other embodiments, the reference position may be another position in the sensed image I2. The processing circuit 140 may calculate the actual eye position X.sub.E of the user in the viewing field FD according to the reference coordinates of a reference position in the sensed image I2 and the eye coordinates of the user in the sensed image I2 (step S240).

[0026] For example, FIG. 4 is a schematic diagram of a sensing situation of the stereoscopic display device 100 according to an embodiment of the invention. In the embodiment shown in FIG. 4, it is assumed that in the x-y-z three-dimensional space of the viewing field FD, the image sensor 130 is used as a reference, the sensing direction of the image sensor 130 toward the user is defined as the z-axis, and the x-axis, the y-axis, and the z-axis are perpendicular to each other. The x-y-z three-dimensional coordinate of the default viewing position X.sub.F in the viewing field FD may be expressed as (x.sub.F, y.sub.F, z.sub.F), and the x-y-z three-dimensional coordinate of the actual eye position X.sub.E in the viewing field FD may be expressed as (x.sub.E, y.sub.E, z.sub.E).

[0027] In the present embodiment, the sensed image I2 of the viewing field FD acquired by the image sensor 130 may correspond to a virtual imaging plane VP where the focal length of the image sensor 130 is located. The image sensor 130 senses the actual eye position X.sub.E in the viewing field FD to obtain the sensed image I2. The imaging plane VP (the sensed image I2) is a u-v two-dimensional plane formed by the u-axis and the v-axis. An eye position C.sub.G in the imaging plane VP (the sensed image I2) corresponds to the actual eye position X.sub.E in the viewing field FD, and a reference position Cs in the imaging plane VP (the sensed image I2) corresponds to the default viewing position X.sub.F in the viewing field FD. On the imaging plane VP, origin coordinates C.sub.0 (0, 0) are used as a reference, the coordinates of the reference position Cs are the reference coordinates (us, vs), and the coordinates of the eye position C.sub.G are the eye coordinates (u.sub.G, v.sub.G). In the embodiment shown in FIG. 4, the x-axis of the viewing field FD is parallel to the u-axis of the imaging plane VP, and the y-axis of the viewing field FD is parallel to the v-axis of the imaging plane VP. As a result, when the default viewing position X.sub.F in the viewing field FD is a preset default viewing position or a known position, the processing circuit 140 may calculate the actual eye position X.sub.E of the user in the viewing field FD according to the reference coordinates (us, vs) of the reference position Cs and the eye coordinates (u.sub.G, v.sub.G) of the eye position C.sub.G in the sensed image I2.

[0028] For example, FIG. 5 is a schematic diagram illustrating the y-z plane of the sensing situation shown in FIG. 4 according to an embodiment of the invention. Please refer to FIG. 4 and FIG. 5 at the same time. In the embodiment shown in FIG. 5, it is assumed that the z-axis coordinate z.sub.E of the user in the viewing field FD (i.e., the actual eye position X.sub.E) (the depth information from the display panel 110 to the eye) is equal to the z-axis coordinate z.sub.F of the default viewing position X.sub.F (the depth information from the display panel 110 to the default viewing position X.sub.F). In the embodiment shown in FIG. 5, taking the image sensor 130 as a reference, the y-z two-dimensional coordinates of the default viewing position X.sub.F may be expressed as (y.sub.F, z.sub.F), the y-z two-dimensional coordinates of the actual eye position X.sub.E may be expressed as (0, z.sub.F), and the relative distance between the default viewing position X.sub.F and the actual eye position X.sub.E on the y-axis is y.sub.F. In this way, in the present embodiment, the relationship between the reference coordinates (us, vs) of the reference position Cs and the eye coordinates (u.sub.G, v.sub.G) of the eye position C.sub.G in the imaging plane VP may be expressed as follows:

[00001]$\frac{f_v}{z_F}=\frac{d}{y_F}.fwdarw.d=\frac{f_v{y}_F}{z_F}$

[00002]$C_s=\left(u_s,v_G-\frac{f_v{y}_F}{z_F}\right)$

[00003]$\Delta \text{Eyeball}=\left(\Delta \text{x},v_G-\frac{f_v{y}_F}{z_F}\right)$

[0029] In particular, d represents the relative distance (y-axis variable) between the reference position Cs and the eye position C.sub.G on the v-axis in the imaging plane VP. fv represents the imaging distance between the display panel 110 (the image sensor 130) and the imaging plane VP corresponding to the sensed image I2, is, the relative distance between the image sensor 130 and the eye postion C.sub.G on the z-axis (z-axis variable). Δx represents the relative distance between the actual eye position X.sub.E and the default viewing position X.sub.F on the x-axis (x-axis variable), and ΔEyeball represents the actual amount of variation between the actual eye position X.sub.E and the default viewing position X.sub.F on the x-y two-dimensional plane. In some embodiments, the processing circuit 140 may calculate the distance d via the reference coordinates (us, vs) of the reference position Cs and the eye coordinates (u.sub.G, v.sub.G) of the eye position C.sub.G in the sensed image I2. In some embodiments, the processing circuit 140 may calculate the imaging distance fv via the focal length of the image sensor 130. According to actual application, in some embodiments, the stereoscopic display device 100 may optionally include a depth sensor (not shown), and the depth sensor may sense a depth information z.sub.F from the display panel 110 to the user (the actual eye position X.sub.E) in the viewing field FD. Therefore, in some embodiments, the processing circuit 140 may calculate the default viewing position X.sub.F corresponding to the reference position Cs in the viewing field FD using the depth information z.sub.F and the reference coordinates (us, vs) of the reference position Cs via the above relational expressions (1) to (3).

[0030] In step S250 shown in FIG. 3, the processing circuit 140 may adjust the liquid crystal rotation angle of the lens array 120 according to the actual eye position X.sub.E, so that the viewing position (ideal position) of the three-dimensional image I1 matches the actual eye position X.sub.E. It should be mentioned that, in the embodiments shown in FIG. 1 and FIG. 2, the processing circuit 140 may change the direction of light refraction by adjusting the liquid crystal rotation angle of the lens array 120, so that the viewing position of the three-dimensional image I1 may be moved from the default viewing position X.sub.F to the actual eye position X.sub.E (or, as close as possible to the actual eye position X.sub.E). Taking the scenario shown in FIG. 4 as an example, the movement of the light (image) is only the movement of the three-dimensional image I1 on the u-v (or x-y) two-dimensional plane to the user’s eyes. However, for the lens array 120 and the image sensor 130, the movement of the light (image) is a stereo conversion in the x-y-z three-dimensional space. Therefore, in some embodiments, the processing circuit 140 may preset or calculate a spatial transformation matrix for converting the u-v two-dimensional coordinates into x-y-z three-dimensional coordinates. The processing circuit 140 may convert the eye coordinates (u.sub.G, v.sub.G) of the eye position C.sub.G in the sensed image I2 into the coordinates (x.sub.E, y.sub.E, z.sub.E) of the actual eye position X.sub.E using the spatial transformation matrix, and then adjust the liquid crystal rotation angle of the lens array 120 according to the coordinates (x.sub.E, y.sub.E, z.sub.E) of the actual eye position X.sub.E.

[0031] For example, in some embodiments, the spatial transformation matrix may be one or a plurality of fixed matrices that are preset before the stereoscopic display device 100 leaves the factory. Or, in some embodiments, the processing circuit 140 may also dynamically calculate the spatial transformation matrix according to the reference coordinates (us, vs) of the reference position Cs in the sensed image I2 and the coordinates (x.sub.F, y.sub.F, z.sub.F) of the default viewing position X.sub.F corresponding to the reference position Cs in the viewing field FD. For example, in some embodiments, the relationship between the reference position Cs and the default viewing position X.sub.F may be expressed as follows:

[00004]$C_s=K_F{X}_F$

[00005]$K_F\left(X_f{}^{\text{t}}\cdot X_F\right)=X_F{}^{\text{t}}\cdot C_s\cdot X_F{}^{-1}$

[00006]$K_F{\left(X_F{}^{\text{t}}\cdot X_F\right)}^{-1}\cdot \left(X_F{}^{\text{t}}\cdot X_F\right)={\left(X_F{}^{\text{t}}\cdot X_F\right)}^{-1}\cdot C_s$

[00007]$K_F={\left(X_F{}^{\text{t}}\cdot X_F\right)}^{-1}\cdot C_s$

[0032] In particular, K.sub.F represents the spatial transformation matrix between the reference position Cs on the two-dimensional plane and the default viewing position X.sub.F in the three-dimensional space. In some embodiments, the reference position Cs may be a 2x1 matrix, the spatial transformation matrix K.sub.F may be a 2x3 matrix, and the default viewing position X.sub.F may be a 3x1 matrix. In some embodiments, the default viewing position X.sub.F is an irreversible non-square matrix, so the processing circuit 140 may solve the spatial transformation matrix K.sub.F via the least square method of the above formulas (5) to (7). Similarly, in some embodiments, the relationship between the eye position C.sub.G and the actual eye position X.sub.E may also be expressed as follows:

[00008]$C_G=K_E{X}_E$

[0033] In particular, K.sub.E represents the spatial transformation matrix between the eye position C.sub.G on the two-dimensional plane and the actual eye position X.sub.E in the three-dimensional space. In some embodiments, the eye position C.sub.G may be a 2x1 matrix, the spatial transformation matrix K.sub.E may be a 2x3 matrix, and the actual eye coordinates X.sub.E may be a 3x1 matrix. In some embodiments, the spatial transformation matrix K.sub.E may be equal to the spatial transformation matrix K.sub.F. As a result, the processing circuit 140 may convert the eye coordinates (u.sub.G, v.sub.G) of the eye position C.sub.G into the coordinates of the actual eye position X.sub.E (x.sub.E, y.sub.E, z.sub.E) using the spatial transformation matrix K.sub.F calculated by the above formula (7) and then via formula (8).

[0034] Moreover, for the lens array 120 and the image sensor 130, the movement of the viewing position of the three-dimensional image I1 may be regarded as the coordinate conversion of the default viewing position X.sub.F in the three-dimensional space. Therefore, in some embodiments, the relationship between the default viewing position X.sub.F and the actual eye position X.sub.E may be expressed as follows:

[00009]$X_E=R_F{X}_F+t$

[0035] In particular, t represents the compensation vector between a plurality of lenses in the lens array 120. R.sub.F represents the rotation matrix when the coordinates of the default viewing position X.sub.F are converted in the three-dimensional space. In some embodiments, the actual eye position X.sub.E may be a 3x1 matrix, the rotation matrix R.sub.F may be a 3x3 matrix, the default viewing position X.sub.F may be a 3x1 matrix, and the compensation vector t may be a 3x1 matrix. As a result, when the compensation vector t approaches 0, the processing circuit 140 may substitute the default viewing position X.sub.F in the viewing field FD and the actual eye position X.sub.E calculated by the above formula (8) into the above formula (9) to calculate the rotation matrix R.sub.F. Then, the processing circuit 140 may calculate the liquid crystal rotation angle of the lens array 120 according to the rotation matrix R.sub.F.

[0036] In some other embodiments, the above formula (8) and formula (9) may also be combined into the following relational formula:

[00010]$C_G=K_E\left(R_F{X}_F+t\right)$

[00011]$R_F=K_E{}^{-1}\cdot X_F{}^t\cdot {\left(X_F{}^t{X}_F\right)}^{-1}\cdot C_G$

[0037] In some embodiments, assuming that the compensation vector t approaches 0 and the spatial transformation matrix K.sub.E is equal to the spatial transformation matrix K.sub.F, the above formula (10) may be expressed as C.sub.G = K.sub.F(R.sub.FX.sub.F). In other words, the processing circuit 140 may also calculate the rotation matrix R.sub.F according to the eye position C.sub.G in the sensed image I2 sensed by the image sensor 130, the default viewing position X.sub.F preset or calculated by the above formula (1), and the spatial transformation matrix K.sub.F calculated by the above formula (7). As a result, afterwards, as long as the image sensor 130 acquires the eye position C.sub.G, the processing circuit 140 may calculate the rotation matrix R.sub.F directly via the above formulas (10) and (11), and obtain the liquid crystal rotation angle needed to rotate the lens array 120 according to the rotation matrix R.sub.F.

[0038] Specifically, the action of coordinate conversion of three-dimensional coordinate points (such as the default viewing position X.sub.F) in the x-y-z three-dimensional space may be disassembled into three-dimensional coordinate points to rotate the x-axis, y-axis, and z-axis respectively, and the rotation matrix R.sub.F thereof may be expressed as follows:

[00012]$R_F=R_y\left({\theta }_y\right)R_x\left({\theta }_x\right)R_z\left({\theta }_z\right)$

[00013]$R_x\left({\theta }_x\right)=\left[\begin{array}{ccc}1& 0& 0\\ 0& cos{\theta }_x& -sin{\theta }_x\\ 0& sin{\theta }_x& cos{\theta }_x\end{array}\right]$

[00014]$R_y\left({\theta }_y\right)=\left[\begin{array}{ccc}cos{\theta }_y& 0& sin{\theta }_y\\ 0& 1& 0\\ -sin{\theta }_y& 0& cos{\theta }_y\end{array}\right]$

[00015]$R_z\left({\theta }_z\right)=\left[\begin{array}{ccc}cos{\theta }_z& -sin{\theta }_z& 0\\ sin{\theta }_z& cos{\theta }_z& 0\\ 0& 0& 1\end{array}\right]$

[0039] In particular, R.sub.x, R.sub.y, and R.sub.z respectively represent rotation matrices when the three-dimensional coordinate points independently rotate the x-axis, y-axis, and z-axis, and the rotation angles thereof are θ.sub.x, θ.sub.y, and θ.sub.z, respectively. In other words, in the case that the three-dimensional coordinate points independently rotate the x-axis, the coordinate conversion thereof only affects the y-z two-dimensional plane, that is, the y-z two-dimensional plane where the three-dimensional coordinate points are located rotates the x-axis. In the case that the three-dimensional coordinate points independently rotate the y-axis, the coordinate conversion thereof only affects the x-z two-dimensional plane, that is, the x-z two-dimensional plane where the three-dimensional coordinate points are located rotates the y-axis. In the case that the three-dimensional coordinate points independently rotate the z-axis, the coordinate conversion thereof only affects the x-y two-dimensional plane, that is, the x-y two-dimensional plane where the three-dimensional coordinate points are located rotates the z-axis.

[0040] Therefore, using the embodiment of FIG. 4 as an example, in the x-y-z three-dimensional space, for the lens array 120 (or the image sensor 130), the way of moving the viewing position of the three-dimensional image I1 from the default viewing position X.sub.F to the actual eye position X.sub.E may be regarded as rotating the z-axis via the x-y two-dimensional plane where the default viewing position X.sub.F is located. Then, the rotation matrix R.sub.F in the above formulas (9) to (11) may be expressed by the rotation matrix R.sub.Z(θ.sub.Z) in the above formula (15). In this way, after the processing circuit 140 calculates the rotation matrix R.sub.F, the rotation angle θ.sub.z when the default viewing position X.sub.F rotates the z-axis may be calculated according to the rotation matrix R.sub.Z(θ.sub.z). Further, the liquid crystal rotation angle in the lens array 120 is adjusted via the processing circuit 140 to change the direction of refraction of the passing light, so that the viewing position of the three-dimensional image I1 matches the actual eye position X.sub.E, so as to maintain the rendering effect of the three-dimensional image.

[0041] FIG. 6 is a schematic diagram illustrating a partial optical path of the stereoscopic display device 100 shown in FIG. 1 and FIG. 2 according to an embodiment of the invention. In the embodiment shown in FIG. 6, the display panel 110 may simultaneously present at least two sub-images configured to form a three-dimensional image, and the lens array 120 may include a plurality of lenses arranged in sequence to correspond to the plurality of sub-images, respectively, so as to respectively project a plurality of sub-images to the eyes of the user. In particular, the number, shape, and arrangement of the lenses in the lens array 120 may be adjusted according to actual need, and the present embodiment is not limited in these regards. For example, in the present embodiment, the three-dimensional image displayed by the display panel 110 may include a left parallax image IM1 and a right parallax image IM2. The lens array 120 may include a lens array 122 and a lens array 121 corresponding to the user’s left eye X.sub.EyeL and right eye X.sub.EyeR, respectively, so that the left parallax image IM1 and the right parallax image IM2 are respectively sent to the user’s left eye X.sub.EyeL and right eye X.sub.EyeR, and then a stereoscopic effect is rendered via the parallax. Corresponding to the actual eye position X.sub.E of the user (the left eye X.sub.EyeL and the right eye X.sub.EyeR), the liquid crystal rotation angles of the lens arrays 121 and 122 need to be calculated separately.

[0042] Specifically, in the present embodiment, the image sensor 130 may sense the user’s left eye X.sub.EyeL and/or right eye X.sub.EyeR to generate a sensed image, and the imaging plane VP corresponding to the sensed image may include left eye coordinates Eye.sub.L and/or right eye coordinates Eye.sub.R corresponding to the user’s left eye X.sub.EyeL and/or right eye X.sub.EyeR. Then, in some embodiments, assuming that the actual position of the left eye X.sub.EyeL is used as a reference, the above formula (9) may be rewritten as follows:

[00016]$Ey{e}_R=K_E\left(R_{EL}{X}_{EyeL}\right)$

[00017]$Ey{e}_L=K_E\left(R_{ER}{X}_{EyeR}+t\right)$

[0043] In the present embodiment, the compensation vector t may be related to the horizontal resolution of the display panel 110. For example, taking the display panel 110 with a resolution of 1920*1080 pixels as an example, the compensation vector t may be a spacing of 0.17925 mm between horizontal pixels, then in the x-y-z three-dimensional space, the compensation vector t may be expressed as a 3x1 matrix

[00018]$\left[\begin{array}{c}0.17925\\ 0\\ 0\end{array}\right].$

R.sub.EL and R.sub.ER indicate the rotation matrices of the lens arrays 121 and 122, respectively. In the present embodiment, it is assumed that the lens array 121 and the lens array 122 are sequentially arranged along the x-axis horizontal direction, and the direction in which the display panel 110 displays images via the lens array 120 is the z-axis. The processing circuit 140 may calculate the rotation matrices R.sub.EL and R.sub.ER corresponding to the lens arrays 121 and 122 according to the actual eye position X.sub.E (the left eye X.sub.EyeL or the right eye X.sub.EyeR) and the compensation vector t via the above formulas (16) and (17). The processing circuit 140 may then calculate the rotation angle θ.sub.z in the rotation matrices R.sub.EL and R.sub.ER according to the rotation matrix R.sub.z(θ.sub.z) independently rotating the z-axis in the above formula (15). As a result, the liquid crystal rotation angle of the lens array 121 and the liquid crystal rotation angle of the lens array 122 may be adjusted separately.

[0044] FIG. 7 is a schematic diagram of the hardware architecture of a stereoscopic display device 200 according to another embodiment of the invention. In the embodiment shown in FIG. 7, the stereoscopic display device 200 includes the display panel 110, the lens array 120, the image sensor 130, and the processing circuit 140. In particular, the implementation of the display panel 110, the lens array 120, and the image sensor 130 may be analogized with reference to the related descriptions of the display panel 110, the lens array 120, and the image sensor 130 shown in FIG. 1 and FIG. 2, and is therefore not repeated herein. In some embodiments, the processing circuit 140 may include a memory 141, a processor 142, an analog-to-digital conversion circuit 143, a timing controller 144, and/or a scaling circuit 145. In particular, the implementation of the processor 142 may be analogized with reference to the relevant description of the processing circuit 140 shown in FIG. 1 and FIG. 2. In some embodiments, the stereoscopic display device 200 may further include a backlight module 150. In particular, the embodiments of the memory 141, the analog-to-digital conversion circuit 143, the timing controller 144, the scaling circuit 145, and the backlight module 150 may be constructed by an image display device known to those with ordinary skill in the art, and the present embodiment is not limited in this regard.

[0045] FIG. 8 is a schematic diagram of a portion of the structure of a stereoscopic display device according to an embodiment of the invention. The display panel 110 and/or the lens array 120 shown in FIG. 8 may be used as an implementation example of the display panel 110 and/or the lens array 120 in the stereoscopic display device 100 shown in FIG. 1 and FIG. 2, or as an implementation example of the display panel 110 and/or the lens array 120 in the stereoscopic display device 200 shown in FIG. 7. In the embodiment shown in FIG. 8, the display panel 110 may include a switching liquid crystal layer SLC, a polarized coating PC, and a plurality of display pixels DP sequentially disposed in an overlapping manner. The lens array 120 may include a glass substrate GS1, a liquid crystal layer LC, and a glass substrate GS2 sequentially disposed in an overlapping manner. The liquid crystal rotation angle of the liquid crystal layer LC in the lens array 120 may be adjusted to change the light transmission direction of the image displayed by the display pixels DP. In particular, the implementation of each element may be constructed by a stereoscopic display device known to those with ordinary skill in the art, and the present embodiment is not limited in this regard.

[0046] Based on the above, the stereoscopic display devices 100 and 200 of the embodiments of the invention may acquire the sensed image I2 of the viewing field FD of the display panel 110 via the image sensor 130, and calculate the actual eye position X.sub.E of the user in the viewing field FD according to the reference position Cs and the eye position C.sub.G in the sensed image I2 via the processing circuit 140, so as to adjust the liquid crystal rotation angle of the lens array 120 according to the actual eye position X.sub.E. In this way, the viewing position of the three-dimensional image I1 displayed by the display panel 110 may match the actual eye position X.sub.E, thereby optimizing user experience.

[0047] Although the invention has been described with reference to the above embodiments, it will be apparent to one of ordinary skill in the art that modifications to the described embodiments may be made without departing from the spirit of the disclosure. Accordingly, the scope of the disclosure is defined by the attached claims not by the above detailed descriptions.