Method of display control and related display driver circuit and application processor
20230072161 · 2023-03-09
Assignee
Inventors
Cpc classification
G09G2300/0417
PHYSICS
G09G2360/18
PHYSICS
G09G2340/16
PHYSICS
G09G2340/0435
PHYSICS
G09G3/2096
PHYSICS
G09G2370/10
PHYSICS
G09G3/20
PHYSICS
International classification
G09G3/20
PHYSICS
Abstract
The present invention provides a method of display control for a display driver circuit operated in a video mode. The method includes steps of: driving a display panel to display a plurality of image frames having a plurality of active frames and a plurality of blanking frames, and determining whether to transmit a notification to an application processor to indicate whether the application processor needs to output image data according to whether an incoming image frame among the plurality of image frames is one of the plurality of active frames or one of the plurality of blanking frames. Wherein, the display panel is refreshed in each of the plurality of active frames, and not refreshed in each of the plurality of blanking frames.
Claims
1. A method of display control for a display driver circuit, the display driver circuit being operated in a video mode, the method comprising: driving a display panel to display a plurality of image frames having a plurality of active frames and a plurality of blanking frames; and determining whether to transmit a notification to an application processor to indicate whether the application processor needs to output image data according to whether an incoming image frame among the plurality of image frames is one of the plurality of active frames or one of the plurality of blanking frames; wherein the display panel is refreshed in each of the plurality of active frames, and not refreshed in each of the plurality of blanking frames.
2. The method of claim 1, wherein the step of determining whether to transmit the notification to the application processor to indicate whether the application processor needs to output the image data according to whether the incoming image frame is one of the plurality of active frames or one of the plurality of blanking frames comprises: transmitting a first notification to the application processor to notify the application processor to output the image data when the incoming image frame is one of the plurality of active frames.
3. The method of claim 2, wherein the step of determining whether to transmit the notification to the application processor to indicate whether the application processor needs to output the image data according to whether the incoming image frame is one of the plurality of active frames or one of the plurality of blanking frames further comprises: transmitting a second notification different from the first notification to the application processor to notify the application processor to stop outputting the image data when the incoming image frame is one of the plurality of blanking frames.
4. The method of claim 1, further comprising: stopping transmitting the notification to the application processor when the incoming image frame is one of the plurality of blanking frames.
5. The method of claim 1, wherein the notification is transmitted through an interface between the display driver circuit and the application processor used for delivering the image data.
6. The method of claim 1, wherein the notification is transmitted through a general purpose output (GPO) pin.
7. The method of claim 1, wherein the notification for a first active frame among the plurality of active frames is carried in the first active frame or a previous image frame previous to the first active frame.
8. The method of claim 1, further comprising: receiving a command from the application processor, wherein the command indicates whether the application processor needs to proactively output the image data.
9. The method of claim 8, wherein the plurality of image frames are allocated to a plurality of skip sequences, each having at least one of the plurality of active frames and at least one of the plurality of blanking frames, and the method further comprises: interrupting a present skip sequence among the plurality of skip sequences and starting an active frame of a next skip sequence among the plurality of skip sequences when the received command indicates that the application processor needs to proactively output the image data.
10. The method of claim 1, wherein the plurality of image frames are allocated to a plurality of skip sequences according to a skip mode of the display panel, and the method further comprises: receiving a mode change signal from the application processor; and controlling the skip mode of the display panel according to the mode change signal.
11. A display driver circuit, configured to be coupled to an application processor and a display panel, the display driver circuit being operated in a video mode and configured to: drive the display panel to display a plurality of image frames having a plurality of active frames and a plurality of blanking frames; and determine whether to transmit a notification to the application processor to indicate whether the application processor needs to output image data according to whether an incoming image frame is one of the plurality of active frames or one of the plurality of blanking frames; wherein the display panel is refreshed in each of the plurality of active frames, and not refreshed in each of the plurality of blanking frames.
12. A method of display control for an application processor, the application processor being configured to control a display driver circuit operated in a video mode, the method comprising: providing a plurality of image frames for the display driver circuit to be displayed on a display panel; outputting first image data for a first image frame among the plurality of image frames to the display driver circuit; and after outputting the first image data, determining whether to transmit a command to the display driver circuit for a second image frame among the plurality of image frames, to indicate whether the application processor is configured to proactively output second image data for the second image frame.
13. The method of claim 12, wherein the step of determining whether to transmit the command to the display driver circuit for the second image frame among the plurality of image frames to indicate whether the application processor is configured to proactively output the second image data for the second image frame comprises: transmitting a first command to the display driver circuit for the second image frame when the application processor is configured to output the second image data for the second image frame, wherein the second image data are different from the first image data.
14. The method of claim 13, wherein the step of determining whether to transmit the command to the display driver circuit for the second image frame among the plurality of image frames to indicate whether the application processor is configured to proactively output the second image data for the second image frame further comprises: transmitting a second command different from the first command to the display driver circuit for the second image frame when the application processor is configured to output the second image data for the second image frame, wherein the second image data are identical to the first image data.
15. The method of claim 13, wherein the step of determining whether to transmit the command to the display driver circuit for the second image frame among the plurality of image frames to indicate whether the application processor is configured to proactively output the second image data for the second image frame further comprises: transmitting a second command different from the first command to the display driver circuit for the second image frame when the application processor is configured to not output any image data for the second image frame.
16. The method of claim 12, wherein the step of determining whether to transmit the command to the display driver circuit for the second image frame among the plurality of image frames to indicate whether the application processor is configured to proactively output the second image data for the second image frame comprises: stopping transmitting the command to the display driver circuit for the second image frame when the application processor is configured to output the second image data for the third image frame, wherein the second image data are identical to the first image data.
17. The method of claim 12, wherein the step of determining whether to transmit the command to the display driver circuit for the second image frame among the plurality of image frames to indicate whether the application processor is configured to proactively output the second image data for the second image frame comprises: stopping transmitting the command to the display driver circuit for the second image frame when the application processor is configured to not output any image data for the second image frame.
18. The method of claim 12, wherein the command is transmitted through an interface between the display driver circuit and the application processor used for delivering the image data.
19. The method of claim 12, wherein the command is transmitted through a general purpose output (GPO) pin.
20. The method of claim 12, wherein the command for the second image frame is carried in the second image frame or a previous image frame previous to the second image frame.
21. The method of claim 12, further comprising: receiving a notification from the display driver circuit, wherein the notification indicates whether the display panel needs to be refreshed.
22. The method of claim 12, wherein the plurality of image frames are allocated to a plurality of skip sequences, each having at least one active frame and at least one blanking frame, and wherein the command instructs the display driver circuit to interrupt a present skip sequence among the plurality of skip sequences and start an active frame of a next skip sequence among the plurality of skip sequences when the command indicates that the application processor is configured to proactively output the second image data.
23. The method of claim 12, wherein the plurality of image frames are allocated to a plurality of skip sequences according to a skip mode of the display panel, and the method further comprises: transmitting a mode change signal to the display driver circuit, to instruct the display driver circuit to control the skip mode of the display panel.
24. An application processor, configured to be coupled to a display driver circuit and a display panel, the display driver circuit being operated in a video mode, and the application processor being configured to: provide a plurality of image frames for the display driver circuit to be displayed on the display panel; output first image data for a first image frame among the plurality of image frames to the display driver circuit; and after the first image data are output, determine whether to transmit a command to the display driver circuit for a second image frame among the plurality of image frames, to indicate whether the application processor is configured to proactively output second image data for the second image frame.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0014]
[0015]
[0016]
[0017]
[0018]
[0019]
[0020]
DETAILED DESCRIPTION
[0021] Please refer to
[0022] In detail, each skip sequence SEQ1-SEQ5 may have one or more active frames (ACT) and one or more blanking frames (BLK). The panel is refreshed in the active frame(s) and is not refreshed in the blanking frame(s). If the frame rate equals 60 Hz in the normal display mode, in order to realize the extremely low frame rate such as 1 Hz, there may be 1 active frame and 59 blanking frames in the repeated skip sequence SEQ5. In other words, the panel may be refreshed in only one of every 60 image frames as the skip sequence SEQ5 is performed repeatedly.
[0023] Please refer to
[0024] In an embodiment, the display driver circuit 202 may be implemented in an integrated circuit (IC) to be realized as a display driver IC. In addition, the display driver IC may be integrated with touch sensing functions to realize a touch and display driver IC (TDDI), or further integrated with fingerprint sensing functions to realize a fingerprint, touch and display driver IC (FTDI). The AP 200 may be, but not limited to, a central processing unit (CPU), microprocessor, microcontroller unit (MCU), or any other type of processing circuit of an electronic device. In the embodiments of the present invention, the display system may be operated in the video mode, where there is no frame buffer included in the display driver circuit 202, and the AP 204 should output the image data when the display panel 200 needs to be refreshed.
[0025] Please note that the display sequence of the LTPO panel is configured in the display driver circuit 202; that is, the display driver circuit 202 may control the flow of the skip sequences with configurations of the active frames and the blanking frames. In the prior art, the AP 204 may not know when to output image data in the video mode because it is not aware of the information of the skip sequences. In order to solve this problem, the display driver circuit 202 may transmit a notification to the AP 204, to indicate whether the AP 204 needs to output image data according to whether an incoming image frame is the active frame or the blanking frame. In other words, the notification may carry the information associated with the active frame and the blanking frame, and thus the AP 204 will output the image data only when the notification indicates that the incoming image frame is the active frame.
[0026] Sometimes the AP 204 may need to proactively output image data. For example, the AP 204 may need to update the image content when the user activates a specific event to modify the displayed image. In such a situation, the AP 204 may transmit a command to the display driver circuit 202, to indicate whether the AP 204 needs to proactively output the image data, i.e., update the image content.
[0027] As can be seen, the display panel 200 is driven by the display driver circuit 202 while the image data are output from the AP 204. The present invention provides a communication scheme that allows the display driver circuit 202 and the AP 204 to negotiate with each other to appropriately output image data, so as to successfully control the panel refresh in the extremely low frame rate when the display system and the display driver circuit 202 are operated in the video mode.
[0028] In general, the AP 204 may deliver the image data to the display driver circuit 202 through a transmission interface. Examples of the transmission interface may include, but not limited to, the Mobile Industry Processor Interface (MIPI), Serial Peripheral Interface (SPI), and Inter-Integrated Circuit (I2C) interface. This transmission interface may usually be a bidirectional interface. In an embodiment, the display driver circuit 202 and the AP 204 may communicate with each other through this interface used for delivering the image data, as shown in
[0029] In another embodiment, the notification NTF and the command CMD may be transmitted in another manner. For example, as shown in
[0030] When the notification NTF and/or the command CMD are sent through the interface for delivering image data, the notification NTF and/or the command CMD may be carried in the blanking interval in which no valid image data are transmitted. For example, the command CMD may be carried in a front porch or a back porch in the image data format, and/or may be indicated in a horizontal synchronization start (HSS) packet, a vertical synchronization start (VSS) packet, or a vertical synchronization end (VSE) packet.
[0031] In another embodiment, the display driver circuit 202 may transmit a notification NTF to the AP 204 through the GPO pin of the display driver circuit 202, while the AP 204 may transmit a command CMD to the display driver circuit 202 through the interface for delivering image data, as shown in
[0032] Please refer to
[0033] Each skip sequence SEQ1-SEQ5 includes one or more active frames and one or more blanking frames. The arrangements of the active frames and the blanking frames are also shown in
[0034] As mentioned above, the display driver circuit 202 may transmit the notification NTF to the AP 204, to indicate whether the incoming image frame is the active frame or the blanking frame. In this embodiment as shown in
[0035] Please refer to
[0036] Step 400: Start.
[0037] Step 402: Drive the display panel to display a plurality of image frames having a plurality of active frames and a plurality of blanking frames.
[0038] Step 404: Determine whether to transmit a notification to an AP to indicate whether the AP needs to output image data according to whether an incoming image frame among the plurality of image frames is one of the plurality of active frames or one of the plurality of blanking frames.
[0039] Step 406: End.
[0040] According to the display control process 40, the display driver circuit may drive the display panel to display image frames, which consist of the active frames and the blanking frames in the skip mode, where the display panel is refreshed in the active frame and is not refreshed in the blanking frame. In this embodiment, the display driver circuit is operated in the video mode and deployed with no frame memory; hence, the AP may output image data only when the display panel needs to refresh the image frames (i.e., the active frames). The display driver circuit thereby determines whether to transmit the notification to the AP, to indicate whether the AP needs to output the image data according to whether the incoming image frame is the active frame or the blanking frame.
[0041] A detailed implementation of the display control process 40 is illustrated in
[0042] Subsequently, when the display system determines to enter the skip mode, the AP may send a command to the display driver circuit. Upon receiving this command, the display driver circuit may start the display sequence in the skip mode consisting of the skip sequences SEQ1-SEQ5, to go through the skip sequences SEQ1-SEQ4 by one time and then repeatedly perform the skip sequence SEQ5. The table in
[0043] The display driver circuit may determine whether to transmit the notification to the AP to indicate whether the incoming image frame is the active frame or the blanking frame through the GPO pin. Note that the display panel is refreshed in the active frame and is not refreshed in the blanking frame; hence, the notification may indicate whether the display panel needs to be refreshed in the incoming image frame. In an embodiment, the display driver circuit may transmit a notification when the incoming image frame is the active frame, and stop transmitting the notification when the incoming image frame is the blanking frame. The notification may be realized as a toggle or a pulse on the GPO pin. As shown in
[0044] In this embodiment, the AP outputs the image data A for each active frame, which means that the AP does not proactively update the image data and thus the same image data A are continuously output. Correspondingly, the AP may transmit the command CMDA for each image frame, to indicate that the image data need not to be updated. In detail, the AP may transmit the command CMDA in the vertical front porch (VFP) of the previous frame, to indicate that the image data output in the current frame are identical to those image data previously output (i.e., the image data A), or indicate that there are no image data output in the current frame.
[0045] Please refer to
[0046] Step 600: Start.
[0047] Step 602: Provide a plurality of image frames for the display driver circuit to be displayed on a display panel.
[0048] Step 604: Output first image data for a first image frame among the plurality of image frames to the display driver circuit.
[0049] Step 606: Determine whether to transmit a command to the display driver circuit for a second image frame among the plurality of image frames, to indicate whether the AP is configured to proactively output second image data for the second image frame.
[0050] Step 608: End.
[0051] According to the display control process 60, the AP may determine whether to transmit a command to the display driver circuit, to indicate whether the AP needs to proactively output the image data. More specifically, when the AP needs to update the image data, the AP may transmit the command correspondingly. In the above embodiment shown in
[0052] Please refer to
[0053] As shown in
[0054] Please note that the present invention aims at providing a novel display control method applicable to the display driver circuit and the AP. Those skilled in the art may make modifications and alterations accordingly. For example, the numbers of active frames and blanking frames in each skip sequence may be configured flexibly. In an embodiment, the numbers of active frames and blanking frames may be configured based on the display characteristics of the panel, and/or based on the frame rate value to be achieved in the skip mode. The frame counts ACT_NUM and BLK_NUM recorded in the tables in the above embodiments are merely served to illustrate an example, and this should not be a limitation of the scope of the present invention. In addition, the number of transitional skip sequences may also be configured flexibly. Also, the embodiments of the present invention are applicable to any types of display panels capable of realizing the extremely low frame rate by refreshing partial image frames. These types of display panels may include, but not limited to, the LTPO panel.
[0055] Further, in the above embodiments, the command sent by the AP for the current image frame is carried in the VFP of the previous image frame, but the implementation of the command transmission is not limited thereto. As shown in the zoom-in diagrams of
[0056] In another embodiment, the notification sent by the display driver circuit may be transmitted through the interface for delivering image data, to be carried in the VBP, VFP, or any other blanking interval. In addition, the display driver circuit may provide different types of notifications for the active frame and the blanking frame. For example, the display driver circuit may transmit a first notification to the AP if the incoming image frame is the active frame, and transmit a second notification different from the first notification to the AP if the incoming image frame is the blanking frame. The AP thereby determines whether to output image data by recognizing the received notification.
[0057] Similarly, although the commands sent by the AP are transmitted through the interface for delivering image data in the embodiments shown in
[0058]
[0059] As shown in
[0060] In an embodiment, the display panel such as an LTPO panel may be configured with multiple low frame rates, which may be applicable to different scenarios. Therefore, different applications may use different skip modes so as to achieve different frame rates. For example, the frame rate may be decreased to 10 Hz in the first skip mode and 5 Hz in the second skip mode. The display panel will enter the first skip mode when an application requesting 10 Hz frame rate is open, and enter the second skip mode when another application requesting 5 Hz frame rate is open. Therefore, in the display system of the present invention, the display panel may be configured with any number of skip modes, and switched between the skip modes flexibly based on the control of the AP. The AP may transmit the mode change signal to notify the display driver circuit to change the skip mode. In an embodiment, the mode change signal may carry information indicating which skip mode the display panel will enter, and the display driver circuit may control the display sequence correspondingly.
[0061]
[0062]
[0063] As shown in
[0064] Another difference between
[0065]
[0066] Please note that the embodiments shown in
[0067] To sum up, the present invention provides a novel display control method applicable to the display driver circuit and the AP, where the display driver circuit and the AP may negotiate with each other to appropriately control the panel refresh when the display system is operated in the video mode. As for a display panel capable of realizing a low frame rate in the skip mode by refreshing in partial image frames such as the LTPO panel, the AP is requested to output the image data only when the image frame needs to be refreshed. Therefore, the display driver circuit may determine whether to transmit a notification to the AP, to indicate whether the image frame needs to be refreshed based on the display sequence of the skip mode. Sometimes the AP may need to proactively update the image data, and the AP may determine whether to transmit a command to the display driver circuit, to indicate whether the AP needs to proactively output the image data. In an embodiment, the command and/or the notification may be sent through the interface used for delivering image data, and/or may be sent through a GPO pin. As a result, the operations of the AP and the display driver circuit will be well synchronized, so as to refresh the display panel appropriately in the skip mode.
[0068] Those skilled in the art will readily observe that numerous modifications and alterations of the device and method may be made while retaining the teachings of the invention. Accordingly, the above disclosure should be construed as limited only by the metes and bounds of the appended claims.