Method and device for delivering a content

Abstract

This method for delivering a multimedia content, said multimedia content including at least one second content, includes, during the rendering of the multimedia content, detecting a start of the second content, performing a fast-forward with a controlled speed during the rendering of the second content, in which the speed is controlled such that at least one representative frame of the second content is completely rendered, detecting an end of the second content, and stopping the fast-forward.

Claims

1. A method, implemented by a renderer device, for delivering a multimedia content, the multimedia content including at least one second content, the method comprising, during rendering of the multimedia content: detecting, by the renderer device, a start of the second content; performing, by the renderer device, a fast-forward with a controlled variable speed during the rendering of the second content, in which the speed is controlled such that at least one representative frame of the second content is completely rendered; detecting, by the renderer device, an end of the second content; and stopping, by the renderer device, the fast-forward.

2. The method of claim 1, further comprising monitoring metadata associated with the multimedia content.

3. The method of claim 2, wherein the metadata contain information related to: the start and end time of the second content; the position of the representative frame in the second content.

4. The method of claim 2, wherein the multimedia content is a video stream and the metadata includes manifest files.

5. The method of claim 2, wherein the multimedia content is a broadcast content and the metadata is embedded in-band or out-of-band.

6. The method of claim 1, wherein the speed of fast-forward is controlled according to a normal distribution if the second content includes at least one representative frame positioned at the beginning of the second content and at least one representative frame positioned at the end of the second content.

7. The method of claim 1, wherein the speed of fast-forward is controlled according to an exponential distribution if the second content includes at least one representative frame positioned only at the beginning of the second content.

8. The method of claim 1, wherein the speed of fast-forward is controlled according to a negative exponential distribution if the second content includes at least one representative frame positioned only at the end of the second content.

9. The method of claim 1, wherein, when the second content includes a plurality of representative frames distributed at a plurality of positions of the second content, the method includes: splitting the second content into a plurality of samples, in which each representative frame is positioned at the end of a corresponding sample; and controlling the speed of fast-forward according to a negative exponential distribution within each sample.

10. The method of claim 1, wherein the speed of fast-forward depends on the duration of the second content.

11. A renderer device, for delivering a multimedia content, the multimedia content including at least one second content, the renderer device comprising at least one processor configured, during rendering of the multimedia content, to: detect a start of the second content; perform a fast-forward with a controlled variable speed during the rendering of the second content, in which the speed is controlled such that at least one representative frame of the second content is completely rendered; detect an end of the second content; and stop the fast-forward.

12. The renderer device of claim 11, wherein the renderer device is set-top box or a television set or a digital video recorder, DVR, or a tablet or a smart-phone.

13. A non-transitory computer-readable medium storing computer-executable instructions to enable a computer to: detect a start of a second content, wherein a multimedia content includes the second content; perform a fast-forward with a controlled variable speed during rendering of the second content, in which the speed is controlled such that at least one representative frame of the second content is completely rendered; detect an end of the second content; and stop the fast-forward.

14. The method of claim 1, wherein the speed of fast-forward is further controlled such that at least one representative frame positioned at the beginning of the second content is completely rendered and such that at least one representative frame positioned at the end of the second content is completely rendered.

15. The method of claim 1, wherein the speed of fast-forward is controlled according to an exponential distribution.

16. The method of claim 1, wherein the multimedia content is a live program, and wherein performing the fast-forward comprises rendering a portion of the multimedia to catch up with the live program.

17. The renderer device of claim 11, wherein the at least one processor is further configured to monitor metadata associated with the multimedia content.

18. The renderer device of claim 11, wherein the at least one processor is further configured, when the second content includes a plurality of representative frames distributed at a plurality of positions of the second content, to: split the second content into a plurality of samples, in which each representative frame is positioned at the end of a corresponding sample; and control the speed of fast-forward according to a negative exponential distribution within each sample.

19. The renderer device of claim 11, wherein the speed of fast-forward depends on the duration of the second content.

20. The renderer device of claim 11, wherein the multimedia content is a live program, and wherein performing the fast-forward comprises rendering a portion of the multimedia to catch up with the live program.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

(1) The present invention is illustrated by way of examples, and not by way of limitation, in the figures of the accompanying drawings, in which like reference numerals refer to similar elements and in which:

(2) FIG. 1, already described, is a schematic view showing the existing use of a trick mode to skip a secondary content;

(3) FIG. 2 is a schematic view showing the use of the trick mode according to an embodiment of the present disclosure;

(4) FIG. 3 is a flowchart is a flowchart showing the steps of the method for delivering a multimedia content according to an embodiment of the present disclosure; and

(5) FIG. 4 is a schematic view illustrating a renderer device, according to an embodiment of the present disclosure.

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS

(6) FIG. 2 shows the renderings, i.e. the playing of the recorded first content 2, i.e. the primary content, in which is inserted a series of advertisements 4, 6, 8, 10 constituting a second content, i.e. the secondary content.

(7) According to the present disclosure, as soon as the start of the second content is detected, the trick mode is triggered either automatically or further to a request of the user. The trick mode rate representing the speed of fast-forward is controlled or varied automatically during the playing of the second content.

(8) According to a first embodiment, the variation of the speed of the fast-forward playing follows a distribution function represented by the curve 12, such that at least one representative frame of the whole second content containing the advertisements 4, 6, 8, 10 is completely rendered.

(9) Here, it is meant by representative frame a critical frame that is considered by the provider as important to be seen by the user. In the case of an advertisement, it may for example show the name of the advertised product or service.

(10) According to a second embodiment, the variation of the speed of the fast-forward playing follows a distribution function represented by the curve 14, such that at least one representative frame of each advertisement 4, 6, 8, 10 is completely rendered.

(11) Advantageously, the speed of fast-forward is varied according to a normal distribution if the second content includes at least one representative frame positioned at the beginning and at least one representative frame positioned at the end of the second content. The peak trick mode rate happens in the middle of the total time of the second content duration. As the time goes beyond the middle, the trick mode rate decreases from 32× to 0× based on a normal distribution.

(12) For example, any advertisement within the 1st standard deviation of the normal distribution would be the highest trick mode rate of 32×. Then, the timestamp between the first and the second standard deviation would have the next level trick mode of 16× while the timestamp between the 2nd and 3rd standard deviation content would have an 8× trick mode. Then after the 4th or 5th standard deviation, the play of the first content starts.

(13) However, if the representative frames appear only at the beginning of the second content, the speed of fast-forward is advantageously varied according to an exponential distribution.

(14) Similarly, if the representative frames appear only at the end of the second content, the speed of fast-forward is advantageously varied according to a negative exponential distribution.

(15) According to an embodiment, if none of the distribution algorithm applies, i.e. when the second content includes a plurality of representative frames distributed at a plurality of positions of the second content, the second content is split into a plurality of samples, in which each representative frame is positioned at the end of a corresponding sample and the speed of fast-forward is varied according to a negative exponential distribution within each sample.

(16) Advantageously, the granularity of trick mode rates is calculated based on the duration of the secondary content rendering. If this duration is high, the trick mode rates may vary up to 32× whereas if the range is low, the trick mode rates may vary only up to 8×.

(17) Table 1 provides the approximation durations of the rendering of secondary contents of 1 and 2 minutes for different trick mode rates:

(18) TABLE-US-00001 TABLE 1 Approx. Duration Approx. Duration Trick mode Frames per for a 1 min for a 2 min rate second secondary content secondary content X  30 FPS 64 128  2X  60 FPS 32 64  4x 120 FPS 16 32  8X 240 FPS 8 16 16X 480 FPS 4 8 32X 960 FPS 2 4

(19) Thus, based on the capability of the renderer device and on the user's preference, the maximum speed used for playing that the secondary content using a track mode may be decided based on Table 1.

(20) Also, as represented in FIG. 2, it may be advantageous to make the variation of the speed of the fast-forward playing follow a distribution function represented by the curve 14, i.e. a succession of curves following one of the above described distributions, such that at least one representative frame of each advertisement 4, 6, 8, 10 is completely rendered.

(21) The flowchart of FIG. 3 illustrates the steps of the method for delivering multimedia content according to an embodiment of the present disclosure.

(22) According to this embodiment, the method of the present disclosure uses metadata associated with the multimedia content.

(23) Preferably, these metadata include the start time and end time of each of the first content and the second content, and timestamps of the representative frames in the second content.

(24) These metadata are inserted in the form of a file, such as the following MAP file which is typically a plain text file with a .MAP extension:

(25) TABLE-US-00002 <Start Timestamp>-<End Timestamp> <1:10>-<1:40> <10:45>-<11:20> <15:45> <16:00> <16:05> <16:17> <16:19> <16:22> <22:00>

(26) This indicates that from the start of the second content, at the time offset of 1:10 to 1:40 and at the time offset of 10:45 to 11:20 there are representative frames that must be played at a normal play speed. There are also representative frames at each of the other indicated timestamps above.

(27) The MAP file may be sent directly to the rendered device. This is preferably the case, for example, in an IP based transmission system such as Adaptive Bit Rate (ABR) streaming or Over The Top (OTT) video delivery, where REST (REpresentational State Transfer) Application Program Interfaces (API) are used.

(28) The renderer device may also generate the MAP file at its side. For example, in the case where the metadata is inserted in an MPEG-2 content, the renderer device generates the MAP file by parsing the MPEG-2 content.

(29) For Adaptive BitRate (ABR) content which is generally the video that is streamed via HTTP, the metadata content is in the form of manifest files in which the representative frame information is inserted.

(30) Thus, when playing the multimedia content, the renderers device monitors, at step 20, the metadata associated with the content. This step may consist on reading the MAP file described above.

(31) Then, at step 22, using the start time of the second content included in the metadata, the renderer device detects the start of the second content and triggers the trick mode playing.

(32) At step 24, using the time positions of the representative frames included in the metadata, the renderer device performs a fast-forward with a varying speed during the playing of the second content. The renderer device varies automatically the speed, without any user intervention, such that at least one representative frame of the second content is completely rendered.

(33) Then, at step 26, using the end time of the second content included in the metadata, the renderer device detects the end of the second content and stops the trick mode playing.

(34) FIG. 4 is a block diagram of an exemplary embodiment of a renderer device 30 implementing the method of the present disclosure.

(35) Advantageously, the renderer device 30 includes one or more processors 32 and a memory 34.

(36) The renderer device 30 includes:

(37) a detecting module 36 configured to detect a start and/or an end of the second content; and

(38) a fast-forward module 38 configured to perform a fast-forward with a varying speed during the rendering of the second content.

(39) According, to an embodiment the renderer device 30 also includes a metadata module 40 configured to read a file of metadata received by the rendered device 30 and stored in the memory 34 and/or to generate a file of metadata.

(40) These modules are advantageously implemented by the CPU 32.

(41) According to the represented embodiment, a bus 42 provides a communications path between various elements of the device 30. Other point-to-point interconnection options (e.g. non-bus architecture) are also feasible.

(42) While there has been illustrated and described what are presently considered to be the preferred embodiments of the present invention, it will be understood by those skilled in the art that various other modifications may be made, and equivalents may be substituted, without departing from the true scope of the present invention. Additionally, many modifications may be made to adapt a particular situation to the teachings of the present invention without departing from the central inventive concept described herein. Furthermore, an embodiment of the present invention may not include all of the features described above. Therefore, it is intended that the present invention is not limited to the particular embodiments disclosed, but that the invention includes all embodiments falling within the scope of the appended claims.

(43) Expressions such as “comprise”, “include”, “incorporate”, “contain”, “is” and “have” are to be construed in a non-exclusive manner when interpreting the description and its associated claims, namely construed to allow for other items or components which are not explicitly defined also to be present. Reference to the singular is also to be construed to be a reference to the plural and vice versa.

(44) A person skilled in the art will readily appreciate that various parameters disclosed in the description may be modified and that various embodiments disclosed and/or claimed may be combined without departing from the scope of the invention.

(45) For example, even if the above description considered advertisements as the main example of second content, the present disclosure method may be implemented for other cases of second content.

(46) For instance, in the case where the content is a comedy in which there are some music parts, the music parts may be considered as a second content that the user wishes to skip by applying the present disclosure teachings.

(47) According to an embodiment, further to having a default setting considering the advertisements and promotional videos as secondary content, a other user settings may be implemented so that the user has the possibility to indicate either content that interests him or content that he wants to avoid and that will be considered as a secondary content. This is preferably based on the genre preferences indicated by the user.

(48) For instance, the user may decide to skip action or comedy or romance or songs or any other genre frames within a media content.

(49) Also, the method of the present disclosure may be used in the case of catch-up of live TV. From the moment that the user presses “pause” to the moment where he tries to catch-up, the above method may be used for the viewing of a secondary content within the live program.

(50) According to a variant, especially in the absence of metadata associated with the multimedia content, the user may indicate the start of the second content to the renderer device, which triggers the execution of the method of the disclosure. The user also indicates the end of the second content. This means that the detecting steps of the start and end of the second content correspond to the reception of the indications of start and end from the user.