Video stream transmission method and related device and system

Abstract

The present disclosure disclose example video stream transmission methods and related devices and systems. One example method includes sending, by a client, a target request to a server, where the target request includes information about a corresponding target spatial location of a target spatial object that needs to be presented upon request by the client in a virtual reality VR content component. A target request feedback by which the server responds to the target request is received by the client, where the target request feedback includes information about a multiplex video stream that is obtained by performing preset multiplexing processing on an original video stream corresponding to the target spatial object. Video parsing and presentation based on the information about the multiplex video stream is performed by the client.

Claims

1. A video stream transmission method, comprising: sending, by a client terminal device, a target request to a server, wherein the target request comprises information about a corresponding target spatial location of a target spatial object that needs to be presented upon request by the client terminal device in a virtual reality VR content component; receiving, by the client terminal device, a target request feedback by which the server responds to the target request, wherein the target request feedback comprises information about a multiplex video stream that is obtained by performing preset multiplexing processing on an original video stream corresponding to the target spatial object; and performing, by the client terminal device, video parsing and presentation based on the information about the multiplex video stream, wherein the information about the multiplex video stream comprises information about N multiplexed sub-video streams that are respectively obtained by performing preset multiplexing processing on N sub-video streams, wherein the N sub-video streams are corresponding sub-video streams generated by dividing the target spatial object into N sub-spatial objects and dividing the original video stream based on the N sub-spatial objects, wherein N is a natural number greater than 1, wherein the target request feedback further comprises multiplexing description information, and wherein the multiplexing description information comprises at least one of the following: a quantity N of the sub-video streams that is comprised in the information about the multiplex video stream; a starting location offset in the information about the multiplex video stream of a starting sub-video stream of the N sub-video streams; a size of the N multiplexed sub-video streams, spatial location information in the VR content component respectively corresponding to the N multiplexed sub-video streams; resolution information of the N multiplexed sub-video streams; a video stream multiplexing type of the N multiplexed sub-video streams; or resolution information of the N sub-video streams.

2. The method according to claim 1, wherein the multiplexing description information further comprises: spatial location information, in the VR content component, respectively corresponding to the N sub-video streams.

3. The method according to claim 1, wherein the target request further comprises at least one of: region of interest (ROI) information, bandwidth information of the client, information about a decoding standard supported by the client, and information about a maximum video resolution of the client.

4. The method according to claim 1, wherein the preset multiplexing processing comprises at least one of binary head-to-tail splicing processing on the video stream, binary head-to-tail splicing of video segments, or sample interleaving multiplexing processing.

5. A video stream transmission method, comprising: receiving, by a server, a target request sent by a client terminal device, wherein the target request comprises information about a corresponding target spatial location of a target spatial object that needs to be presented upon request by the client terminal device in a virtual reality VR content component; searching, by the server based on the target spatial location information, for the corresponding target spatial object in the VR content component; obtaining, by the server, information about a multiplex video stream that is obtained by performing preset multiplexing processing on an original video stream corresponding to the target spatial object; and sending, by the server, a target request feedback to the client in response to the target request, wherein the target request feedback comprises the information about the multiplex video stream, wherein the obtaining, by the server, information about a multiplex video stream that is obtained by performing preset multiplexing processing on an original video stream corresponding to the target spatial object comprises: dividing, by the server, the target spatial object into N sub-spatial objects, and dividing the original video stream based on the N sub-spatial objects, to generate N corresponding sub-video streams, wherein N is natural number greater than 1; and obtaining, by the server, information about N multiplexed sub-video streams that are obtained by separately performing the preset multiplexing processing on the N sub-video streams.

6. The method according to claim 5, wherein the target request feedback further comprises multiplexing description information, and wherein the multiplexing description information comprises at least one of the following: a quantity N of the sub-video streams that is comprised in the information about the multiplex video stream; a starting location offset, in the information about the multiplex video stream, of a starting sub-video stream of the N sub-video streams; a size of the N multiplexed sub-video streams; spatial location information, in the VR content component, respectively corresponding to the N multiplexed sub-video streams; resolution information of the N multiplexed sub-video streams; a video stream multiplexing type of the N multiplexed sub-video streams; or resolution information of the N sub-video streams.

7. The method according to claim 6, wherein the multiplexing description information further comprises: spatial location information, in the VR content component, respectively corresponding to the N sub-video streams.

8. The method according to claim 5, wherein the preset multiplexing processing comprises binary head-to-tail splicing processing on the video stream, binary head-to-tail splicing of video segments, or sample interleaving multiplexing processing.

9. A client terminal device, comprising: at least one processor; a non-transitory computer-readable storage medium coupled to the at least one processor and storing programming instructions for execution by the at least one processor, wherein the programming instructions instruct the at least one processor to: send a target request to a server, wherein the target request comprises information about a corresponding target spatial location, of a target spatial object that needs to be presented upon request by the client terminal device, in a virtual reality VR content component; receive a target request feedback by which the server responds to the target request, wherein the target request feedback comprises information about a multiplex video stream that is obtained by performing preset multiplexing processing on an original video stream corresponding to the target spatial object; and perform video parsing and presentation based on the information about the multiplex video stream, wherein the information about the multiplex video stream comprises information about N multiplexed sub-video streams that are respectively obtained by performing preset multiplexing processing on N sub-video streams, wherein the N sub-video streams are corresponding sub-video streams generated by dividing the target spatial object into N sub-spatial objects and dividing the original video stream based on the N sub-spatial objects, wherein N is a natural number greater than 1, wherein the target request feedback further comprises multiplexing description information, and wherein the multiplexing description information comprises at least one of the following: a quantity N of the sub-video streams that is comprised in the information about the multiplex video stream; a starting location offset, in the information about the multiplex video stream, of a starting sub-video stream of the N sub-video streams; a size of the N multiplexed sub-video streams; spatial location information, in the VR content component, respectively corresponding to the N multiplexed sub-video streams; resolution information of the N multiplexed sub-video streams; a video stream multiplexing type of the N multiplexed sub-video streams; or resolution information of the N sub-video streams.

10. The client terminal device according to claim 9, wherein the multiplexing description information further comprises: spatial location information, in the VR content component, respectively corresponding to the N sub-video streams.

11. The client terminal device according to claim 9, wherein the target request further comprises at least one of: region of interest (ROI) information, bandwidth information of the client, information about a decoding standard supported by the client, and information about a maximum video resolution of the client terminal device.

12. The client terminal device according to claim 9, wherein the preset multiplexing processing comprises at least one of binary head-to-tail splicing processing on the video stream, binary head-to-tail splicing of video segments, or sample interleaving multiplexing processing.

13. A server, comprising: at least one processor; a non-transitory computer-readable storage medium coupled to the at least one processor and storing programming instructions for execution by the at least one processor, wherein the programming instructions instruct the at least one processor to: receive a target request sent by a client, wherein the target request comprises information about a corresponding target spatial location, of a target spatial object that needs to be presented upon request by the client, in a virtual reality VR content component; search, based on the target spatial location information, for the corresponding target spatial object in the VR content component; obtain information about a multiplex video stream that is obtained by performing preset multiplexing processing on an original video stream corresponding to the target spatial object; and send a target request feedback to the client in response to the target request, wherein the target request feedback comprises the information about the multiplex video stream; wherein obtaining information about the multiplex video stream that is obtained by performing preset multiplexing processing on the original video stream corresponding to the target spatial object comprises: dividing the target spatial object into N sub-spatial objects, and dividing the original video stream based on the N sub-spatial objects, to generate N corresponding sub-video streams, wherein N is natural number greater than 1; and obtaining information about N multiplexed sub-video streams that are obtained by separately performing the preset multiplexing processing on the N sub-video streams.

14. The server according to claim 13, wherein the target request feedback further comprises multiplexing description information, and the multiplexing description information comprises at least one of the following: a quantity N of the sub-video streams that is comprised in the information about the multiplex video stream; a starting location offset, in the information about the multiplex video stream, of a starting sub-video stream of the N sub-video streams; a size of the N multiplexed sub-video streams; spatial location information, in the VR content component, respectively corresponding to the N multiplexed sub-video streams; resolution information of the N multiplexed sub-video streams; a video stream multiplexing type of the N multiplexed sub-video streams; or resolution information of the N sub-video streams.

15. The server according to claim 14, wherein the multiplexing description information further comprises: spatial location information, in the VR content component, respectively corresponding to the N sub-video streams.

16. The server according to claim 13, wherein the preset multiplexing processing comprises at least one of binary head-to-tail splicing processing on the video stream, binary head-to-tail splicing of video segments, or sample interleaving multiplexing processing.

Description

BRIEF DESCRIPTION OF DRAWINGS

(1) To describe the technical solutions in the embodiments of the present disclosure more clearly, the following briefly describes the accompanying drawings required for describing the embodiments or the prior art.

(2) FIG. 1 is a schematic diagram of handover between bitstream segments according to an embodiment of the present disclosure;

(3) FIG. 2 is a hierarchical structural diagram of an mdp file according to an embodiment of the present disclosure;

(4) FIG. 3 is a schematic diagram of a spatial relationship between spatial objects according to an embodiment of the present disclosure;

(5) FIG. 4 is a schematic diagram of a network architecture of a video stream transmission system according to an embodiment of the present disclosure;

(6) FIG. 5 is a schematic flowchart of a video stream transmission method according to an embodiment of the present disclosure;

(7) FIG. 6 is a diagram of a change of a 360-degree viewport according to an embodiment of the present disclosure;

(8) FIG. 7 is a mapping from a spherical surface to a coordinates graph according to an embodiment of the present disclosure;

(9) FIG. 8 is a schematic flowchart of another video stream transmission method according to an embodiment of the present disclosure;

(10) FIG. 9 is a schematic diagram of a multiplex video stream according to an embodiment of the present disclosure;

(11) FIG. 10 is a schematic diagram of sample interleaving multiplexing in a video stream according to an embodiment of the present disclosure;

(12) FIG. 11 is a schematic structural diagram of a client according to an embodiment of the present disclosure;

(13) FIG. 12 is a schematic structural diagram of a server according to an embodiment of the present disclosure;

(14) FIG. 13 is a schematic structural diagram of another client according to an embodiment of the present disclosure;

(15) FIG. 14 is a schematic structural diagram of another server according to an embodiment of the present disclosure;

(16) FIG. 15 is a schematic structural diagram of a video stream transmission system according to an embodiment of the present disclosure; and

(17) FIG. 16 is a schematic architectural diagram of a segment-based multiplexing system according to an embodiment of the present disclosure.

DESCRIPTION OF EMBODIMENTS

(18) The following clearly describes the technical solutions in the embodiments of the present disclosure with reference to the accompanying drawings in the embodiments of the present disclosure.

(19) In the specification, claims, and accompanying drawings of the present disclosure, the terms first, second, third, fourth, and so on are intended to distinguish between different objects but do not indicate a particular order. In addition, the terms including and having and any other variants thereof are intended to cover a non-exclusive inclusion. For example, a process, a method, a system, a product, or a device that includes a series of steps or units is not limited to the listed steps or units, but optionally further includes an unlisted step or unit, or optionally further includes another inherent step or unit of the process, the method, the product, or the device.

(20) Mentioning an embodiment in the specification means that a particular characteristic, structure, or feature described with reference to the embodiment may be included in at least one embodiment of the present disclosure. The phrase shown in various locations in the specification may not necessarily refer to a same embodiment, and is not an independent or optional embodiment exclusive from another embodiment. It is explicitly and implicitly understood by persons skilled in the art that the embodiments described in the specification may be combined with another embodiment.

(21) In the following, some terms in this application are described, to help persons skilled in the art have a better understanding.

(22) (1) A client may be installed on a terminal device in a form of software or App, or may be a client existing on a terminal device (for example, a terminal device supporting VR video watching) in a form of an inherent functional component inside a system. In other words, a client in the present disclosure is a terminal device on which the client is successfully installed. The terminal device includes but is not limited to various forms of user equipment (User Equipment, UE) that can provide VR video watching experience, for example, an access terminal, a terminal device, a subscriber unit, a subscriber station, a mobile site, a mobile station, a remote station, a remote terminal, a mobile device, a user terminal, a terminal, a wireless communications device, a user agent or a user apparatus, a cellular phone, a cordless phone, a smartphone, a tablet computer, a Session Initiation Protocol (Session Initiation Protocol, SIP) phone, a wireless local loop (Wireless Local Loop, WLL) station, a smart band, a smart wearable device (such as smart glasses or a smart helmet), an MP3 player (Moving Picture Experts Group Audio Layer III, Moving Picture Experts Group Audio Layer III), an MP4 (Moving Picture Experts Group Audio Layer IV, Moving Picture Experts Group Audio Layer III) player, a personal digital assistant (Personal Digital Assistant, PDA), a handheld device or a computer device having a wireless communications function, another processing device or an in-vehicle device connected to a wireless modem, and a terminal device in a future 5G network.

(23) (2) A server is a cloud service device, a terminal device, a core network device, or the like that can store a large quantity of VR video files, complete request-based interaction with a client, and implement processing operations such as encoding, decoding, and multiplexing on a VR video.

(24) (3) A plurality of refers to two or more than two. The term and/or describes an association relationship for describing associated objects and represents that three relationships may exist. For example, A and/or B may represent the following three cases: Only A exists, both A and B exist, and only B exists. The character / generally indicates an or relationship between the associated objects.

(25) The following describes the embodiments of this application with reference to accompanying drawings.

(26) To facilitate understanding of the embodiments of the present disclosure, the following first describes a network architecture of a video stream transmission system on which the embodiments of the present disclosure are based. FIG. 4 is a schematic diagram of a network architecture of a video stream transmission system according to an embodiment of the present disclosure. Referring to FIG. 4, the system includes a client and a server. A user may use the client to initiate a VR video request to the server by using a wired network or a wireless network. After receiving the request, the server feeds corresponding VR video content back to the client in response to the VR video request. Finally, the client parses the VR video content that is fed back, and presents a VR video effect to the user. In other words, the user implements VR video experience by using video stream interaction between the client and the server.

(27) In the embodiments of the present disclosure, a function of the client includes but is not limited to: sending a VR video request to a client based on current viewport information of the client, where the request carries the viewport information of the client, multiplexing description information, or the like. A function of the server includes but is not limited to: managing description information of all media stream files of a VR video, where the description information includes spatial location information of video stream content in the VR video; obtaining request information from the client and parsing viewport information carried in a request; reading, based on the viewport information, a video stream corresponding to a viewport; and encapsulating and multiplexing a video stream related to a viewport of a user, where an encapsulated and multiplexed file includes multiplexing description information of each viewport. It can be understood that, alternatively, the server may be a logical module on a content delivery network (Content Delivery Network, CDN). It can be understood that the foregoing network architecture is only one of the implementations of the embodiments of the present disclosure. The network architecture in the embodiments of the present disclosure includes but is not limited to the foregoing network architecture. Any network architecture that can implement a video stream transmission method of the present disclosure shall fall within a protected and covered scope of the present disclosure.

(28) FIG. 5 is a schematic flowchart of a video stream transmission method according to an embodiment of the present disclosure. The following describes in detail the video stream transmission method in this embodiment of the present disclosure from a perspective of interaction between a client and a server with reference to FIG. 5. The method may include the following steps S501 to S505.

(29) Step S501: The client sends a target request to the server, and the server receives the target request sent by the client, where the target request includes at least one of the following: information about a corresponding target spatial location, of a target spatial object that needs to be presented upon request by the client, in a virtual reality VR content component, an identifier of a media representation, viewport information of a user of the client, or spatial information of the media representation.

(30) A spatial object (Spatial Objects) is a part of space of a content component. In other words, a content component includes a plurality of spatial objects. In general, during application to a VR video, it can be understood that the VR video includes sub videos corresponding to a plurality of fields of view. An identifier of a media representation is an identifier of a sub video stream. Viewport information of a user of the client is spatial object information. To be specific, in this embodiment of the present disclosure, a VR content component may be a VR video. The target spatial object may be a part of a viewport, in the VR video, that needs to be presented upon request by the user, and may be referred as a region of interest (Region of Interest, ROI). In machine visual and picture processing, a to-be-processed region in a processed picture is outlined by a box, a circle, an ellipse, an irregular polygon, or the like and is referred to as a region of interest.

(31) A difference between a VR video and a normal video lies in that entire video content of the normal video is presented to a user, and only a subset (a sub video) of the entire video of the VR video is presented. To be specific, when the VR video (or a 360-degree video or an omnidirectional video (Omnidirectional video)) is presented on a head-mounted device or a handheld device, only an area of an orientation corresponding to the head of the user in the VR video and associated audio are finally presented. Therefore, the target spatial location information carried in the target request may be considered as a region of a viewport that the user is currently interested in and that needs to be presented. It can be understood that the target request may be triggered by an angle movement of the client, or may be triggered by a related input instruction of the user or the like. The present disclosure sets no limitation thereto.

(32) For example, the user may watch the VR video at 360 degrees. However, at each moment, a video display region viewed by the user is only a part of the VR video. Therefore, during content preparation, VR content is divided into plurality of regions, and each region corresponds to a group of adaptive bitstreams. The client selects, based on a region viewed by the user, a corresponding video bitstream for receiving and viewing. FIG. 6 is a diagram of a change of a 360-degree viewport according to an embodiment of the present disclosure. In FIG. 6, content in a left box and content in a right box are respectively two fields of view regions of a user. When the user watches a video, the user switches a viewport from the left box to the right box by using an operation (for example, by rotating a smart helmet). After the viewport of the user is switched to the right box, a client also needs to present video content of the corresponding viewport region. Because the user views content at an arbitrary viewport location, when the user views content at a viewport, content of the viewport appears in a plurality of regions obtained by dividing VR, and the user needs to obtain video streams of more regions. It can be understood that, in existing 2D picture mapping of a VR, besides being mapped to a coordinates graph (longitude and latitude graph), a spherical surface in FIG. 6 may be mapped to another geometrical body, such as a cube or a polyhedron. The following mainly describes a 2D mapping manner of being mapped to longitude and latitude graph. Other mapping manners also fall within the scope protected and covered by the present disclosure.

(33) FIG. 7 is a mapping from a spherical surface to a coordinates graph according to an embodiment of the present disclosure. In the figure, it is assumed that target spatial location information is coordinates of a top-left location of a viewport region in a VR video and width and height information of the viewport region. For example, in FIG. 6, coordinates of a top-left location of a right box in the coordinates graph is (x, y), and a length and a width of the right box is (w, h). In this case, a request of a client carries values of x, y, w, and h; uniform scaling values of x, y, w, and h, or an angle value in a sphere.

(34) In a possible implementation, the target request further includes at least one of: region of interest ROI information, bandwidth information of the client, information about a decoding standard supported by the client, and information about a maximum video resolution of the client. To be specific, when initiating a video request, the client may further add some related parameters of the client, for example, a video playing condition or playing performance, so that the server can perform video stream processing and feedback more properly.

(35) Step S502: The server searches, based on the target spatial location information, for the corresponding target spatial object in the VR content component.

(36) The server searches, based on the target spatial location information in the received target request, for the corresponding target spatial object in the VR component content, to subsequently obtain a video stream corresponding to the target spatial object. For example, after receiving the target request from the client, the server parses the target request to obtain information about a viewport requested by the client, and obtains, from media presentation description information based on the information about a viewport of the client, a video stream having content that overlaps with a viewport region of the client.

(37) Step S503: The server obtains information about a multiplex video stream that is obtained by performing preset multiplexing processing on an original video stream corresponding to the target spatial object.

(38) After determining the target spatial object (for example, a target viewport of the user), the server obtains the information about the multiplex video stream that is obtained by performing the preset multiplexing processing on the original video stream corresponding to the target spatial object. It should be noted that preset multiplexing processing may be performed on the original video stream corresponding to the target spatial object before the server receives the target request, or after the target request is received. If the preset multiplexing processing is performed before the target request is received, a request responding time can be saved. To be specific, after the target spatial object is determined, the pre-processed information about a multiplex video stream that is obtained by performing the preset multiplexing processing on the original video stream corresponding to the target spatial object is directly obtained, so that a response rate of the server is improved, thereby shortening a response time and improving viewing experience of the user. If the preset multiplexing processing is performed after the target request is received, some multiplexing processing time needs to be consumed, but storage space required for massive preset multiplexing processing in advance can be saved. Certainly alternatively, the foregoing two manners may be combined. To be specific, preset multiplexing processing is performed in advance on some content that may be frequently viewed by the user, and content that the user may not need to view is processed and obtained after the target request is received. Therefore, the present disclosure does not limit a time when the server performs the preset multiplexing processing on the original video stream corresponding to the related target spatial object.

(39) For example, the server obtains the corresponding video stream based on information about the video stream having content that overlaps with the viewport region of the client, and performs preset multiplexing processing on the video stream. For example, the right box in the coordinates graph in FIG. 6 is the viewport region requested by the client, and regions A to I are nine regions described in the media presentation description information. A bitstream multiplexing module can deduce, based on information about the right box and location information of the nine regions A to I, that a content region of the right box covers four regions B, C, E, and F. The bitstream multiplexing module obtains video bitstreams corresponding to the four regions B, C, E, and F from a bitstream obtaining module, and multiplexes the four video streams. A multiplex video stream includes description information of the multiplexed video streams. The description information of the video streams includes some or all the following information: a quantity of video streams in the multiplex video stream, spatial region location information of each multiplexed video stream, resolution information of each multiplexed video stream, storage location information of each multiplexed video stream in the multiplex video stream, a video stream multiplexing type, and resolution information of a video source corresponding to each viewport. Specific preset multiplexing processing may be a processing manner such as binary head-to-tail splicing and sample interleaved storage of bitstream files of the multiplexed video stream in a multiplex file.

(40) In a possible implementation, the information about the multiplex video stream includes information about N multiplexed sub video streams that are respectively obtained by performing preset multiplexing processing on N sub video streams. The N sub video streams and the N multiplexed sub video streams are in a one-to-one correspondence. The N sub video streams are corresponding sub video streams generated by dividing the target spatial object into N sub spatial objects and dividing the original video stream based on the N sub spatial objects, and N is a natural number greater than 1. A target request feedback further includes multiplexing description information, and the multiplexing description information includes at least one of the following: a quantity N of the sub video streams that is included in the information about the multiplex video stream; a starting location offset, in the information about the multiplex video stream, of a starting sub video stream of the N sub video streams; a size of the N multiplexed sub video streams; spatial location information, in the VR content component, respectively corresponding to the N multiplexed sub video streams; resolution information of the N multiplexed sub video streams; a video stream multiplexing type of the N multiplexed sub video streams; and resolution information of the N sub video streams. To be specific, a function of different types of information carried in the multiplexing description information is to help the client parse and present, based on the multiplexing description information, the VR video requested by the user.

(41) Step S504: The server sends a target request feedback to the client in response to the target request, and the client receives the target request feedback by which the server responses to the target request, where the target request feedback includes the information about the multiplex video stream that is obtained by performing the preset multiplexing processing on the original video stream corresponding to the target spatial object.

(42) In the prior art, for content that a user requests to obtain, a server directly returns a corresponding video stream. Therefore, there may be a large amount of redundant video stream code, especially in some VR video scenes that have some repeated scenes. For example, in VR experience scenarios in tour and sightseeing, a color of the sky or a color and texture of a river are basically consistent. Therefore, the repeated content can be multiplexed, to reduce a bandwidth and time for transmitting video streams and improve efficiency.

(43) In a possible implementation, the multiplexing description information further includes: the spatial location information, in the VR content component, respectively corresponding to the N multiplexed sub video streams. The multiplexing description information includes specific spatial location information of a plurality of multiplexed sub video streams. Therefore, the client may finally parse and present, based on such information in the multiplexing description information, the VR video that the user needs to watch.

(44) In a possible implementation, the multiplexing description information further includes: spatial location information, in the VR content component, respectively corresponding to the N sub video streams. Therefore, the client can learn of, at any time based on spatial location information of a video stream, a viewport of which a sub video stream is requested, so that when content of the same viewport needs to be viewed subsequently, it is unnecessary to request repeatedly, thereby improving transmission efficiency of a VR video and improving user experience.

(45) In a possible implementation, the preset multiplexing processing includes binary head-to-tail splicing processing on the video stream, binary head-to-tail splicing of video segments, or sample interleaving multiplexing processing. In other words, there may be a plurality of preset multiplexing processing manners. The present disclosure sets no limitation thereto.

(46) Step S505. The client performs video parsing and presentation based on the information about the multiplex video stream.

(47) The client parses a related video stream based on the information about the multiplex video stream carried in the received target request feedback sent by the server, and finally gives a presentation. For example, the client obtains the multiplex video stream; parses the description information, of the multiplexed video streams, in the multiplex video stream; sends the video stream to a decoder for decoding; and presents, based on information described in the description information of the multiplexed video streams, decoded video content of the video stream. In the present disclosure, in addition to multiplexing a video stream corresponding to each viewport, other video streams that need to be transmitted to the client may be further included.

(48) In this embodiment of the present disclosure, the server multiplexes and encapsulates, based on viewport location information in request information of the client, a video stream related to the viewport location information, and transmits an encapsulated multiplex video stream to the client. The video stream related to the viewport location information is a video stream having video content that partially or entirely overlaps with content of a viewport range requested by the client. To be specific, preset multiplexing processing is performed on a video stream that responds to the request, to respond to the request from the client. This reduces a quantity of requests from the client, and also reduces a quantity of responses from the server. In addition, this ensures simultaneous arrival of video stream information of fields of view of a same moment, thereby reducing a time of waiting for all video streams to be separately received, and reducing a presentation delay of the fields of view.

(49) FIG. 8 is a schematic flowchart of another video stream transmission method according to an embodiment of the present disclosure. The following describes in detail the another video stream transmission method in this embodiment of the present disclosure from a perspective of interaction between a client and a server with reference to FIG. 8. The method may include the following step S801 to step S805.

(50) Step S801 and step S802 in the embodiment provided in FIG. 8 are respectively the same as step S501 and step S502 in the embodiment provided in FIG. 2. Specific implementations are not described herein again.

(51) Step S803. The server divides the target spatial object into N sub spatial objects, and encodes the N sub spatial objects to generate N corresponding sub video streams, where N is natural number greater than 1.

(52) The target spatial object is divided into a plurality of sub spatial objects, so that different sub video streams corresponding to a plurality of spaces can be multiplexed in a more refined manner, thereby further improving video stream multiplexing efficiency. A principle of dividing the target spatial object into N sub spatial objects may be dividing according to continuity of spatial location or may be dividing based on content or overlapping in a video.

(53) Step S804: The server obtains information about N multiplexed sub video streams that are obtained by separately performing preset multiplexing processing on the N sub video streams.

(54) After determining a plurality of sub spatial objects, the server obtains information about a plurality of multiplexed sub video streams that are obtained by performing preset multiplexing processing on the plurality of sub spatial objects, to finally transmit the information to the client at a relatively small code rate, thereby reducing a bandwidth and improving transmission efficiency. It can be understood that the preset multiplexing processing may be performed in advance, or the preset multiplexing processing may be performed after a sub space is determined

(55) Step S805 and step S806 in the embodiment provided in FIG. 8 are respectively the same as step S504 and step S505 in the embodiment provided in FIG. 5. Specific implementations are not described herein again.

(56) Further, the several description manners of the multiplexing description information related to the preset multiplexing processing of the video stream in the foregoing embodiment may be implemented by using any of the following specific description manners:

(57) Description Manner 1:

(58) aligned(8) class FOVMuxBox extends FullBox(form, version, flag) {

(59) unsigned int(16) FOVCount;

(60) unsigned int(32) first_offset;

(61) for(i=1; i<=FOVCount; i++) { unsigned int(32) FOV_size }

(62) }

(63) where:

(64) FOVCount: a quantity of sub video streams that is in information about a multiplex video stream;

(65) first_offset: an offset, in the multiplex video stream, of a sub video stream of a first viewport in the information about the multiplex video stream; and

(66) FOV_size: a size of each multiplexed sub video stream in the multiplex video stream.

(67) 1. A client receives the information about the multiplex video stream, and parses description information of multiplexed video streams in fovm, to obtain a quantity of sub video streams and offset and size information of the sub video streams.

(68) 2. Initialize a plurality of video stream decoders based on the quantity of sub video streams.

(69) 3. De-multiplex, based on the offset and data volume information of each sub video stream, an obtained multiplexed video stream to obtain data of each video stream; and send the data of each video stream to a corresponding video stream decoder for decoding and presentation.

(70) FIG. 9 is a schematic diagram of a multiplex video stream according to an embodiment of the present disclosure. In FIG. 9, a video 1 to a video n are video content in a same time segment, and other data may not exist; and first_offset is a starting location offset of the video 1.

(71) Description Manner 2:

(72) aligned(8) class FOVMuxBox extends FullBox(fovm, version, flag) {

(73) unsigned int(16) FOVCount;

(74) unsigned int(32) first_offset;

(75) for(i=1; i<=FOVCount; i++) { unsigned int(32) x; unsigned int(32) y; unsigned int(32) w; unsigned int(32) h; unsigned int(31) FOV_size }

(76) }

(77) x: information about an x-axis location, of each of N multiplexed sub video streams, in a VR content component;

(78) y: information about a y-axis location, of each of the N multiplexed sub video streams, in the VR content component;

(79) w: a width of the N multiplexed sub video streams; and

(80) h: a height of the N multiplexed sub video streams.

(81) Actions of a client after a multiplex stream is received are as follows:

(82) 1. The first three steps are the same as the actions of the client in the description manner 1. In step 4, pictures obtained through decoding are spliced and presented based on the information of x, y, w, and h in fovm.

(83) Step 5: Present spliced video stream content based on ROI information carried in a request of the client.

(84) Description Manner 3:

(85) aligned(8) class FOVMuxBox extends FullBox(fovm, version, flag) {

(86) unsigned int(16) FOVCount;

(87) unsigned int(32) first_offset;

(88) unsigned int(32) ROI_x;

(89) unsigned int(32) ROI_y;

(90) unsigned int(32) ROI_w;

(91) unsigned int(32) ROI_h;

(92) for(i=1; i<=FOVCount; i++) { unsigned int(32) x; unsigned int(32) y; unsigned int(32) w; unsigned int(32) h; unsigned int(31) FOV_size }

(93) }

(94) ROI_x: information about a corresponding x-axis location, of each of N sub video streams requested by a client, in a VR content component;

(95) ROI_y: information about a corresponding y-axis location, of each of the N sub video streams requested by the client, in the VR content component;

(96) ROI_w: a width of the N sub video streams requested by the client; and

(97) ROI_h: a height of the N sub video streams requested by the client.

(98) The ROI information added in this description manner may be used together with the information in the description manners 1 and 2.

(99) 1. Steps 1 to 4 are the same as the actions of the client in the description manner 2. In step 5: in content obtained by splicing a plurality of fields of view, video content in a region specified by ROI_x, ROI_y, ROI_w, and ROI_h is presented.

(100) Description Manner 4:

(101) aligned(8) class FOVMuxBox extends FullBox(fovm, version, flag) {

(102) unsigned int(16) FOVCount;

(103) unsigned int(32) first_offset;

(104) unsigned int(16) MultiplexType;

(105) if(MultiplexType==FOV) { for(i=1; i<=FOVCount; i++) { unsigned int(31) FOV_size } }

(106) if(MultiplexType==sample) { for(i=1; i<=FOVCount; i++) { unsigned int(32) sampleCount; for(j=1; j<=sampleCount; i++) { unsigned int(32) sample_offset; unsigned int(32) sample_size; } } }

(107) }

(108) MultiplexType: a manner of multiplexing bitstream files of multiplexed video streams in a multiplex file: binary head-to-tail splicing of bitstreams (bitstream segments) of the video streams, or sample interleaving multiplexing in each video stream;

(109) sample_offset: an offset of a sample in a multiplex file; and

(110) sample_size: a size of the sample.

(111) The syntax in this example can be used together with the foregoing description manners 1, 2, and 3.

(112) Actions of a client after receiving a multiplex video stream are as follows:

(113) 1. After receiving the multiplex video stream, the client parses description information of multiplexed video streams in fovm, to obtain manner information in the multiplex video stream.

(114) 2. The client determines, based on the information about the multiplexing manner, a multiplexing manner of data of each viewport. If the multiplexing manner is head-to-tail splicing, the client parses offset information and data volume information, and sends the data of each viewport to a decoder. If the multiplexing manner is sample interleaving, the client parses offset and data volume information of each sample, and sends each sample to a corresponding decoder. FIG. 10 is a schematic diagram of sample interleaving multiplexing in a video stream according to an embodiment of the present disclosure. In the figure, videos (videos 1, 2, and 3) of different fields of view are multiplexed in an interleaving manner. Sub video streams indicated by graticule lines, oblique lines, and vertical lines can be multiplexed in an interleaving manner. A result of the multiplexing is a multiplex video stream on a right side in FIG. 10.

(115) Description Manner 5:

(116) aligned(8) class FOVMuxBox extends FullBox(fovm, version, flag) {

(117) unsigned int(16) FOVCount;

(118) unsigned int(32) first_offset;

(119) unsigned int(32) source_w;

(120) unsigned int(32) source_h;

(121) for(i=1; i<=FOVCount; i++) { unsigned int(32) x; unsigned int(32) y; unsigned int(32) w; unsigned int(32) h; unsigned int(31) FOV_size }

(122) }

(123) or

(124) aligned(8) class FOVMuxBox extends FullBox(fovm, version, flag) {

(125) unsigned int(16) FOVCount;

(126) unsigned int(32) first_offset;

(127) for(i=1; i<=FOVCount; i++) { unsigned int(32) source_w; unsigned int(32) source_h; unsigned int(32) x; unsigned int(32) y; unsigned int(32) w; unsigned int(32) h; unsigned int(31) FOV_size }

(128) }

(129) In this description manner, resolution information of a video source corresponding to each video stream is added, and source_w and source_h are respectively a width and a height of a video source corresponding to a viewport.

(130) Syntax of each spatial location in the foregoing five description manners may be absolute location information in VR video content, or may be a scale value or a yaw angle.

(131) In this embodiment of the present disclosure, the request information of the client carries, in a get request of HTTP by using an HTTP protocol, information about a viewport region of the client, for example, x, y, w, and h in this embodiment.

(132) In this embodiment of the present disclosure, the request information of the client may further carry information such as a bandwidth of the client, a decoding standard supported by the client, and a maximum video resolution. The server selects, based on the information carried in the request, a video stream meeting a performance requirement of the client, for multiplexing and transmission.

(133) In this embodiment of the present disclosure, multiplexed video stream data may be segment media data in a DASH protocol.

(134) In this embodiment of the present disclosure, a related bitstream in multiplexing may include a bitstream that is generated on a server side and that is corresponding to content that partially or entirely overlaps with a content region requested by a client.

(135) This embodiment of the present disclosure retains the method and corresponding beneficial effects in the embodiment of FIG. 5, and describes in detail a plurality of specific implementations of preset multiplexing processing. This further enhances implementability of the present disclosure and further improves video stream transmission efficiency.

(136) To better implement the video stream transmission methods corresponding to FIG. 5 and FIG. 8 in the embodiments of the present disclosure, the present disclosure further provides a related device for realizing and implementing the foregoing methods.

(137) FIG. 11 is a schematic structural diagram of a client according to an embodiment of the present disclosure. As shown in FIG. 11, a client 10 includes a request module 101, a receiving module 102, and a processing module 103.

(138) The request module 101 is configured to send a target request to a server, where the target request includes information about a corresponding target spatial location, of a target spatial object that needs to be presented upon request by the client, in a virtual reality VR content component.

(139) The receiving module 102 is configured to receive a target request feedback by which the server responds to the target request, where the target request feedback includes information about a multiplex video stream that is obtained by performing preset multiplexing processing on an original video stream corresponding to the target spatial object.

(140) The processing module 103 is configured to perform video parsing and presentation based on the information about the multiplex video stream.

(141) The information about the multiplex video stream includes information about N multiplexed sub video streams that are respectively obtained by performing preset multiplexing processing on N sub video streams, the N sub video streams are corresponding sub video streams generated by dividing the target spatial object into N sub spatial objects and encoding the N sub spatial objects, N is a natural number greater than 1, the target request feedback further includes multiplexing description information, and the multiplexing description information includes at least one of the following:

(142) a quantity N of the sub video streams that is included in the information about the multiplex video stream;

(143) a starting location offset, in the information about the multiplex video stream, of a starting sub video stream of the N sub video streams;

(144) a data volume of the N multiplexed sub video streams;

(145) spatial location information, in the VR content component, respectively corresponding to the N multiplexed sub video streams;

(146) resolution information of the N multiplexed sub video streams; and

(147) a video stream multiplexing type of the N multiplexed sub video streams.

(148) Further, the multiplexing description information further includes:

(149) the spatial location information, in the VR content component, respectively corresponding to the N multiplexed sub video streams.

(150) Even further, the multiplexing description information further includes:

(151) spatial location information, in the VR content component, respectively corresponding to the N sub video streams.

(152) Even further, the target request further includes at least one of: region of interest ROI information, bandwidth information of the client, information about a decoding standard supported by the client, and information about a maximum video resolution of the client.

(153) Even further, the preset multiplexing processing includes binary head-to-tail splicing processing on the video stream, binary head-to-tail splicing of video segments, or sample interleaving multiplexing processing.

(154) It can be understood that, for functions of the modules in the client 10, reference may be correspondingly made to specific implementations in the method embodiments in FIG. 5 to FIG. 10. Details are not described herein again.

(155) In this embodiment of the present disclosure, the server multiplexes and encapsulates, based on viewport location information in request information of the client, a video stream related to the viewport location information, and transmits an encapsulated multiplex video stream to the client. The video stream related to the viewport location information is a video stream having video content that partially or entirely overlaps with content of a viewport range requested by the client. To be specific, the server performs preset multiplexing processing on a video stream that responds to the request, to respond to the request from the client. This reduces a quantity of requests from the client, and also reduces a quantity of responses from the server. In addition, this ensures simultaneous arrival of video stream information of fields of view of a same moment, thereby reducing a time of waiting for all video streams to be separately received, and reducing a presentation delay of the fields of view.

(156) FIG. 12 is a schematic structural diagram of a server according to an embodiment of the present disclosure. As shown in FIG. 12, a server 20 includes a receiving module 201, a parsing module 202, an obtaining module 203, and a feedback module 204.

(157) The receiving module 201 is configured to receive a target request sent by a client, where the target request includes information about a corresponding target spatial location, of a target spatial object that needs to be presented upon request by the client, in a virtual reality VR content component.

(158) The parsing module 202 is configured to search, based on the target spatial location information, for the corresponding target spatial object in the VR content component.

(159) The obtaining module 203 is configured to obtain information about a multiplex video stream that is obtained by performing preset multiplexing processing on an original video stream corresponding to the target spatial object.

(160) The feedback module 204 is configured to send a target request feedback to the client in response to the target request, where the target request feedback includes the information about the multiplex video stream.

(161) The obtaining module 203 includes:

(162) a dividing unit, configured to divide the target spatial object into N sub spatial objects, and divide the original video stream based on the N sub spatial objects, to generate N corresponding sub video streams, where N is natural number greater than 1; and

(163) an obtaining unit, configured to obtain information about N multiplexed sub video streams that are obtained by separately performing the preset multiplexing processing on the N sub video streams.

(164) Further, the target request feedback further includes multiplexing description information, and the multiplexing description information includes at least one of the following:

(165) a quantity N of the sub video streams that is included in the information about the multiplex video stream;

(166) a starting location offset, in the information about the multiplex video stream, of a starting sub video stream of the N sub video streams;

(167) a size of the N multiplexed sub video streams;

(168) spatial location information, in the VR content component, respectively corresponding to the N multiplexed sub video streams;

(169) resolution information of the N multiplexed sub video streams; and

(170) a video stream multiplexing type of the N multiplexed sub video streams.

(171) Even further, the multiplexing description information further includes:

(172) the spatial location information, in the VR content component, respectively corresponding to the N multiplexed sub video streams.

(173) Even further, the multiplexing description information further includes:

(174) spatial location information, in the VR content component, respectively corresponding to the N sub video streams.

(175) Even further, the preset multiplexing processing includes binary head-to-tail splicing processing on the video stream, binary head-to-tail splicing of video segments, or sample interleaving multiplexing processing.

(176) It can be understood that, for functions of the modules in the server 20, reference may be correspondingly made to specific implementations in the method embodiments in FIG. 5 to FIG. 10. Details are not described herein again.

(177) In this embodiment of the present disclosure, the server multiplexes and encapsulates, based on viewport location information in request information of the client, a video stream related to the viewport location information, and transmits an encapsulated multiplex video stream to the client. The video stream related to the viewport location information is a video stream having video content that partially or entirely overlaps with content of a viewport range requested by the client. To be specific, the server performs preset multiplexing processing on a video stream that responds to the request, to respond to the request from the client. This reduces a quantity of requests from the client, and also reduces a quantity of responses from the server. In addition, this ensures simultaneous arrival of video stream information of fields of view of a same moment, thereby reducing a time of waiting for all video streams to be separately received, and reducing a presentation delay of the fields of view.

(178) FIG. 13 is a schematic structural diagram of another client according to an embodiment of the present disclosure. As shown in FIG. 13, a client 30 includes a processor 301, a memory 302, and a transceiver 303. The processor 301, the memory 302, and the transceiver 303 may be connected by using a bus or in another manner.

(179) Optionally, the client 30 may further include a network interface 304 and a power module 305.

(180) The processor 301 may be a digital signal processing (Digital Signal Processing, DSP) chip.

(181) The memory 302 is configured to store an instruction. In specific implementation, the memory 302 may use a read-only memory (English: Read-Only Memory, ROM for short) or a random access memory (English: Random Access Memory, RAM for short). In this embodiment of the present disclosure, the memory 302 is configured to store code of a video stream transmission program.

(182) The transceiver 303 is configured to transmit and receive a signal.

(183) The network interface 304 is used by the client 30 to perform data communication with another device. The network interface 304 may be a wired interface or a wireless interface.

(184) The power module 305 is configured to supply power to each module of the client 30.

(185) The processor 301 is configured to call the instruction stored in the memory 302 to perform the following operations:

(186) sending a target request to a server by using the transceiver 303, where the target request includes information about a corresponding target spatial location, of a target spatial object that needs to be presented upon request by the client, in a virtual reality VR content component;

(187) receiving, by using the transceiver 303, a target request feedback by which the server responds to the target request, where the target request feedback includes information about a multiplex video stream that is obtained by performing preset multiplexing processing on an original video stream corresponding to the target spatial object; and

(188) performing video parsing and presentation based on the information about the multiplex video stream.

(189) The information about the multiplex video stream includes information about N multiplexed sub video streams that are respectively obtained by performing preset multiplexing processing on N sub video streams, the N sub video streams are corresponding sub video streams generated by dividing the target spatial object into N sub spatial objects and dividing the original video stream based on the N sub spatial objects, N is a natural number greater than 1, the target request feedback further includes multiplexing description information, and the multiplexing description information includes at least one of the following:

(190) a quantity N of the sub video streams that is included in the information about the multiplex video stream;

(191) a starting location offset, in the information about the multiplex video stream, of a starting sub video stream of the N sub video streams;

(192) a size of the N multiplexed sub video streams;

(193) spatial location information, in the VR content component, respectively corresponding to the N multiplexed sub video streams;

(194) resolution information of the N multiplexed sub video streams; and

(195) a video stream multiplexing type of the N multiplexed sub video streams.

(196) Further, the multiplexing description information further includes:

(197) the spatial location information, in the VR content component, respectively corresponding to the N multiplexed sub video streams.

(198) Even further, the multiplexing description information further includes:

(199) spatial location information, in the VR content component, respectively corresponding to the N sub video streams.

(200) Even further, the target request further includes at least one of: region of interest ROI information, bandwidth information of the client, information about a decoding standard supported by the client, and information about a maximum video resolution of the client.

(201) Even further, the preset multiplexing processing includes binary head-to-tail splicing processing on the video stream, binary head-to-tail splicing of video segments, or sample interleaving multiplexing processing.

(202) It should be noted that, for functions of the functional modules in the client 30 described in this embodiment of the present disclosure, reference may be made to related descriptions of the corresponding client in the embodiments shown in FIG. 5 to FIG. 10. Details are not described herein again.

(203) In this embodiment of the present disclosure, the server multiplexes and encapsulates, based on viewport location information in request information of the client, a video stream related to the viewport location information, and transmits an encapsulated multiplex video stream to the client. The video stream related to the viewport location information is a video stream having video content that partially or entirely overlaps with content of a viewport range requested by the client. To be specific, the server performs preset multiplexing processing on a video stream that responds to the request, to respond to the request from the client. This reduces a quantity of requests from the client, and also reduces a quantity of responses from the server. In addition, this ensures simultaneous arrival of video stream information of fields of view of a same moment, thereby reducing a time of waiting for all video streams to be separately received, and reducing a presentation delay of the fields of view.

(204) FIG. 14 is a schematic structural diagram of another server according to an embodiment of the present disclosure. As shown in FIG. 14, a server 40 includes a processor 401, a memory 402, and a transceiver 403. The processor 401, the memory 402, and the transceiver 403 may be connected by using a bus or in another manner.

(205) Optionally, the server 40 may further include a network interface 404 and a power module 405.

(206) The processor 401 may be a digital signal processing (Digital Signal Processing, DSP) chip.

(207) The memory 402 is configured to store an instruction. In specific implementation, the memory 402 may use a read-only memory (English: Read-Only Memory, ROM for short) or a random access memory (English: Random Access Memory, RAM for short). In this embodiment of the present disclosure, the memory 402 is configured to store code of a video stream transmission program.

(208) The transceiver 403 is configured to transmit and receive a signal.

(209) The network interface 404 is used by the server 40 to perform data communication with another device. The network interface 404 may be a wired interface or a wireless interface.

(210) The power module 405 is configured to supply power to each module of the server 40.

(211) The processor 401 is configured to call the instruction stored in the memory 402 to perform the following operations:

(212) receiving, by using the transceiver 403, a target request sent by a client, where the target request includes information about a corresponding target spatial location, of a target spatial object that needs to be presented upon request by the client, in a virtual reality VR content component;

(213) searching, based on the target spatial location information, for the corresponding target spatial object in the VR content component;

(214) obtaining information about a multiplex video stream that is obtained by performing preset multiplexing processing on an original video stream corresponding to the target spatial object; and

(215) sending, by using the transceiver 403, a target request feedback to the client in response to the target request, where the target request feedback includes the information about the multiplex video stream.

(216) That the processor 401 is configured to obtain information about a multiplex video stream that is obtained by performing preset multiplexing processing on an original video stream corresponding to the target spatial object is:

(217) dividing the target spatial object into N sub spatial objects, and encoding the N sub spatial objects to generate N corresponding sub video streams, where N is natural number greater than 1; and

(218) obtaining information about N multiplexed sub video streams that are obtained by separately performing the preset multiplexing processing on the N sub video streams.

(219) Further, the target request feedback further includes multiplexing description information, and the multiplexing description information includes at least one of the following:

(220) a quantity N of the sub video streams that is included in the information about the multiplex video stream;

(221) a starting location offset, in the information about the multiplex video stream, of a starting sub video stream of the N sub video streams;

(222) a data volume of the N multiplexed sub video streams;

(223) spatial location information, in the VR content component, respectively corresponding to the N multiplexed sub video streams;

(224) resolution information of the N multiplexed sub video streams;

(225) a video stream multiplexing type of the N multiplexed sub video streams; and

(226) resolution information of the N sub video streams.

(227) Even further, the multiplexing description information further includes:

(228) the spatial location information, in the VR content component, respectively corresponding to the N multiplexed sub video streams.

(229) Even further, the multiplexing description information further includes:

(230) spatial location information, in the VR content component, respectively corresponding to the N sub video streams.

(231) Even further, the preset multiplexing processing includes binary head-to-tail splicing processing on the video stream, binary head-to-tail splicing of video segments, or sample interleaving multiplexing processing.

(232) It should be noted that, for functions of the functional modules in the server 40 described in this embodiment of the present disclosure, reference may be made to related descriptions of the corresponding server in the embodiments shown in FIG. 5 to FIG. 10. Details are not described herein again.

(233) In this embodiment of the present disclosure, the server multiplexes and encapsulates, based on viewport location information in request information of the client, a video stream related to the viewport location information, and transmits an encapsulated multiplex video stream to the client. The video stream related to the viewport location information is a video stream having video content that partially or entirely overlaps with content of a viewport range requested by the client. To be specific, the server performs preset multiplexing processing on a video stream that responds to the request, to respond to the request from the client. This reduces a quantity of requests from the client, and also reduces a quantity of responses from the server. In addition, this ensures simultaneous arrival of video stream information of fields of view of a same moment, thereby reducing a time of waiting for all video streams to be separately received, and reducing a presentation delay of the fields of view.

(234) FIG. 15 is a schematic structural diagram of a video stream transmission system according to an embodiment of the present disclosure. A video stream transmission system 50 includes a VR client 501 and VR server 502.

(235) The VR client 501 may be the client 30 in the embodiment of FIG. 13, and the VR server 502 is the server 40 in the embodiment FIG. 14. It can be understood that the video stream transmission system 50 in this embodiment of the present disclosure may further include devices such as a photographic device, a storage device, a routing device, a switching device, and a core network server.

(236) In this embodiment of the present disclosure, the server multiplexes and encapsulates, based on viewport location information in request information of the client, a video stream related to the viewport location information, and transmits an encapsulated multiplex video stream to the client. The video stream related to the viewport location information is a video stream having video content that partially or entirely overlaps with content of a viewport range requested by the client. To be specific, the server performs preset multiplexing processing on a video stream that responds to the request, to respond to the request from the client. This reduces a quantity of requests from the client, and also reduces a quantity of responses from the server. In addition, this ensures simultaneous arrival of video stream information of fields of view of a same moment, thereby reducing a time of waiting for all video streams to be separately received, and reducing a presentation delay of the fields of view.

(237) The embodiments of the present disclosure further provide a computer storage medium. The computer storage medium may store a program. When the program is executed, some or all of the steps of any video stream transmission method in the foregoing method embodiments are performed.

(238) In the foregoing embodiments, the description of each embodiment has respective focuses. For a part that is not described in detail in an embodiment, refer to related descriptions in other embodiments.

(239) It should be noted that, to simplify description, the foregoing method embodiments are expressed as a combination of a series of actions. However, persons skilled in the art should appreciate that the present disclosure is not limited to the described action sequence, because according to the present disclosure, some steps may be performed in other sequences or performed simultaneously. In addition, persons skilled in the art should also appreciate that all the embodiments described in the specification are example embodiments, and the related actions and modules are not necessarily mandatory to the present disclosure.

(240) In the several embodiments provided in this application, it should be understood that the disclosed apparatus may be implemented in other manners. For example, the described apparatus embodiment is merely an example. For example, the unit division is merely logical function division and may be other division in actual implementation. For example, a plurality of units or components may be combined or integrated into another system, or some features may be ignored or not performed. In addition, the displayed or discussed mutual couplings or direct couplings or communication connections may be implemented through some interfaces. The indirect couplings or communication connections between the apparatuses or units may be implemented in electronic or other forms.

(241) The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one position, or may be distributed on a plurality of network units. Some or all of the units may be selected based on actual requirements to achieve the objectives of the solutions of the embodiments.

(242) In addition, functional units in the embodiments of the present disclosure may be integrated into one processing unit, or each of the units may exist alone physically, or two or more units are integrated into one unit. The integrated unit may be implemented in a form of hardware, or may be implemented in a form of a software functional unit.

(243) When the foregoing integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, the integrated unit may be stored in a computer-readable storage medium. Based on such an understanding, the technical solutions of the present disclosure essentially, or the part contributing to the prior art, or all or some of the technical solutions may be implemented in the form of a software product. The software product is stored in a storage medium and includes several instructions for instructing a computer device (which may be a personal computer, a server, or a network device, and may be a processor in a computer device) to perform all or some of the steps of the foregoing methods described in the embodiments of the present disclosure. The foregoing storage medium may include: any medium that can store program code, such as a USB flash drive, a removable hard disk, a magnetic disk, an optical disc, a read-only memory (English: Read-Only Memory, ROM for short), or a random access memory (English: Random Access Memory, RAM for short).

(244) The foregoing embodiments are merely intended for describing the technical solutions of the present disclosure other than limiting the present disclosure. Although the present disclosure is described in detail with reference to the foregoing embodiments, persons of ordinary skill in the art should understand that they may still make modifications to the technical solutions described in the foregoing embodiments or make equivalent replacements to some technical features thereof, without departing from the spirit and scope of the technical solutions of the embodiments of the present disclosure.