Systems and methods for packet payload mapping for robust transmission of data are described. For example, methods may include receiving, using a network interface, packets that each respectively include a primary frame and one or more preceding frames from the sequence of frames of data that are separated from the primary frame in the sequence of frames by a respective multiple of a stride parameter; storing the frames of the packets in a buffer with entries that each hold the primary frame and the one or more preceding frames of a packet; reading a first frame from the buffer as the primary frame from one of the entries; determining that a packet with a primary frame that is a next frame in the sequence has been lost; and, responsive to the determination, reading the next frame from the buffer as a preceding frame from one of the entries.

A Head-Mounted Display (HMD) is provided which comprises a camera configured to capture a video of a real-world scene with a first field-of-view (FoV), a network interface circuit configured to stream video to a receiving display device, and processing means which is operative to generate a 3D model of the real-world scene, and to generate a video from the 3D model using a second FoV which is wider than the first FoV. The processing means is further operative to estimate a motion of the camera, and to stream the generated video to the receiving display device if the estimated motion of the camera satisfies one or more conditions indicative of rapid motion, else stream the captured video to the receiving display device.

A Head-Mounted Display (HMD) is provided which comprises a camera configured to capture a video of a real-world scene with a first field-of-view (FoV), a network interface circuit configured to stream video to a receiving display device, and processing means which is operative to generate a 3D model of the real-world scene, and to generate a video from the 3D model using a second FoV which is wider than the first FoV. The processing means is further operative to estimate a motion of the camera, and to stream the generated video to the receiving display device if the estimated motion of the camera satisfies one or more conditions indicative of rapid motion, else stream the captured video to the receiving display device.

Audio and video transmission device and audio and video transmission system are provided. The audio and video transmission system includes an audio and video transmission device and at least one wireless microphone transmitting device. Each of the at least one wireless microphone transmitting device is configured to send an audio signal acquired by a wireless microphone to the audio and video transmission device. The audio and video transmission device is configured to be respectively connected to the wireless microphone transmitting device and an external video acquisition device and configured to: receive the audio signal from the wireless microphone transmitting device and transmit the audio signal to the video acquisition device, obtain a mixture signal generated by the video acquisition device from the audio signal and a video signal, and process and output the mixture signal.

Audio and video transmission device and audio and video transmission system are provided. The audio and video transmission system includes an audio and video transmission device and at least one wireless microphone transmitting device. Each of the at least one wireless microphone transmitting device is configured to send an audio signal acquired by a wireless microphone to the audio and video transmission device. The audio and video transmission device is configured to be respectively connected to the wireless microphone transmitting device and an external video acquisition device and configured to: receive the audio signal from the wireless microphone transmitting device and transmit the audio signal to the video acquisition device, obtain a mixture signal generated by the video acquisition device from the audio signal and a video signal, and process and output the mixture signal.

A remote control with a microphone subsystem comprising a pair of internal microphones is shown and described. When connected to a remote-control base station that is itself connected to an external power source, the microphone subsystem is continuously energized by the external power source, and the pair of internal microphones operate as far field microphones that receive oral commands uttered by a user from a distance. When the remote control is removed from the base, the microphone subsystem is configured for selective connection to an internal power source by actuating a user control on the remote control. In the external power source mode, signals from both microphones are digitally processed to provide a far-field microphone array with beam forming. In the direct current mode, only one microphone's signals are digitally processed as a simple monaural signal (or they are not digitally processed). The remote control also includes a video camera capable of capturing video image data of the user and transmitting it to an associated television for facial recognition of the user.

A remote control with a microphone subsystem comprising a pair of internal microphones is shown and described. When connected to a remote-control base station that is itself connected to an external power source, the microphone subsystem is continuously energized by the external power source, and the pair of internal microphones operate as far field microphones that receive oral commands uttered by a user from a distance. When the remote control is removed from the base, the microphone subsystem is configured for selective connection to an internal power source by actuating a user control on the remote control. In the external power source mode, signals from both microphones are digitally processed to provide a far-field microphone array with beam forming. In the direct current mode, only one microphone's signals are digitally processed as a simple monaural signal (or they are not digitally processed). The remote control also includes a video camera capable of capturing video image data of the user and transmitting it to an associated television for facial recognition of the user.

A method for transmitting high bandwidth camera data through a SerDes links is provided. The method includes steps of: calculating transmission bandwidth required for transmitting image data, and the image data is obtained by a high bandwidth camera; determining a maximum bandwidth capacity of each SerDes link of a plurality of SerDes links; cutting the image data into a plurality of sub images according to the transmission bandwidth and the maximum bandwidth capacity of each SerDes link; assigning each sub image to a sub image transmission area in a corresponding SerDes link, and each SerDes link containing the sub image transmission area and the sub image reception area; acquiring a plurality of sub images transmitted in the plurality of the SerDes links from the corresponding sub image reception area; and splicing the plurality of sub images into the image data.

A method for transmitting high bandwidth camera data through a SerDes links is provided. The method includes steps of: calculating transmission bandwidth required for transmitting image data, and the image data is obtained by a high bandwidth camera; determining a maximum bandwidth capacity of each SerDes link of a plurality of SerDes links; cutting the image data into a plurality of sub images according to the transmission bandwidth and the maximum bandwidth capacity of each SerDes link; assigning each sub image to a sub image transmission area in a corresponding SerDes link, and each SerDes link containing the sub image transmission area and the sub image reception area; acquiring a plurality of sub images transmitted in the plurality of the SerDes links from the corresponding sub image reception area; and splicing the plurality of sub images into the image data.

A video surveillance system comprising a video management system, one or more computer-implemented digital devices and a plurality of application programs, the system being configured to run the programs on one of or across several of the said one or more computer-implemented digital devices, and configured to perform parallel processing of one or more groups of pictures from one or more video streams with the plurality of application programs in one or across several of the said one or more computer-implemented digital devices.