Abstract
This invention discloses a kind of reliable data transmission method based on hidden Markov model that specific to video transmission quality enhancement over lossy satellite links. It uses HMM model to forecast retransmission rate and adopts the network packet loss rate to reflect the network performance. The underlying network packet loss rate is used as the hidden state of HMM model and the retransmission rate is used as the observation state. By analyzing the historically transmitted data sessions, APRT establishes the relationship between the hidden state transition probability and the emission probability. Then, a robust and efficient retransmission rate prediction is obtained. This invention takes into full consideration of high BER in satellite network channels and adjusts the reliable level according to the satellite network channel characteristics so as to make tradeoff between instantaneity and quality. Consequently, it guarantee the QoS and QoE of video stream.
Claims
1. It is a kind of reliable transmission method based on hidden Markov model to handle the quality and real-time problem of delay-sensitive video service over lossy satellite links, which is characterized in that it comprises the steps as follows: Step 1: Present the specification definition of HMM model This method uses HMM model to forecast retransmission rate; The underlying network packet loss rate is used as the hidden state of HMM model and the retransmission rate is used as the observation state; By analyzing the historically transmitted data sessions, it establishes the relationship between the hidden state transition probability and the emission probability, Then a robust and efficient retransmission rate prediction is obtained; Random variables: w.sub.t is defined as retransmission rate in time period t , w.sub.t is defined as the actual retrasmission rate measured in the network, .sub.t indicates the predicted value of random variable w.sub.t; Assume that the retransmission rate of the strategy W.sub.t is changing with the variation of some hidden state variables X.sub.t X, where X {x.sub.1, x.sub.2, . . . , . . . x.sub.N} represents a set of possible discrete state sequences and N=|X| indicates the number of states; State variables X.sub.t is a random variable and the probability distribution is defined as the vector =(P (X.sub.t=x.sub.1), . . . , ![custom-character]()
=x.sub.N)); The HMM model assumes that the state varies with the Markov process, where the probability distribution of the current state is determined by the state of its previous period, that is P (X.sub.t|x.sub.t1, ![custom-character]()
P (X.sub.t|X.sub.t1); The defined transition probability matrix is P={P.sub.ij}, where P.sub.ij=P (X.sub.t=x.sub.t|X.sub.t1=x.sub.t), According to Markov properties, it can be concluded that .sub.t+=.sub.tP.sup.t; When a hidden state X.sub.t is given, we assume that the probability distribution function (pdf) of network packet loss rate follows the following Gaussian distribution function: W.sub.t|X.sub.t=xN(.sub.x, .sub.x.sup.2); Step 2: Offline training phase When the number of states is given, and the training data set is Set(M*.sub.s, s), utilize the maximum likelihood estimation algorithm to calculate the parameters of HMM model, which can be expressed by the equation .sub.HMM={.sub., P, {(.sub.x, .sub.x.sup.2), x X}}; Step 3: Online prediction stage 1) Prediction initialization: Set(M*.sub.s, s) is the most matching feature for the transmission of flow s, which is defined as .sub.t=Median (Set(M*.sub.s , s)), where Set(M*.sub.s, s) is the mean value of the data set and as the initial network packet loss rate; 2) Forecast phase: In the period t, the updated pdf of the HMM model is given, Then according to Markov feature, the pdf of current time period can be calculated by the equation .sub.t1:t1=.sub.t1|:t1P, The predicted retransmission rate .sub.t can also be calculated; 3) Parameter update of HMM model: When the actual network packet loss rate W.sub.t=w.sub.t and .sub.t|:t1 are given, Baum-Welch algorithm is used to update the parameters of HMM model, .sub.t|:t1 is updated as .sub.t|:t1, and P.sub.ij is updated as P.sub.ij; Step 4: Congestion Control 1) Rate control for video flow: When the receiver uses the HMM model to determine the retransmission rate of the video, it returns the adaptive ACK feedback packet; When the sender receives the ACK packets, the APRT protocol congestion window control adopts the loss based congestion indicators, and the cubic window growth function, which is defined in Cubic TCP, so as to update the congestion window increase quickly and discreetly; 2) Fast retransmission: When the network is in a non-congested state, the receiver side returns almost all the ACK feedbacks of all received data, and the sender performs fast retransmission after receiving duplicated ACKs or timeout as traditional transport protocol; When the network is predicted in a poor or a congested state, the receiver retransmits the acknowledgment feedback partially, and the sender only performs fast retransmission for the confirmed lost packets, For extreme conditions, such as if the network is in idle time, the APRT protocol is regarded as a completely reliable transmission protocol as the TCP protocol.
2. The reliable transmission method based on hidden Markov model as mentioned in claim 1 is characterized in that the formula to calculate .sub.t in Step 3 is defined as follows:
3. The reliable transmission method based on hidden Markov model as mentioned in claim 1 is characterized in that the formulas to calculate .sub.t|:t1 and P.sub.ij in Step 3 is defined as follows:
Description
SPECIFICATION OF THE ATTACHED FIGURES
[0023] FIG. 1 shows the overview of HMM model.
[0024] FIG. 2 shows the simulation topology.
[0025] FIG. 3 shows the average throughput of each protocol under different link error rates when the bottleneck link bandwidth is 10 Mbps.
[0026] FIG. 4 shows the average throughput of each protocol under different link error rates when the bottleneck link bandwidth is 200 Kbps.
[0027] FIG. 5 shows the changing of RTT of different single flow over time when the link error rate is 10.sup.5 in scenario A.
[0028] FIG. 6 shows the changing of RTT of different single flow over time when the link error rate is 10.sup.5 in scenario B.
[0029] FIG. 7 shows the changing of delay jitter of different single flows over time in scenario A and scenario B.
[0030] FIG. 8 shows the changing of delay jitter of different single flows over time in scenario B.
[0031] FIG. 9 shows the subjective video quality of different single protocols using different video test sequence, when the bandwidth is 10 Mb/s and BER is 10.sup.7 (1).
[0032] FIG. 10 shows the subjective video quality of different single protocols using different video test sequence, when the bandwidth is 10 Mb/s and BER is 10.sup.7 (2).
[0033] FIG. 11 shows the subjective video quality of different single protocols using different video test sequence, when the bandwidth is 10 Mb/s and BER is 10.sup.7 (3).
[0034] FIG. 12 shows the subjective video quality of different single protocols using different video test sequence, when the bandwidth is 10 Mb/s and BER is 10.sup.7 (4).
[0035] FIG. 13 shows the subjective video quality of different single protocols using different video test sequence, when the bandwidth is 200 Kb/s and BER is 10.sup.6 (1).
[0036] FIG. 14 shows the subjective video quality of different single protocols using different video test sequence, when the bandwidth is 200 Kb/s and BER is 10.sup.6 (2).
[0037] FIG. 15 shows the subjective video quality of different single protocols using different video test sequence, when the bandwidth is 200 Kb/s and BER is 10.sup.6 (3).
[0038] FIG. 16 shows the impact of different playout buffer sizes on the quality of APRT protocol.
[0039] FIG. 17 shows the average throughput of three video flows under different link BERs when the bottleneck link bandwidth is 10 Mbps.
[0040] FIG. 18 shows the average throughput of three video flows under different link BERs when the bottleneck link bandwidth is 200 Kbps.
[0041] FIG. 19 shows the changing of RTT of different concurrent flows over time in scenario A.
[0042] FIG. 20 shows the changing of RTT of different concurrent flows over time in scenario B.
[0043] FIG. 21 shows the changing of delay jitter of different concurrent flows over time in scenario A.
[0044] FIG. 22 shows the changing of delay jitter of different concurrent flows over time in scenario B.
[0045] FIG. 23 shows subjective video quality of different concurrent protocols using different video test sequence, when the bandwidth is 10 Mb/s and BER is 10.sup.7 (1).
[0046] FIG. 24 shows subjective video quality of different concurrent protocols using different video test sequence, when the bandwidth is 10 Mb/s and BER is 10.sup.7 (2).
[0047] FIG. 25 shows subjective video quality of different concurrent protocols using different video test sequence, when the bandwidth is 200 Kb/s and BER is 10.sup.6 (1).
[0048] FIG. 26 shows subjective video quality of different concurrent protocols using different video test sequence, when the bandwidth is 200 Kb/s and BER is 10.sup.6 (2).
SPECIFIC IMPLEMENTATION METHOD
[0049] Further specific specification is given as follows by combining the attached figures and the implementation case in detail.
[0050] Simulation topology is shown in FIG. 2, which includes the senders, the receivers and the satellite networks. The following two main scenarios are simulated: [0051] Scenario A: bandwidth of the bottleneck link is 10 Mb/s with varied round trip time (RTT), which represents broadband MEO satellite networks; [0052] Scenario B: bandwidth of the bottleneck link is 200 Kb/s with varied RTT, which represents narrowband LEO satellite networks.
[0053] The APRT protocol is compared with different types of protocols, which include various reliability and order. Therein, variable , denote the reliability degree of the transport service provided. A reliable service is 100% reliable. A partially reliable service is the service with [0%, 100%], variable defines the orderliness of the strategy, where [0%, 100%]. P1 represents APRT protocol, P2 represents the protocol with =1, =1, P3 represents the protocol with 1, =1, P4 represents the protocol with 1, =1
[0054] It can be concluded from both FIGS. 3 and 4 that the average throughput of all protocols reduces with the increase of link error rate. As shown in FIG. 3, when the bottleneck link bandwidth is 10 Mbps, all protocols cannot take full advantage of the link bandwidth, so that the network is in a state of no congestion, When the BER is from 10.sup.9 to 10.sup.6, the network is in good state. The average throughput of APRT and p2 strategies are higher than p3 and p4 strategies. This is because the throughput of unreliable strategies (i.e., p3 and p4) is limited by the transfer speed of video encoded frames from the application layer to the transport layer at the sender side. Nevertheless, there is a reliable confirmation component in p2 strategy and APRT protocol, which produces part of the retransmission packets. When the link error rate is greater than 2.010.sup.6, the average throughput of p3 and p4 strategies start to larger than that of reliable p2 strategy, while the APRT protocol begins to perform a similar performance to p4 strategy. The reason for this is that p2 strategy is based on the ACK acknowledgment to assure reliability while APRT adopts partially reliable transfer mechanism.
[0055] As shown in FIG. 4, when the bottleneck link bandwidth is 200 Kbps, the bottleneck link has been saturated, and is in a moderate congestion state. For different BER, p4 strategy always maintains the highest average throughput of about 200 Kbps, followed by p3 strategy. When the link error rate is from 10.sup.9 to 10.sup.6, average throughput of APRT protocol is slightly higher than of p2 strategy. When the BER is larger than 10.sup.6, p2 strategy has an obvious performance degradation, the reason is that p3 and p4 strategies have no packet transmission control mechanism, so that the throughput is large. Therein, p3 strategy applies a packet in-order guarantee mechanism, so that the throughput of p3 is slightly smaller than that of p4 strategy, in which =1. For APRT protocol, it will determine the state of the network according to the HMM model. When approaching the saturation bandwidth occupancy, APRT utilizes partially reliable transmission mechanism. When the network packet loss rate is large, APRT reduces the reliability of the protocol for real-time transmission. Thus, the proposed protocol can make trade-offs between high-quality and playback continuity.
[0056] It can be seen from FIG. 5 that the RTT of APRT protocol changes between [52.5 ms, 53 ms], the RTT of p2 strategy varies between [52.5 ms, 53.5 ms], and that of p3 and p4 strategies changes between [50 ms, 53 ms]. This is because that when the network bandwidth is not fully utilized, the reliable mechanism of p2 strategy will cause network routers cache a certain amount of data packets, so that the packet has a queuing delay. This will result in RTT increase. While for protocols without guaranteeing reliability, the more the protocol is unreliable, the lower the RTT is. Combining the jitter result shown in FIG. 7, p2 strategy has a high delay jitter. The larger the delay jitter is, the less stable queueing produced in the bottleneck routers.
[0057] It can be seen from FIG. 6 that RTT of different protocols has big difference. Therein, the RTT of p2 is much higher than the other three protocols. This is caused by the congestion control of p2 strategy; whose window changes regularly. At this time, the network utilization is high with high random BER in satellite networks, which results in a large number of packets buffered in routers. When the network has free bandwidth, the growth of the window is slow. Once packet loss events occur, congestion window of p2 turns into the congestion avoidance stage. The RTT of p4 packet is less than that of p2 strategy packet. Because of the high utilization of the network at this time, and that p4 strategy does not have congestion control mechanism, the routers of bottleneck link also buffer a large number of data packets. Because of p3 strategy guarantees the packet order and will discard the out-of-order packet at the receiver side, most RTT of p3 packets are less than 150 ms delay. APRT protocol also has a smaller round-trip delay APRT also represents a ladder curve characteristics, which is doe to the HMM model network prediction. APRT carries out an adaptive reliability and avoids unnecessary congestion window reduction so as to maintain the congestion window in a relatively stable state. According to the corresponding delay jitter in FIG. 8, it can be seen that the delay jitter range of p2 strategy is between [0,0.5], which is violent, and the APRT protocol is around 0.1, except that some individual points reach 0.3. p4 and p3 strategies achieve minimal delay jitter, which are all less than 0.06.
[0058] Table 1 examines the packet loss results in different network states. Overall, it can be seen that for different BERs, packet loss rate of different protocols is: packet loss rate of p4>packet loss rate of p3>packet loss rate of APRT>packet loss rate of p2. When the bandwidth of 200 Kbps, the performance of p4 strategy and p3 strategy are affected greatly, and the total number of dropped frames are 452 and 314, respectively. The total number of dropped frames of APRT protocol is 178 at most.
TABLE-US-00001 TABLE 1 Lost Frames of Different Protocols under Single Flow Scenarios with Different Bandwidths and BERs. Bandwidth protocol BER Packet loss rate Lost frame 10 Mb/s P1 10.sup.7 0.0065 17 10.sup.5 0.1215 52 P2 10.sup.7 0.0062 16 10.sup.5 0.1375 40 P3 10.sup.7 0.068 18 10.sup.5 0.1198 286 P4 10.sup.7 0.0074 19 10.sup.5 0.1166 299 200 Kb/s P1 10.sup.7 0.0471 83 10.sup.5 0.1409 178 P2 10.sup.7 0.0285 24 10.sup.5 0.1341 24 P3 10.sup.7 0.1638 303 10.sup.5 0.1364 314 P4 10.sup.7 0.1762 452 10.sup.5 0.1567 402
[0059] The PSNR results are shown in Table 2. The upper part of Table 2 shows a good state of the network, where the bandwidth is not fully utilized and the link BER is 10.sup.8. The four protocols achieve a higher. PSNR value and the corresponding MOS value is 5, while the reliable protocol has higher video transmission quality than the unreliability protocol. The PSNR of the APRT protocol is 11.62% higher than that of the p4 strategy. The lower part of Table 2 shows a poor network status, where the bandwidth low and link BER of 10.sup.5. Therein, PSNR of p2 strategy is 0, indicating that the video cannot be decoded and reconstruction. The video quality based on p3 strategy and p4 strategy is fair and poor, respectively. The APRT protocol with a certain reliability guarantee can reach 32.89, which ensures a better video transmission quality.
TABLE-US-00002 TABLE 2 Video Quality of Different Protocols under Single Flow Scenarios with Different Bandwidths and BERs. Bandwidth MOS protocol BER PSNR MOS evaluation 10 Mb/s P1 10.sup.8 41.525381 5 Excellent P2 41.623857 5 Excellent P3 37.296478 5 Excellent P4 37.202516 5 Excellent 200 Kb/s P1 10.sup.5 32.889131 4 Good P2 0 1 Bad P3 29.525154 3 Fair P4 24.092692 2 Poor
[0060] FIG. 9-12 and FIG. 13-15 show the video quality comparison of different video test sequences in different network states. By comparing with the source video image, it can be seen that the video quality of the APRT protocol and p2 strategy of the second and third columns is almost as clear as the source video image, and the video quality of p4 strategy is slightly worse, especially for dynamic image. In FIG. 13-15, due to this network state, p2 strategy is unable to carry out video decoding and reconstruction work, so we only show the quality of two compared video transfer protocols, i.e., p3 and p4. It can be seen that the quality of APRT protocol video is significantly better than that of p4 protocol.
[0061] FIG. 16 shows that the bigger the playout buffer is, the better the video quality are. When the link error rate is 10.sup.7 and the playout buffer size is less than 150, video quality only achieve fair quality. When the playout buffer size is higher than 150, the video quality is good. When the link error rate of 10.sup.5 and the playout buffer size is less than 110, the video quality is poor, while the playout buffer size is higher than 240, the video quality is good. After the playout buffer size is higher than 350, continue to increase the size of the playout buffer does not improve the quality of the video any more. Overall, we can see that for a playout buffer with 150 to 300 packets, APRT can achieve a good quality of video playback. Moreover, because the poor satellite networks environment, larger playout buffer size is not necessary.
[0062] It can be seen from FIGS. 17 and 18 that the results are almost the same as the single flow experiments, that is, the average throughput of all protocols decrease as the link BER increases. As shown in FIG. 17, the bottleneck link bandwidth is 10 Mbps and the link error rate is 4.510.sup.6, average throughput of APRT, p2 and p4 strategy are around 560 Kbps. The results of FIG. 18 differ from the single flow scenario, the average throughput of APRT protocol holds between the performance of p2 and p4 strategy. When the BER is 10.sup.5, the average throughput of APRT protocol is higher than that of p2 strategy.
[0063] The evaluation of round trip delay and delay jitter is also similar to the result of a single flow scenario. FIG. 19 shows the delay curve changing over time when the link BER is 10.sup.5 in scenario A. It can be seen from the figure that RTT of APRT protocol packet changes in the interval of [52.5 ms, 55 ms]. When p2 becomes stable, its RTT changes in the interval of [52 ms, 65 ms]. The RTT of p3 strategy and p4 strategy are between the interval of [52.5 ms, 60 ms]. The corresponding delay jitter results are given in FIG. 21, which shows that the APRT protocol has a larger round trip delay and can maintain a smaller queuing delay in the router:
[0064] FIG. 20 shows the RTT curve varying over time when link BER is 10.sup.5 in scenario B. It can be seen from the figure that when the network data flow increases, the round trip delay increases from 150 ms to 400 ms comparing with when there is only a single flow in the network. The overall round trip delay of APRT protocol is the smallest. However, as shown in FIG. 22, APRT has a large delay jitter like p2.
[0065] Table 3 is used to check the coexistence of multiple data strip in different network state under different packet loss situation. It can be seen that in the case of multiple flow coexisting situations, all of the protocols have a high packet loss rate, especially when the bandwidth is 200 Kbps. The packet loss rate of APRT reduced by 77.69% and 55.05% comparing with the p4 strategy.
TABLE-US-00003 TABLE 3 Lost Frames of Different Protocols under Concurrent Flow Scenarios with Different Bandwidths and BERs. Bandwidth Protocol BER Packet loss rate Lost frame 10 Mb/s P1 10.sup.7 0.0173 48 10.sup.5 0.1475 71 P2 10.sup.7 0.0158 41 10.sup.5 0.2198 87 P3 10.sup.7 0.0672 54 10.sup.5 0.1340 69 P4 10.sup.7 0.0677 55 10.sup.5 0.1093 74 200 Kb/s P1 10.sup.7 0.1982 54 10.sup.5 0.2981 64 P2 10.sup.7 0.2068 55 10.sup.5 0.3301 69 P3 10.sup.7 0.8885 6814 10.sup.5 0.8885 6791 P4 10.sup.7 0.8885 6814 10.sup.5 0.8867 6800
[0066] For the upper part of Table 4, when the network state is better, the four protocols can reach a higher PSNR value, and the MOS value is 4. The PSNR of difference protocol is not significant. However, when the network gets worse, the performance of APRT protocol is significantly better than the other three protocols. It can be concluded that APRT ensures a better video transmission quality.
TABLE-US-00004 TABLE 4 Video Quality of Different Protocols under Concurrent Flow Scenarios with Different Bandwidths and BERs. Bandwidth MOS Protocol BER PSNR MOS evaluation 10 Mb/s P1 10.sup.8 33.032264 4 Good P2 33.146254 4 Good P3 32.484776 4 Good P4 32.440097 4 Good 200 Kb/s P1 10.sup.6 30.652149 3 Fair P2 0 1 Bad P3 27.088844 3 Fair P4 22.441292 2 Poor
[0067] It can be seen from FIGS. 23 and 24 that the video quality of the APRT protocol and the p2 strategy is almost as well as the source video image, while the video quality transmitted by the p4 strategy is slightly worse, especially for the dynamic images. For FIGS. 25 and 26, because in this network state, p2 strategy transmission of data has been unable to carry out video decoding and reconstruction work, so only shows the quality of other two comparing transmission protocol. It can be seen that video quality based on APRT protocol is significantly better than that of p4 strategy. Because the first sequence images are relatively static, so the quality is better than that of the second row. For second row, the transfer of p4 strategy represents a serious discontinuous phenomenon.
