Apparatus and method for precise positioning based on deep learning
11621791 · 2023-04-04
Assignee
Inventors
Cpc classification
H04L5/0007
ELECTRICITY
H04W72/0453
ELECTRICITY
H04B7/0626
ELECTRICITY
International classification
Abstract
Disclosed herein are an apparatus and method for precise positioning based on deep learning. The method performed by the apparatus includes setting a collection location and a collection environment, collecting wireless signal data based on the collection location and the collection environment, generating a magnitude map image for training from the wireless signal data, and generating a positioning DB model by learning the image characteristics of the magnitude map image for training through deep-learning-based training.
Claims
1. A method for precise positioning based on deep learning, performed by an apparatus for precise positioning based on deep learning, comprising: setting a collection location and a collection environment and collecting wireless signal data based on the collection location and the collection environment; and generating a magnitude map image for training from the wireless signal data and learning image characteristics of the magnitude map image for training through deep-learning-based training, thereby generating a positioning DB model, wherein the wireless signal data is a Channel State Information Reference Signal (CSI-RS), and wherein the magnitude map image is a graph that represents magnitude data of a frequency response for each subcarrier of the CSI-RS.
2. The method of claim 1, wherein the magnitude map image is the graph in which magnitude data of a frequency response for each OFDM symbol index is further considered, in addition to the magnitude data of the frequency response for the each subcarrier.
3. The method of claim 2, wherein the magnitude map image is the graph represented as multiple graphs so as to correspond to CSI-RSs collected from multiple channels in the collection location.
4. The method of claim 3, wherein generating the positioning DB model is configured to generate the positioning DB model by learning the image characteristics of the magnitude map image for training and information about the collection location of the wireless signal data through the deep-learning-based training.
5. The method of claim 4, wherein the image characteristics are a number of graphs and patterns thereof.
6. An apparatus for precise positioning based on deep learning, comprising: one or more processors; and executable memory for storing at least one program executed by the one or more processors, wherein the at least one program is configured to set a collection location and a collection environment and collect wireless signal data based on the collection location and the collection environment; and wherein the at least one program is configured to generate a magnitude map image for training from the wireless signal data and generate a positioning DB model by learning image characteristics of the magnitude map image for training through deep-learning-based training, wherein the wireless signal data is a Channel State Information Reference Signal (CSI-RS), and wherein the magnitude map image is a graph that represents magnitude data of a frequency response for each subcarrier of the CSI-RS.
7. The apparatus of claim 6, wherein the magnitude map image is the graph in which magnitude data of a frequency response for each OFDM symbol index is further considered, in addition to the magnitude data of the frequency response for the each subcarrier.
8. The apparatus of claim 7, wherein the magnitude map image is the graph represented as multiple graphs so as to correspond to CSI-RSs collected from multiple channels in the collection location.
9. The apparatus of claim 8, wherein the at least one program determines a similarity of image characteristics between the magnitude map image and each of previously learned magnitude map images included in the positioning DB model and estimates the location information pertaining to the wireless signal data from information about a collection location of a previously learned magnitude map image having a highest similarity.
10. The apparatus of claim 9, wherein the image characteristics are a number of graphs and patterns thereof.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1) The above and other objects, features and advantages of the present invention will be more clearly understood from the following detailed description taken in conjunction with the accompanying drawings, in which:
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11)
(12)
(13)
(14)
(15)
DESCRIPTION OF THE PREFERRED EMBODIMENTS
(16) The present invention will be described in detail below with reference to the accompanying drawings. Repeated descriptions and descriptions of known functions and configurations that have been deemed to unnecessarily obscure the gist of the present invention will be omitted below. The embodiments of the present invention are intended to fully describe the present invention to a person having ordinary knowledge in the art to which the present invention pertains. Accordingly, the shapes, sizes, etc. of components in the drawings may be exaggerated in order to make the description clearer.
(17) Throughout this specification, the terms “comprises” and/or “comprising” and “includes” and/or “including” specify the presence of stated elements but do not preclude the presence or addition of one or more other elements unless otherwise specified.
(18) Hereinafter, a preferred embodiment of the present invention will be described in detail with reference to the accompanying drawings.
(19)
(20) Referring to
(21) The data collection device 100 may receive multi-channel or multi-antenna wireless signal data transmitted from a base station 10 and transmit the same to the positioning DB server 200.
(22) The positioning DB server 200 may generate a deep-learning-based positioning DB model by preprocessing the received multi-channel or multi-antenna wireless signal data.
(23) Here, the positioning DB server 200 may receive wireless signal data for positioning from the precise positioning device 300, may perform precise positioning using the positioning DB model, and may transmit the result of positioning to the precise positioning device 300.
(24) The precise positioning device 300 may collect multi-channel or multi-antenna wireless signal data from a location for which positioning is required, may request location information pertaining to the wireless signal data from the positioning DB server 200 by transmitting the wireless signal data for positioning to the positioning DB server, and may receive the result of positioning.
(25) The apparatus for precise positioning based on deep learning according to an embodiment of the present invention may be implemented as a single computing device including the components and functions of the data collection device 100, the positioning DB server 200, and the precise positioning device 300.
(26) The apparatus for precise positioning based on deep learning may set a collection location and a collection environment for which positioning is required.
(27) Here, the apparatus for precise positioning based on deep learning may collect wireless signal data based on the collection location and the collection environment.
(28) Here, the apparatus for precise positioning based on deep learning may generate a magnitude map image from the wireless signal data, and may generate a positioning DB model by learning the image characteristics of the magnitude map image through deep-learning-based training.
(29) Here, the apparatus for precise positioning based on deep learning may generate a magnitude map image from the wireless signal data, and may estimate the location information pertaining to the wireless signal data based on the image characteristics of the magnitude map image using the positioning DB model.
(30) Here, the wireless signal data may be a Channel State Information Reference Signal (CSI-RS).
(31) Here, the magnitude map image may be a graph that represents the magnitude data of a frequency response for each subcarrier of the CSI-RS.
(32) Here, the magnitude map image may be the graph in which the magnitude data of a frequency response for each OFDM symbol index is further considered, in addition to the magnitude data of the frequency response for each subcarrier.
(33) Here, the magnitude map image may be the graph represented as multiple graphs so as to correspond to CSI-RSs collected from multiple channels at the collection location.
(34) Here, the apparatus for precise positioning based on deep learning may generate the positioning DB model by learning the image characteristics of the magnitude map image and information about the collection location of the wireless signal data through deep-learning-based training.
(35) Here, the apparatus for precise positioning based on deep learning may determine the similarity of image characteristics between the magnitude map image and each of the previously learned magnitude map images included in the positioning DB model, and may estimate the location information pertaining to the wireless signal data from the information about the collection location of the previously learned magnitude map image having the highest similarity.
(36) Here, the apparatus for precise positioning based on deep learning may determine the positioning accuracy of the wireless signal data for positioning by selecting the label value (location number) of the location information pertaining to the wireless signal data for training that matches the wireless signal data for positioning when the image characteristics of the magnitude map images for positioning are input to the positioning DB model.
(37) Here, the image characteristics may be the number of graphs and the patterns thereof.
(38)
(39) Referring to
(40) That is, at step S410, a collection location and a collection environment may be set, and wireless signal data may be collected based on the collection location and the collection environment.
(41) Referring to
(42) That is, at step S411, the collection location may be set using the data collection device 100 while moving the same depending on the collection environment.
(43) Here, at step S411, wireless signal data may be dynamically collected while moving along a collection path after the collection path is set. Alternatively, multiple fixed points are set in the collection location, after which wireless signal data may be statically collected from the respective points.
(44) Here, at step S411, collection location information with which the training data of the positioning DB model will be labelled may be generated using the GPS location information of a GPS sensor included in the data collection device 100 or using the coordinates of the preset collection location.
(45) Also, at step S410, the collection environment may be set at step S412.
(46) That is, at step S412, settings related to the wireless signal data to collect, that is, a communication company, a frequency, a band, or the like, may be set.
(47) Also, at step S410, wireless signal data may be collected at step S413.
(48) That is, at step S413, after the collection location and the collection environment are set, wireless signal data may be collected along the set collection path or in the set collection location.
(49) Also, in the method for precise positioning based on deep learning according to an embodiment of the present invention, whether to perform training for positioning may be determined at step S420.
(50) That is, at step S420, when the wireless signal data is collected for training, a positioning DB model may be generated at step S430 using the wireless signal data as training data, whereas when the wireless signal data is collected for positioning in order to estimate the location, positioning may be performed at step S440 using the wireless signal data as positioning data.
(51) Here, at step S420, when the positioning DB server 200 is used, the collected wireless signal data may be transmitted thereto.
(52) Also, in the method for precise positioning based on deep learning according to an embodiment of the present invention, a positioning DB model may be generated at step S430.
(53) That is, at step S430, a magnitude map image for training may be generated from the wireless signal data, and a positioning DB model may be generated by learning the image characteristics of the magnitude map image for training through deep-learning-based training.
(54) Referring to
(55) That is, at step S431, a magnitude map image for training, which is capable of reflecting the characteristics of multi-channel or multi-antenna wireless signal data, may be generated.
(56)
(57) Here, the wireless signal data may be a Channel State Information Reference Signal (CSI-RS).
(58) Here, the magnitude map image may be a graph that represents the magnitude data of a frequency response for each subcarrier of the CSI-RS.
(59) Here, the magnitude map image may be the graph in which the magnitude data of a frequency response for each OFDM symbol index is further considered, in addition to the magnitude data of the frequency response for each subcarrier.
(60) Here, the magnitude map image may be the graph represented as multiple graphs so as to correspond to CSI-RSs collected from multiple channels in the collection location.
(61) Here, at step S431, a 3D magnitude map image of the subcarrier for each OFDM symbol of the CSI-RS may be generated.
(62) Referring to
(63) Here, at step S431, a 2D magnitude map image of each subcarrier of the CSI-RS may be generated.
(64) Here, at step S431, the 2D magnitude map image may be alternatively generated from the 3D magnitude map image.
(65) Referring to
(66) Also, at step S430, image preprocessing may be performed at step S432.
(67) That is, at step S432, filtering is performed with the total magnitude of the subcarrier for each OFDM symbol, whereby a preprocessed magnitude map image in which the optimal OFDM symbol index is selected may be acquired.
(68)
(69) Referring to
(70) Referring to
(71) Here, it can be seen that four graphs are represented using different types of lines in order to represent the 2×2 MIMO CSI-RSs, and the four graphs may be alternatively represented using different colors.
(72) Also, at step S430, whether additionally collected wireless signal data is present may be checked at step S433.
(73) That is, when it is determined at step S433 that additionally collected wireless signal data is present, a magnitude map image for training may be generated for the additionally collected wireless signal data at step S431.
(74) Also, at step S430, deep-learning-based training may be performed at step S434.
(75) That is, at step S434, the positional DB model may be generated by learning the image characteristics of the preprocessed magnitude map image for training and the information about the collection location of the wireless signal data through deep-learning-based training.
(76) Here, the image characteristics may be the number of graphs, the type of the lines thereof, the colors thereof, and the patterns thereof.
(77) Here, at step S434, training data that is labeled with the information about the collection location of the wireless signal data and that is grouped by factors such as the number of graphs, the patterns thereof, the colors thereof, the type of the lines thereof, noise, and the like, which are the image characteristics of the preprocessed magnitude map image for training, may be generated, and the positioning DB model may be generated by learning the training data.
(78) Also, in the method for precise positioning based on deep learning according to an embodiment of the present invention, positioning may be performed at step S440.
(79) That is, at step S440, a magnitude map image for positioning may be generated from the wireless signal data, and location information pertaining to the wireless signal data may be estimated based on the image characteristics of the magnitude map image for positioning using the positioning DB model.
(80) Referring to
(81) That is, at step S441, a magnitude map image for positioning, which is capable of reflecting the characteristics of multi-channel or multi-antenna wireless signal data, may be generated.
(82) Here, the wireless signal data may be a Channel State Information Reference Signal (CSI-RS).
(83) Here, the magnitude map image may be a graph that represents the magnitude data of a frequency response for each subcarrier of the CSI-RS.
(84) Here, the magnitude map image may be the graph in which the magnitude data of a frequency response for each OFDM symbol index is further considered, in addition to the magnitude data of the frequency response for each subcarrier.
(85) Here, the magnitude map image may be the graph represented as multiple graphs so as to correspond to CSI-RSs collected from multiple channels in the collection location.
(86) Here, at step S441, a 3D magnitude map image of the subcarrier for each OFDM symbol of the CSI-RS may be generated.
(87) Referring to
(88) Here, at step S441, a 2D magnitude map image of each subcarrier of the CSI-RS may be generated.
(89) Here, at step S441, a 2D magnitude map image may be alternatively generated from the 3D magnitude map image.
(90) Referring to
(91) Also, at step S440, image preprocessing may be performed at step S442.
(92) That is, at step S442, filtering is performed with the total magnitude of the subcarrier for each OFDM symbol, whereby a preprocessed magnitude map image in which the optimal OFDM symbol index is selected may be acquired.
(93) Referring to
(94) Referring to
(95) Here, it can be seen that four graphs are represented using different types of lines in order to represent the 2×2 MIMO CSI-RSs, and the four graphs may be alternatively represented using different colors.
(96) Also, at step S440, positioning for estimating location information pertaining to the wireless signal data may be performed at step S443.
(97) That is, at step S443, the similarity of image characteristics between the magnitude map image for positioning and each of the previously learned magnitude map images included in the positioning DB model may be determined, and location information pertaining to the wireless signal data may be estimated from the information about the collection location of the previously learned magnitude map image having the highest similarity.
(98) Here, the image characteristics may be the number of graphs, the type of the lines thereof, the colors thereof, and the patterns thereof.
(99) Here, at step S443, positioning data that is grouped by factors such as the number of graphs, the patterns thereof, the colors thereof, the type of lines thereof, noise, and the like, which are the image characteristics of the preprocessed magnitude map image for positioning, may be generated, and, using the positioning data, the location information pertaining to the wireless signal data may be estimated from the positioning DB model.
(100) Here, at step S443, the positioning accuracy of the wireless signal data for positioning may be determined by selecting the label value (location number) of the location information pertaining to the wireless signal data for training that matches the wireless signal data for positioning when the image characteristics of the magnitude map images for positioning are input to the positioning DB model.
(101) Also, at step S440, a positioning result may be generated at step S444.
(102) That is, at step S444, a positioning result may be generated from the estimated location information, and the positioning result may be output or transmitted to the device that requested the positioning result.
(103) Here, at step S444, when an additional request for positioning is received, wireless signal data may be additionally collected based on the set collection location and collection environment.
(104) General wireless signal data is mixed with noise depending on the surrounding environment. Accordingly, precise positioning cannot be performed using existing feature-based image-matching technology, such as scale-invariant feature transform (SIFT) or histogram of oriented gradients (HOG), but the apparatus and method for precise positioning based on deep learning according to an embodiment of the present invention enable location information pertaining to wireless signal data to be precisely estimated from the result of learning the magnitude map images of a CSI-RS.
(105)
(106) Referring to
(107) Here, an embodiment in which the collection location and the collection environment are set by selecting ten locations at intervals of about 10 m in an outdoor parking lot, in which a positioning DB model is generated based on actual commercial LTE signals received at the ten locations, and in which positioning is performed at a test location is illustrated. Here, using a collection device, 2×2 MIMO CSI-RS data is collected using two antennas.
(108) The first to tenth locations (locations 1 to 10) indicate the locations from which wireless signal data for training, which is necessary for generating a positioning DB, is collected, and the 11th to 16th locations (locations 11 to 16) indicate the locations from which wireless signal data for positioning, which is necessary for performing positioning, is collected.
(109) Referring to
(110) Here, the positioning DB model may be generated from the first to tenth magnitude map images for training through deep-learning-based training.
(111) Referring to
(112) Here, the apparatus for precise positioning based on deep learning may estimate location information pertaining to the wireless signal data for positioning using the magnitude map images for positioning, corresponding to the 11th to 16th locations (locations 11 to 16), and using the positioning DB model generated from the wireless signal data collected from the first to tenth locations (locations 1 to 10).
(113) Here, the apparatus for precise positioning based on deep learning may determine positioning accuracy by selecting the label value (location number) of the location information pertaining to the wireless signal data for training that matches the wireless signal data for positioning when the image characteristics of the magnitude map images for positioning, corresponding to the 11th to 16th locations (locations 11 to 16), are input to the positioning DB model.
(114) Referring to
(115) Here, with regard to most of the wireless signal data (locations 1 to 10) collected from the six respective test locations, the locations thereof are estimated as the collection locations that are closest thereto, and it can be seen that an average accuracy of 5 m is achieved.
(116)
(117) Referring to
(118) An apparatus for precise positioning based on deep learning according to an embodiment of the present invention may be implemented as a single computing device including a data collection device 100, a positioning DB server 200, and a precise positioning device 300, and may include one or more processors 1110 and executable memory 1130 for storing at least one program executed by the one or more processors 1110. The at least one program may set a collection location and a collection environment, collect wireless signal data based on the collection location and the collection environment, generate a magnitude map image for training from the wireless signal data, generate a positioning DB model by learning the image characteristics of the magnitude map image for training through deep-learning-based training, generate a magnitude map image from the wireless signal data, and estimate location information pertaining to the wireless signal data based on the image characteristics of the magnitude map image using the positioning DB model.
(119) Here, the wireless signal data may be a Channel State Information Reference Signal (CSI-RS).
(120) Here, the magnitude map image may be a graph that represents the magnitude data of a frequency response for each subcarrier of the CSI-RS.
(121) Here, the magnitude map image may be the graph in which the magnitude data of a frequency response for each OFDM symbol index is further considered, in addition to the magnitude data of the frequency response for each subcarrier.
(122) Here, the magnitude map image may be the graph represented as multiple graphs so as to correspond to CSI-RSs collected from multiple channels in the collection location.
(123) Here, the at least one program may generate the positioning DB model by learning the image characteristics of the magnitude map image for training and information about the collection location of the wireless signal data through deep-learning-based training.
(124) Here, the at least one program may determine the similarity of the image characteristics between the magnitude map image and each of the previously learned magnitude map images included in the positioning DB model, and may estimate the location information pertaining to the wireless signal data from the information about the collection location of the previously learned magnitude map image having the highest similarity.
(125) Here, the at least one program may determine the positioning accuracy of the wireless signal data for positioning by selecting the label value (location number) of the location information pertaining to the wireless signal data for training that matches the wireless signal data for positioning when the image characteristics of the magnitude map images for positioning are input to the positioning DB model.
(126) Here, the image characteristics may be the number of graphs and the patterns thereof.
(127) The present invention may improve the low positioning accuracy of an existing positioning method that uses the location of a base station and signal strength, and may enable positioning in places in which GPS is not available.
(128) Also, the present invention may provide positioning technology having high precision based on wireless communication infrastructure in various fields through a general-purpose and more precise positioning method, rather than depending on communication companies and information about repeaters and base stations.
(129) As described above, the apparatus and method for precise positioning based on deep learning according to the present invention are not limitedly applied to the configurations and operations of the above-described embodiments, but all or some of the embodiments may be selectively combined and configured, so that the embodiments may be modified in various ways.