METHOD, DEVICE AND SYSTEM FOR SNOW PROFILE MEASUREMENT
20210387076 · 2021-12-16
Inventors
- Monica Vaksdal (Rådal, NO)
- Kjartan Nesse (Rådal, NO)
- Deborah Karlsen (Oslo, NO)
- Tristan Hollande (Oslo, NO)
- Marcus Landschulze (Salhus, NO)
Cpc classification
A63C5/06
HUMAN NECESSITIES
G01S7/003
PHYSICS
A63C2203/22
HUMAN NECESSITIES
G01S13/86
PHYSICS
G01S13/0209
PHYSICS
A63C2203/18
HUMAN NECESSITIES
G01S7/027
PHYSICS
International classification
A63C5/06
HUMAN NECESSITIES
A63C5/12
HUMAN NECESSITIES
G01S13/88
PHYSICS
G01S7/00
PHYSICS
Abstract
Methods, devices and computer systems utilize ground penetrating radar (GPR) embedded in or mounted on a ski or other equipment that is in contact with the snow during use device in order to obtain snow profile data from layers of snow or ice. A GPR device may include a trained model capable of deriving snow profile information based on GPR data and may also be capable of uploading GPR data to an online service. The online service can use the received GPR data to derive snow profile information, distribute snow profile information to user devices, and generate and distribute updated trained models. The online service may access online repositories of additional information and refine the snow profile information or the trained model based on such addition information. Generated snow profile information can be used to provide avalanche risk assessments.
Claims
1. A ski or other equipment that is in contact with the snow during use device for or part of equipment for travelling across an area covered with snow, comprising: a first antenna configured for transmitting ground penetrating radar signals; a second antenna for receiving reflected ground penetrating radar signals; at least one substrate with said first antenna and said second antenna applied to a first side; a ground plane applied to a second side of said at least one substrate, said second side being opposite to said first side; two first connectors connected to said first and said second antenna respectively and configured to be connected to a radar transceiver; wherein a core or base of said ski is provided with a recessed area into which said at least one substrate is positioned with said first side facing in a direction that is towards the snow when the ski is used; and wherein the ski is provided with one or more holes from said recessed area and towards the top of the ski fully or partly through the ski and into which the two first connectors are positioned.
2. The ski or other equipment that is in contact with the snow during use device according to claim 1, where said at least one hole stretches partly from the recessed area towards the top of the ski and the top of the ski is provided with markings indicating the position of the two connectors such that additional holes can be drilled through the markings in order to expose the two first connectors.
3. The ski or other equipment that is in contact with the snow during use device according to claim 1, where said at least one hole stretches all the way from the recessed area and through the top of the ski and a removable plate or plug is provided on top of the ski such that the at least one hole is covered until the plate or plug is removed to expose the first connectors.
4. The ski or other equipment that is in contact with the snow during use device according to claim 1, where said at least one hole stretches all the way from the recessed area and through the top of the ski and a device holder is provided on top of the ski such that the device holder covers said at least one hole; wherein said device holder has two additional connectors that are connected to said two first connectors and a locking device configured; and said locking device is configured to receive and hold an electronic device and said two additional connectors are configured to provide contact between a radar transceiver in said electronic device and said first and second antenna.
5. The ski or other equipment that is in contact with the snow during use device according to claim 1, wherein said at least one hole stretches all the way from the recessed area and through the top of the ski, and an electronic component is attached to the top of said ski such that it covers said at least one hole; and wherein said electronic component comprises: a radar transceiver connected to said first and second antenna over said two first connectors; and a microcontroller configured to control said radar transceiver to transmit radar signals over said first antenna and receive reflected radar signals over said second antenna, process received radar signals, and generate a representation of the layers of snow or ice below said ski or other equipment that is in contact with the snow during use device.
6. The ski or other equipment that is in contact with the snow during use device according to claim 4, wherein: the antenna component with the first antenna and the second antenna, wherein said first antenna is connected to said radar transceiver and configured to receive a radar transmission signal from said radar transceiver and radiate said radar transmission signal downwards into one or more layers of snow or ice, and said second antenna is configured to receive a reflected radar signal from said one or more layers of snow or ice and deliver said reflected radar signal to said radar transceiver.
7. The ski or other equipment that is in contact with the snow during use device according to claim 6, wherein the electronic component further comprising: one or more radio communication interfaces selected from the group consisting of: WiFi, satellite positioning signals, short range radio, cellular telephone communication, and long range radio communication.
8. The ski or other equipment that is in contact with the snow during use device according to claim 7, wherein said microcontroller is further configured to control said one or more radio communication interfaces in order to establish communication with an online service, upload data derived from said received radar signal and download results generated by said online service from processing of said uploaded data.
9. The ski or other equipment that is in contact with the snow during use device according to claim 6, wherein the microcontroller is further configured to generate estimated snow layer characteristics based on the generated representation of parameters associated with the properties of the one or more layers of snow or ice.
10. The ski or other equipment that is in contact with the snow during use device according to claim 8, wherein the microcontroller is further configured to generate a risk assessment based on said snow layer characteristics, the electronic device further comprising a user interface capable of emitting or displaying one or more of sound, light, symbols and a radio broadcast signal, indicating the result of said generated risk assessment.
11. The ski or other equipment that is in contact with the snow during use device according to claim 6, wherein said microcontroller uses a function stored in memory of the device to generate said representation of parameters representative of the properties of the one or more layers of snow or ice said function taking said received radar signals as input.
12. The ski or other equipment that is in contact with the snow during use device according to claim 11, wherein said function is a trained model generated from machine learning.
13. The ski or other equipment that is in contact with the snow during use device according to claim 1, wherein other equipment that is in contact with the snow during use device is one or more of: snowboard, snow shoes, ski poles, snowmobiles, all-terrain vehicles (ATVs), snowcats, snow groomers, boots and shoes, or remote operated vehicles (ROVs)
14. A computer system connected to a computer network and configured to: receive data derived from a reflected ground penetrating radar signal provided by at least one or more ski or other equipment that is in contact with the snow during use devices according to claim 5; generate a data set from the received data, said data set including labels representing snow condition parameters; perform machine learning on said generated data set including labels representing snow condition parameters to generate a trained model capable of mapping data derived from a reflected ground penetrating radar signal to at least one of a model of said one or more layers of snow or ice and a risk assessment representative of an avalanche risk; and transmit data representing the trained model over the computer network.
15. The computer system according to claim 14, wherein generating said data set including labels representing snow condition parameters includes: performing a data inversion method on said received data derived from a reflected ground penetrating radar signal to generate a model of one or more layers of snow or ice; and generating synthetic ground penetrating radar signal data from said model.
16. The computer system according to claim 14, wherein generating said data set including labels representing snow condition parameters includes: performing unsupervised machine learning on said received data derived from a reflected ground penetrating radar signal to generate an identification of clusters or patterns; and associating identified clusters or patterns with assumed snow condition parameter values.
17. The computer system according to claim 14, wherein said machine learning is performed by transmitting said synthetic data to a cloud based machine learning service and receiving said trained model from said cloud based machine learning service.
18. The computer system according to claim 14, further configured to obtain additional data from one or more online repositories and use said additional data to refine said trained model.
19. The computer system according to claim 18, wherein said additional data is chosen from the group consisting of: current weather data in an area, historical weather data from an area, current temperature in an area, historical temperature in an area, historical data representing amount of sunshine in an area, current air humidity in an area, historical air humidity in an area, terrain data for an area, and historical avalanche information relating to an area.
20. A method in an electronic device mounted on or integrated in the ski or other equipment that is in contact with the snow during use device according to claim 5, the method comprising: transmitting a ground penetrating radar signal downwards into one or more layers of snow or ice; receiving a reflected ground penetrating radar signal from said one or more layers of snow or ice; converting said reflected ground penetrating radar signal to a digital signal; and delivering said digital signal as input to a function that delivers a representation of said one or more layers of snow or ice as its output.
21. The method according to claim 20, further comprising: using a radio communication interface of said electronic device to transmit data derived from said reflected ground penetrating radar signal to a remote online service; and receiving in response from said remote online service at least one of a representation of said one or more layers of snow or ice, and an updated version of said function that delivers a representation of said one or more layers of snow or ice as output when receiving data derived from a ground penetrating radar as its input.
22. The method according to claim 21, wherein said updated version of said function is a trained model based on machine learning from aggregated data derived from reflected ground penetrating radar signals.
23. A method in a computer system connected to a computer network comprising: receiving data derived from a reflected ground penetrating radar signal provided by at least one or more ski or other equipment that is in contact with the snow during use devices according to claim 5; generating a data set from the received data, said data set including labels representing snow condition parameters; performing machine learning on said generated data set including labels representing snow condition parameters to generate a trained model capable of mapping data derived from a reflected ground penetrating radar signal to at least one of a model of said one or more layers of snow or ice and a risk assessment representative of an avalanche risk; and transmitting data representing the trained model over the computer network.
24. The method according to claim 23, wherein generating said data set including labels representing snow condition parameters includes: performing a data inversion method on said received data derived from a reflected ground penetrating radar signal to generate a model of one or more layers of snow or ice; and generating synthetic ground penetrating radar signal data from said model.
25. The method according to claim 23, wherein said data set including labels representing snow condition parameters includes: performing unsupervised machine learning on said received data derived from a reflected ground penetrating radar signal to generate an identification of clusters or patterns; and associating identified clusters or patterns with assumed snow condition parameter values.
26. The method according to claim 23, wherein said machine learning is performed by transmitting said synthetic data to a cloud based machine learning service and receive said trained model from said cloud based machine learning service.
27. The method according to claim 23, further comprising obtaining additional data from one or more online repositories and use said additional data to refine said trained model.
28. The method according to claim 27, wherein said additional data is chosen from the group consisting of: current weather data in an area, historical weather data from an area, current temperature in an area, historical temperature in an area, historical data representing amount of sunshine in an area, current air humidity in an area, historical air humidity in an area, and historical avalanche information relating to an area.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0010] In order to facilitate understanding of the invention and explain how it may be worked in practice, non-limiting examples will be described with reference to the accompanying drawings, in which:
[0011]
[0012]
[0013]
[0014]
[0015]
[0016]
[0017]
[0018]
[0019]
[0020]
[0021]
[0022]
[0023]
[0024]
DETAILED DESCRIPTION
[0025] In the following description of various embodiments, reference will be made to the drawings, in which like reference numerals denote the same or corresponding elements. The drawings are not necessarily to scale. Instead, certain features may be shown exaggerated in scale or in a somewhat simplified or schematic manner, wherein certain conventional elements may have been left out in the interest of exemplifying the principles of the invention rather than cluttering the drawings with details that do not contribute to the understanding of these principles.
[0026] It should be noted that, unless otherwise stated, different features or elements may be combined with each other whether or not they have been described together as part of the same embodiment below. The combination of features or elements in the exemplary embodiments are done in order to facilitate understanding of the invention rather than limit its scope to a limited set of embodiments, and to the extent that alternative elements with substantially the same functionality are shown in respective embodiments, they are intended to be interchangeable. For the sake of brevity, no attempt has been made to disclose a complete description of all possible permutations of features.
[0027] Furthermore, those with skill in the art will understand that the invention may be practiced without many of the details included in this detailed description. Conversely, some well-known structures or functions may not be shown or described in detail, in order to avoid unnecessarily obscuring the relevant description of the various implementations. The terminology used in the description presented below is intended to be interpreted in its broadest reasonable manner, even though it is being used in conjunction with a detailed description of certain specific implementations of the invention.
[0028] The present invention provides several aspects that can be combined into a system for improved monitoring and warning of snow conditions that may represent a risk of avalanches. The first aspect relates to the way data about snow conditions may be obtained, while additional aspects relate to aggregation of such data, processing of aggregated data, and sharing of processed data.
[0029] With the exception of structural details that are specifically developed for a particular type of equipment, for example devices or antennas adapted for integration in skis, the devices and methods described herein are adaptable for use with a wide range of equipment including not only skis, but also snowboards, snow shoes, ski poles, snowmobiles, all-terrain vehicles (ATVs), snowcats, snow groomers, and even boots and shoes or remote operated vehicles (ROVs). For ease of understanding, the examples described herein will primarily describe embodiments where GPR devices are mounted on or integrated in skis, but the examples may be generalized to other types of equipment.
[0030] Reference is first made to
[0031] These layers can be examined in detail by digging a snow profile, which is a time consuming process that can only be performed in order to obtain general information about an area or specific information about a particularly risky hillside. It is not practical or realistic for skiers to dig new snow profiles every time they move into new terrain, and many skiers lack the necessary skills to draw the right conclusions even if they do dig a snow profile.
[0032] The skier 101 shown in
[0033] The transmitter 11 and the receiver 12 may be implemented as a single device or as two units mounted on different locations on a ski 10. For the purposes of the present disclosure, the combined transmitter 11 and receiver, 12 will be referred to as a GPR device and this term is intended to cover both alternatives. As such, a GPR device 13 may comprise a GPR transmitter 11 and a GPR receiver 12 implemented as a single unit, or a GPR device 13 may comprise one GPR transmitter 11 unit and one GPR receiver unit 12. Furthermore, the computing capabilities carried by the skier 101 may be implemented solely in the GPR device 13, or it may be distributed between the GPR device 13 and a portable device 14. In the present disclosure, unless otherwise specified, reference to communication between a GPR device 13 and a remote server is intended to cover any combination of processing of data in the GPR device 13 or by an application on the portable device 14 prior to exchange of data with the server.
[0034] Reference is now made to
[0035] Furthermore, as mentioned above a GPR device 13 according to the invention may be provided with Bluetooth or other short-range communication capabilities enabling communication with a portable device 14 carried by the skier for further processing of data and display of rich information to the skier on a display of the device 14. The portable device 14, or the GPR device 13 itself, may also be provided with wide area communication capabilities able to establish communication with e.g. a cellular base station 15 for upload of data to a remote server. Such communication may, for example, be based on 4G/5G or LoRa-WAN, which are well known to those with skill in the art. When communication between the GPR device and a remote server is referred to in the present disclosure, this is intended to cover direct communication from the GPR device itself as well as communication between the portable device 13
[0036]
[0037] It should be realized that the short range communication between GPR devices 13 illustrated in
[0038] The back end server 17 may implement a service where data is transmitted back to the GPR device 13 in order to enhance the information available to the skier. The back end server 17 may also provide additional web services, for example by serving web pages including maps where avalanche risk is indicated.
[0039] The back end server 17 may thus access data available from the cloud and it may implement or otherwise utilize one or more machine learning algorithms or strategies in order to recognize patterns and extract information from these large datasets. The machine learning strategies may be implemented on the back end server 17 itself, or they may be available as cloud services from centralized servers 20. Examples of such services include Microsoft's Azure and Google's Cloud Machine Learning Engine.
[0040] Having thus described the overall functionality and structure of the system as a whole, a more detailed description of the GPR device will now be given with reference to
[0041] The central component of the GPR device is a low power microcontroller 401. The microcontroller 401 is connected to and controls multiple sensors. The multiple sensors may include a radar transceiver 402, a GPS receiver 403, an accelerometer 404, a gyroscope 405 and a temperature sensor 406. Some embodiments may only have a subset of these sensors, and additional sensors may be included, for example a tiltmeter, and an electronic compass. No attempt will be made to explicitly list all possible configurations of sensors that may be included. Any sensor that provides data that may be obtained from other sources or is considered unnecessary may be omitted in a particular embodiment, as a design choice that may be made by a systems designer. For example, positioning information may be obtained from a GPS receiver included in the portable device 14.
[0042] The micro controller 401 could be used in conjunction with a component dedicated to machine learning, such as a co-processor optimized for pattern recognition (Google Edge TPU, Nvidia GPU, Intel® Movidius™ Myriad™ VPU). This component may then be used to implement pattern recognition algorithms locally (i.e. in the GPR device 13) in manner that is simpler in terms of development cost and complexity. This may also contribute to faster response and lower power consumption.
[0043] The GPR device 13 may further include local memory 407 where data may be stored temporarily or permanently by the microcontroller. The local memory 407 may be implemented in any suitable memory technology known to those with skill in the art. Typically a flash memory technology may be selected, for example Secure Digital (SD) or eMMC.
[0044] The GPR device 13 is furthermore provided with communication interfaces. In the exemplary embodiment illustrated in
[0045] Wireless communication interfaces may include WiFi 409, Bluetooth 410, and a communication capability able to establish WAN communication, for example a cellular (mobile phone) standard.
[0046] Depending on the computational power of the microcontroller itself and the amount of signal processing performed locally by the GPR device 13, a digital signal processor (DSP) 412 may also be included.
[0047] The GPR device 13 will also include antennas. The radar transceiver 402 is connected to one transmitting antenna 412 and one receiving antenna 413. These antennas will be described in further detail below. The GPS receiver 403 and the radio communication modules 409, 410, 411 will also be connected to one or more antennas 414.
[0048] Some embodiments of the GPR device 13 may also include some kind of user interface 415 for output of alerts or other information to the user, for example in the form of a small display, LEDs, audible alarms, and also buttons or switches for turning the device on and off or changing modes of operation. The user interface 415 will hereinbelow also be referred to as a risk assessment indicator 415, but this should not be interpreted to exclude the possibility of outputting other information than risk assessments over the user interface 415. In some embodiments the user interface 415 on the GPR device 13 includes two LEDs. One of these LEDs, when lit or of a specific color e.g. red, may then indicate that the steepness of the slope is above a certain threshold value, for example 30°. The other LED, when lit, may indicate that the risk assessment resulting from the processing of the radar data, as will be discussed further below, is above a certain level. If both LEDs are lit, this may be taken as an indication that the risk of an avalanche is high and that the user should move to a safer area. If only the LED indicating risk based on radar data (e.g. detected presence of a weak snow layer) is indicating danger, this can be interpreted as a warning against moving into steeper areas and a warning to look out for other skiers higher up that may trigger an avalanche.
[0049] In addition to the components described above, the GPR device 13 will also include a number of additional components that are not shown in the drawing because they are well known by people with skill in the art. Such components include a power source, for example a chargeable or replaceable battery, a system clock, communication buses, and antenna impedance compensation circuits. The battery, or any other power source included in a GPR device 14 according to the invention, should, of course, be capable of operating at cold circumstances.
[0050] The radar transceiver 402 is controlled by the microcontroller 401 to operate in a manner similar to methods used in seismic exploration, with a source emitting a transmitted signal and a receiver recording a received signal that is the result of reflection of the transmitted signal by the layers of the snow at various depths.
[0051] In seismic exploration, the source signal is acoustic or elastic waves that penetrate to substantial depths of the Earth's crust. The present invention, however, is designed to penetrate to a maximum depth of approximately 10 meters into layers of snow and transformed snow. The invention therefore uses high frequency electromagnetic waves transmitted and received by radar antennas 412, 413 that can be attached to or fitted inside a ski, preferably without affecting its robustness and with a minimum of adverse impact on manufacturing.
[0052] The radar transceiver 402 may be a microwave radar system integrated on a single CMOS chip that can act as ground-probing radar. Such a radar transceiver can be manufactured with a small size, low power consumption, and as a System-On-Chip (SoC) device. An example of such a chip is XeThru (XeThru is a trademark) which is an SoC device with small size and low power consumption. The availability of this device, which is made by Novelda AS of Kviteseid, Norway) made it possible to test aspects of the invention very early in the development project and therefore prove the viability of the concept very early. Google Soli is another alternative, as is The MIT Lincoln Laboratory Localizing Ground-Penetrating Radar (LGPR)
[0053] An exemplary embodiment of the transmitting antenna 412 and receiving antenna 413 is shown in
[0054] The drawing in
[0065] It is, however, consistent with the principles of the invention to design antennas with other dimensions, including for the use with other frequencies, and to provide the transmitting antenna 412 and the receiving antenna 413 on separate substrates, for example in order to position them further apart on the ski 10.
[0066]
[0067] The antenna patterns 503, 504 are directed downwards toward the snow, while the ground plane 502 and the connectors 506 are directed upward.
[0068] In some embodiments of the invention, the antennas and in some cases also the GPR electronics, may be embedded in the ski when the ski is produced. However, other embodiments are configured for being retrofitted. With the configuration of the antenna shown in
[0069] This gives the following combinations, all of which are consistent with the principles of the invention. First of all it is possible to integrate both the antenna component 500 and the GPR device 13 in the ski. It may be necessary to provide the antennas 414 for GPS reception and wide area network communication on the outside of the ski, or they may be embedded just below the top surface of the ski. This embodiment may require that a rechargeable battery can be wirelessly charged or that the ski is provided with a connector for charging. Secondly, all components may be provided on the outside of the ski. The simplest embodiment representing this alternative is one where all components are provided in one unit which is mounted on the top of the ski. However, it is also possible to distribute components between several units, for example one or more antennas and one or more units containing the electronics. A third alternative is to embed the antenna component 500 in the base or core of the ski and mount the GPR device 13 including external antennas 414 on the top of the ski. The GPR device 13 may according to this alternative either be permanently mounted, or it may be releasably mounted to the top of the ski. Again it is possible to distribute functionality between several units. One possibility is to include some electronics in a holder that is permanently attached to the ski 10 and additional electronics in a device that may be removed from the ski and transferred to another ski with another, similar holder. For example, the radar transceiver may be placed in the permanently attached holder, removing the need for high frequency radio signals to be transmitted over a releasable connector between a removeable device and a permanently attached holder. Such a connector may be worn or exposed to ice, snow and water, which may cause reflections that will corrupt the radar signal.
[0070] Embodiments representing some of the alternatives mentioned above will now be described with reference to
[0071]
[0072] The core or the base of a ski 10 has been provided with a recessed area 601 with substantially the same shape and size as the substrate 501. This may for example be done with a milling machine. In addition, two holes 602 have been made such that they are able to receive the connectors 506 and that a connector, wire or cable can pass through them and connect them to the GPR device on the other side of the ski.
[0073] In embodiments where the antenna is embedded in the ski 10 the recessed area 601 and the holes 602 are provided in the core of the ski. In embodiments where the antenna is embedded in the base of the ski 10 after the ski has been produced, the recessed area 601 is milled into the base and the holes are 602 are drilled all the way through the ski 10.
[0074] In either case, the antenna component 500 is glued into the recess 601. This will position the antennas 412, 413 as close to the snow as possible, either in direct contact with the snow if the antenna component 500 is embedded in the base, or with only the base separating the antenna component 500 from the snow if the antenna component 500 is embedded in the core.
[0075] In some embodiments, the ski 10 is provided with an embedded antenna during production, but the GPR device 13 is not provided with the ski. The embedded antenna does not add any substantial costs to the ski 10, but the GPR device 13 is comparatively much more costly and may not add any value to persons who only ski where there is no avalanche risk whatsoever. In these embodiments, it is unnecessary to drill holes through the layers on top of the core. Instead, a metal cylinder (not shown) fitting each hole 602 may be placed inside the holes such that they establish inner walls of the holes. This may be done for two reasons, namely in order to guide the drill bit when the hole is completed from the top of the ski through the layers above the core in order to provide access to the connector. The metal cylinders may also help prevent an excess of glue from moving up through the hole, something that may deteriorate the connector.
[0076] If the antenna is embedded in the ski during production, once it has been glued in position in the recess 601, the remaining production steps of adding all the layers around the core remain unchanged.
[0077] In one embodiment, the antenna component is embedded in the ski and markings are printed on the top layer of the ski indicating where the connectors 506 are positioned. Holes can then be drilled through the top layers and down towards the connectors at a later time if and when it is desirable to mount a GPR device 13 on the ski 10.
[0078] A similar embodiment is illustrated in
[0079] The embodiment shown in
[0080] The embodiment in
[0081] In other embodiments of the invention, the antenna component 500 is not embedded in the ski 10. Instead, it is integrated in the GPR device 13. The antenna component 500 illustrated in
[0082] Reference is now made to
[0083]
[0084] As already described above, all electronic components may be embedded in the GPR device 13, or some components may be embedded in the holder 705. Examples of components that may be included in the holder 705 are the radar transceiver 402 and associated radio frequency components, possibly as a system on a chip (SOC). In this case the connectors 706 between the GPR device 13 will be a single digital interface and no radio frequency interface. Depending on how components are distributed between the holder 705 and the GPR device 13 the connectors or contacts 706 may include both a digital and a radio frequency interface.
[0085] It should be noted that for the sake of convenience the removable component is referred to as the GPR device 13 also with reference to embodiments where the actual radio frequency components are all included in the holder 705. The GPR device 13 will still include the microcontroller 401, the memory 407, and other components that control the radar transceiver 402 and that process data received from the radar transceiver. The term GPR device 13 is therefore not limited to devices that actually include radio frequency components, but also include devices that are configured to control radio frequency components.
[0086] When determining which components to include in a removable GPR device 13 it will typically be relevant to consider cost of the components in order to be able to reuse expensive components on several pairs of skis, and also to consider data portability in order to be able to accumulate data in one device and based on configuration made on one device, as well as the ability to connect the removable device to a computer for data transfer and configuration.
[0087] Having thus described embodiments representing exemplary designs of the physical and electronic configuration of the devices carried by a skier, a description of the operation of the GPR radar and corresponding signal processing will be presented.
[0088] Returning first to
[0089] The GPR radar determines the transit time of the reflected signal and uses the transit time to calculate the depth of the reflecting layer. GPR radars can be classified as operating either in the time domain or in the frequency domain. A GPR operating in the time domain may transmit baseband pulses or noise modulated pulses. A GPR transmitting baseband pulses uses extremely short pulses that may be considerably shorter than the wavelength of the carrier wave. This is done to achieve a high bandwidth signal and the resulting waveform has a shape similar to a Mexican hat. It is therefore often referred to as a “Mexican hat” wavelet, or more formally as the negative normalized second derivative of a Gaussian function. Other Gaussian pulse shapes are also possible.
[0090] A noise-modulated GPR emits a random waveform as the transmitting signal, and detection of the reflected signal is based on optimal correlation between transmitted signal and received reflection. Due to the unpredictable spreading of energy across the bandwidth of the radar, the noise-modulated GPR reduces the amount of disturbance to others operating in the same bandwidth.
[0091] GPRs operating in the frequency domain include Frequency-Modulated Continuous Wave (FMCW) and Stepped Frequency FMCW (SFCW). FMCW radars may transmit a frequency sweep signal (chirp) or, in the case of SFCW, a sequence of individual frequencies. GPR radars operate in the frequency domain are slower than time domain radar systems, but they may be simpler and thus cheaper to produce. The transit time is obtained using inverse fast Fourier transformations.
[0092] The different types of radar systems described above may involve different advantages and disadvantages with respect to speed, cost, penetration depth, resolution and the amount of information that can be extracted from the signal in addition to transit time. Different embodiments of the invention may use any one of the radar systems described based on design criteria with respect to system performance.
[0093] In addition to transit time, which can be used to calculate depth to layer transitions, additional information about the snow layers can be determined from additional characteristics of the received reflected signal, such as the envelope, or shape, of the signal. In particular, while time between emission and reception will be indicative of the depth and location of transitions between layers, the amplitude, frequency response and shape of the received pulse will depend on dielectric properties of the snow, in particular dielectric permittivity, ε*, magnetic permeability, μ*, and electric conductivity σ*. Thus, it will be possible to characterize these properties based on measurement of amplitude and shape, and from the dielectric properties it is possible to derive characteristics of the snow, such as water content, density, ice-particle shape, etc.
[0094] Reference is made to Complex dielectric permittivity measurements from ground-penetrating radar data to estimate snow liquid water content in the pendular regime, by John H. Bradford, Joel T. Harper and Joel Brown, Water Resources Research, Vol. 45, available from https://agupubs.onlinelibrary.wiley.com.doi/abs/10.1029/2008WR007341, and first published Aug. 5, 2009. This article, which is hereby incorporated by reference in its entirety, describes how reflected amplitude and frequency spectrum can be used to estimate snow properties, and the methods described are used to implement some embodiments of the invention.
[0095] By repeatedly transmitting and receiving pulses while at the same time keeping track of positional data received from a positioning capability of the GPR device 13, such as a GPS receiver 403, possibly enhanced by additional data from for example an accelerometer 404, an inclinometer or gyroscope 405, and external data received over a wireless interface 409, 410, 411, it is possible to characterize the snow layers along the skier's track with considerable accuracy. The radar pulse may be a wide band pulse which may be frequency modulated, for example as a frequency-swept pulse (chirp).
[0096]
[0097] Information about the snow layers derived from the reflected radar signal can be presented on the display 900 of the device 14 graphically, for example in the form of the color or background pattern of the area behind the curves 901, 902, 903, 904s), color or other characteristics of the curves themselves (for example in the form of a diffuse curve), and by other means that are found suitable for conveying this information. A trained person may then be able to estimate the avalanche risk simply by looking at the display, which will show an estimate of a snow profile along the track covered by the skier. It will be understood that the presentation of this information in and of itself is not part of the invention and that any convenient way of conveying information generated by the invention to a user may be selected.
[0098] In order to provide untrained skiers with adequate warnings the alert area 905 presents an estimated level of risk based on further processing of the available information. In some embodiments, this estimate is based on a function, or a set of rules, which maps input data extracted from the radar reflection signal to output risk assessment. This function may be preinstalled on the device and subsequently updated from the cloud service as will be described in further detail below. In some embodiments the function is a trained model (sometimes referred to as a pre-trained model) that has been generated through machine learning performed on aggregated data. An example of such a process will be described below.
[0099] As described above with reference to
[0100] Reference is now made to
[0101] It should also be noted that while the flowchart illustrates the process as a series of discrete steps that are performed one after the other and not repeated until the process returns to that step, an actual embodiment will run many of these steps in parallel. For example, the GPR device 13 will transmit radar pulses (or radar frequency sweeps) continually, for example, some embodiments will emit 200 or more pulses as one measurement, or trace, and one trace takes less than 10 ms. Traces may be generated and stored at specific times, for example every second, or at specific distances, for example every 10 m. The received information is processed as soon as it is obtained, and the online service aggregates, processes and distributes information whenever it is received or requested.
[0102] In a first step 1001 the radar transceiver 402 transmits a radar pulse (or frequency sweep) using the transmitting antenna 412. This pulse is reflected by layer boundaries in the snow as described above and received by the transceiver 402 over the receiving antenna 413 in step 1002. The received reflected signal may then be processed by the microcontroller 401, possibly in cooperation with a co-processor 412, for example a DSP. The signal processing may first include pre-processing, performed as step 1003, in the form of frequency filtering and clutter filtering. The preprocessed data is then stored with locally aggregated data in local memory in step 1004. In a following step 1005 the locally aggregated data is delivered as input to a function, or a set of rules, that maps reflected radar data to an output that may include an estimated snow profile and a risk assessment. This function is preinstalled on the GPR device 13, but may be updated from the cloud service during use, as will be described in further detail below.
[0103] The data delivered as input to the function may, in addition to radar reflection data, include other relevant information received from the cloud service, including for example, weather data, wind, the number of hours an area has been directly exposed to sunshine, historical avalanche data and other relevant information that can be accepted by the function as input.
[0104] In embodiments where the GPR device 13 is provided with some sort of user interface (LED, buzzer, or something similar) with a risk assessment indicator, this indicator may now be updated 1006 if there is a change in risk assessment.
[0105] The new data may now be transferred 1007 to the portable device 14. Depending on the embodiment the data that is transferred may be one or more of the raw radar data, the pre-processed radar data, and the output from the snow profile and risk assessment generating function. It should be noted that it is within the scope of the invention to include all functionality in the GPR device 13 itself, in which case the steps described here as performed by the portable device 14 may be performed by the GPR device 13.
[0106] The transferred data is received 1008 by the portable device 14, for example over a Bluetooth interface. In some embodiments, the data may be further processed by the portable device 14. The snow profile information and risk assessment may then be displayed 1009 on the display of the portable device 14. Furthermore, the data may be uploaded 1010 to an online service 17 using, for example, a cellular network. The data uploaded to the online, or cloud, service 17 may be any combination of one or more of the raw radar input from step 1002, the pre-processed data from step 1003, and the result of the analysis in step 1005. According to the embodiment described in the following description, at least raw or pre-processed radar data is uploaded.
[0107] The online service may be configured to receive or obtain data from other online services and aggregate 1011 this information. This aggregated information may include radar data provided by other GPR devices as well as other relevant information for example relating to weather, wind, humidity, historical avalanche information etc. The online service 17 receives, in step 1012, data from the GPR device 13 and the data may now be processed 1013 together with aggregated data received from other GPR devices 13 as well as other online services. The actual processing may be performed by the server or servers providing the online service themselves, by dedicated hardware, or by another online service, for example a cloud computing platform providing machine learning and artificial intelligence. The processing performed by the online service 17 will be described in further detail below.
[0108] The result of this processing may now be used to update snow profile information and avalanche risk assessment that is stored by the online service and made available to GPR devices as well as other devices, for example as a web site. In addition, the processing may result in an updated snow profile and risk assessment function, as will be described in further detail below. This updated function may also be distributed to GPR devices. The data thus provided 1014 by the online service 17 is received 1015 by the portable device 14. The information may then be added 1016 to the locally aggregated data and it will thus be available the next time the step 1005 of analyzing aggregated data is performed. This process may continue as long as the GPR device 13 is active.
[0109] While the process is described above as flowing from one discrete step to another, it will be realized by those with skill in the art that many of the process steps are performed in parallel and continuously. As such, steps 1001 and 1002 are performed repeatedly, for example by emitting between 100 and 1000 pulses as one measurement, or trace. One trace may take between inns and 100 ms. Traces may be generated and stored at specific times, for example every 0.1 seconds up to every 5 seconds, or at specific distances, for example every 10 m or anywhere between every 2 meters and every 30 meters. The received reflected signals are processed and stored locally subsequent to being received irrespective of which other steps illustrated in the drawing are performed simultaneously. Similarly, external data may be received from the cloud intermittently and independently of the ongoing radar pulses, and the processing of local aggregated data in order to update of risk assessment and display of information on the portable device may at any time utilize all the latest data that has been received and added to the local memory 407.
[0110] Similarly, exchange of data between the GPR device 13 and the portable device 14 can be performed concurrently with the operation of the radar transceiver 402 and the processing of the resulting data.
[0111] The online service 17 may receive data in parallel from many GPR devices as well as other sources of information mentioned above, and the processing, aggregation and distribution of data may utilize any data that is available when the processing, aggregation or distribution is performed.
[0112] It will also be understood that the distribution of tasks between the GPR device 13 and the portable device 14 may be arranged differently, for example by processing or storing data in the portable device 14. Indeed, in some embodiments the GPR device 13 may include wide area communication capabilities and a display and perform all the steps described above as being performed by the portable device 14.
[0113]
[0114]
[0115] The steps illustrated in
[0116] In
[0117] In a first step 1201 the analog radar reflection signal is digitized. This is the same step as step 1101 in
[0118] In a next step 1202 the digitized reflection signal is pre-processed in order to remove noise and other unwanted artifacts. This step corresponds to step 1102 in
[0119] In step 1204 data inversion is performed to build a model of the snow conditions. This may take additional information into consideration, i.e. data obtained from other sources or additional knowledge about snow profile modeling. Data inversion as such is well known from the field of geological exploration.
[0120] Synthetic data may now be generated from the model. The synthetic data may be included in a training set that will be subject to supervised machine learning in step 1205. Synthetic data is used because it gives better control over the input to and the output from the machine learning process and makes it possible to modify the model based on other knowledge that which is inherent in the radar data. However, in alternative embodiments the data inversion and generation of synthetic training data is replaced by unsupervised machine learning for identification of clusters or patterns in the radar data. These clusters or patterns can be used to label the radar data based on best guess estimates, and the labeled radar data is used for supervised machine learning similar to synthetic data supervised machine learning as described above.
[0121] The machine learning process may generate a function that associates snow conditions with snow parameters, and potentially also with avalanche risk. In step 1206 the supervised machine learning may be expanded to include other data, such as weather, historical avalanche information from the relevant area etc.
[0122] The machine learning is performed in two steps (data inversion and synthetic data generation or unsupervised learning, followed by supervised training) in order to create labels (parameter values) for the training set. A potential advantage with the data inversion model is, as already mentioned, greater control over the input to the machine learning that actually generates the trained model. The data samples received from GPR radars all include the same type of information (radar reflection signal, position, slope, temperature), and all this information relates to the same occurrence (the same position and point in time), making the data well suited to unsupervised machine learning as well as data inversion. Other information, such as weather (current as well as historical), historical avalanche information, topography, etc., cannot be directly related to individual samples, but may be used to make more general modifications either to the model generated through data inversion, during the supervised training, or both, providing increased accuracy to the trained model for a given area or given conditions.
[0123] The process then moves on to step 1207 where a finalized parameter generation and risk assessment function, or a corresponding set of rules, are generated. This function is transferred or distributed to GPR devices in step 1208 where they can be used to generate local risk assessment based on real time radar data (step 1104 in
[0124] The steps illustrated in
[0125] Reference is now made to
[0133] Based on the model, synthetic data can be generated, and the synthetic data can be used to further train, test and validate the model using machine learning 1305.
[0134] As described with reference to
[0135] Finally, parameter supervision can be used in step 1306 to verify that the parameters estimated by the trained function correspond to parameters established through data inversion modelling.
[0136] The process described with reference to
[0137]
[0138] The accuracy and the resolution of the snow analysis can be improved based on additional tools. For example, it is possible to combine multiple radars and antennas along the ski as well as on both skis. Furthermore, as the skier moves across the snow surface, multiple radar measurements taken at multiple times and locations may be combined based on positioning information provided by a GPS receiver. Correlation between measurements taken closely together in space and/or time may be used to distinguish relevant information from noise and other unwanted artifacts in the received signal.
[0139] In order to penetrate deeper into the layers of snow, or to cancel noise interferences, the signal from the source may be more complex than just a pulse signal, for example a frequency sweep signal (chirp). This may necessitate pre-processing of the received signal using correlation, deconvolution and filter algorithms. These algorithms may be executed by the DSP 412.
[0140] The present invention is designed to penetrate to a maximum depth of approximately 10 meters into layers of snow and transformed snow. The actual depth of penetration may depend on current conditions such as the density, character and water content of the snow, as well as design choices such as transmitting power, number and design of transmitting and receiving antennas, signal shape, processing power, etc.
[0141] While the invention has been described above in the context of being used by skiers who have GPR radar devices mounted on their skis (or similar equipment such as snow shoes, sled or toboggan), and for the purpose of obtaining avalanche risk assessment, the invention may be adapted to other application areas. Some examples are described below.
[0142] Embodiments of the invention more related to environmental research include equipping expeditions going to very remote areas (such as the north and south poles) with the invention in order to record ice and snow thickness over long periods without having to carry heavy equipment and without dedicating any time to this activity. In the context, the invention will remain unchanged, however the firmware in the GPR device may be updated to make less frequent measurements and therefore extend the typical battery life of the system. The radar may also be configured differently to not focus on thin snow layer resolution but rather on penetrating deeper into the snow layers.
[0143] Another possible application is checking that ice thickness is safe on lakes and rivers before vehicles and people are allowed access. The invention could be used to determine if roads and ski trails should be open or closed during the winter season.
[0144] A further possible application is for checking the crust layer of any type of ground, such as the top layer determination of for example a desert ground, volcanic active area, ground frost thickness, crust above tundra (summer), tundra thickness and other.
[0145] Although the applications discussed above describe the use of GPR devices, it should be understood that the same objective may be achieved using other techniques, for example transmitters/receivers/transducers for ultrasound, to provide the ground reflection signal.
[0146] For some of the above applications, it may be convenient to consider designing a larger antenna.