SMELL SENSING SYSTEM
20240000368 ยท 2024-01-04
Inventors
- Emanuela MAGGIONI (Cambridge, GB)
- Marianna OBRIST (Cambridge, GB)
- Richard HOPPER (Cambridge, GB)
- Florin Udrea (Cambridge, GB)
Cpc classification
A61B5/7475
HUMAN NECESSITIES
International classification
Abstract
The present application relates to a smell sensing system (100) comprising a smell delivery device (104) for delivering an olfactory output (110). The smell delivery device (104) comprises a delivery channel (3) for receiving a substance (5a) from a canister (5), the substance (5a) configured to produce an olfactory output (114). The smell delivery device (104) also comprises an output component (7) through which the substance (5a) is emitted. The smell delivery device (104) also comprises one or more airflow generating elements (13) configured to generate airflow to transport the substance (5a) from the canister (5) to the output component (7). The smell sensing system (100) also comprises a smell sensing device (102) for detecting the olfactory output (110) delivered by the smell delivery device (104). The smell sensing device (102) comprises at least one gas sensor (31, 32) configured to, in response to the olfactory output (110), generate sensor information (114) corresponding to the olfactory output (110). The smell sensing device (102) is configured to output the sensor information (114) to a processor (106).
Claims
1-137. (canceled)
138. A smell delivery device comprising: a delivery channel for receiving a substance from a canister, the substance configured to produce an olfactory output, such as a smell; an output component through which the substance is emitted; and one or more airflow generating elements configured to generate airflow to transport the substance from the canister to the output component; a flow controller for controlling the flow rate, or concentration, of the substance through the delivery channel to the output component; wherein the flow controller is configured to control the flow rate, or concentration of the substance from the delivery channel to the output component in response to feedback from at least one of: a) sensor configured to sense the flow rate, or concentration of the substance, through the delivery channel; b) an environmental sensor configured to sense environmental conditions; and c) a user feedback device configured to receive an input from a user.
139. The smell delivery device of claim 138, wherein the user feedback device is configured to receive input from the user indicating one or more of: a) whether the olfactory output is at a level the user can/cannot sense; b) the emotional response of the user to the olfactory output; c) the duration, and/or the intensity of the user's perception/sensation of the olfactory output; and d) a comparison between different olfactory outputs.
140. The smell delivery device of claim 139, wherein, when the user feedback device receives input from the user indicating that the user cannot sense the olfactory output, the flow controller is configured to modulate the flow rate.
141. The smell delivery device of claim 138, wherein the environmental sensor is configured to sense at least one of: a) the temperature of the environment, b) the humidity of the environment, c) the pressure of the environment, and d) the amount of/identity of pollutants present in the environment.
142. The smell delivery device of claim 141, wherein the flow controller is configured to modulate the flow rate of the substance, in the event that one of: a) the humidity of the environment or at a location within the smell delivery device is above a predefined threshold; b) the temperature of the environment or at a location within the smell delivery device is above a predefined threshold; or c) the pressure of the environment or at a location within the smell delivery device is above a predefined threshold.
143. The smell delivery device of claim 141, wherein, if the amount of pollutants is above a certain threshold, the smell delivery device is configured to stops the flow of the substance.
144. The smell delivery device of claim 138, wherein the sensor configured to sense the flow rate, or concentration, of the substance is configured to communicate the flow rate, or concentration, measurement to the flow controller, and, when the measured flow rate, or concentration, is different than the intended flow rate, the flow controller is configured to modulate the flow rate until the intended flow rate is reached and stabilised.
145. (canceled)
146. The smell delivery device of claim 138, further comprising a distance sensor to determine the distance of the output component to the location of the user, and wherein as the determined distance increases, the flow controller is configured to modulate the flow rate.
147. The smell delivery device of claim 138, further comprising: a second delivery channel for receiving a second substance from a second canister, the second substance configure to produce a second olfactory output, or alter the olfactory output associated with the first substance; a second output component through which the second substance is emitted; and wherein the flow controller is configured to control the flow rate, or concentration, of the second substance from the second delivery channel to the second output component in response to feedback from at least one of: a) a second sensor positioned in the second delivery channel configured to sense the flow rate, or concentration, of the second substance through the second delivery channel; b) the environmental sensor configured to sense environmental conditions; and c) the user feedback device configured to receive an input from a user.
148-155. (canceled)
156. A method of delivering smell to a user, the method comprising: receiving instructions to emit a flow of a first substance, wherein the substance has an olfactory output, such as a smell, associated therewith; beginning the flow of the first substance at a first flow rate, or concentration; receiving feedback from one or more of: a) a sensor configured to sense the flow rate, or concentration of the substance, through the delivery channel; b) an environmental sensor configured to sense environmental conditions; and c) a user feedback device configured to receive an input from a user; and in response to the feedback: changing the flow rate, or concentration, of the first substance.
157. The method of claim 156, wherein the feedback is from the user feedback device and comprises an indication of at least one of: a) whether the user can sense the olfactory output; b) the duration of the user's perception of the olfactory output; and c) the user's emotional response to the olfactory output.
158. The method of claim 156, wherein the feedback is from the environmental sensor and comprises at least one of: a) an indication of whether the humidity of the environment or at a location within the smell delivery device is above a predefined threshold; b) an indication of whether the temperature of the environment or at a location within the smell delivery device is above a predefined threshold; and c) an indication of whether the pressure of the environment or at a location within the smell delivery device is above a predefined threshold.
159. The method of claim 156, wherein the feedback is from the sensor configured to sense the flow rate, or concentration, of the substance, through the delivery channel, and wherein the feedback comprises an indication that the measured flow rate is different to the intended flow rate, and in response, modulating the flow rate until the intended flow rate is reached and stabilised.
160-162. (canceled)
163. A smell sensing system, comprising: a smell delivery device for delivering an olfactory output, comprising: a delivery channel for receiving a substance from a canister, the substance configured to produce an olfactory output; an output component through which the substance is emitted; and one or more airflow generating elements configured to generate airflow to transport the substance from the canister to the output component; and a smell sensing device for detecting the olfactory output delivered by the smell delivery device, comprising: at least one gas sensor configured to, in response to the olfactory output, generate sensor information corresponding to the olfactory output; wherein the smell sensing device is configured to output the sensor information to a processor.
164. The smell sensing system of claim 163, wherein the sensor information comprises an indication of one or more of: a) presence of the olfactory output; b) an intensity of the olfactory output; c) an identification of the smell or a type of smell associated with the olfactory output; d) a pulse duration of the olfactory output; e) a duration between subsequent pulses of the olfactory output; f) a base line of the olfactory output; and g) whether the olfactory output is static or dynamic.
165. The smell sensing system of claim 163, wherein the smell delivery device is configured to output delivery information to the processor corresponding to the substance emitted.
166. The smell sensing system of claim 165, wherein the delivery information is indicative of one or more of: a) the flow rate or concentration of the substance; b) pressure of a pump of the airflow generating elements of the smell delivery device; c) selection of delivery channels of the smell delivery device; d) selection or degree of opening of valves of the delivery channel of the smell delivery device; e) an identification of the smell or a type of smell; f) a pulse duration of the smell; g) a duration between subsequent pulses of the smell; h) a smell base line; and i) whether the smell is static or dynamic.
167. The smell sensing system of claim 163, wherein the smell delivery device is configured to receive instructions from the processor, and wherein the smell delivery device is configured to, in response to receiving the instructions, adjust the delivery of the olfactory output.
168. The smell sensing system of claim 165, further comprising the processor, and wherein the processor is configured to correlate the sensor information with the delivery information to determine a validation of the delivery of the smell by the smell delivery device.
169. The smell sensing system of claim 163, wherein the smell delivery device comprises: a flow controller for controlling the flow rate, or concentration, of the substance through the delivery channel to the output component; wherein the flow controller is configured to control the flow rate, or concentration of the substance from the delivery channel to the output component in response to feedback from at least one of: a) a sensor configured to sense the flow rate, or concentration of the substance, through the delivery channel; b) an environmental sensor configured to sense environmental conditions; and c) a user feedback device configured to receive an input from a user.
Description
BRIEF DESCRIPTION OF THE FIGURES
[0308] Some details of the present invention, both as to its components and operation, are given in the accompanying drawings.
[0309]
[0310]
[0311]
[0312]
[0313]
[0314]
[0315]
[0316]
[0317]
[0318]
[0319]
[0320]
[0321]
[0322]
[0323]
[0324]
[0325]
[0326]
[0327]
[0328]
[0329]
[0330]
[0331]
[0332]
[0333]
[0334]
[0335]
DETAILED DESCRIPTION
[0336] There is described a smell delivery device comprising a delivery channel for receiving a substance from a canister, the substance configured to produce an olfactory output, such as a smell, an output component through which the substance is emitted, and one or more airflow generating elements configured to generate airflow to transport the substance from the canister to the output component. A flow controller is configured to control the flow rate, or concentration, of the substance through the delivery channel to the output component. The flow controller is configured to control the flow rate, or concentration of the substance from the delivery channel to the output component in response to feedback from at least one of a sensor configured to sense the flow rate, or concentration of the substance, through the delivery channel, and/or, an environmental sensor configured to sense environmental conditions, and/or a user feedback device configured to receive an input from a user.
[0337] There is herein disclosed a smell delivery device that may be used in medical applications, to test the smell performance of patients or train the smell perception of users. Such smell delivery device according to the main aspect may also be used in applications such as entertainment, or consumer products/services to deliver and control the smell in the ambient surrounding the device.
[0338] This smell delivery device is a hardware solution for accurate and precise administration of smell stimuli or mixtures of such smell stimuli, with low latency and no-cross contamination between stimuli.
[0339]
[0340] Air is drawn into the air inlet 9 by the flow generator 13. In this embodiment the air flow then travels through the air filter 20, the canister 5, the delivery channel 3 and then out through the output component 7. The sensor 15 configured to measure the flow rate/concentration of the substance in the delivery channel 3 is positioned within the delivery channel 3. The environmental sensor 17 is positioned on the exterior of the smell delivery device. The user feedback device 19 is positioned anywhere on the smell delivery device. The sensor 15 configured to measure the flow rate/concentration in the delivery channel, the environmental sensor 17, and the user feedback device 19 are all configured to communicate with the flow controller 11. The air flow controller 11 controls the flow rate created by the air flow generator 13. The user feedback device 19 is configured to receive an input from a user.
[0341] The air inlet 9 forms an entrance for air to enter the smell delivery device 1. Air is drawn into the air inlet by the flow generator 13. This brings airflow into the device 1. The air flow, after being brought through the air inlet 9, is directed to an air filter 20. This removes impurities from the air, in order to minimise contamination.
[0342] The substance 5a is then added to the purified air flow. In this embodiment the canister 5 comprises polymer beads saturated with the substance 5a. In this embodiment air flow is directed through the canister 5 such that the air makes contact with polymer beads, such that some of the substance 5a is drawn into the air flow. The amount of the substance that is drawn into the air flow is predictable based on the strength of the air flow.
[0343] The air flow comprising the substance 5a then travels through the delivery channel 3, and out of the output component 7. The user is positioned at/near the output component, and then may experience an olfactory output associated with the substance 5a, such as a smell.
[0344] As the air flow travels through the delivery channel 3 the sensor 15 measures the flow rate/concentration of the substance in the delivery channel 3. This is then compared with a target flow rate/concentration by the flow controller 11. If the measured flow rate/concentration is lower than the target the flow controller 11 will instruct the flow generator 13 to increase the air flow. If the measured flow rate/concentration is above the target flow rate the flow controller 11 will instruct the flow generator 13 to decrease the air flow. In this manner the air flow is modulated and a precise flow rate of the substance is maintained.
[0345] Additionally, the smell delivery device 1 comprises the environmental sensor 17. The environmental sensor 17 in this embodiment is configured to measure the humidity and temperature of the environment. During usage if one of these parameters changes the flow controller 11 instructs the flow generator 13 to modulate the flow rate. For example, in some embodiments if the humidity increases then the flow rate may be modulated by increasing the flow rate, and so the flow rate/concentration of the substance.
[0346] Additionally, the smell delivery device 1 comprises the user feedback device 19. As the device is in operation the user provides feedback. For example, in this embodiment the device 1 is used to determine the concentration of a substance at which a user can perceive its smell. The user feedback is therefore an indication of whether the smell is perceived. Starting from a low concentration/flow rate the user provides feedback indicating that they cannot perceive the smell. The flow controller 11 then instructs the flow generator 13 to modulate the flow rate/concentration of the substance to increase the flow rate/concentration. The flow rate/concentration then iteratively reaches the tipping point at which the smell is perceived by the user. In other embodiments this may be reversed with the flow rate/concentration starting at a high level and being reduced until the user can no longer smell the substance.
[0347] It is noted that the canister 5 may be a replaceable element, and therefore the smell delivery device 1 may be manufactured without a canister 5 present. The canister 5 itself may comprise a storage volume storing a substance, wherein the substance is associated with an olfactory output. The canister 5 is configured to be received by the smell delivery device 1, and wherein once received within the smell delivery device 1, the canister 5 is configured to emit the substance into the delivery channel 5. For example, the canisters 5 may be spring-loaded into position such that they can be removed and replaced with a single click. Alternatively, the canisters 5 may slot into place.
[0348] It is noted that
[0349] The flow generator 13 may optionally be a pump, or a valve. For example, the flow generator 9 may comprise a proportional valve such as a piezoelectric or solenoid based proportional valve. Alternatively, the flow generator may comprise a pump, wherein the power of the pump may be controlled. For example, the pump may comprise a piezoelectric, piston or diaphragm type pump in which the power of the pump is controllable.
[0350] The environmental sensor 17 may comprise any sensor that measures a property of the local environment. For example, the environmental sensor may comprise a thermometer to measure a temperature, a barometer to measure pressure, a hygrometer to measure humidity, or a gas sensor to identify background contamination in the environment. In the case of the gas sensor, the system may then shutdown if the contamination level was too high, for example above a pre-set threshold.
[0351] The sensors 15, 17, 19 may sample at a constant rate. Alternatively, if the sensors detect a measurement close to a threshold they may increase the sampling rate to ensure any breach of a pre-set threshold is detected quickly.
[0352] The sensor 15 may be configured to measure the flow rate/concentration of the substance in the delivery channel may either comprise a flow rate sensor or a concentration sensor. For example, the sensor 15 may comprise a gas sensor. Gas sensor types could include metal oxide, photo-ionisation, mass spectrometry, ion-mobility spectrometry and electro-chemical. An e-nose could be used to identify different scent types. Alternatively, a pressure sensor, or a stress/strain gauge may be used to monitor the flow rate through the delivery channel. Monitoring the flow rate of the substance through the delivery channel 3 may comprise monitoring the total flow rate through the delivery channel 3, as this is indicative of the flow rate of the substance through the delivery channel. Alternatively, or additionally, the mass of the substance contained within the canister 5 may be monitored and this may be used to determine the flow rate of the substance through the delivery channel 3.
[0353] The canister 5 may be any canister 5 containing a substance 5a that provides an olfactory output. The example shown illustrates polymer beads saturated with a substance 5a, however other configurations may be used. For example, the canister 5 may contain a liquid, powder, or gel comprising the substance 5a. In the case of a powder the substance 5a may be carried by the air flow. In alternative embodiments the substance 5a may be vaporised by a valve and introduced into the air flow.
[0354]
[0355] Air is drawn into the air inlet 9 by the flow generator 13. In this embodiment the air flow then travels through the air filter 20a. The air then passes through the flow generator 13 and is then directed towards a manifold 22. A manifold 22 is a pipe or chamber with several openings. In this case each opening is controlled by the flow controller 11 and may constitute a valve 24. The valves 24 are opened dependent upon where the flow controller 11 determines the air flow should be directed. These valves may be simple on-off types, or proportional valves to individually control the flow rate in each channel. Each valve 24 is associated with a respective canister 5, such that, when open, air passing through a first valve 24 will travel through a first canister 5, and air travelling through a second valve 24 will travel through a second canister 5, etc. Each canister 5 has associated with it its own delivery channel 3. Therefore, air travelling through a canister 5 will travel through its associated delivery channel 3. This ensures that the substances 5a stored in each canister are isolated from one another. The delivery channels 3 may, as shown in
[0356] It is noted that a single flow generator 13 may be used to produce flow from a plurality of delivery channels. However, each delivery channel 3 may also have associated with it a flow generator 13. Similarly, a single flow controller 11 may be used, or alternatively each delivery channel 3 may have associated with it an individual flow controller 11.
[0357] Each canister 5 may contain a substance 5a. In some embodiments these substances 5a may differ from one another. In another embodiment one or more of the canisters 5 may be empty such that only air is emitted by the associated delivery channel 3 (this is shown by the lack of a canister associated with the fourth valve in
[0358]
[0359] The sensors for characterization of the chemical substances used in the cartridges may be recording data to compute the smell delivery parameters for an optimal application performance. The type of sensor for such a chemical characterization may be of different types determined by the application requirements, such sensor could be gas sensors or embedded PID (photoionization detector) or odour sensors.
[0360] An array of various sensors or free-located inside and outside the delivery device 1 various types may be included inside the smell delivery device, in different locations. The specific type and number of sensors to integrate might be determined through considering key factors such as sensitivity range, stability, response time, sample frequencies, and durability in relation to the specific application requirements.
[0361] Monitoring the consumption performance and the status of the chemical substances in the cartridges may be advantageous. Such monitoring may be performed by at least one weight sensor 28 located in each of the cartridges 5, as illustrated in
[0362]
[0363]
[0364] The canisters 5 are shown schematically in
[0365] A smell delivery device 1 may be defined as an enclosure 30 with air intake 9 from the environment to allow flow generation. The flow generated is the fundamental carrier of the chemical substances. This flow should be directed at least to one valve 24 connected with one cartridge 5 with at least one air output component for smell stimuli 7. The air output component 7 allows the carrier to deliver the smell (chemical substances/odorants) to a person's nose, or within a person's head space. The smell output 7 may have a number of different shapes and dimensions, which would define the speed and spatial resolution, according to the users' specified or adapted distance. For example, a circular smell output component 7 with a diameter of 1 mm would generate a high-speed delivery with an accurate spatial resolution and dispersion emulating a conical trajectory. The smell output connotations may be functional in relation to the optimal perceptual point and the user' distance and position, so that the users' nose or head space may be reached by the carrier with the smell stimuli. These distances may be calculated in function of contextual and environmental factors. As such the timing of the smell delivery, the air flow, and the pressure of the air flow, could be calculated in relation and adapted to suit the environment and chemical substances used. The delivery range may vary between 10-45 cm, which is defined by the selected delivery device parameters and the type of flow generator 13.
[0366] The air output 7 for smell stimuli could be a supra-perceptual threshold stimulus (i.e., the smell stimulus is above the weakest stimulus perceivable) or sub-perceptual threshold stimulus (i.e., the smell stimulus is below the weakest stimulus perceivable). The perceptual threshold stimuli may be defined by application requirements and computed within by a processor. The processor may be located in a separate device, such as an adaptive system unit in communication with the smell delivery system.
[0367] Two custom control units (PCB-printed circuit boards) are shown, one electronic unit control 10 may drive the pump's behaviour and activate at least one fan 32, with inputs from a least a differential/gauge pressure or flow sensors which is attached directly or through a bypass to the at least one channel, and a temperature sensor and humidity sensor. A second electronic unit control 8 may receive and analyse the outputs from the sensors may drive the valve activity, with inputs from the user feedback device (e.g. answers or preferences) chemical substances information for the data stored in the smell application software (see
[0368]
[0369]
[0370]
[0371] A distance sensor may be used to infer the location of the user 48, therefore inputting the information to the control unit for the adjustment of the delivery parameters accordingly. The type of distance sensors 4 would be defined in relation to the target application(s). These sensors may be an optical distance sensor (LIDAR), a CO2 sensor or ultrasonic sensor. The CO2 type sensor, for instance, may allow the number of people in the vicinity of the device to be estimated through detection of the CO2 level.
[0372]
[0373] The extension length and type may be defined by the applications requirements and scenarios.
[0374] The air input intake 9 may be immediately passing through a first of two coalescing carbon air-filters 20a, 20b to remove external environmental particles and odours. The device may have a generic flow generator 13 such as a pump to produce and control the air flow sourcing the filtered air. The flow generator may be of different types, an axial piston, membrane pump or micro-pump or piezoelectric pump, the different applications and implementation requirements would define the type of flow generator most suitable.
[0375] The air flow generated by the pump system might be conveyed through a sealed pipe system to at least one two-way valves 24 such as solenoid valves or piezoelectric type valves, after being carbon filtered to remove additional particles and odours from the flow generator 13 by the means of a second coalescing filter 20b. The air flowing generated after the second filter would produce a breathable air flow that may be odourless with absence of particles.
[0376] Multiple solenoid valves might be served from the same pump system though a manifold structure 22 with a modular access points for several one-way valves 24. Each valve-type solenoid may be fully closed or accurately opened and regulated to modulate the direction and speed of the flow towards each single cartridge 5. The device may have at least one or more cartridges 5, each of them with a weight sensor 28 to monitor changes in mass.
[0377] The delivery device components and the flow generator may overheat, hence at least one axial fan (32,
[0378] The air flow may be measured with an external flow meter (1 SLM-10 SLM, where SLM means Standard Litre per Minute) that could be a digital type as a clamp-on ultrasonic flow meter or air speed sensor or embedded in smell delivery device with a flow sensor 15 or air speed sensor. The flow sensor may have a resolution of 50 SCCM (where SCCM means standard cubic centimetre per minute). The air flow may be modulated through the pump or solenoid behaviours, with accuracy or automated feedback loop control. The air flow for each channel 3 may range between 0.2 L/min to 6 L/min, with an air flow target range from the flow generator of 0-8 SLM, the range may be determinate specifically for the application scenarios driving the definition of the flow generator types.
[0379] The overall delivery device might have a low audible mechanical noise for bias avoidance of the user, such as when used in perceptual studies or health applications. The audible noise may vary in function of the flow type generators, defined and adapted to application requirements. In the case of the healthcare applications, as smell test or training, the noise would be below 40 dB using a diaphragm pump type while for entertainment the noise level requirement can be less prominent and therefore a piston pump could be applicable. In entertainment applications, the delivery device may be positioned away from the users or in a acoustically treated box.
[0380] The device may have at least 1 delivery output connected with one canister (at least with a volume of 5 mL) that could be made from various non-porous and odourless material, containing a chemical substance in different forms. The chemical substance may be in a different form in function of the application scopes and requirements, such as in form of odorant-saturated plastic polymer beads (see
[0381] A various non-porous, non-absorbent and odourless material nozzle or smell output is in communication with at least one channel connected to at least one chemical substance container.
[0382] The cartridge may have a user-friendly slot in/out with a modular design solution from 1 unit to n-units. The device may have no cross-contamination between channels and requires perfect sealing, avoiding air flow drops or smell leakage.
[0383]
[0384] An adaptive system unit is provided which communicates with the smell delivery device (which is described above) via a communication unit configured to communicate with the smell delivery device. The adaptive system unit further comprises an input unit configured to receive instructions from a user. The adaptive system unit may process these user instructions to determine instructions to send to the smell delivery device regarding changes to the flow rate. Alternatively, the adaptive system unit may send the user instructions directly to the smell delivery device. The smell delivery device may then determine any changes required to the flow rate from the user instructions itself. Either way, the communication unit sends information to the smell delivery device (either in the form of the user instructions, or direct instructions to the smell delivery device).
[0385] The smell delivery device emits smell stimuli in accordance with the instructions determined from the user instructions. These stimuli are emitted in the vicinity of the user. The user then provides further feedback to the adaptive system unit as shown in
[0386] Additionally, any errors or other information may be sent by the smell delivery device to the adaptive system unit. These errors may trigger a further instruction, such as an instruction to shut down or stop the process.
[0387] The adaptive system unit may be independent, as in
[0388] The type of adaptive system unit disclosed incorporates a smell application which adaptively controls and instructs the smell delivery through a system sensing and computing environmental, chemicals and perceptual factors.
[0389]
[0390] The overall system may comprise hardware components including the smell delivery device. The smell delivery device may be as described above. Alternatively, or in addition, the smell delivery device may be composed of at least a flow controller, optionally in the form of an electronic unit control, and one flow generator, such as a module of a pump-valve (or other forms of actuators), a canister with a delivery channel and at least one sensor (e.g., a sensor to determine flow rate through the delivery channel, an environmental sensor, or a user feedback device). The electronic control unit may contain a microcontroller or a microprocessor or a state-machine circuit able to interface with the electronic unit, analyse the signal from the at least one sensor and control the signal to the valve.
[0391] The control unit may drive the sensing and modulating of the various delivery parameters (e.g. frequency, intensity, activation channels, user distance adjustment etc.). The flow generator system and the solenoid valves may have the advantage of being able to deliver with a consistent and stable air flow across one or several channels replicating identical stimuli over time, adjustable to user's viabilities, chemical substance characteristics and environmental factors as such relative location. The adaptability may be determined by users' information and inputs and the synchronized sensors inputs. The sensor inputs may represent a security control feedback of behaviour of the overall system, allowing the detection of errors or malfunctions.
[0392] The device may be a portable version by inclusion of a battery and power management technology or non-portable with an external power supply. The external power supply may for example be 12V. The different sensors integrated in the system may have different power consumptions, for example the air flow sensors may have continuous power consumption for flow sensors, which may be less than 10 mW. The total power consumption of the device is preferably in the range of 1-2 A at 12V (12-24 W), however, the system may have low-powered electronics in other embodiments, such as those designed for the portable use.
[0393] As shown in other Figures (such as
[0394] To explain the functionalities and methods of the adaptive system,
[0395] In the majority of the possible applications and the APP implementations a perceptual profile of the users may be inferred by the device. In this particular example a smell stimulus may be tailored to user's perception threshold level (e.g., in smell training or a smell test), the application logic coordinates the delivery of smell stimuli by the delivery device and a separate interaction with the user by questions and answers related to that smell stimuli. The APP may be interacting with a user through an input unit or by receiving data indicative of user's biofeedback (such as heartrate, skin conductance etc.), presenting the questions and answers graphically or in any other modality to capture the users' response to perception features and personal information. This is a dynamic process where the questions of the user are adapted to the user's answers which are translated by the coordinator in delivery instructions. The control unit inside the device may adjust the delivery stimuli to the dynamic process expressed in delivery instructions. Likewise, the control unit integrates the input for the sensors and sends them back to the APP relative to the state-machine feedback (e.g. errors). The control unit may coordinate the mechanical and software components to adjust the delivery parameters with the algorithm driving the sensors.
[0396] The overall APP may be located in a device (e.g., computer system, mobile, tablet computer), as presented in
[0397]
[0398] In this embodiment the user may provide feedback into an external device, such as a tablet, that is connected to the cloud infrastructure.
[0399] To support multiple use applications the delivery device may be integrated in a variety of settings, interacting with other devices (computers, smartphones, tables, PDA, haptic device, VR headset, etc.) and being guided by different software applications that may be deployed in one or more of those devices. In order to communicate with those devices, the smell delivery device may contain multiple connectivity mechanisms, including Bluetooth, ethernet, USB, Wi-Fi, and/or RF technologies. One or multiple smell delivery device may be used in the same applications or by different applications run synchronously or not, according to all the alternative system configurations as below presented in detail.
[0400] Depending on the use case applications, the smell delivery device may advantageously, for instance, have a low latency integration with other devices presented in the same physical space or there may be distributed delivery devices that need to update a remote computer in the cloud with collected information from users in multiple locations.
[0401] According to a further aspect of the present disclosure related to the adaptive unit there are various types of embodiment integration configurations provided. We describe as examples here possible integration settings for the system. The smell delivery device connects directly (via USB port for serial communication, Bluetooth, Wi-fi, RF technologies, etc.) to other general devices (computer, mobile, tablet, etc.) located in the same physical space, as presented in
[0402]
[0403] The smell delivery device connects through Internet (using a client/server architecture) to a remote computer, as in the cloud or in-premises. That remote computer may connect to a second device (computer, mobile, tablet, etc.) co-located with the smell delivery device, which may be used as the user interface.
[0404]
[0405] The smell delivery device connects directly (via USB port for serial communication, Bluetooth, Wi-fi, RF technologies, etc) to a central device used to control other device. For example, the central device may interact with and control other devices in the same physical location (like audio-visual screen, VR sets, haptic devices, light systems, etc.) to achieve a low latency integration and deliver a coordinated multisensory experience.
[0406]
[0407] This configuration is the same as the previous configuration presented in
[0408]
[0409] The smell delivery device connects through the Internet to a remote computer that can live in the cloud or in-premise servers to deliver a general experience that does not require input from the user or retrieval information from stored user profile or APP information.
[0410]
[0411] Therefore, in this embodiment the smell delivery device functions in isolation based on an application running on its own microprocessor. This could be a predefined set delivery experience that does not require input and could retrieve information from a stored user profile or APP information locally-stored in the smell delivery device flow controller, or in another control unit in communication with the smell delivery device. This simple configuration is presented in
[0412]
[0413] The adaptive system unit is configured to receive instructions from a user or biofeedback measure and then process the instructions or feedback to determine a flow instruction. The flow instruction is to modulate the flow generated by the flow generator. This flow instruction is then sent to the smell delivery device. The smell delivery device receives the flow instruction and in response modulate the flow rate, or concentration of the first substance, accordingly.
[0414] For example, the environmental sensor of the smell delivery device may detect the temperature, humidity, or pressure, of the local environment. This may affect a user perception of smell. For example, in the event that the temperature is very cold (for example close to or below 0 degrees Celsius) the volatility of molecules, including substances stored in the canisters may be reduced. This may reduce the smell associated by the substance, and so a higher flow rate, or a higher concentration of a substance may be required. Therefore, the smell delivery device may in response modulate the flow to increase the flow rate, or concentration of the first substance. Similarly, if humidity is high, the user may experience a musty smell. Therefore, to overcome this effect the flow rate may have to be increased, or another substance also emitted to mask the odour associated with the humidity.
[0415] If the sensor in the delivery channel senses that the flow rate/concentration is different to that required then it will feed back to the flow controller that the flow rate, or concentration should be modulated.
[0416] User feedback will also lead to a response. This is dependent on the feedback provided by the user, and the questions that may have been asked to the user. This will depend on the specific application, or test that the user is undergoing.
[0417]
[0418] In the flow chart an example of a possible smell application (APP) is described. In ST1, the APP is loaded and launched by a computing device, which may determine the next step of interaction with the user (or users) (ST2) initiating a loop of interactions between the user and the computing device for which conditions to continue interacting are evaluated in ST3. The smell delivery will be triggered with defined parameters (ST4) and following that the sensing of the environment and the delivery system itself by the smell delivery device (ST5) will allow the algorithm to adjust its delivery parameters to control the actuators in order to modify the airflow as required (ST6).
[0419] The next step is a condition to generate a feedback loop in which the process of other iteration of smells delivery/sensing/adjustment of delivery parameters can be triggered until the goal of delivery is fulfilled (ST7). The whole feedback loop process, from ST4 to ST7, may be performed by the DD's control unit.
[0420] After delivering smell the interaction with the user is based on questions presented to the user (ST8) and their answers supplied to the computing device (ST9), which brings the flow back to defining based on this new information how the program will continue, by returning to ST2. From this point the entire cycle might repeat, or based on the decision made in ST2, decide not to continue the interaction with the user and finish the execution of the application.
[0421] Note that in the example of
[0422]
[0423] In the flow chart an example of a possible smell application (APP) is described. In ST1, the APP is loaded and launched by a computing device, which may load the next step of delivery instructions (ST2) from a data storage, initiating a loop of interactions for which the condition to continue operating is based on delivery instructions left to be executed (ST3). The smell delivery will be triggered with defined parameters based on the next delivery instruction (ST4) and following that the sensing of information from the environment and the delivery system itself (ST5) will allow the algorithm to adjust its delivery parameters to control the actuators component in order to modify the airflow as required (ST6).
[0424] The next step is a condition to generate a feedback loop in which the process of other iteration of smells delivery/sensing/adjustment of delivery parameters can be triggered until the goal of that particular delivery instruction is fulfilled (ST7). The whole feedback loop process, from ST4 to ST7, may be performed by the DD control unit.
[0425] After delivering smell the flow returns to ST3, where it will check for further instructions. From this point the entire cycle might repeat, or no, more delivery instructions left to finish the execution of the application.
[0426] Note that in the example of
[0427]
[0428] In the flow chart an example of a possible smell application (APP) is described. In ST1, the APP is loaded and launched by a computing device, which may request specifically a user smell configuration (ST2) initiating a loop of interactions for which conditions to continue interacting are evaluated in ST3. The smell delivery device will be triggered with defined parameters (ST4) and following that the sensing of the environment and the delivery system itself, specifically air flow, pressure, smell concentration (ST5) will allow the algorithm in driving the sensor feedback to regulate the air flow of the delivery through smell source to control scent concentration (ST6).
[0429] The next step is a condition to generate a feedback loop in which the process of other iteration of smells delivery/sensing/adjustment of delivery parameters can be triggered until the goal of delivery is fulfilled (ST7). The whole feedback loop process, from ST4 to ST7, may be performed by the DD's control unit.
[0430] After delivering smell the interaction with the user is based on questions (ST8) and their answer (ST9), which brings the flow back to defining based on this new information how the program will continue, by returning to ST3. From this point the entire cycle might repeat, or based on the decision made in ST3, decide not to continue the interaction with the user and finish the execution of the application.
[0431] Note that in this example as in
[0432]
[0433] The smell delivery device 102 comprises an array of gas sensors. The array includes a plurality of MOX sensors and a PID sensor for calibration. The gas sensors are configured to generate sensor information in response to an olfactory output 110. In
[0434] The smell sensing device 102 is configured to output sensor information 114 to the computing device 106. The sensor information 114 comprises the output of the gas sensors of the smell sensing device 102. The sensor information 114 may comprise smell intensity, a type of smell, a duration of smell, and/or an identification of the smell. In this example, the smell sensing device 102 has a wireless connection to the computing device 106.
[0435] The computing device 106 may be a computer system, a mobile, or a tablet. For example, the computing device 106 may be a smart device such as a smartphone or tablet. In this embodiment, the computing device 106 is local. In other words, the computing device 106 is local to the user so the user can interact with it. The computing device 106 may also interact with devices such as the smell delivery device 104 and the smell sensing device 102 locally, in this case via a wireless connection but in other cases directly via wires. The computing device 106 has a user interface 108. The user interface 108 forms a user output device. The user interface 108 can output an identification of a smell associated with the olfactory output 110. For example, the user interface 108 can output information 118 to the user, for example through a screen of the computing device 106. The user interface 108 can also receive user input information 116 such as indicating a perception of the smell related to the olfactory output 110 or other questions. The user interface 108 in this example is a touch screen, but in other examples it may be different such as a button which is separate from the user output which may be a display screen.
[0436] The computing device 106 also comprises a processor. In this embodiment, the computing device 106 runs software which performs processing. The Smell Application Software (named APP) previously described in
[0437] The sensor information 114 from the smell sensing device 102 is further correlated with delivery information 112 which is data or information generated by the smell delivery device such as smell delivery flow rate, channel selection, pump pressure, electro-valve opening. The delivery information 112 is received from the smell delivery device 104. This may indicate what canisters are loaded, which delivery channels are active, which valves are open, and the flow rate through each delivery channel. The correlation can determine that the smell delivery device 104 has worked correctly as the expected olfactory output 110 has been released at the expected intensity, as confirmed by the output of the smell sensing device 102 identified in the sensor information 114.
[0438] The computing device 106 can further correlate the sensor information 114 with environmental information from an environmental sensor such as temperature, humidity, or ambient pressure. This is received from an environmental sensor which in this example is located on the smell sensing device 102. The environmental information may therefore be supplied alongside the sensor information 114 in this case and can be transmitted to the computing device 106. In other examples, the environmental sensors may be located elsewhere such as on the smell delivery device 104 or elsewhere. As it is known that parameters such as temperature and humidity affect a sense of smell, information identifying temperature or humidity may be used to determine an environmental effect on the olfactory output 110. For example, the information related to the olfactory output 110 from the sensor information 114 may be compensated based on the environmental information.
[0439] The computing device 106 can further correlate or process the sensor information (and optionally together with the delivery information 112 and/or the environmental information) with user information which can be further information or data from a user feedback device configured to receive an input from a user, wherein the input from the user indicates a parameter of the user's perception of the olfactory output. In this example, the user information 116 is received from the user interface 108 of the computing device 106 where the computing device 106 acts as a user input unit of a user feedback device. The user inputs information such as their perception of a smell, for example indicating whether they can detect the smell, their perceived intensity, and/or their perception of what smell it is. For example, the user may input that they detect a strong odour of lavender, in this case.
[0440] In other embodiments, this further correlation of the sensor information 114 with delivery information 112, environmental information, and/or user information 116 is not necessary and the delivery information 112, environmental information, and/or user input information 116 are not required.
[0441] The processor of the computing device 106 can then correlate the sensor information 114 with the delivery information 112, environmental information, and/or user information 116 to identify the smell of the olfactory output 110. For example, the sensor information 114 from the smell sensing device 102 can be processed and from this the processor can identify a smell from the olfactory output 110 (for example a lavender smell in this case). This may be based on algorithms such as neural networks (trained on test data) analysing the signal of the gas sensors. The array of gas sensors can be used together to detect different VOCs and calibrate each other. In combination, an accurate determination of the olfactory output 110 can be provided.
[0442] The analysis is compensated for effects of the environment, by processing the environmental information, e.g. the temperature and humidity, to compensate for effects on the olfactory output 110. For example, the sensor information 114 may be adjusted when the temperature or humidity is above a certain threshold, or adjusted using a formula dependent on temperature or humidity. The computing device 106 also has a user stored profile 120 of user information which can also be used. This can indicate user preferences relating to desired output, or historical information as to impairments to sense of smell. This can be used to adjust an output through the user interface 108 of the computing device 106, for example alerting the user of an identification of certain smells at a lower intensity to other smells where the user perception is lower for that smell compared to others. The user can also input information 116 through the user interface 108 of the computing device 106 which thus acts as a user feedback device. The user interface 108 can also output answers 118 to questions 116 from the user or other outputs 118 such as an identification of smell or other feedback. User information input to the computing device 106 can then be stored in the user stored profile 120.
[0443] Once the computing device 106 has identified the smell, it can then output the identification via the user interface 108 (user output device) in the form of an output 118. The identification is a representation of the olfactory output 110. In this embodiment, the identification is an image of an object associated with the smell, in particular the object that produces the smell. In this case, the computing device 106 outputs an image of lavender via the user interface 108 so that the screen displays an image of lavender. The user can then see this and understand that the smell is lavender. In cases whether the user smell is impaired, this can aid the user or confirm their sense where it is weak.
[0444] The computing device 106 also sends delivery instructions 122 to the smell delivery device 104. In this case, these adjust the olfactory output 110 by changing the smell or intensity or combination of smells. The adjustment of the olfactory output 110 can be based on the analysis of the computing device 106, for example considering the sensor information 114 of the smell sensing device 102 or other sensors. In one example, based on the sensor information 114 of the smell sensing device 102 indicating the intensity of the olfactory output 110 (for example, the sensor information 114 containing a signal such as a voltage indicating an intensity), the computing device 106 determines that the intensity of the olfactory output 110 is too low. Based on this, the computing device 106 instructs the smell delivery device 104 to increase the intensity. This can be used for smell testing and training. The smell delivery device 104 in this embodiment has multiple delivery channels for receiving a substance from a canister and an output component through which the substance can be emitted. The substance can produce the olfactory output 110 to be detected by the smell sensing device 102. The smell delivery device 104 also has airflow generating elements which generate airflow to transport the substance from the canister to the output component. In some examples, the smell delivery device 104 is the smell delivery device of other embodiments such as in
[0445]
[0446] In this embodiment, the computing device 206 is a remote computing device and is arranged in the cloud infrastructure. In other examples, more than one computing device is provided where the processing is shared across multiple devices or resources in the cloud. In some examples, part of the processing can be performed in the cloud, while part can be performed locally by a local computing device such as computing device 106. The computing device 206 interacts with the smell sensing device 102 and the smell delivery device 104 in a similar manner, but over a remote connection such as over the internet. In this embodiment, the system 100 includes a user interface 208 which is in communication with the computing device 206 in the cloud. In this embodiment, the user interface 208 is a smart device such as a smartphone. The user can interact with the user interface 208 of the smart device to communicate with the computing device 206 in the cloud.
[0447] The smell sensing device 102 may comprise a Bluetooth component or a wireless transmitter and can be connected wirelessly to the computing device 206 or directly to the wireless network. The sensor information 114 from the smell sensing device 102 is further processed in the computing device 206 in the cloud to more accurately predict and differentiate between different categories of smells and their intensities. Machine learning, neural networks or more advanced artificial intelligence (AI) algorithms may be used on the computing device 206 to increase selectivity and sensitivity to smell. As the computing power can be higher when using a cloud service compared to a local device, more complex algorithms such as more powerful AI algorithms can be used. The computing device 206 can also communicate with the user interface 208 for outputting information 118 to a user and receiving input 116 from the user. This allows for the user to input their perception to a smell 116 and to receive an output 118 identifying the smell. The user interface 208 thus acts as a user output device and also as a user feedback device having a user input unit.
[0448] In other words, the system 200 can be operated in a similar manner to the system 100, except that the processing is performed in the cloud.
[0449]
[0450] The smell sensing device 302 is attached to the user so that it is close to the nose of the user. Here the position of the smell sensing device 302 attached to the frame of glasses is specifically shown. The odour is delivered by the smell delivery device 104 via volatile organic compounds. The VOCs diffuse through the medium (air) and part of them reach the user. The intensity of the smell is given by the concentration of the VOCs that reach the user. This in turn is a function of the flow rate through which the smell is delivered in each channel. The smell sensing device 302 detects the concentration of the smell, the type of smell, the smell duration (in the proximity of the user), the background smell and also ambient parameters such as humidity and temperature. In this example, the smell delivery device 302 comprises gas sensors and environmental sensors.
[0451] The smell sensing device 302 provides a live feedback to the smart device 306. The smell delivery device 104 has a wireless transmitter for communicating with the smart device 306 by Bluetooth or other wireless protocol such as Wi-Fi. The sensor information 114 sent from the smell sensing device 302 to the smart device 306 contains a signal of the sensor response to the olfactory output 110 which indicates an intensity of the smell and the data from the smell sensing device 302 may further contain environmental information from environmental sensors indicating, for example, temperature and humidity.
[0452] The information is correlated with a database 124 by the smart device 306 and the feedback olfactory perception from the user. The user feedback can be input via the user interface 308 to the smart device 306. Where the user indicates that they perceive the smell (or indicate a relative intensity), the sensor information 114 can be used to verify this. The database 124 can be used by the smart device 306 to look up historical data such as background olfactory output patterns or historical user data. Thus, the sensor information 114 may be correlated with user information and user input information. In the event that the user indicates that they cannot detect the olfactory output 110 (e.g. lavender smell) emitted by the smell delivery device 104, but the smell sensing device 102 indicates a high intensity of, in this case, lavender, via the sensor information 114, then it is confirmed that the system 300 is working correctly, indicating an impairment to the user's sense of smell. By processing the historical user information, the smart device 306 can determine that the user has historically had difficulty smelling lavender. This information can be output to the user via the user output device, which in this case is provided by the user interface 308 of the smart device 306. In this embodiment, the user output device is the same device (smart device 306) as the processor and the user input device, but in other examples they may be provided separately. This information can also be fed back to the smell delivery device 104 through control signals 122.
[0453] The smart device 306 also communicates with the smell delivery device 104 to control channel selection, flow rate, smell intensity and other parameters. The smart device 306 can instruct the smell delivery device 104 to adjust the olfactory output 110. If, as here, the user has indicated they cannot detect the smell, the smart device 306 can instruct the smell delivery device 104 to increase the intensity such as by increasing flow rate to see if the user can detect the higher intensity. The smart device 306 may communicate with the smell delivery device 104 wirelessly such as over a wireless network or by Bluetooth. The user information can indicate a level at which the user can detect the lavender smell, so the intensity can be changed to confirm this level and detect any change in the user's ability to smell.
[0454] The smart device 306 is the processor in this example and may receive the sensor information 114 and delivery information, and send instructions 122 to adjust the delivery of the olfactory output 110. The smart device 306 also performs the processing and outputs the identification or validation through the user interface 308. In other words, the processing is performed locally by the smart device 306. In other examples, the smart device 306 can act as a communication device and the processing can be performed on another device such as in the cloud. Thus, the smart device 306 can receive the information, but forward this to a remote computing device in the cloud. In other examples, the system 300 may include processing power in the cloud network.
[0455]
[0456]
[0457]
[0458] While this figure shows an example of a simple, schematic implementation of a smell sensing device, other implementations based on different state-of-the-art assembly techniques are possible (not shown). The smell sensing device, could be in the form of a system in package (SIP) and could use techniques such as flip-chip, stack die, chip on board assembly, wafer level packaging etc. The VOC sensors could be for example mounted straight onto the chip of an ASIC rather than through a PCB, using a stack die technique. The humidity and temperature sensor may be co-packaged with the VOC sensor(s), to decrease the form factor and/or reduce the cost of the device.
[0459]
[0460]
[0461] It will be appreciated from the discussion above that the embodiments shown in the Figures are merely exemplary, and include features which may be generalised, removed or replaced as described herein and as set out in the claims. With reference to the drawings in general, it will be appreciated that schematic functional block diagrams are used to indicate functionality of systems and apparatus described herein. For example, the functionality provided by the flow generator may in whole or in part be provided by the valves. In addition, the process functionality described may also be provided by devices which are supported by the adaptive system unit. It will be appreciated however that the functionality need not be divided in this way and should not be taken to imply any particular structure of hardware other than that described and claimed below. The function of one or more of the elements shown in the drawings may be further subdivided, and/or distributed throughout apparatus of the disclosure. In some embodiments the function of one or more elements shown in the drawings may be integrated into a single functional unit.
[0462] The above embodiments are to be understood as illustrative examples. Further embodiments are envisaged. It is to be understood that any feature described in relation to any one embodiment may be used alone, or in combination with other features described, and may also be used in combination with one or more features of any other of the embodiments, or any combination of any other of the embodiments. Furthermore, equivalents and modifications not described above may also be employed without departing from the scope of the invention, which is defined in the accompanying claims.
[0463] In some examples, one or more memory elements can store data and/or program instructions used to implement the operations described herein. Embodiments of the disclosure provide tangible, non-transitory storage media comprising program instructions operable to program a processor to perform any one or more of the methods described and/or claimed herein and/or to provide data processing apparatus as described and/or claimed herein.
[0464] The sensors, flow controller and flow generator (and any of the activities and apparatus outlined herein) and the smell sensing device any of their constituent parts may contain or may be implemented with fixed logic such as assemblies of logic gates or programmable logic such as software and/or computer program instructions executed by a processor. Other kinds of programmable logic include programmable processors, programmable digital logic (e.g., a field programmable gate array (FPGA), an erasable programmable read only memory (EPROM), an electrically erasable programmable read only memory (EEPROM), an application specific integrated circuit, ASIC, or any other kind of digital logic, software, code, electronic instructions, flash memory, optical disks, CD-ROMs, DVD ROMs, magnetic or optical cards, other types of machine-readable mediums suitable for storing electronic instructions, or any suitable combination thereof. Such data storage media may also provide a data storage means for use in conjunction with the smell deliver system to store any data created.