METHOD FOR PROVIDING VEHICLE PET MODE
20250282364 · 2025-09-11
Inventors
Cpc classification
H04W4/80
ELECTRICITY
B60W2040/0881
PERFORMING OPERATIONS; TRANSPORTING
B60W2556/45
PERFORMING OPERATIONS; TRANSPORTING
B60W50/0098
PERFORMING OPERATIONS; TRANSPORTING
B60W40/08
PERFORMING OPERATIONS; TRANSPORTING
B60K2360/573
PERFORMING OPERATIONS; TRANSPORTING
B60W2540/01
PERFORMING OPERATIONS; TRANSPORTING
B60K35/10
PERFORMING OPERATIONS; TRANSPORTING
B60W2540/22
PERFORMING OPERATIONS; TRANSPORTING
B60W2420/54
PERFORMING OPERATIONS; TRANSPORTING
International classification
B60W50/00
PERFORMING OPERATIONS; TRANSPORTING
B60W40/08
PERFORMING OPERATIONS; TRANSPORTING
B60K35/10
PERFORMING OPERATIONS; TRANSPORTING
Abstract
An embodiment relates to a method for providing a pet mode in a vehicle, which is executed by a system, comprising: (a) a step of establishing communication between a user terminal and an infotainment system of the vehicle; (b) a step in which a pet sound collection unit of the user terminal collects sound information occurring inside the vehicle when a pet is present therein, and transmits the collected sound information to a server; (c) a step in which the server classifies the received sound information into pet sounds and non-pet sounds based on a preset algorithm; (d) a step in which the server determines the emotional state of the pet with reference to a preset pet emotion state table, based on the sound classified as a pet sound.
Claims
1. A method for providing a pet mode in a vehicle, performed by a system, comprising: (a) establishing a communication connection between a user terminal and an infotainment system of the vehicle; (b) collecting, by a pet sound collection unit of the user terminal, sound information generated inside the vehicle when a pet is present in the vehicle, and transmitting the collected sound information to a server; (c) distinguishing, by the server, the received sound information into pet vocalizations and other sounds using a predetermined algorithm; (d) determining, by the server, an emotional state of the pet with reference to a preconfigured pet emotional state table for the sound information classified as pet vocalizations; (e) transmitting, by the server, a command signal to the user terminal to control at least one or more of a sound output unit, temperature control unit, window, sunroof, and feeding unit of the vehicle according to the emotional state of the pet using a predetermined algorithm; and (f) transmitting, by the user terminal, the command signal to the infotainment system, and controlling the vehicle by the infotainment system, wherein the command signal includes identification information and operation information related to a target component in the vehicle.
2. The method of claim 1 wherein, the pet sound collection unit includes a voice recognition device installed inside the vehicle and connected via wired or wireless communication, a built-in microphone of the vehicle's infotainment system, and a microphone of the user terminal connected to the vehicle via Bluetooth, and comprises a plurality of microphones configured to receive ambient noise, sound generated from specific sound sources, and pet vocalizations and convert them into electrical sound signals.
3. The method of claim 1, wherein step (c) comprises: (c-1) filtering the sound information to detect the owner's voice; and (c-2) filtering the remaining sound information excluding the owner's voice to remove noise caused by vehicle operation.
4. The method of claim 3, wherein step (c) is performed when the server determines that only the pet is present inside the vehicle, and the server determines that only the pet is present when the collected sound signal does not include the user's voice.
5. The method of claim 3, wherein in step (c-2), the server has pre-stored noise data corresponding to vehicle operation by driving state and vehicle model, wherein the driving state is classified into four states of P (Park), D (Drive), R (Reverse), and N (Neutral) according to the vehicle's gear position, and predetermined vehicle speeds and corresponding noise values are stored for each driving state.
6. The method of claim 1, wherein in step (d), a pet emotional state table is pre-stored in the server, the table matching a plurality of pet emotional states with pitch of pet vocalizations, a preset number of repetitions per unit time, and a duration for which a vocalization is maintained.
7. The method of claim 6, wherein the plurality of pet emotional states includes hunger, fear, aggression, defensiveness, excitement, desire, physical satisfaction, emotional satisfaction, request for help, boredom, pain, and lethargy.
8. The method of claim 1, wherein in step (e): the sound output unit outputs an owner's voice corresponding to the pet's emotional state, which is pre-stored in the server, according to a command signal from the server; the temperature control unit adjusts an air conditioner's temperature according to an air conditioning command signal pre-stored in the server for each pet emotional state, and when a window and a sunroof are cross-opened, the air conditioner operates to perform ventilation; the window and sunroof are opened and closed according to a command signal from the server, such that they do not open beyond the size of the pet's head, and two windows among the vehicle's multiple windows are cross-opened relative to the center of the vehicle; the feeding unit controls a feeding device and watering device according to a command signal pre-stored in the server for each pet emotional state.
9. The method of claim 1, further comprising: (g) providing, to the user terminal, information on the classified pet emotional state and operations of the sound output unit, temperature control unit, and feeding unit as controlled by the server.
10. A system for providing a pet mode in a vehicle, comprising: a user terminal configured to establish a communication connection with a vehicle's infotainment system and to transmit a command signal to the infotainment system so that the infotainment system controls the vehicle; a pet sound collection unit configured to collect sound information generated inside the vehicle when a pet is present and to transmit the collected sound information to a server; and a server configured to distinguish the received sound information into pet vocalizations and other sounds using a predetermined algorithm, determine the pet's emotional state by referring to a pre-stored pet emotional state table, and transmit a command signal to the user terminal to control at least one or more of a sound output unit, temperature control unit, window, sunroof, and feeding unit of the vehicle according to the determined pet emotional state, wherein the command signal includes identification information and operation information related to a target component in the vehicle.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0027]
[0028]
[0029]
[0030]
[0031]
[0032]
DETAILED DESCRIPTION
[0033] Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art to which the present invention pertains can easily implement the invention. However, the present invention may be implemented in various other forms, and is not limited to the embodiments described herein. In the drawings, parts not related to the description are omitted for clarity, and similar reference numerals are assigned to similar parts throughout the specification.
[0034] In the entire specification, when a part is said to be connected to another part, it includes not only cases where they are directly connected, but also cases where they are electrically connected with other elements interposed therebetween. In addition, when a part is said to include a component, it means that it may further include other components unless otherwise specifically stated to the contrary.
[0035] In this specification, the term unit refers to a component realized by hardware, a component realized by software, or a component realized using both. One unit may be realized by two or more pieces of hardware, and two or more units may be realized by a single piece of hardware. The term unit is not limited to either software or hardware, and may be configured to reside on an addressable storage medium or to be executed by one or more processors. For example, a unit may include software components, object-oriented software components, class components, and task components, as well as processes, functions, attributes, procedures, subroutines, segments of program code, drivers, firmware, microcode, circuits, data, databases, data structures, tables, arrays, and variables. The functionalities provided in the components or units may be combined into fewer components or units, or further separated into additional components or units. Additionally, the components or units may be implemented to execute one or more CPUs in a device or a secure multimedia card.
[0036] The term terminal referred to hereinafter may be implemented as a computer or a portable terminal capable of connecting to a server or another terminal via a network. The computer may include, for example, a notebook, desktop, or laptop equipped with a web browser, or VR HMDs (e.g., HTC VIVE, Oculus Rift, GearVR, DayDream, PSVR, etc.). VR HMDs may include PC-based models (e.g., HTC VIVE, Oculus Rift, FOVE, Deepon), mobile models (e.g., GearVR, DayDream, Baofeng Mojing, Google Cardboard), console models (e.g., PSVR), and standalone models (e.g., Deepon, PICO, etc.).
[0037] The portable terminal may include wireless communication devices that guarantee portability and mobility, such as smartphones, tablet PCs, and wearable devices, as well as various devices equipped with communication modules such as Bluetooth Low Energy (BLE), NFC, RFID, ultrasonic, infrared, WiFi, or LiFi.
[0038] The network refers to a connection structure that enables information exchange between respective nodes such as terminals and servers. It may include a Local Area Network (LAN), Wide Area Network (WAN), the Internet (WWW), wired and wireless data communication networks, telephone networks, and wired and wireless television communication networks.
[0039] Examples of wireless data communication networks include, but are not limited to, 3G, 4G, 5G, 3GPP (3rd Generation Partnership Project), LTE (Long Term Evolution), WiMAX (World Interoperability for Microwave Access), Wi-Fi, Bluetooth communication, infrared communication, ultrasonic communication, visible light communication (VLC), and LiFi.
[0040] Hereinafter, a system for providing a pet mode in a vehicle according to an embodiment of the present invention will be described with reference to
[0041] The system for providing a pet mode in a vehicle according to an embodiment of the present invention may include a server (100), an infotainment system (200) installed or embedded in a vehicle, and a user terminal (300).
[0042] According to the present invention, the user terminal (300) may be connected to the infotainment system (200) through Bluetooth pairing and wireless internet-based communication, thereby allowing the user terminal (300) to perform a role of collecting data from the interior of the vehicle together with the infotainment system (200). The user terminal (300) may also perform a role of transmitting the collected information to the server (100) via wired or wireless communication.
[0043] The infotainment system (200) according to an embodiment of the present invention is an integrated multimedia system combining the concepts of information and entertainment. In addition to traditional functions such as navigation and audio, it is a device that enables the user to check various types of information provided by the vehicle and to operate various vehicle functions. It may also include server (100)based voice recognition functionality and OTA (Over-The-Air) technology for wirelessly updating navigation information and software.
[0044] The user terminal (300) may be a smartphone, tablet PC, laptop, or desktop capable of wired or wireless communication with the server (100) and the vehicle's infotainment system (200), and may have installed thereon a program or application for performing the pet mode provision method in a vehicle according to an embodiment of the present invention.
[0045] Referring to
[0046] Hereinafter, an embodiment of the method for providing a pet mode in a vehicle, which is performed by the above-described system, will be explained.
[0047] First, the user terminal (300) and the vehicle's infotainment system (200) are communicatively connected. The communication connection may include wired or wireless connections and, in a preferred embodiment, may be established via Bluetooth pairing.
[0048] Through the above-described connection, the user terminal (300) performs the function of a pet sound acquisition unit (210). The pet sound acquisition unit (210) collects sound information generated inside the vehicle when a pet is present and transmits the collected sound information to the server (100).
[0049] The pet sound acquisition unit (210) according to an embodiment of the present invention may include a voice recognition device installed in the vehicle and connected via wired or wireless communication, a built-in microphone of the vehicle's infotainment system (200), and a microphone device of the user terminal (300) connected to the vehicle via Bluetooth. It may include a plurality of microphones that receive noise and voice from specific sound sources and pet vocalizations generated inside the vehicle and convert them into electrical audio signals.
[0050] For example, assuming the user terminal (300) is a smartphone with a built-in microphone device, after Bluetooth pairing between the vehicle's infotainment system (200) and the smartphone, the microphone device of the smartphone receives the noise, specific source voice, and pet vocalizations generated inside the vehicle, converts them into electrical audio signals, and transmits them to the server (100) via wireless communication means such as LTE or Wi-Fi.
[0051] The sound information received by the server (100) through the above-described process is classified into pet vocalizations and other sounds according to a predetermined algorithm.
[0052] At this time, the server (100) filters the sound information based on a predetermined algorithm to detect the owner's voice, and then filters the remaining sound information to remove noise generated by the operation of the vehicle.
[0053] The process of detecting the owner's voice by filtering the sound information at the server (100) may be performed by detecting voice segments in the sound information using VAD (Voice Activity Detection).
[0054] Since VAD is a technology applied to voice processing to detect the presence or absence of human speech and is a known prior art, detailed description thereof will be omitted.
[0055] Next, the operation of filtering the remaining sound information, excluding the owner's voice, to remove noise caused by vehicle operation may be performed by sequentially applying a KLT (Karhunen-Loeve Transform)-based filter using the Kuhn-Tucker condition and Lagrangian multiplier, and an SDW-MWF (Speech Distortion Weighted Multi-channel Wiener Filter) to extract the owner's voice.
[0056] The method using a Karhunen-Loeve Transform (KLT)-based filter is a noise reduction technique that utilizes the subspace of a covariance matrix. The mathematical expression used for noise reduction is as follows:
[0057] In Equation 1, x represents the speech signal, d denotes noise, and y refers to the audio signal received through the microphone. Using this algorithm, a filter gain H is obtained and applied to y to estimate the speech signal.
[0058] Next, the actual error can be represented using the method shown in Equation 2. Since minimizing this error brings the result closer to the intended value, the objective is to minimize r.sub.x and rd. To achieve this, if r.sub.x is minimized while rd is fixed to a certain value in Equation 2, the optimal value of H can be derived using the Kuhn-Tucker condition and Lagrangian multipliers. For simplicity of computation, Equation 2 can be transformed into the following Equation 3.
[0059] In the above equation, R.sub.x is the covariance matrix of the speech signal, and Rd is the covariance matrix of the noise signal. V is the eigenvector of =R_d.sup.1R.sub.x. The value G is a diagonal matrix, which can be expressed as shown in Equation 4.
[0060] In Equation 4, K denotes the frame size of the overall signal, and M refers to the number of positive eigenvalues of . Therefore, the gain of the KLT-based filter is ultimately derived, enabling noise removal.
[0061] Following the above-described process, the server (100) further filters the already processed acoustic signal using SDW-MWF (Speech Distortion Weighted Multi-channel Wiener Filter).
[0062] That is, the server (100) can remove noise from signalsalready filtered through the KLT-based filter in each single channel (i.e., each microphone)by applying SDW-MWF that utilizes multi-channel characteristics.
[0063] The main principle of the Wiener filter is to derive a filter gain H that satisfies the MMSE (Minimum Mean Square Error) criterion.
[0064] The result obtained from the KLT-based filter is converted into the frequency domain via STFT (Short-Time Fourier Transform), and is expressed as in Equation 5 below.
[0065] Equation 5 represents the input signal, speech signal, and noise signal at the k-th frequency bin of the i-th microphone. Each microphone signal, expressed in the same manner as Equation 5, can be collectively represented as a single vector. Using this expression, noise can be selectively removed.
[0066] The server (100) obtains a filter gain that minimizes the MMSE using the approach described in Equation 6. The filter gain H can be derived by performing partial differentiation with respect to H, and is expressed as shown in Equation 7.
[0067] In Equation 7, e is a vector used to select the microphone for filtering, and Ryy, Rdd denote the autocorrelation matrices of the input signal (speech) and the noise signal, respectively. Equation 7 represents the final filter gain of the MWF (Multi-channel Wiener Filter). However, in general, noise reduction algorithms have a trade-off between filtering performance and the distortion of the final signal. SDW-MWF (Speech Distortion Weighted MWF) is a method that allows this trade-off to be adjusted by expanding Equation 7 and applying a weighting factor to the noise component of the formula. This filter gain can be expressed as shown in Equation 8.
[0068] Equation 8 represents the final filter gain calculated by the server (100). By multiplying the result of the KLT-based filterused for initial noise reductionwith Equation 8, the server (100) can estimate the final speech signal.
[0069] Through the aforementioned process, the server (100) can distinguish between the pet's vocalizations and other sounds (including human voices and background noise) from the audio collected by the pet sound collection unit.
[0070] Accordingly, the server (100) may determine that no pet is present in the vehicle if the collected audio includes no pet vocalizationsor if non-pet sounds exceed a predetermined threshold of the total collected audio. Conversely, if pet vocalizations exceed the predetermined threshold, the server (100) may determine that a pet is present in the vehicle.
[0071] According to an additional embodiment of the present invention, if the server (100) recognizes only pet vocalizations and no human voices from the collected audio signals, it may determine that only the pet is present in the vehicle. In such cases, the server may proceed to distinguish between pet sounds and other sounds (in this case, noise only, without human voice) using the predetermined algorithm.
[0072] Furthermore, in another embodiment of the invention, during the noise reduction process using the acquired filter gain, the server (100) may take into account pre-stored noise profiles corresponding to various vehicle models and driving states, recorded prior to implementation of the invention.
[0073] In this case, the server (100) may store four driving statesP (Park), D (Drive), R (Reverse), and N (Neutral)classified based on the vehicle's transmission gear, along with predefined vehicle speeds and associated noises for each state and vehicle model. During filtering, the server (100) may apply the pre-stored noise data immediately after audio collection, performing a scaling operation (adjusting the amplitude without altering the frequency characteristics) and then removing such noise from the collected audio as a first step.
[0074] For example, the server (100) may store, in its database, the noise patterns and noise levels corresponding to a 2020 Avante XD model vehicle when the gear is in reverse (R) and the driving speed is between 10 km/h and 20 km/h. When the infotainment system (200) of the vehicle connects with the user terminal (300), and the current driving condition of the vehicle matches the aforementioned scenario (gear R and speed between 10 km/h and 20 km/h), the server (100) may scale the corresponding noise pattern using a predetermined algorithm and remove it from the collected audio information, thereby prioritizing the removal of noise generated during vehicle operation.
[0075] Through the above process, for the audio identified as pet vocalizations, the server (100) refers to a predetermined pet emotional state table to determine the emotional state of the pet.
[0076] Referring to
[0077] According to an embodiment of the present invention, the pet emotional state table may include a plurality of pet states such as hunger, fear, aggressive posture, defensive posture, playfulness, yearning, physical satisfaction, emotional satisfaction, request for help, boredom, pain, and lethargy. Each state may be associated with a corresponding command signal (code) stored in the table.
[0078] In this case, the command signal may include identification and operation information related to a control target in the vehicle. The server (100) may use the command signal to control at least one of the audio output unit (220), temperature control unit (230), windows, sunroof, or feeding unit (240) by sending the command to the user terminal (300).
[0079] Referring to
[0080] The pet mode providing system may also include the vehicle's infotainment system (200), where the user terminal (300) transmits the command signal received from the server (100) to the infotainment system (200), and the infotainment system (200) controls the vehicle accordingly.
[0081] Among the components being controlled, the audio output unit (220) may output the pet owner's voice corresponding to the emotional state of the pet, which has been pre-stored in the server (100).
[0082] For example, if the server (100) determines that the emotional state of the pet is fear, the server (100) may transmit the pet owner's voice corresponding to that emotional state (e.g., a soothing voice such as It's okay) through the speaker of the vehicle's infotainment system (200) or the user terminal (300).
[0083] According to an additional embodiment of the present invention, the voice corresponding to each emotional state may be recorded by the user (i.e., the pet owner) via the recording function of the user terminal (300) prior to use, and transmitted to and stored in the server (100). Furthermore, after initial use, the voice may be updated via the user terminal (300).
[0084] Next, the temperature control unit (230) may adjust the air conditioning temperature according to the air conditioner command signal corresponding to the pet's emotional state stored in the server (100). If the windows and sunroof are already partially open for ventilation, the air conditioner may also be activated to accelerate the ventilation process, enabling faster air circulation.
[0085] The windows and sunroof are controlled to open or close according to the command signal, ensuring that neither the windows nor the sunroof are opened wider than the size of the pet's head, thus preventing the pet from escaping the vehicle during ventilation.
[0086] Additionally, two of the vehicle's multiple windows may be opened in a crosswise manner based on the centerline of the vehiclefor example, the driver's side front window and the opposite rear passenger-side window (left front and right rear in Korea).
[0087] This is because air pressure is lower at the top of the front window and relatively higher at the rear, making it most effective to open the driver's front and opposite rear passenger windows for ventilation.
[0088] Next, the feeding unit (240) may operate the feeder and water dispenser when the pet's emotional state is hunger or thirst, thereby alleviating the pet's hunger or thirst.
[0089] Information about the detected emotional state of the pet and the corresponding operation of each component may be provided to the user terminal (300) by at least one of the server (100) or the infotainment system (200).
[0090] In other words, the user may receive not only the pet's emotional state but also information about the type and time of the care actions provided in response to that state via the user terminal (300).
[0091] According to another embodiment of the present invention, the pet mode may be provided in three modescompanion mode, shared mode, and separation modebased on audio analysis. Referring to
[0092] In this case, stable driving may involve a recommendation to avoid sudden stops and rapid acceleration. For walks, the user terminal (300) may use GPS information to suggest nearby resting spots (such as rest areas or parks) within a preset distance.
[0093] On the other hand, the separation mode is provided when only the pet is present in the vehicle, and the guardian is absent. This mode may be useful when the guardian needs to briefly enter a building or store that does not allow pets.
[0094] Although leaving a pet alone in a vehicle for an extended period is discouraged, in unavoidable cases as described above, if the system detects emotional states such as alertness, loneliness, or anxiety, and determines that the pet is in an alert state, the server (100) may collect images of the vehicle's surroundings through the black box or camera device of the vehicle via the infotainment system (200) and send an alert message to the user terminal (300) indicating that a stranger is approaching the vehicle.
[0095] Additionally, if the pet is in a state of loneliness or anxiety, the system may send a message to the user terminal (300) informing them of the pet's emotional condition.
[0096] The shared mode may be provided in both the companion and separation modes when the pet is judged to be in a state of needing to relieve itself, hunger, thirst, feeling hot, enjoyment, or happiness.
[0097] In this case, the system may control at least one of the audio output unit (220), temperature control unit (230), windows, sunroof, and feeding unit (240) to alleviate the pet's condition. The actions taken and the pet's emotional state information may be provided to the user terminal (300).
[0098] Referring to
[0099] First, the user terminal (300) and the vehicle's infotainment system (200) establish a communication connection (S101).
[0100] The pet audio collection unit (210) of the user terminal (300) collects audio information from inside the vehicle when a pet is present and transmits the collected audio information to the server (100) (S102).
[0101] The server (100) classifies the received audio information into pet sounds and other sounds according to a preset algorithm (S103).
[0102] Next, the server (100) determines the emotional state of the pet based on the classified pet sounds by referencing a preset pet emotional state table (S104).
[0103] Based on the pet's emotional state, the server (100) transmits a command signal to the user terminal (300) to control at least one of the vehicle's audio output unit (220), temperature control unit (230), windows, sunroof, and feeding unit (240), according to a preset algorithm (S105).
[0104] Next, the user terminal (300) transmits the command signal to the infotainment system (200), and the infotainment system (200) controls the vehicle (S106).
[0105] An embodiment of the present invention may also be implemented in the form of a computer-readable medium comprising computer-executable instructions such as program modules executed by a computer. A computer-readable medium may be any available medium that can be accessed by a computer and includes both volatile and non-volatile media, as well as removable and non-removable media. Furthermore, computer-readable media may include all forms of computer storage media. Computer storage media include all forms of volatile and non-volatile, removable and non-removable media implemented in any method or technology for the storage of information such as computer-readable instructions, data structures, program modules, or other data.
[0106] The method and system of the present invention have been described with reference to specific embodiments, but some or all components or operations thereof may be implemented using a computer system having a general-purpose hardware architecture.
[0107] The foregoing description of the present invention is for illustrative purposes only. Those skilled in the art to which the present invention pertains will understand that various other specific forms can be implemented without changing the technical spirit or essential features of the present invention. Therefore, the above-described embodiments should be understood as illustrative and not restrictive in any way. For example, components described as being in a single form may be implemented in a distributed manner, and likewise, components described as being distributed may be implemented in a combined form.
[0108] The scope of the present invention should be defined by the following claims rather than by the detailed description, and all modifications or variations derived from the meaning, scope, and equivalents of the claims should be interpreted as being included within the scope of the present invention.