SYSTEMS AND METHODS FOR CHILD PRESENCE DETECTION WITH DRIVER WARNING ALERTS AND BYPASS OPTION

Abstract

A passenger protection system for a vehicle includes a vehicle sensor control system having at least one processor and computerized memory storing vehicle control software therein, wherein the vehicle control software receives input data from a plurality of vehicle sensors. A digital control sequence is triggered in the software by a presence of at least one occupant other than a driver in the vehicle, with the digital control sequence activating and de-activating an alert system on a door of the vehicle. The alert system includes at least one of an audible alert and/or a visible alert and/or haptic alert on the door of the vehicle.

Claims

1. A passenger protection system for a vehicle, comprising: a vehicle control system comprising at least one processor and computerized memory storing vehicle control software therein, wherein the vehicle control software receives input data from a plurality of vehicle sensors; a digital control sequence triggered in the software by a presence of at least one occupant other than a driver in the vehicle, the digital control sequence activating and de-activating an alert system on a door of the vehicle, the alert system comprising at least one of an audible alert and/or a visible alert and/or a haptic alert on the door of the vehicle.

2. The passenger protection system of claim 1, wherein the digital control sequence activates the alert system in an order comprising the visible alert, followed by the haptic alert, followed by the audible alert.

3. The passenger protection system of claim 1, wherein the digital control sequence is in electronic communication with an occupant monitoring system comprising at least one sensor detecting the presence of the occupant other than the driver in the vehicle.

4. The passenger protection system of claim 3, wherein the sensor comprises at least one imaging device identifying the driver and the at least one occupant other than the driver.

5. The passenger protection system of claim 1, wherein the alert system on the door comprises a visible warning button triggered to alert the driver of other occupants in the vehicle prior to the driver exiting the vehicle.

6. The passenger protection system of claim 5, wherein the visible warning button comprises a bypass function triggered by a touch event by the driver.

7. The passenger protection system of claim 1, wherein the alert system comprises a haptic switch connected to the door of the vehicle in a position configured to be touched by the driver prior to exiting the vehicle.

8. (canceled)

9. The passenger protection system of claim 1, wherein the haptic switch comprises a manual bypass function triggered by a touch event by the driver.

10. The passenger protection system of claim 1, wherein the alert system comprises an audible warning function emanating from the door of the vehicle when the door is opened.

11. The passenger protection system of claim 10, wherein a speaker in the door provides the audible warning function.

12. (canceled)

13. The passenger protection system of claim 1, wherein the audible alert and/or the visible alert and/or the haptic alert are deactivated by at least one reset button.

14. (canceled)

15. A passenger protection system for a vehicle, comprising: a vehicle control system comprising at least one processor and computerized memory storing vehicle control software therein, wherein the vehicle control software receives input data from a plurality of vehicle sensors; an occupant monitoring system comprising a plurality of sensors configured to identify a presence of a driver and at least one other occupant in the vehicle, the occupant monitoring system further comprising additional sensors classifying the driver and the other occupant according to a passenger classification system stored in the software; a digital control sequence triggered in the software by a presence of the at least one occupant other than a driver in the vehicle, the digital control sequence activating and de-activating an alert system on at least one door of the vehicle, the alert system comprising at least one of an audible alert and/or a visible alert and/or haptic alert on the at least one door of the vehicle; wherein the additional sensors classifying the driver and the other occupant configure the software to utilize the digital control sequence on a selected door of the vehicle.

16. The passenger protection system of claim 15 wherein the additional sensors classify the driver and the other occupant according to weight or size.

17. The passenger protection system of claim 16, wherein the weight or size indicates a classification selected from a one year old child, a three year old child, a six year old child, a 5.sup.th percentile female, and a 50.sup.th percentile male.

18. The passenger protection system of claim 17, wherein the at least one of the audible alert and/or the visible alert and/or the haptic alert originate from at least one door of the vehicle operated by either the driver or another occupant classified as an adult.

19. The passenger protection system of claim 18, wherein the at least one of the audible alert and/or the visible alert and/or the haptic alert originate from a respective door operated by a last adult exiting the vehicle.

20. The passenger protection system of claim 15, wherein the additional sensors classifying the driver and the other occupant comprise at least one of an imaging device, a seat belt sensor, a size sensor and a weight sensor.

21. A computer implemented method of preventing trapped passengers in a vehicle, comprising; identifying a presence of a driver and at least one other occupant in the vehicle; activating an alert system on a door of the vehicle, the alert system comprising at least one of an audible alert and/or a visible alert and/or haptic alert on the door of the vehicle; tracking respective positions of the driver and the at least one other occupant in the vehicle; tracking vehicle operations; storing input data in computerized memory, the input data corresponding to the respective positions and vehicle operations; using a computer to determine that at least one of the driver and/or the occupant is exiting the vehicle; initiating a digital control sequence to provide the at least one of the audible alert and/or the visible alert and/or the haptic alert on at least one door of the vehicle prior to the exiting.

22. The computer implemented method of claim 21, further comprising initiating the digital control sequence in an order comprising the visible alert followed by the haptic alert followed by the audible alert, until at least one of the driver and/or the other occupant provide manual feedback acknowledging respective alerts.

23. The computer implemented method of claim 22, wherein in the absence of the manual feedback, the alert system provides audible warnings and/or visible warnings that are discernible from outside the vehicle.

24. (canceled)

Description

BRIEF DESCRIPTION OF THE DRAWINGS

[0023] These and other features, aspects, and advantages of the present invention will become apparent from the following description and the accompanying exemplary embodiments shown in the drawings, which are briefly described below.

[0024] FIG. 1 is a schematic environmental depiction of an interior of a vehicle in which the aspects of this disclosure may be implemented.

[0025] FIG. 2A is a cross section view of a capacitive occupant sensor for occupant detection as set forth herein with an occupant approaching the sensor.

[0026] FIG. 2B is a cross section view of a capacitive occupant sensor for occupant detection as set forth herein with the occupant in contact with the sensor.

[0027] FIG. 2C is a cross section view of a capacitive occupant sensor for occupant detection as set forth herein with the occupant changing the position of at least one portion of the sensor and causing a change in corresponding impedance for detection by a computer.

[0028] FIG. 3 is a schematic environmental depiction of an occupant monitoring system using imaging devices to detect physical aspects of occupants in a vehicle as set forth herein.

[0029] FIG. 4 is a schematic plot of input data received by a computer from classification sensors used to classify a vehicle occupant as set forth herein.

[0030] FIG. 5 is an overview schematic illustration of a vehicle sensor control system with an associated alert system as set forth herein.

[0031] FIG. 6 is a side view of a vehicle door configured with warning alert hardware as disclosed herein to prevent leaving a child occupant unattended in a vehicle.

[0032] FIG. 7 is a flow chart depicting the warning alert system of this disclosure.

DETAILED DESCRIPTION

[0033] The figures illustrate the exemplary embodiments in detail. However, it should be understood that the application is not limited to the details or methodology set forth in the description or illustrated in the figures. It should also be understood that the terminology is for the purpose of description only and should not be regarded as limiting.

[0034] A capacitive or electric field type sensor for use in an occupant classification system or occupant sensing system (for example, a system to detect occupancy of a vehicle seat) may be implemented in many ways. For example, according to one embodiment, an AC current may be provided to a sensing electrode located in a vehicle seat or other component, such as a steering wheel. The current or change in the current to the sensor may be measured and used as an indicator of the impedance from the sensing electrode to ground. In certain vehicle seat configurations, a seat heater may be provided.

[0035] In an occupant classification system, the occupant is classified using information from sensors that sense characteristics about the object located on a vehicle seat. Some systems sense the total weight on the seat. When a capacitive sensor is used to classify the occupant, the environment above the seat cover is sensed using various techniques to identify the dielectric and conductive properties of the occupant. A conductive sensing element is placed in the seat and, according to one embodiment, the impedance from the electrode to ground may be used as an indicator of the occupant situation above the seat cover.

[0036] The occupant detection and classification system is configured so that the environment below the seating surface does not influence the classification of the occupant. When a seat heater is provided, typically a resistive heater is employed. A resistive heater is essentially a grounded wire or conductor located in the vehicle seat. The sensing electrode for an occupant classification and detection system may be placed above the seat heater. If the orientation between the sensing electrode and the heater changes, the offset capacitance will change and the change may result in a negative impact on the ability of the system to accurately classify the occupant. For example, the detection system may be configured to include an offset for the measurement of an empty seat conduction. If the empty seat offset of the measurement drifts significantly (e.g., due to a change in orientation of the electrode and heater), the system may not accurately classify the occupant.

[0037] According to various exemplary embodiments, a sensing system for automotive occupant classification may use various conductors in the seat as sensing electrodes. For example, the sensing system may include a “sensor” conductor or assembly located proximate a “shield” conductor. These two conductors, often embodied in non-limiting examples as planar electrodes, are collectively referred to in this application as an “occupant classification sensor.” In the embodiments described herein, therefore, an “occupant classification sensor” has two components, namely the sensor portion and an accompanying shield. The “sensor” and “shield” designations for either electrode may be reversed in any given embodiment.

[0038] According to other exemplary embodiments, a sensing system may use multiple electrodes on opposite sides of a thick piece of foam or any other elastomeric spacer. The electrodes themselves may be, without limitation, copper plates of appropriate thickness, e.g., copper tape. Measurements may be made while the electrodes are in various configurations. According to still other exemplary embodiments, a sensing system may combine or integrate weight sensing concepts with capacitive sensing concepts into a single system. The integrated system may use weight pressure information along with capacitive information to identify the occupant situation and produce a preferred classification.

[0039] Each of the electrodes in the seat back and seat bottom may be incorporated into a sensor pad or any other support structure. The sensor pad may include a layered structure. The sensor pad and sensing electrode may be constructed in a variety of ways, and the method of construction is not considered limiting. For example, the sensor pad may be constructed using a rigid or a flexible circuit board using known printed circuit board techniques such as etching or deposition of conductive materials applied to a dielectric substrate. Alternately, the sensor pad may be the foam cushion or seat pad itself with a discrete conductor, such as a conductive film, sheet or mesh, as the sensing element As described above, the sensing electrode may function as the seat heating element so as to provide a comfortable seating environment for the occupant. If heating is included, a temperature sensor may be disposed near an output of the heating element, which may be used for controlling the temperature of the seat. The controller may include a temperature controller that incorporates a temperature measuring circuit which can receive measurements from the temperature sensor to determine the temperature of the sensor pad and a temperature generating circuit which may provide a signal to the heating element in order to control its operation so that a desired temperature of the seat can be maintained in a closed-loop process. The sensor pad may further include a shielding electrode for shielding the sensing electrode from interference from surrounding conductive components.

[0040] According to various exemplary embodiments, a sensing system may use electronic methods for making capacitive measurements (e.g., using high frequency current measurements or other methods). The sensor assembly materials may include any type of conductive material for the electrodes (e.g., copper, conductive inks, conductive fabrics, etc.) and any compressible material for the spacer between the sensor and the shield (e.g., non-woven felts, woven materials, foams, polymers, dielectrics, materials used to allow air flow for forced air climate control seats, or any other material that will significantly compress at pressures under 1 psi).

[0041] Referring to FIG. 1, a vehicle 10 is shown with an occupant 12 in a seat 14 of the vehicle 10, according to an exemplary embodiment. The seat 14 may include an occupant classification and detection system 16. As shown in FIG. 1, the occupant classification system 16 may generally be located in the seat 14 below the area in which an occupant 12 of the vehicle 10 sits, or may be located in other areas of the seat 14 or vehicle 10. FIG. 1 shows the sensor associated with a driver seat, but the sensor may be operable in any vehicle seat.

[0042] The occupant classification system 16 may generally include a sensor, a shield, and electronics for sensing and classifying the occupancy of the seat 14. For example, the sensor may be used to provide measurements that correspond to the effect of an object on the sensor due to both the conductivity and weight of the object. Measurements from the sensor may be evaluated to determine the existence of an object or occupant in the seat 14. The occupant classification system 16 may include or be configured to operate in conjunction with a seat heating system and/or other systems for the seat 14 of the vehicle 10.

[0043] The occupant classification system 16 includes a capacitive or electric field sensor that includes a sensing electrode as described below in regard to FIG. 2. The capacitive sensor may generally be capable of sensing properties such as a proximity, position, or weight of an object, or the like. Various measurements from the sensing electrode may be used to detect the presence of an object in the seat. For example, the system may measure the change in capacitance (e.g., changes in an electrical property between two conductive objects). As an occupant 12 sits on seat 14, the system may detect a capacitance change to determine the presence of the occupant 12 by the occupant classification system 16.

[0044] Other exemplary embodiment of a capacitive or electric field type occupant classification and detection system may be configured in various embodiments. One illustrative system includes an upper electrode and a lower electrode for sensing an occupant. The system further includes electronics (e.g., sensing and signal conditioning electronics) configured to provide current or signals to drive the electrodes and to provide measurements on the electrodes. The occupant classification and detection systems disclosed herein may include a controller, processor or electronic control unit (ECU) that controls the system and receives various measurements from the system components (e.g., the sensing electrodes). The controller is configured to interact with other vehicle systems such as, for example, vehicle safety systems (e.g., airbag and seat belt systems). The controller may provide a signal to a vehicle safety system that indicates whether an adult person is located in the vehicle seat so that safety devices may be activated if appropriate. The controller for the occupant classification system may be integrated with a controller for another vehicle system such as, for example, the controller used for a vehicle safety system.

[0045] Referring more particularly to FIG. 2, an occupant classification system is described that uses a sensor (e.g., a capacitive vehicle sensor 200) to detect seat occupancy and to detect a weight on the seat. The occupant classification system may generally include a sensor 202 and a shield 204 with a dielectric layer 208 there between. For one embodiment accomplishing occupant sensing, the sensor may be oriented above the shield to reduce the influence that objects located under the shield (e.g., a seat heater) have on sensor measurements. The classification system may include a weight or force sensing capability. When sensing the weight, the sensor and shield may switch orientations (e.g., via electronic switching) with the sensor oriented below the shield to reduce the influence objects placed on top of the seat (e.g., electronic devices) have on sensor measurements. The occupant sensing and weight or force sensing measurements may be used together to determine whether an object on the seat is a person and may reduce the false detection of objects as people. As shown in FIGS. 2A-2C, weight placed upon and/or removed from the sensor change the distance between the sensor plates 202, 204 and the measured capacitance of the dielectric layer 208.

[0046] FIG. 3 is another overview schematic of a vehicle according to this disclosure including another non-limiting example of an Occupant Monitoring System that can be used with an Occupant Classification tool as discussed herein. In FIG. 3, rows of seats (313A, 313B, 313C) are located within the vehicle interior (310), or vehicle cabin, of a vehicle. The vehicle of FIG. 3 incorporates a driver' seat (313A) adjacent a steering wheel (319) and a common driver's control panel (317) (possibly including a viewing screen). The vehicle control system is not shown separately but would be implemented within a computer bank that includes processors (328), memory (327), electronic circuits, and at least one sensor necessary to establish a safe driving environment in the vehicle interior (310). The computers (311) in the vehicle may communicate with occupant classification systems (321) used to determine the entry/exit location, anatomy, age, adult/child/infant status, and other quantitative/qualitative characteristics of each occupant in the vehicle. The vehicle of FIG. 3 would typically include standard equipment from original equipment manufacturers (OEMs) such as seat belt assemblies shown in more detail in other figures. The vehicle of FIG. 3, however, illustrates installation of cameras (312A, 312B, 312C) having respective light sources (316A, 316B, 316C) and positioned in the vehicle interior (310) to establish respective fields of view (325) of occupants, seats (313), seat belt assemblies, and other structures in the vehicle. In this non-limiting example, the cameras/image sensors (312) (also known as optical sensors (312)) have been installed on the ceiling (315) of the vehicle and atop the driver's control panel (317). The vehicle includes the associated circuitry to connect the cameras (312), working in conjunction with light sources (316) and associated arrays/sensors (hereinafter “image sensors” (314)), to a vehicle control system operating via a computer bank of computers (311).

[0047] The occupant classification system (“OCS”) (321 in FIG. 3) may include numerous kinds of hardware, position sensors, pressure sensors, weight sensors, and the like to identify a vehicle occupant so that a vehicle meets regulatory requirements. Many traits of an occupant are currently identified by an OCS to assist in controlling air bag deployment as well as other restraint systems, alerts, and operational control signals. In non-limiting embodiments of this disclosure, images gathered pursuant to the methods and systems herein may be used in conjunction with an OCS to identify proper seat belt placement for many different levels of human development (e.g., adult, child, infant) as well as anatomy structures (large male, average male or female, small female). Optimal seat belt placement for these diverse occupants will be significantly different for each. An OCS may receive data from the computerized imaging systems described herein to conduct edge analyses to detect occupant forms, 3-D depth analyses for torso position, and anatomical dimensioning for seat belt confirmation relative to the occupant's body. Single camera and multi-camera systems for both seat belt monitoring and occupant classification are well within the scope of this disclosure.

[0048] One goal of the embodiments disclosed herein is to establish combinations of data values that are conveniently combinable to improve the safety performance of vehicle systems and to provide a basis for the warning systems discussed below. In particular, the occupant classification system of this disclosure uses data from multiple occupant classification sensors (“OC sensors”), shown by way of non-limiting examples as OC sensors 521A, 521B, 521C in FIG. 5. Without limiting the disclosure, an OC sensor may be an electronic sensor, a weight sensor, a capacitive sensor, a light sensor, or an image sensor/camera as discussed above. Each of these OC sensors is configured to provide an output signal to a controller, or other microprocessor 501, via a respective sensing circuit 502 to assess a physical characteristic of an occupant in a vehicle seat or the lack of an occupant in the vehicle seat. The OC sensors may be strategically placed in the vehicle interior, steering wheel, vehicle seats, and other vehicle component constructions within previously identified zones to provide more than one output signal for comparison purposes, for statistical analysis, and to control other systems in the vehicle pursuant to safety regulations.

[0049] Overall, as noted above, placing multiple OC sensors in the vehicle provides opportunities to utilize the data provided by each OC sensor to define improved threshold boundaries for each classification necessary to identify the physical characteristics of an occupant in the seat. The occupant classification system set forth in this disclosure is particularly adapted to utilize threshold boundaries that have been absent from systems of the prior art. Notably, OC sensors may be utilized to establish threshold boundaries separating an empty or infant occupant of a vehicle seat from a 6 year old child in the seat, separating a 6 year old child classification from a 5.sup.th percentile weight adult female classification, and separating a 5.sup.th percentile weight adult female classification from a 50.sup.th percentile weight adult male classification. FIG. 4 illustrates one graphical embodiment of multiple sensors, at least sensor 1 and sensor 2, providing data that places the occupant into an occupant classification system.

[0050] In general, and without limiting the scope of the embodiments of this disclosure, the current standards for occupant classifications include a 5th percentile adult female classification, which includes occupants having a weight of between 85 to 120 pounds; occupant classifications for a 50.sup.th percentile male classification includes occupants having a weight of between 130 and 190 pounds. The system shown herein may also distinguish between a first child classification, which includes occupants having a weight of less than 20 pounds, a second child classification, which includes occupants having a weight of between 20 and 40 pounds, and a third child classification, which includes occupants having a weight of between 40 and 60 pounds.

[0051] With one goal of the embodiments of this disclosure being to utilize higher resolution thresholds between occupant classifications, an occupant classification system may be configured to use pairs of occupant classification sensors 521A, 521B, 521C of FIG. 5 (again, the “OC sensors”) in numerous combinations to identify a vehicle occupant by a proper weight classification. Identifying the occupant with output from more than one OC sensor helps to minimize confusion between small adults and children and confusion between small adults and slightly larger adults whose weight lies between a 5.sup.th percentile female and 50.sup.th percentile male. The system is also better prepared to minimize any confusion between an occupant and conductive items on a vehicle seat (i.e., cell phones, computers, GPS accessories, and the like) that may change the electrical current response, such as capacitive or induction readings on a sensor in the vehicle seat.

[0052] Before using the occupant classification system in a vehicle, the threshold boundaries for the preferred occupant classifications are established with live test subjects and a plurality of output signals from numerous OC sensors. In the example shown in FIG. 4, and without limiting the embodiments to any one theory of operation, the test data for live subjects is plotted with an output signal value (or representative inductance value calculated for a respective OC sensor from the output signal) along respectively assigned x and y axes for each respective OC sensor output. The test data is calibrated so that each test occupant's known weight is associated with the coordinate system used to plot the test data (i.e., inductance values for each respective OC sensor along the x and y axes). By statistically analyzing the test data and the associated relations to threshold boundaries established by threshold data, the system described herein can use the threshold boundaries to calculate an occupant as fitting within a particular classification (infant or carrier seat, 6 year old child occupant versus 5.sup.th percentile weight adult female occupant (boundary 400), and larger female versus 50.sup.th percentile weight adult male (boundary 405)) may be established. In one non-limiting example, the threshold boundaries for each classification may be determined by midpoint or statistical mean analysis to plot the classification threshold boundaries in a classification system between the statistically significant test data points for various weights. The threshold boundaries may include tolerance levels, specified for any given application, to move the threshold boundary in one direction or another, thereby adjusting the occupant classification scope and resolution. Accordingly, the threshold boundaries are customizable for particular applications.

[0053] Upon customization of the threshold boundaries from live test data, as shown in FIGS. 4 and 5, the OC sensors 521A, 521B, 521C each provide output signals to the controller/microprocessor/CPU 501 that quantifies an electrical signal response present at that OC sensor in a respective zone of the vehicle seat. In the example of FIG. 5, each quantified electrical response can be plotted as a coordinate in a coordinate pair on the same coordinate system as the threshold boundaries as shown in FIG. 4. In this way, the system described herein is scalable in a way that other previously used occupant classification systems have not been.

[0054] Using pairs of OC sensors in selected zones of a vehicle seat structure allows for weighting of the zoned output signals emanating from each OC sensor in statistically significant ways determined empirically for particular applications. The output signals, bearing digitally recordable identification as emanating from one of the selected OC sensors in one of the selected zones, allows for not only higher resolution in occupant classification but also exponentially more combinations of data points to adjust other vehicle systems, particularly air bag deployment and seat belt signaling.

[0055] FIG. 4 illustrates just one coordinate system in which threshold boundary data 400, 405 may be compared against OC sensor data. This representation in FIG. 4 is merely an example for ease of explanation, and an occupant classification system may compare the data in computerized hardware without actually compiling an x and y axis plot. Statistical and data processing techniques may also be used to compile OC sensor data into multi-dimensional coordinate systems, multi-dimensional tables, computerized registers, and numerous other coordinate systems used to track and compare data points in a computerized system. Accordingly, it is well within the scope of the occupant classification system disclosed herein for computer hardware (processors, controllers, memory, graphics cards, and the like) to overlay data from many OC sensors and many pairs of OC sensors into one overall coordinate system to accomplish the objectives. The term “coordinate system,” therefore, is not limited to graphical coordinates but may be represented in any computerized form subject to statistical and data processing techniques.

[0056] As discussed above, the OC sensors and associated computer system may be represented in a sensor control system 500 of FIG. 5 to identify which occupants in a vehicle are adults (i.e., not children under a certain age) and which occupants are infants, toddlers, and children that are too young to exit a vehicle alone and should not be left unattended in a vehicle. Once the occupant classification is completed with a variety of sensor types, the controller/microcontroller/CPU 501 of FIG. 5 may use the occupant classification data to provide control signals to other systems including but not limited to a steering wheel lighting system (i.e., a “lightbar” 511), steering control and assisted driving algorithms 523a, a braking system 523b, and a warning system 523c discussed further in the below disclosure. The various systems receiving data and control information within the sensor control system 500 is not limited to those shown in FIG. 5 because the schematic representation of the control system therein is non-limiting and may include any other vehicle system that can be controlled from a computer in data communication with the vehicle components. The overall vehicle computer environment 522 may include not only the CPU 501, but other computerized components including but not limited to random access memory 509, read only memory 503, computer memory and storage 504, database and information storage structures 505, other input/output devices 506 and associated connections, as well as numerous computer interfaces 507 that interact with vehicle hardware.

[0057] This disclosure takes advantage of the numerous kinds of Occupant Monitoring Systems, Occupant Classification Systems, and Occupant Classification Sensors as described in the above discussion and the associated figures. With so many tools to discern which occupants are adults and which occupants are children at various stages of development, methods and systems of this disclosure are fully functional to realize new warning systems within the vehicle. In certain non-limiting embodiments, this disclosure is particularly directed to warnings that can prevent adults and older children from abandoning younger children, pets, or other living creatures in a vehicle.

[0058] One example embodiment utilizes the various sensor data received from at least one sensing circuit 502 of occupant classification sensors 521A, 521B, 521C, the number of which is entirely optional. As shown in FIG. 5, computerized embodiments herein utilize computer programs having computer instructions that implement warning algorithms based on information regarding the classification of each occupant and other control data received by the CPU 501, particularly other control data indicating that the driver or last remaining adult or older child is exiting the vehicle. This other control data may include indicators from numerous vehicle sensors indicating that the vehicle has stopped or parked, the ignition has been switched off, audio-visual accessories have been switched off, park brake engagement, or image data showing occupants exiting the vehicle. This other control data 519 may be transmitted to the CPU 501 from numerous interfaces 507 connected to vehicle control sensors that are part of an overall vehicle control and communication system. All of this information may be utilized to implement a warning system 523C, particularly a warning system to prevent abandoning a child who is unable to exit the vehicle themselves and should not be left unattended. As shown in FIG. 5, the warning system may include an audible warning signal 510A, a visible warning signal 510B, and a haptic warning signal 510C.

[0059] In one example embodiment, a passenger protection system for a vehicle includes a vehicle sensor control system 500 having at least one processor 501 and computerized memory 504 storing vehicle control software therein, wherein the vehicle control software receives input data 529A, 529B, 529C from a plurality of vehicle sensors 521A, 521B, 521C, which may include occupant classification sensors, image sensors, or other control sensors within the vehicle. Using this sensor input data, the processor (i.e., CPU, microprocessor, or controller) 501 identifies a presence of at least one occupant 12, such as a passenger other than a driver in the vehicle, and that identification triggers a digital control sequence implemented by the CPU 501 and/or other vehicle control computers that are active during vehicle use. In one embodiment, the digital control sequence functions to issue at least one warning signal from a computerized warning system 523C in data communication with the CPU 501. The at least one warning signal is activated in a way that is likely to be noticed by an occupant 12, such as the driver or other passenger occupants in the vehicle, to alert the occupant 12 that at least one other passenger occupant, such as a child that needs care, is in the vehicle 10 and should be attended before everyone else exits the vehicle. The digital control sequence activates and de-activates an alert system 518 within the vehicle 10 that is useful to prevent forgetting an occupant in the vehicle when that occupant cannot take care of themselves and/or cannot exit the vehicle themselves. The warnings may take on any form, placement, frequency, volume, intensity, or other characteristics, but in one non-limiting embodiment, the alert system 518 implements warning signals or alerts 510A, 510B, 510C on or near a door 600 of the vehicle 10 where an adult would exit. In some embodiments, the warning signals 510A, 510B, 510C emanate from a door 600 of the vehicle that would be used by a driver. The warning signals, however, may be activated from any position in the vehicle that is appropriate to alert any occupant exiting the vehicle that another dependent occupant is being left behind. In the embodiments of this disclosure, the alert system 518 includes at least one of an audible alert 510A and/or a visible alert 510B and/or a haptic alert 510C on or near the door 600 of the vehicle 10 because the door is often the object of a vehicle occupant's attention when exiting a vehicle. The audible alert may be any sound that is perceptible by a vehicle occupant and easily interpreted as requiring attention, such as, but not limited to, an automated voice attendant, a beeping sound, a siren sound, or any other audible input to the vehicle occupants. The visible alert may include any number of lighting arrangements that are positioned and colored to catch attention of occupants before exiting the vehicle. A haptic alert may be any signal that can be perceived by touch, such as vibrations, to provide an indicator that an occupant is possibly being left in the vehicle by accident. The digital control sequence, implemented by computerized instructions in software, may activate the alert system 518 and associated warning signals or alerts 510A, 510B, 510C in any order, i.e., simultaneously, sequentially, and in any combination. In one non-limiting example, the order of alerts may increment as time passes or upon the sensor control system 500 utilizing input data 529 to determine that events within the vehicle are progressing toward an occupant such as the driver leaving the vehicle with a child therein. The input data may originate from numerous sensors and images described above and may further include door sensors indicating that the door is opened and the driver is moving out of the driver seat in the vehicle. In one example, an alert sequence may include the visible alert 510B, followed by the haptic alert 510C, followed by the audible alert 510A.

[0060] Example embodiments are illustrated for example in FIG. 6 and may utilize audible alerts 650 emanating from a vehicle speaker 620 that is also connected to audio-visual accessories in the vehicle 10. The speaker 620 may include a computerized voice attendant that speaks commands and verbal warnings such as “occupants remain” upon certain triggering input data 529. The input data in one example triggers the audible alert 650 if a warning is activated because the driver door 600 has been opened. In some embodiments, the alert system 518 provides a respective button 652, 656, 657 for a user to acknowledge each warning which may cause the corresponding alert, whether audible, visible or haptic, to stop or revert to a different status. The same or a similar button may include functionality to implement a bypass function triggered by a touch event by the driver, such as holding the respective button for a predetermined period of time, to temporarily halt warnings. The halt in warnings could be useful in situations when a driver and/or other adults in a vehicle are temporarily exiting a vehicle to do short term activities outside the vehicle like pump gas, retrieve items from the vehicle trunk, or quickly stop at a store or rest area.

[0061] The vehicle sensor control system 500 uses computerized components to implement the digital control sequence that activates the alert system 518. The alert system 518 uses the digital control sequence to activate monitoring and alerting vehicle occupants in a passenger protection system as described herein. To accomplish the alerts, an overall passenger protection system illustrated generally at FIG. 5 is in electronic communication with an occupant monitoring system (the above noted OMS) and/or an occupant classification system (OCS) having at least one occupant classification (OC) sensor detecting the presence of the occupant other than the driver or other adults in the vehicle. The occupant monitoring system includes at least one imaging device 312 and light sources 316 identifying the driver and the at least one occupant other than the driver. The OC sensor may include any of a weight sensor, capacitive sensor 200, or any other tracking device by which the CPU of the sensor control system can be activated by the presence of adults and children in the vehicle.

[0062] As illustrated by the digital control sequence 700 of FIG. 7, in one non-limiting embodiment, the alert system 518 includes a visible warning function 705 that may be associated with a visible warning button 656, a haptic warning function 715 associated with a haptic switch button 657, and/or an audible warning function 725 emanating from a speaker 620 in the vehicle when the door is opened or another triggering event. The audible warning function 725 may be associated with an audible warning button 652 as shown in FIG. 6. The visible warning button 656, the audible warning button 652, and the haptic switch button 657 may be placed in any appropriate location to provide the best alerting function in a given vehicle. In the example of FIG. 6, the visible warning button 656 may be positioned proximately to a bank of window switches 632; the audible warning button 652 is positioned proximately to a vehicle speaker 620, optionally the speaker in a door 600, and the haptic switch button 657 is positioned in a place that a user is likely to touch before exiting a vehicle, such as the door handle 602 of FIG. 6. All of these functions can also be completely turned off by a manual reset button that may be visible in a driver's console. The buttons of this disclosure may be mechanical or MEMS types of digital buttons.

[0063] In another embodiment, a passenger protection system for a vehicle includes a vehicle sensor control system 500 in data communication with at least one processor 501 and computerized memory/computerized storage 504 for storing vehicle control software therein, wherein the vehicle control software receives input data 529 from a plurality of vehicle sensors 521. An occupant monitoring system 599 is also connected to and in data communication with the plurality of sensors 521 configured to identify a presence of a driver and at least one other occupant in the vehicle, the occupant monitoring system 599 further having additional sensors 595 classifying the driver and the other occupant according to a passenger classification system stored in the software. A digital control sequence may be triggered in the software by a presence of the at least one occupant other than a driver in the vehicle, the digital control sequence activating and de-activating an alert system 518 within the vehicle. The alert system may include at least one of an audible alert 510A and/or a visible alert 510B and/or a haptic alert 510C. These alerts may be associated with corresponding hardware positioned on or in proximity to the at least one door 600 of the vehicle. Additional sensors, whether OC sensors or OMS sensors, classifying the driver and the other occupant, configure the software to utilize the digital control sequence 700 when a child is present in the vehicle, and that child is likely not able to care for themselves, cannot exit the vehicle by themselves, and should not be left unattended in a vehicle after all other occupants leave. As noted above, the additional sensors may include image sensors and other occupant classification sensors that classify the driver and the other occupant according to weight or size. The additional sensors and associated input data classifying the driver and the other occupant may be at least one of an imaging device, a seat belt sensor, a size sensor, a weight sensor, a capacitive sensor, and the like.

[0064] In other embodiments, the sensors 521 and additional sensors 595 may provide input data 529 related to a child occupant positioned on in an infant seat, a child car seat, or a toddler booster seat, as discussed in the above disclosure. In non-limiting embodiments, the weight or size indicates a classification selected from a one year old child, a three year old child, a six year old child, a 5th percentile female, and a 50th percentile male such as shown in FIG. 4.

[0065] This example embodiment may utilize any of the features discussed above, and at least one of the audible alert signal 510A and/or the visible alert signal 510B and/or the haptic alert signal 510C may originate from at least one door 600 of the vehicle operated by either the driver or another occupant classified as an adult, particularly when the adult is exiting the vehicle. The adult exiting the vehicle may be a vehicle driver or any other adult or independent child of an age to exit the vehicle last, possibly leaving a smaller child in the vehicle accidentally.

[0066] FIG. 7 illustrates how a digital control sequence 700 may be used in a computer implemented method of preventing trapped passengers in the vehicle by first identifying a presence of a driver and at least one other occupant in the vehicle. When the at least one other occupant is a child that should not be left unattended in the vehicle, instructions in software implemented by a computer and processor 501 in the vehicle activate an alert system 518 on at least a door 600 of the vehicle. The alert system 518 may be at least one of an audible alert and/or a visible alert and/or a haptic alert on the door of the vehicle. Other positions for the alerts are also within the scope of this disclosure (i.e., using the vehicle horn or lights or sending remote alerts to a user's mobile device or cell phone). The method includes tracking respective positions of the driver and the at least one other occupant in the vehicle, such as by using image data to monitor occupant positions in the vehicle and possibly tracking vehicle operations with corresponding sensors 521, 599. All of the input data may be received by at least one processor 501 in the vehicle, stored in computerized memory, and used to populate instructions in control software. A computer uses the input data to determine that at least one of the driver and/or the occupant is exiting the vehicle and initiates the digital control sequence 700 to provide the at least one of the audible alert and/or the visible alert and/or the haptic alert on at least one door of the vehicle prior to the exiting. In one non-limiting embodiment, the digital control sequence activates the alerts in an order such that the visible alert is followed by the haptic alert followed by the audible alert, until at least one of the driver and/or the other occupant provide manual feedback acknowledging respective alerts. In one example, in the absence of the manual feedback, the alert system provides audible warnings and/or visible warnings that are discernible from outside the vehicle. The acoustic warnings and/or visible warnings originate from at least one of a vehicle horn, vehicle headlights, or even a user's cell phone.

[0067] For purposes of this disclosure, the term “coupled” means the joining of two components (electrical, mechanical, or magnetic) directly or indirectly to one another. Such joining may be stationary in nature or movable in nature. Such joining may be achieved with the two components (electrical or mechanical) and any additional intermediate members being integrally defined as a single unitary body with one another or with the two components or the two components and any additional member being attached to one another. Such joining may be permanent in nature or alternatively may be removable or releasable in nature

[0068] The present disclosure has been described with reference to example embodiments, however persons skilled in the art will recognize that changes may be made in form and detail without departing from the spirit and scope of the claimed subject matter. For example, although different example embodiments may have been described as including one or more features providing one or more benefits, it is contemplated that the described features may be interchanged with one another or alternatively be combined with one another in the described example embodiments or in other alternative embodiments. Because the technology of the present disclosure is relatively complex, not all changes in the technology are foreseeable. The present disclosure described with reference to the example embodiments and set forth in the following claims is manifestly intended to be as broad as possible. For example, unless specifically otherwise noted, the claims reciting a single particular element also encompass a plurality of such particular elements.

[0069] It is also important to note that the construction and arrangement of the elements of the system as shown in the preferred and other exemplary embodiments is illustrative only. Although only a certain number of embodiments have been described in detail in this disclosure, those skilled in the art who review this disclosure will readily appreciate that many modifications are possible (e.g., variations in sizes, dimensions, structures, shapes and proportions of the various elements, values of parameters, mounting arrangements, use of materials, colors, orientations, etc.) without materially departing from the novel teachings and advantages of the subject matter recited. For example, elements shown as integrally formed may be constructed of multiple parts or elements shown as multiple parts may be integrally formed, the operation of the assemblies may be reversed or otherwise varied, the length or width of the structures and/or members or connectors or other elements of the system may be varied, the nature or number of adjustment or attachment positions provided between the elements may be varied. It should be noted that the elements and/or assemblies of the system may be constructed from any of a wide variety of materials that provide sufficient strength or durability.

[0070] Accordingly, all such modifications are intended to be included within the scope of the present disclosure. Other substitutions, modifications, changes and omissions may be made in the design, operating conditions and arrangement of the preferred and other exemplary embodiments without departing from the spirit of the present subject matter.

[0071] In example implementations, at least some portions of the activities may be implemented in software provisioned on a networking device. In some embodiments, one or more of these features may be implemented in computer hardware, provided external to these elements, or consolidated in any appropriate manner to achieve the intended functionality. The various network elements may include software (or reciprocating software) that can coordinate image development across domains such as time, amplitude, depths, and various classification measures that detect movement across frames of image data and further detect particular objects in the field of view in order to achieve the operations as outlined herein. In still other embodiments, these elements may include any suitable algorithms, hardware, software, components, modules, interfaces, or objects that facilitate the operations thereof.

[0072] Furthermore, computer systems described and shown herein (and/or their associated structures) may also include suitable interfaces for receiving, transmitting, and/or otherwise communicating data or information in a network environment. Additionally, some of the processors and memory elements associated with the various nodes may be removed, or otherwise consolidated such that single processor and a single memory element are responsible for certain activities. In a general sense, the arrangements depicted in the Figures may be more logical in their representations, whereas a physical architecture may include various permutations, combinations, and/or hybrids of these elements. It is imperative to note that countless possible design configurations can be used to achieve the operational objectives outlined here. Accordingly, the associated infrastructure has a myriad of substitute arrangements, design choices, device possibilities, hardware configurations, software implementations, equipment options, etc.

[0073] In some of example embodiments, one or more memory elements (e.g., memory can store data used for the operations described herein. This includes the memory being able to store instructions (e.g., software, logic, code, etc.) in non-transitory media, such that the instructions are executed to carry out the activities described in this Specification. A processor can execute any type of computer readable instructions associated with the data to achieve the operations detailed herein in this Specification. In one example, processors (e.g., processor) could transform an element or an article (e.g., data) from one state or thing to another state or thing. In another example, the activities outlined herein may be implemented with fixed logic or programmable logic (e.g., software/computer instructions executed by a processor) and the elements identified herein could be some type of a programmable processor, programmable digital logic (e.g., a field programmable gate array (FPGA), an erasable programmable read only memory (EPROM), an electrically erasable programmable read only memory (EEPROM)), an ASIC that includes digital logic, software, code, electronic instructions, flash memory, optical disks, CD-ROMs, DVD ROMs, magnetic or optical cards, other types of machine-readable mediums suitable for storing electronic instructions, or any suitable combination thereof.

[0074] These devices may further keep information in any suitable type of non-transitory storage medium (e.g., random access memory (RAM), read only memory (ROM), field programmable gate array (FPGA), erasable programmable read only memory (EPROM), electrically erasable programmable ROM (EEPROM), etc.), software, hardware, or in any other suitable component, device, element, or object where appropriate and based on particular needs. Any of the memory items discussed herein should be construed as being encompassed within the broad term ‘memory element.’ Similarly, any of the potential processing elements, modules, and machines described in this Specification should be construed as being encompassed within the broad term ‘processor.’