Bidirectional and expressive interaction in a hybrid smart watch
11656579 · 2023-05-23
Assignee
Inventors
Cpc classification
G04C17/0091
PHYSICS
G04B45/0061
PHYSICS
International classification
Abstract
Aspects of the disclosure provide a hybrid smartwatch that incorporates digital technology with an analog timepiece in a wristwatch form factor. A digital display layer of a non-emissive material is configured to present notices, data, content and other information. An analog display layer includes one or more hands of the timepiece, and overlies the digital display layer. The hands may be controlled by a processor through micro-stepper motors or other actuators. Physical motion of the hands provides expressivity, for instance via visual mechatronic effects. This may include buzzing, clapping, providing stylized visual features, hiding or minimizing information, and revealing information. The information presented on the digital display layer is presented concurrently with the hand movement, in a manner that complements the hand motion. This provides a rich, symbiotic dual-display layer arrangement that enhances the capabilities of the digital and analog display layers.
Claims
1. A hybrid smartwatch to provide mechanical expressivity to a user, the hybrid smartwatch comprising: a user interface subsystem including a digital graphical display and one or more physical watch hands; a mechanical movement control subsystem operatively coupled to the one or more physical watch hands, the mechanical movement control subsystem configured to adjust the one or more physical watch hands in one or both of clockwise and counterclockwise directions; and one or more processors operatively coupled to the digital graphical display and the mechanical movement control subsystem, the one or more processors being configured to: select a physics simulation to be presented using the one or more physical watch hands and an object displayed on the digital graphical display, wherein the physics simulation includes an interaction between the one or more physical watch hands and the object; determine a motion of the one or more physical watch hands in accordance with the physics simulation to implement the physics simulation; and instruct the mechanical movement control subsystem to move the one or more physical watch hands according to the determined motion simultaneously with motion of the object on the digital graphical display, wherein the determined motion of the one or more physical watch hands is a non-time based adjustment such that the determined motion of the one or more physical watch hands results in the interplay between the one or more physical watch hands and the object as part of the physics simulation such that the determined motion of the one or more physical watch hands is responsive to the motion of the object.
2. The hybrid smartwatch of claim 1, wherein the mechanical movement control subsystem is configured to adjust the one or more physical watch hands to provide the physics simulation by moving the one or more physical watch hands in selected directions by between 1-180°.
3. The hybrid smartwatch of claim 1, wherein the mechanical movement control subsystem includes a plurality of actuators, each actuator configured to rotate a given one of the physical watch hands.
4. The hybrid smartwatch of claim 3, wherein the digital graphical display comprises a non-emissive display.
5. The hybrid smartwatch of claim 1, wherein the one or more processors are configured to select the physics simulation based on one or more identified items of information to be provided to the user.
6. A hybrid smartwatch to provide mechanical expressivity to a user, the hybrid smartwatch comprising: a user interface subsystem including a digital graphical display and one or more physical watch hands; a mechanical movement control subsystem operatively coupled to the one or more physical watch hands, the mechanical movement control subsystem configured to adjust the one or more physical watch hands in one or both of clockwise and counterclockwise directions; and one or more processors operatively coupled to the digital graphical display and the mechanical movement control subsystem, the one or more processors being configured to: select a physics simulation to be presented using the one or more physical watch hands and an object displayed on the digital graphical display, wherein the physics simulation includes an interaction between the one or more physical watch hands and the object; determine a motion of the one or more physical watch hands in accordance with the physics simulation to implement the physics simulation; and instruct the mechanical movement control subsystem to move the one or more physical watch hands according to the determined motion contemporaneously with movement of the object on the digital graphical display, wherein the determined motion of the one or more physical watch hands is a non-time based adjustment such that the determined motion of the one or more physical watch hands results in the interplay between the one or more physical watch hands and the object as part of the physics simulation such that the determined motion of the one or more physical watch hands is responsive to the movement of the object.
7. The hybrid smartwatch of claim 6, wherein the mechanical movement control subsystem is configured to move the one or more of the physical watch hands to provide the physics simulation by moving the one or more physical watch hands in selected directions by between 1-180°.
8. The hybrid smartwatch of claim 6, wherein the mechanical movement control subsystem includes a plurality of actuators, each actuator configured to rotate a given one of the physical watch hands.
9. The hybrid smartwatch of claim 8, wherein the digital graphical display comprises a non-emissive display.
10. The hybrid smartwatch of claim 6, wherein the one or more processors are configured to select the physics simulation based on one or more identified items of information to be provided to the user.
11. The hybrid smartwatch of claim 6, wherein: with the determined motion, the interplay of the one or more physical watch hands with the selected includes the object moving simultaneously with the motion of one of one or more physical watch hands, or with the determined motion, the interplay of the one or more physical watch hands with the selected includes moving one of the one or more physical watch hands simultaneously with the selected object.
12. A method of providing mechanical expressivity to a user with a hybrid smartwatch, the hybrid smartwatch including a digital graphical display and physical watch hands arranged along a face of the hybrid smartwatch, the method comprising: selecting, by one or more processors, a physics simulation to be presented to a user using the physical watch hands, wherein the physics simulation includes an interaction between one or more of the physical watch hands and an object displayed on the digital graphical display; determining, by the one or more processors in accordance to the selected physics simulation, a motion of the one or more of the physical watch hands to implement the physics simulation; and instructing, by the one or more processors, a mechanical movement control subsystem of the hybrid smartwatch to move the physical watch hands according to the determined motion contemporaneously with movement of the object, wherein the determined motion of the one or more of the physical watch hands is a non-time based adjustment such that the determined motion of the one or more physical watch hands results in the interplay between the one or more of the physical watch hands and the object as part of the physics simulation such that the determined motion of the one or more of the physical watch hands is responsive to the movement of the object.
13. The method of claim 12, wherein the physics simulation is based on one or more identified items of information to be provided to the user.
14. The method of claim 12, further comprising moving the object simultaneously with the determined motion of the one or more of the physical watch hands.
15. The method of claim 12, further comprising moving the one or more of the physical watch hands simultaneously with the object.
16. The method of claim 12, wherein the mechanical movement control subsystem is configured to move the one or more of the physical watch hands to provide the physics simulation by moving the one or more of the physical watch hands in selected directions by between 1-180°.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1)
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11)
DETAILED DESCRIPTION
Overview
(12) The analog and digital display elements in a hybrid smartwatch as discussed herein provide a rich graphical interface in a wearable form factor. Programmable materials are utilized in conjunction with electromechanical control of the watch hands. The programmable materials may include electronic ink (E-ink) pigments or other non-emissive arrangements that are capable of displaying dynamic patterns. A mechanical movement control manages positioning of the watch hands. For instance, micro-stepper motors provide control, positioning and mechanical expressivity via resulting hand movement. While these servo-controlled hands are overlaid on a graphical display, the system coordinates the analog and digital displays to share responsibilities for the user interface.
Example System
(13) As shown in
(14) The memory 114 stores information accessible by the one or more processors 112, including instructions 116 and data 118 that may be executed or otherwise used by each processor 112. The memory 114 may be, e.g., a solid state memory or other type of non-transitory memory capable of storing information accessible by the processor(s), including write-capable and/or read-only memories.
(15) The instructions 116 may be any set of instructions to be executed directly (such as machine code) or indirectly (such as scripts) by the processor. For example, the instructions may be stored as computing device code on the computing device-readable medium. In that regard, the terms “instructions” and “programs” may be used interchangeably herein. The instructions may be stored in object code format for direct processing by the processor, or in any other computing device language including scripts or collections of independent source code modules that are interpreted on demand or compiled in advance. Functions, methods and routines of the instructions are explained in detail below.
(16) The data 118 may be retrieved, stored or modified by processor 112 in accordance with the instructions 116. As an example, data 118 of memory 114 may store predefined scenarios. A given scenario may identify a set of scenario requirements including visual effect types, content to be presented and pre-defined interactions between the watch hands and the graphical display. For instance, particular movements of the watch hands in combination with selected notification types may be included in the predefined scenarios.
(17) User interface 120 includes various I/O elements. For instance, one or more user inputs 122 such as mechanical actuators 124 and/or soft actuators 126 are provided. The mechanical actuators 124 may include a crown, buttons, switches and other components. The soft actuators 126 may be incorporated into a touchscreen cover, e.g., a resistive or capacitive touch screen.
(18) As noted above, one aspect of the technology is the use of analog watch elements enhanced with digital capabilities and connectivity. Thus, both a digital graphical display 128 and a mechanical movement (analog display) 130 are provided in the user interface 120 of the hybrid watch 100. The graphical display 128 may be an E-ink or other type of electrophoretic display. Alternatively, other non-emissive arrangements or even emissive displays may be employed. The mechanical movement 130 includes hour and minute hands. A seconds hand and/or other hand indicators may also be employed.
(19) An example watch configuration 200 with such a user interface 120 is shown in
(20) Returning to
(21) The user interface 120 may also include one or more speakers, transducers or other audio outputs 138. A haptic interface or other tactile feedback 140 is used to provide non-visual and non-audible information to the wearer. And one or more cameras 142 can be included on the housing, band or incorporated into the display.
(22) The hybrid smartwatch 100 also includes a position determination module 144, which may include a GPS chipset 146 or other positioning system components. Information from the accelerometer 134, gyroscope 136 and/or from data received or determined from remote devices (e.g., wireless base stations or wireless access points), can be employed by the position determination module 144 to calculate or otherwise estimate the physical location of the smartwatch 100.
(23) In order to obtain information from and send information to remote devices, the smartwatch 100 may include a communication subsystem 150 having a wireless network connection module 152, a wireless ad hoc connection module 154, and/or a wired connection module 156. While not shown, the communication subsystem 150 has a baseband section for processing data and a transceiver section for transmitting data to and receiving data from the remote devices. The transceiver may operate at RF frequencies via one or more antennae. The wireless network connection module 152 may be configured to support communication via cellular, LTE, 4G and other networked architectures. The wireless ad hoc connection module 154 may be configured to support Bluetooth®, Bluetooth LE, near field communications, and other non-networked wireless arrangements. And the wired connection 156 may include a USB, micro USB, USB type C or other connector, for example to receive data and/or power from a laptop, tablet, smartphone or other device.
(24)
(25) Returning to
(26)
(27) As noted above, the micro-stepper motors or other actuation mechanism(s) 412 are configured to provide control, positioning and mechanical expressivity via resulting hand movement, for instance by causing the one or more hands to rotate or otherwise adjust in a predetermined manner. The micro-stepper motors enable unidirectional or bidirectional rotation of the hands (clockwise and/or counterclockwise) through electrical pulses that may be controlled by the one or more processors 112 of
(28) According to one scenario, the electrical pulses have a pulse width on the order of 2 ms, for instance between about 1.75-2.25 ms. Here, the minute and hour hands may have one the order of 120 steps per revolution, although the number of steps for each hand may vary. In other examples, the pulse widths and steps per revolution may vary, e.g., by +/−10%, or more or less. In some scenarios, the steps are related to the application. For instance, time-related apps may have a 60 step resolution, while other apps may employ a higher (or lower) number of steps. And the pulse width may vary based on motor characteristics of the actuator(s). The timing and duration of the pulses and steps is controlled, for example, by the one or more processors 112 of
(29) The graphical display 404 includes, in this scenario, a non-emissive display. The non-emissive display is bi-stable, which does not require power to maintain the displayed information. The non-emissive display may be arranged as a circle or other shape depending on the overall appearance of the smartwatch. Nonetheless, the display includes a central opening adapted to receive the mechanical movement component 406 of
Example Scenarios
(30) The control and interplay of the pixels of the display and the positioning of the hands is performed cooperatively to create optimal user interfaces for different scenarios. For example, the user interfaces may be optimized according to predetermined criteria, which can vary with different interactions, applications and user preferences.
(31) Aspects of the technology employ physical motion of the watch hands as a means for expressivity. Here, the hands may be used for visual mechatronic effects as a complement or alternative to the information presented on the digital display. For instance, the hybrid smartwatch is able to attract the user's attention with motion of the hands when illumination or sound is inappropriate or insufficient. Various scenarios include buzzing, clapping, stylizing visual features, hiding or minimizing information, revealing information, and influence of display objects on physical hand and vice versa. These scenarios are described with reference to the drawings.
(32)
(33)
(34)
(35)
(36) Conversely,
(37)
(38)
(39) In contrast,
(40) The examples of
(41)
(42) At block 1106, the processors determine whether to concurrently present visual information on the graphical display along with the adjustment of the one or more watch hands. Not every expressive visualization necessarily includes the presentation of corresponding visual information on the graphical display. At block 1108, the processors instruct or otherwise manage the mechanical movement control to adjust the hand(s), in accordance with the selected expressive visualization. This may include sending control signals to the mechanical movement subsystem or electrical pulses directly to micro-stepper motors to achieve the intended hand motion.
(43) At block 1110, when it is determined that visual information will also be presented on the graphical display, the one or more processors cause the graphical display to generate the graphical element(s) thereon. This is done in conjunction with the expressive visualization of the hand adjustment. According to one aspect, the visual information of the graphical element(s) is synced with the mechanical adjustment of the hand(s), such as shown in
(44) It should be understood that these operations do not have to be performed in the precise order described. Rather, various steps can be handled in a different order or simultaneously, and steps may also be added or omitted.
(45) Depending on the specific arrangement, an emissive display, such as an OLED screen, may be employed instead of a non-emissive display.
(46) Unless otherwise stated, the foregoing alternative examples are not mutually exclusive, but may be implemented in various combinations to achieve unique advantages. As these and other variations and combinations of the features discussed above can be utilized without departing from the subject matter defined by the claims, the foregoing description of the embodiments should be taken by way of illustration rather than by way of limitation of the subject matter defined by the claims. In addition, the provision of the examples described herein, as well as clauses phrased as “such as,” “including” and the like, should not be interpreted as limiting the subject matter of the claims to the specific examples; rather, the examples are intended to illustrate only one of many possible embodiments. Further, the same reference numbers in different drawings can identify the same or similar elements.