Display and interaction method in a user interface
11216157 · 2022-01-04
Assignee
Inventors
Cpc classification
International classification
G09G5/00
PHYSICS
G06F3/0481
PHYSICS
Abstract
A display and interaction method in a user interface is provided. A display region is provided on the user interface for displaying a plurality of interactive items on a track. The track extends along a path created between an outer elliptical border and an inner elliptical border. The inner border lies within the outer border and a center of the inner border is offset from a center of the outer border. A plurality of elliptical frames are provided along the track, and each frame is in contact with the inner border, outer border, and its adjacent frames. An interactive item is displayed in some of the elliptical frames, and user input may move the frames along the track. The frames change in size as they move along the track.
Claims
1. A display and interaction method in a user interface of an electronic device including the steps of: providing, at the electronic device, a display region of the user interface for displaying a plurality of interactive items on a track, the track extending along a path created between an elliptical outer border and an elliptical inner border, with the inner border lying within the outer border and with a center of the inner border offset from a center of the outer border; displaying one or more interactive items along the track at the electronic device; and in response to receiving a predetermined user input at the electronic device, moving the plurality of interactive items along the track, with the plurality of interactive items changing in size based on their position along the track whilst moving, wherein a plurality of frames are provided along the track, wherein each of the one or more interactive items are based on one of the frames, a frame displaying only a part of an interactive item, the plurality of frames changing in size based on their position along the track, and wherein an interactive item changes in size corresponding to a change in size of its frame, and wherein an increase in size of the frame allows for the interactive item to be more visible by displaying or revealing more parts or aspects of the interactive item.
2. The display and interaction method as claimed in claim 1 wherein each frame is in contact with the outer border and the inner border, with the plurality of frames changing in size to remain in contact with the inner border and with the outer border whilst moving.
3. The display and interaction method as claimed in claim 1 wherein each frame is in contact with a first neighboring frame adjacent it and in a first direction along the track, and a second neighboring frame adjacent it and in an opposite, second direction along the track.
4. The display and interaction method as claimed in claim 1 wherein the interactive items are larger than the frames resulting in an overlap of the interactive items.
5. The display and interaction method as claimed in claim 1, wherein the frames are hidden from view on the user interface with the interactive items being visible and displayed on the display.
6. The display and interaction method as claimed in claim 1 wherein the track is elliptical, the frames are elliptical, and centers of the elliptical frames move along the track.
7. The display and interaction method as claimed in claim 1 wherein a frame only displays a part of an interactive item, with an increase in size of the frame allowing for visibility of more of the interactive item.
8. The display and interaction method as claimed in claim 1, wherein the track, the outer border and the inner border are hidden from view on the user interface while the interactive items are displayed.
9. The display and interaction method as claimed in claim 1 further comprising the step of: via a configuration interface at the electronic device, adjusting one or more of: a size of the outer border, an offset of the center of the inner border from the center of the outer border, a size of the inner border, a number of interactive items, an orientation of the track with respect to the display region, and any combination thereof.
10. The display and interaction method as claimed in claim 1, wherein a central region within the inner border is used as an information display space.
11. The display and interaction method as claimed in claim 10, wherein the information display space includes information relating to one of: a largest displayed interactive item, all of the interactive items, or a subset of the interactive items.
12. The display and interaction method as claimed in claim 1 wherein the outer border is defined by or lies adjacent to a boundary of a circular display of the electronic device.
13. The display and interaction method as claimed in claim 1 further comprising the step of, in response to receiving a selection input at the electronic device, selecting an interactive item.
14. The display and interaction method as claimed in claim 1 wherein the predetermined user input includes a mode of touch interaction in which the interactive items are moved along the track in response to a rotating touch input on a touch-sensitive display of the user interface or in response to a rotation flicking gesture on the touch-sensitive display in a desired rotation direction.
15. A display and interaction method in a user interface of an electronic device including the steps of: providing, at the electronic device, a display region of the user interface for displaying a plurality of interactive items on a track, the track extending along a path created between an elliptical outer border and an elliptical inner border, with the inner border lying within the outer border and with a center of the inner border offset from a center of the outer border; displaying one or more interactive items along the track at the electronic device; and in response to receiving a predetermined user input at the electronic device, moving the plurality of interactive items along the track, with the plurality of interactive items changing in size based on their position along the track whilst moving, and wherein the non-linear speed control is a one dimensional control having a center point from which touch movement in a first direction away from the center point causes accelerated rotation of the interactive items in a first direction along the track and touch movement in a second direction away from the center point causes an accelerated rotation of the interactive items in a second direction along the track.
16. A display and interaction method in a user interface of an electronic device including the steps of: providing, at the electronic device, a display region of the user interface for displaying a plurality of interactive items on a track, the track extending along a path created between an elliptical outer border and an elliptical inner border, with the inner border lying within the outer border and with a center of the inner border offset from a center of the outer border; displaying one or more interactive items along the track at the electronic device; and in response to receiving a predetermined user input at the electronic device, moving the plurality of interactive items along the track, with the plurality of interactive items changing in size based on their position along the track whilst moving, wherein the interactive items define hierarchy headings, with selection of a main hierarchy heading interactive item causing replacement of the interactive items on the display with sub-heading interactive items associated with the selected hierarchy heading interactive item.
17. A display and interaction method in a user interface of an electronic device including the steps of: providing, at the electronic device, a display region of the user interface for displaying a plurality of interactive items on a track, the track extending along a path created between an elliptical outer border and an elliptical inner border, with the inner border lying within the outer border and with a center of the inner border offset from a center of the outer border; displaying one or more interactive items along the track at the electronic device; and in response to receiving a predetermined user input at the electronic device, moving the plurality of interactive items along the track, with the plurality of interactive items changing in size based on their position along the track whilst moving, wherein moving the plurality of interactive items along the track includes moving the interactive items at an initial speed by means of a flick touch gesture, the movement simulating inertia by the interactive items gradually slowing down and coming to a stop if no further user interaction is received.
18. The display and interaction method as claimed in claim 1 wherein the interactive items are selected from a list comprising: multimedia items, emoticons, menu headings, social media posts, video previews, application icons, contact list items, phone numbers, and any combination thereof.
19. An electronic device having a user interface and comprising: a processor; a non-transitory memory having instructions encoded thereon that, when executed by the processor, cause the processor to: display a plurality of interactive items on a track on the user interface, the track extending along a path created between an elliptical outer border and an elliptical inner border, with the inner border lying within the outer border and with a center of the inner border offset from a center of the outer border; display one or more interactive items along the track; and receive user input and in response to receiving a predetermined user input, move the plurality of interactive items along the track, with the plurality of interactive items changing in size based on their position along the track whilst moving, wherein a plurality of frames are provided along the track, wherein each of the one or more interactive items are based on one of the frames, a frame displaying only a part of an interactive item, the plurality of frames changing in size based on their position along the track, and wherein an interactive item changes in size corresponding to a change in size of its frame, and wherein an increase in size of the frame allows for the interactive item to be more visible by displaying or revealing more parts or aspects of the interactive item.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1) In the drawings:
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11)
(12)
(13)
(14)
(15)
(16)
DETAILED DESCRIPTION WITH REFERENCE TO THE DRAWINGS
(17) Embodiments of the invention provide a user interface usable to display and navigate a plurality of interactive items. Logical components of a user interface (100) according to an embodiment of the invention are shown in
(18) The user interface (100) may be the user interface of any electronic device incorporating a display, such as a mobile phone, tablet computer, personal computer, television, in-vehicle control or infotainment system, wearable electronic device, smartwatch or the like. As will be apparent later in the description, the user interface is particularly suited for use with a circular display, especially a small circular display such as that of a smartwatch. However, the described user interface may also be used within a rectangular or square display such as a computer screen or television. It should be noted for the purposes of this description that a circle is a specific type of ellipse, with major and minor axes of a circle being of equal length, while a major and minor axis of an ellipse have different lengths.
(19) The user interface (100) may include a display component (110) for displaying a plurality of interactive items on a track. The interactive items may be, for example, multimedia items, emoticons, menu headings, social media posts, video previews, application icons, contact list items, and phone numbers or the like, which may be selected, opened or otherwise interacted with.
(20) As will become apparent from the description that follows, the track may extend along a path created between an outer elliptical border and an inner elliptical border. The inner border may lie within the outer border, with a center of the inner border offset from a center of the outer border. The interactive items may be based on frames within the track which may form a closed Steiner chain if the outer border, inner border and frames are circular.
(21) A Steiner chain of circles may be used to form the basis of the described display and control technique when the borders and frames are circular. Interactive items may be displayed based on the frames of a continuously rotatable asymmetric chain. Only two or three frames may be large enough at any given time for proper view and convenient touch selection. The user controls the chain's rotation rate and lets each frame roll smoothly through the point where it reaches its maximum size. A new item may replace an old one on the opposite side in the smallest frame. Selection may trigger an animation where the frame may grow and move to fill the display with its contents. This procedure can be iterated for next level selection or hierarchy navigation.
(22) A Steiner chain consists of a finite number of circles that are all tangent to two non-intersecting given circles. In addition, every circle in the chain also touches its two neighbors. In certain described embodiments, the frames take the form of the circles and provide a basis for the interactive items giving more flexibility to the display of interactive items based on the frames. For example, the interactive items may be within the frames. The radius ratio of an outer and inner circle is constrained by the number of circles in the chain. If this constraint is met, Steiner's porism guarantees that a closed chain can be constructed starting with any circle that touches them both. This in turn implies that a continuous rotation of the chain is possible.
(23) The display component (110) may include a moving component (112) for moving interactive items along the track when required. Throughout the specification, the term “moving” should be broadly interpreted, and shall include bringing moving items to a standstill, and increasing and/or decreasing the speed of moving items. To the extent created by the display refreshment rate of the electronic device display, the movement may be made to appear continuous and smooth to the user, rather than in discrete steps.
(24) The user interface (100) further includes a frame management component (120) for providing a plurality of frames along the track. The frames in embodiments of the invention are elliptical. Each frame is in contact with the outer border, inner border, and with a first neighboring frame in a first direction along the track thereto, and with a second neighboring frame along an opposite, second direction of the track.
(25) An interactive item management component (130) provides an interactive item based on at least some of the frames, and in some instances positioned within all of the frames. The frames may be visible, or may be located in the background so that it appears that the interactive items move on their own. However, interactive items will be based on elliptical frames as they will move with the frame, as further described below. The described interactive items are generally provided within the frames or congruent with the frames, and centered on the frames. However, the interactive items may be larger than the frames resulting in an overlap of the interactive items. The interactive items may be correspond to a shape of the frames but may be any alternative shape. The frames themselves may be hidden, with only the interactive items being visible and displayed on the display.
(26) In response to movement of the frames along the track, the frames are resized so as to remain in contact with the outer border, inner border and neighboring frames. To ensure this, a frame size adjustment component (122) of the frame management component (120) adjusts the size of the frames. Simultaneously, an interactive item size adjustment component (132) adjusts the size of the interactive items within the frames. The adjustment of the frame size and the interactive item size may be linked to automatically correspond so that they are adjusted in proportion to each other.
(27) In at least some embodiments, the interactive item management component (130) is configured to fade or make interactive items less visible in a specific location along the track. This is achieved via an interactive item visibility component (134).
(28) If the plurality of frames, inner boundary and outer boundary are all circular, they may form a Steiner chain.
(29) In at least some embodiments, a user may be able to adjust the size of the outer border, the offset of the inner border, the number of frames, selected interactive items appearing on the track, the orientation of the track with respect to the display, and/or the variation between the sizes of the frames. This may be done via a configuration component (150).
(30) Movement of the frames and the interactive items therein along the track is initiated by predetermined user input received via an input component (140). The input component (140) may include a bezel input component (141) and/or a touch-sensitive input component (142). The touch-sensitive input component (142) may include a first touch input component (143) and a second touch input component (144). The first touch input component (143) may provide functionality for providing a first mode of touch input in which a user may rotate the interactive items by touching the display in a rotating movement, or by flicking in a rotating direction further details of which are provided below. The second touch input component (144) may provide functionality for providing a second mode of touch input in which a user may rotate the interactive items by touching a slider scale controlling non-linear rotation speed further details of which are provided below.
(31)
(32) A plurality of frames are provided (204) along the track by the frame management component (120). As mentioned, these frames may be in the background and may not necessarily be displayed on the display. As also described above, each frame is in contact with the outer border, inner border, and with a first neighboring frame in a first direction along the track thereto, and with a second neighboring frame along an opposite, second direction of the track.
(33) An interactive item is provided (206) in at least some of the frames, possibly in all of the frames.
(34) User input is received (208) from the input component (140). In response to receipt of a predetermined input, the plurality of frames and the interactive items therein move (210) along the track. Movement is facilitated by the moving component (112). The direction and speed of movement depend on the input received.
(35) The frame size adjustment component (122) adjusts (212) the size of the frames, which may be done in the background so as not to be visible, so that they remain in contact with the borders and neighboring frames. The interactive item size adjustment component (132) adjusts (214) the size of interactive items in the frames, while the interactive item visibility component (134) adjusts (216) the visibility of certain interactive items.
(36) If further predetermined user input is received (208), movement may be influenced thereby. This may lead to further size and visibility adjustments to the frames and interactive items. When a selection input is received (218), an interactive item in a selected frame is selected.
(37) An exemplary implementation of a display and interaction method in a user interface is illustrated in
(38)
(39) A plurality of frames (312, 314, 316, 318, 320, 322) are provided along the track (304). Only some of these frames are numbered. Centers of the frames are located on the track (304). The frames are sized so that each frame is in contact with the outer border (306), the inner border (308), a neighboring frame located in a first direction along the track directly next to it, and a neighboring frame in a opposite, second direction along the track directly next to it. As an example, it can be seen that a current largest frame (320) is in contact with both a first neighboring frame (318) and a second neighboring frame (322). It is also in contact with the outer border (306) and the inner border (308). All other frames are similarly in contact with the borders and their neighboring frames. The frames form what is known as a closed Steiner chain.
(40)
(41) In the present embodiment, input may be provided to the smartwatch (300) via an operating bezel (324) provided at the periphery of the display (302) of the smartwatch (300). Movement of the interactive items may be initiated by turning the operating bezel (324), as will be described in further detail below. Input may additionally or alternatively be provided via touch-sensitive inputs. The following embodiments are described using the operating bezel (324) as the input component; however, it will be appreciated that this may be replaced or augmented by touch-sensitive user inputs as described below in relation to
(42)
(43) In this embodiment, the user interface is configured such that the interactive items in the largest three frames are selectable via the touch-sensitive display (302). Presently, the three largest frames (318, 320, 322) respectively include interactive items relating to a calendar application (332), a contacts list (334) and a messaging inbox (336). These interactive items may be selected by touching the touch-sensitive display on the frame with the desired interactive item.
(44) In order to select a different interactive item, for example an interactive item relating to a settings menu (328), the user will need to navigate to that interactive item so that it is selectable and falls within the three frames with selectable interactive items. To navigate the interactive items, a user may turn the operating bezel (324) of the smartwatch (300) to provide an input to the smartwatch, as can be seen in
(45) The user may rotate the operating bezel (324) in an opposite, counter-clockwise direction shown by a further directional arrow (342) in order to stop movement of the interactive items. This is shown in
(46) As explained above, the frames and interactive items are dynamically resized whilst they are moving along the track. The frames of the present embodiment are continuously resized whilst moving along the track so that they still form a Steiner chain together with the outer border and inner border. The interactive items are resized along with the frames in which they are located.
(47) The display and navigation method explained above may provide a more fluid navigation experience on a small round screen than if a selection indicator were moved between different interactive items. The use of a Steiner chain to resize frames and interactive items may allow for easier navigation through a list of items than if the items were all of a similar size. The above method may allow for the display of more items in a list, for easier navigation due to a user being able to see more interactive items without the need for a paging function, and may provide a more fluid navigation experience.
(48) It will be apparent to a person skilled in the art that many modifications may be made to the embodiment described above without departing from the scope of the invention. Interactive items may be selected in a number of ways. In some embodiments, only the interactive item in the largest frame on the display may be selectable, and selection anywhere on the touch-sensitive display will select that item. In such an embodiment, the largest frame may considered a “primary frame”, and selection anywhere on the display will select the interactive item in the primary frame. Alternatively, a selection button or the like may be employed to select an interactive item in a primary frame.
(49) In alternative embodiments, more than three interactive items may be selectable, for example five interactive items located in the five largest frames. In other embodiments, all of the interactive items may be selectable, and a user's ability to select an interactive item will depend on how accurately the user can select the smaller frames on the display. This may however not be practical on small displays. A stylus or similar interaction device may also assist with selection of interactive items.
(50) In some embodiments, more interactive items may be available than can be displayed on the display simultaneously. For example, there may be 60 items.
(51)
(52) A plurality of frames are provided along the track. Centers of the frames are located on the track. The frames are sized so that each frame is in contact with the outer border (406), the inner border (408), a neighboring frame located in a first direction along the track directly next to it, and a neighboring frame in an opposite, second direction along the track directly next to it. The frames of this embodiment again form a closed Steiner chain.
(53) In the present embodiment, interactive items in the form of photos are provided in the frames. Each frame contains a photo. The photos form part of an extensive list of photos, which contains too many photos to allow all of the photos in the list to be shown in the number of frames shown on the display. Only a subset of the list of interactive items are therefore shown on the display at any given time. Presently, numbers in the frames represent the photos forming part of the subset.
(54)
(55) The list of the present embodiment contains 250 items, ranging from photo IMG001 to photo IMG250. In order to navigate to a specific photo, the user will again need to turn an operating bezel (424) of the smartwatch. Navigating to an interactive item within the current subset may take place as was described with reference to
(56) The transition zone (450) is located at a position where a frame will have the smallest size it can be on the display, as can be more clearly seen in
(57) When the operating bezel (424) of the smartwatch (400) is moved counter-clockwise, the frames move in the same direction along the track (404), as indicated by the directional arrow (444). As the frame with photo number IMG072 moves into the transition zone (450), a frame with number IMG053 appears therefrom. The transition zone (450) remains blacked out, as shown in
(58) In
(59) It is also envisaged that frames may gradually become darker as they move towards the transition zone (450), and may gradually lighten as they move away therefrom. This may contribute to a fluid transition experience, as sudden “jumps” in interactive items within a frame may not be easily detected by a user.
(60)
(61) In the present example, in
(62) In
(63) It is envisaged that the transition zone may be blacked out, as in the embodiment described with reference to
(64)
(65)
(66)
(67) Direct manipulation of virtual items on a small touch-sensitive display may become problematic when a finger of user, used to interact with the interactive items, occludes a significant fraction of the screen. This typically happens in the case of a smartwatch with diameter on the order of 30 mm. The relatively small screen size also limits the number of items that can be visually distinguished and reliably selected by tapping. A rotating bezel keeps the user's fingers off the screen, and bezel movements can either be mapped to the position of the items or to the rate of rotation. Additionally or alternatively, gestures on the screen may be detected to initiate rotation, with kinetic behavior if desired. A minimal speed controller strip on the screen or elsewhere on the watch is a third possibility. Selection may be done as usual by tapping directly on the item or by pressing a button; the latter will select the item in the largest circle.
(68) It will be apparent to a person skilled in the art that various methods may be employed to receive user input from an electronic smartwatch. Instead of an operating bezel, an operating button, an operating switch, operating crown, or the like may be provided. In at least some embodiments may user input be received directly via the touch-sensitive display, with a user moving the frames and interactive items via touch movement on a display of the smartwatch. This may allow clutching or flicking of the frames to induce movement of the frames along the track. A combination of bezel operation and touch-sensitive display operation may also be used.
(69) A first mode of touch-sensitive display operation is described in the form of a touch and rotate operation. The first mode of touch interaction moves the frames along the track in response to a rotating touch input on the touch-sensitive display or a rotation flicking gesture on the touch-sensitive display in the desired rotation direction. The rotating touch input causes the frames to rotate at a constant speed or near constant speed with gradual deceleration. For a description of the first mode of touch interaction, an asymmetric Steiner chain display is used, and only two or three items are displayed large enough for proper view and convenient selection. The remaining items are typically much smaller or even out of sight. Despite this, all of the items may be quickly and easily rotated and scaled into a zone where interaction with the items is possible in a smooth and efficient way.
(70) The rotation of the frames around the track is controlled explicitly by a user touching the display and rotating their touching finger or pointer in a movement corresponding to the circle basis of the display. The user may rotate their finger or pointer in either direction and at a speed they wish, while scaling follows from the Steiner-related property of the chain. The user may stop the rotation when they wish and touch one of the interactive items to select it, usually one of the larger interactive items currently displayed.
(71) As an alternative in this first mode of touch interaction, the user may make a flicking touch gesture in a rotation direction in order to start the rotation of the frames in the display. The rotation may be stopped by touching the display and selecting an interactive item. The rotation may be at a constant speed or may have a slight deceleration in order to stop the rotation if no further touch is received.
(72) This first mode of touch interaction provides a one dimensional navigation control with continuous, simultaneous and coordinated moving and scaling of all frames. Emphasis is on user control of the motion rather than computer animation. There is also no need for clutching using this mode. Clutching is where repeated gestures or actions of input are required in order to keep scrolling. In this case there is no need for clutching as the frames continue to rotate at a constant or near constant rotation until the user again touches the display.
(73)
(74)
(75) If there is a constant number of interactive items in the display, for example if there are enough frames in the display to accommodate all the required interactive items, then the interactive items may rotate repeatedly around the track in a cyclical frame movement. If there are a greater number of interactive items compared to the number of frames in the display, then a transition zone may be provided at a point within the smallest frame in which an interactive item is replaced by a new interactive item. In this arrangement, the transition zone may result in a smooth transition and flow through a large number of items. There is no methodical limit to the number of interactive items which might be displayed.
(76) A second mode of touch-sensitive display operation is described in the form of a speed control option. This may be used as a stand-alone input mode or in combination with the first mode of touch interaction and/or the bezel input. In the second mode of touch interaction a touch input provides a non-linear speed control of the speed of rotation of the frames along the track. The second mode of touch interaction provides a one-dimensional speed control for the rotation of the frames around the track of the display. The one-dimensional speed control provides a center point with two opposing directions extending from the center point in a line or curve. The speed control may be provided in a distinct area of the touch-sensitive display such that it may be used in addition to other touch-sensitive control inputs.
(77) Movement of a user's touch along the line or curve away from the center point increases the speed of rotation of the frames in the display in a non-linear manner. This enables an accurate control of small differences at low speed, and high speed where it is possible to move very fast while retaining complete control. This provides kinetic control of continuously variable speed, in order to be intuitively usable on a touch-sensitive display device.
(78)
(79) The speed control may allow a user to stop quickly and completely, starting from any speed. The response to control may be perceived by a user as smooth throughout. Forward and backward speed control are mirror images. Unintentional jitter in finger position should not change the speed. The speed may continue unchanged when the touch contact is made or broken. Only relative touch movements may be used to control the speed. The speed of rotation is not proportional to the touch movement, and details of the non-linear function mapping touch movement are provided below.
(80) Once speed control has been initiated by touching down on the area of the speed control, the touch point may be moved outside it without losing control. The speed may be sustained after a lift, and not appreciably affected when touching down again. The kinetic speed control movement may be up and down the display or on an arc and one dimensional. It is envisaged that the center point may be variable, and may be allocated as a first position of touch on the display.
(81) Furthermore, it is envisaged that the second mode of operation may be suitable for individual use. This may be particularly useful to control a one-dimensional parameter in a non-linear manner, and may be particularly useful to control a parameter that may be visualized in a rotating manner. It will be apparent that touch-control need not be provided to allow use of the second mode of touch operation, but that a lever, such as a joystick, may be equally well employed to provide this mode of operation.
(82)
(83) The shifted equation of the positive part has the form:
v=cx.sup.2e.sup.dx
(84) where c and d are parameters that are adjusted for an example implementation.
(85) The operating system built-in measurement of the touch position returns a centroid of the touch area. When lifting the finger serving as pointer, this position may move unintentionally due to the deformation of the finger. A possible workaround may be to save all inputs and to reverse the last few speed changes once a pointer lift has been detected to eliminate such deformation influence. A similar argument may be made for pointer placement. While not preventing the user from clutching during navigation, speed control may eliminate the need for it. Speed control may be relatively easy to use and may enable both fine control at low speeds and long distance scrolling at high speed.
(86)
(87) It will be appreciated that the areas are not required to be equal and may be at different orientations within the display. The second mode of touch interaction may be provided to the right of the display for easy and quick interaction with a finger of a right hand when a smartwatch is on a left wrist and vice versa if a smartwatch is worn on a right wrist. An indication of the current mode of touch interaction in use may be provided in the form of an icon or visual indication on the display. The indication may also include an indication if the current user input mode is via a bezel input control.
(88) As an example implementation, an application may be provided which may be in the form of a web application or native application. Alternatively, the functionality may be provided as part of an operating system of a device. Example applications include an application launcher in which the interactive items are application icons, an emoticon or ideogram selector, an image browser, a contact selector, etc.
(89) An example of an application launcher may have a chain of 20 frames and an asymmetry that will allow direct interaction with 2 to 3 frames. The smallest frame almost vanishes in size, exactly at the point where it serves as both a sink and a source of items. The open area enclosed by the chain may be used to display the name of an application whose icon is currently in the largest circle. The chain rotation rate may be controlled in steps with the bezel or by touch-sensitive control using the first and/or second touch interactions described above. A tap on any icon may launch its associated app, and a tap in the enclosed area may launch the app currently in focus.
(90) When an app is launched, a brief animation may grow its icon to occupy the whole display, before switching to the first app display. On exiting the app, the full screen icon may reappear and the reverse animation returns the launcher to the state in which it was before the launch. These animations serve to preserve visual context for the user.
(91) It is envisaged that the present invention may be suitable for a selection of specific characters to be sent as part of a text message. If, for example, the interactive items are emoticons, a user may navigate the emoticons in a suitable manner as explained above. Rotation of the chain is again controlled with the bezel and/or touch interaction and an emoji is picked by tapping on it. The chain need not be stationary for picking to work, and it is not stopped by doing so. A buffer may be provided associated with the display, and a user may be allowed to add multiple emoticons to the buffer and perform a send action to transmit the emoticons as part of a message. An information display zone may be used to show one or more emoji that has already been picked and that are in the buffer. When this functionality is provided on a smartwatch, a user may reply to a message using only emoticons, rather than attempting to select individual alphanumeric characters of words on the smartwatch. A left-swipe in the information display zone area may implement backspace, removing the last character from the buffer. Tapping in the information display zone may exit the selector, sending the buffer as a message. This may be sent to a keyboard application for further use.
(92) Touch interaction techniques may achieve effective interaction with a large number of content items on a small round screen. The learning curve to master use of the application may be minimal.
(93) While the chains in the example applications may have 20 frames in the track of the display, there may be more items in the set, for example 60 emoticons in the set. It will typically take longer on average to get to the desired item when the total number of items increases, but interaction with 200 items or more may still be practical.
(94) The described display and interaction method provide for interactive items to swirl around and smoothly change their sizes, enabling relatively easy viewing and selection of the larger sized interactive items. The interactive items may be controlled to continuously glide through the user's focus. The user may be empowered to control the movement and selection. The interactive items may be switched in a smallest circular frame in order to provide additional interactive items for display where the number of interactive items exceeds the number of frames displayed at a given time.
(95) An interactive item may be animated to maximize from its position when selected. This may include that the interactive item grows until it covers the entire display or the area enclosed by the outer border. In some embodiments, a return, back or undo function may be provided, and the maximized interactive item may be animated to its previous position in the frame again when this function is selected. This may provide a visual orientation to a user with respect to the selected interactive item's context.
(96) The above embodiments describe and illustrate only use of a circular smartwatch with a circular display as a device on which the method and system may be implemented, but it will be apparent to a person skilled in the art that the present invention may be employed on multiple alternative electronic devices. Although the method and system are particularly suited for use with small, round, electronic displays, it may be used on any display. For example, if the display method is employed on a rectangular display screen, it may free up space on the display outside the chain of circles to display alternative applications, information, or the like, or may simply remain blank. Additionally, while only circular frames, outer and inner borders were described and illustrated above, the system and method may be equally well used with elliptical frames, outer and inner borders, with a major and minor axis of different lengths. This will allow the display to fill up a rectangular screen to a greater extent than a display with circular inner and outer boundaries and frames. Mapping the chain's central ellipse to a curve or a line may be another way to adapt the method to rectangular displays and larger scales.
(97) For devices that do not allow direct interaction, for example personal computers, laptops, television screens or the like, user input may be provided via any alternative means. For example, an external input component such as a keyboard, mouse, remote control or the like may all be used to provide the necessary input. These devices may typically be external of the actual display.
(98)
(99) In the present embodiment, interactive items provided within the frames are videos. The videos are represented by alphanumeric digits, and VID08, VID10, VID12, VID14 and VID16 are clearly visible, with the elliptical frames hidden from view and therefore shown in broken lines. Videos are typically rectangular in shape, with the result that the ellipses of the present embodiment may be more suited to fit videos therein than circular frames. Video may be shaped so that corners of video frame lie on the boundaries of the frames, or so that the corners of the videos are cut off and so that the video fills the entire frame. Upon a selection action performed on any of the interactive items, the specific video may maximize, enlarging and filling the whole rectangular screen. It is further envisaged that all or some of the videos may play as they move along the track. In one embodiment, only the largest five videos may play simultaneously as they are displayed. This may provide a user with a preview of a number of interactive items. Information about some of interactive items may be displayed in an information display space (1118) within the inner boundary (1114). This may be a current heading description, such as a directory name, a file name of the interactive item in the largest frame, or the like.
(100) It will be apparent that other multimedia items, such as photos, may be displayed in the same manner as the videos of
(101) Sub-heading hierarchies may alternatively already be displayed within an interactive item itself.
(102) The lower order track extends along a lower order path (1164) created between an outer elliptical border and an inner elliptical border of the frame, with the inner border of the interactive items lying within the outer border of the interactive item and with a center of the inner border of the interactive item offset from a center of the outer border of the interactive item exactly as the main display of
(103) When a selection action is performed on an interactive item including a lower order track, the lower order track with its interactive items expand to fill up the display (1150), and may be navigated exactly as explained above. The lower order items may be items in a hierarchy lower down, and may for example be a folder containing additional items. This may allow a user to navigate a folder structure.
(104) It is envisaged that a selection input may need to be performed to enter a lower order hierarchy and display it on the display, while a return, back or undo input may return to a previous, higher hierarchy. Animation may be incorporated so that the lower order hierarchy shrinks back into an interactive item upon a return, back or undo input being received. A selection input may be tapping of a touch-sensitive display, a mouse click, or the like, while a return, back or undo input may be a different type of mouse click, a double tap, or the like.
(105) It is envisaged that more than second lower order tracks and interactive items may be provided within lower order interactive items. This may provide an overview of a lower order hierarchy and may assist in navigating the structure. Lower order interactive items may also rotate on their respective interactive tracks with the main interactive items. It is envisaged that up to four levels of a hierarchy may be displayed at once. A size of a resolution and screen may determine the levels that may be adequately displayed at the same time. More than one input method may be employed to control the movement of different hierarchies of interactive items.
(106) It will be apparent that some interactive items displayed on a track may be lower order hierarchies, while others may be interactive items that may be selected, such as an application or media file. This may be similar to navigating a file and folder structure typically found on a computer directory system.
(107)
(108) It is further envisaged that the present method may be used to cycle through social media posts. A user may simply glance at the contents of the interactive item, presently then a social media post, and select the item to look at it in more detail. In the rectangular display shown in
(109) The technique may be used with lean back interaction environments, for example when selecting videos on a large TV screen with a remote control. Advantages of such an embodiment may include continuous automatic introduction of new items via chain rotation and simplicity of control. The present invention may also be used to navigate television channels, where a user may wish to be provided with examples of what is currently played on a channel before selecting the channel itself.
(110) It is envisaged that a unique remote control device may be provided to a user, with only a few buttons, with which the user may operate the display of the present invention. The remote may, for example, include a button to control a speed and/or direction of movement, a button to select an interactive item, or reverse a previously selected input. It will be apparent to a person skilled in the art that such a remote control device may allow full navigational control with minimal buttons provided. It is envisaged that a small narrow touch strip may suffice to control rotation rate, while selection may be implemented with a tap on the strip or with an additional button.
(111) It is envisaged that a user may be able to adjust the appearance and/or operation of the display. The user may be allowed to change the number of frames on the display, the size of the outer boundary, the offset of the inner boundary, the difference in size between the largest and the smallest frame on the display, and the like. Furthermore, a user may be allowed to set a maximum movement speed for the frames, or may be allowed to choose a selection method that will select an interactive item in a frame.
(112) It will be apparent that the present display method may be usable without the requirement for user interaction. In removing user interaction, the same display method may be employed simply to show content in various frames, which may provide a pleasant viewing and preview experience to a user.
(113) Visibility of interactive items may be controlled in various ways. For example, items may be slightly out of focus in smaller frames, and may become more focused as their frames enlarge. Alternatively, the interactive items may be a fixed resolution, with more of the item becoming visible as the boundary of the frame enlarges, exposing more of the interactive item therein. As a further alternative, interactive items may be covered with disks of variable transparency.
(114) Throughout the specification and claims unless the contents requires otherwise the word ‘comprise’ or variations such as ‘comprises’ or ‘comprising’ will be understood to imply the inclusion of a stated integer or group of integers but not the exclusion of any other integer or group of integers.