AUGMENTED REALITY TOY

Abstract

A toy, for use with a viewing device, may include a plurality of component parts at least two of which include at least one augmented reality marker of a plurality of augmented reality markers enabling digital content associated with the at least one augmented reality marker to be unlocked and influencing at least one of an appearance and function of the toy on the viewing device. The plurality of augmented reality markers, each of which may be a physically independent augmented reality image marker, may be combined and converted into a composite augmented reality marker to produce a single, unique physical item and a composite digital representation.

Claims

1. A toy, for use with a viewing device, comprising a plurality of component parts at least two of which include at least one augmented reality marker of a plurality of augmented reality markers enabling digital content associated with the at least one augmented reality marker to be unlocked and influencing at least one of an appearance and function of the toy on the viewing device, wherein the plurality of augmented reality markers, each of which is a physically independent augmented reality image marker, are combined and converted into a composite augmented reality marker to produce a single, unique physical item and a composite digital representation.

2. The toy as claimed in claim h wherein at least one component part of the at least two component parts with at least one augmented reality marker is substitutable with a component part with a different augmented reality marker.

3. The toy as claimed in claim 1, wherein at least two of the plurality of component parts include at least one of a male mating member and a female mating member via which that at least two component parts are linkable one of directly and indirectly to one another.

4. The toy as claimed in claim 1, wherein at least one of the plurality of augmented reality markers and the toy do not include a near field capture (NFC) device.

5. The toy as claimed in claim 1, wherein the toy defines a character with a head, a torso and a lower body.

6. The toy as claimed in claim 1, wherein the toy is configured to receive a plurality of physical ancillary components,

7. The toy as claimed in claim 6, wherein the plurality of physical ancillary components is at least one of a weapon, a transport mechanism, and a protective device.

8. The toy as claimed in claim 1, wherein the plurality of component parts are a plurality of multi-faceted components.

9. The toy as claimed in claim 8, wherein the plurality of multi-faceted components are a plurality of blocks.

10. The toy as claimed in claim 8, wherein at least two faces of the plurality of multi-faceted components include a different augmented reality marker of the plurality of augmented reality markers.

11. The toy as claimed claim 1, further comprising a light mechanism configured to light the plurality of augmented reality markers.

12. The toy as claimed in claim 11, wherein the toy is hollow and further comprises a light arranged inside the toy configured to light the plurality of augmented reality markers from behind the plurality of augmented reality markers as viewed from outside the toy.

13. The toy as claimed in claim 1, wherein the toy is packaged with instructions on how to access augmented digital content.

14. A kit of parts comprising at least one of a book, a playing surface, a plurality of accessories and a set of gaming instructions for use with a toy including a plurality of component parts at least two of which include at least one augmented reality marker of a plurality of augmented reality markers enabling digital content associated with the at least one augmented reality marker to be unlocked and influencing at least one of an appearance and function of the toy on a viewing device, wherein the plurality of augmented reality markers, each of which is a physically independent augmented reality image marker, are combined and converted into a composite augmented reality marker to produce a single, unique physical item and a composite digital representation.

15. The kit of parts as claimed in claim 14, wherein the playing surface includes an independent augmented reality marker.

16. The kit of parts as claimed in claim wherein the playing surface is a playing card which is provided one of alone and as a pack of different playing cards.

17. A system enabling at least one of a toy and a kit of parts to be played with whilst being viewed through a viewing device configured to access augmented digital content, wherein: the toy includes a plurality of component parts at least two of which include at least one augmented reality marker of a plurality of augmented reality markers enabling digital content associated with the at least one augmented reality marker to be unlocked and influencing at least one of an appearance and function of the toy on the viewing device, wherein the plurality of augmented reality markers, each of which is a physically independent augmented reality image marker, are combined and converted into a composite augmented reality marker to produce a single, unique physical item and a composite digital representation; and the kit of parts includes at least one of a book, a playing surface, a plurality of accessories, and a set of gaming instructions for use with the toy.

18. The system as claimed in claim 17, further comprising at least one of a software, a processor, a storage, a memory, an operating system, an i/o device, an accelerometer and a network interface.

19. The system as claimed in claim 18, wherein, when the toy is viewed through the viewing device, interrogates at least two physically independent augmented reality image markers on at least two component parts of the plurality of component parts to determine at least one of a relative physical position and a relative orientation of each of the at least two physically independent augmented reality image markers to ensure an authenticated composite digital representation is formed.

20. The system as claimed in claim 19, wherein a software configured to process a camera feed continuously evaluates the camera feed to determine the at least one of the relative physical position and the relative orientation of each of the at least two physically independent augmented reality image markers to ensure an authenticated composite digital representation is formed.

21. The system as claimed in claim 17, wherein the system facilitates a playing of a game between at least two players each viewing the toy.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

[0046] Embodiments of the invention are further described hereinafter with reference to the accompanying drawings, in which:

[0047] FIGS. 1a to 1c show assembled toys according to a first aspect of the present invention;

[0048] FIG. 1a shows a first character; FIG. 1b shows a second character, and FIG. 1c shows a third character which is a chimer of the first and second characters;

[0049] FIGS. 2a to 2c show augmented versions of the characters of FIGS. 1a to 1c;

[0050] FIG. 3 shows the components of one embodiment of a simple toy, as illustrated in FIG. 1a, before assembly;

[0051] FIGS. 4a and 4b show an alternative construction of a toy of the invention which is adapted to backlight image markers as per a second aspect of the invention;

[0052] FIG. 4a shows a scaffold housing one or more lights and a battery (not shown) onto which the components are assembled;

[0053] FIG. 4b shows the components assembled on the scaffold of FIG. 4a;

[0054] FIG. 5 illustrates the identification of multiple image markers on a toy, as the prior art;

[0055] FIG. 6 illustrates the process by which a composite marker is formed from multiple image markers, according to a first aspect of the present invention;

[0056] FIGS. 7a to 7c illustrate verification of a composite marker based on physical position;

[0057] FIGS. 8a to 8b illustrate verification of a composite marker based on relative orientation;

[0058] FIG. 9 is a schematic of a system in use such that a first user can view his toy through a device and play a game against a second user with a different toy of the same genre whereby he views both his and his opponents toys in an augmented manner;

[0059] FIGS. 10a to 14 illustrate the sequential steps of an illustrative game play using a toy according to the invention in which;

[0060] FIGS. 10a to 10c illustrate the steps in detecting a correctly assembled toy;

[0061] FIG. 11 illustrates the process steps in registering the toy for game play;

[0062] FIG. 12 illustrates the steps for joining a game;

[0063] FIGS. 13a to 13c illustrate gameplay in which:

[0064] FIG. 13a illustrates how a first user gets his toy to attack a second user toy;

[0065] FIG. 13b illustrates how the system evaluates the effectiveness of an attack;

[0066] FIG. 13c shows the effect of the attack on the opponents toy;

[0067] FIG. 14 is a view of a device display of an augmented toy during an attack; and

[0068] FIG. 15 shows two toys sitting on respective playing surfaces as viewed through a device.

DETAILED DESCRIPTION

[0069] The embodiments described are not intended to be limiting, but are rather intended to demonstrate how the various inventions give rise to a new approach to toys and game play.

[0070] FIGS. 1a, 1b and 1c, illustrate physical toys (10) according to a first aspect of the present invention. FIG. 1a illustrates a first character (10a), FIG. 1b illustrates a second character (10b), and FIG. 1c illustrates a third chimeric character (10c) formed by combining the components (20, 30, and 40) from both the first and second characters.

[0071] Each toy (10a, 10b and 10c) comprises a plurality, in this example three, of interconnecting blocks (20, 30 and 40) which form respectively a head (20), a torso (30) and a lower body (40) in the characters illustrated.

[0072] The block of each toy is or comprises at least one unique augmented reality marker (22; 32; 42). This preferably takes the form of a unique image (2 dimensional) but it could be based on a unique shape (3 dimensional).

[0073] Preferably the marker (22a-b, 32a-b; 42a-b) for each component (20, 30, 40) of each toy (10a, 10b, 10c) wraps around each visible face of a given component (as viewed when correctly assembled).

[0074] Thus, as illustrated in FIG. 3, for the head (20) this includes: the front face (201) corresponding to the face of the character, the rear face (202), the two side face (203 and 204) and the top face (205). For the torso (30) this includes: a front face (301), a rear face (302), and two side faces (303 and 304); and for the lower body (40) this includes: a front face (401), a rear face (402), and two side faces (403 and 404).

[0075] By ensuring each marker wraps around its component the assembled component can be authenticated when viewed through an augmented reality device (100) with a camera (110) such as a tablet or mobile phone from any angle.

[0076] Alternatively the marker could be limited to the primary viewing face, which for a character is the front face (201, 301, 401), i.e. the face depicting the character.

[0077] For the toy (10) to come to life (FIG. 9) it must be viewed through an augmented reality device (100) comprising a camera (110) in a system (500) including software (510). The software identifies that the components (20, 30, 40) are correctly assembled to form an authenticated toy, i.e. one in which the components are connected to one another in the appropriate position (head-torso-lower body) as opposed to an inappropriate position (head-lower body-torso) and in a correct orientation i.e. the torso or lower body are not assembled upside down. Correct orientation also means that all the component faces are in alignment, i.e. all the front faces (201, 301, 401) are aligned in the same plane (and not, for example, a displaced plane (201, 302, 401). The software may be loaded onto the device or it may be accessed through the device communicating with, for example, a server (520).

[0078] The software (510) (or a computer readable memory containing a program that, when executed performs an operation for displaying the toy) performs a number of functions and facilitate a number of method steps to ensure an interactive experience.

[0079] Thus, the software (510) is responsible for ensuring the toy is authenticated as a toy with a given identity (10a ; 10b, 10c) whereby it can overlay digital content (50a, 50b 50c), associated with the authenticated toy, over the camera feed.

[0080] Once authenticated the software creates a composite marker (234a, 234b, 234c) from the plurality of component markers (22, 32, 42), and digital content (50a, 50b, 50c) associated with the authenticated toy is unlocked and influences how the toy appears and or functions. Digital content can include visual and audio content.

[0081] FIGS. 2a, 2b and 2c show the toys of FIGS. 1a-1c in augmented form with digital content (50a ; 50b and 50c) respectively.

[0082] For example, the first character in augmented form FIG. 2a sprouts wings and talons and can flap its wings. It can also let out a piercing squawk and project an attack from its beak. The second character in augmented form FIG. 2b sprouts arms holding swords and the third character, which is a chimer of characters 1a and 1b, shares certain characteristics from its' parent characters but also has its own unique characteristics.

[0083] It will be apparent that a physical toy of the invention can be manufactured in any number of ways. One simple embodiment is illustrated in FIG. 3 which shows the three components which give rise to the toy illustrated in FIG. 1a. These components (20, 30, 40) take the form of interconnecting blocks.

[0084] The block corresponding to the head of the character has five closed faces which carry images giving the character its' distinctive appearance. It comprises a front face (201) corresponding to the face of the character, a rear face (202), two side faces (203 and 204) and a top face (205). The underside (206) comprises a female mating member (207) which in the embodiment illustrated is a hexagonal recess.

[0085] The block corresponding to the torso of the character has four closed faces, namely a front face (301) corresponding to the front of the character, a rear face (302), and two side faces (303 and 304). The top face (305) comprises a male mating member (308) enabling it to be connected or coupled to the underside (206) of block (20). This male mating member, in the embodiment illustrated, is a hexagonal upstand. The underside (306) comprises a female mating member (307), which in the embodiment illustrated is a hexagonal recess.

[0086] The block corresponding to the lower body (40) of the character has four closed faces, namely a front face (401), a rear face (402), and two side faces (403 and 404). It has a top face (405) comprising a male mating member (408) enabling it to be connected or coupled to the underside (306) of block (30). It has an underside (406) which comprises a female mating member (407) which in reality has no function.

[0087] When assembled correctly, in an authenticated manner, the toy appears as shown in FIG. 1a.

[0088] Of course it is possibly to produce the toy and its' components in many different ways and the skilled person will of course appreciate this. It is also possible to ensure the three character defining components (which are not intended to be limiting) can only be assembled in a manner giving rise to an authenticated configuration. i.e. they can only be assembled in one way.

[0089] FIGS. 4a and 4b illustrate an alternative construction of toy (without any artwork) which is particularly suited to creating a toy with a self-illuminating marker system according to a second aspect of the present invention. The toy (10) is made of a translucent or transparent material and the character defining components (20, 30, 40) are assembled over a scaffold (70) which houses a power source and light source (not shown) e.g. a battery and LED array, which can back-light the image marker(s) which are preferably printed or shrunk wrapped onto or around the component blocks which are connected to the scaffold.

[0090] Alternatively, or in addition, the image markers may include a luminescent or electro-luminescent coating.

[0091] In order to facilitate game play the toys capability is determined by attributes acquired from its components and their combination with the other components. For example, the type of head may give rise to differing powers of intelligence, the type of torso may give rise to differing powers of strength, and the type of lower body may give rise to differing powers of speed, which capabilities may be determined by, for example, the attributes given to the component part (20, 30, 40) per se, by a modified set of attributes additionally based on its juxtaposition with one or more other components, or the composite toy per se. In this regard the toys placement on a given playing surface (90a ; 90b), such as playing cards, which may be independently trackable, through the presence of separate markers (92a; 92b), can add to the augmented experience enabling an augmented environment to be built around the toy such that the toy does not have to act as the anchor point for gaming

[0092] Because it is possible to achieve thousands of assembly permutations with a relatively small number of multi-component toys, identifying and authenticating the assembled toy quickly, from the augmented reality markers associated with each component was a significant challenge.

[0093] Typically, and as illustrated in FIG. 5, augmented reality markers (622, 632, 642) are produced as single images and software responds to the detection of the image marker with some behaviour—typically overlying digital images (722, 732, 742) on top of the camera feed such that they appear on a screen (120) of the viewing device (100),

[0094] In contrast, and as illustrated in FIG. 6, the system software recognizes a plurality of image markers (22, 32, 42) and if they are in an appropriate juxtaposition with reference to each other generates a single composite marker (234) which in turn gives rise to behaviours—corresponding to the unique character including an augmented digital representation thereof (50a ; 50b. 50c) as illustrated in FIGS. 2a-2c. The digital representation is displayed over the camera feed, such that an enhanced digital representation of the physical toy appears on a screen (120) of the device. The composite marker also has associated with it other game playing information such as any powers attributed to it, which can be used in game play in, for example, a battle between two characters.

[0095] In the embodiment described each marker image (22, 32, 42) takes the form of a printed image which makes up all or a part of the toys physical image.

[0096] For the toy described the production of a composite marker only occurs if a plurality of augmented reality markers (22, 32, 42), which are present on respective component parts (20, 30, 40), are assembled in an appropriate manner such that the end physical toy is authenticated as a valid toy arrangement. One way of authenticating a correctly assembled toy is illustrated with reference to FIGS. 7 and 8.

[0097] In the embodiment described the three component parts (20, 30, 40) representative of the head, torso and lower body of a character must firstly be assembled together in a correct positional order (FIGS. 7a to 7c), and secondly the components must be correctly orientated (FIGS. 8a-8b).

[0098] Referring to FIGS. 7a-7c, the software (510) analyses each marker image (22, 32, 42) and determines whether the physical arrangement of the components (20, 30, 40) is valid (as FIG. 7c) or invalid (as FIG. 7a or 7b).

[0099] Since the composite marker (234) is produced through an arrangement of images, rather than a single image, the software (510) responsible for processing the camera feed must perform a continuous evaluation of the feed in order to detect both the presence of marker images (22, 32, 42) and a valid physical arrangement as opposed to an invalid physical arrangement.

[0100] In addition to determining an approved physical arrangement, the software also analyses the orientation of the components to ensure that the components are also in a valid orientation (FIG. 8b) as opposed to an invalid one (FIG. 8a).

[0101] Once the software has determined the assembled toy meets the criteria it is authenticated.

[0102] The presence of one or more marker components may also be detected in order to allow the software to respond prior to a full, valid detection taking place.

[0103] An algorithm compares the relative position and orientation of marker components against a database or list of valid arrangements. For any individual marker component, the algorithm determines the required position and orientation of any other components. The algorithm may employ various degrees of tolerance when analysing position and orientation.

[0104] In order for an arrangement to be valid, the algorithm compares the position and orientation of marker components relative to one another.

[0105] An example validation rule is one whereby a composite marker is considered valid if all components are oriented around the same axis and are adjacent to one another along a particular axis. Validation rules may vary between implementations.

[0106] The software can also be used to assist a user to correctly assemble a toy.

[0107] Referring to FIGS. 10a-10c, a first user (U1) assembles the three components of the toy (20, 30, 40) as shown behind the display (120) of the device (100). When viewed through the device, the camera feed detects the component and the software gives the user a split screen view of the component (40) (FIG. 10a left hand side) and a render preview (42) of the component (right hand side).

[0108] As the toy is assembled (FIGS. 10b and 10c) instructions/prompts may be given until a correctly assembled toy is recognised, at which point the toy is registered and the first user (U1) is able to commence game play against another user (U2) or against a toy selected by the system.

[0109] During the process the software continuously analyses the device's camera feed and attempts to identify the presence of one or more markers (FIG. 10a). If one or more markers is identified, the software determines whether the marker arrangement signifies the presence of a fully assembled toy (FIG. 10c).

[0110] If the software has determined that the user has assembled a toy correctly (FIG. 10c) the toy is registered to the user (U1) and confirmed as an authorised toy.

[0111] FIG. 11 illustrates the process were the software (510) is run remotely on a server (520). The marker configuration is sent by the device (100) to the server (520). (Step 1). The marker configuration is validated (Step 2). The toy is registered to the user (Step 3) and authorised (step 4).

[0112] The user is then able to join a game and the process of joining a game is set out, in brief, in FIG. 12.

[0113] Referring to FIG. 12, a toy (10) is viewed through a device (100), the marker configuration (22, 32, 42) of the toy is identified, and it is determined whether or not it is authorised. If it is not, the configuration is registered, and if it is already authorised details are uploaded and the user or player is asked to join a game.

[0114] The user (U1) selects or invites an opponent to join a game whereupon when the second user (U2) joins the game the first user is able to additionally view the opponents toy on his device (and vice versa). Play can then begin.

[0115] In one game the player's toys do battle and the game is played via a user interface on the device (100) as illustrated in FIGS. 13a to 13c with reference also to FIG. 9 and FIG. 14.

[0116] Referring to FIG. 9, game play is facilitated through a device (100) with a camera (110) such as a tablet or phone. The system (500) supporting game play comprises one or more toys (10), one or more viewing devices (100), each with a camera (110), and a display (120) and software (510) which enables digital content (50) to be displayed. The software may be run locally on the device via e.g. an app, or remotely on e.g. a server (520).

[0117] One half of a first users screen displays user 1′s (U1) (also player 1) augmented character (50b) and one half of the screen displays user 2′s (U2) (also player 2 or opponent) augmented character (50a). A touch screen user interface (130) is also provided.

[0118] Gameplay is turn-based (FIGS. 13a-13c). For each turn a user selects the type of attack they wish to carry out by first tapping on the relevant content (140) (circle in screen 1—FIG. 13a) within the augmented reality view (e.g. user taps on head, torso or lower body) of their toy. They then taps on the relevant content (150) (circle in screen 2—FIG. 13a) within the augmented reality view (e.g. user taps on head, torso or lower body) of their opponents toy. In the representation show User 1 uses characteristics associated with his toys torso to attack the head of his opponent's toy.

[0119] Once the user has selected their attack type and target, the software (510) calculates the effectiveness of the attack using an algorithm as illustrated in FIG. 13b. The algorithm takes into account multiple factors which are derived from the attributes of both player's toys. The algorithm determines both the accuracy and the effectiveness of an attack. The algorithm may be executed locally on the device (100) or remotely on a server (520). The algorithm may be executed on both user's devices simultaneously or sequentially, in order to validate the results. Once the effectiveness of an attack has been determined, the software distributes this information to both users (Players 1 and 2) via the network (530).

[0120] The software (510) may respond to the output of the algorithm in a variety of ways (FIG. 14c). An attack may result in a hit (indicated in a variety of ways e.g. trajectory of attack visualised (80) and/or text box (82) indicates hit or miss. Further the screen may display (84) the degree of damage inflicted whereby the toys state is altered which in FIG. 9 is indicate on power bars (86).

[0121] In the Example given the object is to reduce the opponent's health to zero but other games may have other objectives and the outcomes of turns can be visualised in a variety of ways.

[0122] Once both users have received the output of the algorithm, and carried out the appropriate response, the software ends the current player's turn and their opponent is then able to respond. Once a toys health has been depleted, it is considered to have lost the game. After displaying win/loss information to the user, the game may reset or end.

[0123] As can be seen in FIG. 9 the display provides details of e.g. the status of the users toy and that of their opponent's toy.

[0124] In a preferred variant, as illustrated in FIG. 15, the gaming apparatus comprises a playing surface (90) on which the game is played with the toys (10). The playing surface may be provided in the form of playing cards, each card having its own AR marker (92a; 92b) which can influence game play. Thus, packs of cards may be provided.

[0125] The provision of an augmented environment which can be tracked independently of the toy(s) overcomes a number of problems and provides a number of benefits as set out below:

[0126] By fixing the augmented digital content to the playing surface and not the toy, the toy can:

[0127] 1. Move relative to the digital content;

[0128] 2. Interact with digital elements, for example it can kick a digital ball on the playing surface and cause the ball to move (as the digital content is not anchored to the toy);

[0129] 3. Play against a second virtual player, as the second player can be anchored to an independent playing surface.

[0130] By providing an independently trackable playing surface (90) the system facilitating game play can track the toy in a vertical plane, and the playing environment in the horizontal plane. As a consequence:

[0131] 1. Environment content can be tracked to the playing surface, by attaching it to the playing card and not the toy.

[0132] 2. Movement between the toy and the playing surface can be tracked to allow the toy to interact with digital content on the playing surface;

[0133] 3. By placing multiple toys on multiple playing cards, a single device can track and allow interactions between multiple toys;

[0134] 4. Due to the addition of added tracking in the horizontal plane, if the toy is placed on a playing card, the device can continuously track the toy's position not just by the toy but also by the playing card; and

[0135] 5. By using a second playing card, it can be used as the anchor point for a virtual opponent to be visually represented.

[0136] The reader will appreciate that the toys and system of the invention can give rise to many different games and the Example provided is merely illustrative.