Display apparatus, content distribution apparatus, and content distribution system for a robotic device
10706819 ยท 2020-07-07
Assignee
Inventors
Cpc classification
B25J11/0005
PERFORMING OPERATIONS; TRANSPORTING
B25J9/1628
PERFORMING OPERATIONS; TRANSPORTING
B25J9/0003
PERFORMING OPERATIONS; TRANSPORTING
G09G2370/04
PHYSICS
G06F3/14
PHYSICS
International classification
B25J9/00
PERFORMING OPERATIONS; TRANSPORTING
B25J11/00
PERFORMING OPERATIONS; TRANSPORTING
G09G5/12
PHYSICS
Abstract
A display apparatus, which outputs a representation of content data, includes a communicator that obtains from a content distribution apparatus the content data and robot operation data used for operating a robotic device, a storage that stores the content data and the robot operation data, and a controller that transmits the robot operation data to the robotic device connected the display apparatus when the display apparatus outputs the representation of the content data.
Claims
1. A display apparatus that outputs a representation of content data, comprising: one or more non-transitory computer-readable media having computer-executable instructions embodied thereon; a processor coupled to the one or more non-transitory computer-readable media, and configured to execute the computer-executable instructions to: obtain from a content distribution apparatus the content data and a robot operation data used for operating a robotic device; store the content data and the robot operation data; and transmit the robot operation data to the robotic device connected to the display apparatus when the display apparatus outputs the representation of the content data, wherein in a case where the processor determines that the content data is the robot operation data, the processor reads a file containing the robot operation data, the processor determines whether the file that has been read contains identification information corresponding to the robotic device, in a case where the file does not contain the identification information, the processor determines whether the identification information corresponding to the robotic device is set to a frame in which the representation of the content data is output, and in a case where the identification information is set to the frame, the processor extracts the robot operation data from the file that has been read and transmits the robot operation data to the robotic device, and communicates with the robotic device and transmits the robot operation data to the robotic device.
2. The display apparatus according to claim 1, wherein the storage includes a first storage area for storing the content data and a second storage area for storing the robot operation data.
3. The display apparatus according to claim 1, further comprising: first registration circuitry that registers the content data to be output on the display apparatus; second registration circuitry that registers robot operation data used for operating a robotic device connected to the display apparatus; and a data transmitter that distributes the content data and the robot operation data to the display apparatus that is selected.
4. The display apparatus according to claim 3, wherein the first registration circuitry registers the content data in a first content output list associated with a first display area of multiple display areas set in a layout screen corresponding to a display of the display apparatus, and the second registration circuitry registers the robot operation data in a second content output list associated with a second display area of the multiple display areas set in the layout screen corresponding to the display of the display apparatus.
5. The display apparatus according to claim 1, wherein the content data includes at least one of a still image file, a movie file, a music file, and a voice file, and the robot operation data includes at least one of a robot action file and a robot voice file.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1)
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11)
(12)
(13)
(14)
(15)
(16)
(17)
(18)
(19)
(20)
(21)
(22)
(23)
DESCRIPTION OF THE EMBODIMENTS
First Embodiment
(24) A first embodiment of the present disclosure is described below with reference to the drawings.
(25) Configuration of Content Distribution System
(26) A content distribution system 1 according to the first embodiment includes a display apparatus 20, which is communicably connected to a robotic device (hereinafter simply referred to as a robot) 30, and a content distribution apparatus 10, which is communicably connected to the display apparatus 20 and distributes content to the display apparatus 20, as illustrated in
(27) Hereinafter, characteristic configurations of the apparatuses constituting the content distribution system 2 of the first embodiment are described with reference to the drawings.
(28) The content distribution apparatus 10 includes, as illustrated in
(29) The first content data registration unit 130 registers content data, a representation of which is to be output on the display apparatus 20.
(30) The second content data registration unit 150 registers robot operation data used for operating the robot 30.
(31) The data transmission unit 170 transmits data from the content distribution apparatus 10 to the display apparatus 20 and has a function of transmitting content data and robot operation data to the display apparatus 20 that is selected.
(32) Here, the content data may include, for example, a still image file, a movie file, a music file, and/or a voice file. The robot operation data may include, for example, a robot action file and/or a voice file.
(33) The storage unit 190 stores a control program 192 for controlling processing of each unit of the content distribution apparatus 10, signage program editing software 194, and robot action and utterance editing software 195. The storage unit 190 includes a first content data storage area 196 for storing the content data to be output on the display apparatus 20 and a second content data storage area 198 for storing the robot operation data used for operating the robot 30.
(34) The display apparatus 20 includes, as illustrated in
(35) When the content distributed by the content distribution apparatus 10 is output on the display apparatus 20, the control unit 200 transmits to the robot 30 the robot operation data distributed by the content distribution apparatus 10.
(36) The storage unit 290 stores a control program 292 for controlling processing of each unit of the display apparatus 20 and signage player software 293. The storage unit 290 includes a first content data storage area 296 for storing the content data to be output on the display apparatus 20 and a second content data storage area 298 for storing the robot operation data used for operating the robot 30.
(37) The robot 30 includes, as illustrated in
(38) When the content is output on the display apparatus 20, the control unit 300 performs control for operation in accordance with the robot operation data transmitted by the display apparatus 20.
(39) The storage unit 390 stores, for example, a control program 392 for controlling operation processing of the robot 30. The storage unit 390 includes a second content data storage area 398 for storing the robot operation data used for operating the robot 30.
(40) The robot 30 may be a robot having a human-like external form. Specifically, the robot 30 may have, for example, a head, a torso, arms, and legs, with the head configured to be pivotable in both the vertical direction and the lateral direction and the arms configured to be movable in the vertical direction, in addition, the head may have parts corresponding to, for example, eyes and a mouth that constitute a human face.
(41) Configuration of Content Distribution Apparatus
(42) The content distribution apparatus 10 edits a program of content (signage content) to be distributed to the display apparatus 20. The processing for editing and registering content is performed by using the signage program editing software 194.
(43)
(44) Editing of Signage Program
(45) The signage program editing software 194 is used for editing and registering a program in which content is played. The signage program editing software 194 displays a layout screen 194a, in which display areas for content to be output on a display unit of the display apparatus 20 are defined by frames as illustrated in
(46) In the first embodiment, the layout screen 194a includes, as illustrated in
(47) In the playlist screen 194c, as illustrated in
(48) The registration of content in playlists is performed such that a still image file (an image file) g10, a movie file d10, a music file m10, and a robot action and utterance file r10 are registered, in accordance with file types, separately in, for example, a first frame playlist p1 or a third frame playlist p3 that correspond respectively to the frames described above, as illustrated in
(49) In the first frame playlist p1, (1) a movie file d11 about a robotic device, (2) a movie file d12 about store information, and (3) a movie file d13 about new products are registered. In the third frame playlist p3, (1) a robot action and utterance file r11 with which a robot performs greeting operation, (2) a robot action and utterance file r12 with which a robot performs guidance operation, and (3) a robot action and utterance file r13 with which a robot performs announcement operation are registered. Editing of robot action and utterance
(50) In the content distribution apparatus 10, an action and/or speech of a robot is edited and created by running the robot action and utterance editing software 195.
(51) In the robot action and utterance editing software 195, as illustrated in
(52) In the robot action and utterance file r10, the configuration is set to control a particular robot to perform, in accordance with preset commands, actions and utterances, for example, 001: [Action] Bowing 1, 002: [Utterance] Hello . . . . as illustrated in
(53) In the content distribution apparatus 10, the still image file g10, the movie file d10, or the music file m10 to be output on the display apparatus 20, or the robot action and utterance files r10 to be used to operate the robot 30 is edited and registered with respect to each of the frames.
(54) In the first embodiment, as illustrated in
(55) The display apparatus 20 executes a file of content that has been registered.
(56) In the display apparatus 20, as illustrated in
(57) The content of the content files is output on the display apparatus 20 in order of the content files registered in each of the playlists of the respective frames. Specifically, in response to a content output instruction, the movie files d11, d12, and d13 registered in the first frame playlist p1 are sequentially played and the music file m11 registered in the second frame playlist p2 is also played.
(58) Operation Control of Robotic Device
(59) The robot 30 is controlled by the signage player software 293 to perform an action and/or an utterance in accordance with the robot action and utterance file r10 transmitted by the display apparatus 20.
(60) Specifically, when the display apparatus 20 plays content, the display apparatus 20 transmits the robot action and utterance file r10 to the robot 30. The robot 30 is controlled to execute sequentially the robot action and utterance files r11, r12, and r13 transmitted by the display apparatus 20.
(61) Distribution of output content data and robot operation data in content distribution system
(62) Next/processing for performing operation in accordance with distributed content data to be output on the display apparatus 20 and distributed robot operation data used for operating the robot 30 in the content distribution system 1 of the first embodiment is described with reference to flowcharts.
(63)
(64) Content Output Processing of Display Apparatus
(65) Firstly, an outline of processing for controlling the display apparatus 20 to play distributed content in the content distribution system 1 is described.
(66) As illustrated in
(67) Next, content file output processing of the display apparatus 20 in accordance with the playlist information for the respective frames is described.
(68) As illustrated in
(69) The play processing is performed differently for each type of content. Firstly, it is determined whether the content is a still image file (step S206). In a case where it is determined that the content is a still image file, the still image file is read, image data of the still image file is processed, and an corresponding image is presented in a frame (step S208).
(70) Conversely, in step S206, in a case where it is determined that the content is not a still image file, it is subsequently determined whether the content is a movie file (step S210). In a case where it is determined that the content is a movie file, the movie file is read, movie data of the movie file is processed, and a corresponding movie is played in a frame (step S212).
(71) In a case where it is determined in step S210 that the content is not a movie file, it is subsequently determined whether the content is a music file (step S214). In a case where it is determined that the content is a music file, the music file is read, music data of the music file is processed, and corresponding music is output through an audio output terminal (step S216).
(72) In a case where it is determined in step S214 that the content is not a music file, it is subsequently determined whether the content is a robot action and utterance file (step S218). In a case where it is determined that the content is a robot action and utterance file, the robot action and utterance file is read, a communication connection with the robot 30 is established, and the robot action and utterance file is transmitted to the robot 30 to perform operation processing (step S220). In this manner, the operation in accordance with the first content is performed.
(73) A timer is set to measure a preset time until the subsequent content starts being played (step S222), and when the preset time has elapsed (step S224), it is determined whether the play position is at the top of the playlist (step S226). In a case where it is determined that the play position is at the top of the playlist, the play position is set to the top of the playlist (step S228), the processing flow returns to step S204, and the processing for playing the playlist described above is repeated.
(74) Conversely, in a case where it is determined in step S226 that the play position is not at the top of the playlist, the play position in the playlist is moved to the subsequent content file (step S230). The processing flow then returns to step S204 and the play processing of the playlist described above is repeated.
(75) Communication Processing Between Display Apparatus and Robot
(76) Next, communication processing when the display apparatus transmits operation data to the robot 30 is described. The processing for communicating with the robot 30 in the content output processing in step S220 illustrated in
(77) When the display apparatus 20 starts the processing for communicating with the robot 30, as illustrated in
(78) Conversely, in a case where it is determined in step S304 that the robot action and utterance file that has been read does not include any robot ID, it is determined whether the robot ID of a robot to be connected is set in the frame (step S306).
(79) In a case where it is determined in step S306 that the robot ID is set in the frame, the display apparatus 20 extracts robot action data from the robot action and utterance file (step S308).
(80) Conversely, in a case where it is determined in step S306 that any robot ID is not set in the frame, the display apparatus 20 ends the processing for communicating with the robot 30.
(81) After step S308, the display apparatus 20 extracts robot utterance data from the robot action and utterance file (step S310), establishes a communication connection with the robot to be connected (step S312), and transmits the robot action data and the extracted robot utterance data (step S314). Subsequently, the display apparatus 20 ends the communication connection with the robot (step S316). In this manner, the communication processing for transmitting content data from the display apparatus 20 to the robot 30 is completed.
(82) As described above, in the content distribution system 1, after the content distribution apparatus 10 distributes content data and robot operation data to the display apparatus 20, the display apparatus 20 transmits the robot operation data to the robot 30 when playing the content of the content data, and as a result, the robot 30 can perform actions and utterances synchronously with the content played by the display apparatus 20.
(83) In the first embodiment, in the content distribution system 1 including the display apparatus 20 that is communicably connected to the robot 30, and the content distribution apparatus 10 that distributes content to the display apparatus 20, the content distribution apparatus 10 includes the first content data registration unit 130 that registers content data, the second content data registration unit 150 that registers robot operation data, and the data transmission unit 170 that transmits the content data and the robot operation data to the display apparatus 20 that is selected. The display apparatus 20 is controlled such that, when playing the content distributed by the content distribution apparatus 10, the display apparatus 20 transmits to the robot 30 the robot operation data distributed by the content distribution apparatus 10, and the robot 30 is controlled to perform operation in accordance with the robot operation data transmitted by the display apparatus 20 when the display apparatus 20 plays the content. With this configuration, by registering, in the same manner as the still image file g10, the movie file d10, and the music file m10 as the content data, the discrete robot action and utterance file r10 as the robot operation data in the playlist p of the content distribution apparatus 10, both the content data and the robot operation data can be distributed to the display apparatus 20. Accordingly, the robot 30 can be controlled to perform actions and utterances when the display apparatus 20 plays (outputs) a still image, a movie, and/or music, thereby controlling the robot 30 to easily perform actions and/or utterances synchronously with image content and/or music.
Second Embodiment
(84) Next, a second embodiment of the present disclosure is described below with reference to the drawings. For ease of description, configurations that are the same as those of the first embodiment are denoted by the same reference numerals as in the first embodiment, and redundant descriptions thereof are omitted.
(85)
(86) Configuration of Content Distribution System
(87) A content distribution system 201 according to the second embodiment includes a display apparatus 20, which is communicably connected to two robots 30, and a content distribution apparatus 10, which is communicably connected to the display apparatus 20 and distributes content to the display apparatus 20, as illustrated in
(88) The first robot 31 and the second robot 32 are communicably connected to the display apparatus 20.
(89) The second embodiment differs from the first embodiment in a configuration of a layout 294b in which display areas for content to be output on a display unit of the display apparatus 20 are defined by frames as illustrated in
(90) In the layout 294b according to the second embodiment, four frames (a first frame 294b1, a second frame 294b2, a third frame 294b3, and a fourth frame 294b4) are set. Content is registered and output with respect to each of the frames. In addition, similarly to the first embodiment, playlists are set in association with the respective frames.
(91) Concerning the four frames in the layout 294b, the first frame 294b1 and the second frame 294b2 are configured to occupy larger areas and the third frame 294b3 and the fourth frame 294b4 are configured to occupy smaller areas.
(92) In the display apparatus 20 of the second embodiment, display content and the like are output in the first frame 294b1 and the second frame 294b2. Conversely, display content and the like are not output in the third frame 294b3 and the fourth frame 294b4 and robot action and utterance files are registered in the playlists of the third frame 294b3 and the fourth frame 294b4(so that the playlists function as playlists used for the robot 30.
(93) In the second embodiment, as illustrated in FIGS. 17A to 17D, the movie files d11, d12, and d13 are registered in a first frame playlist, the music file m11 is registered in a second frame playlist, robot action and utterance files r11, r12, and r13 associated with the first robot 31 are registered in a third frame playlist, and robot action and utterance files r21, r22, and r23 associated with the second robot 32 are registered in a fourth frame playlist.
(94) In signage program editing software 194 of the second embodiment, as illustrated in
(95) In this example, the first frame 294b1 and the second frame 294b2 are set so as not to control any robot, the third frame 294b3 is set as an area for controlling the first robot 31, and the fourth frame 294b4 is set as an area for controlling the second robot 32.
(96) The frame assigned for controlling a robot is not necessarily displayed on a layout screen when the frame is in conjunction with the frame assignment setting screen 294c illustrated in
(97) Content Output Processing of Display Apparatus
(98) In the display apparatus 20, as illustrated in
(99) The content files are output on the display apparatus 20 in order of the content files registered in each of the playlists of the respective frames. Specifically, in response to a content output instruction, the movie files d11, d12, and d13 registered in the first frame playlist p1 are sequentially played and the music file m11 registered in the second frame playlist p2 is also played.
(100) Operation Control of Robotic Device
(101) The first robot 31 and the second robot 32 are controlled by the signage player software 293 to perform an action and/or an utterance in accordance with the robot action and utterance files r10 and r20 transmitted by the display apparatus 20.
(102) Specifically, when the display apparatus 20 plays content, the display apparatus 20 also transmits the robot action and utterance files r10 and r20 to the first robot 31 and the second robot 32. The first robot 31 and the second robot 32 are controlled to execute sequentially the robot action and utterance files r11, r12, and r13, or the robot action and utterance files r21, r22, and r23 that are transmitted by the display apparatus 20.
(103) In this manner, by using the signage program editing software 194, when the display apparatus 20 outputs distributed content, robot operation data is transmitted to both two robots of the first robot 31 and the second robot 32, and the first robot 31 and the second robot 32 are accordingly controlled to perform actions and utterances, thereby synchronizing actions and utterances performed by the first robot 31 and the second robot 32 with the content output on the display apparatus 20.
(104) With this configuration, in the content distribution system 201 according to the second embodiment, in a case where the display apparatus 20 is communicably connected to multiple robots, such as the first robot 31 and the second robot 32, when the display apparatus 20 outputs distributed content, the display apparatus 20 transmits robot operation data to both two robots of the first robot 31 and the second robot 32, and the first robot 31 and the second robot 32 are accordingly controlled to perform actions and utterances, thereby synchronizing actions and utterances performed by the first robot 31 and the second robot 32 with the content output on the display apparatus 20. Third embodiment
(105) Next, a third embodiment of the present disclosure is described below with reference to the drawings. It should be noted that, for ease of description, configurations that are the sane as those of the first embodiment are denoted by the same reference numerals as in the first embodiment, and redundant descriptions thereof are omitted.
(106)
(107) Configuration of Content Distribution System
(108) A content distribution system 301 according to the third embodiment includes, similarly to the second embodiment, a display apparatus 20, which is communicably connected to two robots 30, and a content distribution apparatus 10, which is communicably connected to the display apparatus 20 and distributes content to the display apparatus 20, as illustrated in
(109) The first robot 31 and the second robot 32 are communicably connected to the display apparatus 20.
(110) In the third embodiment, as illustrated in
(111) In the robot action and utterance file r31, the configuration is set to control individually the first robot 31 and the second robot 32 to perform, in accordance with preset commands, actions and utterances, for example, 001: [Action] Bowing 1, 002: [Utterance] Hello . . . . as illustrated in
(112) In the third embodiment, similarly to the second embodiment, a frame assignment setting screen 394c of signage program editing software 194 is configured to set a frame in association with the first robot 31 and the second robot 32 as illustrated in
(113) Content Output Processing of Display Apparatus
(114) In the display apparatus 20, as illustrated in
(115) The content files are output on the display apparatus 20 in order of the content files registered in each of the playlists of the respective frames. Specifically, in response to a content output instruction, the movie files d11, d12, and d13 registered in the first frame playlist p1 are sequentially played and the music file m11 registered in the second frame playlist p2 is also played.
(116) Operation Control of Robotic Device
(117) The first robot 31 and the second robot 32 are controlled by the signage player software 293 to perform an action and/or an utterance in accordance with the robot action and utterance file r30 transmitted by the display apparatus 20.
(118) Specifically, when the display apparatus 20 plays content, the display apparatus 20 also transmits the robot action and utterance files r30 to the first robot 31 and the second robot 32.
(119) The first robot 31 and the second robot 32 are controlled to perform sequentially actions and/or utterances individually associated with either of the two robots in accordance with the robot action and utterance files r31, r32, and r33 transmitted by the display apparatus 20.
(120) In this manner, by using the signage program editing software 194, when the display apparatus 20 outputs distributed content, the display apparatus 20 also transmits robot operation data, which includes data about actions and/or utterances individually associated with either of the first robot 31 and the second robot 32, to two robots of the first robot 31 and the second robot 32 in accordance with the robot action and utterance file r30, and the first robot 31 and the second robot 32 are accordingly controlled to perform actions and/or utterances, thereby synchronizing actions and/or utterances performed by the first robot 31 and the second robot 32 with the content output on the display apparatus 20.
(121) With this configuration, in the content distribution system 301 according to the third embodiment, in a case where the display apparatus 20 is communicably connected to multiple robots, such as the first robot 31 and the second robot 32, when the display apparatus 20 outputs distributed content, the display apparatus 20 also transmits robot operation data, which includes data about actions and/or utterances individually associated with either of the first robot 31 and the second robot 32, to two robots of the first robot 31 and the second robot 32 in accordance with the robot action and utterance file r30, and the first robot 31 and the second robot 32 are accordingly controlled to perform actions and/or utterances, thereby synchronizing actions and/or utterances performed by the first robot 31 and the second robot 32 with the content output on the display apparatus 20.
(122) The present disclosure contains subject matter related to that disclosed in Japanese Priority Patent Application JP 2018-026164 filed in the Japan Patent Office on Feb. 16, 2018, the entire contents of which are hereby incorporated by reference.
(123) The present disclosure is not limited to the embodiments described above, and various modifications to the embodiments may be made without departing from the scope of the present disclosure. It should be understood that various modifications and alterations within the scope indicated in the appended claims may occur to those skilled in the art, and any embodiment obtained by combining technical functions modified as appropriate within the scope of the claims are also embraced within the technical scope of the present disclosure.