MOBILE TERMINAL APPARATUS AND METHOD FOR CONTROLLING DISPLAY OF THE MOBILE TERMINAL APPARATUS
20200026396 ยท 2020-01-23
Inventors
- KOHICHI MURAKAMI (Osaka, JP)
- Yasuhiro Nakai (Osaka, JP)
- KOHJI KATAMOTO (Osaka, JP)
- YASUTOMO HAYANO (Osaka, JP)
- MASAO SAEDA (Osaka, JP)
Cpc classification
G06F3/04847
PHYSICS
G06F3/1204
PHYSICS
International classification
G06F3/0484
PHYSICS
H04N1/00
ELECTRICITY
Abstract
A mobile terminal apparatus and a method for controlling display of the mobile terminal apparatus are display a plurality of thumbnail images in a thumbnail display area of a display screen, to receive an operation to choose a thumbnail image in the thumbnail display area in which the plurality of thumbnail images are displayed, to display an enlarged image of the chosen thumbnail image in an enlarged display area of the display screen, with the chosen thumbnail image kept displayed, to receive an operation to change a size of the enlarged display area on the display screen, and to increase an enlargement ratio of the enlarged image to fit the size of the enlarged display area when increasing the size of the enlarged display area.
Claims
1. A mobile terminal apparatus comprising: a display unit including a display screen; a display control program for displaying a plurality of thumbnail images respectively corresponding to a plurality of image data on the display screen to allow the plurality of thumbnail images to be chosen on the display screen; a control unit; and a storage unit storing the plurality of image data respectively corresponding to the plurality of thumbnail images, wherein the display control program causes the control unit to execute: a first control step of displaying the plurality of thumbnail images in a thumbnail display area of the display screen; a second control step of receiving an operation to choose a thumbnail image in the thumbnail display area in which the plurality of thumbnail images are displayed; a third control step of displaying an enlarged image of the chosen thumbnail image in an enlarged display area of the display screen, with the chosen thumbnail image kept displayed; a fourth control step of receiving an operation to change a size of the enlarged display area on the display screen; and a fifth control step of increasing an enlargement ratio of the enlarged image to fit the size of the enlarged display area when increasing the size of the enlarged display area.
2. The mobile terminal apparatus according to claim 1, wherein the fifth control step includes decreasing a display number of the thumbnail images by a number corresponding to an increase in the size of the enlarged display area.
3. The mobile terminal apparatus according to claim 1, wherein the third control step includes displaying the enlarged display area on the thumbnail display area in an overlapping manner.
4. The mobile terminal apparatus according to claim 1, wherein the fourth control step includes receiving the operation to change the size of the enlarged display area on the display screen, with the chosen thumbnail image kept displayed in the thumbnail display area.
5. The mobile terminal apparatus according to claim 4, wherein the second control step includes holding a state in which a previously chosen thumbnail image is chosen, and wherein the fourth control step includes receiving the operation to change the size of the enlarged display area on the display screen, with the chosen thumbnail image and the previously chosen thumbnail image kept displayed in the thumbnail display area.
6. The mobile terminal apparatus according to claim 1, wherein the fourth control step includes defining a largest display size of the enlarged display area and inhibiting the size of the enlarged display area from exceeding the largest display size.
7. The mobile terminal apparatus according to claim 1, wherein the fifth control step includes, when decreasing the size of the enlarged display area, decreasing the enlargement ratio of the enlarged image to fit the size of the enlarged display area.
8. The mobile terminal apparatus according to claim 7, wherein the fifth control step includes increasing a display number of the thumbnail images by a number corresponding to a decrease in the size of the enlarged display area.
9. The mobile terminal apparatus according to claim 1, wherein the first control step includes setting a size and a position of the thumbnail image to fit a size of the display screen.
10. The mobile terminal apparatus according to claim 1, wherein the first control step includes setting a display number of the thumbnail images to fit a size of the display screen.
11. The mobile terminal apparatus according to claim 1, wherein the fourth control step includes setting a predetermined largest display size of the thumbnail display area to fit a size of the display screen.
12. The mobile terminal apparatus according to claim 1, further comprising: a sixth control step of transmitting image data corresponding to the chosen thumbnail image to an image forming apparatus.
13. The mobile terminal apparatus according to claim 12, further comprising: a seventh control step of receiving installed function data on a function installed in the image forming apparatus from the image farming apparatus; and an eighth control step of displaying a preview of an image to be formed based on the image data on the display screen according to the installed function of the image forming apparatus.
14. The mobile terminal apparatus according to claim 13, wherein the installed function is a function of forming an image on a sheet of a preset specified size, and wherein the eighth control step includes displaying a preview of the image to be formed based on the image data on the display screen according to the specified size.
15. A method for controlling display of a mobile terminal apparatus displaying a plurality of thumbnail images respectively corresponding to a plurality of image data on a display screen to allow the plurality of thumbnail images to be chosen on the display screen, the method comprising: a first control step of displaying the plurality of thumbnail images in a thumbnail display area of the display screen; a second control step of receiving an operation to choose a thumbnail image in the thumbnail display area in which the plurality of thumbnail images are displayed; a third control step of displaying an enlarged image of the chosen thumbnail image in an enlarged display area of the display screen, with the chosen thumbnail image kept displayed; a fourth control step of receiving an operation to change a size of the enlarged display area on the display screen; and a fifth control step of increasing an enlargement ratio of the enlarged image to fit the size of the enlarged display area when increasing the size of the enlarged display area.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0011]
[0012]
[0013]
[0014]
[0015]
[0016]
[0017]
[0018]
[0019]
[0020]
[0021]
[0022]
[0023]
DESCRIPTION OF THE EMBODIMENTS
[0024] Embodiments of the present disclosure will be described hereinbelow with reference to the drawings. In the following description, like parts are identified by the same reference signs. The names and functions are also the same. Thus, the detailed descriptions thereof will not be repeated.
Configuration of Image Forming System
[0025]
[0026] An image forming system 100 illustrated in
[0027] The mobile terminal apparatus 10 and the image forming apparatus 20 respectively include short-range wireless communication units 10a and 20a for short-range wireless communication so as to communicate with each other. Examples of the short-range wireless communication include wireless local area network (LAN) communication and wireless personal area network (PAN) communication. An example of the wireless LAN communication is wireless LAN communication based on the IEEE802.11 standard, typified by the Wi-Fi standard. An example of the wireless PAN communication is wireless PAN communication based on the IEEE802.15 standard, typified by the Bluetooth standard. In this example, the wireless communication units 10a and 20a are communication interfaces based on the IEEE802.11 standard.
[0028] The mobile terminal apparatus 10 communicates with a server 30 outside the image forming system 100 via a predetermined communication tool, such as the Internet. The mobile terminal apparatus 10 and the server 30 respectively include wide-area wireless communication units 10b and 30b so as to communicate with each other. The server 30 stores image data uploaded from the mobile terminal apparatus 10 in a database DB. The mobile terminal apparatus 10 downloads the image data stored in the server 30. The image forming system 100 may include the server 30.
[0029] Examples of the communication tool for the mobile terminal apparatus 10 and the server 30 include a communication tool via the Internet based on a mobile phone communication standard and a communication tool via the wireless LAN communication based on the IEEE802.11 standard.
[0030] The mobile terminal apparatus 10 of the image forming system 100 illustrated in
Hardware Configuration of Mobile Terminal Apparatus
[0031]
[0032] As illustrated in
User Interface
[0033] The user interface 12 includes an output unit, such as the display unit 12a, and an input unit, such as the touch operation unit 12b and the operation button 12c. The user interface 12 can typically control start-up of a display control program DP and display image data.
Control Unit
[0034] The control unit 15 is a computer including a central processing unit (CPU). The control unit 15 executes a program P including the display control program DP, which is stored (installed) in the storage unit 16 in advance, to implement various functions necessary for the control unit 15. The control unit 15 executes various processes by loading the program P, such as the display control program DP, stored in advance in a read only memory (ROM) of the storage unit 16 onto a random access memory (RAM) of the storage unit 16 and executing the program P.
[0035] The control unit 15 controls transmission and reception of data during communication and various input and output operations and computational processing operations. Upon receiving a touch operation on the touch operation unit 12b on the display unit 12a using a user's finger, the control unit 15 reads the operation position with the touch operation unit 12b, determines that an operation button displayed on the operation position on the display unit 12a is pressed, and performs processing.
Storage Unit
[0036] The storage unit 16 includes a non-volatile memory, such as a RAM, and a volatile memory, such as a ROM. The storage unit 16 is subjected to write control in which information is written and read control in which information is read under instructions from the control unit 15. In this example, the storage unit 16 is a mass storage such as a flash memory.
[0037] The storage unit 16 stores (installs) the program P, such as the display control program DP, in advance. In this example, the display control program DP is a program, or a so-called application, for use in a multifunctional mobile communication terminal apparatus, such as a smartphone. The display control program DP is installed in advance or by being downloaded from a program server (not illustrated) via a communication tool, such as the Internet.
[0038] The storage unit 16 also stores image data IM, such as photographic data captured using a camera function of the mobile terminal apparatus 10 or photographic data taken from an external storage medium.
Short-Range Wireless Communication Unit
[0039] The short-range wireless communication unit 10a is capable of communication based on the same communication protocol as the communication protocol of the short-range wireless communication unit 20a of the image forming apparatus 20.
Wide-Area wireless Communication Unit
[0040] The wide-area wireless communication unit 10b is capable of communication based on the same communication protocol as the communication protocol of the wide-area wireless communication unit 30b of the server 30. The wide-area wireless communication unit 10b receives the image data IM stored in the server 30 from the server 30.
Software Configuration of Mobile Terminal Apparatus
[0041] The control unit 15 functions as a unit including a first control section Q1, a second control section Q2, a third control section Q3, a fourth control section Q4, and a fifth control section Q5. In other words, the display control program DP causes the control unit 15 to execute a first control step corresponding to the first control section Q1, a second control step corresponding to the second control section Q2, a third control step corresponding to the third control section Q3, a fourth control step corresponding to the fourth control section Q4, and a fifth control step corresponding to the fifth control section Q5.
[0042]
[0043] The display control program DP is a display control program for displaying a plurality of thumbnail images SN(1) to SN(n) corresponding to a plurality of image data IM(1) to IM(n) (n is an integer greater than or equal to 2) on the display screen G so that the plurality of thumbnail images SN(1) to SN(n) can be chosen on the display screen G. The storage unit 16 stores the plurality of image data IM(1) to IM(n) respectively corresponding to the plurality of thumbnail images SN(1) to SN(n). The display unit 12a includes the display screen G.
First Embodiment
First Control Step
[0044] At the first control step, the control unit 15 displays the plurality of thumbnail images SN(1) to SN(n) on a thumbnail display area of the display screen G (see
Second Control Step
[0045] At the second control step, the control unit 15 receives a choosing operation on the display screen G in which the plurality of thumbnail images SN(1) to SN(n) are displayed (in this example, n=24: 64) (see
Third Control Step
[0046] At the third control step, the control unit 15 displays an enlarged image E of the chosen thumbnail image SN(i) in an enlarged display area of the display screen G with the chosen thumbnail image SN(i) kept displayed (see
Fourth Control Step
[0047] At the fourth control step, the control unit 15 receives an operation to change the size of the enlarged display area of the display screen G (see
Fifth Control Step
[0048] When increasing the size of the enlarged display area is, then at the fifth control step, the control unit 15 increases the magnification ratio of the enlarged image E to fit the size of the enlarged display area (see
[0049] Thereafter, when [Finish] button F2 (see
[0050] The image forming apparatus 20 prints the image data IM transmitted from the mobile terminal apparatus 10 after print setting.
Description of the Present Embodiment
[0051] According to the present embodiment, the control unit 15 displays the plurality of thumbnail images SN(1) to SN(n) in the thumbnail display area of the display screen G (the first control step: see
[0052] When the user wants to return the enlarged image E of the thumbnail image SN(i) to the original size, the user performs a size-reducing operation on the enlarged display area . Then, the control unit 15 reduces the size of the enlarged display area to the original size (the fifth control step: see
Second Embodiment
[0053] In the present embodiment, the control unit 15 decreases the number of thumbnail images displayed by a number corresponding to an increase in the size of the enlarged display area (the fifth control step: see
Third Embodiment
[0054] In the present embodiment, the control unit 15 displays the enlarged display area on the thumbnail display area in an overlapping manner (the third control step: see
Fourth Embodiment
[0055] In the present embodiment, the control unit 15 receives an operation to change the size of the enlarged display area of the display screen G, with the chosen thumbnail image SN(i) kept displayed in the thumbnail display area (the fourth control step: see
FIFTH EMBODIMENT
[0056] In the present embodiment, the control unit 15 holds a state in which a thumbnail image SN(j) is chosen (j is an integer from 1 to n other than i, in this example, j=11, 15) (the second control step: see
[0057] This allows the enlarged display area to be enlarged, with the chosen thumbnail image SN(i) and the held thumbnail image SN(j) kept displayed in the thumbnail display area . Thus, the chosen thumbnail image SN(i) and the held thumbnail image SN(j) can be held even when the enlarged display area is enlarged.
[0058] Alternatively, the control unit 15 may be configured, when the user touches the thumbnail image SN(i) on the display screen G, to cancel the choice of the thumbnail image SN(j) chosen before, to display the enlarged image E of the thumbnail image SN(i) chosen this time in the enlarged display area of the display screen G, with the thumbnail image SN(i) kept displayed (the third control step), and to receive an operation to change the size of the enlarged display area of the display screen G (the fourth control step).
Sixth Embodiment
[0059] The size of the display screen G varies depending on the model of the mobile terminal apparatus 10, so that it is difficult to specify the resolution of the enlarged image E in advance. This makes the process of enlarging the enlarged image E corresponding to the thumbnail image complicated. In particular, an apparatus provided with a control unit 15 whose processing speed is low takes a long processing time, which makes it difficult to smoothly display the enlarged image E at the time of enlargement. This is particularly prominent in the case where the mobile terminal apparatus 10 in which the display control program DP is installed is a standard apparatus (for example, ANDROID).
[0060] In this respect, the control unit 15 of the present embodiment specifies a predetermined largest display size for the enlarged display area so that the enlarged display area does not exceed the largest display size (the fourth control step).
[0061] This allows the resolution of the enlarged image E to be specified in advance. This makes it easy to enlarge the enlarged image E corresponding to the thumbnail image SN(i). In particular, this reduces the processing time even if the processing speed of the control unit 15 is low, allowing the enlarged image E to be smoothly displayed at the time of enlargement. The mobile terminal apparatus 10 has information on the size of the display screen G of the mobile terminal apparatus 10 itself. The control unit 15 uses the information on the size of the display screen G of the mobile terminal apparatus 10 itself in the display control program DP.
Seventh Embodiment
[0062] In the present embodiment, when decreasing the size of the enlarged display area , the control unit 15 decreases the enlargement ratio of the enlarged image E to fit the size of the enlarged display area (the fifth control step). This allows the enlarged image E to be displayed all over the enlarged display area .
Eighth Embodiment
[0063] In the present embodiment, the control unit 15 increases the number of thumbnail images displayed by a number corresponding to a decrease in the size of the enlarged display area (the fifth control step: see
Ninth Embodiment
[0064] The size of the display screen G varies depending on the model of the mobile terminal apparatus 10, so that a desired number of thumbnail images SN(1) to SN(n) may not be displayed on the display screen G, or the thumbnail images SN(1) to SN(n) may be displaced depending on the size of the thumbnail images SN(1) to SN(n). This is particularly prominent in the case where the mobile terminal apparatus 10 is a standard apparatus.
[0065] In this respect, the control unit 15 of the present embodiment sets the size and the positions of the thumbnail images SN(1) to SN(n) to fit the size of the display screen G (the first control step: see
Tenth Embodiment
[0066] The size of the display screen G varies depending on the model of the mobile terminal apparatus 10, so that, depending on the number of thumbnail images SN(1) to SN(n) displayed, the thumbnail images SN(1) to SN(n) may be too small for the user to recognize the thumbnail images SN(1) to SN(n). This is particularly prominent in the case where the mobile terminal apparatus 10 is a standard apparatus.
[0067] In this respect, the control unit 15 of the present embodiment sets the number of thumbnail images SN(1) to SN(n) displayed to fit the size of the display screen G (the first control step). Specifically, the control unit 15 sets the number of thumbnail images SN(1) to SN(n) displayed larger as the display screen G is smaller. This makes the thumbnail image SN(i) to a size easy for the user to recognize regardless of the size of the display screen G of the mobile terminal apparatuses 10 of various types.
Eleventh Embodiment
[0068] In the present embodiment, the control unit 15 sets a predetermined largest display size of the thumbnail display area to fit the size of the display screen G (the fourth control step: see
Twelfth Embodiment
[0069] In the present embodiment, the control unit 15 functions as a unit further including a sixth control section Q6. In other words, the display control program DP causes the control unit 15 to execute steps further including a sixth control step corresponding to the sixth control section Q6.
[0070] At the sixth control step, the control unit 15 transmits image data IM corresponding to the chosen thumbnail image SN(i) to the image forming apparatus 20. This allows the image data IM in the mobile terminal apparatus 10 to be received by the image forming apparatus 20, allowing an image based on the image data IM to be printed by the image forming apparatus 20.
Thirteenth Embodiment
[0071] Some of the image forming apparatuses 20, 21, . . . (the image forming apparatuses 21 . . . are not illustrated) operating in the field can print on sheets of Japanese standard L size [89 mm127 mm] and sheets of Japanese standard 2L size [127 mm178 mm] or more, others can only print on sheets of A4size [210 mm297 mm] or sheets of A4 size or more. Thus, the image forming apparatuses 20, 21, . . . have different functions. Thus, when the mobile terminal apparatus 10 transmits image data IM corresponding to the chosen thumbnail image SN(i) to the image forming apparatus 20, an image to be formed (a target image) based on the image data IM is previewed on the display screen of the operation unit of the image forming apparatus 20 according to the function of the image forming apparatus 20. Because of this, part of the image data IM may not be displayed depending on the size (aspect ratio) of the image data IM transmitted from the mobile terminal apparatus 10.
[0072] For example, if the image size of the image data IM corresponding to the chosen thumbnail image SN(i) is L size, while the image forming apparatus 20 to which the image data IM is transmitted does not have a function for-printing L-size sheets, the image data IM is previewed on the display screen of the image forming apparatus 20, with part of the image data IM missing. For this reason, after transmitting the image data IM from the mobile terminal apparatus 10 to the image forming apparatus 20, the user has to process the image data IM to fit the function provided for the image forming apparatus 20 with the mobile terminal apparatus 10 and transmit the processed image data IM to the image forming apparatus 20 again. Thus, the user has to transmit the image data IM to the image forming apparatus 20 twice, which takes much time and labor for the transmission operation.
[0073] In this respect, the control unit 15 of the present embodiment functions as a unit further including a seventh control section Q7 and an eighth control section Q8. In other words, the display control program DP causes the control unit 15 to execute a seventh control step corresponding the seventh control section Q7 and an eighth control step corresponding to the eighth control section Q8.
[0074] At the seventh control step, the control unit 15 receives function data on the functions of the image forming apparatus 20 from the image forming apparatus 20. At the eighth control step, the control unit 15 previews the target image based on the image data IM on the display screen G of the display unit 12a according to the function provided for the image forming apparatus 20.
[0075] This allows the control unit 15 of the mobile terminal apparatus 10 to preview the target image based on the image data IM on the display screen G of the display unit 12a according to the function of the image forming apparatus 20. This allows the user to process the image data IM with the mobile terminal apparatus 10 so as to fit the function of the image forming apparatus 20 before transmitting the image data IM to the image forming apparatus 20. Thus, the user can transmit the image data IM in the mobile terminal apparatus 10 to the image forming apparatus 20 at one time, which can save the time and labor for the transmission operation.
[0076] An example of the installed function is a function of forming images on sheets of a preset specified size (L-size, 2L-size, or A4-size). The control unit 15 previews a target image based on the image data IM on the display screen G of the display unit 12a according to the specified size (the eighth control step).
[0077]
[0078] For example, the control unit 15 displays a preview of a photographic image based on the image data IM on the display screen G of the display unit 12a according to L size or 2L size (see
[0079] If the image based on the image data IM corresponding to the chosen thumbnail image SN(i) is an L-size photographic image, a 2L-size photographic image, an A4-size monochrome double-sided image, or an A3-size color single-sided image, but the image forming apparatus 20 to which the image data IM is transmitted does not have a support function, the control unit 15 displays a message that the image data IM is not printed by the image forming apparatus 20 on the display screen G of the display unit 12a of the mobile terminal apparatus 10 (see
[0080] The image forming system 100 includes the mobile terminal apparatus 10 and the image forming apparatus 20.
[0081] In the present embodiment, the control unit 15 of the mobile terminal apparatus 10 functions as a unit further including a ninth control section Q9 and a tenth control section Q10. In other words, the display control program DP causes the control unit 15 to execute a ninth control step corresponding to the ninth control section Q9 and a tenth control step corresponding to the tenth control section Q10.
[0082] At the ninth control step, the control unit 15 transmits image data IM(i) and IM(j) corresponding to chosen thumbnail images SN(i) and SN(j) to the server 30. At the tenth control step, the control unit 15 receives image data IM(i) and IM(j) stored in the database DB of the server 30. The server 30 stores the image data IM(i) and IM(j) transmitted from the mobile terminal apparatus 10 in the database DB.
[0083] This allows the user to store the image data IM(i) and IM(j) corresponding to the thumbnail images SN(i) and SN(j) chosen in the mobile terminal apparatus 10 in the database DB of the server 30. The user can receive the image data IM(i) and IM(j) stored in the database DB of the server 30 with the mobile terminal apparatus 10.
[0084] Image data IM printed with the image forming apparatus 20 of a first model installed in a first installation site is stored in the database DB of the server 30 in advance. If the image data IM is to be printed with the image forming apparatus 21 of a second model installed in a second installation site, the image forming apparatus 21 may not have the function installed in the image forming apparatus 20.
[0085] In this respect, the control unit 15 of the mobile terminal apparatus 10 of the present embodiment can display a preview of an image based on the image data IM stored in the server 30 on the display screen G of the display unit 12a according to the function installed in the image forming apparatus 20. This allows the user to process the image data IM to fit the function installed in the image forming apparatus 20 using the mobile terminal apparatus 10 before transmitting the image data IM stored in the server 30 to the image forming apparatus 20. Thus, the user can transmit the image data IM in the mobile terminal apparatus 10 to the image forming apparatus 20 at one time, which can save the time and labor for the transmission operation.
[0086] The present disclosure contains subject matter-related to that disclosed in Japanese Priority Patent Application JP 2018-137602 filed in the Japan Patent Office on Jul. 23, 2018, the entire contents of which are hereby incorporated by reference.
[0087] It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and alterations may occur depending on design requirements and other factors insofar as they are within the scope of the appended claims or the equivalents thereof.