IMAGE PROCESSING SYSTEM, REMOTELY CONTROLLED SHOOTING ASSEMBLY AND EXPOSURE INFORMATION PROMPT METHOD
20170280038 ยท 2017-09-28
Inventors
Cpc classification
B64U2101/30
PERFORMING OPERATIONS; TRANSPORTING
H04N23/66
ELECTRICITY
G06T7/80
PHYSICS
B64U2201/10
PERFORMING OPERATIONS; TRANSPORTING
B64C39/024
PERFORMING OPERATIONS; TRANSPORTING
H04N23/70
ELECTRICITY
H04N23/667
ELECTRICITY
International classification
Abstract
An image processing system includes an image receiving unit configured to receive a picture sent by a remote shooting apparatus, an image analysis unit configured to analyze the picture to obtain exposure situations of respective parts in the picture, an exposure evaluation unit configured to evaluate exposure conditions of the respective parts in the picture based on the exposure situations of the respective parts in the picture to determine whether the respective parts in the picture are overexposed and determine overexposed parts, and an exposure information prompt unit configured to prompt an evaluation result in accordance with evaluation of the exposure evaluation unit.
Claims
1. An image processing system, comprising: an image receiving unit configured to receive a picture sent by a remote shooting apparatus; an image analysis unit configured to analyze the picture to obtain exposure situations of respective parts in the picture; an exposure evaluation unit configured to evaluate exposure conditions of the respective parts in the picture based on the exposure situations of the respective parts in the picture, to determine whether the respective parts in the picture are overexposed and determine overexposed parts; and an exposure information prompt unit configured to prompt an evaluation result in accordance with evaluation of the exposure evaluation unit.
2. The image processing system of claim 1, wherein the imaging device is disposed on a mobile platform.
3. The image processing system of claim 2, wherein the mobile platform is an unmanned aerial vehicle, and the imaging device is disposed on the unmanned aerial vehicle through a gimbal.
4. The image processing system of claim 1, further comprising: a shooting parameter acquisition unit configured to acquire shooting parameters of the remote shooting apparatus; and a shooting parameter setting unit configured to calculate suitable shooting parameters in accordance with the shooting parameters obtained by the shooting parameter acquisition unit and the evaluation result of the exposure evaluation unit.
5. The image processing system of claim 4, wherein the shooting parameter setting unit corrects the shooting parameters in accordance with the evaluation result to obtain the suitable shooting parameters.
6. The image processing system of claim 4, wherein the shooting parameter setting unit transmits the suitable shooting parameters to a display screen of a mobile terminal for the display screen to display the suitable shooting parameters to a user.
7. The image processing system of claim 4, wherein the shooting parameters comprise at least one of an aperture size, a shutter speed, or an ISO film speed.
8. The image processing system of claim 4, further comprising: a command generation unit configured to generate a control command in accordance with the suitable shooting parameters; and a sending unit configured to transmit the control command to the remote shooting apparatus.
9. The image processing system of claim 8, wherein the control command comprises the suitable shooting parameter or includes a command generated in accordance with the suitable shooting parameter for controlling the remote shooting apparatus.
10. An exposure information prompt method, comprising: receiving a picture from a remote shooting apparatus; displaying the picture; analyzing the picture to obtain exposure situations of respective parts in the picture; evaluating exposure conditions of the respective parts in the picture in accordance with the exposure situations of the respective parts in the picture, to determine whether the respective parts in the picture are overexposed; and highlighting an overexposed part in the picture if an overexposure situation exists in the picture.
11. The exposure information prompt method of claim 10, wherein highlighting the overexposed part includes at least one of marking the overexposed parts with a pattern of a zebra crossing, highlighting the overexposed parts in a blinking manner, or displaying the overexposed parts in a particular color.
12. The exposure information prompt method of claim 10, further comprising: performing picture shooting using current shooting parameters if the overexposure situation does not exist in the picture.
13. The exposure information prompt method of claim 10, further comprising: acquiring shooting parameters of the picture.
14. The exposure information prompt method of claim 13, wherein the shooting parameters comprise at least one of an aperture size, a shutter speed, or an ISO film speed.
15. The exposure information prompt method of claim 13, further comprising: calculating suitable shooting parameters in accordance with the acquired shooting parameters and an evaluation result of the picture.
16. The exposure information prompt method of claim 15, wherein calculating the suitable shooting parameters includes correcting the shooting parameters corresponding to the picture in accordance with the evaluation result to obtain the suitable shooting parameters.
17. The exposure information prompt method of claim 15, further comprising: generating a control command in accordance with the suitable shooting parameters.
18. The exposure information prompt method of claim 17, wherein the control command comprises the suitable shooting parameter or includes a command generated in accordance with the suitable shooting parameter for controlling the remote shooting apparatus.
19. The exposure information prompt method of claim 10, wherein evaluating the exposure conditions of the respective parts in the picture further includes evaluating the exposure conditions of the respective parts to determine whether the respective parts of the picture are underexposed, the method further comprising: performing picture shooting in accordance with current shooting parameters if underexposure does not exist.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0066]
[0067]
[0068]
[0069]
DESCRIPTION OF MAIN REFERENCE NUMERALS
[0070]
TABLE-US-00001 TABLE 1 Remotely controlled shooting 100 assembly Mobile terminal 10 Display screen 11 First receiver/sender 13 Image processing system 12 Receiving unit 121 Image analysis unit 122 Exposure evaluation unit 123 Exposure information prompt unit 124 Shooting parameter acquisition unit 125 Shooting parameter setting unit 126 Command generation unit 127 Sending unit 128 Display unit 129 Remote shooting apparatus 20 Carrier 21 Second receiver/sender 211 Image capturing element 22
[0071] Embodiments of the present disclosure are further described below in combination with the accompanying drawings.
DETAILED DESCRIPTION OF THE EMBODIMENTS
[0072] Referring to
[0073] In some embodiments, the mobile terminal 10 further controls movement of the remote shooting apparatus 20, to make the remote shooting apparatus 20 shoot a picture in different environments, occasions and/or positions.
[0074] The mobile terminal 10 is an electronic device having a display screen 11, and the display screen 11 may be used for displaying an image/video returned by the remote shooting apparatus 20. Specifically, the mobile terminal 10 may be a mobile phone, a tablet computer, a notebook computer, a desktop computer or the like.
[0075] The mobile terminal 10 includes a first receiver/sender 13 used for receiving the image/video and the shooting parameter from the remote shooting apparatus 20.
[0076] Referring to
[0077] The receiving unit 121 is used for receiving the image/video and the shooting parameter returned by the remote shooting apparatus 20. The receiving unit 121 may receive the image/video and the shooting parameters returned by the remote shooting apparatus 20 in a wired and/or wireless manner.
[0078] The image analysis unit 122 is used for analyzing the image/video received by the receiving unit 121, to obtain exposure situations of respective parts in the image/video picture.
[0079] The exposure evaluation unit 123 is used for evaluating exposure conditions of the respective parts in the video/image picture in accordance with the exposure situations of the respective parts in the video/image picture obtained by the image analysis unit 122, to determine whether or not the respective parts in the video/image picture are overexposed and determine overexposed parts. In addition, in other embodiments, the exposure evaluation unit 123 further evaluates an underexposure situation of the video/image picture.
[0080] The exposure information prompt unit 124 is used for prompting the overexposed part in the image/video picture to the user in accordance with an evaluation result of the exposure evaluation unit 123. Specifically, the exposure information prompt unit 124 marks an overexposed part in the picture displayed in the display screen 11. In the embodiment, the overexposed parts in the picture displayed in the display screen 11 are marked with a pattern similar to a zebra crossing. Optionally, the overexposed parts in the picture displayed in the display screen 11 are highlighted in a blinking manner, or the overexposed parts in the picture displayed in the display screen 11 are displayed in a particular color.
[0081] The shooting parameter acquisition unit 125 is used for acquiring the shooting parameters of the remote shooting apparatus 20, and the shooting parameters include, but is not limited to, an aperture size, a shutter speed and an ISO film speed.
[0082] The shooting parameter setting unit 126 obtains by calculation shooting parameters that make the picture displayed by the display screen 11 obtain a suitable degree of exposure in accordance with the shooting parameters obtained by the shooting parameter acquisition unit 125 and the evaluation result of the exposure evaluation unit 123. In the embodiment, the shooting parameter setting unit 126 at least sets one parameter in an aperture size, a shutter speed and an ISO film speed.
[0083] Specifically, the shooting parameter setting unit 126 corrects shooting parameters corresponding to the image/video picture in accordance with an evaluation result for an exposure condition of the image/video picture, to obtain reset shooting parameters. For example, if the image/video picture is overexposed, the shutter speed is increased, the aperture is decreased and/or the ISO film speed is reduced appropriately; if the image/video picture is underexposed, the shutter speed is decreased, the aperture is increased and/or the ISO film speed is increased appropriately.
[0084] Shooting parameters set by the shooting parameter setting unit 126 can be transmitted to the display unit 129, and the display unit 129 displays the set shooting parameters to a user, so that the user can manually operate the remote shooting apparatus 20 to shoot a picture in accordance with the shooting parameters.
[0085] The command generation unit 127 is used for generating a corresponding control command in accordance with the shooting parameters set by the shooting parameter setting unit 126. The control command may only include the shooting parameters set by the shooting parameter setting unit 126, and may also be a command, which is generated in accordance with the shooting parameters, of controlling the remote shooting apparatus 20 to shoot a picture in accordance with the shooting parameters set by the shooting parameter setting unit 126. When the control command only includes the shooting parameters set by the shooting parameter setting unit 126, the remote shooting apparatus 20 may, in accordance with the shooting parameters set by the shooting parameter setting unit 126, shoot a picture on its own according to the shooting parameters.
[0086] The sending unit 128 is used for transmitting the control command generated by the command generation unit 127 to the remote shooting apparatus 20. The sending unit 128 may transmit the control command to the remote shooting apparatus 20 in a wired and/or wireless manner. It can be understood that the functions of the sending unit 128 and the receiving unit 121 can be implemented by the first receiver/sender 13. In addition, the command of controlling the remote shooting apparatus 20 to move is also sent to the remote shooting apparatus 20 through the sending unit 128.
[0087] The display unit 129 is used for displaying the image/video received by the mobile terminal 10 to a user, displaying an overexposed part in the image/video picture to the user, and displaying the shooting parameter of the image/video picture and the reset shooting parameter to the user. It can be understood that the function of the display unit 129 can be implemented by the display screen 11.
[0088] The remote shooting apparatus 20 includes a carrier 21 and an image capturing element 22 disposed on the carrier 21.
[0089] The carrier 21 is used for carrying the image capturing element 22. Specifically, the carrier 21 may be stationary and may also be moving. For example, the stationary carrier 21 may be a structure (for example, a street sign, a billboard, an upright post, a cross bar, a wall and so on) or a natural object (for example, a big tree, hillstone and so on); the moving carrier 21 may be a vehicle, a ship, an aerial vehicle, a human being or an animal and so on. In the embodiment, the carrier 21 is a movable platform, and specifically, the carrier is an Unmanned Aerial Vehicle (UAV). The UAV may be a rotor aircraft (for example, a helicopter or a rotorcraft), an aerial vehicle having a fixed wing and a rotor, or an aerial vehicle neither having a fixed wing nor having a rotor (for example, a blimp or a hot air balloon).
[0090] The carrier 21 includes a second receiver/sender 211, and the second receiver/sender 211 may establish communication with the first receiver/sender 13, to transmit information between the remote shooting apparatus 20 and the mobile terminal 10. In the embodiment, the second receiver/sender 211 has information sending and receiving functions at the same time.
[0091] The second receiver/sender 211 and the first receiver/sender 13 can implement mutual communication therebetween in a wired manner such as by using cables or optical fibers, and can also implement mutual communication therebetween in a wireless manner such as by using local area networks, wide area networks, infrared, radio, Wi-Fi, 2G networks, 3G networks, 4G networks, 5G networks, point-to-point (P2P) networks, telecommunication networks or cloud networks. Optionally, in wireless communication, it is possible to use a relay station, for example, a signal tower, a satellite, or a mobile base station or the like. The wireless communication may be short-range or non short-range.
[0092] The image capturing element 22 is used for acquiring an image of a scene/object to be shot and transmitting the obtained image/video to the second receiver/sender 211. In the embodiment, the image capturing element 22 transmits the obtained image/video to the second receiver/sender 211 in a real time manner.
[0093] In the embodiment, the image capturing element 22 is a digital camera, and specifically, the image capturing element 22 is a CCD (Charge-coupled Device) type or a CMOS (Complementary Metal Oxide Semiconductor) type digital camera.
[0094] It can be understood that the second receiver/sender 211 may also be directly integrated onto the image capturing element 22.
[0095] Referring to
[0096] S01, an image/video returned by a remote shooting apparatus is received. This step can be completed in a wired and/or wireless communication manner.
[0097] S02, the received image/video picture is displayed.
[0098] S03, the received image/video is analyzed, to obtain exposure situations of respective parts in the image/video picture.
[0099] S04, exposure conditions of the respective parts in the video/image picture are evaluated in accordance with the exposure situations of the respective parts in the image/video picture obtained by the analysis unit, to determine whether or not the respective parts in the image/video picture are overexposed and determine overexposed parts.
[0100] S05, an overexposed part in the image/video picture is highlighted if an overexposure situation exists in the image/video picture. Specifically, the overexposed parts are marked with a pattern similar to a zebra crossing, the overexposed parts are displayed in a blinking manner, or the overexposed parts are displayed in a particular color.
[0101] S06, shooting is performed by using current shooting parameters if an overexposure situation does not exist in the image/video picture.
[0102] Referring to
[0103] S11, an image/video returned by a remote shooting apparatus is received. This step can be completed in a wired and/or wireless communication manner.
[0104] S12, the received image/video picture is displayed.
[0105] S13, the received image/video is analyzed, to obtain exposure situations of respective parts in the image/video picture.
[0106] S14, exposure conditions of the respective parts in the video/image picture are evaluated in accordance with the exposure situations of the respective parts in the image/video picture obtained by the analysis unit, to determine whether or not the respective parts in the image/video picture are overexposed or underexposed and determine overexposed parts in the image/video picture.
[0107] S15, the overexposed part in the image/video picture is highlighted if an overexposure situation exists in the image/video picture. Specifically, the overexposed parts are marked with a pattern similar to a zebra crossing, the overexposed parts are displayed in a blinking manner, or the overexposed parts are displayed in a particular color.
[0108] S16, a shooting parameter of a current image/video picture is acquired. The shooting parameter includes, but is not limited to, an aperture size, a shutter speed and an ISO film speed.
[0109] S17, a shooting parameter that makes the picture obtain a suitable degree of exposure is obtained by calculation in accordance with the acquired shooting parameter and an evaluation result for the image/video picture. In the implementation, the shooting parameter obtained by calculation at least includes one parameter in an aperture size, a shutter speed and an ISO film speed.
[0110] Specifically, it is feasible to correct shooting parameters corresponding to the image/video picture in accordance with an evaluation result for an exposure condition of the image/video picture, to obtain reset shooting parameters. For example, if the image/video picture is overexposed, the shutter speed is increased, the aperture is decreased and/or the ISO film speed is reduced appropriately; if the image/video picture is underexposed, the shutter speed is decreased, the aperture is increased and/or the ISO film speed is increased appropriately.
[0111] S18, a corresponding control command is generated in accordance with the shooting parameters obtained by calculation. The control command may only include the shooting parameters obtained by calculation, and may also be a command, which is generated in accordance with the shooting parameters, of controlling the remote shooting apparatus to shoot a picture in accordance with the shooting parameters obtained by calculation. When the control command only includes the shooting parameters obtained by calculation, the remote shooting apparatus may, in accordance with shooting parameters obtained by calculation, shoot a picture on its own according to the shooting parameters.
[0112] S19, the generated control command is sent to the remote shooting apparatus. In this step, it is feasible to transmit the control command to the remote shooting apparatus in a wired and/or wireless manner.
[0113] S20, if it is judged in step S14 that an overexposure or underexposure situation does not exist in the image/video picture, shooting is performed by using current shooting parameters.
[0114] The image processing system, the remotely controlled shooting assembly, the mobile terminal and the exposure information prompt method, by displaying, in the mobile terminal 10, an overexposed part in an image/video picture returned by a remote shooting apparatus, can thus rapidly and conveniently understand, in real time, an exposure situation of the image/video picture shot by the remote shooting apparatus, so as to shoot an image/video in line with user requirements; in addition, the mobile terminal 10 sets shooting parameters in accordance with evaluation for an exposure situation of the image/video picture, which can enhance operational convenience of the system, and is more intelligent and convenient especially for users without shooting experience.
[0115] It can be understood that a person skilled in the art can also make other changes and the like to be used in the design of the present disclosure within the spirit of the present disclosure, as long as the changes do not depart from the technical effect of the present disclosure. The changes made in accordance with the spirit of the present disclosure should all be included in the scope of the present disclosure.