System, method and apparatus for networking independent synchronized generation of a series of images

11258939 · 2022-02-22

    Inventors

    Cpc classification

    International classification

    Abstract

    System, Method and Apparatus for generating a collection of images, the technique including providing at least two mobile devices with a data processing unit, a storage memory and a camera integrated therein or connected thereto; providing a master system with a data processing unit and a storage memory or configuring of one of the mobile devices as master system and configuring of the other or of all mobile devices as slave systems; setting a recording criterion in the master system; transmitting the recording criterion to the slave systems; setting a series ending criterion in the master system; transmitting the series ending criterion to the slave systems; respectively performing a process for recording an image on each slave system as long as the series ending criterion is not fulfilled comprising the steps of recording at least one image with the camera of one of the slave systems whenever the recording criterion is fulfilled, and sending the image from the slave system to the master system together with a time stamp, a series number and/or another variable for grouping the image; saving each of the images sent respectively with their time stamp, their series number and/or their variable for grouping in the storage memory of the master system; and generating a series of images comprising the images sent in order according to their time stamp, their series number and/or their variable for grouping.

    Claims

    1. A method for generating images comprising the steps of: a) providing at least two devices with a storage memory and a camera integrated therein or connected thereto; b) providing a master system with a storage memory or configuring of one of the devices as the master system and configuring of the other or of all devices as slave systems; c1) setting a recording criterion in the master system; d1) transmitting the recording criterion to the slave systems and saving the recording criterion in each slave system; c2) setting a series ending criterion in the master system; d2) transmitting the series ending criterion from the master system to the slave systems and saving the series ending criterion in each slave system; e) respectively performing on each said slave system a process for recording an image on each slave system as long as the series ending criterion is not fulfilled comprising the steps: e1) recording at least one image with the camera of one of the respective slave systems whenever the recording criterion is fulfilled for that respective slave system; and e2) sending the image from the respective slave system to the master system.

    2. The method according to claim 1, wherein the recording criterion or a single subcondition thereof is a relative position of the slave system to another slave system and/or to the master system.

    3. The method according to claim 1, wherein sending and receiving only takes place when the recording criterion or a single subcondition thereof is a specific signal of the master system or of one of the and at least one slave system; and wherein no sending and receiving takes place between the slave systems.

    4. The method according to claim 1, wherein the camera of one of the slave systems is continuously or in phases in a recording condition and collects optical data, wherein the slave system and/or the master system comprises an image recognition software for analyzing this optical data, and wherein the recording criterion or a single subcondition thereof is the identification of a certain pattern or a certain structure by the image recognition software and/or is the comparison with other patterns, structure and/or images by the image recognition software.

    5. The method according to claim 1, wherein in case of a breakdown of communications between the master system and/or the mobile devices are connected with a network, for example the Internet, and the slave system each mobile device starts and/or continues with step e) and performs step e1) based on the stored recording criterion or a single subcondition thereof is a receipt of certain electronic signals from the network.

    6. The method according to claim 1, wherein the master system is configured to react with a receipt confirmation upon receiving an image in step e2).

    7. The method according to claim 1, wherein the slave system is configured to save the image, especially permanently or in case of interruption of a connection of the slave system with the master system and/or in case of failure of a sending according to step e2), and wherein it is sent again at a later point in time in case of restoration of the contact and/or together with the sending of another image in a later step e2).

    8. The method according to claim 1, wherein step b) comprises sending an invitation signal from the master system to the mobile devices, wherein preferably the invitation signal comprises program data for the configuration as slave system or connection information for receiving such program data.

    9. The method according to claim 1, wherein the master system is configured to send recording criterion and series ending criterion, preferably upon manual activation, to a slave system, which does not yet perform step e) and which is preferably newly configured, wherein this slave system afterwards performs step e) as well.

    10. The method according to claim 1, wherein the master system is at the same time configured as slave system and furthermore configured to not perform step e) for itself or to interrupt the step e), especially upon manual activation.

    11. A method according to claim 1, wherein additionally a second recording criterion and a second series ending criterion are set, wherein step e) comprises furthermore the steps, preferably repeatedly: e3) recording at least one image with the camera of the slave system whenever the second recording criterion is fulfilled and the second series ending criterion is not fulfilled; and e4) sending the image from the slave system to the master system together with a time stamp of the image; wherein preferably the second recording criterion is receiving a confirmation signal that all slave systems have executed step e2) and/or in case of repetition have executed step e4).

    12. A method according to claim 1, wherein an image criterion is set in step c1) or c2) and is send in step d1) or d2) to the slave systems, wherein the image criterion comprises parameters of the image recording like for example zoom, number of pixels, sharpness or the like, wherein the image recording in step e1) takes place according to the image criterion and/or wherein the image recording in step e1) takes place when the image criterion is fulfilled.

    13. The method according to claim 1, wherein the slave systems are divided in primary slave systems and sub slave systems or are configured as such, wherein to every primary slave system at least one of the sub slave systems is assigned to, wherein in the primary slave system the recording criterion for all of the corresponding sub slave systems can be set or can be varied according to limits set in the master system.

    14. The method according to claim 1, wherein step e1) is always recording at least one image with the camera of the respective slave system whenever the recording criterion is fulfilled for that respective slave system and the series ending criterion is not fulfilled for that respective slave system.

    15. The method according to claim 1, wherein the recording criterion is fulfilled several times before the series ending criterion is fulfilled.

    16. The method according to claim 1, wherein several recording criteria are set in step c1); wherein these several recording criteria are transmitted and saved in step d1); and wherein in step e1) recording at least one image with the camera of the respective slave system always takes place whenever at least one of the several recording criteria is fulfilled for that respective slave system.

    17. The method according to claim 1, wherein both the recording criterion and the series ending criterion is one selected from the group consisting of position, time, elapsed time, distance to other devices or points, bodily characteristics of the user, receiving certain signals, certain reciprocal communication, certain activities/messages/signals in networks, confirmation or command signals of the master system, air pressure, temperature, humidity or speed of the slave system; and wherein the selection is different for the recording criterion and the series ending.

    18. A system for generating a collection of images comprising: a group of mobile devices, wherein at least one of said mobile devices is configured as a master system, and wherein at least one of said mobile devices is configured as a slave system, wherein said group of mobile devices carries out the steps of claim 1.

    19. A method for generating images comprising the steps of: a) providing at least two devices with a storage memory and a camera integrated therein or connected thereto; b) providing a master system with a storage memory or configuring of one of the devices as the master system and configuring of the other or of all devices as slave systems; c1) setting a recording criterion in the master system; d1) transmitting the recording criterion to the slave systems and saving the recording criterion in each slave system; e) respectively performing on each said slave system a process for recording an image on each slave system comprising the steps: e1) recording at least one image with the camera of one of the respective slave systems whenever the recording criterion is fulfilled for that respective slave system; and e2) sending the image from the respective slave system to the master system together with a time stamp, a series number and/or another variable for grouping the image; f) saving each of the images send respectively in step e2) with their time stamp, their series number and/or their variable for grouping in the storage memory of the master system; and g) generating a series of images comprising the images sent in order according to their time stamp, their series number and/or their variable for grouping.

    Description

    BRIEF DESCRIPTION OF THE DRAWINGS

    (1) While the specification concludes with claims particularly pointing out and distinctly claiming the subject matter that is regarded as forming the present invention, it is believed that the invention will be better understood from the following description taken in conjunction with the accompanying DRAWINGS, where like reference numerals designate like structural and other elements, in which:

    (2) In the following examples for the realization of the invention are described with reference to the Figures.

    (3) FIG. 1 shows a block diagram of an inventive method for networking independent synchronized generation of a series of images.

    (4) FIG. 2 shows schematically the networking of several mobile devices and of a web server.

    (5) FIG. 3 shows schematically in a top view various situations with and without image recording according to the inventive method.

    (6) FIG. 1 shows schematically an example for an inventive method. In a first step 200 the devices are provided. This usually means that available mobile devices with cameras are selected for example several smartphones, with which a series of images is to be recorded.

    (7) Hereafter in the second step 210 the selection is made manually or through configuration (for example on the basis of local configuration data or remotely available or on the basis of data from accounts and/or user profiles), which of the mobile devices are to be configured as master system and which as slave system, and this configuration is carried out. This can take place by respective program data being downloaded from the network, for example the Internet, and being installed, for example in the like of one or several apps which are installed on smartphones. Or in step 210 it is set in programs/apps already present on the devices via selection which device is the master device and which ones are slaves.

    (8) Therein the master system can also be at the same time one of the slave systems, wherein the method basically intends to configure at least two slave systems.

    (9) In the first part of the step 220, which is performed with the device configured as master (what lies in the left of FIG. 1 are steps which are carried out with the master system; correspondingly step 230 lying on the right is carried out with the slave systems), recording criterion and series ending criterion is set. Afterwards, these are sent to the slave systems in the second part of step 220.

    (10) In the following, step 230 is carried out as long as the series ending criterion is not fulfilled.

    (11) Therein in a sub step 232 of step 230 an image and/or a video and/or several images are always recorded with the camera of the respective slave system, when the recording criterion is fulfilled. Alternatively, also the user of the slave system can be instructed to record an image, when the criterion is fulfilled.

    (12) Afterwards, the image or the images are sent to the master system with a time stamp (this is of course not applicable for slave system which serve at the same time as master), wherein additional recordings take place as long as the series ending criterion is not fulfilled and the recording criterion is fulfilled.

    (13) In case the series ending criterion is fulfilled in the sub step 236 all remaining images are sent to the master system with the time stamp, which especially includes all images whose sending failed in sub step 234 due to lack of connection between slave and master. Therein additionally the information is sent that the series is finished on this slave system so that no further images are to be expected.

    (14) Sub step 236 especially can be repeated as long as images remain whose receiving has not being confirmed by the master system.

    (15) While step 230 is carried out with the slave systems, step 240 is also carried out with the master system as images are received and saved. Preferably in each case a confirmation of receiving will be send to the respective slave system. This preferably takes place until the series ending criterion is fulfilled and preferably until all slave systems have confirmed a respective end.

    (16) Additionally a further criterion for ending step 240 can also be provided and/or set; for example exceeding a time limit, exceeding a certain number of finished series by slave systems or also a manually activated function which ends step 240.

    (17) In step 250 then all generated images are composed to a series of images in order of their time stamps. Therein the images can also be connected with further information like for example texts generated by the users of the slave systems during step 230.

    (18) In FIG. 2 devices used in a variation of the method described previously are shown schematically. Indeed four mobile devices are configured as the master system 100 and three slave systems 120. But additionally the Web server 110 exists.

    (19) The method differs from that shown in FIG. 1 therein that although images are sent to the master system 100 however the master system 100 forwards the images to the web server 110. Carrying out the steps 240 and 250 then takes place on the web server 110.

    (20) Additionally to generating the series of images the web server 110 can then provide access data and/or encoding data to the master system 100 and/or to the slave systems 120, so that from these systems the generated series of images can be obtained. Therein the usual encryption techniques like public-key encryption can be used.

    (21) The latter can alternatively also take place in or before step 200 by the web server 110 for example providing apps and at the same time also access data or accounts to the mobile devices.

    (22) FIG. 3 shows schematically the application of an inventive method in a certain scenario in top view.

    (23) Therein the drawn through lines represent real existing objects, namely the two objects of interest 4 and 5 with a quadratic base, which might be for example buildings 4 and 5, and the object with a rhomboid base 6, which for example might be a piece of art 6.

    (24) Large dashed circles 3a, 3b, 3c and 3d represent recording areas defined within the method, which are relevant for recording criteria of the method.

    (25) Small dashed circles 1a to 1e represent several positions of a first mobile device or slave system or the user of the slave system at different points in time. Small dashed triangles 2c, 2d and 2e represent slave systems or users different from the first slave system and different from one another, which are part of the same method as the first slave system.

    (26) At the beginning of the method a mobile device is at position 1a and is configured as a slave system according to step 210. At a not shown master system recording criteria and the series ending criterion according to step 220 are defined.

    (27) As recording criteria are set: present in area 3b and no other slave system in area 3b, wherein area 3b is defined as a circle which touches the wall of the building 4 at a certain place (first recording criteria); present in area 3d and no other slave system in area 3d, wherein area 3d is defined as a circle which touches the wall of the building 5 at a certain place (second recording criteria); present in area 3c, wherein area 3c is defined by the distance from the piece of art, and the camera positioned and oriented such, that in the image data captured by the camera the left and the right corner of the piece of art 6 are at the same distance from the lower corner (third recording criteria); and present in area 3a, wherein the area 3a is defined by a circle with respective distance to the middle of the circle from the piece of art (fourth recording criteria).

    (28) The areas might for example have been defined via a respective screen input within a displayed satellite photo. But every other kind of input is also possible.

    (29) Therein as series ending criterion positioning in area 3a and recording of an image from this area according to the last recording criterion is set.

    (30) Furthermore it is set that the users each only receive the message that an image is to be recorded and that they receive a confirmation if an image according to one of the recording criteria was recorded.

    (31) Recording criteria and series ending criterion are transferred to the slave system 1a. With that a part of the method starts which corresponds to step 230.

    (32) The slave system is brought to the building 4, wherein the slave system 1b generates according to the previously described step 232 a message when entering the area 3b that an image is to be recorded, because the slave system is in the right area and no other slave system is present. This corresponds to the first recording criterion.

    (33) The user activates manually the slave system 1b accordingly so that an image is recorded. The slave system generates a confirmation, that an image according to the first recording criteria was recorded, and the image is sent with a time stamp to the master system according to step 234. The master system sends a confirmation to the slave system 1b and this creates a respective message for the user, so that the user knows that his image was accepted for the series of images.

    (34) Thereafter the slave system is moved to area 3c. The slave system 1c however does not create a request for recording according to step 232, as the part of the third recording criterion about the correct orientation of the camera is not fulfilled. The user does not realize this and he makes a recording nevertheless.

    (35) As no recording criterion was fulfilled the recorded image is also not sent to the master system.

    (36) On the other hand at the slave system 2c which is also in the area a message according to step 232 is generated to record an image, because slave system 2c is in area 3c and is also in regard to the camera orientation orientated correctly towards the piece of art 6. As presence or absence of other slave systems is irrelevant for the third recording criterion the presence of the slave system 1c has no influence.

    (37) In the following the slave system 1d is brought into the area 3d. Although the slave system 1d is correctly positioned nevertheless the part of the second recording criterion that no other slave system should be present in area 3d is not fulfilled. Accordingly step 232 with a message requesting to record an image does not take place.

    (38) Nevertheless the users records an image. As no recording criterion is fulfilled this image is also not sent to the master system.

    (39) Subsequently the slave system 1e is moved into the area 3a. As the fourth recording criterion is fulfilled a message according to step 232 with a request to record an image is created. As the presence of other slave systems is not relevant with the fourth recording criterion the slave system 2e has no influence upon this. Rather the slave system 2e would also generate a request for recording if slave system 2e also just arrived in the area 3a.

    (40) After the user has recorded an image manually this image is sent to the master system according to step 234. The master system sends a confirmation to the slave system 1e and the slave system 1e creates a respective message for the user.

    (41) As now the series ending criterion is fulfilled step 230 is ended with sending a confirmation of the series ending to the master system, as all images have been sent successfully to the master system. The user receives a respective message through the slave system.

    (42) The master system will afterwards—if from the other slave systems similar confirmations of the series ending arrive or if otherwise a termination of step 240 takes place—generate a series of images. This series of images includes the images recorded with the slave systems 1a, 1b, 1c, 1d, 1e from the positions of the slave system 1b and 1e according to their time stamps together with the other images of the other slave systems belonging to this series of images.

    (43) Of course the method can also be arranged to generate additional messages. For example it is generally possible within all inventive methods that users are alerted via messages about the partial fulfillment of the recording criteria (for example with the slave system 1d that the position is correct, but that another slave system is present) or the nearly complete fulfillment of the recording criterion. This can especially take place in form of instructions, for example how the orientation of the camera is to be changed, for example for the slave system 1c.

    (44) Furthermore, it can also be provided that the user can manually retrieve respective information.

    (45) The previous descriptions are of preferred embodiments for implementing the invention, and the scope of the invention should not necessarily be limited by these descriptions. It should be understood that all articles, references and citations recited herein are expressly incorporated by reference in their entirety. The scope of the current invention is defined by the following claims.