SELF-CONFIGURING RECORDING DEVICE FOR IMAGE DATA OF AN IMAGING SENSOR DEVICE
20240121352 ยท 2024-04-11
Assignee
Inventors
Cpc classification
International classification
Abstract
A recording device for a recording of a serialized image data stream from a sensor device. The recording device comprises a deserializer for deserializing the image data stream. To configure the first deserializer, the recording device comprises a configuration device, which records a configuration data stream transmitted by a receiving device for the purpose of configuring a serializer arranged in the sensor device and derives a configuration of the deserializer of the recording device by an analysis of the recording of the configuration data. In an example, the derivation takes place by an abstraction of the configuration of the serializer into a functionality of the serializer, a derivation of a functionality of the first deserializer from the functionality of the first serializer, and a concretization of the functionality of the first deserializer into a configuration of the first deserializer.
Claims
1. A recording device to record a serialized image data stream flowing from a sensor device to a receiving device, the recording device comprising: a first data interface to establish a first data link between the first data interface and the sensor device to transmit the image data stream to the first data interface; a first deserializer to deserialize the image data stream received at the first data interface; a storage device to record the image data stream deserialized by the first deserializer and store image data from the image data stream on a storage medium; and a configuration device to record a configuration data stream transmitted by the receiving device to configure a serializer arranged in the sensor device to serialize an image data stream output by a sensor and to feed the serialized image data stream to the first data link, to analyze the recording of the configuration data and determine a preparation of the serialized image data stream by the serializer arranged in the sensor device based on the analysis, to determine, with the aid of the information obtained as the result of the analysis, a configuration of the first deserializer, which configures the first deserializer to reconstruct the image data stream output by the sensor, and to configure the first deserializer according to the determined configuration of the first deserializer.
2. The recording device according to claim 1, further comprising: a second data interface to establish a second data link between the second data interface and the receiving device to transmit the image data stream to the receiving device; and a first serializer to re-serialize the image data stream after it is recorded by the storage device and to output the re-serialized image data stream by the second data interface, and which comprises a plurality of input pins for receiving image data, wherein the configuration device is configured: to record a configuration data stream transmitted by the receiving device to the second data interface via the second data link for the purpose of configuring a second serializer, which is arranged in the sensor device for serializing the image data stream transmitted via the first data link; to analyze the recording of the configuration data and to determine, based on the analysis, how the image data stream is to be prepared for the first serializer and distributed to the input pins of the first serializer; and to design the configuration of the first deserializer such that the configuration of the first deserializer configures the first deserializer, prepares the image data stream as determined in the analysis, and distributes it to the input pins of the first serializer (11).
3. The recording device according to claim 2, wherein the first serializer and the second serializer belong to the same production series, and the recording device is configured to configure the first serializer with the aid of the configuration data stream, or wherein the first serializer and the second serializer belong to different production series, and the configuration device is configured to convert the configuration of the second serializer predefined by the configuration data stream into a configuration of the first serializer having the same technical function, and to configure the first serializer according to the configuration having the same technical function.
4. The recording device according to claim 3, wherein the recording device is configured to intercept the configuration data stream such that the receiving device configures the first serializer instead of the second serializer with the aid of the configuration data stream.
5. The recording device according to claim 4, wherein the recording device is configured to intercept configuration data streams repeatedly transmitted by the receiving device, in particular all transmitted configuration data streams, until the configuration of the first deserializer is completed.
6. The recording device according to claim 5, wherein the recording device is configured to forward repeatedly transmitted configuration data streams to the sensor device until the configuration of the first deserializer is completed to configure the second serializer.
7. The recording device according to claim 6, wherein the recording device is configured to forward a confirmation signal transmitted by the sensor device after the completion of the configuration of the second serializer to confirm a readiness for use of the sensor device to the receiving device.
8. The recording device according to claim 1, wherein the configuration device is configured to read out, for the analysis, an existing configuration of a second deserializer, which is installed in the receiving device for deserializing the image data stream transmitted via the second data link, and to take it into account when determining the configuration of the first deserializer.
9. The recording device according to claim 2, wherein the configuration device is configured to take into account, during the determination of the configuration of the first deserializer, a netlist, which describes the data links of input pins of the first serializer having a number of internal data lines of the recording device for transmitting image data to the input pins.
10. The recording device according to claim 1, wherein the configuration device is configured to determine the configuration of the first deserializer, to consult a first abstraction map, which assigns a technical functionality of the serializer to each of the possible configurations of the serializer or all possible configurations of the serializer, to determine a functionality of the serializer by applying the first abstraction map to the configuration of the serializer, to consult a at least one compatibility map, which assigns a functionality of the first deserializer to each of the possible functionalities of the serializer or all possible functionalities of the serializer, to determine a functionality of the first deserializer by applying the compatibility map to the determined functionality of the serializer, to consult a first concretization map, which assigns, in each case, a configuration of the first deserializer to functionalities of the first deserializer or all functionalities of the first deserializer, and to determine the configuration of the first deserializer by applying the first concretization map to the determined functionality of the first deserializer.
11. The recording device according to claim 10, wherein a compatibility map is designed as a functionality map to assign a functionality of the first deserializer to each of the possible functionalities or to all possible functionalities of the first serializer.
12. The recording device according to claim 10, wherein the compatibility map comprises: a second abstraction map, which assigns a specification of the image data stream to each of the possible functionalities of the serializer or to all possible functionalities of the serializer; and a second concretization map, which assigns a functionality of the first deserializer to each of the possible specifications of the image data stream or all possible specifications of the image data stream.
13. The recording device according to claim 10, wherein the configuration device is configured to determine the functionality of the first deserializer, to consult a first compatibility map and to apply it to the determined functionality of the first serializer, and to consult a second compatibility map and to apply it to the determined functionality of the first serializer.
14. A computer-implemented method for configuring a first deserializer of a recording device, which is designed to prepare a recording of a serialized image data stream flowing from a sensor device to a receiving device comprising: a first data interface, which is designed for an establishment of a first data link between the first data interface and the sensor device for the purpose of transmitting the image data stream); a first deserializer configured to deserialize the image data stream received at the first data interface; and a storage device, which is configured to record the image data stream deserialized by the first deserializer and store image data from the image data stream on a storage medium, the method comprising: configuring the first data link; transmitting a recording of a configuration data stream by the receiving device via the second data link, which is provided for a configuration of a serializer, which is arranged in the sensor device for serializing an image data stream output by a sensor and for feeding the serialized image data stream to the first data link; analyzing the recording of the configuration data; determining a preparation of the serialized image data stream by the serializer arranged in the sensor device, based on the analysis; a determining a configuration of the first deserializer, which configures the first deserializer to reconstruct the image data stream output by the sensor based on the information obtained by the analysis; and configuring the first deserializer according to the determined configuration.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0029] The present invention will become more fully understood from the detailed description given hereinbelow and the accompanying drawings which are given by way of illustration only, and thus, are not limitive of the present invention, and wherein:
[0030]
[0031]
[0032]
[0033]
[0034]
[0035]
DETAILED DESCRIPTION
[0036] The illustration of
[0037] Sensor device 4 comprises an imaging system 16, for example a camera optical system, for imaging an electromagnetic field on an image plane and a sensor 20 arranged on the image plane for reconstructing a digitally coded map of the surroundings of sensor device 4 from the electromagnetic field. Sensor 20 is configured to continuously translate the electromagnetic field into image data frames, each of which represents one snapshot of the surroundings of the sensor device, and to continuously send the image data frames as image data stream 22 via the internal data lines of sensor device 4. Data image stream 22 is depicted as solid arrows in the overall illustration of
[0038] A second deserializer 24 is arranged in receiving device 6 to receive image data stream 22 from second data link 14, to deserialize it, and to forward deserialized image data stream 22 to a processor unit 26 of receiving device 6 via internal data lines of receiving device 6. Receiving device 6 may be designed, for example, as a control unit, a perception routine for recognizing and classifying objects in image data stream 22 may be configured in processor unit 26, and also a decision routine for generating control commands based on the classified objects.
[0039] Recording device 2 is arranged between sensor device 4 and receiving device 6 for the purpose of recording image data stream 22 output by sensor device 4. To ensure a proper functioning of both sensor device 4 and receiving device 6, recording device 2 is designed as a man in the middle. This means that recording device 2 does not identify itself to either sensor device 4 or receiving device 6 even though all data exchanged between sensor device 4 and receiving device 6 flow through recording device 2. In normal operation, recording device 2 emulates receiving device 6 to communicate directly with sensor device 4 and emulates sensor device 4 to communicate directly with receiving device 6. From the perspective of sensor device 4 and receiving device 6, first data link 12 and second data link 14 act as though they are a single, direct data link.
[0040] First deserializer 9 is arranged and configured to receive serialized image data stream 22 from first data interface 8, to deserialize it, and to forward deserialized image data stream 22 to first serializer 11 via internal data lines L1, . . . , L10 of recording device 2. Recording device 2 comprises a storage device 5, which is configured to record the data stream deserialized by first deserializer 9 and to store the recording of image data stream 22 on a data carrier 7 inserted into a drive of the recording device.
[0041] First serializer 11 is arranged and configured to receive deserialized image data stream 22 recorded by storage device 5 from deserializer 9, re-serialize it, and output it via second data interface 10 and conduct it to second data link 14.
[0042] Serializers and deserializers may be configured with respect to their technical functionality, normally by setting a register. During normal operation, i.e., when sensor device 4 and receiving device 6 communicate with each other directly without the presence of recording device 2, receiving device 6 configures second deserializer 24 during startup and sends a configuration data stream 23 for configuring second serializer 18 in sensor device 4. Configuration data streams for configuring serializers and deserializers are represented as dashed arrows in the entire illustration of
[0043] Configuration data stream 23 defines a configuration or a register setting of second serializer 18, and sensor device 4 is designed to receive configuration data stream 23 and to configure second serializer 18 according to the specification of the configuration data stream. Configuration data stream 23 may be generated by second deserializer 24 itself or by another component of receiving device 6. On the part of sensor device 4, second serializer 18 may likewise itself receive configuration data stream 23 and configure it itself according to the specification thereof, or another component of sensor device 4 may receive configuration data stream 23 and configure second serializer 18.
[0044] First serializer 11 belongs to the same production series as second serializer 18. Both are therefore identical with respect to their technical equipment and their technical design and may be exchanged with each other. As a result, configuration data stream 23 may be used directly to configure first serializer 11, and recording device 2 is configured to intercept configuration data stream 23 actually provided for second serializer 18 and configure first serializer 11 with the aid of configuration data stream 23.
[0045] The technical functionality of first serializer 11 thus exactly corresponds to the provided technical functionality of second serializer 18, since the two serializers are from the same production series, and first serializer 11 was configured with the aid of configuration data stream 23 provided for second serializer 18. First deserializer 9 must be configured to prepare image data stream 22 supplied by sensor device 4 and to distribute it to the internal data lines of recording device 2 or to the input pins of first serializer 11 in such a way that first serializer 11 is able to carry out its technical functionality predefined by configuration data stream 23. Finally, the first deserializer must be configured to reverse the serialization of image data stream 22 carried out by second serializer 18 and to reconstruct the image data stream output by sensor 20. Unlike the configuration of first serializer 11, this configuration of first deserializer 9 may not be carried out directly because receiving device 6 does not provide a configuration data stream suitable for this purpose.
[0046] For the purpose of determining and carrying out such a configuration of first deserializer 9, recording device 2 comprises a configuration device 28, which is configured to record configuration data stream 23 and analyze the recording of the configuration data. (If configuration data stream 23 according to the teaching of DE 10 2019 132 476 A1 is converted into another configuration data stream, configuration device 28 records the converted configuration data stream at this point.) With the aid of the information obtained as the result of the analysis, configuration device 28 determines a configuration of first deserializer 9 which configures first deserializer 9, for the purpose of formatting the image data from the image data stream in the correct manner expected by configured first serializer 11, and distributing them to the input pins of first serializer 11. Upon conclusion of the determination, configuration device 28 generates a deserializer configuration data stream 30, which is suitable for configuring first deserializer 9 as determined in the analysis and configures first deserializer 9 with the aid of deserializer configuration data stream 30.
[0047] Even though configuration device 28 is shown in the illustration in
[0048] The illustrations in
[0049] As shown in the illustration in
[0050] In the second step, configuration device 28 consults a first abstraction map 42 for the purpose of deriving a functionality 44 of first serializer 11 from register setting 40 of first serializer 11, based on first abstraction map 42. First abstraction map 42 is basically an overview in table form, which compares the register settings of first serializer 11 with technical functionalities of first serializer 11 and is sufficiently comprehensive that a functionality of the first serializer resulting from the particular register setting may be read out for each possible register setting of first serializer 11. First abstraction map 42 advantageously lists settings of individual registers or partial register settings, i.e. settings of small groups of registers, and assigns a function or a partial functionality of first serializer 11 to each individual register setting and/or each partial register setting, so that functionality 44 of first serializer 11 results as the totality of functions and/or partial functionalities.
[0051] Functionality 44 of first serializer 11 is a listing of technical functions of first serializer 11, which results from register setting 40 of the first serializer but no longer has a reference to the model or to the production series of first serializer 11 and, in particular, has no reference to specific partial configurations of first serializer 40.
[0052] After deriving functionality 44 of first serializer 11, configuration device 28 consults a first compatibility map 46 for the purpose of deriving a functionality 48 of the first deserializer from functionality 44 of first serializer 11, based on first compatibility map 46. A compatibility map is a map which assigns the possible functions and/or partial functionalities of first serializer 11 to functions and/or partial functionalities of first deserializer 9 which first deserializer 9 must have so that, on the one hand, a reasonable, interpretable image data stream 23 according to image data stream 23 output by sensor 20 is available to storage device 5 and, on the other hand, first deserializer 9 may properly carry out the particular function or partial functionality.
[0053] As a random example in functionality 44 of first serializer 11, a sequence may be predefined, in which first serializer 11 and second serializer 18 output the image data in the serialized image data stream. The first deserializer must, of course, consider this sequence in order to reconstruct a reasonable, readable stream of image data frames from the image data stream supplied via first data link 12. In keeping with the sequence predefined by configuration data stream 23, configuration device 28 determines a configuration of first deserializer 9, which configures first deserializer 9 to reverse a serialization of image data stream 23 carried out in this very sequence for the purpose of reconstructing the original image data frames from serialized image data stream 23, as output by sensor 18.
[0054] First compatibility map 46 is designed as a functionality map, i.e., as an assignment in table form, which assigns functions and/or partial functionalities and/or functionalities of first serializer 11 directly to functions and/or partial functionalities and/or functionalities of the first deserializer, so that a functionality 48 of the first deserializer may be derived from functionality 46 of first serializer 11 with the aid of first compatibility map 46. Functionality 48 of first deserializer 9 is described on the same abstraction level as functionality 44 of first serializer 11, i.e., it comprises a listing of technical functions and/or partial functionalities without a reference to a particular deserializer production series, a particular deserializer model, or specific partial configurations of first deserializer 9.
[0055] Finally, configuration device 28 derives a specific configuration, i.e., a specific register setting 52 of first deserializer 9, from functionality 48 of first deserializer 9 and consults a first concretization map 50 for this purpose. In terms of its contents, first concretization map 50 is similar to first abstraction map 42, i.e., it assigns registers and/or partial register settings of first deserializer 9 in table form to functions and/or partial functionalities of first deserializer 9, while configuration device 28 uses it in reverse order. After determining register setting 52, configuration device 28 generates deserializer configuration data stream 30 in such a way that deserializer configuration data stream 30 configures the registers of first deserializer 9 according to determined register setting 52 of the first deserializer and configures first deserializer 9 with the aid of deserializer configuration data stream 30.
[0056] If second deserializer 24 supports this function, configuration device 28 reads out configuration 55 of second deserializer 24 via second data link 14 and takes into account configuration 55 of second deserializer 24 when determining register setting 52 of first deserializer 9. Since first deserializer 9 and second deserializer 24 process a serialized image data stream 22 of the same type, the probability is high that some configuration features of second deserializer 24 may be applicable to first deserializer 9 as well.
[0057] When deriving register setting 52 of first deserializer 9 based on first concretization map 50, configuration device 28 additionally consults a netlist 54, which correlates input pins PS1, . . . , PS10 of the first serializer with internal data lines L1, . . . , L10 of recording device 2. Netlist 54 is explained in the illustration in
[0058]
[0059] The illustration in
[0060] Second compatibility map 56 further comprises a second concretization map 62. Configuration device 28 consults second concretization map 62 for the purpose of deriving functionality 48 of the first deserializer from specification 60 of image data stream 22. In terms of its contents, second concretization map 62 is similar to second abstraction map 58, i.e., it assigns functionalities of first deserializer 9 to specifications of image data stream 22 resulting from these very functionalities, while configuration device 28 uses them in reverse order. After generating specification 60 of image data stream 22, configuration device 28 applies second concretization map 62 to specification 60 for the purpose of reading out from the second concretization map which functionalities first deserializer 9 must have in order to generate an image data stream 22 which fulfills these very specifications.
[0061] The illustration in
[0062] It is evident that, to carry out the steps described above, configuration device 28 requires access to the information necessary for this purpose, i.e., abstraction maps 42, 58, concretization maps 62, 50, netlist 54, and possibly functionality map 46. A database is advantageously provided, which includes a multiplicity of abstraction maps 42, 58, netlists 54, and possibly compatibility maps 46 to be able to carry out an automatic configuration of first deserializer 9 according to the invention for a multiplicity of possible production series of first serializer 11. Since a uniform production series of first deserializer 9 is provided in the presented example, it is not necessary to provide different examples of first concretization map 50 and second concretization map 62. If necessary, however, it is, of course, also possible to add a multiplicity of concretization maps 50, 62 for different production series of first deserializer 9. The information suitable for first serializer 11 (at least first abstraction map 42 and netlist 54, if necessary second abstraction map 58 and/or compatibility map 56) must be stored on a storage medium readable by configuration device 28.
[0063] In the illustration in
[0064] After the transmission of configuration data stream 23, second deserializer 24 waits for a confirmation signal 82 from sensor device 4 to confirm that sensor device 4 is fully configured and ready for use. After confirmation signal 82 fails to arrive, due to blocked second data link 14, second deserializer 24 undertakes further attempts to configure second serializer 18 by repeatedly transmitting configuration data stream 23. Until the conclusion of the configuration phase, recording device 2 intercepts all repeatedly transmitted configuration data streams 23, so that the repeated configuration attempts remain without effect.
[0065] After configuration data stream 23 has been stored, configuration device 28 enters a configuration determination mode 86, within which configuration device 28 carries out the work steps described above for one of
[0066] After the configuration of first deserializer 9 has been concluded, and recording device 2 is thus fully configured and ready for use, recording device 2 ends the configuration phase and cancels the blockage of second data link 14. Recording device 2 transitions into a normal operation, within which it forwards each communication between sensor device 4 and receiving device 6 unchanged. During normal operation, sensor device 4 and receiving device 6 may exchange data as though recording device 2 were not present. First configuration data stream 23 transmitted by second deserializer 24 after the completion of the configuration phase properly reaches second serializer 18. After completion of the configuration of second serializer 18, sensor device 4 confirms the readiness for use of the sensor device by transmitting confirmation signal 82. After conformation signal 82 has been received, receiving device 6 also transitions into a normal operation, after which the overall layout shown in the illustration in
[0067] The invention being thus described, it will be obvious that the same may be varied in many ways. Such variations are not to be regarded as a departure from the spirit and scope of the invention, and all such modifications as would be obvious to one skilled in the art are to be included within the scope of the following claims.