CN114268706B - Time timing method and device for camera - Google Patents
Time timing method and device for camera Download PDFInfo
- Publication number
- CN114268706B CN114268706B CN202111521449.9A CN202111521449A CN114268706B CN 114268706 B CN114268706 B CN 114268706B CN 202111521449 A CN202111521449 A CN 202111521449A CN 114268706 B CN114268706 B CN 114268706B
- Authority
- CN
- China
- Prior art keywords
- time
- relative
- image data
- time service
- frame information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 36
- 238000013519 translation Methods 0.000 claims abstract description 44
- 230000001360 synchronised effect Effects 0.000 claims description 34
- 238000012545 processing Methods 0.000 claims description 14
- 230000005540 biological transmission Effects 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000005538 encapsulation Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
Landscapes
- Studio Devices (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The method includes synchronizing time service of a first server through a protocol translation synchronization box, sending first relative time stamps to the first server and at least one camera to trigger the cameras in the at least one camera to expose, sending image data with the first relative time stamps to the first server by a plurality of cameras in the at least one camera, and inserting the first absolute time information received after the first relative time stamps and before the next relative time stamps into image data of each group by the first server as accurate time corresponding to the first relative time stamps.
Description
Technical Field
The present disclosure relates to the field of cameras, and in particular, to a method and apparatus for time timing of a camera.
Background
When unified data processing is needed between the multi-camera systems, for example, a plurality of 3D motion capture camera systems need to reconstruct coordinates of all data exposed at the same time, one scheme is to perform accurate time timing on the data of each subsystem, so that all the data exposed at the same time are aligned.
Currently, the scheme of aligning data exposed at the same time is only a scheme internal to subsystems, for example, each subsystem may practically align frame data exposed at the same time by a relative time stamp and then output coordinate information, thereby establishing an independent coordinate system of a non-absolute time domain. However, since the relative time stamps of the individual subsystems are independent, when unified data processing is required between the multi-camera systems, all data of the plurality of subsystems exposed at the same time cannot be aligned by the relative time stamps inside the respective subsystems. However, a scheme for performing accurate time service on the data of each subsystem is not proposed at present.
Therefore, how to perform accurate time timing on the image data of the camera is a problem to be solved.
Disclosure of Invention
The application provides a time timing method and device for a camera, which can perform accurate time timing on image data of the camera, so that unified data processing can be performed among multiple camera systems.
In a first aspect, a time timing method of a camera is provided, and the method includes: the method comprises the steps that a first server receives time service data every other first time period, wherein the time service data comprise absolute time information and first frame information, and the first frame information is used for identifying frame information of the time service data; the first server receives a first relative timestamp, and the first relative timestamp is used for triggering a plurality of cameras to expose; the first server receiving relatively time stamped image data from each of the plurality of cameras, each relatively time stamped image data comprising image data, the first relative time stamp, and second frame information for identifying frame information of the relatively time stamped image data; the first server determines first time service data, wherein the first time service data is the first time service data received by the first server after receiving the first relative time stamp and before receiving the next relative time stamp; the first server groups a plurality of the image data with relative time stamps according to second frame information in the image data with relative time stamps, and inserts absolute time information in the first time service data into the image data of each group according to first frame information in the first time service data and second frame information in each group of the image data with relative time stamps.
Optionally, the first time period is determined from a multiple of the multiple cameras.
Optionally, the first frame information includes a frame field and a subframe number, which are determined according to a multiple of the multiple cameras.
Optionally, the second frame information includes a frame number, the frame number being determined according to a multiple of the multiple cameras.
Optionally, the first relative timestamp is included in a 1Hz frequency broadcast packet generated from a protocol translation synchronization box.
In a second aspect, there is provided a method for time timing of a camera, the method comprising: the protocol translation synchronous box receives time service information from synchronous time service equipment; the protocol translation synchronization box sends time service data to a first server every a first time period according to the time service information, wherein the time service data comprises absolute time information and first frame information, and the first frame information is used for identifying frame information of the time service data; the protocol translation synchronization box sends a relative time stamp every second time period according to the time service information, and the relative time stamp is used for triggering a plurality of cameras to expose.
Optionally, the first time period is determined from a multiple of the multiple cameras.
Optionally, the first frame information includes a frame field and a subframe number, which are determined according to a multiple of the multiple cameras.
Optionally, the second period of time is 1 second.
Optionally, the relative timestamp is included in a broadcast packet.
In a third aspect, a time timing device of a camera is provided, where the device includes: the time service system comprises a receiving and transmitting module, a receiving and transmitting module and a receiving module, wherein the receiving and transmitting module is used for receiving time service data at intervals of a first time period, the time service data comprises absolute time information and first frame information, and the first frame information is used for identifying frame information of the time service data; the receiving and transmitting module is used for receiving a first relative time stamp, and the first relative time stamp is used for triggering a plurality of cameras to expose; the transceiver module is configured to receive relative time stamped image data from each of the plurality of cameras, each relative time stamped image data comprising image data, the first relative time stamp, and second frame information identifying frame information of the relative time stamped image data; the processing module is used for determining first time service data, wherein the first time service data is the first time service data received by the first server after receiving the first relative time stamp and before receiving the next relative time stamp; the processing module is used for grouping a plurality of image data with relative time stamps according to second frame information in the image data with relative time stamps, and inserting absolute time information in the first time service data into the image data of each group according to first frame information in the first time service data and second frame information in each group of image data with relative time stamps.
Optionally, the first time period is determined from a multiple of the multiple cameras.
Optionally, the first frame information includes a frame field and a subframe number, which are determined according to a multiple of the multiple cameras.
Optionally, the second frame information includes a frame number, the frame number being determined according to a multiple of the multiple cameras.
Optionally, the first relative timestamp is included in a 1Hz frequency broadcast packet generated from a protocol translation synchronization box.
In a fourth aspect, there is provided a time timing apparatus of a camera, the apparatus comprising: the receiving and transmitting module is used for receiving time service information from the synchronous time service equipment; the processing module is used for sending time service data to the first server every first time period according to the time service information, the time service data comprises absolute time information and first frame information, and the first frame information is used for identifying frame information of the time service data; the receiving and transmitting module is used for transmitting a relative time stamp every second time period according to the time service information, and the relative time stamp is used for triggering a plurality of cameras to expose.
Optionally, the first time period is determined from a multiple of the multiple cameras.
Optionally, the first frame information includes a frame field and a subframe number, which are determined according to a multiple of the multiple cameras.
Optionally, the second period of time is 1 second.
Optionally, the relative timestamp is included in a broadcast packet.
In a fifth aspect, a time timing system of a camera is provided, where the system includes a first server, a second server, a synchronization timing device, a protocol translation synchronization box, and a plurality of cameras;
the second server sends an initial standard time to the synchronous time service equipment;
the synchronous time service equipment sends time service information to the protocol translation synchronous box according to the initial standard time, and the time service information is used for synchronous time service of the synchronous time service equipment to the protocol translation synchronous box;
the protocol translation synchronization box sends time service data to the first server every other first time period according to the time service information, wherein the time service data comprises absolute time information and first frame information, and the first frame information is used for identifying frame information of the time service data;
the protocol translation synchronization box sends a first relative timestamp according to the time service information, and the first relative timestamp is used for triggering the cameras to expose;
the first server receives the first relative timestamp;
the plurality of cameras expose according to the first relative time stamp and acquire image data;
the first server determines first time service data, wherein the first time service data is the first time service data received by the first server after receiving the first relative time stamp and before receiving the next relative time stamp;
each camera of the plurality of cameras transmits relative time stamped image data to the first server, the relative time stamped image data including the image data, the first relative time stamp, and second frame information for identifying frame information of the relative time stamped image data;
the first server receives a plurality of image data with relative time stamps;
the first server groups a plurality of the image data with relative time stamps according to second frame information in the image data with relative time stamps, and inserts absolute time information in the first time service data into the image data of each group according to first frame information in the first time service data and second frame information in each group of the image data with relative time stamps.
As can be seen from the foregoing embodiments, in the time timing method of a camera provided in the present application, a first server receives timing data every first time period, where the timing data includes absolute time information and first frame information, on one hand, the first server realizes that absolute time information is mastered in real time, and can improve the accuracy of its own time, and on the other hand, provides accurate absolute time information for accurate timing of image data sent by the first server for multiple cameras. After receiving the first relative time stamp, the first server triggers the first server to map absolute time information in first time service data with the first relative time stamp, wherein the first time service data is the first time service data received by the first server after receiving the first relative time stamp and before receiving the next relative time stamp. The first server groups a plurality of image data with relative time stamps according to second frame information in the plurality of image data with relative time stamps, and inserts absolute time information in the first time service data into the image data of each group according to the first frame information in the first time service data and the second frame information in each group of image data with relative time stamps, so that the accurate time service of all the image data of the camera system is finished while the synchronous exposure of a plurality of cameras in the camera system is realized, and further, the first server can accurately time service the plurality of camera systems, and can realize all the image data alignment of the multi-camera system and further perform unified data processing.
Drawings
In order to more clearly illustrate the technical solutions of the present application, the drawings that are needed in the embodiments will be briefly described below, and it will be obvious to those skilled in the art that other drawings can be obtained from these drawings without inventive effort.
FIG. 1 is a schematic flow chart of an exemplary method for time timing a camera according to some embodiments of the present application;
fig. 2 is a schematic flowchart of a time timing method of another example camera according to some embodiments of the present application.
Detailed Description
Embodiments of the present application are described in detail below, examples of which are illustrated in the accompanying drawings, wherein the same or similar reference numerals refer to the same or similar elements or elements having the same or similar functions throughout. The embodiments described below by referring to the drawings are exemplary only for the purpose of illustrating the present application and are not to be construed as limiting the present application.
As used herein, the singular forms "a", "an", "the" and "the" are intended to include the plural forms as well, unless expressly stated otherwise, as understood by those skilled in the art. It will be further understood that the terms "comprises" and/or "comprising," when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof. It will be understood that when an element is referred to as being "connected" or "coupled" to another element, it can be directly connected or coupled to the other element or intervening elements may also be present. Further, "connected" or "coupled" as used herein may include wirelessly connected or wirelessly coupled. The term "and/or" as used herein includes all or any element and all combination of one or more of the associated listed items.
Aiming at how to carry out accurate time timing on the image data of the cameras, thereby enabling the same data processing between the multi-camera systems, the application proposes the following scheme.
Fig. 1 is a schematic flowchart of an exemplary method for time service of a camera according to some embodiments of the present application, and the following description of the method for time service of a camera provided in the present application is made with reference to fig. 1.
S100, the first server receives time service data every first time period, wherein the time service data comprises absolute time information and first frame information.
The first frame information is used for identifying frame information of time service data.
In one example, the first server receives timing data from the protocol translation synchronization box at intervals of a first time period. Optionally, the time service data is transmitted in a unicast manner. Further optionally, the time service data is in a data encapsulation format of a user data packet protocol (User Datagram Protocol, UDP).
Optionally, the first server is an upper computer software development kit (Software Development Kit, SDK).
Optionally, the first frame information includes a frame field and a subframe number. Further alternatively, the frame field occupies 1 byte and the subframe number occupies 1 byte. The frame domain refers to the output frequency with the same frequency as the time service equipment, the identification number used for the synchronization of the multiple subsystems, and the subframe number refers to the frame number multiplied on the basis of the time service frequency.
It should be noted that the absolute time is understood as a world standard time of the location of the first server.
By adopting the mode, on one hand, the first server can master real-time and ensure the accuracy of time information, and on the other hand, the first server uses absolute time information and first frame information to time the image data of the camera.
S110, the first server receives the first relative time stamp.
Wherein the first relative timestamp is used to trigger the plurality of cameras to expose.
In one example, a first server receives a first relative timestamp from a protocol translation synchronization box transmission. Optionally, the first relative timestamp is contained in a 1Hz frequency broadcast packet generated from the protocol translation synchronization box. That is, the first server receives a broadcast packet containing a relative time stamp every second. It should be noted that, in practice, the first server may receive a relative timestamp every second, and the first relative timestamp is one of a plurality of relative timestamps received by the first server.
Alternatively, the data size occupied by the relative timestamp is 4 bytes.
S120, the first server receives image data with a relative time stamp from each of the plurality of cameras.
Wherein each image data with a relative time stamp comprises image data, the first relative time stamp and second frame information.
Wherein the second frame information is used to identify frame information of the image data with a relative time stamp.
Specifically, the first server serves the plurality of cameras, which belong to one camera system. The system may also include a first camera, a second camera, and other cameras.
Optionally, the first camera is an ethernet camera.
The image data is obtained by exposing the corresponding camera according to the first relative time stamp.
Optionally, the second frame information includes a frame number, i.e., a frame number output by the camera, which refers to a frame number within one broadcasting period (1 s). Further alternatively, the frame sequence number occupies 2 bytes.
Alternatively, the frame number is determined according to the frequency multiplication of the plurality of cameras, for example, the first camera has a fundamental frequency of 30Hz, if the frequency multiplication number of the first camera is 2, the frame number may be 0001-003b, if the frequency multiplication number of the first camera is 4, the frame number may be 0001-0078, and so on.
Optionally, the first time period is determined according to a frequency multiplication of the first camera, as shown in the following formula (1):
wherein t is a first time period, and m is a frequency doubling number. For example, if the frequency multiplication number of the first camera is 2, the first period is about 16ms, and if the frequency multiplication number of the first camera is 4, the first period is about 8ms.
Optionally, the frame field and the subframe number are determined from a multiple of the multiple cameras. For example, taking the first camera as an example, if the frequency multiplication number of the first camera is 2, the number of one frame field corresponds to the number of 2 subframe numbers, and if the frequency multiplication number of the first camera is 4, the number of one frame field corresponds to the number of 4 subframe numbers.
S130, the first server determines first time service data.
The first time service data is first time service data received by the first server after receiving the first relative time stamp and before receiving the next relative time stamp.
Specifically, the "the first time service data is the first time service data received by the first server after receiving the first relative timestamp" includes the following cases:
case one
The first server receives the first time service data and analyzes the first time service data successfully after receiving the first relative time stamp and before receiving the next time stamp, and then does not receive or analyze the time service data sent by the protocol translation synchronization box before receiving the next relative time stamp, and the first server inserts absolute time information in the first time service data into the image data, namely the first time service data is the first time service data.
Case two
After the first relative time stamp is received and before the next time stamp is received, the protocol translation synchronization box sequentially sends first time service data, second time service data and the like, the first server does not successfully receive or analyze the first time service data, then the first server continuously receives or analyzes the second time service data, third time service data and the like until the time service data is successfully analyzed, and then the time service data which is successfully analyzed is the first time service data.
S140, the first server groups the plurality of image data with relative time stamps according to the second frame information in the plurality of image data with relative time stamps, and inserts absolute time information in the first time service data into the image data of each group according to the first frame information in the first time service data and the second frame information in each group of image data with relative time stamps.
Specifically, inserting absolute time information in the first time service data into the image data of each group according to the first frame information in the first time service data and the second frame information in the image data of each group with relative time stamp comprises the following steps: after the first server determines that the first frame information in the first time service data and the second frame information in each set of image data are corresponding, absolute time information in the first time service data is inserted into each set of image data.
Taking the first camera and the second camera as examples, the first server divides the image data with the relative time stamp sent by the first camera and the image data with the relative time stamp sent by the second camera into a group according to the second frame information, and adds absolute time information in the first time service data to the image data of the same group.
By adopting the method, the first server inserts absolute time information in the received time service data into each group of image data with the relative time stamp after receiving the relative time stamp and before receiving the next relative time stamp, so that the effect of accurately time service the image data is realized, and meanwhile, the protocol translation synchronization box realizes the effect of multi-camera synchronous exposure by broadcasting the relative time stamp at a fixed frequency. Furthermore, the server and the camera of other systems also carry out time timing and synchronous triggering exposure by the protocol translation synchronous box, so that accurate time timing of all image data of the multi-camera system can be realized, and unified data processing can be further carried out.
Fig. 2 is a schematic flowchart of a time timing method of another camera according to some embodiments of the present application, and based on the method in fig. 1, a specific example is described below in conjunction with fig. 2.
S200, the second server defines initial standard time to the synchronous time service equipment through single time service.
Optionally, the second server sends the start standard time to the synchronous time service device once every 24 hours, and the start standard time can be understood as the world standard time of the second server.
Optionally, the second server transmits the start standard time through a Type-C transmission line.
And defining the initial standard time by the second server, and calibrating the time of the synchronous time service equipment to improve the accuracy of the camera system time.
S210, the synchronous time service device sends time service information to the protocol translation synchronous box, and the protocol translation synchronous box receives the time service information.
Optionally, the synchronous timing device sends timing information to the protocol translation synchronization box at a frequency of 30 Hz.
The time service information may be world standard time (absolute time), or may be a time service of synchronization completed in a manner of counting relative time stamps, so as to ensure the precision of time of the protocol translation synchronization box.
In one example, the synchronization timing device, upon receiving the start standard time, sends timing information to the protocol translation synchronization box in a data format specified by the SMPTE protocol.
Because the synchronous time service device generally only supports SMPTE protocol and IEEE1588 (PTP) protocol, and cannot directly perform time service synchronization on the camera and the first server (upper computer) that do not support the protocol, a protocol conversion synchronization box needs to be added in the middle to complete time service and synchronous triggering exposure on the camera and the first server.
Specifically, the protocol translation synchronization box parses timing information encapsulated in a data format specified by SMPTE protocol, and performs accurate time calibration using the timing information.
S220, the protocol translation synchronization box sends time service data to the first server every other first time period, and accordingly, the first server receives the time service data.
Specifically, according to the time service information, the protocol translation synchronization box sends time service data to the first server through the gigabit ethernet interface in a unicast mode, and the protocol translation synchronization box encapsulates the time service data in a UDP encapsulation mode.
Illustratively, the time service data is contained in a time service message.
This first period of time is about 8ms for example.
The timing data includes 3 bytes of absolute time information (e.g., 010101 (1 hour 1 minute 1 second)), 1 byte frame field number (e.g., 00), and 1 byte subframe number (e.g., 00).
The protocol translation synchronization box sends a relative timestamp every second time period S230, and accordingly, the first server and the plurality of cameras receive the relative timestamp.
Specifically, the protocol translation synchronization box broadcasts a 4-byte relative timestamp (e.g., 1a1b1c1 d) based on the timing information.
For example, after the protocol translation synchronization box receives the timing information of one period (receives the timing information of 30Hz frequency), the protocol translation synchronization box sends the relative timestamp of 4 bytes in a broadcast manner.
Optionally, the second time period is 1 second, that is, the protocol translation synchronization box sends a broadcast packet with a relative timestamp every 1 second.
Optionally, the protocol translation synchronization box starts sending the timing data about 4ms apart after sending a relative timestamp.
The first camera and the second camera included in the plurality of cameras are described below as examples.
S240, the first camera acquires first image data, and the second camera acquires second image data.
Specifically, the first camera and the second camera complete the second trigger signal by receiving the count of the first relative time stamp in the broadcast packet, and complete the exposure of the corresponding frame frequency with the accurate clock frequency thereof, and output the image data.
The protocol translation synchronization box synchronizes the exposure of the individual cameras by means of relative time stamps.
S250, the first camera sends the first relatively time-stamped image data to the first server, and the second camera sends the second relatively time-stamped image data to the first server.
Wherein the first image data with relative time stamp comprises first image data, the first relative time stamp and second frame information, and the second image data with relative time stamp comprises second image data, the first relative time stamp and the second frame information, namely, after the first camera and the second camera are exposed at the same time, the image data with the same relative time stamp is sent to the first server.
Optionally, the second frame information includes a 2 byte frame number (e.g., 0001).
S260, the first server precisely time-service the image data.
Specifically, after the first server receives the first image data with the relative time stamp and the second image data with the relative time stamp, taking the image data with the same frame number in the first image data with the relative time stamp and the second image data with the relative time stamp as a group, determining that the first frame information in the first time service data and the second frame information in the group of image data are corresponding, inserting the absolute time information in the first time service data into the image data in the group, wherein the first time service data is the first time service data received by the first server after receiving the first relative time stamp and before receiving the next relative time stamp.
Alternatively, taking the first camera and the second camera operating at 120Hz as an example (i.e., the frequency multiplication number is 4), the correspondence between the relative time stamp and the absolute time information is shown in table one.
List one
It should be noted that "-" in table one only plays a role of spacing each byte, i.e., distinguishing different bytes, and does not play a limiting role.
In the following, for example, in connection with the table, a first camera transmits first image data with a relative time stamp "1a-1b-1c-1d" to a first server, a second camera transmits second image data with a relative time stamp "1a-1b-1c-1d" to the first server, after receiving the first image data (frame number 00-01) and the second image data (frame number 00-01), takes the first image data and the second image data with the same frame number as a group, then maps absolute time information "01-01-01" in the first image data with a relative time stamp successfully received with the relative time stamp "1a-1b-1c-1d", and confirms that frame information (00-01) of the group of image data and frame information (00-00) of time service data are corresponding, and inserts the absolute time information "01-01-01" into the group of image data.
By adding a protocol translation synchronization box, the synchronization time service device can accurately time service the camera though the synchronization time service device is different from a protocol supported by the camera by adopting the method shown in fig. 2. On the other hand, by setting mapping rules of absolute time information and relative time stamps, the synchronous timing device can accurately time-service cameras of a plurality of systems on the basis of synchronously exposing the cameras of the plurality of systems, so that all data of the multi-camera system can be uniformly processed.
Corresponding to the embodiment of the time timing method of the camera, the application also provides an embodiment of the time timing device of the camera. The device comprises:
the time service system comprises a receiving and transmitting module, a receiving and transmitting module and a receiving module, wherein the receiving and transmitting module is used for receiving time service data at intervals of a first time period, the time service data comprises absolute time information and first frame information, and the first frame information is used for identifying frame information of the time service data;
the transceiver module is used for receiving a first relative time stamp, and the first relative time stamp is used for triggering a plurality of cameras to expose;
the transceiver module is configured to receive relatively time-stamped image data from each of the plurality of cameras, each relatively time-stamped image data including image data, the first relative time stamp, and second frame information identifying frame information of the relatively time-stamped image data;
the processing module is used for determining first time service data, wherein the first time service data is the first time service data received by the first server after receiving the first relative time stamp and before receiving the next relative time stamp;
the processing module is used for grouping a plurality of image data with relative time stamps according to second frame information in the image data with relative time stamps, and inserting absolute time information in the first time service data into the image data of each group according to first frame information in the first time service data and second frame information in each group of image data with relative time stamps.
Other embodiments of the apparatus are described in the above examples of the method in fig. 1 and 2, and are not described herein.
It should be understood that, although the steps in the flowcharts of the figures are shown in order as indicated by the arrows, these steps are not necessarily performed in order as indicated by the arrows. The steps are not strictly limited in order and may be performed in other orders, unless explicitly stated herein. Moreover, at least some of the steps in the flowcharts of the figures may include a plurality of sub-steps or stages that are not necessarily performed at the same time, but may be performed at different times, the order of their execution not necessarily being sequential, but may be performed in turn or alternately with other steps or at least a portion of the other steps or stages.
The foregoing is only a partial embodiment of the present application, and it should be noted that, for a person skilled in the art, several improvements and modifications can be made without departing from the principle of the present application, and these improvements and modifications should also be considered as the protection scope of the present application.
Claims (13)
1. A method of time timing for a camera, the method comprising:
the method comprises the steps that a first server receives time service data every other first time period, wherein the time service data comprise absolute time information and first frame information, and the first frame information is used for identifying frame information of the time service data;
the first server receives a first relative timestamp, and the first relative timestamp is used for triggering a plurality of cameras to expose;
the first server receiving relatively time stamped image data from each of the plurality of cameras, each relatively time stamped image data comprising image data, the first relative time stamp, and second frame information for identifying frame information of the relatively time stamped image data;
the first server determines first time service data, wherein the first time service data is the first time service data received by the first server after receiving the first relative time stamp and before receiving the next relative time stamp;
the first server groups a plurality of the image data with relative time stamps according to second frame information in the image data with relative time stamps, and inserts absolute time information in the first time service data into the image data of each group according to first frame information in the first time service data and second frame information in each group of the image data with relative time stamps.
2. The method of claim 1, wherein the first time period is determined from a multiple of the multiple cameras.
3. The method of claim 1 or 2, wherein the first frame information includes a frame field and a subframe number, the frame field and subframe number being determined from a multiple of the multiple cameras.
4. The method of claim 1, wherein the second frame information comprises a frame number, the frame number determined from a multiple of the multiple cameras.
5. The method of claim 1, wherein the first relative timestamp is included in a 1Hz frequency broadcast packet generated from a protocol translation synchronization box.
6. A method of time timing for a camera, the method comprising:
the protocol translation synchronous box receives time service information from synchronous time service equipment;
the protocol translation synchronization box sends time service data to a first server at intervals of a first time period according to the time service information, so that the first server uses the time service data to time service the image data of each camera in a plurality of cameras, the time service data comprises absolute time information and first frame information, and the first frame information is used for identifying frame information of the time service data;
the protocol translation synchronization box sends a relative timestamp every second time period according to the time service information, and the relative timestamp is used for triggering a plurality of cameras to expose;
the first server uses the time service data to time service the image data of each camera in the plurality of cameras, and the method comprises the following steps:
after the first server receives one of the relative timestamps as a first relative timestamp, the first server receives relative-timestamp image data from each of the plurality of cameras, each relative-timestamp image data including image data, the first relative timestamp, and second frame information identifying frame information of the relative-timestamp image data;
the first server determines the first time service data received after receiving the first relative time stamp and before receiving the next relative time stamp as first time service data;
the first server groups the plurality of image data with relative time stamps according to second frame information in the plurality of image data with relative time stamps, and inserts absolute time information in the first time service data into the image data of each group according to first frame information in the first time service data and second frame information in each group of image data with relative time stamps.
7. The method of claim 6, wherein the first time period is determined from a multiple of the multiple cameras.
8. The method of claim 6 or 7, wherein the first frame information includes a frame field and a subframe number, the frame field and subframe number being determined according to a multiple of the multiple cameras.
9. The method of claim 6, wherein the second period of time is 1 second.
10. The method of claim 6, wherein the relative time stamp is included in a broadcast packet.
11. A time timing apparatus for a camera, the apparatus comprising:
the time service system comprises a receiving and transmitting module, a receiving and transmitting module and a receiving module, wherein the receiving and transmitting module is used for receiving time service data at intervals of a first time period, the time service data comprises absolute time information and first frame information, and the first frame information is used for identifying frame information of the time service data;
the receiving and transmitting module is used for receiving a first relative time stamp, and the first relative time stamp is used for triggering a plurality of cameras to expose;
the transceiver module is configured to receive relative time stamped image data from each of the plurality of cameras, each relative time stamped image data comprising image data, the first relative time stamp, and second frame information identifying frame information of the relative time stamped image data;
the processing module is used for determining first time service data, wherein the first time service data is the first time service data received by the receiving and transmitting module after receiving the first relative time stamp and before receiving the next relative time stamp;
the processing module is used for grouping a plurality of image data with relative time stamps according to second frame information in the image data with relative time stamps, and inserting absolute time information in the first time service data into the image data of each group according to first frame information in the first time service data and second frame information in each group of image data with relative time stamps.
12. A time timing apparatus for a camera, the apparatus comprising:
the receiving and transmitting module is used for receiving time service information from the synchronous time service equipment;
the processing module is used for sending time service data to the first server at intervals of a first time period according to the time service information, so that the first server uses the time service data to time service the image data of each camera in the plurality of cameras, the time service data comprises absolute time information and first frame information, and the first frame information is used for identifying frame information of the time service data;
the receiving and transmitting module is used for transmitting a relative time stamp every second time period according to the time service information, and the relative time stamp is used for triggering a plurality of cameras to expose;
the first server uses the time service data to time service the image data of each camera in the plurality of cameras, and the method comprises the following steps:
after the first server receives one of the relative timestamps as a first relative timestamp, the first server receives relative-timestamp image data from each of the plurality of cameras, each relative-timestamp image data including image data, the first relative timestamp, and second frame information identifying frame information of the relative-timestamp image data;
the first server determines the first time service data received after receiving the first relative time stamp and before receiving the next relative time stamp as first time service data;
the first server groups the plurality of image data with relative time stamps according to second frame information in the plurality of image data with relative time stamps, and inserts absolute time information in the first time service data into the image data of each group according to first frame information in the first time service data and second frame information in each group of image data with relative time stamps.
13. A time timing system of a camera, which is characterized by comprising a first server, a second server, a synchronous timing device, a protocol translation synchronous box and a plurality of cameras;
the second server sends an initial standard time to the synchronous time service equipment;
the synchronous time service equipment sends time service information to the protocol translation synchronous box according to the initial standard time, and the time service information is used for synchronous time service of the synchronous time service equipment to the protocol translation synchronous box;
the protocol translation synchronization box sends time service data to the first server every other first time period according to the time service information, wherein the time service data comprises absolute time information and first frame information, and the first frame information is used for identifying frame information of the time service data;
the protocol translation synchronization box sends a first relative timestamp according to the time service information, and the first relative timestamp is used for triggering the cameras to expose;
the first server receives the first relative timestamp;
the plurality of cameras expose according to the first relative time stamp and acquire image data;
the first server determines first time service data, wherein the first time service data is the first time service data received by the first server after receiving the first relative time stamp and before receiving the next relative time stamp;
each camera of the plurality of cameras transmits relative time stamped image data to the first server, the relative time stamped image data including the image data, the first relative time stamp, and second frame information for identifying frame information of the relative time stamped image data;
the first server receives a plurality of image data with relative time stamps;
the first server groups a plurality of the image data with relative time stamps according to second frame information in the image data with relative time stamps, and inserts absolute time information in the first time service data into the image data of each group according to first frame information in the first time service data and second frame information in each group of the image data with relative time stamps.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111521449.9A CN114268706B (en) | 2021-12-13 | 2021-12-13 | Time timing method and device for camera |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111521449.9A CN114268706B (en) | 2021-12-13 | 2021-12-13 | Time timing method and device for camera |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114268706A CN114268706A (en) | 2022-04-01 |
| CN114268706B true CN114268706B (en) | 2024-02-02 |
Family
ID=80826905
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111521449.9A Active CN114268706B (en) | 2021-12-13 | 2021-12-13 | Time timing method and device for camera |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114268706B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116156074B (en) * | 2022-11-21 | 2024-03-15 | 辉羲智能科技(上海)有限公司 | Multi-camera acquisition time synchronization method |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9984354B1 (en) * | 2014-09-30 | 2018-05-29 | Amazon Technologies, Inc. | Camera time synchronization system |
| CN109639383A (en) * | 2018-12-24 | 2019-04-16 | 苏州蜗牛数字科技股份有限公司 | A kind of method and system for realizing distributed frame sync server group |
| CN109729277A (en) * | 2018-11-19 | 2019-05-07 | 魔门塔(苏州)科技有限公司 | Multi-sensor collection timestamp synchronizing device |
| CN111556226A (en) * | 2020-07-13 | 2020-08-18 | 深圳市智绘科技有限公司 | Camera system |
| CN112261283A (en) * | 2020-09-08 | 2021-01-22 | 北京微视新纪元科技有限公司 | Synchronous acquisition method, device and system of high-speed camera |
| CN112672415A (en) * | 2020-12-25 | 2021-04-16 | 之江实验室 | Multi-sensor time synchronization method, device, system, electronic device and medium |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7177520B2 (en) * | 2000-09-15 | 2007-02-13 | Ibm Corporation | System and method of timecode repair and synchronization in MPEG streams |
| DE102008017933B4 (en) * | 2008-04-08 | 2012-04-26 | Baumer Optronic Gmbh | Method and device for the synchronization of camera systems |
| US10015369B2 (en) * | 2016-05-04 | 2018-07-03 | Gopro, Inc. | Synchronization of cameras using wireless beacons |
-
2021
- 2021-12-13 CN CN202111521449.9A patent/CN114268706B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9984354B1 (en) * | 2014-09-30 | 2018-05-29 | Amazon Technologies, Inc. | Camera time synchronization system |
| CN109729277A (en) * | 2018-11-19 | 2019-05-07 | 魔门塔(苏州)科技有限公司 | Multi-sensor collection timestamp synchronizing device |
| CN109639383A (en) * | 2018-12-24 | 2019-04-16 | 苏州蜗牛数字科技股份有限公司 | A kind of method and system for realizing distributed frame sync server group |
| CN111556226A (en) * | 2020-07-13 | 2020-08-18 | 深圳市智绘科技有限公司 | Camera system |
| CN112261283A (en) * | 2020-09-08 | 2021-01-22 | 北京微视新纪元科技有限公司 | Synchronous acquisition method, device and system of high-speed camera |
| CN112672415A (en) * | 2020-12-25 | 2021-04-16 | 之江实验室 | Multi-sensor time synchronization method, device, system, electronic device and medium |
Non-Patent Citations (2)
| Title |
|---|
| Synchronizing Multiple Data Streams by Time For Vehicle Control;Sid Masih;2018 IEEE Intelligent Vehicles Symposium (IV);全文 * |
| 基于可编程逻辑电路的相机高精度同步信号研究;牛仁杰;半导体光电;全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114268706A (en) | 2022-04-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112672415B (en) | Multi-sensor time synchronization method, device, system, electronic device and medium | |
| CN110567453B (en) | Bionic eye multi-channel IMU and camera hardware time synchronization method and device | |
| US7206327B2 (en) | Method and circuit for insertion of time stamp into real time data | |
| EP3291551B1 (en) | Image delay detection method and system | |
| CN111555834B (en) | Clock synchronization method and system of wireless network based on IEEE1588 protocol | |
| CN111309094A (en) | Synchronous board card and method for data acquisition of sensor equipment | |
| CN114268706B (en) | Time timing method and device for camera | |
| WO2017179608A1 (en) | Timing synchronization method, sensor embedding terminal, and sensor network system | |
| CN103138887B (en) | A kind of processing method and system of 1588 event message | |
| CN106506107B (en) | A kind of ntp server time service implementation method based on hardware timestamping | |
| US20140003454A1 (en) | Method and system for recording, synchronizing and analysing data by means of analysis devices which are spatially distributed in a communication network | |
| US20090157895A1 (en) | Method for synchronizing at least two streams | |
| CN103546273B (en) | Frequency synchronism device and method based on PTP frames | |
| JP2012513139A (en) | Method for synchronizing transport streams in a multiplexer with an external coprocessor | |
| CN111464255B (en) | Data synchronization method and data acquisition device based on CPLD | |
| CN108810575B (en) | Method and device for sending target video | |
| CN102983959B (en) | Method for realizing one-step mode and two-step mode for PTP (precision time synchronization protocol) in a plurality of MAC | |
| JP2006250638A (en) | Video camera provided with clock synchronization function | |
| WO2023201822A1 (en) | Multi-camera synchronous correction method and apparatus, and storage medium | |
| JP2001244932A (en) | Method and system for measuring network delay | |
| CN113014346A (en) | Server time deviation monitoring method and device, computer equipment and storage medium | |
| US20040054809A1 (en) | Synchronous object unification protocol | |
| US20230179314A1 (en) | In-band signaling for ingress ptp packets at a master entity | |
| CN110290580A (en) | A kind of method and its system based on 1588 agreement passing times | |
| CN116032412B (en) | Multi-camera cross-platform time synchronization method, device and system and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20221228 Address after: 100144 909-92, Floor 9, Building 17, Yard 30, Shixing Street, Shijingshan District, Beijing (cluster registration) Applicant after: Beijing Yuanke Shijie Technology Co.,Ltd. Address before: 100094 701, 7 floor, 7 building, 13 Cui Hunan Ring Road, Haidian District, Beijing. Applicant before: Lingyunguang Technology Co.,Ltd. Applicant before: Beijing Lingyun Photon Technology Co.,Ltd. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |