CN113473009A - Photographing method and device based on dual systems and camera equipment - Google Patents
Photographing method and device based on dual systems and camera equipment Download PDFInfo
- Publication number
- CN113473009A CN113473009A CN202110725011.6A CN202110725011A CN113473009A CN 113473009 A CN113473009 A CN 113473009A CN 202110725011 A CN202110725011 A CN 202110725011A CN 113473009 A CN113473009 A CN 113473009A
- Authority
- CN
- China
- Prior art keywords
- operating system
- photographing
- exposure frame
- global exposure
- buffer
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 63
- 230000009977 dual effect Effects 0.000 title claims abstract description 18
- 239000000872 buffer Substances 0.000 claims abstract description 112
- 238000004590 computer program Methods 0.000 claims description 9
- 239000002131 composite material Substances 0.000 claims description 4
- 238000004891 communication Methods 0.000 description 12
- 238000012545 processing Methods 0.000 description 11
- 230000000694 effects Effects 0.000 description 9
- 230000004044 response Effects 0.000 description 6
- RZVHIXYEVGDQDX-UHFFFAOYSA-N 9,10-anthraquinone Chemical compound C1=CC=C2C(=O)C3=CC=CC=C3C(=O)C2=C1 RZVHIXYEVGDQDX-UHFFFAOYSA-N 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 4
- 238000013507 mapping Methods 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 2
- 230000000903 blocking effect Effects 0.000 description 1
- 238000012790 confirmation Methods 0.000 description 1
- 230000003111 delayed effect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/665—Control of cameras or camera modules involving internal camera communication with the image sensor, e.g. synchronising or multiplexing SSIS control signals
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B64—AIRCRAFT; AVIATION; COSMONAUTICS
- B64D—EQUIPMENT FOR FITTING IN OR TO AIRCRAFT; FLIGHT SUITS; PARACHUTES; ARRANGEMENT OR MOUNTING OF POWER PLANTS OR PROPULSION TRANSMISSIONS IN AIRCRAFT
- B64D47/00—Equipment not otherwise provided for
- B64D47/08—Arrangements of cameras
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/63—Control of cameras or camera modules by using electronic viewfinders
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Aviation & Aerospace Engineering (AREA)
- Studio Devices (AREA)
Abstract
The embodiment of the application provides a photographing method and device based on a dual system and a camera device, wherein the method comprises the following steps: starting a photographing preview mode of the camera equipment through the first operating system; sending a photographing instruction to the first operating system through the second operating system; storing the global exposure frame and a storage pointer corresponding to the shooting parameters thereof in a first buffer through a first operating system, and sending a shooting completion instruction to a second operating system; restarting a photographing preview mode through a first operating system; storing the storage pointer in a second buffer by a second operating system according to the photographing completion instruction, and sending a photo storage completion instruction to the first operating system; and generating a synthetic photo file according to the global exposure frame, the shooting parameters and the positioning information of the unmanned aerial vehicle through a second operating system. By the provided photographing scheme based on the dual-system, the photographing process is optimized, the time consumption of a waiting link in the photographing process can be reduced, and the photographing speed is improved.
Description
Technical Field
The present application relates to the field of photographing technologies, and in particular, to a photographing method and apparatus based on dual systems, and a camera device.
Background
With the continuous development of the photographing technology, the application scenes of the photographing technology are continuously enlarged, and the photographing technology is more and more used in the high-precision mapping process. In high-precision mapping, some specific scenes require a relatively fast photographing speed. At present, a multi-system architecture is generally adopted to complete a photo shooting task in a high-precision surveying and mapping process, and because a plurality of links are needed to wait for generating a final high-precision photo by adopting the multi-system architecture, the photo shooting speed for obtaining the high-definition photo is slow.
Disclosure of Invention
In order to solve the technical problem, an embodiment of the application provides a photographing method and device based on a dual system and a camera device.
In a first aspect, an embodiment of the present application provides a photographing method based on dual systems, which is applied to a camera device including a first operating system and a second operating system, where the camera device is mounted on an unmanned aerial vehicle, and the method includes:
starting a photographing preview mode of the photographing equipment through the first operating system;
sending a photographing instruction to the first operating system through the second operating system;
acquiring a global exposure frame through the first operating system according to the photographing instruction, storing the global exposure frame and a storage pointer corresponding to the photographing parameter of the global exposure frame in a first buffer, and sending a photographing completion instruction to the second operating system;
restarting the photographing preview mode through the first operating system;
storing the storage pointer in a second buffer by the second operating system according to the photographing completion instruction, and sending a photo storage end instruction to the first operating system;
and acquiring the global exposure frame and the shooting parameters from the first operating system through the second operating system according to the storage pointer, and generating a synthetic photo file according to the global exposure frame, the shooting parameters and the positioning information of the unmanned aerial vehicle when the global exposure frame is shot.
Optionally, the shooting parameters include original positioning information; generating a synthetic photo file according to the global exposure frame, the shooting parameters and the positioning information of the unmanned aerial vehicle when the global exposure frame is shot, wherein the synthetic photo file comprises:
setting reserved blank information of the global exposure frame through the second operating system, storing the global exposure frame, the shooting parameters and the reserved blank information in an associated manner to obtain an initial synthetic photo file, setting a file name of the initial synthetic photo file, and writing the file name into a third buffer;
after the second operating system acquires the positioning information of the unmanned aerial vehicle from the unmanned aerial vehicle and stores the positioning information of the unmanned aerial vehicle into a fourth buffer, the second operating system acquires the file name from the third buffer, acquires the initial synthetic photo file according to the file name, updates the original positioning information of the initial synthetic photo file into the positioning information of the unmanned aerial vehicle, and acquires an intermediate synthetic photo file;
and the second operating system writes the self-defined data set for the global exposure frame into the reserved blank information of the intermediate synthetic photo file to obtain the synthetic photo file.
Optionally, the shooting parameters are Exif format data, the reserved blank information is reserved blank XMP information, and the positioning information of the unmanned aerial vehicle is RTK positioning information.
Optionally, the updating the original location information of the initial synthesized photo file to the positioning information of the unmanned aerial vehicle includes:
and converting the RTK positioning information into Exif format positioning data, and updating the original positioning information of the initial synthetic photo file into the Exif format positioning data.
Optionally, before the second operating system acquires the global exposure frame and the shooting parameters from the first operating system according to the storage pointer, the method further includes:
and generating a photographing ending semaphore through the second operating system, and acquiring the storage pointer from the second buffer according to the photographing ending semaphore.
Optionally, the first buffer to the fourth buffer are all ring buffers.
Optionally, the first buffer is a first ring buffer, and the storing the global exposure frame and the storage pointer corresponding to the shooting parameter thereof in the first buffer includes:
storing, by the first operating system, the store pointer in the first ring buffer and setting a storage location in the first buffer that stores the store pointer as used;
after the second operating system stores the storage pointer in a second buffer according to the photographing completion instruction and sends a photo storage end instruction to the first operating system, the method further includes:
and receiving the photo storage ending instruction through the first operating system, and setting a storage unit for storing the storage pointer in the first ring buffer to be unused.
In a second aspect, an embodiment of the present application provides a dual-system-based photographing apparatus, which is applied to an image capturing device including a first operating system and a second operating system, where the image capturing device is mounted on an unmanned aerial vehicle, and the apparatus includes:
the starting module is used for starting a photographing preview mode of the photographing equipment through the first operating system;
the sending module is used for sending a photographing instruction to the first operating system through the second operating system;
the first storage module is used for acquiring a global exposure frame through the first operating system according to the photographing instruction, storing the global exposure frame and a storage pointer corresponding to the photographing parameter of the global exposure frame in a first buffer, and sending a photographing completion instruction to the second operating system;
the restarting module is used for restarting the photographing preview mode through the first operating system;
the second storage module is used for storing the storage pointer in a second buffer according to the photographing completion instruction through the second operating system and sending a photo storage ending instruction to the first operating system;
a generating module, configured to obtain, by the second operating system, the global exposure frame and the shooting parameter from the first operating system according to the storage pointer;
and generating a synthetic photo file according to the global exposure frame, the shooting parameters and the positioning information of the unmanned aerial vehicle when the global exposure frame is shot.
Optionally, the shooting parameters include original positioning information; the generating module is further configured to set reserved blank information of the global exposure frame through the second operating system, store the global exposure frame, the shooting parameters, and the reserved blank information in an associated manner to obtain an initial synthesized photo file, set a file name of the initial synthesized photo file, and write the file name into a third buffer;
after the second operating system acquires the positioning information of the unmanned aerial vehicle from the unmanned aerial vehicle and stores the positioning information of the unmanned aerial vehicle into a fourth buffer, the second operating system acquires the file name from the third buffer, acquires the initial synthetic photo file according to the file name, updates the original positioning information of the initial synthetic photo file into the positioning information of the unmanned aerial vehicle to obtain an intermediate synthetic photo file, and writes the custom data set for the global exposure frame into the reserved blank information of the intermediate synthetic photo file to obtain the synthetic photo file.
Optionally, the shooting parameters are Exif format data, the reserved blank information is reserved blank XMP information, and the positioning information of the unmanned aerial vehicle is RTK positioning information.
Optionally, the generating module is further configured to convert the RTK positioning information into Exif format positioning data, and update the original positioning information of the initial synthesized photo file into the Exif format positioning data.
Optionally, the dual-system-based photographing apparatus further includes:
and the acquisition module is used for generating a photographing ending semaphore through the second operating system and acquiring the storage pointer from the second buffer according to the photographing ending semaphore.
Optionally, the first buffer to the fourth buffer are all ring buffers.
Optionally, the first buffer is a first ring buffer, and the first storage module is further configured to store the storage pointer in the first ring buffer through the first operating system, and set a storage unit in the first buffer, where the storage pointer is stored, as a used storage unit;
the photographing device based on the dual system further comprises:
and the setting module is used for receiving the photo storage ending instruction through the first operating system and setting the storage unit for storing the storage pointer in the first annular buffer to be unused.
In a third aspect, an embodiment of the present application provides an image capturing apparatus, including: the dual-system-based photographing method comprises a memory and a processor, wherein the processor is configured with a first operating system and a second operating system, the memory stores a computer program, and the computer program executes the dual-system-based photographing method provided by the first aspect when the processor runs.
In a fourth aspect, the present application provides a computer-readable storage medium, which stores a computer program, and when the computer program runs on a processor, the dual-system based photographing method provided in the first aspect is executed.
According to the double-system-based photographing method, the double-system-based photographing device and the photographing equipment, the first operating system obtains the global exposure frame according to the photographing instruction, the storage pointers corresponding to the global exposure frame and the photographing parameters of the global exposure frame are stored in the first buffer, the photographing completion instruction is sent to the second operating system, the photographing preview mode is restarted through the first operating system, the asynchronous response flow is set, the first operating system can enter the photographing preview mode more quickly, the flow is optimized, and the waiting time is reduced. The second operating system stores the storage pointer in a second buffer according to the photographing completion instruction, sends a photo storage completion instruction to the first operating system, does not perform a specific photo processing flow after receiving the photographing completion instruction of the first operating system, only stores the global exposure frame and the storage pointer of the photographing parameters of the global exposure frame, and enables the second operating system to enter a stage of sending the photographing instruction to the first operating system more quickly, so that the effects of optimizing the flow and reducing the waiting time are achieved. Therefore, the whole photographing process is optimized, the time consumption of a waiting link in the photographing process can be minimized, the photographing speed is improved, and when the data communication pressure of the multi-core communication channel is high, rapid photographing can be achieved.
Drawings
In order to more clearly explain the technical solutions of the present application, the drawings needed to be used in the embodiments are briefly introduced below, and it should be understood that the following drawings only illustrate some embodiments of the present application and therefore should not be considered as limiting the scope of protection of the present application. Like components are numbered similarly in the various figures.
Fig. 1 is a schematic flow chart illustrating a dual-system-based photographing method according to an embodiment of the present application;
fig. 2 is a schematic flow chart illustrating step S106 of the dual-system-based photographing method according to the embodiment of the present application;
fig. 3 shows a schematic structural diagram of a dual-system-based photographing apparatus provided in an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments.
The components of the embodiments of the present application, generally described and illustrated in the figures herein, can be arranged and designed in a wide variety of different configurations. Thus, the following detailed description of the embodiments of the present application, presented in the accompanying drawings, is not intended to limit the scope of the claimed application, but is merely representative of selected embodiments of the application. All other embodiments, which can be derived by a person skilled in the art from the embodiments of the present application without making any creative effort, shall fall within the protection scope of the present application.
Hereinafter, the terms "including", "having", and their derivatives, which may be used in various embodiments of the present application, are intended to indicate only specific features, numbers, steps, operations, elements, components, or combinations of the foregoing, and should not be construed as first excluding the existence of, or adding to, one or more other features, numbers, steps, operations, elements, components, or combinations of the foregoing.
Furthermore, the terms "first," "second," "third," and the like are used solely to distinguish one from another and are not to be construed as indicating or implying relative importance.
Unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which the various embodiments of the present application belong. The terms (such as those defined in commonly used dictionaries) should be interpreted as having a meaning that is consistent with their contextual meaning in the relevant art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein in various embodiments.
Example 1
The embodiment of the disclosure provides a photographing method based on a dual system, which is applied to a camera device comprising a first operating system and a second operating system.
Specifically, as shown in fig. 1, the photographing method based on the dual system includes:
and step S101, starting a photographing preview mode of the photographing equipment through the first operating system.
In this embodiment, the first operating system is a real-time operating system, and the second operating system is a non-real-time operating system. Specifically, the first operating system is a rtos operating system, and the second operating system is a Linux operating system. The first operating system is used for generating image data, and the second operating system is used for storing the image data.
In this embodiment, the photographing preview mode of the image pickup apparatus is started by the first operating system, so that the image pickup apparatus is in the photographing preview mode, and after a photographing instruction of the second operating system is received, a photo can be immediately taken, thereby saving photographing time. In the present embodiment, the resolution of the photographing preview mode may be set to the maximum resolution of the image pickup apparatus so as to acquire a high definition image by the image pickup apparatus.
In this embodiment, the camera device can be carried on the unmanned aerial vehicle, and can shoot photos in different areas by flying the unmanned aerial vehicle.
And step S102, sending a photographing instruction to the first operating system through the second operating system.
In this embodiment, after step S102, the second operating system blocks and waits for a photographing completion instruction sent by the first operating system, where the photographing completion instruction may be an Acknowledgement (ACK) signal indicating that photographing is successful.
Step S103, acquiring a global exposure frame through the first operating system according to the photographing instruction, storing the global exposure frame and a storage pointer corresponding to the photographing parameter thereof in a first buffer, and sending a photographing completion instruction to the second operating system.
In this embodiment, the first operating system controls the image capturing device to capture an overall exposure frame through complicated pipeline control according to the photographing instruction. It is added that the global exposure frame may also be referred to as a global shutter frame. The storage pointers comprise a storage pointer of the global exposure frame and a storage pointer of the shooting parameters corresponding to the global exposure frame, and the storage pointer of the global exposure frame is as follows: an address pointer for indicating storage of a global exposure frame, wherein the shooting parameters of the global exposure frame refer to: the shooting parameters corresponding to the camera device when shooting the global exposure frame include initial positioning information with inaccurate shooting parameters, and the shooting parameters can be shooting parameters in an Exif format. The storage pointer of the shooting parameters corresponding to the global exposure frame is as follows: and the address pointer is used for indicating and storing the shooting parameters corresponding to the global exposure frame. The file format of the shooting parameters of the global exposure frame is convertible to an image file format (Exif). The shooting parameters corresponding to the global exposure frame comprise parameters such as aperture size exposure time and the like.
It should be noted that, in step S103, the first operating system sends a photographing completion instruction to the second operating system, and the second operating system receives the photographing completion instruction from the first operating system.
And step S104, restarting the photographing preview mode through the first operating system.
In this embodiment, after step S103 is executed, step S104 is executed instead of waiting for blocking to wait for the second operating system to send a confirmation signal that the processing of the global exposure frame is successful, mainly because the scheduling priority of the multi-core communication task is the lowest, when the system processing data pressure is high or the multi-core communication channel is preempted by other communication data for too many processor CPU time slices, the response of the multi-core communication is not very timely, so the asynchronous response flow is set, and the first operating system can enter the photo preview mode more quickly, thereby achieving the effect of optimizing the flow and reducing the waiting time.
And step S105, storing the storage pointer in a second buffer by the second operating system according to the photographing completion instruction, and sending a photo storage end instruction to the first operating system.
In this embodiment, from step S102, the time t1 when the second operating system receives the photographing completion instruction from the first operating system after the second operating system sends the photographing instruction to the first operating system may be regarded as the time when the global exposure frame is photographed. In step S105, after receiving the photographing completion instruction from the first operating system, the second operating system does not perform a specific photo processing procedure, but only stores the global exposure frame and the storage pointer of the photographing parameter thereof, so that the second operating system can more quickly enter a stage of sending the photographing instruction to the first operating system, thereby achieving the effects of optimizing the procedure and reducing the waiting time.
And step S106, acquiring the global exposure frame and the shooting parameters from the first operating system through the second operating system according to the storage pointer, and generating a synthetic photo file according to the global exposure frame, the shooting parameters and the positioning information of the unmanned aerial vehicle when the global exposure frame is shot.
In this embodiment, the positioning information of the unmanned aerial vehicle when the global exposure frame is shot is forwarded to the second operating system by the unmanned aerial vehicle, and the positioning information of the unmanned aerial vehicle may be RTK positioning information including longitude and latitude information, height information, and the like. When the camera shooting device shoots the global shutter frame, the unmanned aerial vehicle acquires RTK positioning information of the unmanned aerial vehicle, due to the fact that the forwarding pressure is large, the time when the second operating system of the camera shooting device receives the RTK positioning information is delayed, and after the second operating system receives the RTK positioning information, the RTK positioning information is stored in a specified buffer.
In this embodiment, the custom data set for the global exposure frame may be custom data obtained by summarizing and explaining the global exposure frame according to a preset file format, and for example, the custom data may be positioning information indicating whether the current photo is successfully and correctly updated. The preset file format may be an XMP file format, for example, custom data is set according to the XMP file format.
Optionally, the shooting parameters include original positioning information, referring to fig. 2, the step S106 of generating a synthetic photo file according to the global exposure frame, the shooting parameters, and the positioning information of the unmanned aerial vehicle when shooting the global exposure frame includes:
step S1061, setting reserved blank information of the global exposure frame through the second operating system, storing the global exposure frame, the shooting parameters and the reserved blank information in an associated manner to obtain an initial synthetic photo file, setting a file name of the initial synthetic photo file, and writing the file name into a third buffer;
step S1062, after the second operating system acquires the positioning information of the unmanned aerial vehicle from the unmanned aerial vehicle and stores the positioning information of the unmanned aerial vehicle in a fourth buffer, the second operating system acquires the file name from the third buffer, acquires the initial synthetic photo file according to the file name, updates the original positioning information of the initial synthetic photo file into the positioning information of the unmanned aerial vehicle, and obtains an intermediate synthetic photo file;
step S1063, the second operating system writes the custom data set for the global exposure frame into the reserved blank information of the intermediate synthetic photo file, so as to obtain the synthetic photo file.
In this embodiment, the initial composite photograph file may be stored in a memory, which may be a FLash memory (FLash). The RTK positioning information of the unmanned aerial vehicle is generated by the unmanned aerial vehicle according to actual conditions, and due to the fact that the unmanned aerial vehicle transmits different pressures, the unmanned aerial vehicle transmits the RTK positioning information of the unmanned aerial vehicle to a second operating system of the camera equipment for a period of time, and the time for the second operating system to receive the flight control information is unfixed. And after receiving the RTK positioning information of the unmanned aerial vehicle, updating the positioning information in the initial synthetic photo file into RTK positioning information, and updating corresponding custom data for the reserved blank information to obtain a synthetic photo file.
It is supplementary to be noted that the shooting parameters are Exif format data, the reserved blank information is reserved blank XMP information, and the positioning information of the unmanned aerial vehicle is RTK positioning information.
It is further supplementary stated that said updating the original location information of the initial composite photo file to the drone location information includes:
converting the RTK positioning information into Exif format positioning data, and updating the original positioning information of the initial synthetic photo file into the Exif format positioning data;
the second operating system writes the custom data set for the global exposure frame into the reserved blank information of the intermediate synthetic photo file to obtain the synthetic photo file, including:
and writing the custom data in the XMP format into the reserved blank XMP information of the intermediate synthetic photo file to obtain the synthetic photo file.
In this embodiment, the first buffer to the fourth buffer are all ring buffers. Specifically, the first buffer is a first ring buffer, the second buffer is a second ring buffer, the third buffer is a third ring buffer, and the fourth buffer is a fourth ring buffer. It is added that the ring buffer may also be called a ring buf. In this embodiment, the storage capacity of the ring buffer is 5M, and may include 32 storage units, where one storage unit corresponds to one subscript, and one storage unit stores one set of data.
Optionally, before step S106, the photographing method based on dual systems further includes:
and generating a photographing ending semaphore through the second operating system, and acquiring the storage pointer from the second buffer according to the photographing ending semaphore.
In this embodiment, the second operating system stores the storage pointer in the second buffer, which can indicate that the first operating system has taken a picture for the shooting instruction sent by the second operating system, the second operating system confirms the shooting progress for the shooting instruction sent before, and after the shooting end semaphore is generated, the second operating system may resend another shooting instruction to the first operating system subsequently, and instruct the first operating system to take another picture.
In this embodiment, the photographing end semaphore includes the storage address information of the storage pointer stored in the second buffer, and after the second operating system reads the corresponding storage address information from the photographing end semaphore, the storage pointer may be obtained from the storage address corresponding to the second buffer.
Optionally, the first buffer is a first ring buffer, and in step S102, the storing the global exposure frame and the storage pointer corresponding to the shooting parameter thereof in the first buffer includes:
storing, by the first operating system, the store pointer in the first ring buffer, and setting a storage location in the first buffer that stores the store pointer as used.
In the present embodiment, one storage unit corresponds to one subscript, and the subscript of the storage unit storing the storage pointer in the first ring buffer is set to be used.
Optionally, the photographing method based on the dual system further includes:
and receiving the photo storage ending instruction through the first operating system, and setting a storage unit for storing the storage pointer in the first ring buffer to be unused.
In this embodiment, after receiving the photo storage end instruction, the first operating system sets the index of the storage unit in the first ring buffer, where the storage pointer is stored, to be unused, so that the first ring buffer stores data in a circulating manner.
It should be noted that the operation of the second operating system in the whole photographing process may be divided into a photographing command task, a photo storage task, a flight control processing task, and a photographing synchronization task. And when processing the photographing command task, the second operating system sends a photographing instruction to the first operating system through the independent multi-core communication channel. The first operating system receives a photographing instruction, sets photographing parameters of the photographing equipment, controls the photographing equipment to acquire a global exposure frame, stores the global exposure frame and the corresponding photographing parameters, generates a storage pointer of the global exposure frame and the corresponding photographing parameters, and stores the storage pointer in the first annular buffer. And the first operating system sends a photographing completion instruction to the second operating system. And the second operating system receives the photographing completion instruction. And sending a photographing instruction from the second operating system to the first operating system until the second operating system receives a photographing completion instruction, which is considered as photographing time t 1.
After the first operating system sends a photographing completion instruction to the second operating system, the subscript of the storage unit of the first ring buffer storing the storage pointer is set to be used. And the process of photographing the words by the first operating system is finished, the photographing preview mode of the photographing equipment is restarted, and the next photographing can be carried out at any time. And restarting the photographing preview mode through the first operating system, and setting an asynchronous response process to enable the first operating system to enter the photographing preview mode more quickly, so that the effects of optimizing the process and reducing the waiting time are achieved.
And the first operating system asynchronously waits for a photo storage ending instruction sent by the second operating system, and after receiving the photo storage ending instruction, the subscript of the storage unit of the first ring buffer for storing the storage pointer is set as unused.
And after receiving the photographing completion instruction, the second operating system continues to process the subsequent steps of the photographing command task. After the second operating system receives the photographing completion instruction, if the storage pointer is acquired according to the photographing completion instruction and is successfully stored in the second ring buffer, the photographing completion semaphore is sent to the photo storage task, and the photo storage completion instruction is sent to the first operating system. After receiving the shooting completion instruction of the first operating system, the second operating system does not perform a specific photo processing flow, only stores the global exposure frame and the storage pointer of the shooting parameters thereof, and can enable the second operating system to enter a stage of sending the shooting instruction to the first operating system more quickly, thereby achieving the effects of optimizing the flow and reducing the waiting time.
And after the second operating system sends the photographing ending semaphore to the photo storage task and sends the photo storage ending semaphore to the first operating system, the first operating system can consider that the second operating system finishes storing data. And acquiring a storage pointer from the second operating system according to the photographing completion instruction, successfully storing the storage pointer into the second ring buffer, and sending a photograph storage ending instruction to the first operating system by the second operating system, wherein the photograph storage ending instruction is regarded as photographing time t 2.
After receiving the photographing ending semaphore, a photo storage task of the second operating system acquires a storage pointer from the second ring buffer, acquires a global exposure frame and photographing parameters thereof according to the storage pointer, sets corresponding reserved blank XMP information for the global exposure frame, stores the global exposure frame, the photographing parameters and the reserved blank XMP information in an associated manner to obtain an initial synthesized photo file, sets a file name of the initial synthesized photo file, and writes the file name into a third buffer, so that the execution of the photo storage task is ended.
In the flight control processing task of the second operating system, the camera device is in communication connection with the unmanned aerial vehicle, the camera device acquires unmanned aerial vehicle positioning information corresponding to a shooting global exposure frame from the unmanned aerial vehicle, the unmanned aerial vehicle positioning information is generally RTK positioning information, and the RTK positioning information is stored in the fourth annular buffer.
In a photographing synchronization task of the second operating system, a file name of an initial synthesized photo file is acquired from the third annular buffer, a corresponding initial synthesized photo file is acquired from the flash memory according to the file name, corresponding RTK positioning information is acquired from the fourth annular buffer, the RTK positioning information is converted into Exif format positioning data, the original positioning information of the initial synthesized photo file is updated to the Exif format positioning data, and an intermediate synthesized photo file is acquired. And the second operating system writes the custom data in the XMP format into the reserved blank XMP information of the intermediate synthetic photo file to obtain a synthetic photo file. The execution process time of the photographing synchronization task is regarded as the photographing time t 3. In the whole flow, the time required for photographing to obtain the composite photograph file is the sum of the photographing time t1, the photographing time t2 and the photographing time t 3.
It should be noted that, after the photographing time t2 is over, the second ring buffer stores the global exposure frame and the storage pointer of the photographing parameters thereof, and at this time, a high-precision photo needs to be generated and also needs corresponding RTK positioning information, because of the forwarding pressure of the unmanned aerial vehicle, the time for the camera device to receive the RTK positioning information is not fixed, so that three tasks, namely a photo storage task, a flight control processing task and a photographing synchronization task, are divided, and the RTK positioning information is synchronized.
In the dual-system-based photographing method provided by this embodiment, the first operating system obtains a global exposure frame according to the photographing instruction, stores the global exposure frame and a storage pointer corresponding to the photographing parameter in the first buffer, sends a photographing completion instruction to the second operating system, restarts the photographing preview mode through the first operating system, and sets an asynchronous response flow, so that the first operating system can enter the photographing preview mode more quickly, thereby achieving the effects of optimizing the flow and reducing the waiting time. The second operating system stores the storage pointer in a second buffer according to the photographing completion instruction, sends a photo storage completion instruction to the first operating system, does not perform a specific photo processing flow after receiving the photographing completion instruction of the first operating system, only stores the global exposure frame and the storage pointer of the photographing parameters of the global exposure frame, and enables the second operating system to enter a stage of sending the photographing instruction to the first operating system more quickly, so that the effects of optimizing the flow and reducing the waiting time are achieved. Therefore, the whole photographing process is optimized, the time consumption of a waiting link in the photographing process can be minimized, the photographing speed is improved, and when the data communication pressure of the multi-core communication channel is high, rapid photographing can be achieved.
Example 2
In addition, the embodiment of the disclosure provides a photographing device based on dual systems, which is applied to an image pickup apparatus including a first operating system and a second operating system.
Specifically, as shown in fig. 3, the dual system-based photographing apparatus 300 includes:
a starting module 301, configured to start a shooting preview mode of the image capturing apparatus through the first operating system;
a sending module 302, configured to send a photographing instruction to the first operating system through the second operating system;
a first storage module 303, configured to obtain, by the first operating system, a global exposure frame according to the photographing instruction, store the global exposure frame and a storage pointer corresponding to a photographing parameter of the global exposure frame in a first buffer, and send a photographing completion instruction to the second operating system;
a restart module 304, configured to restart the preview taking mode through the first operating system;
a second storage module 305, configured to store the storage pointer in a second buffer according to the photographing completion instruction through the second operating system, and send a photo storage end instruction to the first operating system;
a generating module 306, configured to obtain, by the second operating system, the global exposure frame and the shooting parameters from the first operating system according to the storage pointer, and generate a synthetic photo file according to the global exposure frame, the shooting parameters, and the positioning information of the unmanned aerial vehicle when shooting the global exposure frame.
Optionally, the shooting parameters include original positioning information; the generating module 306 is further configured to set reserved blank information of the global exposure frame through the second operating system, store the global exposure frame, the shooting parameter, and the reserved blank information in an associated manner, obtain an initial synthesized photo file, set a file name of the initial synthesized photo file, and write the file name into a third buffer;
after the second operating system acquires the positioning information of the unmanned aerial vehicle from the unmanned aerial vehicle and stores the positioning information of the unmanned aerial vehicle into a fourth buffer, the second operating system acquires the file name from the third buffer, acquires the initial synthetic photo file according to the file name, updates the original positioning information of the initial synthetic photo file into the positioning information of the unmanned aerial vehicle, and acquires an intermediate synthetic photo file;
and the second operating system writes the self-defined data set for the global exposure frame into the reserved blank information of the intermediate synthetic photo file to obtain the synthetic photo file.
Optionally, the shooting parameters are Exif format data, the reserved blank information is reserved blank XMP information, and the positioning information of the unmanned aerial vehicle is RTK positioning information.
Optionally, the generating module 306 is further configured to convert the RTK positioning information into Exif format positioning data, and update the original positioning information of the initial synthesized photo file into the Exif format positioning data;
and writing the custom data in the XMP format into the reserved blank XMP information of the intermediate synthetic photo file to obtain the synthetic photo file.
Optionally, the dual-system-based photographing apparatus 300 further includes:
and the acquisition module is used for generating a photographing ending semaphore through the second operating system and acquiring the storage pointer from the second buffer according to the photographing ending semaphore.
Optionally, the first buffer to the fourth buffer are all ring buffers.
Optionally, the first buffer is a first ring buffer, and the first storage module 303 is further configured to store the storage pointer in the first ring buffer through the first operating system, and set a storage unit in the first buffer, where the storage pointer is stored, as a used storage unit;
the dual system-based photographing apparatus 300 further includes:
and the setting module is used for receiving the photo storage ending instruction through the first operating system and setting the storage unit for storing the storage pointer in the first annular buffer to be unused.
In the dual-system-based photographing apparatus provided in this embodiment, the first operating system obtains the global exposure frame according to the photographing instruction, stores the global exposure frame and the storage pointer corresponding to the photographing parameter in the first buffer, sends the photographing completion instruction to the second operating system, restarts the photographing preview mode through the first operating system, and sets the asynchronous response flow, so that the first operating system can enter the photographing preview mode more quickly, thereby achieving the effects of optimizing the flow and reducing the waiting time. The second operating system stores the storage pointer in a second buffer according to the photographing completion instruction, sends a photo storage completion instruction to the first operating system, does not perform a specific photo processing flow after receiving the photographing completion instruction of the first operating system, only stores the global exposure frame and the storage pointer of the photographing parameters of the global exposure frame, and enables the second operating system to enter a stage of sending the photographing instruction to the first operating system more quickly, so that the effects of optimizing the flow and reducing the waiting time are achieved. Therefore, the whole photographing process is optimized, the time consumption of a waiting link in the photographing process can be minimized, the photographing speed is improved, and when the data communication pressure of the multi-core communication channel is high, rapid photographing can be achieved.
Example 3
Furthermore, an embodiment of the present disclosure provides an image capturing apparatus, including a memory and a processor, where the memory stores a computer program, and the computer program, when running on the processor, executes the dual-system-based photographing method provided in the above-mentioned method embodiment 1.
It should be noted that, for the specific implementation steps of this embodiment, reference may be made to the description of the corresponding contents of the dual-system-based photographing method in embodiment 1, which is not described herein again.
Example 4
The present application further provides a computer-readable storage medium, on which a computer program is stored, which, when executed by a processor, implements the steps of the dual-system based photographing method of embodiment 1.
It should be noted that, for the specific implementation steps of this embodiment, reference may be made to the description of the corresponding contents of the dual-system-based photographing method in embodiment 1, which is not described herein again.
In this embodiment, the computer-readable storage medium may be a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or terminal that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or terminal. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or terminal that comprises the element.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present application may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present application.
While the present embodiments have been described with reference to the accompanying drawings, it is to be understood that the invention is not limited to the precise embodiments described above, which are meant to be illustrative and not restrictive, and that various changes may be made therein by those skilled in the art without departing from the spirit and scope of the invention as defined by the appended claims.
Claims (10)
1. A shooting method based on dual systems is applied to camera equipment comprising a first operating system and a second operating system, and comprises the following steps:
starting a photographing preview mode of the photographing equipment through the first operating system;
sending a photographing instruction to the first operating system through the second operating system;
acquiring a global exposure frame through the first operating system according to the photographing instruction, storing the global exposure frame and a storage pointer corresponding to the photographing parameter of the global exposure frame in a first buffer, and sending a photographing completion instruction to the second operating system;
restarting the photographing preview mode through the first operating system;
storing the storage pointer in a second buffer by the second operating system according to the photographing completion instruction, and sending a photo storage end instruction to the first operating system;
and acquiring the global exposure frame and the shooting parameters from the first operating system through the second operating system according to the storage pointer, and generating a synthetic photo file according to the global exposure frame, the shooting parameters and the positioning information of the unmanned aerial vehicle when the global exposure frame is shot.
2. The method of claim 1, wherein the shooting parameters include raw positioning information; generating a synthetic photo file according to the global exposure frame, the shooting parameters and the positioning information of the unmanned aerial vehicle when the global exposure frame is shot, wherein the synthetic photo file comprises:
setting reserved blank information of the global exposure frame through the second operating system, storing the global exposure frame, the shooting parameters and the reserved blank information in an associated manner to obtain an initial synthetic photo file, setting a file name of the initial synthetic photo file, and writing the file name into a third buffer;
after the second operating system acquires the positioning information of the unmanned aerial vehicle from the unmanned aerial vehicle and stores the positioning information of the unmanned aerial vehicle into a fourth buffer, the second operating system acquires the file name from the third buffer, acquires the initial synthetic photo file according to the file name, updates the original positioning information of the initial synthetic photo file into the positioning information of the unmanned aerial vehicle, and acquires an intermediate synthetic photo file;
and the second operating system writes the self-defined data set for the global exposure frame into the reserved blank information of the intermediate synthetic photo file to obtain the synthetic photo file.
3. The method of claim 2, wherein the shooting parameters are Exif format data, the reserved blank information is reserved blank XMP information, and the drone positioning information is RTK positioning information.
4. The method of claim 3, wherein the updating the original positioning information of the initial composite photo file to the drone positioning information comprises:
converting the RTK positioning information into Exif format positioning data, and updating the original positioning information of the initial synthetic photo file into the Exif format positioning data;
the second operating system writes the custom data set for the global exposure frame into the reserved blank information of the intermediate synthetic photo file to obtain the synthetic photo file, including:
and writing the custom data in the XMP format into the reserved blank XMP information of the intermediate synthetic photo file to obtain the synthetic photo file.
5. The method of claim 1, wherein before the obtaining, by the second operating system, the global exposure frame and the shooting parameters from the first operating system according to the storage pointer, the method further comprises:
and generating a photographing ending semaphore through the second operating system, and acquiring the storage pointer from the second buffer according to the photographing ending semaphore.
6. The method of claim 3, wherein the first through fourth buffers are all ring buffers.
7. The method according to claim 6, wherein the first buffer is a first ring buffer, and the storing the global exposure frame and the storage pointer corresponding to the shooting parameter thereof in the first buffer comprises:
storing, by the first operating system, the store pointer in the first ring buffer,
setting a storage unit for storing the storage pointer in the first buffer to be used;
after the second operating system stores the storage pointer in a second buffer according to the photographing completion instruction and sends a photo storage end instruction to the first operating system, the method further includes:
and receiving the photo storage ending instruction through the first operating system, and setting a storage unit for storing the storage pointer in the first ring buffer to be unused.
8. The utility model provides a device of shooing based on dual system which characterized in that is applied to the camera equipment that includes first operating system and second operating system, the device includes:
the starting module is used for starting a photographing preview mode of the photographing equipment through the first operating system;
the sending module is used for sending a photographing instruction to the first operating system through the second operating system;
the first storage module is used for acquiring a global exposure frame through the first operating system according to the photographing instruction, storing the global exposure frame and a storage pointer corresponding to the photographing parameter of the global exposure frame in a first buffer, and sending a photographing completion instruction to the second operating system;
the restarting module is used for restarting the photographing preview mode through the first operating system;
the second storage module is used for storing the storage pointer in a second buffer according to the photographing completion instruction through the second operating system and sending a photo storage ending instruction to the first operating system;
and the generation module is used for acquiring the global exposure frame and the shooting parameters from the first operating system through the second operating system according to the storage pointer and generating a synthetic photo file according to the global exposure frame, the shooting parameters and the positioning information of the unmanned aerial vehicle when the global exposure frame is shot.
9. An image pickup apparatus characterized by comprising: a memory configured with a first operating system and a second operating system, and a processor, the memory storing a computer program that, when executed by the processor, performs the dual system-based photographing method according to any one of claims 1 to 7.
10. A computer-readable storage medium, characterized in that it stores a computer program which, when run on a processor, performs the dual system-based photographing method of any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110725011.6A CN113473009B (en) | 2021-06-29 | 2021-06-29 | Photographing method and device based on dual systems and camera equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110725011.6A CN113473009B (en) | 2021-06-29 | 2021-06-29 | Photographing method and device based on dual systems and camera equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113473009A true CN113473009A (en) | 2021-10-01 |
| CN113473009B CN113473009B (en) | 2022-11-08 |
Family
ID=77873634
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110725011.6A Active CN113473009B (en) | 2021-06-29 | 2021-06-29 | Photographing method and device based on dual systems and camera equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113473009B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114500768A (en) * | 2022-02-18 | 2022-05-13 | 广州极飞科技股份有限公司 | Camera synchronous shooting method and device, unmanned equipment and storage medium |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060204236A1 (en) * | 2005-02-16 | 2006-09-14 | Nikon Corporation | Intermittent photo-taking device and microscope system having the same device |
| CN104994277A (en) * | 2015-06-30 | 2015-10-21 | 青岛海信移动通信技术股份有限公司 | Rapid shooting method and device for mobile communication terminal |
| CN105338249A (en) * | 2015-11-24 | 2016-02-17 | 努比亚技术有限公司 | Independent camera system-based shooting method and mobile terminal |
| CN106060406A (en) * | 2016-07-27 | 2016-10-26 | 维沃移动通信有限公司 | Photographing method and mobile terminal |
| CN106102057A (en) * | 2016-05-27 | 2016-11-09 | 北京奇虎科技有限公司 | Portable control end equipment and WiFi access remote authentication method, device |
| US9854155B1 (en) * | 2015-06-16 | 2017-12-26 | Amazon Technologies, Inc. | Determining camera auto-focus settings |
| CN108471499A (en) * | 2018-05-06 | 2018-08-31 | 深圳市保千里电子有限公司 | A method of taking pictures and select photo automatically based on artificial intelligence |
| CN108924590A (en) * | 2018-06-27 | 2018-11-30 | 哈尔滨市舍科技有限公司 | Video playing and camera system |
| CN111924119A (en) * | 2020-07-15 | 2020-11-13 | 招商局国际信息技术有限公司 | Wharf intelligent point inspection method and system based on unmanned aerial vehicle |
-
2021
- 2021-06-29 CN CN202110725011.6A patent/CN113473009B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060204236A1 (en) * | 2005-02-16 | 2006-09-14 | Nikon Corporation | Intermittent photo-taking device and microscope system having the same device |
| US9854155B1 (en) * | 2015-06-16 | 2017-12-26 | Amazon Technologies, Inc. | Determining camera auto-focus settings |
| CN104994277A (en) * | 2015-06-30 | 2015-10-21 | 青岛海信移动通信技术股份有限公司 | Rapid shooting method and device for mobile communication terminal |
| CN105338249A (en) * | 2015-11-24 | 2016-02-17 | 努比亚技术有限公司 | Independent camera system-based shooting method and mobile terminal |
| CN106102057A (en) * | 2016-05-27 | 2016-11-09 | 北京奇虎科技有限公司 | Portable control end equipment and WiFi access remote authentication method, device |
| CN106060406A (en) * | 2016-07-27 | 2016-10-26 | 维沃移动通信有限公司 | Photographing method and mobile terminal |
| CN108471499A (en) * | 2018-05-06 | 2018-08-31 | 深圳市保千里电子有限公司 | A method of taking pictures and select photo automatically based on artificial intelligence |
| CN108924590A (en) * | 2018-06-27 | 2018-11-30 | 哈尔滨市舍科技有限公司 | Video playing and camera system |
| CN111924119A (en) * | 2020-07-15 | 2020-11-13 | 招商局国际信息技术有限公司 | Wharf intelligent point inspection method and system based on unmanned aerial vehicle |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114500768A (en) * | 2022-02-18 | 2022-05-13 | 广州极飞科技股份有限公司 | Camera synchronous shooting method and device, unmanned equipment and storage medium |
| CN114500768B (en) * | 2022-02-18 | 2023-06-16 | 广州极飞科技股份有限公司 | Camera synchronous shooting method and device, unmanned equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113473009B (en) | 2022-11-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20200327698A1 (en) | Image Processing Apparatus, Method for Image Processing, and Electronic Device | |
| US11927442B2 (en) | Aerial survey method and apparatus capable of eliminating redundant aerial photos | |
| CN101232581A (en) | Image forming apparatus and method of controlling continuously shot images | |
| CN106708070B (en) | Aerial photography control method and device | |
| CN113473009B (en) | Photographing method and device based on dual systems and camera equipment | |
| CN110383810B (en) | Information processing apparatus, information processing method, and information processing program | |
| CN105320718B (en) | Transaction completion in a synchronous replication environment | |
| TW201351983A (en) | Storyboards for capturing images | |
| US20130188064A1 (en) | Photographing apparatus, image transfer method, and program | |
| JP5571944B2 (en) | Imaging apparatus, control method therefor, and program | |
| US10896124B2 (en) | Recording control apparatus, control method thereof and non-transitory computer-readable storage medium | |
| CN114500768B (en) | Camera synchronous shooting method and device, unmanned equipment and storage medium | |
| CN116932645A (en) | Data synchronization method, device, system, equipment and medium of data lake | |
| US20120249840A1 (en) | Electronic camera | |
| US20050128194A1 (en) | Terminal control apparatus, terminal control method, terminal control program and storage medium | |
| CN111986309B (en) | System and method for generating special film Pre-vis based on three-dimensional scanning | |
| JP2000134531A (en) | Image pickup device, its controlling method and storage medium | |
| JP4804317B2 (en) | Electronics | |
| JP2019169146A (en) | Image creation system, image display system, image creation method, image creation program, and movable body | |
| JP2006287588A (en) | Image processing apparatus and method, data file structure, computer program, and storage medium | |
| CN115442524B (en) | Image pickup method and system, terminal equipment and computer readable storage medium | |
| JP2012103963A (en) | Content data management device, content data management system, content data management program and content data management method | |
| KR102568698B1 (en) | UAV-based image file/transmission validation system and method | |
| CN210444370U (en) | Underwater camera device based on raspberry group | |
| JP5473470B2 (en) | Electronic device, control method therefor, and program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |