Specific embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete
Site preparation is described, it is clear that described embodiment is only a part of embodiment of the invention, rather than whole embodiments.It is based on
Embodiment in the present invention, it is every other that those of ordinary skill in the art are obtained under the premise of creative work is not made
Embodiment, belongs to the scope of protection of the invention.
Method first embodiment
As shown in Fig. 2 The embodiment provides a kind of processing method of view data, mobile terminal is applied to,
The mobile terminal include camera module, at least one coprocessor be connected with the camera module and with least one association treatment company
The primary processor for connecing, the processing method includes:
Step 201:The memory space that the view data that primary processor gathers camera module takes is carried out with predetermined threshold
Compare.
The processing method of the view data of the embodiment of the present invention, camera system that can be as shown in Figure 3 is realized.This is taken pictures and is
System include at least one coprocessor (coprocessor is only illustrated in Fig. 3) that camera module and camera module connect and
The primary processor of the coprocessor connection.
Wherein, the output end of camera module is connected with the input of coprocessor, and camera module may include that multiple shootings are single
First (camera), coprocessor can control the camera module, and primary processor can control coprocessor and camera module.Main process task
Data communication interface unit, control interface unit are provided between device and coprocessor;Set between primary processor and camera module
It is equipped with communications interface unit;Communications interface unit is provided between coprocessor and camera module.
Function detailed description below to each part is as follows.
Coprocessor is received to view data, caching, treatment, and by the data is activation after treatment to primary processor;
Coprocessor also can Bypass (bypass channel) view data to primary processor.The life that the executable primary processor of coprocessor sends
Order, coprocessor also can individually perform calculation process as a subsystem element.In addition, the transmittable order of coprocessor is to each
Individual image unit is controlled.The structure of coprocessor is including but not limited to module as shown in Figure 4.
A, bypass channel Bypass submodules can receive any image unit in multiple image units by communication interface
View data, and be transmitted directly to primary processor;Also the view data of multiple image units can be sent to main process task simultaneously
Device.
The executable primary processor of b, Digital Signal Processing DSP submodules is sent to the order of coprocessor, at operation image
Reason dependent instruction, calculation process is carried out to view data.
C, Double Data Rate synchronous DRAM (Double Data Rate Synchronous Dynamic
Random Access Memory, DDR) submodule can caching image data, can store primary processor by control interface load
Image procossing application firmware, can also store DSP calculate treatment ephemeral data.
D, power supply submodule, management is powered to coprocessor.
E, communication interface submodule support coprocessor and camera module or main processor system communication, and view data is passed
It is defeated.
F, read-only memory (Read Only Memory, ROM) submodule storage coprocessor system start associated firmware etc..
Primary processor is made up of the SOC System on Chip/SoCs of mobile terminal, and the high pass manufacturer processor that such as mobile terminal is commonly used is valiant
Imperial, valiant imperial series etc..Primary processor is including but not limited to unit module as shown in Figure 5:Graphics processing unit, processor list
Unit, system bus, memory cell, other submodule units.Primary processor can enter to the image data information of coprocessor output
Row is received, caching, treatment, and is stored and be shown to interface of mobile terminal by the data after treatment;Primary processor can be transmitted
Order or parameter are controlled to coprocessor to coprocessor.Primary processor can independently be held as image processing system unit
The treatment of row image operation.
In addition, it is necessary to explanation, coprocessor and primary processor data communication interface unit are passed for general purpose image data
Defeated interface, for example, the image data communication between coprocessor and primary processor can be processed with one or more groups of mobile industries
Device MIPI interfaces realize that every group interface can transmit view data with 1*lane, 2*lane or 4*lane.
Control interface unit between coprocessor and primary processor can for one or more groups of SPI interfaces, I2C interfaces or
GPIO etc.;The order of coprocessor is controlled for transmitting primary processor, or can be used to transmit coprocessor to the life of primary processor
Order or data, or for transmitting the firmware data for downloading primary processor to coprocessor.
The communications interface unit of primary processor and each camera module can be I2C interfaces or GPIO interface etc., for transmitting master
Processor controls order or the data of each camera module.
The communications interface unit of coprocessor and each camera module can use one or more groups of I2C mouthfuls and one or more groups of MIPI
Interface;For transmitting each camera module to the view data of coprocessor, or for transmitting coprocessor to each camera module
Order or data.
Camera module, for induced environment light, and is converted to data signal by the light of sensing, so that output data image is believed
Breath.
In above-mentioned steps 201, be compared for the memory space occupancy of view data and predetermined threshold by primary processor
Purpose be in order to determine coprocessor whether need with primary processor together to camera module gather view data process,
To accelerate image processing efficiency.
Step 202:When above-mentioned memory space is more than above-mentioned predetermined threshold, primary processor is connected to above-mentioned camera module
At least one coprocessor, export the first control instruction.
Specifically, the serial peripheral equipment interface SPI by connecting the primary processor and the coprocessor, described the is exported
One control instruction;Or by controlling the universal input/output GPIO interface of the connection primary processor and the coprocessor
State, export first control instruction.
First control instruction is the control instruction for controlling coprocessor that image procossing is carried out to view data.In picture number
When being more than above-mentioned predetermined threshold according to the memory space for taking, export the first control instruction to coprocessor to control coprocessor
Certain treatment is carried out to view data, so as to mitigate primary processor data volume to be dealt with.
Here predetermined threshold, can be modified setting according to user's request, be not specifically limited herein.
Step 203:Primary processor obtains the above-mentioned picture number that above-mentioned coprocessor is transmitted according to above-mentioned first control instruction
According to and data processed result, the data processed result be above-mentioned coprocessor according to preset algorithm in above-mentioned view data preset
What the view data of frame number was calculated.
The data volume of the view data of the default frame number can be less than or equal to the picture number of above-mentioned camera module collection
According to memory space occupancy.Coprocessor receives and the view data of default frame number can be cached after above-mentioned first control instruction arrives
DDR, and data image to caching carries out a frame or many frame arithmetics, and operation result is preserved in DDR, and operation result is transmitted
To primary processor, primary processor view data to be dealt with is reduced.
Step 204:Primary processor is according to above-mentioned view data and above-mentioned data processed result, output image.
Here, primary processor carries out calculating treatment according to preset algorithm to above-mentioned view data, obtains master processor processes
As a result, and by master processor processes result and above-mentioned data processed result carry out integration treatment, the image after output integration treatment.
If primary processor result is that the result after 3A calculating is carried out to view data, above-mentioned data processed result is to view data
The result after multiframe composite calulation treatment is carried out, now, the image after integration treatment refers to carry out 3A to calculate and multiframe synthesis
Image after calculating.Primary processor and coprocessor can be carried out at different algorithms to view data in the embodiment of the present invention
Reason, it is also possible to same algorithm process is carried out to view data, to lift processing speed and efficiency.As at the association that dsp system is constituted
Reason device does the treatment of multiple image composite calulation, and primary processor does the calculating such as 3A and realizes snapshots.What dsp system here was constituted
Coprocessor can be directed to the hardware and algorithm of image procossing application design specialized, reduce the calculating time, optimize system power consumption.
Further, since above-mentioned primary processor and coprocessor can separate the diverse location for being in the layout of Mobile terminal main board, profit
In the heat dissipation design of mobile terminal.
Specifically, above-mentioned data processed result includes:The coprocessor is according to the first preset algorithm and the second pre- imputation
Method, the first image information that the view data to presetting frame number is calculated, the view data of the default frame number takes
Memory space less than the camera module collection view data take memory space;
Now, above-mentioned steps 204 include:
Primary processor is according to the first preset algorithm and the second preset algorithm to removing the default frame number in described image data
Outside other view data carry out calculating treatment, obtain the second image information;
Integration treatment, the figure after output integration treatment are carried out to described first image information and second image information
Picture.
Wherein, above-mentioned first preset algorithm may particularly include multiframe synthesis, noise reduction process, the cutting of image, the scape of image
Depths reason etc..Above-mentioned second preset algorithm can be specially 3A calculating etc., i.e. automatic exposure AE, auto-focusing AF, AWB
The calculating of AWB.Image after integration treatment refers to carry out the figure after the treatment of the first preset algorithm and the treatment of the second preset algorithm
Picture.
Here, primary processor and coprocessor carry out identical algorithm process to view data, i.e., all carry out first and preset
Algorithm and the second preset algorithm, primary processor and coprocessor are processed the partial data in view data respectively, to carry
Rise processing speed and efficiency.
Specifically, above-mentioned data processed result includes:The coprocessor is according to the first preset algorithm to presetting frame number
View data carries out the preprocessing image data that calculating treatment is obtained, the memory space of the view data occupancy of the default frame number
Less than or equal to the memory space that the view data that the camera module is gathered takes;
Now, above-mentioned steps 204 include:
Primary processor according to the first preset algorithm and the second preset algorithm, to removing the default frame number in described image data
View data outside other view data carry out calculating treatment, obtain the 3rd image information, and default according to described second
Algorithm carries out calculating treatment to the preprocessing image data, obtains the 4th image information;
Integration treatment, the figure after output integration treatment are carried out to the 3rd image information and the 4th image information
Picture.
Here, the image after integration treatment refers to after carrying out the treatment of the first preset algorithm and the treatment of the second preset algorithm
Image.Primary processor and coprocessor carry out different algorithm process to view data, and coprocessor is only to the figure of default frame number
As data carry out the first algorithm process, and the second calculating treatment is carried out to the view data for presetting frame number by primary processor, to carry
Rise processing speed and efficiency.
Above-mentioned implementation process is illustrated with reference to concrete application scene.
Camera system is in preview mode first, and now, primary processor can select one or more image units to carry out
Preview, as shown in fig. 6, after the view data of image unit collection enters coprocessor, primary processor is sent to by coprocessor,
Meanwhile, coprocessor caches a frame or a few frame image datas in DDR submodules, treatment during for taking pictures.Work as camera system
Into after exposal model, as shown in fig. 7, coprocessor caching image data is to DDR, and to caching and new incoming data figure
As carrying out a frame or many frame arithmetics, after the completion of computing, notify that primary processor computing is completed by control interface.Coprocessor passes through
Image data interface (such as MIPI interfaces) transmission computing after data image is to primary processor and is saved in DDR.Primary processor
Data and meter after the view data after treatment coprocessor treatment, the parameter that calculates and master processor processes can be integrated
The parameter for calculating, and the data after treatment are stored and are shown to interface of mobile terminal.
In addition, during coprocessor computing, can be while Bypass and the new view data of preservation camera module collection.Main place
Reason device goes on row calculation process to the view data of coprocessor Bypass.Coprocessor and primary processor can be interacted parallel simultaneously
Processed.
Further, before above-mentioned steps 202, also include:
Primary processor to the coprocessor transmit image procossing application firmware, in order to coprocessor according to the image at
Predetermined process ought to be carried out to view data with fixation.The image procossing application can be specially the first preset algorithm firmware and/or
Second preset algorithm firmware.
Need first to carry out coprocessor initialization process in the embodiment of the present invention, primary processor starts coprocessor
Power supply;Primary processor provides system clock to coprocessor, herein it should be noted that also can be with external crystal-controlled oscillation as association
The clock of processor, now provides clock without primary processor;Primary processor resets to coprocessor;Coprocessor is from interior
The ROM in portion starts and waits primary processor to download firmware;Primary processor is by control interface loading firmware to coprocessor, firmware
It is stored in the DDR modules inside co-processor module.
In addition, in the embodiment of the present invention primary processor by change GPIO mouthfuls of state make coprocessor enter sleep state or
Sending order by SPI interface makes coprocessor enter sleep state.The power supply and clock of coprocessor after into sleep pattern
Can be always maintained at, can also close power supply and clock.
For closing the coprocessor standby mode of power supply and clock, it is necessary to when waking up, primary processor starts initialization association
The flow of processor can wake up coprocessor;
When standby mode for not closing power supply and clock needs to wake up, primary processor can be by changing GPIO mouthfuls of state
Or wake command wake-up coprocessor is sent by SPI interface.
The processing method of the view data of the embodiment of the present invention, primary processor takes in the view data that camera module is gathered
Memory space be more than predetermined threshold when, to coprocessor export the first control instruction so that coprocessor according to this first control
System instruction transmits view data and data processed result to primary processor, and the data processed result is coprocessor according to pre- imputation
Method is calculated to the view data that frame number is preset in view data, by primary processor according to described image data and institute
State data processed result, output image.In the embodiment of the present invention when the memory space that view data takes is larger, by main process task
Device and the common view data to camera module collection of coprocessor are processed, and accelerated image processing speed, are improved place
Manage efficiency, enhance effect of taking pictures.
Second embodiment
As shown in figure 8, embodiments of the invention additionally provide a kind of processing method of view data, it is applied to mobile whole
End, the mobile terminal include camera module, at least one coprocessor being connected with the camera module and with least one association at
The primary processor of connection is managed, the processing method includes:
Step 801:The memory space that the view data that primary processor gathers camera module takes is carried out with predetermined threshold
Compare.
The step is identical with above-mentioned steps 201, and here is omitted.
Step 802:When the memory space be less than or equal to the predetermined threshold when, primary processor to above-mentioned shooting
At least one coprocessor of module connection, exports the second control instruction.
By connecting the serial peripheral equipment interface SPI of the primary processor and the coprocessor, second control is exported
Instruction;Or
The state of the universal input/output GPIO interface by controlling to connect the primary processor and the coprocessor,
Export second control instruction.
The view data that camera module is gathered is transferred to main process task by control coprocessor during the second control instruction here
The instruction of device, because the memory space occupancy of now view data is smaller, then without coprocessor to view data at
Reason, coprocessor is only to play transmitting effect.The view data of camera module collection is by the bypass channel inside coprocessor
Bypass modules directly transmit view data to primary processor.Bypass modules at least support a view data for image unit
Bypass presets the view data of frame number without caching to primary processor.Coprocessor in Bypass patterns inside DSP
Low-power consumption mode is in DDR submodule units, system power consumption is reduced.
Step 803:Primary processor obtains the described image number that the coprocessor is transmitted according to second control instruction
According to, and calculating treatment, output image are carried out to described image data according to preset algorithm.
Now, primary processor is processed all of view data according to the first preset algorithm and the second preset algorithm,
And output image, coprocessor then be in low-power consumption mode, reduce system power consumption.
Need first to carry out coprocessor initialization process in the embodiment of the present invention, primary processor starts coprocessor
Power supply;Primary processor provides system clock to coprocessor, herein it should be noted that also can be with external crystal-controlled oscillation as association
The clock of processor, now provides clock without primary processor;Primary processor resets to coprocessor;Coprocessor is from interior
The ROM in portion starts and waits primary processor to download firmware;Primary processor is by control interface loading firmware to coprocessor, firmware
It is stored in the DDR modules inside co-processor module.Upon initialization, before above-mentioned steps 802, primary processor can be to described
Coprocessor transmits image procossing application firmware.
In addition, in the embodiment of the present invention primary processor by change GPIO mouthfuls of state make coprocessor enter sleep state or
Sending order by SPI interface makes coprocessor enter sleep state.The power supply and clock of coprocessor after into sleep pattern
Can be always maintained at, can also close power supply and clock.
For closing the coprocessor standby mode of power supply and clock, it is necessary to when waking up, primary processor starts initialization association
The flow of processor can wake up coprocessor;
When standby mode for not closing power supply and clock needs to wake up, primary processor can be by changing GPIO mouthfuls of state
Or wake command wake-up coprocessor is sent by SPI interface.
The processing method of the view data of the embodiment of the present invention, the view data that primary processor gathers camera module takes
Memory space be compared with predetermined threshold;When the memory space occupancy is less than or equal to the predetermined threshold,
Primary processor exports the second control instruction at least one coprocessor being connected with above-mentioned camera module;Primary processor is obtained
The described image data that the coprocessor is transmitted according to second control instruction, and according to preset algorithm to described image number
According to carrying out calculating treatment, output image.When the memory space occupancy of view data is smaller, possible coprocessor is by picture number
Processed according to primary processor is transmitted directly to, DSP the and DDR submodule units inside coprocessor is in low-power consumption mould
Formula, reduces system power consumption.
3rd embodiment
As shown in figure 9, embodiments of the invention additionally provide a kind of mobile terminal, including:
Camera module 901, the camera module is used to gather view data and is transferred to coprocessor;
At least one coprocessor 902 being connected with the camera module;
Primary processor 903, is connected with least one coprocessor, and the view data for camera module to be gathered is accounted for
Memory space is compared with predetermined threshold;When the memory space is more than the predetermined threshold, processed to the association
Device exports the first control instruction;Obtain the described image data sum that the coprocessor is transmitted according to first control instruction
According to result, the data processed result is for the coprocessor according to preset algorithm to presetting frame number in described image data
View data carry out calculating treatment and obtain;According to described image data and the data processed result, output image.
The mobile terminal of the embodiment of the present invention, the primary processor 903 is additionally operable to when the memory space is less than or waits
When the predetermined threshold, to the coprocessor, the second control instruction is exported;The coprocessor is obtained according to described second
The described image data of control instruction transmission, and calculating treatment, output image are carried out to described image data according to preset algorithm.
The mobile terminal of the embodiment of the present invention, the data processed result includes:The coprocessor is default according to first
Algorithm and the second preset algorithm, the first image information that the view data to presetting frame number is calculated, the default frame
The memory space that several view data takes is less than the memory space that the view data of camera module collection takes;
As shown in Figure 10, the primary processor 903 includes:
First computing module 9031, for according to first preset algorithm and second preset algorithm to described image
Other view data in data in addition to the default frame number carry out calculating treatment, obtain the second image information;
First integrates module 9032, for being carried out at integration to described first image information and second image information
Reason, the image after output integration treatment.
The mobile terminal of the embodiment of the present invention, the data processed result includes:The coprocessor is default according to first
Algorithm carries out the preprocessing image data that calculating treatment is obtained, the picture number of the default frame number to the view data for presetting frame number
According to the memory space for taking less than or equal to the memory space that the view data that the camera module is gathered takes;
The primary processor 903 includes:
Second computing module 9033, for according to the first preset algorithm and the second preset algorithm, in described image data
Other view data in addition to the view data of the default frame number carry out calculating treatment, obtain the 3rd image information, and root
Calculating treatment is carried out to the preprocessing image data according to second preset algorithm, the 4th image information is obtained;
Second integrates module 9034, for being carried out at integration to the 3rd image information and the 4th image information
Reason, the image after output integration treatment.
The mobile terminal of the embodiment of the present invention, the primary processor is used for by connecting at the primary processor and the association
The serial peripheral equipment interface SPI of device is managed, first control instruction is exported;Or
The state of the universal input/output GPIO interface by controlling to connect the primary processor and the coprocessor,
Export first control instruction.
The mobile terminal of the embodiment of the present invention, the memory space that primary processor takes in the view data that camera module is gathered
During more than predetermined threshold, the first control instruction is exported to coprocessor so that coprocessor is according to first control instruction to master
Processor transmit view data and data processed result, the data processed result be coprocessor according to preset algorithm to picture number
The view data of default frame number is calculated in, by primary processor according to described image data and the data processing
As a result, output image.In the embodiment of the present invention when the memory space that view data takes is larger, processed by primary processor and association
The common view data to camera module collection of device is processed, and is accelerated image processing speed, is improved treatment effeciency, enhancing
Effect of taking pictures.
Fourth embodiment
Figure 11 is the block diagram of the mobile terminal of another embodiment of the present invention.Mobile terminal 1 100 shown in Figure 11 includes:
At least one processor 1101, memory 1102, at least one network interface 1104 and user interface 1103.Mobile terminal 1 100
In each component be coupled by bus system 1105.It is understood that bus system 1105 be used for realize these components it
Between connection communication.Bus system 1105 in addition to including data/address bus, also including power bus, controlling bus and status signal
Bus.But for the sake of for clear explanation, various buses are all designated as bus system 1105 in fig. 11.Processor 1101 includes
Primary processor and coprocessor.Mobile terminal 1 100 also includes camera module.
Wherein, user interface 1103 can include display, keyboard or pointing device (for example, mouse, trace ball
(track ball), touch-sensitive plate or touch-screen etc..
It is appreciated that the memory 1102 in the embodiment of the present invention can be volatile memory or non-volatile memories
Device, or may include both volatibility and nonvolatile memory.Wherein, nonvolatile memory can be read-only storage
(Read-Only Memory, ROM), programmable read only memory (Programmable ROM, PROM), erasable programmable are only
Read memory (Erasable PROM, EPROM), Electrically Erasable Read Only Memory (Electrically EPROM,
) or flash memory EEPROM.Volatile memory can be random access memory (Random Access Memory, RAM), its use
Make External Cache.By exemplary but be not restricted explanation, the RAM of many forms can use, such as static random-access
Memory (Static RAM, SRAM), dynamic random access memory (Dynamic RAM, DRAM), synchronous dynamic random-access
Memory (Synchronous DRAM, SDRAM), double data speed synchronous dynamic RAM (Double Data
Rate SDRAM, DDRSDRAM), it is enhanced Synchronous Dynamic Random Access Memory (Enhanced SDRAM, ESDRAM), synchronous
Connection dynamic random access memory (Synchlink DRAM, SLDRAM) and direct rambus random access memory
(Direct Rambus RAM, DRRAM).The memory 1102 of system and method described herein be intended to including but not limited to this
The memory of a little and any other suitable type.
In some embodiments, memory 1102 stores following element, can perform module or data structure, or
Person their subset, or their superset:Operating system 11021 and application program 11022.
Wherein, operating system 11021, comprising various system programs, such as ccf layer, core library layer, driving layer etc. are used for
Realize various basic businesses and process hardware based task.Application program 11022, comprising various application programs, such as matchmaker
Body player (MediaPlayer), browser (Browser) etc., for realizing various applied business.Realize the embodiment of the present invention
The program of method may be embodied in application program 11022.
In embodiments of the present invention, by the program for calling memory 1102 to store or instruction, specifically, can be application
The program stored in program 11022 or instruction, the storage that view data takes that primary processor is used to gather camera module are empty
Between be compared with predetermined threshold;When the memory space be more than the predetermined threshold when, primary processor to the shooting mould
At least one coprocessor of group connection, exports the first control instruction;Primary processor obtains the coprocessor according to described the
One control instruction transmission described image data and data processed result, the data processed result be the coprocessor according to
Preset algorithm is calculated to the view data that frame number is preset in described image data;Primary processor is according to described image
Data and the data processed result, output image.
The method that the embodiments of the present invention are disclosed can apply in processor 1101, or real by processor 1101
It is existing.Processor 1101 is probably a kind of IC chip, the disposal ability with signal.In implementation process, the above method
Each step can be completed by the instruction of the integrated logic circuit of the hardware in processor 1101 or software form.Above-mentioned
Processor 1101 can be general processor, digital signal processor (Digital Signal Processor, DSP), special
Integrated circuit (Application Specific Integrated Circuit, ASIC), ready-made programmable gate array (Field
Programmable Gate Array, FPGA) or other PLDs, discrete gate or transistor logic,
Discrete hardware components.Can realize or perform disclosed each method in the embodiment of the present invention, step and logic diagram.It is general
Processor can be microprocessor or the processor can also be any conventional processor etc..With reference to embodiment of the present invention institute
The step of disclosed method, can be embodied directly in hardware decoding processor and perform completion, or with the hardware in decoding processor
And software module combination performs completion.Software module may be located at random access memory, and flash memory, read-only storage may be programmed read-only
In the ripe storage medium in this area such as memory or electrically erasable programmable memory, register.The storage medium is located at
Memory 1102, processor 1101 reads the information in memory 1102, with reference to the step of its hardware completion above method.
It is understood that embodiments described herein can with hardware, software, firmware, middleware, microcode or its
Combine to realize.Realized for hardware, processing unit can be realized in one or more application specific integrated circuits (Application
Specific Integrated Circuits, ASIC), digital signal processor (Digital Signal Processing,
DSP), digital signal processing appts (DSP Device, DSPD), programmable logic device (Programmable Logic
Device, PLD), field programmable gate array (Field-Programmable Gate Array, FPGA), general processor,
In controller, microcontroller, microprocessor, other electronic units for performing the application function or its combination.
Realized for software, can be by the skill that performs the module (such as process, function etc.) of this paper functions to realize this paper
Art.Software code is storable in memory and by computing device.Memory can be within a processor or outside processor
Realize in portion.
Alternatively, primary processor is additionally operable to:When the memory space is less than or equal to the predetermined threshold, Xiang Yusuo
At least one coprocessor of camera module connection is stated, the second control instruction is exported;The coprocessor is obtained according to described
The described image data of two control instructions transmission, and calculating treatment, output figure are carried out to described image data according to preset algorithm
Picture.
Alternatively, the data processed result includes:The coprocessor is according to the first preset algorithm and the second pre- imputation
Method, the first image information that the view data to presetting frame number is calculated, the view data of the default frame number takes
Memory space less than the camera module collection view data take memory space;
Primary processor specifically for:According to first preset algorithm and second preset algorithm to described image data
In other view data in addition to the default frame number carry out calculating treatment, obtain the second image information;To first figure
As information and second image information carry out integration treatment, the image after output integration treatment.
Alternatively, the data processed result includes:The data processed result includes:The coprocessor is according to first
Preset algorithm carries out the preprocessing image data that calculating treatment is obtained, the figure of the default frame number to the view data for presetting frame number
As memory space of the memory space less than or equal to the view data occupancy of camera module collection that data take;
Primary processor specifically for:According to the first preset algorithm and the second preset algorithm, to removing institute in described image data
Stating other view data outside the view data of default frame number carries out calculating treatment, obtains the 3rd image information, and according to institute
State the second preset algorithm carries out calculating treatment to the preprocessing image data, obtains the 4th image information;To the 3rd figure
As information and the 4th image information carry out integration treatment, the image after output integration treatment.
Alternatively, primary processor is additionally operable to the Serial Peripheral Interface (SPI) by connecting the primary processor and the coprocessor
SPI, exports first control instruction;Or
The state of the universal input/output GPIO interface by controlling to connect the primary processor and the coprocessor,
Export first control instruction.
Mobile terminal 1 100 can realize each process of mobile terminal realization in previous embodiment, to avoid repeating, this
In repeat no more.
The mobile terminal 1 100 of the embodiment of the present invention, the storage that primary processor takes in the view data that camera module is gathered
When space is more than predetermined threshold, the first control instruction is exported to coprocessor so that coprocessor is according to first control instruction
View data and data processed result are transmitted to primary processor, the data processed result is coprocessor according to preset algorithm to figure
As the view data that frame number is preset in data is calculated, by primary processor according to described image data and the data
Result, output image.In the embodiment of the present invention when the memory space that view data takes is larger, by primary processor and association
The common view data to camera module collection of processor is processed, accelerate image processing speed, improve treatment effeciency,
Enhance effect of taking pictures.
Fourth embodiment
Figure 12 is the structural representation of the mobile terminal of another embodiment of the present invention.Specifically, the mobile end in Figure 12
End 1200 can be mobile phone, panel computer, personal digital assistant (Personal Digital Assistant, PDA) or vehicle-mounted
Computer etc..
Mobile terminal 1 200 in Figure 12 include radio frequency (Radio Frequency, RF) circuit 1210, memory 1220,
Input block 1230, display unit 1240, processor 1260, voicefrequency circuit 1270, WiFi (Wireless Fidelity) module
1280 and power supply 1290.Processor 1260 includes primary processor and coprocessor.Mobile terminal 1 200 also includes camera module.
Wherein, input block 1230 can be used to receive the numeral or character information of user input, and produce with movement eventually
The user at end 1200 is set and the relevant signal input of function control.Specifically, in the embodiment of the present invention, the input block
1230 can include contact panel 1231.Contact panel 1231, also referred to as touch-screen, can collect user thereon or neighbouring touch
Operation (such as user uses the operations of any suitable object or annex on contact panel 1231 such as finger, stylus) is touched, and
Corresponding attachment means are driven according to formula set in advance.Optionally, contact panel 1231 may include touch detecting apparatus and
Two parts of touch controller.Wherein, touch detecting apparatus detect the touch orientation of user, and detect the letter that touch operation brings
Number, transmit a signal to touch controller;Touch controller receives touch information from touch detecting apparatus, and is converted into
Contact coordinate, then give the processor 1260, and the order sent of receiving processor 1260 and can be performed.Furthermore, it is possible to
Contact panel 1231 is realized using polytypes such as resistance-type, condenser type, infrared ray and surface acoustic waves.Except contact panel
1231, input block 1230 can also include other input equipments 1232, and other input equipments 1232 can be included but is not limited to
One kind or many in physical keyboard, function key (such as volume control button, switch key etc.), trace ball, mouse, action bars etc.
Kind.
Wherein, display unit 1240 can be used for display by the information of user input or be supplied to information and the movement of user
The various menu interfaces of terminal 1200.Display unit 1240 may include display panel 1241, optionally, using LCD or can have
The forms such as machine light emitting diode (Organic Light-Emitting Diode, OLED) configure display panel 1241.
It should be noted that contact panel 1231 can cover display panel 1241, touch display screen is formed, when the touch display screen
Detect thereon or after neighbouring touch operation, processor 1260 is sent to determine the type of touch event, with post processing
Device 1260 provides corresponding visual output according to the type of touch event in touch display screen.
Touch display screen includes Application Program Interface viewing area and conventional control viewing area.The Application Program Interface viewing area
And the arrangement mode of the conventional control viewing area is not limited, can be arranged above and below, left-right situs etc. can distinguish two and show
Show the arrangement mode in area.The Application Program Interface viewing area is displayed for the interface of application program.Each interface can be with
The interface element such as the icon comprising at least one application program and/or widget desktop controls.The Application Program Interface viewing area
It can also be the empty interface not comprising any content.The conventional control viewing area be used for show utilization rate control higher, for example,
Application icons such as settings button, interface numbering, scroll bar, phone directory icon etc..
Wherein processor 1260 is the control centre of mobile terminal 1 200, using various interfaces and connection whole mobile phone
Various pieces, by running or performing software program of the storage in first memory 1221 and/or module, and call and deposit
The data in second memory 1222 are stored up, the various functions and processing data of mobile terminal 1 200 are performed, so as to mobile whole
End 1200 carries out integral monitoring.Optionally, processor 1260 may include one or more processing units.
In embodiments of the present invention, by call store the first memory 1221 in software program and/or module and/
Or the data in the second memory 1222, the memory space of view data occupancy of the primary processor for camera module to be gathered
It is compared with predetermined threshold;When the memory space be more than the predetermined threshold when, primary processor to the camera module
At least one coprocessor of connection, exports the first control instruction;Primary processor obtains the coprocessor according to described first
The described image data and data processed result of control instruction transmission, the data processed result are the coprocessor according to pre-
Imputation method is calculated to the view data that frame number is preset in described image data;Primary processor is according to described image number
According to the data processed result, output image.
Alternatively, primary processor is additionally operable to:When the memory space is less than or equal to the predetermined threshold, Xiang Yusuo
At least one coprocessor of camera module connection is stated, the second control instruction is exported;The coprocessor is obtained according to described
The described image data of two control instructions transmission, and calculating treatment, output figure are carried out to described image data according to preset algorithm
Picture.
Alternatively, the data processed result includes:The coprocessor is according to the first preset algorithm and the second pre- imputation
Method, the first image information that the view data to presetting frame number is calculated, the view data of the default frame number takes
Memory space less than the camera module collection view data take memory space;
Primary processor specifically for:According to first preset algorithm and second preset algorithm to described image data
In other view data in addition to the default frame number carry out calculating treatment, obtain the second image information;To first figure
As information and second image information carry out integration treatment, the image after output integration treatment.
Alternatively, the data processed result includes:The data processed result includes:The coprocessor is according to first
Preset algorithm carries out the preprocessing image data that calculating treatment is obtained, the figure of the default frame number to the view data for presetting frame number
As memory space of the memory space less than or equal to the view data occupancy of camera module collection that data take;
Primary processor specifically for:According to the first preset algorithm and the second preset algorithm, to removing institute in described image data
Stating other view data outside the view data of default frame number carries out calculating treatment, obtains the 3rd image information, and according to institute
State the second preset algorithm carries out calculating treatment to the preprocessing image data, obtains the 4th image information;To the 3rd figure
As information and the 4th image information carry out integration treatment, the image after output integration treatment.
Alternatively, primary processor is defeated by connecting the serial peripheral equipment interface SPI of the primary processor and the coprocessor
Go out first control instruction;Or
The state of the universal input/output GPIO interface by controlling to connect the primary processor and the coprocessor,
Export first control instruction.
It can be seen that, the mobile terminal 1 200 of the embodiment of the present invention, primary processor takes in the view data that camera module is gathered
Memory space be more than predetermined threshold when, to coprocessor export the first control instruction so that coprocessor according to this first control
System instruction transmits view data and data processed result to primary processor, and the data processed result is coprocessor according to pre- imputation
Method is calculated to the view data that frame number is preset in view data, by primary processor according to described image data and institute
State data processed result, output image.In the embodiment of the present invention when the memory space that view data takes is larger, by main process task
Device and the common view data to camera module collection of coprocessor are processed, and accelerated image processing speed, are improved place
Manage efficiency, enhance effect of taking pictures.
Those of ordinary skill in the art are it is to be appreciated that the list of each example described with reference to the embodiments described herein
Unit and algorithm steps, can be realized with the combination of electronic hardware or computer software and electronic hardware.These functions are actually
Performed with hardware or software mode, depending on the application-specific and design constraint of technical scheme.Professional and technical personnel
Described function, but this realization can be realized it is not considered that exceeding using distinct methods to each specific application
The scope of the present invention.
It is apparent to those skilled in the art that, for convenience and simplicity of description, the system of foregoing description,
The specific work process of device and unit, may be referred to the corresponding process in preceding method embodiment, will not be repeated here.
In embodiment provided herein, it should be understood that disclosed apparatus and method, can be by other
Mode is realized.For example, device embodiment described above is only schematical, for example, the division of the unit, is only
A kind of division of logic function, can there is other dividing mode when actually realizing, such as multiple units or component can combine or
Person is desirably integrated into another system, or some features can be ignored, or does not perform.Another, shown or discussed is mutual
Between coupling or direct-coupling or communication connection can be the INDIRECT COUPLING or communication link of device or unit by some interfaces
Connect, can be electrical, mechanical or other forms.
The unit that is illustrated as separating component can be or may not be it is physically separate, it is aobvious as unit
The part for showing can be or may not be physical location, you can with positioned at a place, or can also be distributed to multiple
On NE.Some or all of unit therein can be according to the actual needs selected to realize the mesh of this embodiment scheme
's.
In addition, during each functional unit in each embodiment of the invention can be integrated in a processing unit, it is also possible to
It is that unit is individually physically present, it is also possible to which two or more units are integrated in a unit.
If the function is to realize in the form of SFU software functional unit and as independent production marketing or when using, can be with
Storage is in a computer read/write memory medium.Based on such understanding, technical scheme is substantially in other words
The part contributed to prior art or the part of the technical scheme can be embodied in the form of software product, the meter
Calculation machine software product is stored in a storage medium, including some instructions are used to so that a computer equipment (can be individual
People's computer, server, or network equipment etc.) perform all or part of step of each embodiment methods described of the invention.
And foregoing storage medium includes:USB flash disk, mobile hard disk, ROM, RAM, magnetic disc or CD etc. are various can be with store program codes
Medium.
The above, specific embodiment only of the invention, but protection scope of the present invention is not limited thereto, and it is any
Those familiar with the art the invention discloses technical scope in, change or replacement can be readily occurred in, should all contain
Cover within protection scope of the present invention.Therefore, protection scope of the present invention should be defined by scope of the claims.