CN108090126A - Image processing method, device and mobile terminal, image-recognizing method and server - Google Patents
Image processing method, device and mobile terminal, image-recognizing method and server Download PDFInfo
- Publication number
- CN108090126A CN108090126A CN201711125033.9A CN201711125033A CN108090126A CN 108090126 A CN108090126 A CN 108090126A CN 201711125033 A CN201711125033 A CN 201711125033A CN 108090126 A CN108090126 A CN 108090126A
- Authority
- CN
- China
- Prior art keywords
- preview image
- category information
- category
- information
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F16/5866—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using information manually generated, e.g. tags, keywords, comments, manually generated location and time information
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/951—Indexing; Web crawling techniques
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/10—Terrestrial scenes
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- General Engineering & Computer Science (AREA)
- Library & Information Science (AREA)
- Multimedia (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The embodiment of the invention discloses a kind of image processing method, device and mobile terminal, a kind of image-recognizing method and servers.Described image processing method includes：Shooting preview instruction is received, gathers initial preview image；Identifying has the identification object of biological characteristic in the initial preview image；It sends the identification object to category and identifies server；Receive the category information of the category identification server feedback；The category information is added to the initial preview image, obtains targets preview image.According to embodiments of the present invention, the efficiency that user obtains information is improved.
Description
Technical field
The present embodiments relate to the communications field more particularly to a kind of image processing method and image processing apparatus and,
A kind of image-recognizing method and server and, a kind of mobile terminal.
Background technology
At present, more and more users obtain information by knowledge figure website.For example, user sees certain trees, think
Information, the user such as solving the title of the trees, illustrate can first take pictures to trees with mobile phone, then log in some knowledge figure website,
And by the photo upload of trees to some knowledge figure website, knowledge figure website is identified for photo, and recognition result is returned to use
Family.
However, during using figure website acquisition information is known, user is taken pictures, logs in website, uploads and shine
Multiple operations such as piece expend operation and the time of user, affect the efficiency that user obtains information.Therefore, existing knowledge figure side
There is obtain the problem of information efficiency is relatively low for method.
The content of the invention
The present invention provides a kind of image processing method and image processing apparatus and, a kind of image-recognizing method and clothes
Be engaged in device and, a kind of mobile terminal, with solve the problems, such as it is existing knowledge drawing method there is obtain information efficiency it is relatively low.
In order to solve the above-mentioned technical problem, the present invention is realized in：A kind of image processing method, applied to mobile whole
End, the described method includes：
Shooting preview instruction is received, gathers initial preview image；
Identifying has the identification object of biological characteristic in the initial preview image；
It sends the identification object to category and identifies server；
Receive the category information of the category identification server feedback；
The category information is added to the initial preview image, obtains targets preview image.
In a first aspect, the embodiment of the present invention additionally provides a kind of image-recognizing method, identify and service applied to category
Device, the described method includes：
Receive the identification object of mobile terminal；
Identify the target organism classification belonging to the identification object；
Extraction target organism classification information corresponding with the target organism classification；
The target organism classification information is sent to the mobile terminal.
Second aspect, the embodiment of the present invention additionally provide a kind of image processing apparatus, including：
Initial preview image capture module for receiving shooting preview instruction, gathers initial preview image；
Object Identification Module is identified, for identifying the identification object in the initial preview image with biological characteristic；
It identifies object sending module, server is identified for sending the identification object to category；
Category information receiving module, for receiving the category letter of the category identification server feedback
Breath；
Category information add module for the category information to be added to the initial preview image, obtains
To targets preview image.
The third aspect, the embodiment of the present invention additionally provide a kind of server, including：
Object receiving module is identified, for receiving the identification object of mobile terminal；
Category identification module, for identifying the target organism classification belonging to the identification object；
Category information extraction modules, for extracting target organism classification letter corresponding with the target organism classification
Breath；
Category information sending module, for the target organism classification information to be sent to the mobile terminal.
Fourth aspect, the embodiment of the present invention additionally provide a kind of mobile terminal, including processor, memory and are stored in institute
The computer program that can be run on memory and on the processor is stated, when the computer program is performed by the processor
It realizes such as the step of described image processing method.
According to embodiments of the present invention, by gathering initial preview image when receiving shooting preview and instructing, and identify just
Identification object is sent to category identification server, for life by the identification object with biological characteristic in beginning preview image
Species do not identify that server returns to category information for identification object, after category information is received, are added
To initial preview image, targets preview image is obtained.So as to save user and be taken pictures, log in knowledge figure website, upload pictures
Deng multiple operations and time for being operated, improve the efficiency that user obtains information.
Description of the drawings
Fig. 1 is a kind of flow chart for image processing method that the embodiment of the present invention one provides；
Fig. 2 is a kind of flow chart of image processing method provided by Embodiment 2 of the present invention；
Fig. 3 is a kind of schematic diagram of addition category information of the embodiment of the present invention；
Fig. 4 is a kind of schematic diagram of result of page searching displaying of the embodiment of the present invention；
Fig. 5 is a kind of schematic diagram of targets preview image of the embodiment of the present invention；
Fig. 6 is a kind of image-recognizing method that the embodiment of the present invention three provides；
Fig. 7 is a kind of structure diagram for image processing apparatus that the embodiment of the present invention four provides；
Fig. 8 is a kind of structure diagram for image processing apparatus that the embodiment of the present invention five provides；
Fig. 9 is a kind of structure diagram for server that the embodiment of the present invention six provides；
A kind of hardware architecture diagram of Figure 10 mobile terminals of each embodiment to realize the present invention.
Specific embodiment
The exemplary embodiment of the disclosure is more fully described below with reference to accompanying drawings.Although the disclosure is shown in attached drawing
Exemplary embodiment, it being understood, however, that may be realized in various forms the disclosure without should be by embodiments set forth here
It is limited.On the contrary, these embodiments are provided to facilitate a more thoroughly understanding of the present invention, and can be by the scope of the present disclosure
Completely it is communicated to those skilled in the art.
Embodiment one
Fig. 1 is a kind of flow chart for image processing method that the embodiment of the present invention one provides, and this method is applied to mobile whole
End, this method specifically may include steps of：
Step 110, shooting preview instruction is received, gathers initial preview image.
It should be noted that above-mentioned mobile terminal can include the terminals such as mobile phone, tablet computer.It is set on mobile terminal
There is camera, can be used for gathering preview image, and preview image is illustrated in shooting preview interface, browsed for user.
In the specific implementation, user is when seeing certain flowers and plants, certain trees, certain animal, in order to know the flowers and plants, tree
The information such as wood, the title of insect, classification, characteristic introduction, user can submit a shooting preview instruction on mobile terminals, with
Start shooting preview interface.When receiving shooting preview instruction, mobile terminal can call camera collection image, as upper
The initial preview image stated.
Step 120, identifying has the identification object of biological characteristic in the initial preview image.
After initial preview image is collected, mobile terminal can identify the living things feature recognition pair in initial preview image
As.Wherein, living things feature recognition object can be the various objects with biological characteristic, for example, animal, plant etc..
Step 130, send the identification object to category and identify server.
Mobile terminal can know the biological characteristic after the living things feature recognition object in identifying initial preview image
Other object is sent to category identification server.In practical applications, it can intercept from initial preview image and include life
By the preview subgraph, some is uploaded on mobile terminal backstage by browser for the preview subgraph of object feature recognition object
Know figure website.
In practical applications, insighted figure application may be installed in mobile terminal, it therefore, can after preview subgraph is obtained
Preview subgraph is uploaded in the knowledge figure application of mobile terminal Background scheduling, to pass through knowledge figure application.Those skilled in the art can
According to actual needs, living things feature recognition object is sent to category identification server, the present invention using various ways
Embodiment is not restricted this.
Wherein, the category identification server includes multiple categories and corresponding multiple biological species
Other information, category identification server be used to identify target organism classification belonging to the living things feature recognition object,
And the corresponding category information of the target organism classification is sent to the mobile terminal.
More specifically, above-mentioned category identification server can according to the biological characteristic of living things feature recognition object,
The category belonging to it is identified, as above-mentioned target organism classification.For example, the websites such as figure, flowers and plants are known by Baidu.Category
Identification server can prestore multiple categories and, prestore multiple category information.Multiple categories and more
There is correspondence, category identification server is identifying the mesh of living things feature recognition object between a category information
After marking category, the corresponding category information of the target organism classification can be inquired about, and the category inquired is believed
Breath, is back to mobile terminal.
Step 140, the category information of the category identification server feedback is received.
In the specific implementation, mobile terminal can receive the category information that category identification server returns, with
Just by the category information, added in initial preview image.
Wherein, which can be special for the trivial name of certain classification biology, scientific name, species, kind, form
The information such as sign, build environment, geographical distribution, associated history and culture, biological value.In practical applications, category is known
Other server may return to an initial category information, may include substantial amounts of text in initial category information
Word, pictorial information, mobile terminal can screen initial category information, obtain key message and believe as category
Breath.Those skilled in the art can set the particular content of category information according to actual needs, and the embodiment of the present invention is to this
It is not limited.
Step 150, the category information is added to the initial preview image, obtains targets preview image.
In the specific implementation, after category information is got, which can be added to initial preview
In image, a targets preview image is obtained.Add category information mode can there are many, for example, can be by biology
Classification information is added to living things feature recognition object surrounding or is covered on living things feature recognition object.
After obtaining targets preview image, it can be shown in the shooting preview interface of mobile terminal, user can obtain in real time
Get the category information of living things feature recognition object.
In practical application, user can also be directed to the targets preview image added with category information and be shot, and obtain
To the photo for including living things feature recognition object and corresponding category information.
According to embodiments of the present invention, by gathering initial preview image when receiving shooting preview and instructing, and identify just
In beginning preview image there is the identification object of biological characteristic, identification object is sent to category identification server, for biology
Classification identification server returns to category information for identification object, after category information is received, adds it to
Initial preview image obtains targets preview image.So as to save user and be taken pictures, log in knowledge figure website, upload pictures etc.
Multiple operations and time for being operated, improve the efficiency that user obtains information.
Embodiment two
Fig. 2 is a kind of flow chart of image processing method provided by Embodiment 2 of the present invention, and this method is applied to mobile whole
End, this method specifically may include steps of：
Step 210, shooting preview instruction is received, gathers initial preview image.
Step 220, identifying has the identification object of biological characteristic in the initial preview image.
In practical applications, it can identify the biological characteristic in initial preview image, identification pair is determined according to biological characteristic
As.A variety of specific recognition methods may be employed in those skilled in the art, and the embodiment of the present invention is without limitation.
Step 230, send the living things feature recognition object to category and identify server.
Optionally, the step 230, including：
Step 231, preview subgraph is extracted from the initial preview image；The preview sub-picture pack contains the tool
There is the identification object of biological characteristic.
In the specific implementation, identification object residing region in the picture can be identified, by the area in initial preview image
The parts of images in domain intercepts out, as preview subgraph, then includes the identification pair with biological characteristic in the preview subgraph
As.
Step 232, Object identifying request is generated.
In the specific implementation, mobile terminal can be answered in Background scheduling browser or knowledge figure application by browser or knowledge figure
With generation includes the Object identifying request of preview subgraph.
Step 233, the Object identifying is sent to ask to identify server to the category.
In the specific implementation, mobile terminal can be applied by browser or knowledge figure is sent to biological species by Object identifying request
It does not identify server, for the identification object in category identification server identification preview subgraph, and feeds back category letter
Breath.
Step 240, the category information of the category identification server feedback is received.
Step 250, the category information is added to the initial preview image, obtains targets preview image.
For example, adding the word instruction frame of a suspension on initial preview image, life is write in word instruction frame
Object classification information.
Optionally, the initial preview image includes multiple images position, association being respectively provided between multiple images position
Relation, the step 250 can include：
Step 251, first image of the identification object with biological characteristic in the initial preview image is determined
Position.
In the specific implementation, multiple images position can be included in initial preview image, can set between picture position
Incidence relation.For example, it is associated for it in upper left picture position, can be set having with the picture position in upper right side
System.After category information is received, the picture position that identification object is presently in initial preview image can be identified,
As the first picture position.
Step 252, the category information is added to and associated second picture position in described first image position
On.
In the specific implementation, can determine with the associated another picture position in the first picture position, as the second picture position.
Then, category information is added in second picture position.
Step 253, by the initial preview image added with the category information, as the targets preview image.
In the specific implementation, after category information is added to the second picture position of initial preview image, it can be with
By the initial preview image added with category information, as above-mentioned targets preview image.
Fig. 3 is a kind of schematic diagram of addition category information of the embodiment of the present invention.It can be seen that in shooting preview
On interface, displaying has initial preview image, and initial preview image includes two basin plants, is respectively at the left and right sides of image, will
The picture position that two basin plants of the left and right sides are presently in initial preview image is as the first picture position A1 and first
Picture position B1, in second picture position A2 associated with the first picture position A1 and the first picture position B1 associated second
On the B2 of picture position, corresponding category information is added respectively, has obtained targets preview image.
Optionally, the method can further include：
Receive the position moving operation instruction of user；
In the initial preview image, the category information is moved to the 3rd figure from second picture position
Image position.
In practical applications, after category information being added to the second picture position, category information may
Other objects in preview image are sheltered from, user may need to adjust the position of category information in the picture, Yong Huke
To submit position moving operation instruction.Wherein, moving operation instruction in position can be user to some in shooting preview interface
The clicking operation of position or in shooting preview interface, the click that category information is dragged to some position are grasped
Make.Position user can be clicked on or drag target, as the 3rd picture position, by category information from current
The second picture position, be moved to the 3rd picture position.
Optionally, the category information is added to and associated second image in described first image position described
After step on position, the method can further include：
The information editing received for the category information asks；Described information edit requests include self-defined biology
Classification information；
On the second picture position of the initial preview image, the category information is replaced with described self-defined
Category information.
In the specific implementation, user can be directed to category information into edlin.User can submit on mobile terminals
Information editing asks.For example, the category information of long-press initial preview image asks to submit to trigger information editing, alternatively,
Click on default information editing's entrance in shooting preview interface.User can input self-defined category information, this is made by oneself
Adopted category information replaces some or all of original category information.So as to obtain including self-defined life
The preview image of object classification information.
In practical application, user can input self-defined category information by voice mode, improve user's input
The convenience of information.
Optionally, after the step 250, the method further includes：
When detecting the mobile terminal shake, the initial preview image of next frame is gathered, and the category is believed
Breath obtains the targets preview image of next frame added to the initial preview image of next frame.
In practical applications, when gathering initial preview image, mobile terminal may be shaken, and cause biological characteristic
It identifies that position of the object in initial preview image changes, therefore, the dither state of mobile terminal can be detected, work as detection
It is shaken to mobile terminal, then gathers next frame initial preview image, it is initial in next frame to redefine living things feature recognition object
The first picture position in preview image, and update and new associated second picture position in the first picture position, by biological species
Other information is added in updated second picture position.Even if mobile terminal shake as a result, causes living things feature recognition object
Position in initial preview image changes, and position of the category information in preview image can also correspondingly more
Newly, the position of category information is avoided to deviate the position of living things feature recognition object.
Step 260, page search entrance is added on the targets preview image.
In the specific implementation, a page search entrance can be added on targets preview image, which can be used for adjusting
With browser, page searching request is initiated.Page search entrance can be arranged in category information, can also be arranged on
On living things feature recognition object, the embodiment of the present invention is not restricted the specific location of page search entrance.
Step 270, when receiving the page search operation for page search entrance, sent to page search server
Page searching request；The page searching request includes the category information.
In the specific implementation, user can be clicked on, be double-clicked the page of category information or living things feature recognition object
Search operation, after the page search operation is detected, mobile terminal can call browser to be sent to page search server
Page searching request in the page searching request, can include category information, for example, using botanical name as page
The keyword of faceted search.
Step 280, the result of page searching that the page search server is directed to category information feedback is received.
In the specific implementation, page search server is after page searching request is received, it can be according to category information
Page search is carried out, has obtained multiple pages for including category information, as result of page searching, and by search result
The page is back to mobile terminal.
Step 290, the browser of the mobile terminal is called, loads described search results page.
In the specific implementation, mobile terminal after result of page searching is received, can call browser to load the search knot
The fruit page, and switch to foreground and shown to user.Result of page searching can include on the detailed of living things feature recognition object
Information to the greatest extent, so as to so that user can get the information for more meeting its demand.
Fig. 4 is a kind of schematic diagram of result of page searching displaying of the embodiment of the present invention.It can be seen that when user asks
After searched page, browser can be switched in shooting preview interface, result of page searching, search result are loaded in browser
Include on living things feature recognition object, more detailed information in the page.
In practical applications, the targets preview image can be stored.More specifically, user can be directed to targets preview figure
As submitting shooting instruction, mobile terminal can store targets preview image when receiving shooting instruction, the photograph obtained as shooting
Piece.
Fig. 5 is a kind of schematic diagram of targets preview image of the embodiment of the present invention.It can be seen that targets preview image bag
Classification information containing plant He the plant.
According to embodiments of the present invention, by the way that category information is added to initial preview image, targets preview figure is obtained
Picture, and store the targets preview image, due to including category information in targets preview image, when user again in the future
During browsing objective preview image, you can category information is got, without image is uploaded to knowledge figure website again to obtain
Category information saves operation and the time of user, further improves the efficiency that user obtains information.Moreover, user
It can be directly by the targets preview images share to other users so that user can easily share category information, nothing
Must user first send image, category information is retransmited, so as to improve the efficiency of interactive information between user.
Embodiment three
Fig. 6 is a kind of image-recognizing method that the embodiment of the present invention three provides, and this method is applied to category identification clothes
Business device, the category identification server include multiple categories and category information corresponding with its, should
Method specifically may include steps of：
Step 310, the identification object of mobile terminal is received.
In the specific implementation, category identification server can receive the Object identifying request of mobile terminal submission, object
It identifies preview subgraph there are one being included in request, can include the identification object with biological characteristic in preview subgraph.
Category identification server can extract the preview subgraph, for identification of the preview subgraph identification with biological characteristic
Object.
Step 320, the target organism classification belonging to the identification object is identified.
Category identification server according to the biological characteristic in preview subgraph, can identify the biology of identification object
Classification, as above-mentioned target organism classification.
Step 330, target organism classification information corresponding with the target organism classification is extracted.
Category identification server can extract category information corresponding with the target organism classification, as above-mentioned
Target organism classification information.
Step 340, the target organism classification information is sent to the mobile terminal.
The target organism classification information that category identification server can will extract, returns to mobile terminal, for moving
The target organism classification information is added to initial preview image by dynamic terminal, obtains targets preview image.
Example IV
Fig. 7 be the embodiment of the present invention four provide a kind of image processing apparatus structure diagram, described image processing unit
400 can specifically include following module：
Initial preview image capture module 410 for receiving shooting preview instruction, gathers initial preview image；
Object Identification Module 420 is identified, for identifying the identification object in the initial preview image with biological characteristic；
It identifies object sending module 430, server is identified for sending the identification object to category；
Category information receiving module 440, for receiving the category of the category identification server feedback
Information；
Category information add module 450, for the category information to be added to the initial preview image,
Obtain targets preview image.
Embodiment five
Fig. 8 be the embodiment of the present invention five provide a kind of image processing apparatus structure diagram, described image processing unit
500 can specifically include following module：
Initial preview image capture module 510 for receiving shooting preview instruction, gathers initial preview image；
Object Identification Module 520 is identified, for identifying the identification object in the initial preview image with biological characteristic；
It identifies object sending module 530, server is identified for sending the living things feature recognition object to category；
Category information receiving module 540, for receiving the category of the category identification server feedback
Information；
Category information add module 550, for the category information to be added to the initial preview image,
Obtain targets preview image.
Page search entrance add module 560, for adding page search entrance on the targets preview image；
Searching request sending module 570, for being directed to the page search operation of page search entrance when reception, to page
Faceted search server sends page searching request；The page searching request includes the category information；
Result of page searching receiving module 580 is believed for receiving the page search server for the category
Cease the result of page searching of feedback；
Result of page searching load-on module 590 for calling the browser of the mobile terminal, loads described search result
The page.
Optionally, the identification object sending module 530, can include：
Preview subgraph extracting sub-module, for extracting preview subgraph from the initial preview image；The preview
Sub-picture pack contains the identification object with biological characteristic；
Submodule is requested to generate, for generating Object identifying request；
Request-to-send submodule asks to identify server to the category for sending the Object identifying.
Optionally, the initial preview image includes multiple images position, association being respectively provided between multiple images position
Relation, the category information add module 550, can include：
First picture position determination sub-module, for determining the identification object with biological characteristic described initial pre-
Look at the first picture position in image；
Information adds submodule, for the category information to be added to and described first image position associated the
On two picture positions；
Targets preview image generates submodule, for that will be added with the initial preview image of the category information, makees
For the targets preview image.
Optionally, the category information add module 550 can further include：
Receiving submodule is operated, for receiving the position moving operation instruction of user；
Information mobile submodule, in the initial preview image, by the category information from described second
Picture position is moved to the 3rd picture position.
Optionally, described image processing unit 500 can further include：
Next frame image capture module, for when detecting the mobile terminal shake, gathering the initial preview of next frame
Image, and the category information is obtained into the targets preview image of next frame added to the initial preview image of next frame.
Optionally, the category information add module 550 can further include：
Information editing's request receiving submodule, the information editing for receiving for the category information ask；Institute
Stating information editing's request includes self-defined category information；
Information replaces submodule, in the second picture position of the initial preview image, by the category
Information replaces with the self-defined category information.
Embodiment six
Fig. 9 is a kind of structure diagram for server that the embodiment of the present invention six provides, and the server 600 includes multiple lifes
Species are not and category information corresponding with its, the server 600 can specifically include following module：
Object receiving module 610 is identified, for receiving the identification object of mobile terminal；
Category identification module 620, for identifying the target organism classification belonging to the identification object；
Category information extraction modules 630, for extracting target organism classification corresponding with the target organism classification
Information；
Category information sending module 640, for the target organism classification information to be sent to the mobile terminal.
The image processing apparatus and service that the embodiment of the present invention four, the embodiment of the present invention five and the embodiment of the present invention six provide
Device can realize each process that image processing apparatus and server are realized in the embodiment of the method for Fig. 1 to Fig. 2 and Fig. 6, be
It avoids repeating, which is not described herein again.
A kind of hardware architecture diagram of Figure 10 mobile terminals of each embodiment to realize the present invention, the mobile terminal
700 include but not limited to：Radio frequency unit 701, network module 702, audio output unit 703, input unit 704, sensor
705th, display unit 706, user input unit 707, interface unit 708, memory 709, processor 710 and power supply 711 etc.
Component.It will be understood by those skilled in the art that the mobile terminal structure shown in Figure 10 does not form the restriction to mobile terminal,
Mobile terminal can include either combining some components or different components arrangement than illustrating more or fewer components.
In the embodiment of the present invention, mobile terminal includes but not limited to mobile phone, tablet computer, laptop, palm PC, vehicle-mounted end
End, wearable device and pedometer etc..
Wherein, processor 710 for receiving shooting preview instruction, gather initial preview image；Identify the initial preview
There is the identification object of biological characteristic in image；It sends the identification object to category and identifies server；Receive the life
Species do not identify the category information of server feedback；The category information is added to the initial preview image,
Obtain targets preview image.
In embodiments of the present invention, by gathering initial preview image when receiving shooting preview and instructing, and identify just
In beginning preview image there is the identification object of biological characteristic, identification object is sent to category identification server, for biology
Classification identification server returns to category information for identification object, after category information is received, adds it to
Initial preview image obtains targets preview image.So as to save user and be taken pictures, log in knowledge figure website, upload pictures etc.
Multiple operations and time for being operated, improve the efficiency that user obtains information.
It should be understood that in the embodiment of the present invention, radio frequency unit 701 can be used for receiving and sending messages or communication process in, signal
Send and receive, specifically, by from base station downlink data receive after, handled to processor 710；In addition, by uplink
Data sending is to base station.In general, radio frequency unit 701 includes but not limited to antenna, at least one amplifier, transceiver, coupling
Device, low-noise amplifier, duplexer etc..In addition, radio frequency unit 701 can also by wireless communication system and network and other set
Standby communication.
Mobile terminal has provided wireless broadband internet to the user by network module 702 and has accessed, and such as user is helped to receive
It sends e-mails, browse webpage and access streaming video etc..
Audio output unit 703 can be receiving by radio frequency unit 701 or network module 702 or in memory 709
The voice data of storage is converted into audio signal and exports as sound.Moreover, audio output unit 703 can also be provided and moved
The relevant audio output of specific function that dynamic terminal 700 performs is (for example, call signal receives sound, message sink sound etc.
Deng).Audio output unit 703 includes loud speaker, buzzer and receiver etc..
Input unit 704 is used to receive audio or video signal.Input unit 704 can include graphics processor
(Graphics Processing Unit, GPU) 7041 and microphone 7042, graphics processor 7041 is in video acquisition mode
Or the static images or the image data of video obtained in image capture mode by image capture apparatus (such as camera) carry out
Reason.Treated, and picture frame may be displayed on display unit 706.Through graphics processor 7041, treated that picture frame can be deposited
Storage is sent in memory 709 (or other storage mediums) or via radio frequency unit 701 or network module 702.Mike
Wind 7042 can receive sound, and can be voice data by such acoustic processing.Treated voice data can be
The form output of mobile communication base station can be sent to via radio frequency unit 701 by being converted in the case of telephone calling model.
Mobile terminal 700 further includes at least one sensor 705, such as optical sensor, motion sensor and other biographies
Sensor.Specifically, optical sensor includes ambient light sensor and proximity sensor, wherein, ambient light sensor can be according to environment
The light and shade of light adjusts the brightness of display panel 7061, and proximity sensor can close when mobile terminal 700 is moved in one's ear
Display panel 7061 and/or backlight.As one kind of motion sensor, accelerometer sensor can detect in all directions (general
For three axis) size of acceleration, size and the direction of gravity are can detect that when static, available for identification mobile terminal posture (ratio
Such as horizontal/vertical screen switching, dependent game, magnetometer pose calibrating), Vibration identification correlation function (such as pedometer, tap)；It passes
Sensor 705 can also include fingerprint sensor, pressure sensor, iris sensor, molecule sensor, gyroscope, barometer, wet
Meter, thermometer, infrared ray sensor etc. are spent, details are not described herein.
Display unit 706 is used to show by information input by user or be supplied to the information of user.Display unit 706 can wrap
Display panel 7061 is included, liquid crystal display (Liquid Crystal Display, LCD), Organic Light Emitting Diode may be employed
Forms such as (Organic Light-Emitting Diode, OLED) configure display panel 7061.
User input unit 707 can be used for the number for receiving input or character information and generation and the use of mobile terminal
The key signals input that family is set and function control is related.Specifically, user input unit 707 include touch panel 7071 and
Other input equipments 7072.Touch panel 7071, also referred to as touch-screen, collect user on it or neighbouring touch operation
(for example user uses any suitable objects such as finger, stylus or attachment on touch panel 7071 or in touch panel 7071
Neighbouring operation).Touch panel 7071 may include both touch detecting apparatus and touch controller.Wherein, touch detection
Device detects the touch orientation of user, and detects the signal that touch operation is brought, and transmits a signal to touch controller；Touch control
Device processed receives touch information from touch detecting apparatus, and is converted into contact coordinate, then gives processor 710, receiving area
It manages the order that device 710 is sent and is performed.It is furthermore, it is possible to more using resistance-type, condenser type, infrared ray and surface acoustic wave etc.
Type realizes touch panel 7071.Except touch panel 7071, user input unit 707 can also include other input equipments
7072.Specifically, other input equipments 7072 can include but is not limited to physical keyboard, function key (such as volume control button,
Switch key etc.), trace ball, mouse, operation lever, details are not described herein.
Further, touch panel 7071 can be covered on display panel 7061, when touch panel 7071 is detected at it
On or near touch operation after, send to processor 710 with determine touch event type, be followed by subsequent processing device 710 according to touch
The type for touching event provides corresponding visual output on display panel 7061.Although in Fig. 10, touch panel 7071 is with showing
Show that panel 7061 is the component independent as two to realize the function that outputs and inputs of mobile terminal, but in some embodiments
In, can be integrated by touch panel 7071 and display panel 7061 and realize the function that outputs and inputs of mobile terminal, it is specific this
Place does not limit.
Interface unit 708 is the interface that external device (ED) is connected with mobile terminal 700.For example, external device (ED) can include
Line or wireless head-band earphone port, external power supply (or battery charger) port, wired or wireless data port, storage card end
Mouth, port, audio input/output (I/O) port, video i/o port, earphone end for connecting the device with identification module
Mouthful etc..Interface unit 708 can be used for receive the input (for example, data message, electric power etc.) from external device (ED) and
One or more elements that the input received is transferred in mobile terminal 700 can be used in 700 He of mobile terminal
Data are transmitted between external device (ED).
Memory 709 can be used for storage software program and various data.Memory 709 can mainly include storing program area
And storage data field, wherein, storing program area can storage program area, application program (such as the sound needed at least one function
Sound playing function, image player function etc.) etc.；Storage data field can store according to mobile phone use created data (such as
Voice data, phone directory etc.) etc..In addition, memory 709 can include high-speed random access memory, can also include non-easy
The property lost memory, a for example, at least disk memory, flush memory device or other volatile solid-state parts.
Processor 710 is the control centre of mobile terminal, utilizes each of various interfaces and the entire mobile terminal of connection
A part is stored in storage by running or performing the software program being stored in memory 709 and/or module and call
Data in device 709 perform the various functions of mobile terminal and processing data, so as to carry out integral monitoring to mobile terminal.Place
Reason device 710 may include one or more processing units；Preferably, processor 710 can integrate application processor and modulatedemodulate is mediated
Device is managed, wherein, the main processing operation system of application processor, user interface and application program etc., modem processor is main
Handle wireless communication.It is understood that above-mentioned modem processor can not also be integrated into processor 710.
Mobile terminal 700 can also be included to the power supply 711 (such as battery) of all parts power supply, it is preferred that power supply 711
Can be logically contiguous by power-supply management system and processor 710, so as to realize management charging by power-supply management system, put
The functions such as electricity and power managed.
In addition, mobile terminal 700 includes some unshowned function modules, details are not described herein.
Preferably, the embodiment of the present invention also provides a kind of mobile terminal, and including processor 710, memory 709 is stored in
On memory 709 and the computer program that can be run on the processor 710, the computer program are performed by processor 710
Each process of the above-mentioned image processing method embodiments of Shi Shixian, and identical technique effect can be reached, to avoid repeating, here
It repeats no more.
The embodiment of the present invention also provides a kind of computer readable storage medium, and meter is stored on computer readable storage medium
Calculation machine program, the computer program realize each process of above-mentioned image processing method embodiment when being performed by processor 710, and
Identical technique effect can be reached, to avoid repeating, which is not described herein again.Wherein, the computer readable storage medium, such as
Read-only memory (Read-Only Memory, abbreviation ROM), random access memory (Random Access Memory, abbreviation
RAM), magnetic disc or CD etc..
It should be noted that herein, term " comprising ", "comprising" or its any other variant are intended to non-row
His property includes, so that process, method, article or device including a series of elements not only include those elements, and
And it further includes other elements that are not explicitly listed or further includes as this process, method, article or device institute inherently
Element.In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that including this
Also there are other identical elements in the process of element, method, article or device.
Through the above description of the embodiments, those skilled in the art can be understood that above-described embodiment side
Method can add the mode of required general hardware platform to realize by software, naturally it is also possible to by hardware, but in many cases
The former is more preferably embodiment.Based on such understanding, technical scheme substantially in other words does the prior art
Going out the part of contribution can be embodied in the form of software product, which is stored in a storage medium
In (such as ROM/RAM, magnetic disc, CD), used including some instructions so that a station terminal (can be mobile phone, computer services
Device, air conditioner or network equipment etc.) perform method described in each embodiment of the present invention.
The embodiment of the present invention is described above in conjunction with attached drawing, but the invention is not limited in above-mentioned specific
Embodiment, above-mentioned specific embodiment is only schematical rather than restricted, those of ordinary skill in the art
Under the enlightenment of the present invention, present inventive concept and scope of the claimed protection are not being departed from, can also made very much
Form is belonged within the protection of the present invention.
Claims (17)
1. a kind of image processing method, applied to mobile terminal, which is characterized in that the described method includes：
Shooting preview instruction is received, gathers initial preview image；
Identifying has the identification object of biological characteristic in the initial preview image；
It sends the identification object to category and identifies server；
Receive the category information of the category identification server feedback；
The category information is added to the initial preview image, obtains targets preview image.
2. according to the method described in claim 1, it is characterized in that, the identification object to the category that sends identifies clothes
The step of business device, including：
Preview subgraph is extracted from the initial preview image；The preview sub-picture pack has biological characteristic described in containing
Identify object；
Generate Object identifying request；
The Object identifying is sent to ask to identify server to the category.
3. according to the method described in claim 1, it is characterized in that, the initial preview image include multiple images position, it is more
Incidence relation is respectively provided between a picture position, it is described that the category information is added to the initial preview image,
The step of obtaining targets preview image, including：
Determine first picture position of the identification object with biological characteristic in the initial preview image；
By the category information be added to on associated second picture position in described first image position；
By the initial preview image added with the category information, as the targets preview image.
4. according to the method described in claim 3, it is characterized in that, it is described by the category information be added to it is described
After step on associated second picture position in first picture position, the method further includes：
Receive the position moving operation instruction of user；
In the initial preview image, the category information is moved to the 3rd image position from second picture position
It puts.
5. according to the method described in claim 1, it is characterized in that, it is described by the category information be added to it is described just
Beginning preview image, after the step of obtaining targets preview image, the method further includes：
Page search entrance is added on the targets preview image；
When receiving the page search operation for page search entrance, sending page search to page search server please
It asks；The page searching request includes the category information；
Receive the result of page searching that the page search server is directed to category information feedback；
The browser of the mobile terminal is called, loads described search results page.
6. according to the method described in claim 1, it is characterized in that, it is described by the category information be added to it is described just
Beginning preview image, after the step of obtaining targets preview image, the method further includes：
When detecting the mobile terminal shake, the initial preview image of next frame is gathered, and the category information is added
The initial preview image of next frame is added to, obtains the targets preview image of next frame.
7. according to the method described in claim 3, it is characterized in that, it is described by the category information be added to it is described
After step on associated second picture position in first picture position, the method further includes：
The information editing received for the category information asks；Described information edit requests include self-defined category
Information；
On the second picture position of the initial preview image, the category information is replaced with into the self-defined biology
Classification information.
8. a kind of image-recognizing method identifies server applied to category, which is characterized in that the category identification clothes
Business device includes multiple categories and category information corresponding with its, the described method includes：
Receive the identification object of mobile terminal；
Identify the target organism classification belonging to the identification object；
Extraction target organism classification information corresponding with the target organism classification；
The target organism classification information is sent to the mobile terminal.
9. a kind of image processing apparatus, which is characterized in that including：
Initial preview image capture module for receiving shooting preview instruction, gathers initial preview image；
Object Identification Module is identified, for identifying the identification object in the initial preview image with biological characteristic；
It identifies object sending module, server is identified for sending the identification object to category；
Category information receiving module, for receiving the category information of the category identification server feedback；
Category information add module for the category information to be added to the initial preview image, obtains mesh
Mark preview image.
10. device according to claim 9, which is characterized in that the identification object sending module, including：
Preview subgraph extracting sub-module, for extracting preview subgraph from the initial preview image；The preview subgraph
As including the identification object with biological characteristic；
Submodule is requested to generate, for generating Object identifying request；
Request-to-send submodule asks to identify server to the category for sending the Object identifying.
11. device according to claim 9, which is characterized in that the initial preview image includes multiple images position, more
It is respectively provided with incidence relation between a picture position, the category information add module, including：
First picture position determination sub-module, for determining the identification object with biological characteristic in the initial preview figure
The first picture position as in；
Information adds submodule, for the category information to be added to and associated second figure in described first image position
On image position；
Targets preview image generates submodule, for that will be added with the initial preview image of the category information, as institute
State targets preview image.
12. according to the devices described in claim 11, which is characterized in that the category information add module further includes：
Receiving submodule is operated, for receiving the position moving operation instruction of user；
Information mobile submodule, in the initial preview image, by the category information from second image
Position is moved to the 3rd picture position.
13. device according to claim 9, which is characterized in that described device further includes：
The page searches for entrance add module, for adding page search entrance on the targets preview image；
Searching request sending module, for when receiving the page search operation for page search entrance, being searched for the page
Server sends page searching request；The page searching request includes the category information；
Result of page searching receiving module, for receiving the page search server for category information feedback
Result of page searching；
Result of page searching load-on module for calling the browser of the mobile terminal, loads described search results page.
14. device according to claim 9, which is characterized in that described device further includes：
Next frame image capture module, for when detecting the mobile terminal shake, gathering the initial preview image of next frame,
And the category information is added to the initial preview image of next frame, obtain the targets preview image of next frame.
15. according to the devices described in claim 11, which is characterized in that the category information add module is also wrapped
It includes：
Information editing's request receiving submodule, the information editing for receiving for the category information ask；The letter
Ceasing edit requests includes self-defined category information；
Information replaces submodule, in the second picture position of the initial preview image, by the category information
Replace with the self-defined category information.
16. a kind of server, which is characterized in that the server includes multiple categories and biology corresponding with its
Classification information, the server include：
Object receiving module is identified, for receiving the identification object of mobile terminal；
Category identification module, for identifying the target organism classification belonging to the identification object；
Category information extraction modules, for extracting target organism classification information corresponding with the target organism classification；
Category information sending module, for the target organism classification information to be sent to the mobile terminal.
17. a kind of mobile terminal, which is characterized in that including processor, memory and be stored on the memory and can be in institute
The computer program run on processor is stated, such as claim 1 to 7 is realized when the computer program is performed by the processor
Any one of image processing method the step of.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711125033.9A CN108090126B (en) | 2017-11-14 | 2017-11-14 | Image processing method and device, mobile terminal, image identification method and server |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711125033.9A CN108090126B (en) | 2017-11-14 | 2017-11-14 | Image processing method and device, mobile terminal, image identification method and server |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108090126A true CN108090126A (en) | 2018-05-29 |
| CN108090126B CN108090126B (en) | 2021-09-24 |
Family
ID=62172609
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711125033.9A Active CN108090126B (en) | 2017-11-14 | 2017-11-14 | Image processing method and device, mobile terminal, image identification method and server |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108090126B (en) |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108924418A (en) * | 2018-07-02 | 2018-11-30 | 珠海市魅族科技有限公司 | A kind for the treatment of method and apparatus of preview image, terminal, readable storage medium storing program for executing |
| CN109033991A (en) * | 2018-07-02 | 2018-12-18 | 北京搜狗科技发展有限公司 | A kind of image-recognizing method and device |
| CN109255325A (en) * | 2018-09-05 | 2019-01-22 | 百度在线网络技术（北京）有限公司 | Image-recognizing method and device for wearable device |
| CN110941987A (en) * | 2019-10-10 | 2020-03-31 | 北京百度网讯科技有限公司 | Target object identification method and device, electronic equipment and storage medium |
| CN113038001A (en) * | 2021-02-26 | 2021-06-25 | 维沃移动通信有限公司 | Display method and device and electronic equipment |
| CN113111248A (en) * | 2021-03-16 | 2021-07-13 | 百度在线网络技术（北京）有限公司 | Search processing method and device, electronic equipment and storage medium |
| CN113111249A (en) * | 2021-03-16 | 2021-07-13 | 百度在线网络技术（北京）有限公司 | Search processing method and device, electronic equipment and storage medium |
| WO2021179804A1 (en) * | 2020-03-11 | 2021-09-16 | Oppo广东移动通信有限公司 | Image processing method, image processing device, storage medium, and electronic apparatus |
| CN114629837A (en) * | 2022-03-18 | 2022-06-14 | 澜途集思(深圳)数字科技有限公司 | Ecological biological identification method based on NoC algorithm |
| CN114726999A (en) * | 2021-01-05 | 2022-07-08 | 北京小米移动软件有限公司 | Image acquisition method, image acquisition device and storage medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2013012860A1 (en) * | 2011-07-19 | 2013-01-24 | Ball Horticultural Company | Seed classification using spectral analysis to determine existence of a seed structure |
| CN103533248A (en) * | 2013-10-24 | 2014-01-22 | 腾讯科技（上海）有限公司 | Image processing method, terminal and system |
| CN103605687A (en) * | 2013-11-01 | 2014-02-26 | 上海斐讯数据通信技术有限公司 | Photographing and image recognizing system and method of mobile terminal |
| CN103617430A (en) * | 2013-09-14 | 2014-03-05 | 西北农林科技大学 | Portable campus plant species recognition system based on plant leaf image information |
| CN103942049A (en) * | 2014-04-14 | 2014-07-23 | 百度在线网络技术（北京）有限公司 | Augmented reality realizing method, client-side device and server |
| CN104361348A (en) * | 2014-10-27 | 2015-02-18 | 华南理工大学 | Flower and plant recognition method on intelligent terminal |
| CN106529375A (en) * | 2015-09-11 | 2017-03-22 | 上海乐今通信技术有限公司 | Mobile terminal and object feature identification method for image of mobile terminal |
-
2017
- 2017-11-14 CN CN201711125033.9A patent/CN108090126B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2013012860A1 (en) * | 2011-07-19 | 2013-01-24 | Ball Horticultural Company | Seed classification using spectral analysis to determine existence of a seed structure |
| CN103617430A (en) * | 2013-09-14 | 2014-03-05 | 西北农林科技大学 | Portable campus plant species recognition system based on plant leaf image information |
| CN103533248A (en) * | 2013-10-24 | 2014-01-22 | 腾讯科技（上海）有限公司 | Image processing method, terminal and system |
| CN103605687A (en) * | 2013-11-01 | 2014-02-26 | 上海斐讯数据通信技术有限公司 | Photographing and image recognizing system and method of mobile terminal |
| CN103942049A (en) * | 2014-04-14 | 2014-07-23 | 百度在线网络技术（北京）有限公司 | Augmented reality realizing method, client-side device and server |
| CN104361348A (en) * | 2014-10-27 | 2015-02-18 | 华南理工大学 | Flower and plant recognition method on intelligent terminal |
| CN106529375A (en) * | 2015-09-11 | 2017-03-22 | 上海乐今通信技术有限公司 | Mobile terminal and object feature identification method for image of mobile terminal |
Non-Patent Citations (2)
| Title |
|---|
| KHANCHAI KINGKANGWAN等: ""Gun identification using image synchronization for DTI"s virtual shooting range"", 《2016 SECOND ASIAN CONFERENCE ON DEFENCE TECHNOLOGY (ACDT)》 * |
| 丁常宏等: ""数字图像模式识别技术在植物叶片识别中的应用"", 《世界林业研究》 * |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108924418A (en) * | 2018-07-02 | 2018-11-30 | 珠海市魅族科技有限公司 | A kind for the treatment of method and apparatus of preview image, terminal, readable storage medium storing program for executing |
| CN109033991A (en) * | 2018-07-02 | 2018-12-18 | 北京搜狗科技发展有限公司 | A kind of image-recognizing method and device |
| CN109255325A (en) * | 2018-09-05 | 2019-01-22 | 百度在线网络技术（北京）有限公司 | Image-recognizing method and device for wearable device |
| CN110941987A (en) * | 2019-10-10 | 2020-03-31 | 北京百度网讯科技有限公司 | Target object identification method and device, electronic equipment and storage medium |
| WO2021179804A1 (en) * | 2020-03-11 | 2021-09-16 | Oppo广东移动通信有限公司 | Image processing method, image processing device, storage medium, and electronic apparatus |
| CN114726999A (en) * | 2021-01-05 | 2022-07-08 | 北京小米移动软件有限公司 | Image acquisition method, image acquisition device and storage medium |
| CN114726999B (en) * | 2021-01-05 | 2023-12-26 | 北京小米移动软件有限公司 | Image acquisition method, image acquisition device and storage medium |
| CN113038001A (en) * | 2021-02-26 | 2021-06-25 | 维沃移动通信有限公司 | Display method and device and electronic equipment |
| CN113111248A (en) * | 2021-03-16 | 2021-07-13 | 百度在线网络技术（北京）有限公司 | Search processing method and device, electronic equipment and storage medium |
| CN113111249A (en) * | 2021-03-16 | 2021-07-13 | 百度在线网络技术（北京）有限公司 | Search processing method and device, electronic equipment and storage medium |
| CN114629837A (en) * | 2022-03-18 | 2022-06-14 | 澜途集思(深圳)数字科技有限公司 | Ecological biological identification method based on NoC algorithm |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108090126B (en) | 2021-09-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108090126A (en) | Image processing method, device and mobile terminal, image-recognizing method and server | |
| CN108470041A (en) | A kind of information search method and mobile terminal | |
| CN109445894A (en) | A kind of screenshot method and electronic equipment | |
| CN107977144A (en) | A kind of screenshotss processing method and mobile terminal | |
| CN108062404A (en) | Processing method, device, readable storage medium storing program for executing and the terminal of facial image | |
| CN109582475A (en) | A kind of sharing method and terminal | |
| CN109165320A (en) | A kind of information collection method and mobile terminal | |
| CN109947650A (en) | Script step process methods, devices and systems | |
| CN109862266A (en) | A kind of image sharing method and terminal | |
| CN107784089A (en) | A kind of storage method of multi-medium data, processing method and mobile terminal | |
| CN107908770A (en) | A kind of photo searching method and mobile terminal | |
| CN109508399A (en) | A kind of facial expression image processing method, mobile terminal | |
| CN110308837A (en) | File management method and terminal | |
| CN114357278B (en) | Topic recommendation method, device and equipment | |
| CN109495616A (en) | A kind of photographic method and terminal device | |
| CN110069675A (en) | A kind of search method and mobile terminal | |
| CN108718389A (en) | A kind of screening-mode selection method and mobile terminal | |
| CN108600544A (en) | A kind of Single-hand control method and terminal | |
| CN108322897A (en) | Cutting ferrule meal combined method and device | |
| CN107992615A (en) | A kind of network address recommends method, server and terminal | |
| CN107943960A (en) | A kind of method of application grooms, mobile terminal | |
| CN107728877A (en) | One kind applies recommendation method and mobile terminal | |
| CN107967652B (en) | A kind of information sharing method sends lateral terminal, receives lateral terminal and server | |
| CN108040001B (en) | A kind of information flag method, terminal | |
| CN108459813A (en) | A kind of searching method and mobile terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |