CN109472825A - A kind of object search method and terminal device - Google Patents

A kind of object search method and terminal device Download PDF

Info

Publication number
CN109472825A
CN109472825A CN201811204693.0A CN201811204693A CN109472825A CN 109472825 A CN109472825 A CN 109472825A CN 201811204693 A CN201811204693 A CN 201811204693A CN 109472825 A CN109472825 A CN 109472825A
Authority
CN
China
Prior art keywords
target object
information
terminal device
depth information
model
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201811204693.0A
Other languages
Chinese (zh)
Other versions
CN109472825B (en
Inventor
冯天良
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Vivo Mobile Communication Co Ltd
Original Assignee
Vivo Mobile Communication Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Vivo Mobile Communication Co Ltd filed Critical Vivo Mobile Communication Co Ltd
Priority to CN201811204693.0A priority Critical patent/CN109472825B/en
Publication of CN109472825A publication Critical patent/CN109472825A/en
Application granted granted Critical
Publication of CN109472825B publication Critical patent/CN109472825B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/70Determining position or orientation of objects or cameras
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/50Depth or shape recovery
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10016Video; Image sequence
    • G06T2207/10021Stereoscopic video; Stereoscopic image sequence

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The embodiment of the invention discloses a kind of object search method and terminal devices, wherein the side is applied to the terminal device including TOF camera, wherein the described method includes: acquiring the depth information of the target object in angular field of view by TOF camera;In the case where the target object belongs to preset object set, based on the depth information of the target object, the 3D model of the target object is obtained;Show the 3D model of the target object;The first input of receiving terminal apparatus user;In response to first input, the distance prompt information of the target object is exported, the distance prompt information is used to prompt the real-time range between the target object and the terminal user.The object search method provided through the invention can save terminal user and search for object spent time to be searched and energy.

Description

A kind of object search method and terminal device
Technical field
The present embodiments relate to field of communication technology more particularly to a kind of object search method and terminal devices.
Background technique
In daily life, people usually have the demand for finding article in dark conditions, such as: family when overtime work is gone back home People has turned off the light rest, if wanting to look for certain part article in that case, but the torch for the equipment that is also not desired to turn on light or open a terminal When influencing household's rest, the part article at this moment can only be gropingly gone under dark surrounds.When going for the part article in groping, Can inevitably bump against on other furniture cause it is unnecessary collide with, can also consumable articles hunter a large amount of time and energy.
As it can be seen that when finding article under dark surrounds at present, it can consumable articles hunter plenty of time and energy.
Summary of the invention
The embodiment of the present invention provides a kind of object search method, time-consuming when solving searching article existing in the prior art The problem of long and consumption great effort.
In order to solve the above-mentioned technical problem, the present invention is implemented as follows:
In a first aspect, the embodiment of the invention provides a kind of object search methods, applied to the terminal including TOF camera Equipment, wherein the described method includes: acquiring the depth information of the target object in angular field of view by TOF camera;Described In the case that target object belongs to preset object set, based on the depth information of the target object, the target pair is obtained The 3D model of elephant;Show the 3D model of the target object;The first input of receiving terminal apparatus user;In response to described first Input exports the distance prompt information of the target object, and the distance prompt information is for prompting the target object and institute State the real-time range between terminal user.
Second aspect, the embodiment of the invention provides a kind of terminal devices, including TOF camera, wherein the terminal is set Standby includes: acquisition module, for acquiring the depth information of the target object in angular field of view by the TOF camera;It obtains Module, in the case where the target object belongs to preset object set, based on the depth information of the target object, Obtain the 3D model of the target object;Display module, for showing the 3D model of the target object;First receiving module, The first input for receiving terminal apparatus user;Output module is prompted, for exporting the mesh in response to first input Mark the distance prompt information of object, the distance prompt information for prompt the target object and the terminal user it Between real-time range.
The third aspect the embodiment of the invention provides a kind of terminal device, including processor, memory and is stored in described It is real when the computer program is executed by the processor on memory and the computer program that can run on the processor The step of any object search method described in the existing embodiment of the present invention.
Fourth aspect, the embodiment of the invention provides a kind of computer readable storage medium, the computer-readable storage Computer program is stored on medium, and any described in the embodiment of the present invention is realized when the computer program is executed by processor The step of kind object search method.
In embodiments of the present invention, it is acquired in angular field of view by TOF (Time of Flight, flight time) camera Target object depth information;In the case where target object belongs to preset object set, the depth based on target object Information obtains the 3D model of target object;The 3D model of displaying target object;The first input of receiving terminal apparatus user;It rings The distance prompt information of target object should be exported, distance prompt information is for prompting target object i.e. to be searched in the first input Real-time range between object and terminal user can quickly navigate to object to be searched, and export distance prompt information Guiding terminal equipment user reaches object present position to be searched, is consumed to save terminal user and search for object to be searched Time and efforts.
Detailed description of the invention
Fig. 1 is one of the flow chart of the object search method provided according to embodiments of the present invention;
Fig. 2 is the two of the flow chart of the object search method provided according to embodiments of the present invention;
Fig. 3 is the structural block diagram of the terminal device of the embodiment of the present invention;
Fig. 4 is the hardware structural diagram of the terminal device provided according to embodiments of the present invention.
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete Site preparation description, it is clear that described embodiments are some of the embodiments of the present invention, instead of all the embodiments.Based on this hair Embodiment in bright, every other implementation obtained by those of ordinary skill in the art without making creative efforts Example, shall fall within the protection scope of the present invention.
Referring to Fig.1, one of the flow chart of object search method provided in an embodiment of the present invention is shown.
The object search method of the embodiment of the present invention the following steps are included:
Step 101: the depth information of the target object in angular field of view is acquired by TOF camera.
The object search method of the embodiment of the present invention is applied to the terminal device including TOF camera.TOF camera passes through Infrared transmitter continuously emits light pulse, is encountering people or object back reflection, and sensor receives the reflected light of people or object, By calculating the time difference of infrared light transmitting and reflection, the stereoscopic vision of people or object is formed.
It, can be with the TOF of opening terminal apparatus when terminal user searches for object, that is, target object under dark surrounds Camera, based on TOF camera collected each object depth information construct respectively collected each object 3D mould Then type carries out 3D model to be displayed for terminal user according to 3D model to determine whether the object is searched for Target object.It is with the depth information for only collecting an object in the angular field of view of TOF camera in the embodiment of the present invention Example is illustrated.During specific implementation, the depth letter of multiple objects may be collected in the angular field of view of TOF camera Breath, correspondingly then need respectively according to the depth information of collected each object obtain the 3D model of each object respectively and shown Show.
During specific implementation, object set can be pre-created in terminal user, include multiple objects in object set Two-dimensional image.The object for including in object set can be all or part of article put in certain region, can also To be article that terminal user is commonly used, can also be it is some it is small in size, be not easy the article being found etc., the present invention In embodiment with no restrictions to the particular content for the object for including in object set.
In the depth information for collecting target object, it need to judge whether target object belongs to preset object set, if It is then to execute follow-up process;If it is not, then return step 101 resurveys the depth information of the object in angular field of view.
In the case where target object belongs to preset object set, the depth information of target object is stored.Store target The depth information of object is convenient for the subsequent 3D model that target object is accurately constructed according to the depth information.
Step 102: in the case where target object belongs to preset object set, the depth information based on target object, Obtain the 3D model of target object.
Depth information based on target object when obtaining the 3D model of target object, can be based on target by terminal device The depth information of object constructs the 3D model of target object;Alternatively, the depth information of target object is uploaded to by terminal device Server obtains the 3D model for the depth information building based on target object that server is sent.
It can be saved by terminal device building 3D model and the depth information of target object is uploaded to server, and received 3D model spent time transmitted by server promotes the efficiency for obtaining the 3D model of target object.By server construction 3D model The processing load of terminal device can effectively be mitigated by being sent to terminal device afterwards.
Step 103: the 3D model of displaying target object.
After getting the 3D model of target object, acquired 3D model is shown to the current interface in terminal device On.
Step 104: the first input of receiving terminal apparatus user.
Whether inquiry message can be popped up after showing 3D with 3D model shown by inquiry terminal equipment user is wait search Rope object.If terminal user determines that shown 3D model is that object to be searched can input the input of determine instruction i.e. first.
If show the 3D model of multiple target objects in shooting preview interface, terminal device can detecte terminal device Selection operation of the user to a certain 3D model;The corresponding target object of 3D model selected is determined as object to be searched. Wherein, selection operation, that is, terminal user first of a certain 3D model is inputted.
Step 105: in response to the first input, exporting the distance prompt information of the target object.
Wherein, distance prompt information is used to prompt the real-time range between target object and terminal user.Terminal is set Standby user can easily search out object to be searched by distance prompt information.
Distance prompt information can be the information of text information, voice messaging or text in conjunction with voice, and the present invention is real The concrete type for applying prompt information of adjusting the distance in example is not particularly limited.
Object search method provided in an embodiment of the present invention acquires the target object in angular field of view by TOF camera Depth information;In the case where target object belongs to preset object set, the depth information based on target object obtains mesh Mark the 3D model of object;The 3D model of displaying target object;The first input of receiving terminal apparatus user;It is defeated in response to first Enter, exports the distance prompt information of target object, distance prompt information is for prompting target object object i.e. to be searched and terminal Real-time range between equipment user can quickly navigate to object to be searched, and export distance prompt information guidance terminal and set Standby user reaches object present position to be searched, so that saving terminal user searches for object spent time and essence to be searched Power.
Referring to Fig. 2, the two of the flow chart of object search method provided in an embodiment of the present invention are shown.
Object search method in the embodiment of the present invention specifically includes the following steps:
Step 201: the object information of the object to be searched of receiving terminal apparatus user input.
Object information may include at least one of following: object oriented, characteristics of objects;It include characteristics of objects in object information In the case where, characteristics of objects include object type, in object size at least one of;Wherein, same target type is corresponding at least A kind of object model.Above-mentioned specific classification is set by the object information of object to be searched, is just looked into treating object search When looking for, object to be searched is rapidly and accurately determined from the target object searched in angular field of view.
Pre-selection creation object set in the embodiment of the present invention, each object can be divided according to characteristics of objects in object set Class divides each object according to object type, object size, can be by each object in object set according to said features The classification more refined.
In the embodiment of the present invention, terminal user is when treating object search by terminal device and scanning for, input The object information of object to be searched, convenient for terminal device by object information or the characteristics of objects of object to be searched, according to right As signature search object to be searched, to promote search efficiency.
Step 202: object information is stored into object set.
The object information of each object to be searched is stored into object set, is searched convenient for subsequent treating object search Suo Shi can determine its characteristics of objects according to the object information of object to be searched, have needle from target object according to characteristics of objects Whether the judgement to property includes wherein object to be searched.
Step 203: the depth information of the target object in angular field of view is acquired by TOF camera.
The angular field of view of TOF camera can by terminal user using when be adjusted according to demand, the present invention implement This is not particularly limited in example.
After the depth information for collecting target object, the depth information of target object is stored.It can during specific implementation Different strategies is taken to save the depth information of target object, difference is as follows:
Can be saved according to angular field of view: the angular field of view of TOF camera is fixed and invariable, and can only save visual angle model The depth information of target object in enclosing, for example the angular field of view of current TOF camera is 80 degree, current visual angle is 0 degree and arrives 80 degree, then the depth information of target object within the scope of 0 degree to 80 degree is only saved, new visual angle is 30 to arrive after camera rotates It 110 degree, then empties the depth information of the target object within the scope of previously stored 0 degree to 80 degree and saves 30 degree to 110 degree models Enclose interior target object depth information.
It is saved according to whether target object belongs to default object set.If target object belongs to local preset object Set then saves the depth information of target object;Conversely, not saving the depth information of target object then.According to object to be searched Characteristics of objects saves.As the characteristics of objects of object to be searched be it is round, then only retain circular target object in target object Depth information.
It is saved according to the classification of object to be searched.Two-dimensional image set can be established according to the classification of object, For example, the corresponding one or more of two-dimensional images of " book " class, corresponding one or more of two-dimensional images of " remote controler " class etc.. If object key word to be searched is book, the depth information for the target object that two-dimensional image is book is only saved, it is to be searched right As keyword is remote controler, then the depth information for the target object that two-dimensional image is remote controler is only saved.
It is saved according to the size of object to be searched.Such as have in object key word to be searched 8.2 cun hereinafter, then only saving The depth information of 8.2 cun of target objects below.
Step 204: the feelings that at least one object information in the object information and object set of target object matches Under condition, object-based depth information obtains the 3D model of target object.
Depth information based on target object when obtaining the 3D model of target object, can be based on target by terminal device The depth information of object constructs the 3D model of target object;Alternatively, the depth information of target object is uploaded to by terminal device Server obtains the 3D model for the depth information building based on target object that server is sent.
It can be saved by terminal device building 3D model and the depth information of target object is uploaded to server, and received 3D model spent time transmitted by server promotes the efficiency for obtaining the 3D model of target object.By server construction 3D model The processing load of terminal device can effectively be mitigated by being sent to terminal device afterwards.
Step 205: the 3D model of displaying target object.
After getting the 3D model of target object, acquired 3D model is shown to the current interface in terminal device On.
Step 206: the first input of receiving terminal apparatus user.
Whether inquiry message can be popped up after showing 3D with 3D model shown by inquiry terminal equipment user is wait search Rope object.If terminal user determines that shown 3D model is object to be searched, the input of determine instruction i.e. first can be inputted.
If show the 3D model of multiple target objects in shooting preview interface, terminal device can detecte terminal device Selection operation of the user to a certain 3D model;The corresponding target object of 3D model that will be selected, is determined as object to be searched. Wherein, selection operation, that is, terminal user first of a certain 3D model is inputted.
Step 207: in response to the first input, exporting the distance prompt information of target object.
Wherein, distance prompt information is used to prompt the real-time range between target object and the terminal user.
A method of preferably exporting the distance prompt information of target object are as follows: between terminal device and target object Distance be gradually reduced during, in real time play speech prompt information until the distance between terminal device and target object it is small In preset threshold.Wherein, speech prompt information is the information for prompt terminal equipment user and the target object distance.In advance If threshold value can be configured according to actual needs by those skilled in the art, such as be set as 0.1 meter, 0.2 meter or 0.05 Rice etc., is not particularly limited this in the embodiment of the present invention.
This kind exports the mode of distance prompt information, is not necessarily to terminal user's preview terminal device display interface, terminal Equipment user only pass through voice prompting can quickly, accurately find target object, be able to ascend convenient for end users operation The usage experience of terminal user.
Object search method provided in an embodiment of the present invention acquires the target object in angular field of view by TOF camera Depth information;In the case where target object belongs to preset object set, the depth information based on target object obtains mesh Mark the 3D model of object;The 3D model of displaying target object;The first input of receiving terminal apparatus user;It is defeated in response to first Enter, exports the distance prompt information of target object, distance prompt information is for prompting target object object i.e. to be searched and terminal Real-time range between equipment user can quickly navigate to object to be searched, and export distance prompt information guidance terminal and set Standby user reaches object present position to be searched, so that saving terminal user searches for object spent time and essence to be searched Power.In addition, object search method provided in an embodiment of the present invention, on the one hand, the object information of the object to be searched according to input It is scanned for, object to be searched targetedly can be quickly determined from collected target object, promotes search effect Rate.On the other hand, during being gradually reduced at a distance from terminal device is between target object, voice prompting letter is played in real time Breath is not necessarily to terminal user's preview terminal device display interface, and terminal user only passes through voice prompting can quick, essence Target object is found quasi-ly, and the usage experience of terminal user is able to ascend convenient for end users operation.
Referring to Fig. 3, the structural block diagram of the terminal device of the embodiment of the present invention is shown.Terminal device is able to achieve aforementioned implementation The details of object search method in example, and reach identical effect.
The terminal device of the embodiment of the present invention includes TOF camera, the terminal device further include: acquisition module 301 is used In the depth information for acquiring the target object in angular field of view by the TOF camera;Module 302 is obtained, for described In the case that target object belongs to preset object set, based on the depth information of the target object, the target pair is obtained The 3D model of elephant;Display module 303, for showing the 3D model of the target object;First receiving module 304, for receiving The first input of terminal user;Output module 305 is prompted, for exporting the target pair in response to first input The distance prompt information of elephant, the distance prompt information is for prompting between the target object and the terminal user Real-time range.Wherein, acquisition module 301, acquisition module 302, display module 303, the first receiving module 304 and prompt output Module 305 is sequentially connected with.
Preferably, the terminal device further include: the second receiving module, for passing through the TOF in the acquisition module Before camera acquires the depth information of the target object in default angular field of view, receive terminal user's input to The object information of object search;First memory module, for storing the object information into object set;The acquisition mould Block is specifically used for: what at least one object information in the object information of the target object and the object set matched In the case of, based on the depth information of the object, obtain the 3D model of the target object.Wherein, the second receiving module, first Memory module, acquisition module obtain module, display module, the first receiving module and output module are prompted to be sequentially connected with.
Preferably, the object information includes at least one of the following: object oriented, characteristics of objects;In the object information In the case where including characteristics of objects, the characteristics of objects include object type, in object size at least one of;Wherein, same The corresponding at least one object model of object type.
Preferably, the terminal device further include: the second memory module, for passing through the TOF in the acquisition module After camera acquires the depth information of the target object in default angular field of view, belong to preset object in the target object In the case where set, the depth information of the target object is stored.Wherein, the acquisition module, the second memory module, acquisition mould Block, display module, the first receiving module and prompt output module are sequentially connected with.
Preferably, the acquisition module includes: the first submodule, for the depth information based on the target object, structure Build the 3D model of the target object;Alternatively, second submodule, for the depth information of the target object to be uploaded to service Device obtains the 3D model for the depth information building based on the target object that the server is sent.
Terminal device provided in an embodiment of the present invention can be realized terminal device in the embodiment of the method for Fig. 1 to Fig. 2 and realize Each process, to avoid repeating, which is not described herein again.
Terminal device provided in an embodiment of the present invention acquires the depth of the target object in angular field of view by TOF camera Spend information;In the case where target object belongs to preset object set, the depth information based on target object obtains target pair The 3D model of elephant;The 3D model of displaying target object;The first input of receiving terminal apparatus user;It is defeated in response to the first input The distance prompt information of target object out, distance prompt information is for prompting target object object i.e. to be searched and terminal device to use Real-time range between family can quickly navigate to object to be searched, and export distance prompt information guidance terminal user Object present position to be searched is reached, so that saving terminal user searches for object spent time to be searched and energy.
Referring to Fig. 4, a kind of hardware structural diagram of terminal device of the embodiment of the present invention is shown.
A kind of hardware structural diagram of Fig. 4 terminal device of each embodiment to realize the present invention, the terminal device 400 Including but not limited to: radio frequency unit 401, audio output unit 403, input unit 404, sensor 405, is shown network module 402 Show the components such as unit 406, user input unit 407, interface unit 408, memory 409, processor 410 and power supply 411. It will be understood by those skilled in the art that terminal device structure shown in Fig. 4 does not constitute the restriction to terminal device, terminal is set Standby may include perhaps combining certain components or different component layouts than illustrating more or fewer components.In the present invention In embodiment, terminal device includes but is not limited to mobile phone, tablet computer, laptop, palm PC, car-mounted terminal, can wear Wear equipment and pedometer etc..
Processor 410, for acquiring the depth information of the target object in angular field of view by TOF camera;Described In the case that target object belongs to preset object set, based on the depth information of the target object, the target pair is obtained The 3D model of elephant;Show the 3D model of the target object;The first input of receiving terminal apparatus user;In response to described first Input exports the distance prompt information of the target object, and the distance prompt information is for prompting the target object and institute State the real-time range between terminal user.
Terminal device provided in an embodiment of the present invention acquires the depth of the target object in angular field of view by TOF camera Spend information;In the case where target object belongs to preset object set, the depth information based on target object obtains target pair The 3D model of elephant;The 3D model of displaying target object;The first input of receiving terminal apparatus user;It is defeated in response to the first input The distance prompt information of target object out, distance prompt information is for prompting target object object i.e. to be searched and terminal device to use Real-time range between family can quickly navigate to object to be searched, and export distance prompt information guidance terminal user Object present position to be searched is reached, should be understood that save terminal user and search for object spent time to be searched and energy , in the embodiment of the present invention, radio frequency unit 401 can be used for receiving and sending messages or communication process in, signal sends and receivees, tool Body, after the downlink data from base station is received, handled to processor 410;In addition, the data of uplink are sent to base station. In general, radio frequency unit 401 include but is not limited to antenna, at least one amplifier, transceiver, coupler, low-noise amplifier, Duplexer etc..In addition, radio frequency unit 401 system can also be communicated with network and other equipment by wireless communication.
Terminal device provides wireless broadband internet by network module 402 for user and accesses, and such as user is helped to receive It sends e-mails, browse webpage and access streaming video etc..
Audio output unit 403 can be received by radio frequency unit 401 or network module 402 or in memory 409 The audio data of storage is converted into audio signal and exports to be sound.Moreover, audio output unit 403 can also provide and end The relevant audio output of specific function that end equipment 400 executes is (for example, call signal receives sound, message sink sound etc. Deng).Audio output unit 403 includes loudspeaker, buzzer and receiver etc..
Input unit 404 is for receiving audio or video signal.Input unit 404 may include graphics processor (Graphics Processing Unit, GPU) 4041 and microphone 4042, graphics processor 4041 is in video acquisition mode Or the image data of the static images or video obtained in image capture mode by image capture apparatus (such as camera) carries out Reason, wherein image capture apparatus includes TOF camera.Treated, and picture frame may be displayed on display unit 406.Through figure Treated that picture frame can store in memory 409 (or other storage mediums) or via radio frequency unit for processor 4041 401 or network module 402 sent.Microphone 4042 can receive sound, and can be sound by such acoustic processing Frequency evidence.Treated, and audio data can be converted in the case where telephone calling model and can be sent via radio frequency unit 401 Format to mobile communication base station exports.
Terminal device 400 further includes at least one sensor 405, such as optical sensor, motion sensor and other biographies Sensor.Specifically, optical sensor includes ambient light sensor and proximity sensor, wherein ambient light sensor can be according to environment The light and shade of light adjusts the brightness of display panel 4061, and proximity sensor can close when terminal device 400 is moved in one's ear Display panel 4061 and/or backlight.As a kind of motion sensor, accelerometer sensor can detect in all directions (general For three axis) size of acceleration, it can detect that size and the direction of gravity when static, can be used to identify terminal device posture (ratio Such as horizontal/vertical screen switching, dependent game, magnetometer pose calibrating), Vibration identification correlation function (such as pedometer, tap);It passes Sensor 405 can also include fingerprint sensor, pressure sensor, iris sensor, molecule sensor, gyroscope, barometer, wet Meter, thermometer, infrared sensor etc. are spent, details are not described herein.
Display unit 406 is for showing information input by user or being supplied to the information of user.Display unit 406 can wrap Display panel 4061 is included, liquid crystal display (Liquid Crystal Display, LCD), Organic Light Emitting Diode can be used Forms such as (Organic Light-Emitting Diode, OLED) configure display panel 4061.
User input unit 407 can be used for receiving the number or character information of input, and generate the use with terminal device Family setting and the related key signals input of function control.Specifically, user input unit 407 include touch panel 4071 and Other input equipments 4072.Touch panel 4071, also referred to as touch screen collect the touch operation of user on it or nearby (for example user uses any suitable objects or attachment such as finger, stylus on touch panel 4071 or in touch panel 4071 Neighbouring operation).Touch panel 4071 may include both touch detecting apparatus and touch controller.Wherein, touch detection Device detects the touch orientation of user, and detects touch operation bring signal, transmits a signal to touch controller;Touch control Device processed receives touch information from touch detecting apparatus, and is converted into contact coordinate, then gives processor 410, receiving area It manages the order that device 410 is sent and is executed.Furthermore, it is possible to more using resistance-type, condenser type, infrared ray and surface acoustic wave etc. Seed type realizes touch panel 4071.In addition to touch panel 4071, user input unit 407 can also include other input equipments 4072.Specifically, other input equipments 4072 can include but is not limited to physical keyboard, function key (such as volume control button, Switch key etc.), trace ball, mouse, operating stick, details are not described herein.
Further, touch panel 4071 can be covered on display panel 4061, when touch panel 4071 is detected at it On or near touch operation after, send processor 410 to determine the type of touch event, be followed by subsequent processing device 410 according to touching The type for touching event provides corresponding visual output on display panel 4061.Although in Fig. 4, touch panel 4071 and display Panel 4061 is the function that outputs and inputs of realizing terminal device as two independent components, but in some embodiments In, can be integrated by touch panel 4071 and display panel 4061 and realize the function that outputs and inputs of terminal device, it is specific this Place is without limitation.
Interface unit 408 is the interface that external device (ED) is connect with terminal device 400.For example, external device (ED) may include having Line or wireless head-band earphone port, external power supply (or battery charger) port, wired or wireless data port, storage card end Mouth, port, the port audio input/output (I/O), video i/o port, earphone end for connecting the device with identification module Mouthful etc..Interface unit 408 can be used for receiving the input (for example, data information, electric power etc.) from external device (ED) and By one or more elements that the input received is transferred in terminal device 400 or can be used in 400 He of terminal device Data are transmitted between external device (ED).
Memory 409 can be used for storing software program and various data.Memory 409 can mainly include storing program area The storage data area and, wherein storing program area can (such as the sound of application program needed for storage program area, at least one function Sound playing function, image player function etc.) etc.;Storage data area can store according to mobile phone use created data (such as Audio data, phone directory etc.) etc..In addition, memory 409 may include high-speed random access memory, it can also include non-easy The property lost memory, a for example, at least disk memory, flush memory device or other volatile solid-state parts.
Processor 410 is the control centre of terminal device, utilizes each of various interfaces and the entire terminal device of connection A part by running or execute the software program and/or module that are stored in memory 409, and calls and is stored in storage Data in device 409 execute the various functions and processing data of terminal device, to carry out integral monitoring to terminal device.Place Managing device 410 may include one or more processing units;Preferably, processor 410 can integrate application processor and modulatedemodulate is mediated Manage device, wherein the main processing operation system of application processor, user interface and application program etc., modem processor is main Processing wireless communication.It is understood that above-mentioned modem processor can not also be integrated into processor 410.
Terminal device 400 can also include the power supply 411 (such as battery) powered to all parts, it is preferred that power supply 411 Can be logically contiguous by power-supply management system and processor 410, to realize management charging by power-supply management system, put The functions such as electricity and power managed.
In addition, terminal device 400 includes some unshowned functional modules, details are not described herein.
Preferably, the embodiment of the present invention also provides a kind of terminal device, including processor 410, and memory 409 is stored in On memory 409 and the computer program that can run on the processor 410, the computer program are executed by processor 410 Each process of the above-mentioned object search embodiment of the method for Shi Shixian, and identical technical effect can be reached, to avoid repeating, here It repeats no more.
The embodiment of the present invention also provides a kind of computer readable storage medium, and meter is stored on computer readable storage medium Calculation machine program, the computer program realize each process of above-mentioned object search embodiment of the method, and energy when being executed by processor Reach identical technical effect, to avoid repeating, which is not described herein again.Wherein, the computer readable storage medium, such as only Read memory (Read-Only Memory, abbreviation ROM), random access memory (Random Access Memory, abbreviation RAM), magnetic or disk etc..
It should be noted that, in this document, the terms "include", "comprise" or its any other variant are intended to non-row His property includes, so that the process, method, article or the device that include a series of elements not only include those elements, and And further include other elements that are not explicitly listed, or further include for this process, method, article or device institute it is intrinsic Element.In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that including being somebody's turn to do There is also other identical elements in the process, method of element, article or device.
Through the above description of the embodiments, those skilled in the art can be understood that above-described embodiment side Method can be realized by means of software and necessary general hardware platform, naturally it is also possible to by hardware, but in many cases The former is more preferably embodiment.Based on this understanding, technical solution of the present invention substantially in other words does the prior art The part contributed out can be embodied in the form of software products, which is stored in a storage medium In (such as ROM/RAM, magnetic disk, CD), including some instructions are used so that a terminal (can be mobile phone, computer, service Device, air conditioner or network equipment etc.) execute method described in each embodiment of the present invention.
The embodiment of the present invention is described with above attached drawing, but the invention is not limited to above-mentioned specific Embodiment, the above mentioned embodiment is only schematical, rather than restrictive, those skilled in the art Under the inspiration of the present invention, without breaking away from the scope protected by the purposes and claims of the present invention, it can also make very much Form belongs within protection of the invention.

Claims (14)

1. a kind of object search method, applied to the terminal device including TOF camera, which is characterized in that the described method includes:
The depth information of the target object in angular field of view is acquired by TOF camera;
In the case where the target object belongs to preset object set, based on the depth information of the target object, obtain The 3D model of the target object;
Show the 3D model of the target object;
The first input of receiving terminal apparatus user;
In response to first input, the distance prompt information of the target object is exported, the distance prompt information is for mentioning Show the real-time range between the target object and the terminal user.
2. the method according to claim 1, wherein described acquired in default angular field of view by TOF camera Target object depth information before, the method also includes:
Receive the object information of the object to be searched of terminal user's input;
The object information is stored into object set;
It is described in the case where the target object belongs to preset object set, based on the depth information of the object, obtain The 3D model of the target object, comprising:
In the case that at least one object information in the object information of the target object and the object set matches, Based on the depth information of the object, the 3D model of the target object is obtained.
3. according to the method described in claim 2, it is characterized in that, the object information includes at least one of the following: object name Claim, characteristics of objects;
In the case where the object information includes characteristics of objects, the characteristics of objects includes object type, in object size At least one of;
Wherein, the corresponding at least one object model of same target type.
4. the method according to claim 1, wherein described acquired in default angular field of view by TOF camera Target object depth information after, the method also includes:
In the case where the target object belongs to preset object set, the depth information of the target object is stored.
5. the method according to claim 1, wherein the depth information based on the target object, obtains The 3D model of the target object, comprising:
Based on the depth information of the target object, the 3D model of the target object is constructed;
Alternatively, the depth information of the target object is uploaded to server, obtain that the server sends based on the mesh Mark the 3D model of the depth information building of object.
6. the method according to claim 1, wherein the distance prompt information of the output target object, Include:
During being gradually reduced at a distance from the terminal device is between the target object, voice prompting letter is played in real time Breath is until the distance between the terminal device and the target object are less than preset threshold;
Wherein, the speech prompt information is the information for prompting the terminal user Yu the target object distance.
7. a kind of terminal device, including TOF camera, which is characterized in that the terminal device further include:
Acquisition module, for acquiring the depth information of the target object in angular field of view by the TOF camera;
Module is obtained, in the case where the target object belongs to preset object set, based on the target object Depth information obtains the 3D model of the target object;
Display module, for showing the 3D model of the target object;
First receiving module, the first input for receiving terminal apparatus user;
Prompt output module, for exporting the distance prompt information of the target object in response to first input, it is described away from It is used to prompt the real-time range between the target object and the terminal user from prompt information.
8. terminal device according to claim 7, which is characterized in that the terminal device further include:
Second receiving module, for acquiring the target preset in angular field of view by the TOF camera in the acquisition module Before the depth information of object, the object information of the object to be searched of terminal user's input is received;
First memory module, for storing the object information into object set;
The acquisition module is specifically used for: at least one of the object information of the target object and the object set pair In the case that image information matches, based on the depth information of the object, the 3D model of the target object is obtained.
9. terminal device according to claim 8, which is characterized in that the object information includes at least one of the following: pair As title, characteristics of objects;
In the case where the object information includes characteristics of objects, the characteristics of objects includes object type, in object size At least one of;
Wherein, the corresponding at least one object model of same target type.
10. terminal device according to claim 7, which is characterized in that the terminal device further include:
Second memory module, for acquiring the target preset in angular field of view by the TOF camera in the acquisition module After the depth information of object, in the case where the target object belongs to preset object set, the target object is stored Depth information.
11. terminal device according to claim 7, which is characterized in that the acquisition module includes:
First submodule constructs the 3D model of the target object for the depth information based on the target object;Alternatively,
Second submodule obtains what the server was sent for the depth information of the target object to be uploaded to server The 3D model of depth information building based on the target object.
12. terminal device according to claim 7, which is characterized in that the prompt output module is specifically used for:
During being gradually reduced at a distance from the terminal device is between the target object, voice prompting letter is played in real time Breath is until the distance between the terminal device and the target object are less than preset threshold;
Wherein, the speech prompt information is the information for prompting the terminal user Yu the target object distance.
13. a kind of terminal device, which is characterized in that including processor, memory and be stored on the memory and can be in institute The computer program run on processor is stated, such as claim 1 to 6 is realized when the computer program is executed by the processor Any one of described in object search method the step of.
14. a kind of computer readable storage medium, which is characterized in that store computer journey on the computer readable storage medium Sequence is realized when the computer program is executed by processor such as object search method described in any one of claims 1 to 6 Step.
CN201811204693.0A 2018-10-16 2018-10-16 Object searching method and terminal equipment Active CN109472825B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811204693.0A CN109472825B (en) 2018-10-16 2018-10-16 Object searching method and terminal equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811204693.0A CN109472825B (en) 2018-10-16 2018-10-16 Object searching method and terminal equipment

Publications (2)

Publication Number Publication Date
CN109472825A true CN109472825A (en) 2019-03-15
CN109472825B CN109472825B (en) 2021-06-25

Family

ID=65664690

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811204693.0A Active CN109472825B (en) 2018-10-16 2018-10-16 Object searching method and terminal equipment

Country Status (1)

Country Link
CN (1) CN109472825B (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112413827A (en) * 2020-11-23 2021-02-26 珠海格力电器股份有限公司 Intelligent air conditioner and information display method and device thereof
CN112911358A (en) * 2021-01-12 2021-06-04 海信视像科技股份有限公司 Laser television and human eye protection method based on laser television
CN113341737A (en) * 2021-05-18 2021-09-03 珠海格力电器股份有限公司 Control method, system, device, equipment and storage medium of intelligent household equipment

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6771808B1 (en) * 2000-12-15 2004-08-03 Cognex Corporation System and method for registering patterns transformed in six degrees of freedom using machine vision
JP2008275366A (en) * 2007-04-26 2008-11-13 Tokyo Institute Of Technology Stereoscopic 3-d measurement system
CN102236520A (en) * 2010-05-06 2011-11-09 Lg电子株式会社 Mobile terminal and image display method therein
JP2014027355A (en) * 2012-07-24 2014-02-06 Casio Comput Co Ltd Object retrieval device, method, and program which use plural images
CN104599314A (en) * 2014-06-12 2015-05-06 深圳奥比中光科技有限公司 Three-dimensional model reconstruction method and system
JP2015105899A (en) * 2013-12-02 2015-06-08 シャープ株式会社 Three-dimension measuring device
JP2016181181A (en) * 2015-03-24 2016-10-13 キヤノン株式会社 Image processing apparatus, image processing method, and program
CN107463659A (en) * 2017-07-31 2017-12-12 广东欧珀移动通信有限公司 Object search method and its device
CN107466404A (en) * 2017-05-11 2017-12-12 深圳前海达闼云端智能科技有限公司 Articles search method, apparatus and robot
CN108052992A (en) * 2017-11-22 2018-05-18 同济大学 A kind of Intelligent indoor is looked for something storage system

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6771808B1 (en) * 2000-12-15 2004-08-03 Cognex Corporation System and method for registering patterns transformed in six degrees of freedom using machine vision
JP2008275366A (en) * 2007-04-26 2008-11-13 Tokyo Institute Of Technology Stereoscopic 3-d measurement system
CN102236520A (en) * 2010-05-06 2011-11-09 Lg电子株式会社 Mobile terminal and image display method therein
JP2014027355A (en) * 2012-07-24 2014-02-06 Casio Comput Co Ltd Object retrieval device, method, and program which use plural images
JP2015105899A (en) * 2013-12-02 2015-06-08 シャープ株式会社 Three-dimension measuring device
CN104599314A (en) * 2014-06-12 2015-05-06 深圳奥比中光科技有限公司 Three-dimensional model reconstruction method and system
JP2016181181A (en) * 2015-03-24 2016-10-13 キヤノン株式会社 Image processing apparatus, image processing method, and program
CN107466404A (en) * 2017-05-11 2017-12-12 深圳前海达闼云端智能科技有限公司 Articles search method, apparatus and robot
CN107463659A (en) * 2017-07-31 2017-12-12 广东欧珀移动通信有限公司 Object search method and its device
CN108052992A (en) * 2017-11-22 2018-05-18 同济大学 A kind of Intelligent indoor is looked for something storage system

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112413827A (en) * 2020-11-23 2021-02-26 珠海格力电器股份有限公司 Intelligent air conditioner and information display method and device thereof
CN112911358A (en) * 2021-01-12 2021-06-04 海信视像科技股份有限公司 Laser television and human eye protection method based on laser television
CN113341737A (en) * 2021-05-18 2021-09-03 珠海格力电器股份有限公司 Control method, system, device, equipment and storage medium of intelligent household equipment
CN113341737B (en) * 2021-05-18 2023-11-10 珠海格力电器股份有限公司 Control method, system, device, equipment and storage medium of intelligent household equipment

Also Published As

Publication number Publication date
CN109472825B (en) 2021-06-25

Similar Documents

Publication Publication Date Title
CN109151180A (en) A kind of object identifying method and mobile terminal
CN107592459A (en) A kind of photographic method and mobile terminal
CN109409244A (en) A kind of object puts the output method and mobile terminal of scheme
CN109582475A (en) A kind of sharing method and terminal
CN108897473A (en) A kind of interface display method and terminal
CN108833709A (en) A kind of the starting method and mobile terminal of camera
CN109062411A (en) A kind of screen luminance adjustment method and mobile terminal
CN110290469A (en) A kind of air navigation aid and mobile terminal
CN109189303A (en) Method for editing text and mobile terminal
CN109145731A (en) A kind of fingerprint identification method, device and mobile terminal
CN110209313A (en) Icon moving method and terminal device
CN108683850A (en) A kind of shooting reminding method and mobile terminal
CN110457086A (en) A kind of control method of application program, mobile terminal and server
CN110096203A (en) A kind of screenshot method and mobile terminal
CN110519512A (en) A kind of object processing method and terminal
CN109388456A (en) A kind of head portrait selection method and mobile terminal
CN107835495A (en) A kind of message prompt method, device and mobile terminal
CN110018805A (en) A kind of display control method and mobile terminal
CN109472825A (en) A kind of object search method and terminal device
CN109033912A (en) A kind of recognition methods of identification code and mobile terminal
CN109451144A (en) A kind of message treatment method and terminal device
CN108600544A (en) A kind of Single-hand control method and terminal
CN109033913A (en) A kind of recognition methods of identification code and mobile terminal
CN110188252A (en) A kind of searching method and terminal
CN109982273A (en) A kind of information replying method and mobile terminal

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant