CN104156069A - Object picking method and device and user equipment - Google Patents
Object picking method and device and user equipment Download PDFInfo
- Publication number
- CN104156069A CN104156069A CN201410401461.XA CN201410401461A CN104156069A CN 104156069 A CN104156069 A CN 104156069A CN 201410401461 A CN201410401461 A CN 201410401461A CN 104156069 A CN104156069 A CN 104156069A
- Authority
- CN
- China
- Prior art keywords
- image
- information
- mirror
- eyes
- user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Landscapes
- Image Analysis (AREA)
Abstract
The embodiment of the invention discloses an object picking method and device. The method comprises the steps that at least one image including at least one image area is acquired, wherein the at least one image area corresponds to a user through at least one target object watched through a mirror; the first position information of the point of regard of the user relative to the mirror is acquired; the at least one image area in the at least one image is determined according to the first position information and the second position information of one collecting position of the at least one image relative to the mirror; the at least one image is analyzed to determine at least one target object corresponding to the at least one image area. According to the technical scheme, the reflection direction of the sight line of the user, which is reflected by the mirror, is tracked, the image of the reflection direction is acquired, the target object which draws attention to the user through the mirror is picked, and the object picking method and device are particularly suitable for picking interested target objects conveniently in occasions where the user needs to use the mirror to watch the objects.
Description
Technical field
The application relates to human-computer interaction technique field, relates in particular to a kind of acquiring object method and acquiring object device.
Background technology
Development along with technology, in order to obtain the information of interested destination object or to connect with described destination object, people can pick up described destination object in several ways, for example: by user's action, specify described destination object, for example,, with pointing to described destination object; Or, by sight line, follow the trail of the destination object of determining that eyes of user is being watched attentively; Or describe and determine described destination object etc. by voice.
Summary of the invention
The object that the embodiment of the present application is possible is: a kind of acquiring object technical scheme is provided.
First aspect, the application's a possible embodiment provides a kind of acquiring object method, comprising:
Obtain at least one image that comprises at least one image-region, wherein, at least one destination object that described at least one image-region is watched attentively by a mirror with a user is corresponding;
Obtain described user's blinkpunkt with respect to the primary importance information of described mirror;
According to a collection position of described primary importance information and described at least one image, with respect to the second place information of described mirror, determine the described at least one image-region in described at least one image;
Analyze described at least one destination object that described at least one image determines that described at least one image-region is corresponding.
Second aspect, the application's a possible embodiment provides a kind of acquiring object device, comprising:
Image collection module, for obtaining at least one image that comprises at least one image-region, wherein, at least one destination object that described at least one image-region is watched attentively by a mirror with a user is corresponding;
Position information acquisition module, for obtaining described user's blinkpunkt with respect to the primary importance information of described mirror;
Image-region determination module, for determining described at least one image-region of described at least one image with respect to the second place information of described mirror according to a collection position of described primary importance information and described at least one image;
Image processing module, described at least one destination object of determining that for analyzing described at least one image described at least one image-region is corresponding.
The third aspect, the application's a possible embodiment provides a kind of subscriber equipment, comprises above-mentioned acquiring object device.
At least one embodiment of the embodiment of the present application is by the reflection direction of track user sight line after a specularly reflected, and obtain at least one image of this reflection direction, pick up at least one destination object that user pays close attention to by described mirror, be particularly suitable for need to watching the occasion of at least one object to pick up easily the interested destination object of user with mirror user.
Accompanying drawing explanation
Fig. 1 is the process flow diagram of a kind of acquiring object method of the embodiment of the present application;
Fig. 2 is the structural representation block diagram of a kind of acquiring object device of the embodiment of the present application;
Fig. 3 a, 3b and 3c are the application scenarios schematic diagram of three kinds of acquiring object devices of the embodiment of the present application;
Fig. 4 a is the structural representation block diagram of the another kind of acquiring object device of the embodiment of the present application;
Fig. 4 b is the structural representation block diagram of first information acquiring unit of a kind of acquiring object device of the embodiment of the present application;
Fig. 4 c is the structural representation block diagram of position information acquisition module of a kind of acquiring object device of the embodiment of the present application;
Fig. 4 d is the structural representation block diagram of the second information acquisition unit of a kind of acquiring object device of the embodiment of the present application;
Fig. 5 is the structural representation block diagram of another acquiring object device of the embodiment of the present application;
Fig. 6 is the structural representation block diagram of a kind of subscriber equipment of the embodiment of the present application.
Embodiment
Below in conjunction with accompanying drawing (in some accompanying drawings, identical label represents identical element) and embodiment, the application's embodiment is described in further detail.Following examples are used for illustrating the application, but are not used for limiting the application's scope.
It will be understood by those skilled in the art that the terms such as " first " in the application, " second ", only for distinguishing different step, equipment or module etc., neither represent any particular technology implication, also do not represent the inevitable logical order between them.
As shown in Figure 1, the embodiment of the present application provides a kind of acquiring object method, comprising:
S110 obtains at least one image that comprises at least one image-region, and wherein, at least one destination object that described at least one image-region is watched attentively by a mirror with a user is corresponding;
S120 obtains described user's blinkpunkt with respect to the primary importance information of described mirror;
S130 determines the described at least one image-region in described image according to a collection position of described primary importance information and described at least one image with respect to the second place information of described mirror;
S140 analyzes described at least one image and determines described at least one destination object that described at least one image-region is corresponding.
In the embodiment of the present application, described mirror is to have a reflecting surface, can by described reflecting surface, watch the object of a destination object attentively for user, the catoptron of shapes such as conventional plane, convex surface or concave surface, glass, the water surface etc., the catoptron of mainly take below describes as example.
For instance, acquiring object device provided by the invention, as the executive agent of the present embodiment, is carried out S110～S140.Particularly, described acquiring object device can be arranged in subscriber equipment in the mode of software, hardware or software and hardware combining.
The embodiment of the present application is by the reflection direction of track user sight line after a specularly reflected, and obtain at least one image of this reflection direction, pick up at least one destination object that user pays close attention to by described mirror, be particularly suitable for need to watching the occasion of at least one object to pick up easily the interested destination object of user with mirror user.
By embodiment below, further illustrate each step of the embodiment of the present application method:
S110 obtains at least one image that comprises at least one image-region.
In the embodiment of the present application, the corresponding region of the picture that described at least one image-region is described at least one destination object on described at least one image.
In a kind of possible embodiment of the embodiment of the present application, described step S110 comprises:
At described mirror rear side, obtain described at least one image.
In a kind of possible embodiment of the embodiment of the present application, described mirror can be a single plane fluoroscopy mirror, its front side towards described user and described at least one destination object is reflection side, and the rear side contrary with described front side is transmissive side, by an image acquisition device, at the described rear side of described mirror, towards described front side, obtain described at least one image.
Certainly, in the another kind of possible embodiment of the embodiment of the present application, can also in described mirror side, obtain described at least one image by alternate manner.For example: described mirror is provided with at least one hole, the image collecting device that is arranged on described mirror rear side can obtain described at least one image by described hole.
In another possible embodiment, when the reflecting surface of the described mirror liquid such as be water, can also obtain described at least one image at described liquid internal, for example, by one, camera or video camera obtain the image of the described at least one destination object on the water surface under water.Certainly, in the present embodiment, when determining described at least one image-region, need to consider the refractive index of water.
S120 obtains described user's blinkpunkt with respect to the primary importance information of described mirror.
In a kind of possible embodiment of the embodiment of the present application, described step S120 comprises:
Two eyes that obtain described user are two direction of visual lines with respect to described mirror with respect to the 3rd positional information of described mirror and the sight line of described two eyes;
According to described the 3rd positional information and described two direction of visual lines, determine described primary importance information.
As shown in Figure 3 a, in the embodiment of the present application, the sight line E1 that described blinkpunkt F is described two eyes and the intersection point of sight line E2.
In a kind of possible embodiment, described at least one image also comprises described user's two eye image regions corresponding to described two eyes;
Obtaining described the 3rd positional information comprises: at least according to the 3rd positional information described in described at least one Image Acquisition.
In the present embodiment, position by eye image region corresponding to described eyes on described at least one image and size can obtain described eyes with respect to the positional information of the image capture position of described at least one image, according to the second place information between described image capture position and described mirror, can obtain described the 3rd positional information again.
In one case, distance between described image capture position and mirror can be ignored to described eyes with to the distance of described at least one destination object substantially with respect to described mirror, now, can using described eyes with respect to the positional information of the image capture position of described at least one image as described the 3rd positional information.
In the present embodiment, described in, obtaining described two direction of visual lines comprises: according to two direction of visual lines described in described at least one Image Acquisition.
For example, can according to eyes in described at least one image towards and the position of pupil in described eyes determine described direction of visual lines.
Certainly, those skilled in the art can know, in other possible embodiment, except by the 3rd positional information described in described at least one Image Acquisition and described direction of visual lines, can also obtain described the 3rd positional information and described direction of visual lines according to alternate manner.For example: in a kind of possible embodiment, can also obtain described positional information by a position transducer that is arranged on described mirror side.Or, can also determine described the 3rd positional information by being arranged on the position transducer of user's side.Again for example, can obtain described direction of visual lines by other sight line follow-up mechanism.
In another possible embodiment of the embodiment of the present application, obtain described primary importance information and comprise:
Eyes that obtain described user are the direction of visual lines with respect to described mirror with respect to the 4th positional information of described mirror and the sight line of described eyes;
Determine the degree of depth of watching attentively of described eyes;
According to described the 4th positional information, described direction of visual lines and described in watch primary importance information described in Depth determination attentively.
In the present embodiment, not that the intersection point by two an eye line obtains described primary importance information, but direction of visual lines by eyes and watch the degree of depth attentively and obtain described primary importance information.
In a kind of possible embodiment, described at least one image also comprises described user's an eyes image-region corresponding to described eyes;
Obtaining described the 4th positional information comprises: at least according to the 4th positional information described in described at least one Image Acquisition; And/or
Obtaining described direction of visual lines comprises: according to direction of visual lines described in described at least one Image Acquisition.
In the embodiment of the present application, mode and the above-mentioned mode of obtaining described the 3rd positional information and described two direction of visual lines of obtaining described the 4th positional information and described direction of visual lines are basic identical, repeat no more here.
In the present embodiment, obtain watching the degree of depth attentively and can watching the degree of depth attentively described in determining by detecting the optical parametric of eyes of user optical system when watching described at least one destination object of described eyes.For example, in a kind of possible embodiment, can take by the eyeground to user, the parameter of filming apparatus is determined the degree of depth of user's blinkpunkt when obtaining an eyeground picture rich in detail.
S130 determines the described at least one image-region in described at least one image according to a collection position of described primary importance information and described at least one image with respect to the second place information of described mirror.
In the embodiment of the present application, according to described primary importance information and described second place information exchange, cross to calculate for how much and just can obtain described at least one destination object with respect to the 5th positional information of described collection position, according to the 5th positional information, just can obtain the position of described at least one destination object in described at least one image, and then determine described at least one image-region.
S140 analyzes described at least one image and determines described at least one destination object that described at least one image-region is corresponding.
In the embodiment of the present application, after having determined described at least one image-region, by analyzing and processing such as image recognitions, can determine described at least one destination object.
In a kind of possible embodiment of the embodiment of the present application, after having determined described at least one destination object, described method also comprises:
Obtain at least one relevant information of described at least one destination object.
In the embodiment of the present application, described at least one relevant information comprises following at least one:
Attribute information, link information and the communication information.
Certainly, those skilled in the art can know, except three kinds of relevant informations recited above, other possible relevant information also may be used, and will not enumerate here.
In a kind of possible application scenarios, described mirror is the rearview mirror of vehicles, the rearview mirror of automobile both sides for example, by above-mentioned embodiment, determined after the destination object at the rear that described user watches attentively by described rearview mirror, for example, can obtain the attribute information of described destination object, for example: described destination object is another automobile, described attribute information can be the brand of described another automobile, vehicle, price etc., or can also be the information such as license plate number of described another automobile.
In the possible application scenarios of another kind, described mirror can be for example the rearview mirror in a bus, and driver can determine a passenger by above-mentioned embodiment, then obtains described passenger's the communication information, communicates with described passenger.
Can find out, the embodiment of the embodiment of the present application is inconvenient to turn one's head user, need to watch by a mirror occasion of object attentively, can help easily user to pick up interested destination object.
It will be appreciated by those skilled in the art that, in the said method of the application's embodiment, the sequence number size of each step does not also mean that the priority of execution sequence, the execution sequence of each step should be definite with its function and internal logic, and should not form any restriction to the implementation process of the application's embodiment.
As shown in Figure 2, a kind of possible embodiment of the embodiment of the present application provides a kind of acquiring object device 200, comprising:
Image collection module 210, for obtaining at least one image that comprises at least one image-region, wherein, at least one destination object that described at least one image-region is watched attentively by a mirror with a user is corresponding;
Position information acquisition module 220, for obtaining described user's blinkpunkt with respect to the primary importance information of described mirror;
Image-region determination module 230, for determining described at least one image-region of described at least one image with respect to the second place information of described mirror according to a collection position of described primary importance information and described at least one image;
Image processing module 240, described at least one destination object of determining that for analyzing described at least one image described at least one image-region is corresponding.
The embodiment of the present application is by the reflection direction of track user sight line after a specularly reflected, and obtain at least one image of this reflection direction, pick up at least one destination object that user pays close attention to by described mirror, be particularly suitable for need to watching the occasion of at least one object to pick up easily the interested destination object of user with mirror user.
By embodiment below, further illustrate each module of the embodiment of the present application device.
In the embodiment of the present application, the corresponding region of the picture that described at least one image-region is described at least one destination object on described at least one image.
In a kind of possible embodiment of the embodiment of the present application, described image collection module 210 is arranged on described mirror rear side.
In a kind of possible embodiment of the embodiment of the present application, described mirror can be a single plane fluoroscopy mirror, its front side towards described user and described at least one destination object is reflection side, and the rear side contrary with described front side is transmissive side, by described image collection module 210, at the described rear side of described mirror, towards described front side, obtain described at least one image.
Certainly, in the another kind of possible embodiment of the embodiment of the present application, can also in described mirror side, obtain described at least one image by alternate manner.For example: described mirror is provided with at least one hole, the image collecting device that is arranged on described mirror rear side can obtain described at least one image by described hole.
In another possible embodiment, when the reflecting surface of the described mirror liquid such as be water, can also obtain described at least one image at described liquid internal, for example, by one, camera or video camera obtain the image of the described at least one destination object on the water surface under water.Certainly, in the present embodiment, when determining described at least one image-region, need to consider the refractive index of water.
As shown in Fig. 4 a, in a kind of possible embodiment of the embodiment of the present application, described position information acquisition module 220 comprises:
First information acquiring unit 221, for obtain two eyes of described user with respect to the 3rd positional information of described mirror and the sight line of described two eyes two direction of visual lines with respect to described mirror;
Primary importance information determining unit 222, for determining described primary importance information according to described the 3rd positional information and described two direction of visual lines.
As shown in Figure 4 b, in a kind of possible embodiment of the embodiment of the present application, described at least one image also comprises described user's two eye image regions corresponding to described two eyes;
Described first information acquiring unit 221 comprises:
The first information obtains subelement 2211, at least according to the 3rd positional information described in described at least one Image Acquisition; With
The first direction of visual lines obtains subelement 2212, for according to two direction of visual lines described in described at least one Image Acquisition.
In the present embodiment, the described first information obtain subelement 2211 can be by eye image region corresponding to described eyes the position on described at least one image and size obtain described eyes with respect to the positional information of described image collection module 210, according to the second place information between described image capture position and described mirror, can obtain described the 3rd positional information again.
In one case, distance between described image collection module 210 and mirror can be ignored to described eyes with to the distance of described at least one destination object substantially with respect to described mirror, now, can using described eyes with respect to the positional information of described image collection module 210 as described the 3rd positional information.
In the present embodiment, described the first direction of visual lines obtains subelement 2212, for example, can according to eyes in described at least one image towards and the position of pupil in described eyes determine described direction of visual lines.
Certainly, those skilled in the art can know, described first information acquiring unit 221 can also be other possible structure, for example, may comprise a position transducer, is used for obtaining described the 3rd positional information.Again, for example, also may comprise a sight line follow-up mechanism, be used for obtaining described direction of visual lines.
As shown in Figure 3 a, in a kind of possible embodiment of the embodiment of the present application, described mirror 310 is direct transmission mirror, and it is reflection side 311 towards described user's described eyes 320 and a side of described at least one destination object 330, and a side contrary with described reflection side is transmissive side 312;
Described image collection module 210 is arranged on the transmissive side 312 of described mirror 310.
Described user can see described at least one destination object 330 by the reflection of described reflection side 311, described image collection module 210 can see through the transmission of described mirror 310 transmissive side 312, collects the described at least one image that comprises described at least one image-region.
Two eyes 320 of described user respectively two sight line E1, E2 of correspondence intersect at an intersection point F place after the reflection of described mirror 310.Those skilled in the art can know, the position of intersection point F is corresponding to the position of described at least one destination object 330.
In the embodiment of the present application, described image collection module 210 can be a wide angle picture harvester, comprises described eyes 320 and described at least one destination object described eye image region and described at least one image-region of correspondence respectively in the described at least one image collecting.
Certainly, in other possible embodiment of the embodiment of the present application, described mirror can need not be direct transmission mirror, on described mirror, for example can have at least one hole, and described image collection module 210 for example can see through described hole and obtain described at least one image.
As shown in Fig. 4 c, described position information acquisition module 220 comprises:
The second information acquisition unit 223, for obtain described user's eyes with respect to the 4th positional information of described mirror and the sight line of described eyes the direction of visual lines with respect to described mirror;
Watch Depth determination unit 224 attentively, for determining the degree of depth of watching attentively of described eyes;
Second place information determining unit 225, for according to described the 4th positional information, described direction of visual lines and described in watch primary importance information described in Depth determination attentively.
As shown in Fig. 4 d, in a kind of possible embodiment, described at least one image also comprises described user's an eyes image-region corresponding to described eyes;
Described the second information acquisition unit 223 comprises:
The second acquisition of information subelement 2231, at least according to the 4th positional information described in described at least one Image Acquisition;
The second direction of visual lines obtains subelement 2232, for according to direction of visual lines described in described at least one Image Acquisition.
Wherein, described the second acquisition of information subelement 2231 obtains the mode of described the 4th positional information and the described first information and obtains subelement 2211 to obtain the mode of described the 3rd positional information basic identical; Described the second direction of visual lines obtains subelement 2232 and obtains described direction of visual lines and described the first direction of visual lines and obtain subelement 2212 to obtain the mode of described two direction of visual lines basic identical, repeats no more here.
In the present embodiment, described in, watch Depth determination unit 224 attentively and can watch the degree of depth attentively described in determining by detecting the optical parametric of eyes of user optical system when watching described at least one destination object.For example, in a kind of possible embodiment, described in watch Depth determination unit 224 attentively and can take by the eyeground to user, the parameter of filming apparatus is determined the degree of depth of user's blinkpunkt when obtaining an eyeground picture rich in detail.
As shown in Figure 3 b, described image collection module 210 comprises along described mirror 310 a plurality of image acquisition units 211 arranged apart in the embodiment of the present application, for obtaining the described at least one image that comprises described eye image region and described at least one image-region.
In present embodiment, after having obtained described the 4th position and described direction of visual lines by described the second information acquisition unit 223, incident angle and the distance A O from eyes to described reflection spot O of reflection spot O, the described sight line E of the sight line E that can obtain described eyes 320 on described mirror 310, therefore can obtain the reflection direction of described sight line E after described mirror 310 reflections.
In the present embodiment, by described watch that Depth determination unit 224 obtained described eyes 320 attentively watch degree of depth AB attentively.
Described second place information determining unit 225 deducts distance A O and just can obtain reflecting the length OF of retracement line E by watching degree of depth AB attentively, therefore can determine that the blinkpunkt F of described eyes is with respect to the primary importance information of described mirror 310.
In the embodiment of the present application, described image-region determination module 230 is crossed to calculate for how much according to described primary importance information and described second place information exchange and just can be obtained described at least one destination object with respect to the 5th positional information of described collection position, according to the 5th positional information, just can obtain the position of described at least one destination object in described at least one image, and then determine described at least one image-region.
As shown in Figure 3 c, in the possible embodiment of another kind, described mirror is the surface 341 of water 340, and described image collection module 210 is positioned at the inside of described water 340, now described image-region determination module 230, when determining described at least one image-region, also needs to consider the refractive index of water.
In the embodiment of the present application, after having determined described at least one image-region, described image processing module 240, by analyzing and processing such as image recognitions, can be determined described at least one destination object.
As shown in Fig. 4 a, in a kind of possible embodiment, described device 200 also comprises:
Relevant information acquisition module 250, for obtaining at least one relevant information of described at least one destination object.
In a kind of possible embodiment, described relevant information acquisition module 250 is further used for, and obtains at least one in following information:
The attribute information of described at least one destination object, link information and the communication information.
The description of obtaining corresponding relevant information at different application scenarioss referring to said method embodiment in corresponding description, repeat no more here.
The structural representation of another acquiring object device 500 that Fig. 5 provides for the embodiment of the present application, the application's specific embodiment does not limit the specific implementation of acquiring object device 500.As shown in Figure 5, this acquiring object device 500 can comprise:
Processor (processor) 510, communication interface (Communications Interface) 520, storer (memory) 530 and communication bus 540.Wherein:
Processor 510, communication interface 520 and storer 530 complete mutual communication by communication bus 540.
Communication interface 520, for the net element communication with such as client etc.
Processor 510, for executive routine 532, specifically can carry out the correlation step in said method embodiment.
Particularly, program 532 can comprise program code, and described program code comprises computer-managed instruction.
Processor 510 may be a central processor CPU, or specific integrated circuit ASIC (Application Specific Integrated Circuit), or is configured to implement one or more integrated circuit of the embodiment of the present application.
Storer 530, for depositing program 532.Storer 530 may comprise high-speed RAM storer, also may also comprise nonvolatile memory (non-volatile memory), for example at least one magnetic disk memory.Program 532 specifically can be for making described acquiring object device 500 carry out following steps:
Obtain at least one image that comprises at least one image-region, wherein, at least one destination object that described at least one image-region is watched attentively by a mirror with a user is corresponding;
Obtain described user's blinkpunkt with respect to the primary importance information of described mirror;
According to a collection position of described primary importance information and described at least one image, with respect to the second place information of described mirror, determine the described at least one image-region in described at least one image;
Analyze described at least one destination object that described at least one image determines that described at least one image-region is corresponding.
In program 532, the specific implementation of each step can, referring to description corresponding in the corresponding steps in above-described embodiment and unit, be not repeated herein.Those skilled in the art can be well understood to, and for convenience and simplicity of description, the specific works process of the equipment of foregoing description and module, can describe with reference to the corresponding process in preceding method embodiment, does not repeat them here.
As shown in Figure 6, a kind of possible embodiment of the embodiment of the present application also provides a kind of subscriber equipment 600, comprises acquiring object device 610 recited above.
In a kind of possible embodiment, described subscriber equipment 600 can be the vehicles such as automobile, motorcycle, ships and light boats, aircraft, in other possible embodiment, described subscriber equipment 600 can also be user's portable equipment, such as having mobile phone, panel computer of minute surface etc.
Those of ordinary skills can recognize, unit and the method step of each example of describing in conjunction with embodiment disclosed herein, can realize with the combination of electronic hardware or computer software and electronic hardware.These functions are carried out with hardware or software mode actually, depend on application-specific and the design constraint of technical scheme.Professional and technical personnel can specifically should be used for realizing described function with distinct methods to each, but this realization should not thought and exceeds the application's scope.
If described function usings that the form of SFU software functional unit realizes and during as production marketing independently or use, can be stored in a computer read/write memory medium.Understanding based on such, the part that the application's technical scheme contributes to prior art in essence in other words or the part of this technical scheme can embody with the form of software product, this computer software product is stored in a storage medium, comprise that some instructions are with so that a computer equipment (can be personal computer, server, or the network equipment etc.) carry out all or part of step of method described in each embodiment of the application.And aforesaid storage medium comprises: USB flash disk, portable hard drive, ROM (read-only memory) (ROM, Read-Only Memory), the various media that can be program code stored such as random access memory (RAM, Random Access Memory), magnetic disc or CD.
Above embodiment is only for illustrating the application; and the not restriction to the application; the those of ordinary skill in relevant technologies field; in the situation that do not depart from the application's spirit and scope; can also make a variety of changes and modification; therefore all technical schemes that are equal to also belong to the application's category, and the application's scope of patent protection should be defined by the claims.
Claims (17)
1. an acquiring object method, is characterized in that, comprising:
Obtain at least one image that comprises at least one image-region, wherein, at least one destination object that described at least one image-region is watched attentively by a mirror with a user is corresponding;
Obtain described user's blinkpunkt with respect to the primary importance information of described mirror;
According to a collection position of described primary importance information and described at least one image, with respect to the second place information of described mirror, determine the described at least one image-region in described at least one image;
Analyze described at least one destination object that described at least one image determines that described at least one image-region is corresponding.
2. the method for claim 1, is characterized in that, obtains described primary importance information and comprises:
Two eyes that obtain described user are two direction of visual lines with respect to described mirror with respect to the 3rd positional information of described mirror and the sight line of described two eyes;
According to described the 3rd positional information and described two direction of visual lines, determine described primary importance information.
3. method as claimed in claim 2, is characterized in that, described at least one image also comprises described user's two eye image regions corresponding to described two eyes;
Obtaining described the 3rd positional information comprises: at least according to the 3rd positional information described in described at least one Image Acquisition; And/or
Obtaining described two direction of visual lines comprises: according to two direction of visual lines described in described at least one Image Acquisition.
4. the method for claim 1, is characterized in that, obtains described primary importance information and comprises:
Eyes that obtain described user are the direction of visual lines with respect to described mirror with respect to the 4th positional information of described mirror and the sight line of described eyes;
Determine the degree of depth of watching attentively of described eyes;
According to described the 4th positional information, described direction of visual lines and described in watch primary importance information described in Depth determination attentively.
5. method as claimed in claim 4, is characterized in that, described at least one image also comprises described user's an eyes image-region corresponding to described eyes;
Obtaining described the 4th positional information comprises: at least according to the 4th positional information described in described at least one Image Acquisition; And/or
Obtaining described direction of visual lines comprises: according to direction of visual lines described in described at least one Image Acquisition.
6. the method for claim 1, is characterized in that, described in obtain described at least one image and comprise:
At described mirror rear side, obtain described at least one image.
7. the method for claim 1, is characterized in that, described method also comprises:
Obtain at least one relevant information of described at least one destination object.
8. method as claimed in claim 7, is characterized in that, described at least one relevant information comprises following at least one:
Attribute information, link information and the communication information.
9. an acquiring object device, is characterized in that, comprising:
Image collection module, for obtaining at least one image that comprises at least one image-region, wherein, at least one destination object that described at least one image-region is watched attentively by a mirror with a user is corresponding;
Position information acquisition module, for obtaining described user's blinkpunkt with respect to the primary importance information of described mirror;
Image-region determination module, for determining described at least one image-region of described at least one image with respect to the second place information of described mirror according to a collection position of described primary importance information and described at least one image;
Image processing module, described at least one destination object of determining that for analyzing described at least one image described at least one image-region is corresponding.
10. device as claimed in claim 9, is characterized in that, described position information acquisition module comprises:
First information acquiring unit, for obtain two eyes of described user with respect to the 3rd positional information of described mirror and the sight line of described two eyes two direction of visual lines with respect to described mirror;
Primary importance information determining unit, for determining described primary importance information according to described the 3rd positional information and described two direction of visual lines.
11. devices as claimed in claim 10, is characterized in that, described at least one image also comprises described user's two eye image regions corresponding to described two eyes;
Described first information acquiring unit comprises:
The first information obtains subelement, at least according to the 3rd positional information described in described at least one Image Acquisition; And/or
The first direction of visual lines obtains subelement, for according to two direction of visual lines described in described at least one Image Acquisition.
12. devices as claimed in claim 9, is characterized in that, described position information acquisition module comprises:
The second information acquisition unit, for obtain described user's eyes with respect to the 4th positional information of described mirror and the sight line of described eyes the direction of visual lines with respect to described mirror;
Watch Depth determination unit attentively, for determining the degree of depth of watching attentively of described eyes;
Second place information determining unit, for according to described the 4th positional information, described direction of visual lines and described in watch primary importance information described in Depth determination attentively.
13. devices as claimed in claim 12, is characterized in that, described at least one image also comprises described user's an eyes image-region corresponding to described eyes;
Described the second information acquisition unit comprises:
The second acquisition of information subelement, at least according to the 4th positional information described in described at least one Image Acquisition; And/or
The second direction of visual lines obtains subelement, for according to direction of visual lines described in described at least one Image Acquisition.
14. devices as claimed in claim 9, is characterized in that, described image collection module is arranged on described mirror rear side.
15. devices as claimed in claim 9, is characterized in that, described device also comprises:
Relevant information acquisition module, for obtaining at least one relevant information of described at least one destination object.
16. devices as claimed in claim 15, is characterized in that, described relevant information acquisition module is further used for, and obtains at least one in following information:
The attribute information of described at least one destination object, link information and the communication information.
17. 1 kinds of subscriber equipmenies, is characterized in that, comprise the acquiring object device described in any one in claim 9-16.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410401461.XA CN104156069B (en) | 2014-08-15 | 2014-08-15 | Object picking method and device and user equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410401461.XA CN104156069B (en) | 2014-08-15 | 2014-08-15 | Object picking method and device and user equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104156069A true CN104156069A (en) | 2014-11-19 |
| CN104156069B CN104156069B (en) | 2017-04-12 |
Family
ID=51881588
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410401461.XA Active CN104156069B (en) | 2014-08-15 | 2014-08-15 | Object picking method and device and user equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104156069B (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106294911A (en) * | 2015-06-04 | 2017-01-04 | 北京智谷睿拓技术服务有限公司 | Information processing method, information processor and subscriber equipment |
| CN106296796A (en) * | 2015-06-04 | 2017-01-04 | 北京智谷睿拓技术服务有限公司 | Information processing method, information processor and subscriber equipment |
| CN109415016A (en) * | 2017-06-16 | 2019-03-01 | 京东方科技集团股份有限公司 | The method of the interactive control devices and control vehicle mirrors of view-based access control model |
| US10268265B2 (en) * | 2015-06-04 | 2019-04-23 | Beijing Zhigu Rui Tuo Tech Co., Ltd | Information processing method, information processing apparatus and user equipment |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH09218376A (en) * | 1996-02-09 | 1997-08-19 | Sharp Corp | Stereoscopic display device |
| US20070014552A1 (en) * | 2004-02-17 | 2007-01-18 | Yoshinobu Ebisawa | Eyeshot detection device using distance image sensor |
| CN103557859A (en) * | 2013-10-10 | 2014-02-05 | 北京智谷睿拓技术服务有限公司 | Image acquisition and positioning method and image acquisition and positioning system |
| CN103605199A (en) * | 2013-08-30 | 2014-02-26 | 北京智谷睿拓技术服务有限公司 | Imaging device and method |
| CN103604412A (en) * | 2013-10-30 | 2014-02-26 | 北京智谷睿拓技术服务有限公司 | Positioning method and positioning device |
| CN103630116A (en) * | 2013-10-10 | 2014-03-12 | 北京智谷睿拓技术服务有限公司 | Image acquiring and positioning method and image acquiring and positioning device |
-
2014
- 2014-08-15 CN CN201410401461.XA patent/CN104156069B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH09218376A (en) * | 1996-02-09 | 1997-08-19 | Sharp Corp | Stereoscopic display device |
| US20070014552A1 (en) * | 2004-02-17 | 2007-01-18 | Yoshinobu Ebisawa | Eyeshot detection device using distance image sensor |
| CN103605199A (en) * | 2013-08-30 | 2014-02-26 | 北京智谷睿拓技术服务有限公司 | Imaging device and method |
| CN103557859A (en) * | 2013-10-10 | 2014-02-05 | 北京智谷睿拓技术服务有限公司 | Image acquisition and positioning method and image acquisition and positioning system |
| CN103630116A (en) * | 2013-10-10 | 2014-03-12 | 北京智谷睿拓技术服务有限公司 | Image acquiring and positioning method and image acquiring and positioning device |
| CN103604412A (en) * | 2013-10-30 | 2014-02-26 | 北京智谷睿拓技术服务有限公司 | Positioning method and positioning device |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106294911A (en) * | 2015-06-04 | 2017-01-04 | 北京智谷睿拓技术服务有限公司 | Information processing method, information processor and subscriber equipment |
| CN106296796A (en) * | 2015-06-04 | 2017-01-04 | 北京智谷睿拓技术服务有限公司 | Information processing method, information processor and subscriber equipment |
| US20180188805A1 (en) * | 2015-06-04 | 2018-07-05 | Beijing Zhigu Rui Tuo Tech Co., Ltd | Information processing method, information processing apparatus and user equipment |
| US10268265B2 (en) * | 2015-06-04 | 2019-04-23 | Beijing Zhigu Rui Tuo Tech Co., Ltd | Information processing method, information processing apparatus and user equipment |
| CN106296796B (en) * | 2015-06-04 | 2019-08-13 | 北京智谷睿拓技术服务有限公司 | Information processing method, information processing unit and user equipment |
| CN106294911B (en) * | 2015-06-04 | 2019-09-10 | 北京智谷睿拓技术服务有限公司 | Information processing method, information processing unit and user equipment |
| US10474232B2 (en) * | 2015-06-04 | 2019-11-12 | Beijing Zhigu Rui Tuo Tech Co., Ltd | Information processing method, information processing apparatus and user equipment |
| CN109415016A (en) * | 2017-06-16 | 2019-03-01 | 京东方科技集团股份有限公司 | The method of the interactive control devices and control vehicle mirrors of view-based access control model |
| CN109415016B (en) * | 2017-06-16 | 2022-06-28 | 京东方科技集团股份有限公司 | Vision-based interactive control device and method for controlling vehicle rearview mirror |
| US11400862B2 (en) | 2017-06-16 | 2022-08-02 | Boe Technology Group Co., Ltd. | Vision-based interactive control apparatus and method of controlling rear-view mirror for vehicle |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104156069B (en) | 2017-04-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20210334767A1 (en) | Analyzing Images and Videos of Damaged Vehicles to Determine Damaged Vehicle Parts and Vehicle Asymmetries | |
| US9583032B2 (en) | Navigating content using a physical object | |
| EP3316080B1 (en) | Virtual reality interaction method, apparatus and system | |
| Fletcher et al. | Correlating driver gaze with the road scene for driver assistance systems | |
| US10394321B2 (en) | Information acquiring method, information acquiring apparatus, and user equipment | |
| CN104182043A (en) | Object picking-up method, object picking-up device and user equipment | |
| JP2022517254A (en) | Gaze area detection method, device, and electronic device | |
| CN109151204B (en) | Navigation method and device based on mobile terminal and mobile terminal | |
| EP3906527B1 (en) | Image bounding shape using 3d environment representation | |
| CN104156069A (en) | Object picking method and device and user equipment | |
| WO2013106128A1 (en) | Method and apparatus for enabling real-time product and vendor identification | |
| CN108351470A (en) | Optical communication connector, optic communication cable and electronic equipment | |
| Martin et al. | Real time driver body pose estimation for novel assistance systems | |
| CN108021902A (en) | Head pose recognition methods, head pose identification device and storage medium | |
| JP2022176081A (en) | Adaptive eye tracking machine learning model engine | |
| US10885704B1 (en) | 3D mapping by distinguishing between different environmental regions | |
| US9418617B1 (en) | Methods and systems for receiving input controls | |
| CN104199556A (en) | Information processing method and device | |
| CN111192329A (en) | Sensor calibration result verification method and device and storage medium | |
| WO2017176711A1 (en) | Vehicle recognition system using vehicle characteristics | |
| Shahid et al. | Eye-gaze and augmented reality framework for driver assistance | |
| CN115240150A (en) | Lane departure warning method, system, device and medium based on monocular camera | |
| KR20220058277A (en) | Method of stereo matching and image processing apparatus performing the same | |
| CN112232317A (en) | Target detection method and device, equipment and medium for target orientation recognition | |
| CN112829583A (en) | Method for displaying travel information, apparatus for displaying travel information, and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |