Embodiment
For the purpose, technical scheme and the advantage that make the utility model embodiment is clearer, below in conjunction with embodiment and accompanying drawing, embodiment is described in further details to the utility model.At this, illustrative examples of the present utility model and explanation thereof are used to explain the utility model, but not as to qualification of the present utility model.
The composition frame chart of a kind of multiple goal treating apparatus that Fig. 1 provides for the utility model embodiment, please refer to Fig. 1, this device comprises: image acquisition units 11, target judging unit 12, de-noising unit 13, multiple goal separative element 14 and coordinate generation unit 15, wherein:
Image acquisition units 11 is used to obtain with the luminophor consecutive image information of the telepilot of thing as a token of.
In the present embodiment, telepilot can be one or more.
In the present embodiment, this image acquisition units 11 can be a camera, to obtain the image of telepilot by the mode of taking, to obtain its consecutive image information.It can pass through existing any camera chip, and for example Mage-Sensor realizes.
Wherein, this telepilot is provided with luminophor as moving target, so that camera is known the movement locus of telepilot according to the movement locus of luminophor.This luminophor can be light emitting led that has special spectrum in order to emission, 850nm for example so that after camera catches image, the multiple goal treating apparatus of present embodiment can efficiency confirmed in view of the above target.In the present embodiment, this luminophor can be used to send infrared light, but present embodiment not with this as restriction.
Wherein, consecutive image information is meant the set of diagrams picture that camera photographs in the given time, for example takes 30 two field pictures in 1 second.
Target judging unit 12 is used for confirming a plurality of targets of every two field picture in the described consecutive image according to described consecutive image information, finds out moving target from these a plurality of targets, and calculate the center of gravity of each moving target respectively.
In the present embodiment, owing to may have a plurality of targets in the image that camera photographs, for example the target that the light that sends of the luminophor on telepilot forms, also may have other static or moving targets, the target that forms of the light that sends of sunlight, the light that fixing shot-light sends, the light lamp that rocks or the like light source for example, this target judging unit 12 is used for the consecutive image according to the camera shooting, judges the existence of each target.
According to an embodiment of present embodiment, this target judging unit 12 can comprise the clustering processing module, with according to described consecutive image information, the target with same characteristic features is merged, and obtains a plurality of targets of every two field picture in the described consecutive image.
Present embodiment carries out clustering processing in carrying out the target deterministic process, be in order to reduce the number of image object, on the one hand, the processing of too many target is taken a part of resource; On the other hand, having the different target of same characteristic features in the image may light source feedback just just itself.The consecutive image that present embodiment photographs camera by the clustering processing module carries out clustering algorithm to be handled, and the pixel fusion of identical characteristics is integral, and reduces the number of target in the image.Wherein, Jing Dian clustering algorithm has based on watershed divide and fuzzy C-means clustering, based on K-Means cluster or the like.
In the present embodiment, by clustering processing, the spot noise that will much loose is fused to together, the indirect purpose that has played de-noising, and therefore, this clustering processing module can also be removed large tracts of land interference noise or static background.
In the present embodiment, after the target of having determined to exist, can also judge that each target is static or motion, therefrom finds out moving target, and calculates the center of gravity of each moving target according to motion detection.
Wherein, motion detection can adopt classic algorithm, if promptly each pixel difference of consecutive frame is greater than a threshold value, and this pixel of present frame is in the smooth background after the de-noising, thinks that then this pixel is the motion pixel.In the present embodiment, owing to pass through clustering algorithm, be clustered into a plurality of targets in every two field picture, then motion detection is based on the consecutive frame target, rather than based on pixel.
De-noising unit 13 is used for a plurality of targets of the every two field picture of described consecutive image are carried out Filtering Processing, with efficiency confirmed target.
In the present embodiment, if image acquisition units 11 is to be used to gather with the luminophor image information of a plurality of telepilots of thing as a token of, then in the present embodiment, a plurality of effective targets can be confirmed in this de-noising unit 13.Wherein, corresponding telepilot of effective target.
In the present embodiment, when the camera collection image,, circuit, electromagnetism etc. can introduce various noises owing to disturbing, white Gaussian noise for example, be characterized in randomness and low light level epistasis, noise brings interference can for the processing multiple goal, so present embodiment carries out filtering by de-noising unit 13 according to the continuous multiple frames image information, select for use different Filtering Model to filter out corresponding noise.Wherein, de-noising unit 13 can adopt classical frame filter model, for example average value filtering, Gauss's low-pass filtering or the like, for example, in N successive frame, the barycentric coordinates of same target are p (i), the absolute value of adjacent barycentric coordinates difference is A (i), A (in)=| p (in)-p (in-1) |, if the mean square deviation of the A (i) of N frame is then thought Gaussian noise less than a threshold value.
Multiple goal separative element 14 is used for the barycentric coordinates according to the effective target of the every two field picture of described consecutive image, confirms the motion track of described effective target.
The multiple goal separative element 14 of present embodiment utilizes the barycentric coordinates of the continuous multiple frames image motion target that is write down, and judges the movement locus that a plurality of moving targets of current frame image are affiliated.Illustrate: two luminophor a, each autokinesis of b, every frame all can write down the barycentric coordinates A (n) of two moving targets, and B (n) then has two track TA (n) certainly, and TB (n), every frame can judge A (n) and belong to TA (n), and B (n) belongs to TB (n).
In the present embodiment, this multiple goal separative element 14 is to be used for coming automatic judgement should belong to which moving target according to track each moving object, also be, for each moving object, multiple goal separative element 14 can according to its separately track judge automatically it belongs to which known target.
In the present embodiment, because its movement locus of different target has nothing in common with each other, the multiple goal separative element 14 of present embodiment judges automatically according to the movement locus of each moving object which target is the barycentric coordinates of the effective target of present frame should belong to, for example, the i bar track T (n of present frame, i), its in present frame coordinates of motion predicted value Pre (n, i)=2*T (n-1, i)-T (n-2, i), if Pre (n, i) and the absolute value of the difference of the barycentric coordinates C (n) of certain target of present frame less than a threshold value, think that then this target belongs to i bar track, by that analogy, which track is all targets that can calculate present frame belong to.Wherein, the detection of movement locus can utilize speed, acceleration, perhaps utilize respectively the target center of gravity (X, motion vector Y) or the like it should be noted that, when target many more, the correctness that its movement locus detects is low more, because there is similar interference between each target trajectory, is head it off, can adopt the model of probability verification to detect correctness and carry out corresponding coupling, not repeat them here.
In the present embodiment, can also according to wide, the height of each target and area check once more above-mentioned judge whether correct.For example, at first utilizing optical flow method and Kalman filter model, is that estimation criterion is checked with Minimum Mean Square Error, comes verification with wide height and area then, because under the fixed-size situation of luminophor, it becomes the tall and big little threshold value of can setting for of image width to be limited at camera.It should be noted that, if the user moves forward and backward telepilot, its wide high surface that is reflected to the moving target on the image amasss and also can change, for addressing this problem, can adopt a plurality of cameras, calculate the distance of each target range screen and angle with the 3D method and wait and distinguish, do not repeat them here.
Coordinate generation unit 15 is used for the barycentric coordinates according to the effective target of the every two field picture of described consecutive image, calculates the screen display coordinate of described effective target, the motion track of the corresponding screen display coordinate of motion track of acquisition and described effective target.
In the present embodiment, this coordinate generation unit 15 be used to calculate each moving object at the screen display coordinate of present frame outputing to the screen of terminal, thereby control moving of a plurality of cursors on the screen respectively.For example, each moving target barycentric coordinates of supposing adjacent two frames are T (n), T (n-1), then the frame difference of present frame coordinate is d (n)=T (n)-T (n-1), receiving end can be noted the coordinate M (n) of previous frame screen mouse arrow, and then the displaing coordinate of present frame screen mouse arrow is M (n)+d (n).
According to an embodiment of present embodiment, this multiple goal treating apparatus can also comprise:
Output unit 16 is used for the screen display coordinate of described effective target is outputed to terminal, is shown by described terminal.
In the present embodiment, this output unit 16 can arrive end host with above-mentioned coordinates transmission by wired or wireless mode, thereby a plurality of cursors on the control terminal screen is mobile.
The multiple goal treating apparatus of present embodiment can be handled a plurality of moving targets, realizes the application that the multi-user operates simultaneously, and locatees quickly and accurately.
The composition frame chart of a kind of terminal that Fig. 2 provides for the utility model embodiment please refer to Fig. 2, and this terminal also comprises aforesaid multiple goal treating apparatus 22 and telepilot 23 except comprising terminal body 21, wherein:
Terminal body 21 is the composition of existing terminal, and the terminal here can be personal computer, Digital Television or simulated television, if for example terminal is a personal computer, then terminal body 21 is existing main frame and display; If terminal is a Digital Television, then terminal body 21 is existing digital television; If terminal is a simulated television, then terminal body 21 is existing set-top box and simulated television.
Multiple goal treating apparatus 22 has been done detailed description in the aforementioned embodiment, does not repeat them here.
Telepilot 23 is used for by luminophor to multiple goal treating apparatus 22 emission light, with by 22 pairs of multiple goal treating apparatus with the judgement and the processing of the motion track of the telepilot of thing as a token of of this luminophor, the moving of the cursor of control terminal body 21.
Wherein, telepilot 23 can be one or more.
According to an embodiment of present embodiment, this telepilot 23 mainly comprises:
Luminophor is used to launch light, is the consecutive image information of the described telepilot of mark so that described multiple goal treating apparatus obtains with this luminophor.
In the present embodiment, can control the whether luminous of this luminophor, so that send light signal according to control by illuminated switch.
In the present embodiment, this luminophor can be the infraluminescence body, sends the infrared light of special spectrum, present embodiment not with this as restriction, as long as the camera of multiple goal treating apparatus 22 can be caught the motion track information of this luminophor.
According to the another one embodiment of present embodiment, this telepilot 23 can also comprise:
Basal keystroke portion is used to send the key set code stream information of basal keystroke;
Wherein, the basal keystroke of this basal keystroke portion has comprised numerical key, function key, shortcut etc., and is identical with the function of the basal keystroke of existing telepilot in function, do not repeat them here.
Mousebutton portion is used to send the key set code stream information of mousebutton;
Wherein, the mousebutton of this mousebutton portion has comprised left mouse button, right mouse button, Mouse Scroll adjusting key etc., and its function also function with each button of existing mouse is identical, does not repeat them here.
At least one is wireless or infrared emission unit, is used for the key set code stream information of described basal keystroke and/or the key set code stream information of described mousebutton are sent to described multiple goal treating apparatus.
Wherein, the wireless or infrared emission unit here is to be used for the key set code stream information of basal keystroke portion and/or the key set code stream information of mousebutton portion are sent to multiple goal treating apparatus 22, therefore, an embodiment according to present embodiment, two wireless or infrared emission units can be set, with the key set code stream information that sends basal keystroke portion respectively and the key set code stream information of mousebutton portion; According to the another one embodiment of present embodiment, a wireless or infrared emission unit can only be set, with the key set code stream information of transmission basal keystroke portion and the key set code stream information of mousebutton portion.
The terminal of present embodiment can be personal computer, Digital Television or simulated television, comprise aforesaid terminal body 21, multiple goal treating apparatus 22 and telepilot 23, cooperation by telepilot 23 and multiple goal treating apparatus 22, broken through the restriction of traditional remote controller and conventional mouse, more convenient and quicker growing terminal and the business that provides thereof are controlled and used.
Fig. 3 please refer to Fig. 3 for a kind of terminal applies synoptic diagram that the utility model embodiment provides, and in should using, this terminal comprises: terminal body 31; The telepilot 33 of multiple goal treating apparatus 32 and two band luminophors, wherein:
Terminal body 31 represents that by a display screen in the present embodiment, this terminal body 31 can be the display of computing machine, the display screen of Digital Television, the perhaps display screen of simulated television.
Multiple goal treating apparatus 32 is by a box indicating, and in the present embodiment, this multiple goal treating apparatus 32 can be contained in the processing host of computing machine, the processing section of Digital Television, the perhaps set-top box of simulated television.
The telepilot 33 of two band luminophors can be the mouse type telepilot, has the function of mouse and telepilot concurrently.
In should using, the telepilot 33 of band luminophor sends infrared light, multiple goal treating apparatus 32 is caught the image of this telepilot 33 by camera, judge the existence of two moving targets, and after calculating separately coordinate respectively, be transferred to terminal body 31 by wired or wireless mode, thereby two cursors moves on the screen of control terminal body 31.
Present embodiment is to be that example is illustrated with two telepilots, but present embodiment not with this as restriction, for example the scheme of a telepilot or a plurality of telepilots can be applied to the utility model.
Present embodiment combines remote-controller function and mouse function are better, handle by multiple goal, promptly, utilize adjacent multiple image data to judge the center of gravity of moving target, judge movement locus under each moving target of present frame according to movement locus, and utilize probability model to test, make the air mouse scheme can judge and handle a plurality of moving targets, the application that practicable multi-user operates simultaneously, and locate quickly and accurately, and have following advantage:
1. not only can be used for seeing TV, video recording, VCD, DVD etc., can also be used for playing games, surf the Net, send e-mails, shopping online, online program request etc.
2. solved the limitation that user's operation can only be arranged when former mouse remote control device is worked, made and on PC or TV, can divide a plurality of zones that allow the multi-user operate respectively, for example picture-in-picture can have two users to change platform respectively on the TV.
3. having solved former mouse remote control device can only have a player's limitation in field of play, makes more actualization of recreation (especially shooting game).
The method of describing in conjunction with embodiment disclosed herein or the step of algorithm can directly use the software module of hardware, processor execution, and perhaps the combination of the two is implemented.Software module can place the storage medium of any other form known in random access memory (RAM), internal memory, ROM (read-only memory) (ROM), electrically programmable ROM, electrically erasable ROM, register, hard disk, moveable magnetic disc, CD-ROM or the technical field.
Above-described specific embodiment; the purpose of this utility model, technical scheme and beneficial effect are further described; institute is understood that; the above only is a specific embodiment of the utility model; and be not used in and limit protection domain of the present utility model; all within spirit of the present utility model and principle, any modification of being made, be equal to replacement, improvement etc., all should be included within the protection domain of the present utility model.