CN201845345U - Facial expression identifying data collecting system based on active vision - Google Patents
Facial expression identifying data collecting system based on active vision Download PDFInfo
- Publication number
- CN201845345U CN201845345U CN2010205645344U CN201020564534U CN201845345U CN 201845345 U CN201845345 U CN 201845345U CN 2010205645344 U CN2010205645344 U CN 2010205645344U CN 201020564534 U CN201020564534 U CN 201020564534U CN 201845345 U CN201845345 U CN 201845345U
- Authority
- CN
- China
- Prior art keywords
- camera
- steering wheel
- facial expression
- cloud terrace
- data acquisition
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Landscapes
- Image Processing (AREA)
- Image Analysis (AREA)
Abstract
The utility model relates to a facial expression identifying data collecting system based on an active vision, and aims to overcome the problem that a facial expression can't be accurately detected and a steady-quality image can't be obtained in any wide-range scene for identifying the facial expression. The system mainly comprises a master computer, a camera, a lens, a two-degree-of-freedom steering engine holder and a steering engine control plate, and is characterized in that a video camera (3) comprises the camera (1) and the lens (2) and is fixed on the two-degree-of-freedom steering engine holder (4); the steering engine holder (4) is controlled by the steering engine control plate (5) to perform horizontal swing and vertical pitching, so as to drive the video camera (3) to perform corresponding movement and track a target; the steering engine control plate (5) is connected with the master computer (6); and the interaction interface of the master computer (6) can be divided into four areas, namely, a camera arrangement area, a holder arrangement area, a human face tracking and display area and an expression identification and display area.
Description
Technical field
The utility model relates to a kind of image capturing system, is specifically related to a kind of human facial expression recognition data acquisition system (DAS) based on active vision
Background technology
Human face expression identification is the important component part of man-machine interaction and emotion Calculation and Study.Because people's face comprises abundant behavioural information, therefore human face expression is discerned and helped understanding human psychological conditions such as emotion and can carrying out effective man-machine interaction.Present interactive mode man-machine interaction stage from mutual stage of verbal order, the mutual stage development of graphical user interface to natural harmony.But existing facial expression data acquisition system all is to use the USB camera to come image data to obtain the information of facial expression.This method exists following limitation.
1) the USB camera is to be placed in fixing position to gather facial expression information, will cause the facial expression data acquisition range limited like this.Be exactly gathered the people can only be in the certain limit in video camera the place ahead among a small circle activity, in case the pickup area that face-image has part to leave camera will cause the phenomenon that can't discern to take place.
2) when exterior light is issued as before changing, the acceptance that video camera can only be passive background at this moment has only by adding some algorithms of removing illumination and reduces influence, will strengthen the complicacy of algorithm and the speed of on-line operation like this.
3) when needs carry out dynamic tracking to expression, what this data acquisition system (DAS) can be followed the tracks of is limited in scope, and when face was done the degree of depth and horizontally rotated, the angle that can follow the tracks of all was limited.
4) existing technology is difficult to adapt to the man-machine interaction mode of " natural harmony " at present.
In sum, existing technology is difficult to guarantee arbitrarily on a large scale in the scene, very detects facial expression accurately and obtains stay-in-grade image and come facial expression is discerned.
Technology contents
The utility model provides a kind of human facial expression recognition data acquisition system (DAS) based on active vision, automatically seek the people's face portion expression picture in any scene, and obtain steady quality facial expression image and dynamic sequence image, its purpose is to solve and is difficult to guarantee in the existing technology obtaining the facial expression picture in the environment on a large scale arbitrarily, be difficult to obtain the stay-in-grade facial expression picture of multi-faceted multi-angle, can not be from the influence of factors such as data acquisition aspect minimizing illumination.
The utility model provides active vision facial expression acquisition system can obtain stay-in-grade expression picture, also can obtain the dynamic sequence picture of enough time spans, and can obtain on a large scale from multi-angle and be studied the object's face expression picture, so just can improve the robustness of system from the data acquisition link, more can make the exchange of man-machine natural harmony more.If the service robot installs this data acquisition system (DAS), just can in the scene of service, provide corresponding method of service for it, and can lock that to need service object initiatively be that it is offered help according to different service objects' expression information.
Above-mentioned purpose of the present utility model is achieved in that accompanying drawings is as follows:
1) a kind of human facial expression recognition data acquisition system (DAS) described in the utility model based on active vision, mainly by main frame, camera, camera lens, two degrees of freedom steering wheel The Cloud Terrace and steering wheel control panel are formed, its hardware configuration as shown in Figure 1, described camera (1) and camera lens (2) are formed video camera (3), video camera is fixed on the two degrees of freedom steering wheel The Cloud Terrace (4), steering wheel The Cloud Terrace (4) is by steering wheel control panel (5) control carrying out horizontal hunting and pitching up and down, thereby drive video camera (3) and do corresponding sports target following, steering wheel control panel (5) is connected with main frame (6), the interactive interface of described main frame (6) is divided into four zones, comprising: the camera setting area, the The Cloud Terrace setting area, the face tracking viewing area, the Expression Recognition viewing area.
2) the steering wheel The Cloud Terrace (4) that a cover has two degree of freedom is installed in described video camera (3) below, these two degree of freedom be respectively can horizontally rotate 360 ° with 360 ° of vertical rotations, this steering wheel The Cloud Terrace (4) links to each other with the USB interface of main frame (6) by steering wheel control panel (5), to the level and the vertical control of steering wheel.
3) in the camera setting area, pixel, frame per second, picture format and the contrast of camera are carried out On-line Control.
4) in the The Cloud Terrace setting area, serial ports, baud rate and level and upright position are set, adjust steering wheel The Cloud Terrace movement velocity simultaneously and carry out reset operation.
5) described face tracking viewing area comprises a display window and people's face track button, and after pressing the face tracking button, image display area above it will show the visual scene of camera, and calibrate the position of people's face.
6) described Expression Recognition viewing area comprises an expression identification function button, a recognition result display box and a facial expression image display window, after pressing the expression recognition button, system samples human face expression image at this moment, and show at display window, be used for contrasting with recognition result, the recognition result of system is presented at as a result in the display box.
Compared with prior art, advantage of the present utility model and effect are that the active vision facial expression acquisition system that is provided can obtain stay-in-grade expression picture, also can obtain the dynamic sequence picture of enough time spans, and can obtain on a large scale from multi-angle and be studied the object's face expression picture, so just can improve the robustness of system from the data acquisition link, more can make the exchange of man-machine natural harmony more.
Description of drawings
The utility model will be by example, and the following accompanying drawing of reference is further to set forth:
Fig. 1 is the utility model system for use in carrying hardware structure diagram.
Fig. 2 is the utility model system for use in carrying schematic diagram.
Fig. 3 is the used human-computer interaction interface of the utility model.
Among the figure: 1, camera; 2, camera lens; 3, video camera; 4, two degrees of freedom steering wheel The Cloud Terrace; 5, steering wheel control panel; 6 main frames
Embodiment
The utility model provides a kind of human facial expression recognition data acquisition system (DAS) based on active vision, can obtain stay-in-grade expression picture, also can obtain the dynamic sequence picture of enough time spans, and can obtain on a large scale from multi-angle and be studied the object's face expression picture.
1, the human facial expression recognition data acquisition system (DAS) based on active vision provided by the utility model is divided into three parts, and the one, realize the detection and location of people's face, the 2nd, the tracking of people's face, the 3rd, FacialExpression Recognition.Its hardware mainly is made up of hardware such as camera, camera lens, two degrees of freedom steering wheel The Cloud Terrace, steering wheel control panels.Hardware mechanism provided by the utility model as shown in Figure 1, in the utility model, need and to be fixed on by the video camera (3) that camera (1) and camera lens (2) are formed on the two degrees of freedom steering wheel The Cloud Terrace (4), carry out horizontal hunting and pitching up and down by steering wheel control panel (5) control steering wheel The Cloud Terrace (4), thereby drive video camera (3) and do corresponding sports, realize tracking target.The steering wheel (4) that one cover has two degree of freedom is installed below video camera, these two degree of freedom be respectively can horizontally rotate 360 ° with 360 ° of vertical rotations.This steering wheel (4) links to each other with the USB interface of main frame (6) by steering wheel control panel (5), realizes level and vertical control to steering wheel (4).
2, based on the interactive interface of the human facial expression recognition data acquisition system (DAS) of active vision, should be able to allow operating personnel's hardware equipment easily, three basic functions of realization system, that is: people's face detection and location, face tracking, human face expression identification, working condition and program run result with system represents to operating personnel simultaneously, realizes man-machine interaction simply and easily.The utility model carries out the program realization according to the designing requirement and the thinking of interactive interface, and the interface form as shown in Figure 3.
The area dividing of 3 interactive interfaces:
Interactive interface is divided into four zones, comprising: camera setting area, The Cloud Terrace setting area, face tracking viewing area, Expression Recognition viewing area.
The regional function of 4 interactive interfaces:
In the camera setting area, can carry out On-line Control to pixel, frame per second, picture format and the contrast of camera; In the The Cloud Terrace setting area, serial ports, baud rate, level and upright position can be set, can adjust the The Cloud Terrace movement velocity and carry out reset operation simultaneously; The face tracking viewing area comprises a display window and people's face track button, and after pressing the face tracking button, image display area above it will show the visual scene of camera, and calibrate the position of people's face; The Expression Recognition viewing area comprises an expression identification function button, a recognition result display box and a facial expression image display window, after pressing the expression recognition button, system samples human face expression image at this moment, and show at display window, so that contrast with recognition result, the recognition result of system will be presented at as a result in the display box.
Claims (6)
1. human facial expression recognition data acquisition system (DAS) based on active vision, mainly by main frame, camera, camera lens, two degrees of freedom steering wheel The Cloud Terrace and steering wheel control panel are formed, it is characterized in that, described camera (1) and camera lens (2) are formed video camera (3), video camera is fixed on the two degrees of freedom steering wheel The Cloud Terrace (4), steering wheel The Cloud Terrace (4) is by steering wheel control panel (5) control carrying out horizontal hunting and pitching up and down, thereby drive video camera (3) and do corresponding sports target following, steering wheel control panel (5) is connected with main frame (6), the interactive interface of described main frame (6) is divided into four zones, comprising: the camera setting area, the The Cloud Terrace setting area, the face tracking viewing area, the Expression Recognition viewing area.
2. a kind of human facial expression recognition data acquisition system (DAS) according to claim 1 based on active vision, it is characterized in that, the steering wheel The Cloud Terrace (4) that a cover has two degree of freedom is installed in described video camera (3) below, these two degree of freedom be respectively can horizontally rotate 360 ° with 360 ° of vertical rotations, this steering wheel The Cloud Terrace (4) links to each other with the USB interface of main frame (6) by steering wheel control panel (5), to the level and the vertical control of steering wheel.
3. a kind of human facial expression recognition data acquisition system (DAS) based on active vision according to claim 1 is characterized in that, in the camera setting area, pixel, frame per second, picture format and the contrast of camera is carried out On-line Control.
4. a kind of human facial expression recognition data acquisition system (DAS) according to claim 1 based on active vision, it is characterized in that, in the The Cloud Terrace setting area, serial ports, baud rate and level and upright position are set, adjust steering wheel The Cloud Terrace movement velocity simultaneously and carry out reset operation.
5. a kind of human facial expression recognition data acquisition system (DAS) according to claim 1 based on active vision, it is characterized in that, described face tracking viewing area comprises a display window and people's face track button, after pressing the face tracking button, image display area above it will show the visual scene of camera, and calibrate the position of people's face.
6. a kind of human facial expression recognition data acquisition system (DAS) according to claim 1 based on active vision, it is characterized in that, described Expression Recognition viewing area comprises an expression identification function button, a recognition result display box and a facial expression image display window, after pressing the expression recognition button, system samples human face expression image at this moment, and shows at display window, be used for contrasting with recognition result, the recognition result of system is presented at as a result in the display box.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2010205645344U CN201845345U (en) | 2010-10-15 | 2010-10-15 | Facial expression identifying data collecting system based on active vision |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2010205645344U CN201845345U (en) | 2010-10-15 | 2010-10-15 | Facial expression identifying data collecting system based on active vision |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN201845345U true CN201845345U (en) | 2011-05-25 |
Family
ID=44040230
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2010205645344U Expired - Fee Related CN201845345U (en) | 2010-10-15 | 2010-10-15 | Facial expression identifying data collecting system based on active vision |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN201845345U (en) |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102528821A (en) * | 2011-12-31 | 2012-07-04 | 北京工业大学 | Bionic multi-vision physical platform based on multiple independent holders |
| CN103281481A (en) * | 2013-04-28 | 2013-09-04 | 桂林电子科技大学 | Camera steering device for hemispherical wide-angle shooting |
| CN103365404A (en) * | 2012-04-01 | 2013-10-23 | 联想(北京)有限公司 | Human-computer interaction method and human-computer interaction device |
| CN104800950A (en) * | 2015-04-22 | 2015-07-29 | 中国科学院自动化研究所 | Robot and system for assisting autistic child therapy |
| CN109729249A (en) * | 2018-12-26 | 2019-05-07 | 武汉市澜创信息科技有限公司 | A kind of photographic device and control method |
| CN109976335A (en) * | 2019-02-27 | 2019-07-05 | 武汉大学 | A kind of traceable Portable stereoscopic live streaming intelligent robot and its control method |
| CN110053075A (en) * | 2019-04-25 | 2019-07-26 | 太平洋未来科技（深圳）有限公司 | A kind of computer face that multi-angle flexibly commutates identification camera |
| CN110414314A (en) * | 2019-06-11 | 2019-11-05 | 汉腾汽车有限公司 | A kind of camera structure carrying out Face tracking and recognition and system |
| CN112446248A (en) * | 2019-08-30 | 2021-03-05 | 东北师范大学 | Facial expression collection system |
| CN112929619A (en) * | 2021-02-03 | 2021-06-08 | 广州工程技术职业学院 | Tracking display structure of facial feature points in animation character |
| CN114954863A (en) * | 2022-07-05 | 2022-08-30 | 中国农业大学 | Autonomous inspection early warning bionic robotic dolphin system and control method |
| CN116407118A (en) * | 2023-04-17 | 2023-07-11 | 深圳市儿童医院 | Postoperative state monitoring device and postoperative state monitoring method |
-
2010
- 2010-10-15 CN CN2010205645344U patent/CN201845345U/en not_active Expired - Fee Related
Cited By (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102528821A (en) * | 2011-12-31 | 2012-07-04 | 北京工业大学 | Bionic multi-vision physical platform based on multiple independent holders |
| CN103365404A (en) * | 2012-04-01 | 2013-10-23 | 联想(北京)有限公司 | Human-computer interaction method and human-computer interaction device |
| CN103365404B (en) * | 2012-04-01 | 2016-07-06 | 联想(北京)有限公司 | A kind of method and apparatus of man-machine interaction |
| CN103281481A (en) * | 2013-04-28 | 2013-09-04 | 桂林电子科技大学 | Camera steering device for hemispherical wide-angle shooting |
| CN104800950A (en) * | 2015-04-22 | 2015-07-29 | 中国科学院自动化研究所 | Robot and system for assisting autistic child therapy |
| CN109729249A (en) * | 2018-12-26 | 2019-05-07 | 武汉市澜创信息科技有限公司 | A kind of photographic device and control method |
| CN109976335A (en) * | 2019-02-27 | 2019-07-05 | 武汉大学 | A kind of traceable Portable stereoscopic live streaming intelligent robot and its control method |
| CN110053075A (en) * | 2019-04-25 | 2019-07-26 | 太平洋未来科技（深圳）有限公司 | A kind of computer face that multi-angle flexibly commutates identification camera |
| CN110414314A (en) * | 2019-06-11 | 2019-11-05 | 汉腾汽车有限公司 | A kind of camera structure carrying out Face tracking and recognition and system |
| CN112446248A (en) * | 2019-08-30 | 2021-03-05 | 东北师范大学 | Facial expression collection system |
| CN112446248B (en) * | 2019-08-30 | 2024-06-21 | 东北师范大学 | Facial expression acquisition system |
| CN112929619A (en) * | 2021-02-03 | 2021-06-08 | 广州工程技术职业学院 | Tracking display structure of facial feature points in animation character |
| CN112929619B (en) * | 2021-02-03 | 2022-04-19 | 广州工程技术职业学院 | Tracking display structure of facial feature points in animation character |
| CN114954863A (en) * | 2022-07-05 | 2022-08-30 | 中国农业大学 | Autonomous inspection early warning bionic robotic dolphin system and control method |
| CN116407118A (en) * | 2023-04-17 | 2023-07-11 | 深圳市儿童医院 | Postoperative state monitoring device and postoperative state monitoring method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN201845345U (en) | Facial expression identifying data collecting system based on active vision | |
| CN101310289B (en) | Capturing and processing facial motion data | |
| CN100373394C (en) | Petoscope based on bionic oculus and method thereof | |
| CN102221887B (en) | Interactive projection system and method | |
| CN107357427A (en) | A kind of gesture identification control method for virtual reality device | |
| CN107665505B (en) | Method and device for realizing augmented reality based on plane detection | |
| CN105931263A (en) | Target tracking method and electronic equipment | |
| CN102591449A (en) | Low-latency fusing of virtual and real content | |
| CN104835163A (en) | Embedded real-time high-speed binocular vision system for moving target detection | |
| CN103612252A (en) | Intelligent remote social adjuvant therapy robot for autism children | |
| CN108885487B (en) | Gesture control method of wearable system and wearable system | |
| CN104821010A (en) | Binocular-vision-based real-time extraction method and system for three-dimensional hand information | |
| CN103105924B (en) | Man-machine interaction method and device | |
| CN103985137A (en) | Moving object tracking method and system applied to human-computer interaction | |
| CN102508578A (en) | Projection positioning device and method as well as interaction system and method | |
| CN113711587A (en) | Lightweight cross-display device with passive depth extraction | |
| US20240137664A1 (en) | Patch tracking image sensor | |
| CN103544714A (en) | Visual tracking system and method based on high-speed image sensor | |
| CN102932638B (en) | 3D video monitoring method based on computer modeling | |
| CN106576156A (en) | Wearable mediated reality system and method | |
| CN102799271A (en) | Method and system for identifying interactive commands based on human hand gestures | |
| CN105279786A (en) | Method and system for obtaining object three-dimensional model | |
| CN103761011B (en) | A kind of method of virtual touch screen, system and the equipment of calculating | |
| CN106709464B (en) | Tujia brocade skill limb and hand motion collection and integration method | |
| CN111399634B (en) | Method and device for recognizing gesture-guided object |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20110525 Termination date: 20151015 |
|
| EXPY | Termination of patent right or utility model |