CN108848366A - Information acquisition device and method based on 3D video camera - Google Patents

Information acquisition device and method based on 3D video camera Download PDF

Info

Publication number
CN108848366A
CN108848366A CN201810727933.9A CN201810727933A CN108848366A CN 108848366 A CN108848366 A CN 108848366A CN 201810727933 A CN201810727933 A CN 201810727933A CN 108848366 A CN108848366 A CN 108848366A
Authority
CN
China
Prior art keywords
duration
information acquisition
faceform
processing end
module
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201810727933.9A
Other languages
Chinese (zh)
Other versions
CN108848366B (en
Inventor
吴跃华
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Qingyan Heshi Technology Co ltd
Original Assignee
Angrui Shanghai Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Angrui Shanghai Information Technology Co Ltd filed Critical Angrui Shanghai Information Technology Co Ltd
Priority to CN201810727933.9A priority Critical patent/CN108848366B/en
Publication of CN108848366A publication Critical patent/CN108848366A/en
Application granted granted Critical
Publication of CN108848366B publication Critical patent/CN108848366B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Studio Devices (AREA)

Abstract

The invention discloses a kind of information acquisition device and method based on 3D video camera, the information acquisition device includes several 3D video cameras and a processing end, the processing end includes that a generation module, an identification module and an acquisition module, the 3D video camera are used to obtain the continuous 3D image of photographic subjects in a space;The generation module is used for the 3D video generation 3D model according to synchronization;The identification module faceform in 3D model for identification;The information for obtaining module and obtaining photographic subjects concern target object by faceform.Of the invention information acquisition device and method based on 3D video camera can obtain the image of human body by 3D video camera, and according to the attention rate of image capturing photographic subjects, facilitate parent, teacher to grasp the learning state of student, improve the learning efficiency of student.

Description

Information acquisition device and method based on 3D video camera
Technical field
The present invention relates to a kind of information acquisition device and method based on 3D video camera.
Background technique
3D video camera, what is utilized is the video camera of 3D camera lens manufacture, usually there are two tools more than pick-up lens, spacing and people Eye spacing is close, can shoot the similar seen different images for being directed to Same Scene of human eye.Holographic 3D has 5 camera lens of disk More than, by dot grating image Huo Ling shape raster holographic imaging can the comprehensive same image of viewing, can such as come to its border personally.
The 3D revolution so far of First 3D video camera is unfolded all around Hollywood weight pound sheet and important competitive sports.With The appearance of 3D video camera, this technology distance domestic consumer close step again.After the release of this video camera, we are from now on Each unforgettable moment of life, such as the first step that child steps, celebration of graduating from university etc. can be captured with 3D camera lens.
Usually there are two the above camera lenses for 3D video camera.The function of 3D video camera itself, can be by two just as human brain Lens image is fused together, and becomes a 3D rendering.These images can play on 3D TV, and spectators wear so-called master Dynamic formula shutter glasses may be viewed by, and can also pass through naked eye 3D display equipment direct viewing.3D shutter glasses can be with per second 60 Secondary speed enables the eyeglass fast crosstalk of left and right glasses switch.This means that each eye is it is seen that Same Scene is slightly shown not Same picture, so brain can be thus to be the single photo presented in appreciation with 3D for it.
Existing 3D video camera, which exists, to be had a single function, the lesser defect of application range.
Summary of the invention
The technical problem to be solved by the present invention is in order to overcome in the prior art 3D video camera exist have a single function, using model Lesser defect is enclosed, provides a kind of image that can obtain human body by 3D video camera, and according to image capturing photographic subjects Attention rate facilitates parent, teacher to grasp the learning state of student, improve student's learning efficiency based on 3D video camera Information acquisition device and method.
The present invention is to solve above-mentioned technical problem by following technical proposals:
A kind of information acquisition device based on 3D video camera, it is characterized in that, the information acquisition device includes several 3D Video camera and a processing end, the processing end obtain module including a generation module, an identification module and one,
The 3D video camera is used to obtain the continuous 3D image of photographic subjects in a space;
The generation module is used for the 3D video generation 3D model according to synchronization;
The identification module faceform in 3D model for identification;
The information for obtaining module and obtaining photographic subjects concern target object by faceform.
Preferably, the information includes concern duration,
The identification module is also used to obtain the direction of faceform;
When the acquisition module is also used to obtain duration of the direction of faceform in target zone as the concern It is long.
Preferably, the information acquisition device further includes a microphone, the information includes concern duration divided by target language The value of sound duration,
The microphone be used to acquire voice in the space and by Application on Voiceprint Recognition acquisition target voice it is lasting when It is long;
The identification module is also used to obtain the direction of faceform;
The module that obtains is also used to obtain the direction of faceform in the case where target voice continues in target zone In duration as the concern duration.
Preferably, the information include bow duration divided by target decibel duration value,
The microphone is used to acquire the voice in the space and obtains the duration of target decibel;
The identification module is also used to obtain the direction of faceform;
The module that obtains is also used to obtain the direction of faceform in the case where target decibel continues in range of bowing In duration be used as described in bow duration.
Preferably, the information acquisition device further includes a human eye tracing module,
The human eye tracing module is used to obtain the direction of eyes in faceform;
The acquisition module is also used to when the direction of the eyes constant duration being greater than preset duration, in the concern The duration is subtracted in duration as newest concern duration.
The application also provides a kind of information acquisition method based on 3D video camera, it is characterized in that, the acquisition of information side Method realizes that the information acquisition device includes several 3D video cameras and a processing end, the letter by an information acquisition device Ceasing acquisition methods includes:
The 3D video camera obtains the continuous 3D image of photographic subjects in a space;
The processing end is according to the 3D video generation 3D model of synchronization;
Faceform in the processing end identification 3D model;
The processing end obtains the information that photographic subjects pay close attention to target object by faceform.
Preferably, the information includes concern duration, the information acquisition method includes:
The processing end obtains the direction of faceform;
The processing end obtains duration of the direction of faceform in target zone as the concern duration.
Preferably, the information acquisition device further includes a microphone, the information includes concern duration divided by target language The value of sound duration, the information acquisition method include:
The microphone acquires the voice in the space and obtains the duration of target voice by Application on Voiceprint Recognition;
The processing end obtains the direction of faceform;
The processing end obtains duration of the direction of faceform in target zone in the case where target voice continues As the concern duration.
Preferably, the information includes value of the duration divided by target decibel duration of bowing, the information acquisition method Including:
The microphone is used to acquire the voice in the space and obtains the duration of target decibel;
The processing end obtains the direction of faceform;
The processing end obtains duration of the direction of faceform in range of bowing in the case where target decibel continues As the duration of bowing.
Preferably, the information acquisition method includes:
The processing end obtains the direction of eyes in faceform;
The processing end subtracts in the concern duration when the direction of the eyes constant duration being greater than preset duration Go the duration as newest concern duration.
On the basis of common knowledge of the art, above-mentioned each optimum condition, can any combination to get each preferable reality of the present invention Example.
The positive effect of the present invention is that:Of the invention information acquisition device and method based on 3D video camera can The image of human body is obtained by 3D video camera, and according to the attention rate of image capturing photographic subjects, facilitates parent, teacher to student Learning state grasped, improve the learning efficiency of student.
Detailed description of the invention
Fig. 1 is the flow chart of the information acquisition method of the embodiment of the present invention 1.
Fig. 2 is the flow chart of the information acquisition method of the embodiment of the present invention 2.
Fig. 3 is another flow chart of the information acquisition method of the embodiment of the present invention 2.
Specific embodiment
The present invention is further illustrated below by the mode of embodiment, but does not therefore limit the present invention to the reality It applies among a range.
Embodiment 1
The present embodiment provides a kind of information acquisition device based on 3D video camera, the information acquisition device includes several 3D Video camera, a processing end and several user terminals.
The processing end includes a generation module, an identification module and an acquisition module.
The 3D video camera is used to obtain the continuous 3D image of photographic subjects in a space.
The generation module is used for the 3D video generation 3D model according to synchronization.
The processing end can be mobile phone, computer or cloud server.
The 3D video camera is used to obtain the continuous 3D image of photographic subjects in a space.
As soon as the continuous 3D image can be the 3D image every preset interval shooting, such as obtained at interval of 0.1 second One 3D image.
3D image has continuity, and timeliness is able to record the motion state of photographic subjects.
In the present embodiment, the 3D video camera is used to shoot the 3D video recording of photographic subjects in the space;
The processing end intercepts several 3D images with preset interval in the 3D image.
The generation module is used for the 3D video generation 3D model according to synchronization.Specifically, the generation module For comparing 3D model described in the difference in adjacent 3D image and the 3D video generation by difference.
The 3D model can be the 3D video generation shot by a 3D video camera, and it is same to be also possible to multiple 3D video cameras The 3D image joint that one moment obtained forms.
The present embodiment obtains several 3D images, and 3D image has a shooting timing, it is adjacent refer to it is adjacent in timing.
Model is generated especially by connecting method, the generation module picture under synchronization on 3D image for identification Plain layer characteristic point, and 3D image is spliced in such a way that same pixel layer characteristic point is overlapped to obtain the 3D model.
Background is static in the image of shooting, and human body is movement, can obtain work by the identification to difference Dynamic image, removal background can obtain the 3D model of movement.
The 3D model of movement is made of a series of independent models, and each independent 3D model passes through multiple 3D image joints At.
The identification module faceform in 3D model for identification;
The information for obtaining module and obtaining photographic subjects concern target object by faceform.
Concern target object may include the variation of the direction of gaze and pupil of eyes, can analyze the concern of user Degree.
In the present embodiment, the information includes concern duration.The processing end further includes that an identification module and one obtain mould Block.
The identification module is also used to obtain the direction of faceform;
When the acquisition module is also used to obtain duration of the direction of faceform in target zone as the concern It is long.
The information acquisition device is also used to send the information to target terminal.Listening to the teacher for student is reported to parent State.
Using above- mentioned information acquisition device, the present embodiment also provides a kind of information acquisition method, including:
Step 100, the 3D video camera obtain the continuous 3D image of photographic subjects in a space;
Step 101, the processing end are according to the 3D video generation 3D model of synchronization;
Faceform in step 102, processing end identification 3D model;
Step 103, the processing end obtain the information that photographic subjects pay close attention to target object by faceform.
Wherein the information in step 103 includes concern duration, and the concern duration is obtained by processing end, specially:
The processing end obtains duration of the direction of faceform in target zone as the concern duration.
The information acquisition device based on 3D video camera and method of the present embodiment can pass through 3D video camera and obtain human body Image, and according to the attention rate of image capturing photographic subjects, facilitate parent, teacher to grasp the learning state of student, mentions The learning efficiency of high student.
Embodiment 2
The present embodiment is substantially the same manner as Example 1, the difference is that only:
The information acquisition device further includes a microphone, when the information includes that concern duration continues divided by target voice Long value.
The microphone be used to acquire voice in the space and by Application on Voiceprint Recognition acquisition target voice it is lasting when It is long;
The identification module is also used to obtain the direction of faceform;
The module that obtains is also used to obtain the direction of faceform in the case where target voice continues in target zone In duration as the concern duration.
The information further include bow duration divided by target decibel duration value,
The microphone is used to acquire the voice in the space and obtains the duration of target decibel;
The identification module is also used to obtain the direction of faceform;
The module that obtains is also used to obtain the direction of faceform in the case where target decibel continues in range of bowing In duration be used as described in bow duration.
The information acquisition device further includes a human eye tracing module,
The human eye tracing module is used to obtain the direction of eyes in faceform;
The acquisition module is also used to when the direction of the eyes constant duration being greater than preset duration, in the concern The duration is subtracted in duration as newest concern duration.
Class hour is said in teacher, by acquiring the face direction of student, can more accurately obtain the information;And certainly Practise, examination when be able to detect the conscientious degree of student by acquiring face duration of bowing and can assist invigilating.
By tracking the duration that can recognize that student stands in amazement, stares blankly to human eye, and the hair is subtracted from concern duration Slow-witted duration, further increases the accuracy of the information.
Referring to fig. 2, using above- mentioned information acquisition device, the present embodiment also provides a kind of information acquisition method, including:
Step 200, the microphone acquire the voice in the space and obtain holding for target voice by Application on Voiceprint Recognition Continuous duration;
Step 201, the processing end obtain the direction of faceform;
Step 202, the processing end obtain the direction of faceform in the case where target voice continues in target zone In duration as the concern duration.
Referring to Fig. 3, the information acquisition method further includes:
Step 300, the microphone are used to acquire the voice in the space and obtain the duration of target decibel;
Step 301, the processing end obtain the direction of faceform;
Step 302, the processing end obtain the direction of faceform in the case where target decibel continues in range of bowing In duration be used as described in bow duration.
Step 200 is to 202 and step 300 to the refinement that 302 be all 1 step 103 of embodiment, in order to further limit State information.Step 200 to 202 and step 300 to 302 can by volume that microphone acquires, vocal print make and sentence accordingly It is disconnected, such as detect that target voice thens follow the steps 200, if detection decibel is lower than preset value (i.e. in the range of target decibel) Then follow the steps 300.
Wherein, step 202, which can be further improved, is:
The processing end obtains the direction of eyes in faceform;
The processing end subtracts in the concern duration when the direction of the eyes constant duration being greater than preset duration Go the duration as newest concern duration.
Although specific embodiments of the present invention have been described above, it will be appreciated by those of skill in the art that these It is merely illustrative of, protection scope of the present invention is defined by the appended claims.Those skilled in the art is not carrying on the back Under the premise of from the principle and substance of the present invention, many changes and modifications may be made, but these are changed Protection scope of the present invention is each fallen with modification.

Claims (10)

1. a kind of information acquisition device based on 3D video camera, which is characterized in that the information acquisition device includes that several 3D take the photograph Camera and a processing end, the processing end obtain module including a generation module, an identification module and one,
The 3D video camera is used to obtain the continuous 3D image of photographic subjects in a space;
The generation module is used for the 3D video generation 3D model according to synchronization;
The identification module faceform in 3D model for identification;
The information for obtaining module and obtaining photographic subjects concern target object by faceform.
2. information acquisition device as described in claim 1, which is characterized in that the information includes concern duration,
The identification module is also used to obtain the direction of faceform;
The acquisition module is also used to obtain duration of the direction of faceform in target zone as the concern duration.
3. information acquisition device as described in claim 1, which is characterized in that the information acquisition device further includes a Mike Wind, the information include value of the concern duration divided by target voice duration,
The microphone is used to acquire the voice in the space and obtains the duration of target voice by Application on Voiceprint Recognition;
The identification module is also used to obtain the direction of faceform;
The module that obtains is also used to obtain the direction of faceform in the case where target voice continues in target zone Duration is as the concern duration.
4. information acquisition device as claimed in claim 3, which is characterized in that the information includes bowing duration divided by target point The value of shellfish duration,
The microphone is used to acquire the voice in the space and obtains the duration of target decibel;
The identification module is also used to obtain the direction of faceform;
The module that obtains is also used to obtain the direction of faceform in the case where target decibel continues in range of bowing Duration is bowed duration described in being used as.
5. information acquisition device as claimed in claim 3, which is characterized in that the information acquisition device further includes that a human eye chases after Track module,
The human eye tracing module is used to obtain the direction of eyes in faceform;
The acquisition module is also used to when the direction of the eyes constant duration being greater than preset duration, in the concern duration In subtract the duration as newest concern duration.
6. a kind of information acquisition method based on 3D video camera, which is characterized in that the information acquisition method is obtained by an information Device is taken to realize, the information acquisition device includes several 3D video cameras and a processing end, and the information acquisition method includes:
The 3D video camera obtains the continuous 3D image of photographic subjects in a space;
The processing end is according to the 3D video generation 3D model of synchronization;
Faceform in the processing end identification 3D model;
The processing end obtains the information that photographic subjects pay close attention to target object by faceform.
7. information acquisition method as described in claim 1, which is characterized in that the information includes concern duration, the information Acquisition methods include:
The processing end obtains the direction of faceform;
The processing end obtains duration of the direction of faceform in target zone as the concern duration.
8. information acquisition method as described in claim 1, which is characterized in that the information acquisition device further includes a Mike Wind, the information include paying close attention to duration divided by the value of target voice duration, and the information acquisition method includes:
The microphone acquires the voice in the space and obtains the duration of target voice by Application on Voiceprint Recognition;
The processing end obtains the direction of faceform;
The processing end obtains duration conduct of the direction of faceform in target zone in the case where target voice continues The concern duration.
9. information acquisition method as claimed in claim 3, which is characterized in that the information includes bowing duration divided by target point The value of shellfish duration, the information acquisition method include:
The microphone is used to acquire the voice in the space and obtains the duration of target decibel;
The processing end obtains the direction of faceform;
The processing end obtains duration conduct of the direction of faceform in range of bowing in the case where target decibel continues The duration of bowing.
10. information acquisition method as claimed in claim 3, which is characterized in that the information acquisition method includes:
The processing end obtains the direction of eyes in faceform;
The processing end subtracts institute in the concern duration when the direction of the eyes constant duration being greater than preset duration The duration is stated as newest concern duration.
CN201810727933.9A 2018-07-05 2018-07-05 Information acquisition device and method based on 3D camera Active CN108848366B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810727933.9A CN108848366B (en) 2018-07-05 2018-07-05 Information acquisition device and method based on 3D camera

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810727933.9A CN108848366B (en) 2018-07-05 2018-07-05 Information acquisition device and method based on 3D camera

Publications (2)

Publication Number Publication Date
CN108848366A true CN108848366A (en) 2018-11-20
CN108848366B CN108848366B (en) 2020-12-18

Family

ID=64200242

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810727933.9A Active CN108848366B (en) 2018-07-05 2018-07-05 Information acquisition device and method based on 3D camera

Country Status (1)

Country Link
CN (1) CN108848366B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109657702A (en) * 2018-11-23 2019-04-19 盎锐(上海)信息科技有限公司 3D deep semantic perception algorithm and device

Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020080094A1 (en) * 2000-12-22 2002-06-27 Frank Biocca Teleportal face-to-face system
CN102932638A (en) * 2012-11-30 2013-02-13 天津市电视技术研究所 3D video monitoring method based on computer modeling
CN103473791A (en) * 2013-09-10 2013-12-25 惠州学院 Method for automatically recognizing abnormal velocity event in surveillance video
CN104159067A (en) * 2014-03-18 2014-11-19 深圳市贝尔信智能***有限公司 Intelligent monitoring system and method based on combination of 3DGIS with real scene video
CN104517102A (en) * 2014-12-26 2015-04-15 华中师范大学 Method and system for detecting classroom attention of student
CN104834896A (en) * 2015-04-03 2015-08-12 惠州Tcl移动通信有限公司 Method and terminal for information acquisition
CN105825189A (en) * 2016-03-21 2016-08-03 浙江工商大学 Device for automatically analyzing attendance rate and class concentration degree of college students
CN105956586A (en) * 2016-07-15 2016-09-21 瑞胜科信息(深圳)有限公司 Intelligent tracking system based on TOF 3D camera
CN106264536A (en) * 2015-05-21 2017-01-04 长沙维纳斯克信息技术有限公司 A kind of 3D anthropometric scanning apparatus and method
CN107292271A (en) * 2017-06-23 2017-10-24 北京易真学思教育科技有限公司 Learning-memory behavior method, device and electronic equipment
CN107832698A (en) * 2017-11-02 2018-03-23 北方工业大学 Learning interest testing method and device based on array lens

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020080094A1 (en) * 2000-12-22 2002-06-27 Frank Biocca Teleportal face-to-face system
CN102932638A (en) * 2012-11-30 2013-02-13 天津市电视技术研究所 3D video monitoring method based on computer modeling
CN103473791A (en) * 2013-09-10 2013-12-25 惠州学院 Method for automatically recognizing abnormal velocity event in surveillance video
CN104159067A (en) * 2014-03-18 2014-11-19 深圳市贝尔信智能***有限公司 Intelligent monitoring system and method based on combination of 3DGIS with real scene video
CN104517102A (en) * 2014-12-26 2015-04-15 华中师范大学 Method and system for detecting classroom attention of student
CN104834896A (en) * 2015-04-03 2015-08-12 惠州Tcl移动通信有限公司 Method and terminal for information acquisition
CN106264536A (en) * 2015-05-21 2017-01-04 长沙维纳斯克信息技术有限公司 A kind of 3D anthropometric scanning apparatus and method
CN105825189A (en) * 2016-03-21 2016-08-03 浙江工商大学 Device for automatically analyzing attendance rate and class concentration degree of college students
CN105956586A (en) * 2016-07-15 2016-09-21 瑞胜科信息(深圳)有限公司 Intelligent tracking system based on TOF 3D camera
CN107292271A (en) * 2017-06-23 2017-10-24 北京易真学思教育科技有限公司 Learning-memory behavior method, device and electronic equipment
CN107832698A (en) * 2017-11-02 2018-03-23 北方工业大学 Learning interest testing method and device based on array lens

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109657702A (en) * 2018-11-23 2019-04-19 盎锐(上海)信息科技有限公司 3D deep semantic perception algorithm and device
CN109657702B (en) * 2018-11-23 2023-02-07 盎锐(上海)信息科技有限公司 3D depth semantic perception method and device

Also Published As

Publication number Publication date
CN108848366B (en) 2020-12-18

Similar Documents

Publication Publication Date Title
US9927948B2 (en) Image display apparatus and image display method
CN104253984B (en) Information processor and information processing method
CN108463840B (en) Information processing apparatus, information processing method, and recording medium
US20190304081A1 (en) Arrangement for generating head related transfer function filters
CN110636276B (en) Video shooting method and device, storage medium and electronic equipment
US20150156475A1 (en) Method and Device for Implementing Stereo Imaging
KR20140125183A (en) Eye-glasses which attaches projector and method of controlling thereof
CN108600729B (en) Dynamic 3D model generation device and image generation method
JP2006287921A (en) Moving image generating apparatus, moving image generation method, and program
CN101620359A (en) Judging method of eye sight line
JP2009239347A (en) Image processor and image processing program
CN108848366A (en) Information acquisition device and method based on 3D video camera
CN109241947A (en) Information processing unit and method for the monitoring of stream of people's momentum
CN108833890A (en) Data processing equipment and method based on camera
JPS62122494A (en) Stereoscopic vision device
CN108389253A (en) Mobile terminal with modeling function and model generating method
US10075631B2 (en) Imaging apparatus, imaging method and recording medium having program for performing self-timer shooting
CN104780341B (en) A kind of information processing method and information processing unit
CN108881842A (en) Monitoring system and information processing method based on 3D video camera
CN110288680A (en) Image generating method and mobile terminal
CN108921102B (en) 3D image processing method and device
CN111736692B (en) Display method, display device, storage medium and head-mounted device
CN108810517A (en) Image processor with monitoring function and method
CN108573526A (en) Face snap device and image generating method
JP7065708B2 (en) Recording / playback device and program

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right

Effective date of registration: 20230720

Address after: 201703 Room 2134, Floor 2, No. 152 and 153, Lane 3938, Huqingping Road, Qingpu District, Shanghai

Patentee after: Shanghai Qingyan Heshi Technology Co.,Ltd.

Address before: 201703 No.206, building 1, no.3938 Huqingping Road, Qingpu District, Shanghai

Patentee before: UNRE (SHANGHAI) INFORMATION TECHNOLOGY Co.,Ltd.

TR01 Transfer of patent right