CN104680146A - Movie type detection system based on identification on viewing expressions of audiences - Google Patents

Movie type detection system based on identification on viewing expressions of audiences Download PDF

Info

Publication number
CN104680146A
CN104680146A CN201510101618.1A CN201510101618A CN104680146A CN 104680146 A CN104680146 A CN 104680146A CN 201510101618 A CN201510101618 A CN 201510101618A CN 104680146 A CN104680146 A CN 104680146A
Authority
CN
China
Prior art keywords
spectators
expression
film
detection system
viewing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201510101618.1A
Other languages
Chinese (zh)
Inventor
不公告发明人
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Wuxi Sani Pacifies Science And Technology Ltd
Original Assignee
Wuxi Sani Pacifies Science And Technology Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Wuxi Sani Pacifies Science And Technology Ltd filed Critical Wuxi Sani Pacifies Science And Technology Ltd
Priority to CN201510101618.1A priority Critical patent/CN104680146A/en
Publication of CN104680146A publication Critical patent/CN104680146A/en
Pending legal-status Critical Current

Links

Landscapes

  • Studio Devices (AREA)

Abstract

The invention relates to a movie type detection system based on identification on viewing expressions of audiences. The detection system is positioned in a movie playing field and comprises a digital signal processor and a plurality of expression identification subsystems; each expression identification subsystem is positioned on the back of an audience seat and is used for identifying the face expression of the viewing audience behind the audience seat; the digital signal processor is respectively connected with the expression identification subsystems and is used for receiving a plurality of face expressions and determining the type of a currently played movie according to the face expressions. By adopting the movie type detection system, the movie type of the movie to be shown can be determined on the basis of the real-time viewing expressions of the audiences and accuracy and reasonability of determining the movie type are improved.

Description

Based on the film types detection system of spectators' viewing Expression Recognition
Technical field
The present invention relates to image processing field, particularly relate to a kind of film types detection system based on spectators' viewing Expression Recognition.
Background technology
The mode of film due to shooting and the diversity of plot of setting, thus exist dissimilar.For film classified types is necessary, after dividing film types, can select to provide important evidence for the spectators of viewing of coming carry out film, watch with the film selecting oneself age bracket applicable or oneself psychological bearing capability applicable.The division of film types is generally complete but before not yet formally showing at film shooting.Play if just do not promoted by film before film is formally shown, its consequence is very serious, and such as, the spectators with heart disease or angiocardiopathy have falsely dropped the horror film that plot is too exaggerated, and probably cause spectators to trigger disease, cause serious personal injury.
Thus, need to be carried out grade classification accurately before film is formally shown.In prior art, the film types dividing mode that film administrative authority takes is generally select the film personage of specialty to watch film to be shown in advance, and relevant investigation form is filled in after viewing, adopt the multiple investigation form of mode statistical of complicate statistics finally to determine film types.Although this mode can divide the type of film to be shown to a certain extent, because the number selected is very few, the accuracy of division is not high and reasonable not, and statistics consumes a large amount of manpowers simultaneously, and the efficiency of statistics is not high.
As can be seen here, need a kind of new film types detection system, adopt the mode of detection of electrons and electronics statistics to substitute original manual detection and complicate statistics mode, improve the automaticity of whole detection system, avoid too much manual intervention.
Summary of the invention
In order to solve the problem, the invention provides a kind of film types detection system based on spectators' viewing Expression Recognition, described detection system is arranged on film and plays place, first high efficiency image processing techniques is adopted to detect the viewing expression of multiple spectators, then based on the viewing expression programming count film types of multiple spectators, like this, only need collect before showing film and playing multiple spectators carry out viewing can when film finishes automatic acquisition film types.
According to an aspect of the present invention, provide a kind of film types detection system based on spectators' viewing Expression Recognition, described detection system comprises digital signal processor and multiple Expression Recognition subsystem, each Expression Recognition subsystem is positioned on the back of spectators' seat, for identifying the facial expression of the viewing spectators of described spectators' heater, described digital signal processor is connected respectively with described multiple Expression Recognition subsystem, receive multiple facial expression, and determine the film types of current broadcasting based on described multiple facial expression.
More specifically, in the described film types detection system based on spectators' viewing Expression Recognition, also comprising: cinematic movie presentation device, for playing film to be shown, and sending when film starts broadcasting and film terminates broadcasting start broadcasting signal and off-the-air signal respectively, RS232 serial communication device, is connected with described cinematic movie presentation device, for start broadcasting described in receiving signal or described off-the-air signal, USB connection interface, for inserting outside USB flash disk, every data that in the outside USB flash disk of automatic reading, predetermined storage area stores, described every data comprise default eye reference pattern, preset eyebrow reference pattern and default mouth reference pattern, described default eye reference pattern is the image taken in advance benchmark eye, described default eyebrow reference pattern is the image taken in advance benchmark eyebrow, and described default mouth reference pattern is the image taken in advance benchmark mouth, static storage device, is connected with described USB connection interface, for receiving and storing described every data, LCDs, is connected with described digital signal processor, to receive and to show the film types of described current broadcasting that described digital signal processor exports, each Expression Recognition subsystem comprises timer, CMOS vision camera, servicing lighting, image segmentation apparatus and single-chip microcomputer: timer, for the shooting of CMOS vision camera provides timing signal, CMOS vision camera, is connected with described timer, and based on the facial expression of described timing signal every default timing interval shooting once corresponding viewing spectators, to export viewer expression image, the resolution of described viewer expression image is 1920 × 1080, servicing lighting, comprises lighting source and luminance sensor, and described lighting source is connected with described luminance sensor, and the ambient brightness exported based on described luminance sensor determines the brightness of the floor light light being supplied to described CMOS vision camera, image segmentation apparatus, be connected respectively with described CMOS vision camera and described static storage device, based on described default eye reference pattern, described default eyebrow reference pattern and described default mouth reference pattern match spectators' ocular respectively from described viewer expression image, spectators brow region and spectators' mouth region, and by described spectators' ocular, described spectators brow region and described spectators' mouth region split respectively from described viewer expression image, to obtain described spectators' eye subimage respectively, described spectators' eyebrow subimage and described spectators' mouth subimage, single-chip microcomputer, be connected respectively with described image segmentation apparatus and described static storage device, the amplitude that spectators' eye opens is determined based on described spectators' eye subimage, the shape of spectators' eyebrow movement is determined based on described spectators' eyebrow subimage, the amplitude that spectators' mouth opens is determined based on described spectators' mouth subimage, and export viewer expression based on BP neural network, the amplitude that described BP neural network adopts described spectators' eye to open, the amplitude that the shape of described spectators' eyebrow movement and described spectators' mouth open is as input, to fear, indignation, grieved, glad, detest, one of these 7 kinds of viewer expression surprised and tranquil are as exporting, adopt the training sample preset and the test sample book of presetting, adopt BP algorithm as learning algorithm, wherein said default training sample, described default test sample book and described BP algorithm are all stored in described static storage device, described digital signal processor and described RS232 serial communication device, described static storage device is connected respectively with described multiple Expression Recognition subsystem, when starting broadcasting signal described in receiving, start described multiple Expression Recognition subsystem to receive the viewer expression of each Expression Recognition subsystem timing output, when receiving described off-the-air signal, close described multiple Expression Recognition subsystem to stop receiving the viewer expression of each Expression Recognition subsystem output, and when receiving described off-the-air signal based on the film types of the described current broadcasting of all viewer expression statistics received, wherein, each Expression Recognition subsystem also comprises infrared detector, whether the viewing spectators for detecting corresponding spectators' heater exist, and in the non-existent situation of viewing spectators corresponding spectators' heater being detected, shutdown signal is sent to described digital signal processor, described digital signal processor, when receiving described shutdown signal, cuts out the Expression Recognition subsystem sending the infrared detector place of shutdown signal, lighting source determines that based on the ambient brightness that described luminance sensor exports the brightness of the floor light light being supplied to described CMOS vision camera comprises: the brightness adjusting described floor light light makes the brightness of described floor light light and described ambient brightness be inversely proportional to.
More specifically, in the described film types detection system based on spectators' viewing Expression Recognition, also comprise: power-supply unit, for each component devices in described detection system except described power-supply unit provides power supply supply.
More specifically, in the described film types detection system based on spectators' viewing Expression Recognition, described power-supply unit is positioned at the control machine room that described film plays place.
More specifically, in the described film types detection system based on spectators' viewing Expression Recognition, described timer provided a timing signal every 10 seconds.
More specifically, in the described film types detection system based on spectators' viewing Expression Recognition, described cinematic movie presentation device, described RS232 serial communication device, described USB connection interface, described static storage device and described digital signal processor are all positioned at the control machine room that described film plays place.
More specifically, in the described film types detection system based on spectators' viewing Expression Recognition, described RS232 serial communication device, described USB connection interface, described static storage device and described digital signal processor are integrated on one piece of surface-mounted integrated circuit.
Accompanying drawing explanation
Below with reference to accompanying drawing, embodiment of the present invention are described, wherein:
Fig. 1 is the block diagram of the film types detection system based on spectators' viewing Expression Recognition illustrated according to an embodiment of the present invention.
Fig. 2 is the block diagram of the Expression Recognition subsystem of the film types detection system based on spectators' viewing Expression Recognition illustrated according to an embodiment of the present invention.
Embodiment
Below with reference to accompanying drawings the embodiment of the film types detection system based on spectators' viewing Expression Recognition of the present invention is described in detail.
Film is the important tool of the daily amusement of people.According to the different criteria for classifying, the division of film types has various ways.
The first dividing mode, according to scene partitioning, film personage being appeared at criminal offence field is decided to be crime sheet, personage is appeared at nihilism, the film in existential field is decided to be black patch, being decided to be epic by occurring in film in the past, the film occurring in future or space being decided to be science fiction film, the film relating to sports items is decided to be sports film, the film relating to field, battlefield being decided to be war film, being decided to be Western by relating to US West from the colony epoch to the film in modern times.
The second dividing mode, divide according to the mood of spectators, action movie is decided to be by relating to the film that violence or physics strength carries out fighting, danger will be comprised, the film of risk and opportunity is decided to be adventure movie, the film attempting to cause spectators' laugh is decided to be comedy, the film mainly paying close attention to role's development is decided to be feature film, the film of the illusory content related to outside reality is decided to be fantasy film, the film attempting to cause spectators' fear is decided to be horror film, the film relating to reasoning from logic is decided to be reasoning sheet, the film relating to Romance element is decided to be romance movie, horror film is decided to be by attempting to cause the excitement of spectators or the film of anxiety.
The third dividing mode, divides according to the form of shooting, can be divided into cartoon, biographical film, documentary film, musical film and short-movie.
4th kind of dividing mode, divides according to the viewer age of applicable viewing, can be divided into film for children, family's sheet and adult.
Wherein, be the second dividing mode on the larger dividing mode of spectators' impact, the films types that can watch determined by spectators' needs according to oneself health, if do not have correlation type prompting and spectators to have selected inappropriate film, consequence is by hardly imaginable.Such as, if the spectators with heart disease or angiocardiopathy have falsely dropped the horror film that plot is too exaggerated, probably caused spectators to trigger disease, caused serious personal injury.
The Type division treating released movies in prior art engages several professional celluloid personage to watch usually, and fill up a form afterwards, relevant staff adds up.This mode of prior art too relies on manually, the low and inadequate science of efficiency.
The present invention has built a kind of film types detection system based on spectators' viewing Expression Recognition, treating the expression automatically according to each spectators of facial expression analysis multiple period of audience in released movies playing process, institute's espressiove of accumulative all spectators is added up, and obtains by the type treating released movies of watching.Whole detection system without the need to manually participate in can automatic analysis go out films types, and detection mode rationality and accuracy higher.
Fig. 1 is the block diagram of the film types detection system based on spectators' viewing Expression Recognition illustrated according to an embodiment of the present invention, described detection system is positioned at film and plays place, comprise: digital signal processor 2 and multiple Expression Recognition subsystem 1, the quantity of described multiple Expression Recognition subsystem 1 is n, n be more than or equal to 1 natural number, described digital signal processor 2 is connected respectively with described multiple Expression Recognition subsystem 1.
Wherein, each Expression Recognition subsystem 1 is positioned on the back of spectators' seat, for identifying the facial expression of the viewing spectators of described spectators' heater, described digital signal processor 2 receives multiple facial expression, and determines the film types of current broadcasting based on described multiple facial expression.
Then, continue to be further detailed the concrete structure of the film types detection system based on spectators' viewing Expression Recognition of the present invention.
Described detection system also comprises: cinematic movie presentation device, for playing film to be shown, and sends when film starts broadcasting and film terminates broadcasting start broadcasting signal and off-the-air signal respectively.
Described detection system also comprises: RS232 serial communication device, is connected with described cinematic movie presentation device, for start broadcasting described in receiving signal or described off-the-air signal.
Described detection system also comprises: USB connection interface, for inserting outside USB flash disk, every data that in the outside USB flash disk of automatic reading, predetermined storage area stores, described every data comprise default eye reference pattern, preset eyebrow reference pattern and default mouth reference pattern, described default eye reference pattern is the image taken in advance benchmark eye, described default eyebrow reference pattern is the image taken in advance benchmark eyebrow, and described default mouth reference pattern is the image taken in advance benchmark mouth.
Described detection system also comprises: static storage device, is connected with described USB connection interface, for receiving and storing described every data.
Described detection system also comprises: LCDs, is connected with described digital signal processor 2, to receive and to show the film types of described current broadcasting that described digital signal processor 2 exports.
As shown in Figure 2, each Expression Recognition subsystem 1 comprises timer 11, CMOS vision camera 13, servicing lighting 12, image segmentation apparatus 14 and single-chip microcomputer 15.
Described timer 11, for the shooting of CMOS vision camera 13 provides timing signal; Described CMOS vision camera 13 is connected with described timer 11, based on the facial expression of described timing signal every default timing interval shooting once corresponding viewing spectators, to export viewer expression image, the resolution of described viewer expression image is 1920 × 1080.
Described servicing lighting 12 comprises lighting source and luminance sensor, and described lighting source is connected with described luminance sensor, and the ambient brightness exported based on described luminance sensor determines the brightness of the floor light light being supplied to described CMOS vision camera 13.
Described image segmentation apparatus 14 is connected respectively with described CMOS vision camera 13 and described static storage device, based on described default eye reference pattern, described default eyebrow reference pattern and described default mouth reference pattern match spectators' ocular respectively from described viewer expression image, spectators brow region and spectators' mouth region, and by described spectators' ocular, described spectators brow region and described spectators' mouth region split respectively from described viewer expression image, to obtain described spectators' eye subimage respectively, described spectators' eyebrow subimage and described spectators' mouth subimage.
Described single-chip microcomputer 15 is connected respectively with described image segmentation apparatus 14 and described static storage device, the amplitude that spectators' eye opens is determined based on described spectators' eye subimage, the shape of spectators' eyebrow movement is determined based on described spectators' eyebrow subimage, determine based on described spectators' mouth subimage the amplitude that spectators' mouth opens, and export viewer expression based on BP neural network.
The amplitude that the amplitude that described BP neural network adopts described spectators' eye to open, the shape of described spectators' eyebrow movement and described spectators' mouth open is as input, to fear, indignation, grieved, glad, detest, one of these 7 kinds of viewer expression surprised and tranquil are as exporting, adopt the training sample preset and the test sample book of presetting, adopt BP algorithm as learning algorithm, wherein said default training sample, described default test sample book and described BP algorithm are all stored in described static storage device.
Described digital signal processor 2 and described RS232 serial communication device, described static storage device is connected respectively with described multiple Expression Recognition subsystem 1, when starting broadcasting signal described in receiving, start described multiple Expression Recognition subsystem 1 to receive the viewer expression of each Expression Recognition subsystem timing output, when receiving described off-the-air signal, close described multiple Expression Recognition subsystem 1 to stop receiving the viewer expression of each Expression Recognition subsystem 1 output, and when receiving described off-the-air signal based on the film types of the described current broadcasting of all viewer expression statistics received.
Wherein, each Expression Recognition subsystem 1 can also comprise infrared detector, whether the viewing spectators for detecting corresponding spectators' heater exist, and in the non-existent situation of viewing spectators corresponding spectators' heater being detected, shutdown signal is sent to described digital signal processor 2, described digital signal processor 2, when receiving described shutdown signal, cuts out the Expression Recognition subsystem 1 sending the infrared detector place of shutdown signal; Lighting source determines that based on the ambient brightness that described luminance sensor exports the brightness of the floor light light being supplied to described CMOS vision camera 13 comprises: the brightness adjusting described floor light light makes the brightness of described floor light light and described ambient brightness be inversely proportional to.
Wherein, described detection system can also comprise: power-supply unit, for each component devices in described detection system except described power-supply unit provides power supply supply; Described power-supply unit can be positioned at the control machine room that described film plays place; Described timer 11 can be selected to provide a timing signal every 10 seconds; Described cinematic movie presentation device, described RS232 serial communication device, described USB connection interface, described static storage device and described digital signal processor 2 can be positioned at the control machine room that described film plays place, and alternatively, described RS232 serial communication device, described USB connection interface, described static storage device and described digital signal processor 2 are integrated on one piece of surface-mounted integrated circuit.
In addition, CMOS (Complementary Metal-Oxide-Semiconductor), Chinese formal name used at school is complementary metal oxide semiconductor (CMOS), and he is originally a kind of important chip in computer system, saves the data that System guides is the most basic.Manufacturing technology and the general computer chip of CMOS do not have difference, mainly utilize the semiconductor that silicon and this two kinds of elements of germanium are made, make it on CMOS, co-exist the semiconductor of band N (band-electricity) and P (band+electricity) level, the electric current that these two complementary effects the produce chip that can be processed is noted down and is interpreted to image.Found that CMOS also can as the imageing sensor in digital photography through processing afterwards.
Cmos sensor also can be subdivided into passive type element sensor (Passive Pixel Sensor CMOS) and active pixel sensor (Active Pixel Sensor CMOS).The prerequisite that up-to-date cmos sensor obtains widespread use is its higher sensitivity had, compared with short exposure time and the Pixel Dimensions that day by day reduces.A yardstick of pixel sensitivity is the fill factor, curve factor ratio of whole elemental area (photosensitive area with) and the product of quantum efficiency (quantity of the electronics generated by the photon bombarding screen).Ccd sensor has a very large fill factor, curve factor because of the inherent characteristic of its technology.And in cmos image sensors, in order to realize the noise objective that may compare favourably with CCD converter and level of sensitivity, people are to cmos image sensor fit on CMOS active pixel sensor (APS), and cause fill factor, curve factor to reduce, reason is that the sizable a part of area of Pixel surface is exaggerated shared by device transistor, and the free space leaving photodiode for is less.So the important development goal of of current cmos sensor expands fill factor, curve factor exactly.
Sai Pulasi (FillFactory), by a technology of its patented mandate, can improve fill factor, curve factor significantly, and this technology can become one piece of photosensitive region a part of area maximum for standard CMOS silicon.Along with diminishing of Pixel Dimensions, improving fill factor, curve factor comes more difficult, current most popular technology is from photosensitizing type (FSI before traditional, Front Side Illumination) become back photosensitizing type (BSI, Back Side Illumination), the transistors such as amplifier and interconnection circuit are placed in back, and front portion all leaves photodiode for, so just achieve the fill factor, curve factor of 100%.In addition, for a typical industrial image sensor, the shooting due to many scenes is all carry out when lighting condition is very poor, and therefore having larger dynamic range will be very useful.
Cmos image sensor achieves this target by multi slope operation: transformation curve is made up of the straight line portion that inclination is different, and they together form a nonlinear characteristic curve.Therefore, the darkness part of a width scene likely occupies a big chunk of integrating analog-to-digital converter conversion range: converting characteristic curve is the most precipitous here, to realize high sensitivity and contrast.Light at image is caught the overexposure of several order of magnitude by the leveling of characteristic curve the first half, and shows them with a more careful scale.Adopt the mode of multi slope to operate LUPA-4000 to match making up to the optical dynamic range of 90dB and 10 A/D conversion ranges.There is the IM-001 series cmos image sensor of VGA resolution on this basis further; They aim at automobile application and design.Its pixel is made up of photodiode, can provide the adaptive dynamic range up to 120dB.ACM 100 camera model towards automobile application just have employed these sensors, and this camera model it is said it is the fully integratedization camera solution taking the lead in like product appearing on the market: this vision solution is counted as the key element following the tracks of the future automobile security system of guiding towards driver's protection, crashproof, night vision support and tire.
In addition, for the portable use independent of electrical network, the CMOS technology famous with low power consumption characteristic also has an obvious advantage: cmos image sensor designs for 5V and 3.3V supply voltage.CCD chip then needs the supply voltage of about 12V, employing electric pressure converter of therefore having to, thus causes power consumption to increase.In total power consumption, another benefit will be brought in control and system function integration to cmos sensor: he eliminates all external connection lines with other semiconductor elements.Nowadays the driver of its high power consumption is abandoned, this is because carry out communicating consumed energy than much lower by the outside implementation of PCB or substrate at chip internal.
Adopt the film types detection system based on spectators' viewing Expression Recognition of the present invention,, testing mechanism backward technology problem not high for existing film types detecting pattern detection efficiency, according to the projection operation start of cinematic movie presentation device to the extraction of the facial expression of each spectators, and the facial expression of each period of accumulative all spectators is finally to add up the type of the film determining to be played, detection efficiency of the present invention is higher, and testing mechanism is more advanced.
Be understandable that, although the present invention with preferred embodiment disclose as above, but above-described embodiment and be not used to limit the present invention.For any those of ordinary skill in the art, do not departing under technical solution of the present invention ambit, the technology contents of above-mentioned announcement all can be utilized to make many possible variations and modification to technical solution of the present invention, or be revised as the Equivalent embodiments of equivalent variations.Therefore, every content not departing from technical solution of the present invention, according to technical spirit of the present invention to any simple modification made for any of the above embodiments, equivalent variations and modification, all still belongs in the scope of technical solution of the present invention protection.

Claims (7)

1. the film types detection system based on spectators' viewing Expression Recognition, be positioned at film and play place, described detection system comprises digital signal processor and multiple Expression Recognition subsystem, each Expression Recognition subsystem is positioned on the back of spectators' seat, for identifying the facial expression of the viewing spectators of described spectators' heater, described digital signal processor is connected respectively with described multiple Expression Recognition subsystem, receive multiple facial expression, and determine the film types of current broadcasting based on described multiple facial expression.
2., as claimed in claim 1 based on the film types detection system of spectators' viewing Expression Recognition, it is characterized in that, described detection system also comprises:
Cinematic movie presentation device, for playing film to be shown, and sends when film starts broadcasting and film terminates broadcasting start broadcasting signal and off-the-air signal respectively;
RS232 serial communication device, is connected with described cinematic movie presentation device, for start broadcasting described in receiving signal or described off-the-air signal;
USB connection interface, for inserting outside USB flash disk, every data that in the outside USB flash disk of automatic reading, predetermined storage area stores, described every data comprise default eye reference pattern, preset eyebrow reference pattern and default mouth reference pattern, described default eye reference pattern is the image taken in advance benchmark eye, described default eyebrow reference pattern is the image taken in advance benchmark eyebrow, and described default mouth reference pattern is the image taken in advance benchmark mouth;
Static storage device, is connected with described USB connection interface, for receiving and storing described every data;
LCDs, is connected with described digital signal processor, to receive and to show the film types of described current broadcasting that described digital signal processor exports;
Each Expression Recognition subsystem comprises:
Timer, for the shooting of CMOS vision camera provides timing signal;
CMOS vision camera, is connected with described timer, and based on the facial expression of described timing signal every default timing interval shooting once corresponding viewing spectators, to export viewer expression image, the resolution of described viewer expression image is 1920 × 1080;
Servicing lighting, comprises lighting source and luminance sensor, and described lighting source is connected with described luminance sensor, and the ambient brightness exported based on described luminance sensor determines the brightness of the floor light light being supplied to described CMOS vision camera;
Image segmentation apparatus, be connected respectively with described CMOS vision camera and described static storage device, based on described default eye reference pattern, described default eyebrow reference pattern and described default mouth reference pattern match spectators' ocular respectively from described viewer expression image, spectators brow region and spectators' mouth region, and by described spectators' ocular, described spectators brow region and described spectators' mouth region split respectively from described viewer expression image, to obtain described spectators' eye subimage respectively, described spectators' eyebrow subimage and described spectators' mouth subimage,
Single-chip microcomputer, be connected respectively with described image segmentation apparatus and described static storage device, the amplitude that spectators' eye opens is determined based on described spectators' eye subimage, the shape of spectators' eyebrow movement is determined based on described spectators' eyebrow subimage, the amplitude that spectators' mouth opens is determined based on described spectators' mouth subimage, and export viewer expression based on BP neural network, the amplitude that described BP neural network adopts described spectators' eye to open, the amplitude that the shape of described spectators' eyebrow movement and described spectators' mouth open is as input, to fear, indignation, grieved, glad, detest, one of these 7 kinds of viewer expression surprised and tranquil are as exporting, adopt the training sample preset and the test sample book of presetting, adopt BP algorithm as learning algorithm, wherein said default training sample, described default test sample book and described BP algorithm are all stored in described static storage device,
Described digital signal processor and described RS232 serial communication device, described static storage device is connected respectively with described multiple Expression Recognition subsystem, when starting broadcasting signal described in receiving, start described multiple Expression Recognition subsystem to receive the viewer expression of each Expression Recognition subsystem timing output, when receiving described off-the-air signal, close described multiple Expression Recognition subsystem to stop receiving the viewer expression of each Expression Recognition subsystem output, and when receiving described off-the-air signal based on the film types of the described current broadcasting of all viewer expression statistics received,
Wherein, each Expression Recognition subsystem also comprises infrared detector, whether the viewing spectators for detecting corresponding spectators' heater exist, and in the non-existent situation of viewing spectators corresponding spectators' heater being detected, shutdown signal is sent to described digital signal processor, described digital signal processor, when receiving described shutdown signal, cuts out the Expression Recognition subsystem sending the infrared detector place of shutdown signal;
Wherein, lighting source determines that based on the ambient brightness that described luminance sensor exports the brightness of the floor light light being supplied to described CMOS vision camera comprises: the brightness adjusting described floor light light makes the brightness of described floor light light and described ambient brightness be inversely proportional to.
3., as claimed in claim 2 based on the film types detection system of spectators' viewing Expression Recognition, it is characterized in that, described detection system also comprises:
Power-supply unit, for each component devices in described detection system except described power-supply unit provides power supply supply.
4., as claimed in claim 3 based on the film types detection system of spectators' viewing Expression Recognition, it is characterized in that:
Described power-supply unit is positioned at the control machine room that described film plays place.
5., as claimed in claim 2 based on the film types detection system of spectators' viewing Expression Recognition, it is characterized in that:
Described timer provided a timing signal every 10 seconds.
6., as claimed in claim 2 based on the film types detection system of spectators' viewing Expression Recognition, it is characterized in that:
Described cinematic movie presentation device, described RS232 serial communication device, described USB connection interface, described static storage device and described digital signal processor are all positioned at the control machine room that described film plays place.
7., as claimed in claim 6 based on the film types detection system of spectators' viewing Expression Recognition, it is characterized in that:
Described RS232 serial communication device, described USB connection interface, described static storage device and described digital signal processor are integrated on one piece of surface-mounted integrated circuit.
CN201510101618.1A 2015-03-08 2015-03-08 Movie type detection system based on identification on viewing expressions of audiences Pending CN104680146A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510101618.1A CN104680146A (en) 2015-03-08 2015-03-08 Movie type detection system based on identification on viewing expressions of audiences

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510101618.1A CN104680146A (en) 2015-03-08 2015-03-08 Movie type detection system based on identification on viewing expressions of audiences

Publications (1)

Publication Number Publication Date
CN104680146A true CN104680146A (en) 2015-06-03

Family

ID=53315164

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510101618.1A Pending CN104680146A (en) 2015-03-08 2015-03-08 Movie type detection system based on identification on viewing expressions of audiences

Country Status (1)

Country Link
CN (1) CN104680146A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112115756A (en) * 2020-03-22 2020-12-22 张冬梅 Block chain management platform for content analysis

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101567966A (en) * 2008-04-21 2009-10-28 敦煌天池股份有限公司 Surveillance camera unit with light source
US20120222057A1 (en) * 2011-02-27 2012-08-30 Richard Scott Sadowsky Visualization of affect responses to videos
CN102929660A (en) * 2012-10-09 2013-02-13 广东欧珀移动通信有限公司 Control method of mood theme of terminal device and terminal device

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101567966A (en) * 2008-04-21 2009-10-28 敦煌天池股份有限公司 Surveillance camera unit with light source
US20120222057A1 (en) * 2011-02-27 2012-08-30 Richard Scott Sadowsky Visualization of affect responses to videos
CN102929660A (en) * 2012-10-09 2013-02-13 广东欧珀移动通信有限公司 Control method of mood theme of terminal device and terminal device

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
张强: "《基于标准模型特征的人脸表情识别研究》", 《中国优秀硕士学位论文全文数据库》, 15 April 2013 (2013-04-15), pages 2 *
张素娥: "《人脸表情识别方法研究》", 《中国优秀硕士学位论文全文数据库》, 15 June 2014 (2014-06-15) *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112115756A (en) * 2020-03-22 2020-12-22 张冬梅 Block chain management platform for content analysis

Similar Documents

Publication Publication Date Title
US10085060B2 (en) Integrated solution method and system for monitoring cinema content and conducting movie-viewing statistics
US9232149B2 (en) Determining a final exposure setting automatically for a solid state camera without a separate light metering circuit
US8401378B2 (en) Flash control for electronic rolling shutter
US9953428B2 (en) Digital camera unit with simultaneous structured and unstructured illumination
CN100442827C (en) Image pick-up device and image processing method
EP1309189A2 (en) Intelligent TV room
CN100499747C (en) Digital camera
US20090147094A1 (en) Digital imaging device capable of auto-regulating brightness of display panel and brightness auto-regulating method thereof
CN110012244A (en) Solid state image sensor, picture pick-up device and image capture method
CN101300825B (en) Image sensor
CN106603904A (en) Capturing a stable image using an ambient light sensor-based trigger
US10091420B2 (en) Light-emission control apparatus and method for the same
CN104657720A (en) Film type detection method based on audience film-watching expression recognition
EP3354012B1 (en) Imaging system unit cell and methods for dynamic range imaging
CN104869319B (en) Image treatment method and image processor
US20170126966A1 (en) Photography method using gaze detection
US9743009B2 (en) Image processing method and image processing device
JP6149826B2 (en) Imaging apparatus and scene determination method
CN102629068A (en) Photographing apparatus, display control method, and program
CN104680146A (en) Movie type detection system based on identification on viewing expressions of audiences
CN204423394U (en) Based on the film types detection system of spectators' viewing Expression Recognition
CN111583843A (en) System and method for adjusting screen brightness of single camera
CN102915720A (en) DIsplay apparatus and control method thereof
Wolf et al. Smart Camera Design
CA2732558C (en) Apparatus and method for utilizing a flash led as a video indicator light

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20150603

RJ01 Rejection of invention patent application after publication