CN109255652B

CN109255652B - Advertisement playing method based on human face and related product

Info

Publication number: CN109255652B
Application number: CN201810973879.6A
Authority: CN
Inventors: 张磊
Original assignee: Shenzhen Kep Technology Co ltd
Current assignee: SHENZHEN KEP TECHNOLOGY Co.,Ltd.
Priority date: 2018-08-24
Filing date: 2018-08-24
Publication date: 2021-09-03
Anticipated expiration: 2038-08-24
Also published as: CN109255652A

Abstract

The present disclosure provides a face-based advertisement playing method and related products, the method comprising the steps of: the method comprises the steps that a terminal collects a first picture, and carries out face recognition on the first picture to determine a first identity of the first picture; extracting preference information of the first identity, and acquiring advertisements matched with the preference information; the terminal controls the display screen to play the advertisement. The technical scheme provided by the application plays the advertisement according to the face, and improves the advantage of individuation of advertisement playing.

Description

Advertisement playing method based on human face and related product

Technical Field

The invention relates to the technical field of culture media, in particular to an advertisement playing method based on human faces and a related product.

Background

The elevator advertisement is a new type advertisement medium, it refers to the advertisement carrier made and published on the inner wall of the elevator of the city building. The elevator has various advertisement types, mainly comprises a commercial elevator and a building elevator, and has the expression form that a photo frame is installed in an elevator car, and the advertisement type is directly installed on an elevator door.

The existing elevator advertisement is developed to realize the playing of the advertisement through a liquid crystal display screen, for example, the elevator advertisement of a mass media, the playing of the existing advertisement is in a fixed playing mode, different advertisements cannot be played according to different users, and therefore the playing of the existing advertisement cannot be personalized.

Disclosure of Invention

The embodiment of the invention provides an advertisement playing method based on a human face and a related product, which can realize playing based on human face recognition, so that the advertisement playing method has the advantage of personalized playing.

In a first aspect, an embodiment of the present invention provides a method for playing an advertisement based on a human face, where the method includes:

the method comprises the steps that a terminal collects a first picture, and carries out face recognition on the first picture to determine a first identity of the first picture;

extracting preference information of the first identity, and acquiring advertisements matched with the preference information;

the terminal controls the display screen to play the advertisement.

Optionally, the acquiring the advertisement matched with the preference information specifically includes:

and extracting the promotion object corresponding to the first advertisement, and determining the first advertisement as the advertisement matched with the preference information if the preference information comprises the promotion object.

Optionally, the method further includes:

the floor of the user is determined according to the first identity and the floor command is sent to the elevator controller, and the floor command is used for indicating the elevator to run to the floor.

Optionally, the method further includes:

recording the first advertisement into a historical viewing record of the first identity.

In a second aspect, a terminal is provided, which includes: a processor, a camera and a display screen,

the camera is used for acquiring a first picture;

the processor is used for carrying out face recognition on the first picture to determine a first identity of the first picture; extracting preference information of the first identity, and acquiring advertisements matched with the preference information; and controlling the display screen to play the advertisement.

Optionally, the processing unit is specifically configured to extract a promotional item corresponding to the first advertisement, and determine that the first advertisement is an advertisement matched with the preference information if the preference information includes the promotional item.

Optionally, the terminal further comprises a communication unit,

the processing unit is further used for determining the floor of the user according to the first identity, and controlling the communication unit to send the floor command to the elevator controller, wherein the floor command is used for indicating the elevator to run to the floor.

Optionally, the processing unit is specifically configured to record the first advertisement into a historical viewing record of the first identity.

Optionally, the terminal is: a tablet computer or a personal computer.

In a third aspect, a computer-readable storage medium is provided, which stores a program for electronic data exchange, wherein the program causes a terminal to execute the method provided in the first aspect.

The embodiment of the invention has the following beneficial effects:

therefore, the technical scheme provided by the application can be used for carrying out face recognition on the user to determine the first identity of the user, determining the favorite information according to the first identity, searching the advertisement matched with the favorite information, and playing the first advertisement, so that the played advertisement can be personalized and adjusted according to the face information, and the elevator advertisement playing method has the advantage of personalized playing of elevator advertisements.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.

Fig. 1 is a schematic structural diagram of a terminal.

Fig. 2 is a flow chart of a method for playing advertisements based on human faces.

Fig. 3 is a schematic structural diagram of a terminal according to an embodiment of the present invention.

Detailed Description

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

The terms "first," "second," "third," and "fourth," etc. in the description and claims of the invention and in the accompanying drawings are used for distinguishing between different objects and not for describing a particular order. Furthermore, the terms "include" and "have," as well as any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements listed, but may alternatively include other steps or elements not listed, or inherent to such process, method, article, or apparatus.

Reference herein to "an embodiment" means that a particular feature, result, or characteristic described in connection with the embodiment can be included in at least one embodiment of the invention. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is explicitly and implicitly understood by one skilled in the art that the embodiments described herein can be combined with other embodiments.

Referring to fig. 1, fig. 1 is a schematic structural diagram of a terminal (advertisement playing terminal), as shown in fig. 1, the terminal may include a computer device, specifically, a tablet computer, a personal computer or a terminal, where the personal computer is, for example, an iOS personal computer, a Windows personal computer, etc. For convenience of description, hereinafter, referred to as a terminal, as shown in fig. 1, the terminal includes: processor 101, display screen 104, communication module 102, memory 103 and camera 105.

The processor 101 is a control center of the terminal, connects various parts of the entire terminal using various interfaces and lines, and performs various functions of the terminal and processes data by operating or executing software programs and/or modules stored in the memory 103 and calling data stored in the memory 103, thereby integrally monitoring or controlling the terminal. Alternatively, processor 101 may include one or more processing units; optionally, the processor 101 may integrate an application processor, a modem processor, and an artificial intelligence chip, wherein the application processor mainly processes an operating system, a user interface, an application program, and the like.

Further, the memory 104 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.

The communication module 103 may be used for receiving and transmitting information. In general, the communication module 103 includes, but is not limited to, an antenna, at least one Amplifier, a transceiver, a coupler, a Low Noise Amplifier (LNA), a duplexer, and the like. In addition, the communication module 103 can also communicate with a network and other devices through wireless communication. The wireless communication may use any communication standard or protocol, such as a mobile communication protocol or a short-range communication protocol (including but not limited to bluetooth, WIFI, etc.).

The display screen 104 may be used for displaying advertisements, and may specifically be an LCD display screen, but may also be other forms of display screens, such as a touch display screen.

The camera 105 is specifically used for capturing pictures or videos.

The terminal further includes a power supply (e.g., a battery) for supplying power to the various components, and optionally, the power supply may be logically connected to the processor 101 through a power management system, so that functions of managing charging, discharging, and power consumption are implemented through the power management system.

Referring to fig. 2, fig. 2 provides a method for playing an advertisement based on a human face, where the method is shown in fig. 2 and executed by a terminal shown in fig. 1, and the method includes the following steps:

step S201, a terminal collects a first picture, and carries out face recognition on the first picture to determine a first identity of the first picture;

the face recognition algorithm may specifically adopt an existing face recognition algorithm, for example, a Baidu face recognition algorithm, a Google face recognition algorithm, a Tencent face recognition algorithm, and the like.

Step S02, extracting the favorite information of the first identity, and acquiring the advertisement matched with the favorite information;

the preference information includes, but is not limited to: the preference of the first identity and the shopping information of the first identity may be obtained in a manner of requesting from the server, or may include other manners, such as presetting a questionnaire to the user, and determining the preference information of the user according to the questionnaire of the user.

The advertisement matched with the preference information may specifically include: and extracting the promotion object corresponding to the first advertisement, and determining the first advertisement as the advertisement matched with the preference information if the preference information comprises the promotion object.

For example, if the user prefers a vehicle, the promotional item corresponding to the first advertisement is a speed, and the vehicle contains a speed, then the speed is determined to be an advertisement matching the vehicle.

And step S203, the terminal controls the display screen to play the advertisement.

The technical scheme provided by the application carries out face recognition on the user to determine the first identity of the user, determines the favorite information according to the first identity, then searches the advertisement matched with the favorite information, and plays the first advertisement, so that the played advertisement can be personalized and adjusted according to the face information, and the elevator advertisement personalized playing method has the advantage of personalized playing of elevator advertisements.

Specifically, the manner of determining the first identity of the first picture by performing face recognition on the first picture may be that the first picture is input to a neural network model to perform a multilayer operation to obtain a forward operation result, and the identity of the first picture is determined according to the forward operation result.

If the performing the multi-layer operation includes a convolution operation, and the convolution kernel is a 3 × 3 convolution kernel, the performing the convolution operation may specifically include:

determining input data [ CI ] [ H ] [ W ] and convolution Kernel [ CO ] [ CI ] [3] [3] of convolution operation, cutting the convolution Kernel [ CO ] [ CI ] [3] [3] along the CO direction to form CO Kernel [ CI ] [3] [3], performing three-dimensional convolution operation on the CO Kernel [ CI ] [3] [3] and the input data to obtain CO three-dimensional convolution results, and combining the CO three-dimensional convolution results along the CO direction to obtain a final output result [ CO ] [ CI ] [ H ] [ 2] [ W-2 ].

The one-time three-dimensional convolution operation may specifically include, for example, cutting the input data [ CI ] [ H ] [ W ] into CI pieces of [ H ] [ W ] along the CI direction, cutting the Kernel [ CI ] [3] [3] into CI pieces of Kernel [3] [3] along the CI direction, performing convolution operation on [ H ] [ W ] and Kernel [3] [3] that are the same in the CI direction to obtain CI pieces of [ H-2] [ W-2], and arranging the CI pieces of [ H-2] [ W-2] along the CI direction to obtain the three-dimensional convolution result [ CI ] [ H ] [ 2] [ W-2 ].

The CI is a depth value, H is a height value, W is a width value, and CO is a number value which are integers more than or equal to 5.

The obtaining of CI [ H-2] [ W-2] by performing convolution operation on [ H ] [ W ] and Kernel [3] [3] that are the same in the CI direction may specifically include:

cutting the [ H ] [ W ] into H-2 matrixes [3] [ W ] along the H direction, performing convolution calculation on each matrix [3] [ W ] and Kernel [3] [3] to obtain a result of one row in the H direction in the [ H-2] [ W-2], and calculating the H-2 matrixes [3] [ W ] to obtain a result of the H-2 row to obtain a calculation result [ H-2] [ W-2 ];

the obtaining a row result in the H direction by performing convolution operation on the matrix [3] [ W ] and the Kernel [3] [3] may specifically include:

if w is 6, then the matrix [3] is set][6]Is cut into 3 [3] s by a moving step 1][4]Sub-matrix [3]][4]₁、[3][4]₂、[3][4]₃Where the lower corner marks the sequence number of the submatrix, pair [3]][4]₁Performing a unit operation to obtain [ H-2][W-2]The unit operation specifically includes: will [3]][4]₁Extracting 4 elements in a row in the H direction each time, performing inner product on the first 3 elements of the 4 elements and the elements at the corresponding positions of the convolution Kernel to obtain a row of inner product results, and multiplying the last element of the 4 th element and the corresponding element of the convolution Kernel to obtain a product result, wherein the corresponding element of the convolution Kernel is Kernel [3]][3]The middle height value is the value for extracting one row in H direction, and the width value is the serial number of the submatrix (if extracting [3]][4]₁When H is 1, the element at the corresponding position is the 1 st element, and when H is 2, the element at the corresponding position is the 4 th element, if extracted [3]][4]₂When H is 1, the element at the corresponding position is the 2 nd element, and when H is 2, the element at the corresponding position is the 5 th element), 3 times of unit operation is performed to obtain 3 inner product results and 3 product results, the 3 inner product results are added to obtain one element value, the 3 inner product results are added to obtain the sum of the first sequence number, and [3] pair of the sum of the first sequence number is obtained][4]₂、[3][4]₃Also performs unit operation to obtain [ H-2][W-2]The other element value, the further element value, the sum of the second ordinal number and the sum of the third ordinal number in the row in the H direction in [ H-2] is obtained by adding the sum of the first ordinal number, the sum of the second ordinal number and the sum of the third ordinal number][W-2]One more element value of a row in the H direction; one element value, another element value, yet another element value, and yet another elementThe values are arranged along the w direction to obtain the result of one row in the H direction.

If w is greater than 6, the matrix is cut 3 times by the moving step 1, and the moving step in the w direction is converted into cutting the sub-matrix 2 times, which is equivalent to leaving one row of data in the w direction because the row of data has already been calculated.

For the scheme, the technical effect is that for the convolution data extraction, the existing equipment extracts data which are 128 bits each time, and because the existing data are based on the operation of floating point data, each floating point data is composed of 32 bits regardless of the size, the data which is 128 bits is extracted once is just one row of data in the H direction, when the data is extracted once, the same H data is only recorded once, namely 4 values are only recorded with one H data, so that the data extraction efficiency is saved, and the data extraction amount is also reduced.

Optionally, the method may further include:

Referring to fig. 3, fig. 3 provides a terminal including: a processor 301, a camera 302 and a display 303,

the camera is used for acquiring a first picture;

An embodiment of the present invention further provides a computer storage medium, where the computer storage medium stores a computer program for electronic data exchange, and the computer program enables a computer to execute part or all of the steps of any one of the face-based advertisement playing methods described in the above method embodiments.

Embodiments of the present invention also provide a computer program product, which includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to cause a computer to execute some or all of the steps of any one of the face-based advertisement playing methods described in the above method embodiments.

It should be noted that, for simplicity of description, the above-mentioned method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present invention is not limited by the order of acts, as some steps may occur in other orders or concurrently in accordance with the invention. Further, those skilled in the art should also appreciate that the embodiments described in the specification are exemplary embodiments and that the acts and modules illustrated are not necessarily required to practice the invention.

In the foregoing embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.

In the embodiments provided in the present application, it should be understood that the disclosed apparatus may be implemented in other manners. For example, the above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units is only one type of division of logical functions, and there may be other divisions when actually implementing, for example, a plurality of units or components may be combined or may be integrated into another system, or some features may be omitted, or not implemented. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of some interfaces, devices or units, and may be an electric or other form.

The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit may be implemented in the form of hardware, or may be implemented in the form of a software program module.

The integrated units, if implemented in the form of software program modules and sold or used as stand-alone products, may be stored in a computer readable memory. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a memory and includes several instructions for causing a computer device (which may be a personal computer, a terminal, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned memory comprises: a U-disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic or optical disk, and other various media capable of storing program codes.

Those skilled in the art will appreciate that all or part of the steps in the methods of the above embodiments may be implemented by associated hardware instructed by a program, which may be stored in a computer-readable memory, which may include: flash Memory disks, Read-Only memories (ROMs), Random Access Memories (RAMs), magnetic or optical disks, and the like.

The above embodiments of the present invention are described in detail, and the principle and the implementation of the present invention are explained by applying specific embodiments, and the above description of the embodiments is only used to help understanding the method of the present invention and the core idea thereof; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.

Claims

1. A face-based advertisement playing method is characterized by comprising the following steps:

the terminal controls the display screen to play the advertisement;

the step of performing face recognition on the first picture to determine the first identity of the first picture comprises: inputting the first picture into a neural network model to execute multilayer operation to obtain a forward operation result, and determining the identity of the first picture according to the forward operation result;

if the performing the multi-layer operation includes convolution operation and the convolution kernel is 3 × 3 convolution kernel, the performing the convolution operation specifically includes:

determining input data [ CI ] [ H ] [ W ] and convolution Kernel [ CO ] [ CI ] [3] [3] of convolution operation, cutting the convolution Kernel [ CO ] [ CI ] [3] [3] along the CO direction to form CO Kernel [ CI ] [3] [3], performing three-dimensional convolution operation on the CO Kernel [ CI ] [3] [3] and the input data to obtain CO three-dimensional convolution results, and combining the CO three-dimensional convolution results along the CO direction to obtain a final output result [ CO ] [ CI ] [ H ] [ 2] [ W-2 ];

the one-time three-dimensional convolution operation specifically comprises the steps of cutting input data [ CI ] [ H ] [ W ] into CI [ H ] [ W ] along the CI direction, cutting Kernel [ CI ] [3] [3] into CI Kernel [3] [3] along the CI direction, performing convolution operation on the [ H ] [ W ] and the Kernel [3] [3] which are the same in the CI direction to obtain CI [ H-2] [ W-2], and arranging the CI [ H-2] [ W-2] along the CI direction to obtain a three-dimensional convolution result [ CI ] [ H ] [ 2] [ W-2 ];

the CI is a depth value, H is a height value, W is a width value, and CO is a quantity value which is an integer more than or equal to 5;

performing convolution operation on the same [ H ] [ W ] and Kernel [3] [3] in the CI direction to obtain CI [ H-2] [ W-2] specifically comprises:

performing convolution operation on the matrix [3] [ W ] and the Kernel [3] [3] to obtain a row of results in the H direction specifically comprises the following steps:

if w =6, the matrix [3] is applied] [6]Is cut into 3 [3] s by a moving step 1] [4]Sub-matrix [3]] [4]₁、[3] [4]₂、[3] [4]₃Where the lower corner marks the sequence number of the submatrix, pair [3]] [4]₁Performing a unit operation to obtain [ H-2][W-2]The unit operation specifically includes: will [3]] [4]₁Extracting 4 elements in a row in the H direction each time, performing inner product on the first 3 elements of the 4 elements and the elements at the corresponding positions of the convolution Kernel to obtain a row of inner product results, and multiplying the last element of the 4 th element and the corresponding element of the convolution Kernel to obtain a product result, wherein the corresponding element of the convolution Kernel is Kernel [3]][3]The middle height value is the value of extracting one row in H direction, the width value is the serial number of the submatrix, 3 times of unit operation is executed to obtain 3 inner product results and 3 product results, the 3 inner product results are added to obtain an element value, the 3 product results are added to obtain the sum of the first serial number, and the [3] row is matched] [4]₂、[3] [4]₃Also performs unit operation to obtain [ H-2][W-2]The other element value, the further element value, the sum of the second ordinal number and the sum of the third ordinal number in the row in the H direction in [ H-2] is obtained by adding the sum of the first ordinal number, the sum of the second ordinal number and the sum of the third ordinal number][W-2]One more element value of a row in the H direction; one element value, another element value, yet another element value, andthe element values are also arranged along the w direction to obtain the result of one row in the H direction.

2. The method of claim 1, wherein the acquiring the advertisement matching the preference information specifically comprises:

3. The method of claim 1, further comprising:

4. The method of claim 3, further comprising:

recording the first advertisement into a historical viewing record for the first identity.

5. A terminal, the terminal comprising: a processor, a camera and a display screen, which is characterized in that,

the camera is used for acquiring a first picture;

the processor is used for carrying out face recognition on the first picture to determine a first identity of the first picture; extracting preference information of the first identity, and acquiring advertisements matched with the preference information; controlling the display screen to play the advertisement;

if w =6, the matrix [3] is applied] [6]Is cut into 3 [3] s by a moving step 1] [4]Sub-matrix [3]] [4]₁、[3] [4]₂、[3] [4]₃Where the lower corner marks the sequence number of the submatrix, pair [3]] [4]₁Performing a unit operation to obtain [ H-2][W-2]The unit operation specifically includes: will [3]] [4]₁Extracting 4 elements in a row in the H direction each time, performing inner product on the first 3 elements of the 4 elements and the elements at the corresponding positions of the convolution Kernel to obtain a row of inner product results, and multiplying the last element of the 4 th element and the corresponding element of the convolution Kernel to obtain a product result, wherein the corresponding element of the convolution Kernel is Kernel [3]][3]The middle height value is a value for extracting one line in the H direction, and the width value is a sub-matrixPerforms 3 unit operations to obtain 3 inner product results and 3 product results, adds the 3 inner product results to obtain an element value, adds the 3 product results to obtain the sum of the first sequence number, and pairs [3]] [4]₂、[3] [4]₃Also performs unit operation to obtain [ H-2][W-2]The other element value, the further element value, the sum of the second ordinal number and the sum of the third ordinal number in the row in the H direction in [ H-2] is obtained by adding the sum of the first ordinal number, the sum of the second ordinal number and the sum of the third ordinal number][W-2]One more element value of a row in the H direction; arranging one element value, another element value and the element value in the w direction to obtain the result of one row in the H direction.

6. The terminal of claim 5,

the processor is specifically configured to extract a promotional object corresponding to the first advertisement, and determine that the first advertisement is an advertisement matched with the preference information if the preference information includes the promotional object.

7. The terminal according to claim 5, characterized in that the terminal further comprises a communication unit,

the processor is further configured to determine a floor of the user based on the first identity, and control the communication unit to send the floor command to the elevator controller, the floor command being used to instruct the elevator to travel to the floor.

8. The terminal of claim 5,

the processor is specifically configured to record the first advertisement into a historical viewing record of the first identity.

9. A terminal according to any of claims 5-8,

the terminal is as follows: a tablet computer or a personal computer.

10. A computer-readable storage medium storing a program for electronic data exchange, wherein the program causes a terminal to perform the method as provided in any one of claims 1-4.