CN112398952A - Electronic resource pushing method, system, equipment and storage medium - Google Patents
Electronic resource pushing method, system, equipment and storage medium Download PDFInfo
- Publication number
- CN112398952A CN112398952A CN202011427872.8A CN202011427872A CN112398952A CN 112398952 A CN112398952 A CN 112398952A CN 202011427872 A CN202011427872 A CN 202011427872A CN 112398952 A CN112398952 A CN 112398952A
- Authority
- CN
- China
- Prior art keywords
- user
- electronic resource
- emotion
- physiological data
- electronic
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/55—Push-based network services
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
- G06F18/214—Generating training patterns; Bootstrap methods, e.g. bagging or boosting
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N20/00—Machine learning
- G06N20/20—Ensemble learning
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Computer Vision & Pattern Recognition (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Artificial Intelligence (AREA)
- General Physics & Mathematics (AREA)
- Evolutionary Computation (AREA)
- Physics & Mathematics (AREA)
- Signal Processing (AREA)
- Computing Systems (AREA)
- Life Sciences & Earth Sciences (AREA)
- Computer Networks & Wireless Communication (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Medical Informatics (AREA)
- Bioinformatics & Computational Biology (AREA)
- Evolutionary Biology (AREA)
- Mathematical Physics (AREA)
- User Interface Of Digital Computer (AREA)
- Hardware Redundancy (AREA)
- Radar Systems Or Details Thereof (AREA)
- Electrotherapy Devices (AREA)
- Telephone Function (AREA)
Abstract
The invention provides an electronic resource pushing method, a system, equipment and a storage medium, wherein the electronic resource pushing method comprises the following steps: acquiring physiological data of a user; obtaining the emotion type of the user according to the physiological data; matching at least one electronic resource according to the emotion type of the user; and pushing the matched electronic resource to the user. According to the electronic resource pushing method, the physiological data of the user is received, the current emotion of the user is analyzed and judged, the electronic resource is matched with the preference of the user in different emotions and pushed to the user, and the effects of relieving and comforting the user when the emotion of the user falls down and stabilizing the user when the user is angry and avoiding conflict upgrading are achieved; the electronic resource pushing system adaptively intervenes the emotion of the user, and intelligent communication between the man and the machine is realized.
Description
Technical Field
The present invention relates to the field of internet, and in particular, to a method, a system, a device, and a storage medium for pushing electronic resources.
Background
With the development of science and technology, more and more devices or apparatuses are used for monitoring various physiological data, some intelligent devices can already read the emotion of a user, but in the technologies, only emotion collection and analysis are carried out on the user, and the requirement that people have greater and greater stress along with the fast rhythm of work and life cannot be met at the moment, so that the method becomes a development direction of human-computer communication intellectualization by monitoring the emotion of the user and pushing personalized emotion-relieving content of the user or providing an emotion soothing means according to the monitored emotion of the user.
It is to be noted that the information disclosed in the above background section is only for enhancement of understanding of the background of the present invention and therefore may include information that does not constitute prior art known to a person of ordinary skill in the art.
Disclosure of Invention
Aiming at the problems in the prior art, the invention aims to provide an electronic resource pushing method, a system, equipment and a storage medium, which realize intelligent communication between a human and a machine by monitoring the emotion of a user and pushing electronic resources for interfering the emotion of the user according to personal preference of the user.
Some embodiments of the present invention provide an electronic resource pushing method, including the following steps:
acquiring physiological data of a user;
obtaining the emotion type of the user according to the physiological data;
matching at least one electronic resource according to the emotion type of the user;
and pushing the matched electronic resource to the user.
According to some examples of this invention, the obtaining of the mood type of the user from the physiological data further comprises the steps of:
inputting the physiological data into the trained emotion classification model of the user to obtain the emotion type of the user;
the trained emotion classification model is established by the following method:
establishing a machine learning model for emotion classification based on the emotion training samples;
and inputting the characteristics of each emotion and the corresponding emotion type into the machine learning model to obtain a trained emotion classification model.
According to some examples of the invention, the obtaining physiological data of the user comprises first physiological data, second physiological data, third physiological data and/or fourth physiological data:
the first physiological data is obtained by:
acquiring an image of a user through image acquisition equipment, acquiring emotional characteristics of the image, and acquiring the first physiological data according to the emotional characteristics of the image;
the second physiological data is obtained by:
acquiring the audio frequency of a user through sound acquisition equipment, acquiring emotional characteristics of the audio frequency, and acquiring the second physiological data according to the emotional characteristics of the audio frequency;
the third physiological data is obtained by a body temperature sensor;
the fourth physiological data is obtained by a heart rate monitor.
According to some examples of this invention, said matching electronic resources according to the mood type of the user comprises the steps of:
acquiring a user emotion intervention feature library according to the user identity;
inputting the emotion type of the user into the user emotion intervention feature library to match at least one electronic resource;
and if the matching fails, inputting the emotion type of the user into the statistical emotion intervention feature library to match at least one electronic resource.
According to some examples of this invention, the method further comprises the steps of:
calculating the matched recommendation index of each electronic resource according to the weight of each electronic resource;
and pushing the electronic resource with the highest recommendation index to the user.
According to some examples of this invention, the method comprises:
acquiring equipment parameters and/or scene parameters of a user;
and obtaining the weight of each electronic resource according to the equipment parameter and the scene parameter.
According to some examples of this invention, the method further comprises the steps of:
acquiring feedback information of the user on the pushed electronic resource;
and if the feedback information is unsatisfactory, pushing the electronic resource with the highest recommendation index to the user according to the obtained recommendation index of each electronic resource.
According to some examples of this invention, after sending the electronic resource to the user, the method further comprises:
acquiring feedback information of the user on the pushed electronic resource;
and if the feedback information is satisfactory, adding the mapping relation between the emotion types and the electronic resources of the user to the user emotional intervention feature library.
According to some examples of the invention, obtaining feedback information of the user on the pushed electronic resource comprises:
obtaining satisfaction degree data input by a user for the pushed electronic resources; or
And monitoring the physiological data of the user, and judging the satisfaction degree data of the user on the pushed electronic resources according to the physiological data.
According to some examples of the invention, physiological data of a user is acquired through a headset of the user terminal, the headset being provided with a heart rate monitor and/or a brain wave detector, the physiological data comprising a heart rate and/or brain waves of the user.
According to some examples of the invention, the headset is further provided with a vibrator and/or an audio generator, the headset generating vibrations and/or playing audio in accordance with the electronic resource after the step of pushing the matched electronic resource to the user.
Still other embodiments of the present invention further provide an electronic resource pushing system, configured to implement the electronic resource pushing method, including a user module, a resource matching module, and an emotion intervention module, where:
the user module is used for acquiring physiological data of a user;
the resource matching module is used for obtaining the emotion type of the user according to the physiological data;
the emotion intervention module is used for matching at least one electronic resource according to the emotion type of the user;
the user module is further used for pushing the electronic resource matched with the emotion type to a user.
Still other embodiments of the present invention further provide an electronic resource pushing device, including:
a processor;
a memory having stored therein executable instructions of the processor;
wherein the processor is configured to perform the steps of the electronic resource pushing method via execution of the executable instructions.
Still other embodiments of the present invention provide a computer-readable storage medium for storing a program, which when executed by a processor implements the steps of the electronic resource pushing method.
According to the electronic resource pushing method, the physiological data of the user is received, the current emotion of the user is analyzed and judged, the electronic resource is matched with the preference of the user in different emotions and pushed to the user, and the effects of relieving and comforting the user when the emotion of the user falls down and stabilizing the user when the user is angry and avoiding conflict upgrading are achieved; the electronic resource pushing system adaptively intervenes the emotion of the user, and intelligent communication between the man and the machine is realized.
Drawings
Other features, objects, and advantages of the invention will be apparent from the following detailed description of non-limiting embodiments, which proceeds with reference to the accompanying drawings and which is incorporated in and constitutes a part of this specification, illustrating embodiments consistent with the present application and together with the description serve to explain the principles of the application. It is obvious that the drawings in the following description are only some embodiments of the invention, and that for a person skilled in the art, other drawings can be derived from them without inventive effort.
Fig. 1 is a flowchart illustrating an electronic resource pushing method according to an embodiment of the invention;
fig. 2 is a flowchart of an electronic resource pushing method according to another embodiment of the invention;
fig. 3 is a schematic structural diagram of an electronic resource pushing system according to an embodiment of the invention;
FIG. 4 is an interaction diagram of an electronic resource pushing system according to an embodiment of the invention;
fig. 5 is a schematic structural diagram of an electronic resource pushing apparatus according to an embodiment of the present invention;
fig. 6 is a schematic structural diagram of a computer-readable storage medium according to an embodiment of the present invention.
Detailed Description
Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments may, however, be embodied in many different forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of example embodiments to those skilled in the art. The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments.
Furthermore, the drawings are merely schematic illustrations of the present disclosure and are not necessarily drawn to scale. The same reference numerals in the drawings denote the same or similar parts, and thus their repetitive description will be omitted. Some of the block diagrams shown in the figures are functional entities and do not necessarily correspond to physically or logically separate entities. These functional entities may be implemented in the form of software, or in one or more hardware modules or integrated circuits, or in different networks and/or processor devices and/or microcontroller devices.
Fig. 1 is a flowchart of an electronic resource pushing method according to an embodiment of the present invention, specifically, the electronic resource pushing method includes the following steps:
s100: acquiring physiological data of a user;
s200: obtaining the emotion type of the user according to the physiological data;
s300: matching at least one electronic resource according to the emotion type of the user;
s400: and pushing the matched electronic resource to the user.
According to the method, firstly, the physiological data of the user is obtained through the step S100, and the emotion type of the user is obtained through the step S200 according to the physiological data, so that at least one electronic resource can be matched according to the emotion type of the user through the step S300 and the step S400, and the matched electronic resource is pushed to the user; the emotion of the user is intervened in a self-adaptive manner, and intelligent communication between a human and a machine is achieved to a certain extent.
In the step S100, the physiological data of the user is acquired, and according to the type or source of the physiological parameter, the physiological data may include first physiological data, second physiological data, third physiological data, and/or fourth physiological data, and the like:
with the development of science and technology, a real scene may include a plurality of user devices, including wearing devices of a user, such as smart glasses, wristbands, watches, earphones and the like, and the user devices may also be smart home systems that can construct a management system for efficient residential facilities (Internet of Things, IOT devices) and family schedule Things, wherein the plurality of IOT devices or the IOT devices and a remote server may be connected through a wired network or a wireless network, and the IOT devices include smart home appliances: such as air-conditioning, television, home entertainment, home theater, central background music system, electric heating, etc.; the physiological data of the user in the step S100 may be acquired by an image acquisition device, a sound acquisition device, or the like of the user device.
As defined first physiological data is obtained by an image acquisition device of a user device, the first physiological data may be obtained by:
the method comprises the steps of obtaining an image of a user through image collection equipment, wherein emotional characteristics of the image are first physiological data of the user, and the emotional characteristics can be facial expressions or body languages of the user.
As defined the second physiological data is obtained by a sound collection device of the user device, the second physiological data being obtained by:
acquiring the audio frequency of a user through sound acquisition equipment, acquiring emotional characteristics of the audio frequency, and acquiring the second physiological data according to the emotional characteristics of the audio frequency;
similarly, the emotional change of the user can also be reflected in the change of the body temperature, and therefore, the body temperature can also be used as the physiological data of the user, i.e. the third physiological data is obtained by the body temperature sensor;
in addition, since the emotional change of the user may also be reflected in the change of the heart rate, the brain wave, and the like, and may also be used as the physiological data of the user, the fourth physiological data is obtained by the heart rate monitor. Of course, the physiological data of the user is not limited to the above-mentioned types, for example, the heart rate, pulsation, brain wave, etc. of the user can be collected by using an earphone worn by the user.
The physiological data of the user of the present invention is not limited to the above-described types and acquisition manners. After obtaining the physiological data of the user, the system executes S200, that is, obtaining the emotion type of the user according to the physiological data further includes the following steps:
inputting the physiological data into the trained emotion classification model of the user to obtain the emotion type of the user;
the trained emotion classification model is established by the following method:
establishing a machine learning model for emotion classification based on the emotion training samples;
and inputting the characteristics of each emotion and the corresponding emotion type into the machine learning model to obtain a trained emotion classification model.
The emotion classification model may include a plurality of models, which may include emotion classification models for images, such as a convolutional neural network algorithm model, and specifically, for an image acquisition device to acquire a user picture, the picture may be classified by a convolutional neural network algorithm, and a group of emotion types related to the emotion of the user, such as excited emotion types, cheerful emotion types, and surprised emotion types, are obtained through a classification result; negative emotion types such as a questionable emotion type, an angry emotion type, a sad emotion type, a distressed emotion type, and the like. The user picture is not limited to be static, but also comprises video collected by an image collecting device, such as video related to head gestures or related to gestures can be analyzed and framed, and emotion types related to emotions of the user can be obtained.
The emotion classification model can comprise an emotion classification model aiming at audio, specifically, the audio of a user is obtained through a sound collection device, the volume, the speech speed and the tone of the sound can be analyzed in real time according to the sound of the client, and the real-time emotion state of the client is determined according to the volume information, the speech speed information and the tone information; if the volume of the sound in the audio of the user is judged to exceed a certain decibel or a set volume threshold, and the number of times or the duration time that the volume exceeds a certain threshold, if so, the emotion of the user is considered to be excited or impulsive. Of course, the second physiological data can also be input to obtain the emotion type of the user through an emotion classification model which is constructed and trained through semantic attributes and prosody attributes in the audio.
The electronic data pushing method of the invention collects the physiological data of the user through intelligent equipment, such as wearing equipment of intelligent glasses, wristbands, watches, earphones and the like, intelligent household equipment, vehicle-mounted equipment and the like, analyzes the emotion of the user, and carries out content recommendation or measures for calming the emotion according to the analyzed emotion types and the hobbies in different emotions, thereby relieving the emotion. Certainly, the triggering of the electronic resource pushing of the present invention is not limited to a specific emotion type, that is, not limited to a negative emotion, but triggers the electronic resource pushing, and when the user is in a positive emotion, the electronic resource pushing of the scene response may also be triggered.
After the system performs step S200, that is, after obtaining the emotion type of the user according to the physiological data of the user, in another embodiment, see fig. 2, said matching the electronic resource according to the emotion type of the user includes the following steps:
s210: acquiring a user emotion intervention feature library according to the user identity;
s310: inputting the emotion type of the user into the user emotion intervention feature library to match at least one electronic resource;
if the matching fails, executing S320: the emotion type of the user is input into a statistical emotional intervention feature library to be matched with at least one electronic resource.
In an embodiment, the user emotional intervention feature library may be stored in the user side, or may be stored in the cloud server, and when the user emotional intervention feature library is stored in the remote server, the system may first identify the user identity, and obtain the corresponding user emotional intervention feature library according to information such as the user identity.
In the above embodiment, the statistical emotional intervention feature database may be regarded as an electronic resource database that obtains preferences of the public when emotional intervention is needed by using historical big data, and includes mapping relationship tables of different emotional types and electronic resources.
And the user emotional intervention feature library can be regarded as an emotional intervention feature library trained or obtained by other means according to the personal preference of each user on the basis of the statistical emotional intervention feature library. The user emotional intervention feature library comprises mapping relations between the emotion types of the users and the electronic resources.
The electronic resource pushing method provided by the invention matches the electronic resource and pushes the electronic resource to the user by combining the user emotion and the personal preference of the user, so that the pushed electronic resource is more accurate, and the emotion intervention effect is better.
In order to achieve a more accurate emotional intervention effect, the electronic resource pushing method of the present invention may further include a step of further improving the user emotional intervention feature library after sending the electronic resource to the user in step S400, where the user emotional intervention feature library may be constructed as shown in fig. 2, and specifically, may include the following steps:
s500: acquiring feedback information of the user on the pushed electronic resource;
if the feedback information is satisfactory, S600: adding the mapping relation between the emotion types of the users and the electronic resources to the user emotion intervention feature library;
and if the feedback information is unsatisfactory, not establishing the mapping relation between the emotion type and the electronic resource of the user.
The electronic resource may be a music file or a video file for soothing a user, or some operation instruction for a device of the user in a scene. For example, according to the electronic resource pushing method of the present invention, an earphone using the method of the present invention may be designed, for example, a sensor for monitoring sound, heartbeat, pulsation, and brain wave is added in the earphone, and a rhythm vibration generator generating similar pulse or music or a vibrator or an audio generator of music is added, at this time, if the matched audio frequency is music or phase sound, the earphone may receive and play the electronic resource of the audio frequency class pushed by the system; or may be a command to control the vibration of the vibration generator. Of course, the electronic resource may include data such as the playing volume of the pushed music file and the video file. The matched electronic resources can be stored in the user side or the cloud server. The user side can be a mobile phone, a tablet computer, a notebook computer, a desktop computer and other terminal equipment used by the user.
Step S300 is to match at least one electronic resource according to the emotion type of the user, in an actual scene, the system can match a plurality of electronic resources according to the emotion type of the user, and the plurality of electronic resources can be arranged from high to low according to the recommendation index. In some embodiments, the method of the present invention further comprises the steps of:
calculating the matched recommendation index of each electronic resource according to the weight of each electronic resource;
and pushing the electronic resource with the highest recommendation index to the user.
After the matched electronic resource is pushed to the user in step S400, the method further includes:
s500: acquiring feedback information of the user on the pushed electronic resource;
and if the feedback information is unsatisfactory, pushing the electronic resource with the highest recommendation index to the user according to the obtained recommendation index of each electronic resource.
The feedback information of the user on the pushed electronic resource is obtained and can comprise satisfaction degree data of the pushed electronic resource input by the user; or monitoring the physiological data of the user, and judging the satisfaction degree data of the user to the pushed electronic resources according to the physiological data.
When the matched electronic resource is pushed to the user in step S400, the electronic resource can be pushed according to an actual scene or a device configured by the user, and therefore, the method of the present invention may further include the following steps:
acquiring equipment parameters and/or scene parameters of a user; the equipment parameters of the user mainly comprise whether the equipment can bear or run the electronic resources pushed by the method;
and obtaining the weight of each electronic resource according to the equipment parameter and the scene parameter. The above steps have the effect of
The device parameters herein may include the types of specific user devices included in the actual scene, and if the user devices are found to include home theaters of the smart home system, the electronic resources that can be pushed may be audio or video, at this time, the weight of the electronic resources of the audio or video type may be increased, and correspondingly, if there is no user device for video playing, at this time, the weight of the electronic resources of the video type may be decreased. The step is mainly to consider the actual scene and select the most easily realized electronic resources to recommend to the user.
Each electronic resource recommendation index is the sum of (the weight related to each electronic resource x scene) and (the weight related to each electronic resource x device), and the steps can ensure the possibility that the pushed electronic resources interfere with the emotion of the user. For example, if the highest recommendation index in the matched electronic resources is a video file, it is detected whether a video playing device exists in the user equipment, and if so, the video file is directly pushed to the video playing device to be played; if not, the system may push the audio file whose recommendation index is the next highest to the user, and if the user does not have an audio playing device, the system pushes other electronic resources that may implement emotional intervention.
Some embodiments of the present invention further provide an electronic resource pushing system, configured to implement the electronic resource pushing method, including a user module M100, a resource matching module M200, and an emotion intervention module M300, where:
the user module M100 is configured to obtain physiological data of a user;
the resource matching module M200 is used for obtaining the emotion type of the user according to the physiological data;
the emotion intervention module M300 is used for matching at least one electronic resource according to the emotion type of the user;
the user module M100 is further configured to push the electronic resource with the matched emotion type to the user.
An interaction schematic diagram of the electronic resource pushing system according to an embodiment of the present invention is shown in fig. 4, and the function implementation manners of each function module in the electronic resource pushing system according to the embodiment can be implemented by using the specific implementation manners of each step in the electronic resource pushing method. For example, the user module M100, the resource matching module M200, and the emotional intervention module M300 may respectively adopt the specific implementation manners of the steps S100 to S400 to implement the functions thereof, which are not described herein again. Compared with the existing observability system which only monitors the physiology of the user and only analyzes the emotion result, the system provided by the invention has the advantages that the emotion of the user is interfered by pushing electronic resources, and the intelligent type of human-computer interaction is promoted.
Still other embodiments of the present invention further provide an electronic resource pushing device, including: a processor; a memory having stored therein executable instructions of the processor; wherein the processor is configured to perform the steps of the electronic resource pushing method via execution of the executable instructions.
As will be appreciated by one skilled in the art, aspects of the present invention may be embodied as a system, method or program product. Thus, various aspects of the invention may be embodied in the form of: an entirely hardware embodiment, an entirely software embodiment (including firmware, microcode, etc.) or an embodiment combining hardware and software aspects that may all generally be referred to herein as a "circuit," module "or" platform.
An electronic device 600 according to this embodiment of the invention is described below with reference to fig. 5. The electronic device 600 shown in fig. 5 is only an example and should not bring any limitation to the functions and the scope of use of the embodiments of the present invention.
As shown in fig. 5, the electronic device 600 is embodied in the form of a general purpose computing device. The components of the electronic device 600 may include, but are not limited to: at least one processing unit 610, at least one memory unit 620, a bus 630 connecting the different platform components (including the memory unit 620 and the processing unit 610), a display unit 640, etc.
Wherein the storage unit stores program code which can be executed by the processing unit 610 such that the processing unit 610 performs the steps according to various exemplary embodiments of the present invention as described in the above-mentioned method section of the present specification. For example, processing unit 610 may perform the steps as shown in fig. 1.
The storage unit 620 may include readable media in the form of volatile memory units, such as a random access memory unit (RAM)6201 and/or a cache memory unit 6202, and may further include a read-only memory unit (ROM) 6203.
The memory unit 620 may also include a program/utility 6204 having a set (at least one) of program modules 6205, such program modules 6205 including, but not limited to: an operating system, one or more application programs, other program modules, and program data, each of which, or some combination thereof, may comprise an implementation of a network environment.
The electronic device 600 may also communicate with one or more external devices 700 (e.g., keyboard, pointing device, bluetooth device, etc.), with one or more devices that enable a user to interact with the electronic device 600, and/or with any devices (e.g., router, modem, etc.) that enable the electronic device 600 to communicate with one or more other computing devices. Such communication may occur via an input/output (I/O) interface 650. Also, the electronic device 600 may communicate with one or more networks (e.g., a Local Area Network (LAN), a Wide Area Network (WAN), and/or a public network such as the Internet) via the network adapter 660. The network adapter 660 may communicate with other modules of the electronic device 600 via the bus 630. It should be appreciated that although not shown in the figures, other hardware and/or software modules may be used in conjunction with the electronic device 600, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage platforms, to name a few.
The embodiment of the invention also provides a computer-readable storage medium for storing a program, wherein the program is executed to realize the steps of the electronic resource pushing method. In some possible embodiments, the various aspects of the invention may also be implemented in the form of a program product comprising program code means for causing a terminal device to carry out the steps according to the various exemplary embodiments of the invention described in the method part above of this description when said program product is run on the terminal device.
Referring to fig. 6, a program product 800 for implementing the above method according to an embodiment of the present invention is described, which may employ a portable compact disc read only memory (CD-ROM) and include program code, and may be run on a terminal device, such as a personal computer. However, the program product of the present invention is not limited in this regard and, in the present document, a readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
The program product may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium include: an electrical connection having one or more wires, a portable disk, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
A computer readable storage medium may include a propagated data signal with readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A readable storage medium may also be any readable medium that is not a readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a readable storage medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Program code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computing device, partly on the user's device, as a stand-alone software package, partly on the user's computing device and partly on a remote computing device, or entirely on the remote computing device or server. In the case of a remote computing device, the remote computing device may be connected to the user computing device through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computing device (e.g., through the internet using an internet service provider).
In summary, the present invention provides an electronic resource pushing method, system, device and storage medium, where the electronic resource pushing method includes the following steps: acquiring physiological data of a user; obtaining the emotion type of the user according to the physiological data; matching at least one electronic resource according to the emotion type of the user; and pushing the matched electronic resource to the user. According to the electronic resource pushing method, the physiological data of the user is received, the current emotion of the user is analyzed and judged, the electronic resource is matched with the preference of the user in different emotions and pushed to the user, and the effects of relieving and comforting the user when the emotion of the user falls down and stabilizing the user when the user is angry and avoiding conflict upgrading are achieved; the electronic resource pushing system adaptively intervenes the emotion of the user, and intelligent communication between the man and the machine is realized.
The foregoing is a more detailed description of the invention in connection with specific preferred embodiments and it is not intended that the invention be limited to these specific details. It will be evident to those skilled in the art that the present application is not limited to the details of the foregoing illustrative embodiments, and that the present application may be embodied in other specific forms without departing from the spirit or essential attributes thereof. The present embodiments are therefore to be considered in all respects as illustrative and not restrictive, the scope of the application being indicated by the appended claims rather than by the foregoing description, and all changes which come within the meaning and range of equivalency of the claims are therefore intended to be embraced therein. Any reference sign in a claim should not be construed as limiting the claim concerned. Furthermore, it is obvious that the word "comprising" does not exclude other elements or steps, and the singular does not exclude the plural. A plurality of units or means recited in the apparatus claims may also be implemented by one unit or means in software or hardware. The terms first, second, etc. are used to denote names, but not any particular order.
Claims (14)
1. An electronic resource pushing method is characterized by comprising the following steps:
acquiring physiological data of a user;
obtaining the emotion type of the user according to the physiological data;
matching at least one electronic resource according to the emotion type of the user;
and pushing the matched electronic resource to the user.
2. The electronic resource pushing method as claimed in claim 1, wherein said obtaining the emotion type of the user according to the physiological data further comprises the steps of:
inputting the physiological data into the trained emotion classification model of the user to obtain the emotion type of the user;
the trained emotion classification model is established by the following method:
establishing a machine learning model for emotion classification based on the emotion training samples;
and inputting the characteristics of each emotion and the corresponding emotion type into the machine learning model to obtain a trained emotion classification model.
3. The electronic resource pushing method according to claim 1, wherein the acquiring of the physiological data of the user includes first physiological data, second physiological data, third physiological data and/or fourth physiological data:
the first physiological data is obtained by:
acquiring an image of a user through image acquisition equipment, acquiring emotional characteristics of the image, and acquiring the first physiological data according to the emotional characteristics of the image;
the second physiological data is obtained by:
acquiring the audio frequency of a user through sound acquisition equipment, acquiring emotional characteristics of the audio frequency, and acquiring the second physiological data according to the emotional characteristics of the audio frequency;
the third physiological data is obtained by a body temperature sensor;
the fourth physiological data is obtained by a heart rate monitor.
4. The electronic resource pushing method according to claim 1, wherein the step of matching the electronic resource according to the emotion type of the user comprises the steps of:
acquiring a user emotion intervention feature library according to the user identity;
inputting the emotion type of the user into the user emotion intervention feature library to match at least one electronic resource;
and if the matching fails, inputting the emotion type of the user into the statistical emotion intervention feature library to match at least one electronic resource.
5. The electronic resource pushing method according to claim 4, further comprising the steps of:
calculating the matched recommendation index of each electronic resource according to the weight of each electronic resource;
and pushing the electronic resource with the highest recommendation index to the user.
6. The electronic resource pushing method according to claim 5, wherein the method comprises:
acquiring equipment parameters and/or scene parameters of a user;
and obtaining the weight of each electronic resource according to the equipment parameter and the scene parameter.
7. The electronic resource pushing method according to claim 5, further comprising the steps of:
acquiring feedback information of the user on the pushed electronic resource;
and if the feedback information is unsatisfactory, pushing the electronic resource with the highest recommendation index to the user according to the obtained recommendation index of each electronic resource.
8. The electronic resource pushing method according to claim 4, wherein after the electronic resource is sent to the user, the method further comprises the following steps:
acquiring feedback information of the user on the pushed electronic resource;
and if the feedback information is satisfactory, adding the mapping relation between the emotion types and the electronic resources of the user to the user emotional intervention feature library.
9. The electronic resource pushing method according to claim 7 or 8, wherein obtaining feedback information of the pushed electronic resource from the user comprises:
obtaining satisfaction degree data input by a user for the pushed electronic resources; or
And monitoring the physiological data of the user, and judging the satisfaction degree data of the user on the pushed electronic resources according to the physiological data.
10. The electronic resource pushing method according to claim 1, wherein physiological data of the user is acquired through an earphone at a user end, the earphone is provided with a heart rate monitor and/or a brain wave detector, and the physiological data includes a heart rate and/or a brain wave of the user.
11. The method as claimed in claim 10, wherein the earphone is further provided with a vibrator and/or an audio generator, and after the step of pushing the matched electronic resource to the user, the earphone generates a vibration and/or plays audio according to the electronic resource.
12. An electronic resource pushing system for implementing the electronic resource pushing method of any one of claims 1 to 11, comprising a user module, a resource matching module and an emotional intervention module, wherein:
the user module is used for acquiring physiological data of a user;
the resource matching module is used for obtaining the emotion type of the user according to the physiological data;
the emotion intervention module is used for matching at least one electronic resource according to the emotion type of the user;
the user module is further used for pushing the electronic resource matched with the emotion type to a user.
13. An electronic resource pushing device, comprising:
a processor;
a memory having stored therein executable instructions of the processor;
wherein the processor is configured to perform the steps of the electronic resource pushing method of any one of claims 1 to 11 via execution of the executable instructions.
14. A computer-readable storage medium for storing a program, wherein the program is configured to implement the steps of the electronic resource pushing method according to any one of claims 1 to 11 when executed by a processor.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011427872.8A CN112398952A (en) | 2020-12-09 | 2020-12-09 | Electronic resource pushing method, system, equipment and storage medium |
| TW110104283A TWI823055B (en) | 2020-12-09 | 2021-02-04 | Electronic resource pushing method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011427872.8A CN112398952A (en) | 2020-12-09 | 2020-12-09 | Electronic resource pushing method, system, equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112398952A true CN112398952A (en) | 2021-02-23 |
Family
ID=74624811
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011427872.8A Pending CN112398952A (en) | 2020-12-09 | 2020-12-09 | Electronic resource pushing method, system, equipment and storage medium |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN112398952A (en) |
| TW (1) | TWI823055B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113819614A (en) * | 2021-09-13 | 2021-12-21 | 青岛海尔空调器有限总公司 | Method and device for controlling air conditioner and air conditioner |
| CN115578115A (en) * | 2022-09-21 | 2023-01-06 | 支付宝(杭州)信息技术有限公司 | Resource decimation processing method and device |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107424019A (en) * | 2017-08-15 | 2017-12-01 | 京东方科技集团股份有限公司 | The art work based on Emotion identification recommends method, apparatus, medium and electronic equipment |
| CN108154398A (en) * | 2017-12-27 | 2018-06-12 | 广东欧珀移动通信有限公司 | Method for information display, device, terminal and storage medium |
| CN108536803A (en) * | 2018-03-30 | 2018-09-14 | 百度在线网络技术（北京）有限公司 | Song recommendations method, apparatus, equipment and computer-readable medium |
| CN110362744A (en) * | 2019-06-26 | 2019-10-22 | 联通沃悦读科技文化有限公司 | Read recommended method and system, terminal device, computer equipment and medium |
| CN110717337A (en) * | 2019-09-29 | 2020-01-21 | 北京声智科技有限公司 | Information processing method, device, computing equipment and storage medium |
| US20200151212A1 (en) * | 2018-11-13 | 2020-05-14 | Baidu Online Network Technology (Beijing) Co., Ltd. | Music recommending method, device, terminal, and storage medium |
| CN111177459A (en) * | 2019-12-14 | 2020-05-19 | 华为技术有限公司 | Information recommendation method and device, electronic equipment and computer-readable storage medium |
Family Cites Families (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9972357B2 (en) * | 2014-01-08 | 2018-05-15 | Adobe Systems Incorporated | Audio and video synchronizing perceptual model |
| US10157626B2 (en) * | 2016-01-20 | 2018-12-18 | Harman International Industries, Incorporated | Voice affect modification |
| US11049147B2 (en) * | 2016-09-09 | 2021-06-29 | Sony Corporation | System and method for providing recommendation on an electronic device based on emotional state detection |
| US20200046277A1 (en) * | 2017-02-14 | 2020-02-13 | Yuen Lee Viola Lam | Interactive and adaptive learning and neurocognitive disorder diagnosis systems using face tracking and emotion detection with associated methods |
| CN107030691B (en) * | 2017-03-24 | 2020-04-14 | 华为技术有限公司 | Data processing method and device for nursing robot |
| US20190175016A1 (en) * | 2017-12-11 | 2019-06-13 | International Business Machines Corporation | Calculate Physiological State and Control Smart Environments via Wearable Sensing Elements |
| KR102649074B1 (en) * | 2018-01-08 | 2024-03-18 | 워너 브로스. 엔터테인먼트 인크. | Social interaction application for detection of neurophysiological states |
| US11012659B2 (en) * | 2018-08-07 | 2021-05-18 | International Business Machines Corporation | Intelligent illumination and sound control in an internet of things (IoT) computing environment |
| CN111149172B (en) * | 2019-12-30 | 2021-05-11 | 深圳市易优斯科技有限公司 | Emotion management method, device and computer-readable storage medium |
-
2020
- 2020-12-09 CN CN202011427872.8A patent/CN112398952A/en active Pending
-
2021
- 2021-02-04 TW TW110104283A patent/TWI823055B/en active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107424019A (en) * | 2017-08-15 | 2017-12-01 | 京东方科技集团股份有限公司 | The art work based on Emotion identification recommends method, apparatus, medium and electronic equipment |
| CN108154398A (en) * | 2017-12-27 | 2018-06-12 | 广东欧珀移动通信有限公司 | Method for information display, device, terminal and storage medium |
| CN108536803A (en) * | 2018-03-30 | 2018-09-14 | 百度在线网络技术（北京）有限公司 | Song recommendations method, apparatus, equipment and computer-readable medium |
| US20200151212A1 (en) * | 2018-11-13 | 2020-05-14 | Baidu Online Network Technology (Beijing) Co., Ltd. | Music recommending method, device, terminal, and storage medium |
| CN110362744A (en) * | 2019-06-26 | 2019-10-22 | 联通沃悦读科技文化有限公司 | Read recommended method and system, terminal device, computer equipment and medium |
| CN110717337A (en) * | 2019-09-29 | 2020-01-21 | 北京声智科技有限公司 | Information processing method, device, computing equipment and storage medium |
| CN111177459A (en) * | 2019-12-14 | 2020-05-19 | 华为技术有限公司 | Information recommendation method and device, electronic equipment and computer-readable storage medium |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113819614A (en) * | 2021-09-13 | 2021-12-21 | 青岛海尔空调器有限总公司 | Method and device for controlling air conditioner and air conditioner |
| CN115578115A (en) * | 2022-09-21 | 2023-01-06 | 支付宝(杭州)信息技术有限公司 | Resource decimation processing method and device |
| CN115578115B (en) * | 2022-09-21 | 2023-09-08 | 支付宝(杭州)信息技术有限公司 | Resource lottery processing method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| TW202223804A (en) | 2022-06-16 |
| TWI823055B (en) | 2023-11-21 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11012659B2 (en) | Intelligent illumination and sound control in an internet of things (IoT) computing environment | |
| KR102444165B1 (en) | Apparatus and method for providing a meeting adaptively | |
| JP2018190413A (en) | Method and system for processing user command to adjust and provide operation of device and content provision range by grasping presentation method of user speech | |
| US11521038B2 (en) | Electronic apparatus and control method thereof | |
| KR20220002820A (en) | Method and apparatus for generating information | |
| JP6728319B2 (en) | Service providing method and system using a plurality of wake words in an artificial intelligence device | |
| CN111986691B (en) | Audio processing method, device, computer equipment and storage medium | |
| US11602287B2 (en) | Automatically aiding individuals with developing auditory attention abilities | |
| CN112398952A (en) | Electronic resource pushing method, system, equipment and storage medium | |
| CN113593595A (en) | Voice noise reduction method and device based on artificial intelligence and electronic equipment | |
| US11687806B2 (en) | Problem solving using selected datasets of internet-of-things system | |
| WO2016206642A1 (en) | Method and apparatus for generating control data of robot | |
| US11751800B2 (en) | Seizure detection using contextual motion | |
| CN111312243B (en) | Equipment interaction method and device | |
| US11164575B2 (en) | Methods and systems for managing voice response systems to optimize responses | |
| KR102396147B1 (en) | Electronic device for performing an operation using voice commands and the method of the same | |
| US11749270B2 (en) | Output apparatus, output method and non-transitory computer-readable recording medium | |
| CN114970562A (en) | Semantic understanding method, device, medium and equipment | |
| CN114115533A (en) | Intelligent interaction method and device | |
| WO2020102943A1 (en) | Method and apparatus for generating gesture recognition model, storage medium, and electronic device | |
| US11302323B2 (en) | Voice response delivery with acceptable interference and attention | |
| EP3686753A1 (en) | Electronic device and method for controlling the electronic device | |
| KR102643720B1 (en) | Artificial intelligence interface system for robot | |
| US20220101860A1 (en) | Automated speech generation based on device feed | |
| CN108831446B (en) | Method and apparatus for generating sample |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |