CN109474845A - Bullet screen control method, bullet screen processing server and computer readable storage medium - Google Patents

Bullet screen control method, bullet screen processing server and computer readable storage medium Download PDF

Info

Publication number
CN109474845A
CN109474845A CN201811076875.4A CN201811076875A CN109474845A CN 109474845 A CN109474845 A CN 109474845A CN 201811076875 A CN201811076875 A CN 201811076875A CN 109474845 A CN109474845 A CN 109474845A
Authority
CN
China
Prior art keywords
barrage
information
display
physiological characteristic
characteristic parameter
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201811076875.4A
Other languages
Chinese (zh)
Other versions
CN109474845B (en
Inventor
张昶
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Migu Cultural Technology Co Ltd
China Mobile Communications Group Co Ltd
MIGU Music Co Ltd
Original Assignee
Migu Cultural Technology Co Ltd
China Mobile Communications Group Co Ltd
MIGU Music Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Migu Cultural Technology Co Ltd, China Mobile Communications Group Co Ltd, MIGU Music Co Ltd filed Critical Migu Cultural Technology Co Ltd
Priority to CN201811076875.4A priority Critical patent/CN109474845B/en
Publication of CN109474845A publication Critical patent/CN109474845A/en
Application granted granted Critical
Publication of CN109474845B publication Critical patent/CN109474845B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44213Monitoring of end-user related data
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/475End-user interface for inputting end-user data, e.g. personal identification number [PIN], preference data
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/478Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4788Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/488Data services, e.g. news ticker
    • H04N21/4884Data services, e.g. news ticker for displaying subtitles

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Social Psychology (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Databases & Information Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The invention discloses a bullet screen control method, which comprises the following steps: acquiring physiological characteristic parameters representing the physical sign state of a user; determining an emotion type corresponding to the physiological characteristic parameter; and determining corresponding display attribute information and/or display content information based on the emotion type, and outputting bullet screen information associated with the physiological characteristic parameter based on the display attribute information and/or the display content information.

Description

Barrage control method, barrage processing server and computer readable storage medium
Technical field
The present invention relates to field of multimedia communication more particularly to a kind of barrage control method, barrage processing server and Computer readable storage medium.
Background technique
Currently, more and more live streaming APP or video APP are to use with the continuous development of internet video play-back technology Family provides the function of delivering barrage.During watching video, user can express oneself by way of sending barrage Viewing impression, barrage content and other spectators can also be passed through and carry out exchange and interdynamic.
In existing usage scenario, user during viewing own self emotion often by the shadow of broadcasting content It rings.For example, being influenced when user is watching the sad program of comparison by programme content, the mood of user may also become Must be sadder, in this case, user may deliver the barrage contents of some reflection sad moods by barrage system, Exchanged with will pass through barrage with other spectators, and, it is desirable on the Show Styles of barrage can also at this time mood, The barrage content delivered matches.At this point, user needs to be configured by Show Styles of the barrage system to barrage.
Existing barrage system has provided a user the function that some pairs of barrage Show Styles are adjusted, but these are adjusted The function of section is all that user is needed voluntarily to adjust as needed.And the mode adjusted is the font to barrage, font size, face nothing but Color, transparency etc. are adjusted;Certainly, existing certain barrage systems may provide a kind of payment regulatory function for user, User can open more regulatory functions by way of payment, for example add special efficacy barrage frame etc. for barrage.However, i.e. Make be barrage system provide this payment function, user is also required to voluntarily select suitable barrage special efficacy as needed, with complete The setting of pairs of barrage.
But in actual use, the plot of the videos such as film, TV play or live streaming often changes very fast Speed accompanies therewith, and the emotional change of user often also occurs very fast.Thus, when user is manually entered barrage content, then again Manual setting Show Styles very likely occurs user at this time and wants that section of plot for expressing mood is already expired, and view being played on Frequency plot wants the inconsistent situation of mood when sending barrage with user before;Alternatively, when user completes input and sets After setting, without before watch plot when that mood.
It can be seen that due to the barrage control mode that existing barrage system provides, entire barrage transmission process is completely dependent on In the voluntarily manual operation of user, thus bring to user that barrage feature operation is troublesome, time-consuming, not flexible and real-time is poor Problem leverages the user experience that barrage function uses.
Summary of the invention
In view of this, the main purpose of the present invention is to provide a kind of barrage control method, barrage processing server and Computer readable storage medium.
In order to achieve the above objectives, the technical scheme of the present invention is realized as follows:
The embodiment of the invention provides a kind of barrage control methods, which comprises
Obtain the physiological characteristic parameter of characterization user's sign state;
Determine the corresponding type of emotion of the physiological characteristic parameter;
Corresponding display attribute information and/or display content information are determined based on the type of emotion, are based on the display Attribute information and/or the barrage information of display content information output and the physiological characteristic parameter association.
In above scheme, the display attribute information is comprised at least one of the following: display font, display font size, display face Color, plays track, display switch state, special display effect, play sound effect, mood markup information at broadcasting speed;
It is described to be specifically included based on display attribute information output and the barrage information of the physiological characteristic parameter association, It is adjusted based on Show Styles of the display attribute information to barrage content, based on the barrage content and after adjusting The Show Styles exports the barrage information;Wherein, the barrage content includes the content information of user's input or is based on The display content information that the type of emotion determines.
In above scheme, the display content information includes text and/or expression;
It is described to be specifically included based on the display content information output and the barrage information of the physiological characteristic parameter association, Using the display content information determined based on the type of emotion as the barrage information with the physiological characteristic parameter association It is exported.
In above scheme, the physiological characteristic parameter detect to user's body specifically by intelligent terminal The parameter arrived.
In above scheme, the physiological characteristic parameter is comprised at least one of the following:
Heart rate, pulse frequency, respiratory rate, blood pressure, shell temperature.
In above scheme, the method also includes:
It determines the associated multiple barrage information of same multimedia resource, obtains and correspond to together from the multiple barrage information One type of emotion and at least two barrage information for belonging to different terminals;
Friend recommendation information is sent to the corresponding terminal of at least two barrages information respectively.
The embodiment of the invention also provides a kind of barrage processing servers, comprising: communication module and processing module,
The communication module, for obtaining the physiological characteristic parameter of characterization user's sign state;It is also used to belong to based on display Property the information and/or output of display content information and the barrage information of the physiological characteristic parameter association;
The processing module, for determining the corresponding type of emotion of the physiological characteristic parameter;It is also used to based on the feelings Thread type determines the corresponding display attribute information and/or display content information.
In above scheme, the display attribute information is comprised at least one of the following: display font, display font size, display face Color, plays track, display switch state, special display effect, play sound effect, mood markup information at broadcasting speed;
The processing module is used for the barrage based on display attribute information output and the physiological characteristic parameter association Information specifically includes, and is adjusted based on Show Styles of the display attribute information to barrage content, based in the barrage The Show Styles after holding and adjusting exports the barrage information;Wherein, the barrage content includes the interior of user's input The display content information for holding information or being determined based on the type of emotion.
In above scheme, the display content information includes text and/or expression;
The processing module is used for the barrage based on display the content information output and the physiological characteristic parameter association Information specifically includes, and closes using the display content information determined based on the type of emotion as with the physiological characteristic parameter The barrage information of connection is exported.
In above scheme, the physiological characteristic parameter detect to user's body specifically by intelligent terminal The parameter arrived.
In above scheme, the physiological characteristic parameter is comprised at least one of the following:
Heart rate, pulse frequency, respiratory rate, blood pressure, shell temperature.
In above scheme, the processing module is also used to determine the associated multiple barrage information of same multimedia resource, from At least two barrage information for corresponding to same type of emotion and belonging to different terminals are obtained in the multiple barrage information;Point Friend recommendation information is not sent to the corresponding terminal of at least two barrages information.
The embodiment of the invention also provides a kind of barrage processing server, the server includes: processor and for depositing The memory of the enough computer programs run on a processor of energy storage,
Wherein, the processor is for executing the step of the method for the embodiment of the present invention when running the computer program Suddenly.
The embodiment of the invention also provides a kind of computer readable storage mediums, are stored thereon with computer program, described The step of the method for the embodiment of the present invention is realized when computer program is executed by processor.
Barrage control method provided by the embodiment of the present invention, the physiological characteristic by obtaining characterization user's sign state are joined Number;Determine the corresponding type of emotion of the physiological characteristic parameter;Corresponding display attribute information is determined based on the type of emotion And/or display content information, based on the display attribute information and/or the output of display content information and the physiological characteristic parameter Associated barrage information.In this way, providing simple, efficiently barrage function for user, the user that barrage function uses is improved Experience.
Detailed description of the invention
Fig. 1 is the flow diagram of barrage control method provided in an embodiment of the present invention;
Fig. 2 is the structural schematic diagram of barrage processing server provided in an embodiment of the present invention;
Fig. 3 is the structural schematic diagram for the barrage control system that one embodiment of the invention provides;
Fig. 4 be another embodiment of the present invention provides barrage control system structural schematic diagram.
Specific embodiment
With reference to the accompanying drawing and specific embodiment the present invention is further described in more detail.
Fig. 1 is the flow diagram of barrage control method provided in an embodiment of the present invention.As shown, the method packet It includes:
Step 101, the physiological characteristic parameter for obtaining characterization user's sign state;
In a kind of embodiment of the application, the physiological characteristic parameter be by intelligent terminal to user's body into The parameter that row detection obtains.
Specifically, user when watching multimedia resource, in real time examine the body of user by the intelligent terminal It surveys, to acquire the physiological characteristic parameter of user;The physiological characteristic parameter collected is sent to multimedia resource to broadcast Put equipment;The physiological characteristic parameter is sent to barrage processing server again by the multimedia resource playback equipment, so that institute State the physiological characteristic parameter that barrage processing server obtains characterization user's sign state.In this way, not only realizing to user The acquisition of physiological characteristic parameter, and can be by the physiological characteristic parameter collected and multimedia resource playback equipment shape At association, that is, since the physiological characteristic parameter is to be sent to barrage processing service by the multimedia resource playback equipment Device, therefore the barrage processing server can determine that the physiological characteristic parameter is when obtaining the physiological characteristic parameter Belong to user corresponding to which multimedia resource playback equipment.
Here, the intelligent terminal is the terminal device with detection user's physiological characteristic parameter function, specifically, The intelligent terminal can be intelligent wearable device, for example, Intelligent bracelet, smartwatch, intelligent glasses etc..The intelligence It can be provided with sensor on terminal device, by the body of the sensor senses user, obtain the physiological characteristic parameter of user, And the physiological characteristic parameter is exported according to the information that certain rule is converted into electric signal or form needed for other.
The multimedia resource playback equipment can be terminal device, such as mobile phone, laptop, tablet computer, platform Formula computer etc..The application program (APP) for playing multimedia resource, more matchmakers that the APP is played are installed on the terminal device Body resource includes programme televised live, the video program of recorded broadcast or game picture;In addition it is also possible to include playing to supply by given pace Picture, audio, the text etc. of user's browsing;The APP can provide the function of delivering barrage for user, specifically broadcast to it Put content-form with no restriction.Before the APP provides the function of delivering barrage for user, first handled for user to the barrage Server application account, or prompt user log in registered account;In this case, even if having multidigit user in terminal side Simultaneously viewing program, the barrage processing server also only with account or log in the account terminal identification and distinguish use Family, without being distinguished with actual user.
The intelligent terminal can be used cooperatively with the multimedia resource playback equipment, be configured by user The connection relationship between intelligent terminal and multimedia resource playback equipment is established in operation, for example, passing through bluetooth, scanning two dimension The modes such as code or dedicated programs connect Intelligent bracelet and smart phone, when the physiology of Intelligent bracelet acquisition user When characteristic parameter, those collected physiological characteristic parameters are shown by the Intelligent bracelet APP being mounted on smart phone, intelligence The APP and Intelligent bracelet APP of broadcasting multimedia resource on mobile phone can open mutually permission, so that playing multimedia resource APP the collected user's physiological characteristic parameter of Intelligent bracelet can be obtained from Intelligent bracelet APP.
Without being limited thereto, the intelligent terminal and the multimedia resource playback equipment are also possible to integral structure.I.e. Terminal device had not only had multimedia resource playing function, but also the function of the physiological characteristic parameter with acquisition tables requisition family sign state Energy;At this point, directly the physiological characteristic collected can be joined after the physiological characteristic parameter of the terminal device acquisition user Number is sent to barrage processing server, so that the physiology that the barrage processing server obtains characterization user's sign state is special Levy parameter.
In a kind of embodiment of the application, the physiological characteristic parameter is comprised at least one of the following: heart rate, pulse frequency Rate, respiratory rate, blood pressure, shell temperature.Above-mentioned physiological characteristic parameter can be carried out by the sensor on intelligent terminal Measurement, for example, detection unit can be equipped on intelligent terminal, can specifically include heart rate sensor, for The heart rate data information at family is monitored and acquires;In addition, the parameters such as pulse frequency, respiratory rate, blood pressure, shell temperature can also To be measured by corresponding sensor.It will be apparent to those skilled in the art that the acquisition of these physiological characteristic parameters can be with It is achieved by existing intelligent terminal.Certainly, physiological characteristic parameter described in the embodiment of the present invention is not limited to this, It is any to be acquired by intelligent terminal, and physiological characteristic parameter relevant to user emotion state belongs to the present invention Design within.
Step 102 determines the corresponding type of emotion of the physiological characteristic parameter;
It is corresponding with type of emotion according to the multiple groups physiological characteristic parameter pre-established in a kind of embodiment of the application Relationship determines type of emotion corresponding with the physiological characteristic parameter of active user.
Specifically, the background work personnel of barrage processing server can be first passed through to collected in advance as sample The practical emotional status of physiological characteristic parameter and user at that time is analyzed, and determines physiological characteristic parameter and pre-set use The corresponding relationship of family type of emotion, and then type of emotion library is established according to the corresponding relationship, it is preserved in the type of emotion library The corresponding relationship of multiple groups physiological characteristic parameter and type of emotion.For example, the type of emotion library established may include such as the following table 1 Shown in corresponding relationship, specifically include the corresponding relationship between heart rate range and various type of emotion:
Heart rate (beat/min) Type of emotion
[60,100) It is tranquil
[100,160] Excitement
[45,60) It loses
Table 1
For example, when the physiological characteristic parameter of the APP of the broadcasting multimedia resource on the smart phone user got When being 130 beats/min of heart rate, then the heart rate data can be sent to barrage processing server by the APP for playing multimedia resource, So that the barrage processing server can be determining and current according to pre-set heart rate and type of emotion mapping table Type of emotion corresponding to user's physiological characteristic parameter is excitement.
It is appreciated that sign state is due to the control meeting by central nervous system when the mood of user changes It changes, at this point, the physiological characteristic parameter of characterization user's sign state can reflect that user's is current to a certain extent Mood.Similar therewith, the mood of user can also be reflected by behavioural characteristic, for example, the facial expression of user, voice The tone, body Oscillation Amplitude, the content information etc. that there are also users to input in barrage input frame.Although physiological characteristic and behavior are special Sign all can serve as to judge the important information of user emotion, but is needing to carry out acquisition characteristics information by instrument and equipment and judge When user emotion, the effect of the two has apparent difference.For judging the side of user emotion by acquiring behavior characteristic information Formula, there may be larger differences for the behavioural characteristic showed due to different user when reflecting own self emotion, it is more likely that goes out Now same type of emotion but the case where show different behavioural characteristics;For example, some users face table when excited Feelings exaggeration, and some users then show it is containing;Spoken sounds are influenced sometimes by environment and limitation, in the case where excitement In order to avoid influencing other people and restraining itself not issue the biggish sound;The word content information of input may use irony, Or send the vocabulary of some no specific emotional meanings;Therefore, complicated behavioural characteristic is that the judgement of instrument and equipment brings one Fixed degree of error often will appear the problem to user's current emotional identification inaccuracy.And the physiological characteristic parameter of user to The mood at family reflects more direct, true, and instrument and equipment may be implemented to quantify for the acquisition of physiological characteristic parameter, right The judgement of user's current emotional is more accurate.
In embodiments of the present invention, the physiological characteristic parameter may include a variety of physiological characteristic parameter types, thus comprehensive Close the type of emotion for considering that many-sided sign state of user changes to judge user;Physiological characteristic parameter and row can also be used It is characterized the type of emotion that the mode that information combines judges user.
Step 103 determines corresponding display attribute information and/or display content information based on the type of emotion, is based on The display attribute information and/or the barrage information of display content information output and the physiological characteristic parameter association.
In a kind of embodiment of the application, the display attribute information is comprised at least one of the following: display font, display Font size, broadcasting speed, plays track, display switch state, special display effect, play sound effect, mood markup information at display color.
It is described based on display attribute information output and the physiological characteristic parameter in a kind of embodiment of the application Associated barrage information specifically includes, and is adjusted, is based on based on Show Styles of the display attribute information to barrage content The Show Styles after the barrage content and adjusting exports the barrage information.Wherein, the barrage content includes using The content information of family input or the display content information determined based on the type of emotion.
It is to be appreciated that display attribute information includes display font, display font size, display color, refer to barrage Word content is set as specific font corresponding with the type of emotion, specific font size, particular color, so that output is more to playing The terminal of media resource shown, for example, when the type of emotion of user is " happiness ", with the word that the form of expression is more active Body (e.g., Chinese-language bright cloud), the font size of " larger ", red color show barrage text;And display attribute information includes broadcasting speed, broadcasts Track is put, refers to that the broadcasting speed to barrage content on terminal display, broadcasting track are arranged, for example, when using When the type of emotion at family is " losing ", barrage content is played with the track at a slow speed, gradually to fall;And display switch state refers to Barrage display function is opened, barrage display function is closed or changes the size and location of barrage display area, for example, in barrage When user emotion type mutates during display function is in close state, the barrage closed originally is opened, or to user Selection window is sent, reminds user that can open barrage display function, to browse whether other users also generate this section of plot Mood is touched;For another example, barrage display function is in the open state, but determines that user emotion type is " anxiety ", Ke Yiguan at this time Barrage display function is closed, or sends selection window to user, reminds user that can carry out shutoff operation, so that user can be more To watch program absorbedly;May include the special display effect for increasing barrage content as special display effect, e.g., to barrage content into Row rendering can also include increasing the special display effect of barrage frame, such as increase frame;Play sound effect refers to aobvious in terminal screen While showing barrage content information, increase compatible audio therewith.
It is worth noting that, the embodiment of the invention also provides the display properties that can be barrage increase mood markup information Mode.Barrage processing server can be to belong to the barrage of same type of emotion to increase unified feelings when exporting barrage information Thread mark, for example can be the tail portion increase " smiling face's mark " for belonging to the barrage of " happy " type of emotion, then showing the barrage During, user can mark according to the mood of barrage tail portion, select interested barrage.Barrage processing server may be used also Only to carry out special mood mark to barrage information identical with active user's type of emotion in all barrage information of output, To facilitate active user to find barrage that oneself is liked, having total feelings mood in the barrage information of magnanimity.
Also, in the output barrage information with physiological characteristic parameter association, the barrage processing server may be used also To send friend recommendation information to the corresponding user account of at least two barrage information respectively based on type of emotion, passed through with realizing Good friend's social functions of barrage;The friend recommendation information can be shown by the window in addition to barrage frame, for user's choosing It selects;Good friend's application can also be issued to the transmission user of this barrage by way of long-pressing this bar barrage frame;Alternatively, directly Addition good friend's icon is provided by mood markup information.
In one embodiment of the invention, user is during watching multimedia resource (for example, video), by video Plot influences, and in the front half section of video, user emotion is tranquiler, but when having arrived the climax parts of video, user emotion Become to get excited with the drive of plot.In this case, when user sends barrage in the front half section expectation of video When, the APP for playing video receives the content information of the collected user's heart rate information of intelligent wearable device and user's input, And the content information of the heart rate information of user and input is sent to barrage processing server, the barrage processing server can With according to the mapping table of pre-set heart rate and type of emotion, it is determining with corresponding to active user's physiological characteristic parameter Type of emotion is " calmness ", and then barrage Show Styles corresponding to " mood is tranquil " is determined in barrage Show Styles library, and By the pattern, barrage function is set;And when user is when the climax parts expectation of video sends barrage, video APP receives intelligence The content information that the current heart rate information of the collected user of wearable device and user input at this time, and those information are sent To barrage processing server, and then barrage processing server can determine that current user emotion type is " excitement ", and determination Barrage Show Styles corresponding with the mood, and then barrage information is exported according to the pattern.
In a kind of embodiment of the application, the display content information includes text and/or expression;It is described based on described The output of display content information and the barrage information of the physiological characteristic parameter association specifically include, and described will be based on the mood class The display content information that type determines is exported as the barrage information with the physiological characteristic parameter association.
It is to be appreciated that barrage control method provided in an embodiment of the present invention, can not only be based on user emotion type tune Whole display attribute information can also be suitble to the display content information of expression current emotional directly for user's push.For example, when determining When user emotion type is " happiness ", barrage processing server determines corresponding display content information for characters in a fancy style " heartily!", or Person shows that content information is the full animation expression etc. of smiling face.To, it is manually entered barrage content without user in any case, into One step alleviates the manual operation of user, truly realizes the effect that mood output barrage information is watched according to user.
In a kind of embodiment of the application, acknowledgement window is provided, is "Yes" when acknowledgement window receives expression meaning When instruction, instruction multimedia resource playback equipment according to the output and the physiological characteristic parameter association barrage information into Row display.
In embodiments of the present invention, barrage processing server can only determine that corresponding display belongs to based on user emotion type Property information, and be based only upon the barrage information of display attribute information output and the physiological characteristic parameter association;For example, bullet Curtain processing server issues play sound effect to multimedia resource playback equipment or changes the instruction of display switch state;For another example, The font size for the content information that barrage processing server inputs user based on the display attribute information, color are adjusted, and Output at most media resource plays equipment.Barrage processing server can also only determine corresponding display based on user emotion type Content information, and it is based only upon the barrage information of display the content information output and the physiological characteristic parameter association, for example, Barrage processing server issues the instruction for playing smiling face's full animation expression to multimedia resource playback equipment.Barrage processing server is also Corresponding display attribute information can have not only been determined based on user emotion type, but also has determined corresponding display content information, thus base It is adjusted in Show Styles of the display attribute information to the display content information determined based on the type of emotion, The Show Styles based on the barrage content and after adjusting exports the barrage information.
In a kind of embodiment of the application, barrage control method provided in an embodiment of the present invention can also include: preparatory Establish display attribute information and/or display content information mode;Preset rules are established, the preset rules are to determine the display The rule of corresponding relationship between attribute information and/or display content information mode and the type of emotion.
In a kind of embodiment of the application, the method can also include: open modification authority, and the modification authority is used It modifies in permission user to the display attribute information and/or display content information mode and the preset rules.
In one embodiment of the invention, the background work personnel of barrage processing server can use according to certain amount The routine use at family is accustomed to, and multiple fonts Show Styles is arranged, is stored in barrage font style library.And it is directed to different barrages Corresponding user emotion type is arranged in font style, according to barrage Show Styles and user corresponding with the barrage Show Styles Type of emotion generates barrage Show Styles and determines rule, and saves those in the barrage style library in barrage processing server Rule.
What needs to be explained here is that the background work personnel of barrage processing server can also rule of thumb construct in advance The barrage Show Styles library of default, and the modification authority in open barrage Show Styles library, so that user is using the more matchmakers of broadcasting When the APP of body resource, can according to oneself use habit, neatly to barrage Show Styles and barrage Show Styles it is true Set pattern is then adjusted.
For example, corresponding barrage Show Styles can be arranged for " excitement " mood according to the use habit of oneself in user For a;It is b that corresponding barrage Show Styles, which is arranged, for " sadness " mood;Corresponding barrage is arranged for " losing " mood to show Pattern is c, etc..
In a kind of embodiment of the application, the method also includes: it searches in the terminal for playing same multimedia resource, Friend recommendation is sent to the terminal where those accounts in identical progress, the user account with identical type of emotion, and respectively Information.For example, barrage processing server can be to user in the multimedia resource playing process after multimedia resource plays The barrage of middle transmission is counted, and is filtered out different user account and corresponded to same mood class what same playback progress was sent The barrage information of type, to carry out friend recommendation each other to those user accounts.
The embodiment of the invention also provides a kind of barrage processing servers.Fig. 2 is the structure of the barrage processing server Schematic diagram;As shown, the barrage processing server includes: communication module and processing module.
The communication module, for obtaining the physiological characteristic parameter of characterization user's sign state;It is also used to belong to based on display Property the information and/or output of display content information and the barrage information of the physiological characteristic parameter association;
The processing module, for determining the corresponding type of emotion of the physiological characteristic parameter;It is also used to based on the feelings Thread type determines the corresponding display attribute information and/or display content information.
In one embodiment, the display attribute information comprises at least one of the following: display font, display font size, display Color, plays track, display switch state, special display effect, play sound effect, mood markup information at broadcasting speed;
The processing module is used for the barrage based on display attribute information output and the physiological characteristic parameter association Information specifically includes, and is adjusted based on Show Styles of the display attribute information to barrage content, based in the barrage The Show Styles after holding and adjusting exports the barrage information;Wherein, the barrage content includes the interior of user's input The display content information for holding information or being determined based on the type of emotion.
In one embodiment, the display content information includes text and/or expression;
The processing module is used for the barrage based on display the content information output and the physiological characteristic parameter association Information specifically includes, and closes using the display content information determined based on the type of emotion as with the physiological characteristic parameter The barrage information of connection is exported.
In one embodiment, the physiological characteristic parameter detects user's body specifically by intelligent terminal Obtained parameter.
In one embodiment, the physiological characteristic parameter comprises at least one of the following: heart rate, pulse frequency, respiratory rate, Blood pressure, shell temperature.
In one embodiment, the processing module is also used to determine the associated multiple barrage information of same multimedia resource, At least two barrage information of different terminals are obtained corresponding to same type of emotion and belonged to from the multiple barrage information; Friend recommendation information is sent to the corresponding terminal of at least two barrages information respectively.
It should be understood that barrage processing server provided by the above embodiment is when carrying out barrage function control, only with The division progress of above-mentioned each program module can according to need for example, in practical application and distribute above-mentioned processing by not Same program module is completed, i.e., the internal structure of server is divided into different program modules, described above complete to complete Portion or part are handled.In addition, barrage processing server provided by the above embodiment and barrage control method embodiment belong to together One design, specific implementation process are detailed in embodiment of the method, and which is not described herein again.
In addition, in one embodiment of this invention, the barrage processing server, the intelligent terminal and described more Media resource plays equipment collectively constitutes barrage control system.Fig. 3 shows a kind of structural schematic diagram of barrage control system.Its In, Intelligent bracelet 1 is also used to for obtaining the physiological characteristic parameter of characterization user's sign state by the physiological characteristic parameter It is sent to terminal device 2;Terminal device 2 is also used to receive the Intelligent bracelet 1 and sends over for playing multimedia resource Physiological characteristic parameter, and receive the barrage content information of user's input, and by the physiological characteristic parameter and the bullet Curtain content information is sent to barrage control system 3;The terminal device 2 is also used to receive what the barrage control system 3 exported Barrage information, and the barrage information is shown and is played on the page in multimedia resource;The barrage control system 3, for holding Function described in row various embodiments of the present invention.
In another embodiment of the invention, the barrage processing server and the terminal device collectively constitute barrage control System processed.Fig. 4 shows the structural schematic diagram of barrage control system in the embodiment.Wherein, the terminal device 2, for broadcasting Multimedia resource is put, is also used to obtain the physiological characteristic parameter of characterization user's sign state, and receive the barrage of user's input Content information is also used to the physiological characteristic parameter and the barrage content information being sent to barrage processing server 3;Institute It states terminal device 2 and is also used to receive the barrage information that the barrage control system 3 exports, and the barrage information is shown more On the media resource plays page;The barrage control system 3, for executing function described in various embodiments of the present invention.
The embodiment of the invention also provides a kind of barrage processing server, the server includes: processor and for depositing The memory of the enough computer programs run on a processor of energy storage, wherein the processor is for running the computer journey When sequence, the step of executing aforementioned barrage control method of the embodiment of the present invention.
In the exemplary embodiment, barrage processing server can by one or more application specific integrated circuit (ASIC, Application Specific Integrated Circuit), DSP, programmable logic device (PLD, Programmable Logic Device), Complex Programmable Logic Devices (CPLD, Complex Programmable Logic Device), scene Programmable gate array (FPGA, Field-Programmable Gate Array), general processor, controller, microcontroller (MCU, Micro Controller Unit), microprocessor (Microprocessor) or other electronic components are realized, are used for Execute preceding method.
The embodiment of the invention also provides a kind of computer readable storage mediums, are stored thereon with computer program, described The step of aforementioned barrage control method of the embodiment of the present invention is realized when computer program is executed by processor.
The computer readable storage medium can be FRAM, ROM, PROM, EPROM, EEPROM, Flash Memory, The memories such as magnetic surface storage, CD or CD-ROM;It is also possible to include the various of one of above-mentioned memory or any combination Equipment, such as mobile phone, computer, tablet device, personal digital assistant.
Those of ordinary skill in the art will appreciate that: realize that all or part of the steps of above method embodiment can pass through The relevant hardware of program instruction is completed, and program above-mentioned can be stored in a computer readable storage medium, the program When being executed, step including the steps of the foregoing method embodiments is executed;And storage medium above-mentioned include: movable storage device, ROM, The various media that can store program code such as RAM, magnetic or disk.
If alternatively, the above-mentioned integrated module of the present invention is realized in the form of software function module and as independent product When selling or using, it also can store in a computer readable storage medium.Based on this understanding, the present invention is implemented Substantially the part that contributes to existing technology can be embodied in the form of software products the technical solution of example in other words, The computer software product is stored in a storage medium, including some instructions are used so that computer equipment (can be with It is personal computer, server or network equipment etc.) execute all or part of each embodiment the method for the present invention. And storage medium above-mentioned includes: that movable storage device, ROM, RAM, magnetic or disk etc. are various can store program code Medium.
The foregoing is only a preferred embodiment of the present invention, is not intended to limit the scope of the present invention, it is all Made any modifications, equivalent replacements, and improvements etc. within the spirit and principles in the present invention, should be included in protection of the invention Within the scope of.

Claims (14)

1. a kind of barrage control method, which is characterized in that the described method includes:
Obtain the physiological characteristic parameter of characterization user's sign state;
Determine the corresponding type of emotion of the physiological characteristic parameter;
Corresponding display attribute information and/or display content information are determined based on the type of emotion, are based on the display properties Information and/or the barrage information of display content information output and the physiological characteristic parameter association.
2. the method according to claim 1, wherein the display attribute information comprises at least one of the following: aobvious Show font, display font size, display color, broadcasting speed, play track, display switch state, special display effect, play sound effect, feelings Thread markup information;
It is described to be specifically included based on display attribute information output and the barrage information of the physiological characteristic parameter association, it is based on The Show Styles of barrage content is adjusted in the display attribute information, described in after the barrage content and adjusting Show Styles exports the barrage information;Wherein, the barrage content includes the content information of user's input or is based on described The display content information that type of emotion determines.
3. the method according to claim 1, wherein the display content information includes text and/or expression;
It is described to be specifically included based on the display content information output and the barrage information of the physiological characteristic parameter association, by institute The display content information determined based on the type of emotion is stated to give as the barrage information with the physiological characteristic parameter association Output.
4. the method according to claim 1, wherein the physiological characteristic parameter is set specifically by intelligent terminal The standby parameter that user's body is detected.
5. the method according to claim 1, wherein the physiological characteristic parameter comprises at least one of the following:
Heart rate, pulse frequency, respiratory rate, blood pressure, shell temperature.
6. the method according to claim 1, wherein the method also includes:
It determines the associated multiple barrage information of same multimedia resource, obtains from the multiple barrage information corresponding to same feelings Thread type and at least two barrage information for belonging to different terminals;
Friend recommendation information is sent to the corresponding terminal of at least two barrages information respectively.
7. a kind of barrage processing server characterized by comprising communication module and processing module,
The communication module, for obtaining the physiological characteristic parameter of characterization user's sign state;It is also used to believe based on display properties Breath and/or the barrage information of display content information output and the physiological characteristic parameter association;
The processing module, for determining the corresponding type of emotion of the physiological characteristic parameter;It is also used to based on the mood class Type determines the corresponding display attribute information and/or display content information.
8. barrage processing server according to claim 7, which is characterized in that the display attribute information include with down toward Few one kind: display font, display color, broadcasting speed, plays track, display switch state, special display effect, broadcasts display font size Playback effect, mood markup information;
The processing module is used for the barrage information based on display attribute information output and the physiological characteristic parameter association Specifically include, be adjusted based on Show Styles of the display attribute information to barrage content, based on the barrage content with And the Show Styles after adjusting exports the barrage information;Wherein, the barrage content includes the content letter of user's input Breath or the display content information determined based on the type of emotion.
9. barrage processing server according to claim 7, which is characterized in that the display content information includes text And/or expression;
The processing module is used for the barrage information based on display the content information output and the physiological characteristic parameter association Specifically include, using it is described based on the type of emotion determine display content information as with the physiological characteristic parameter association Barrage information is exported.
10. barrage processing server according to claim 7, which is characterized in that the physiological characteristic parameter is specially logical Cross the parameter that intelligent terminal detects user's body.
11. barrage processing server according to claim 7, which is characterized in that the physiological characteristic parameter includes following It is at least one:
Heart rate, pulse frequency, respiratory rate, blood pressure, shell temperature.
12. barrage processing server according to claim 7, which is characterized in that
The processing module is also used to determine the associated multiple barrage information of same multimedia resource, believes from the multiple barrage At least two barrage information for corresponding to same type of emotion and belonging to different terminals are obtained in breath;Respectively to described at least two The corresponding terminal of a barrage information sends friend recommendation information.
13. a kind of barrage processing server, which is characterized in that the server includes: processor and can locate for storing The memory of the computer program run on reason device,
Wherein, when the processor is used to run the computer program, side described in any one of perform claim requirement 1 to 6 The step of method.
14. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the computer program The step of any one of claim 1 to 6 the method is realized when being executed by processor.
CN201811076875.4A 2018-09-14 2018-09-14 Bullet screen control method, bullet screen processing server and computer readable storage medium Active CN109474845B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811076875.4A CN109474845B (en) 2018-09-14 2018-09-14 Bullet screen control method, bullet screen processing server and computer readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811076875.4A CN109474845B (en) 2018-09-14 2018-09-14 Bullet screen control method, bullet screen processing server and computer readable storage medium

Publications (2)

Publication Number Publication Date
CN109474845A true CN109474845A (en) 2019-03-15
CN109474845B CN109474845B (en) 2021-11-16

Family

ID=65664326

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811076875.4A Active CN109474845B (en) 2018-09-14 2018-09-14 Bullet screen control method, bullet screen processing server and computer readable storage medium

Country Status (1)

Country Link
CN (1) CN109474845B (en)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110519617A (en) * 2019-07-18 2019-11-29 平安科技(深圳)有限公司 Video comments processing method, device, computer equipment and storage medium
CN110891194A (en) * 2019-12-06 2020-03-17 北京小米移动软件有限公司 Comment information display method and device, terminal and storage medium
CN111726696A (en) * 2019-03-21 2020-09-29 阿里巴巴集团控股有限公司 Application method, device and equipment of sound barrage and readable storage medium
CN111800664A (en) * 2019-09-23 2020-10-20 赵家琦 Content selection mechanism based on signal analysis
CN111818279A (en) * 2019-04-12 2020-10-23 阿里巴巴集团控股有限公司 Subtitle generating method, display method and interaction method
CN113055700A (en) * 2021-03-22 2021-06-29 北京卡路里信息技术有限公司 Method and device for displaying comment content
CN113051692A (en) * 2021-02-26 2021-06-29 国网河北省电力有限公司电力科学研究院 Model establishing method and device for fingerprint database of power distribution network and terminal equipment
CN113127628A (en) * 2021-04-23 2021-07-16 北京达佳互联信息技术有限公司 Method, device, equipment and computer-readable storage medium for generating comments
CN113778301A (en) * 2021-08-16 2021-12-10 盒马(中国)有限公司 Emotion interaction method based on content service and electronic equipment
CN113938739A (en) * 2021-09-09 2022-01-14 广州虎牙科技有限公司 Information display method and device, electronic equipment and storage medium

Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020146667A1 (en) * 2001-02-14 2002-10-10 Safe Drive Technologies, Llc Staged-learning process and system for situational awareness training using integrated media
CN104717124A (en) * 2013-12-13 2015-06-17 腾讯科技(深圳)有限公司 Friend recommendation method, device and server
CN105847735A (en) * 2016-03-30 2016-08-10 宁波三博电子科技有限公司 Face recognition-based instant pop-up screen video communication method and system
CN105872679A (en) * 2015-12-31 2016-08-17 乐视网信息技术(北京)股份有限公司 Barrage display method and device
CN105979338A (en) * 2016-05-16 2016-09-28 武汉斗鱼网络科技有限公司 System and method for matching colors according to emotions of bullet screen contents
CN106383449A (en) * 2016-10-27 2017-02-08 江苏金米智能科技有限责任公司 Smart home music control method and smart home music control system based on physiological data analysis
CN106909907A (en) * 2017-03-07 2017-06-30 佛山市融信通企业咨询服务有限公司 A kind of video communication sentiment analysis accessory system
CN107566914A (en) * 2017-10-23 2018-01-09 咪咕动漫有限公司 A kind of display control method of barrage, electronic equipment and storage medium
CN107659725A (en) * 2017-09-26 2018-02-02 维沃移动通信有限公司 A kind of audio-frequency processing method and mobile terminal
CN107948732A (en) * 2017-12-04 2018-04-20 京东方科技集团股份有限公司 Playback method, video play device and the system of video
CN107967933A (en) * 2017-12-15 2018-04-27 安徽徽韵心理咨询有限公司 A kind of multichannel body and mind feedback control system
CN108491244A (en) * 2018-03-20 2018-09-04 深圳市万普拉斯科技有限公司 A kind of Desktop-scene switching method, device and user terminal
CN108513175A (en) * 2018-03-29 2018-09-07 网宿科技股份有限公司 A kind of processing method and system of barrage information
CN108509033A (en) * 2018-03-13 2018-09-07 广东欧珀移动通信有限公司 Information processing method and related product

Patent Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020146667A1 (en) * 2001-02-14 2002-10-10 Safe Drive Technologies, Llc Staged-learning process and system for situational awareness training using integrated media
CN104717124A (en) * 2013-12-13 2015-06-17 腾讯科技(深圳)有限公司 Friend recommendation method, device and server
CN105872679A (en) * 2015-12-31 2016-08-17 乐视网信息技术(北京)股份有限公司 Barrage display method and device
CN105847735A (en) * 2016-03-30 2016-08-10 宁波三博电子科技有限公司 Face recognition-based instant pop-up screen video communication method and system
CN105979338A (en) * 2016-05-16 2016-09-28 武汉斗鱼网络科技有限公司 System and method for matching colors according to emotions of bullet screen contents
CN106383449A (en) * 2016-10-27 2017-02-08 江苏金米智能科技有限责任公司 Smart home music control method and smart home music control system based on physiological data analysis
CN106909907A (en) * 2017-03-07 2017-06-30 佛山市融信通企业咨询服务有限公司 A kind of video communication sentiment analysis accessory system
CN107659725A (en) * 2017-09-26 2018-02-02 维沃移动通信有限公司 A kind of audio-frequency processing method and mobile terminal
CN107566914A (en) * 2017-10-23 2018-01-09 咪咕动漫有限公司 A kind of display control method of barrage, electronic equipment and storage medium
CN107948732A (en) * 2017-12-04 2018-04-20 京东方科技集团股份有限公司 Playback method, video play device and the system of video
CN107967933A (en) * 2017-12-15 2018-04-27 安徽徽韵心理咨询有限公司 A kind of multichannel body and mind feedback control system
CN108509033A (en) * 2018-03-13 2018-09-07 广东欧珀移动通信有限公司 Information processing method and related product
CN108491244A (en) * 2018-03-20 2018-09-04 深圳市万普拉斯科技有限公司 A kind of Desktop-scene switching method, device and user terminal
CN108513175A (en) * 2018-03-29 2018-09-07 网宿科技股份有限公司 A kind of processing method and system of barrage information

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
CHUNLEI ZHAO: "《Supervision of Webcasting-Anchor Behavior Evaluation Based on Barrage Emotion Analysis》", 《2018 4TH INTERNATIONAL CONFERENCE ON BIG DATA COMPUTING AND COMMUNICATIONS》 *
吴年继: "《从哔哩哔哩弹幕评论看天文科学传播的三种视频形态》", 《中国科普理论与实践探索——第二十三届全国科普理论研讨会论文集》 *

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111726696A (en) * 2019-03-21 2020-09-29 阿里巴巴集团控股有限公司 Application method, device and equipment of sound barrage and readable storage medium
CN111726696B (en) * 2019-03-21 2022-09-09 阿里巴巴集团控股有限公司 Application method, device and equipment of sound barrage and readable storage medium
CN111818279A (en) * 2019-04-12 2020-10-23 阿里巴巴集团控股有限公司 Subtitle generating method, display method and interaction method
CN110519617A (en) * 2019-07-18 2019-11-29 平安科技(深圳)有限公司 Video comments processing method, device, computer equipment and storage medium
CN111800664B (en) * 2019-09-23 2022-04-15 深圳市天极文化科技有限公司 Content selection mechanism and method based on signal analysis
CN111800664A (en) * 2019-09-23 2020-10-20 赵家琦 Content selection mechanism based on signal analysis
CN110891194A (en) * 2019-12-06 2020-03-17 北京小米移动软件有限公司 Comment information display method and device, terminal and storage medium
CN113051692A (en) * 2021-02-26 2021-06-29 国网河北省电力有限公司电力科学研究院 Model establishing method and device for fingerprint database of power distribution network and terminal equipment
CN113055700A (en) * 2021-03-22 2021-06-29 北京卡路里信息技术有限公司 Method and device for displaying comment content
CN113127628A (en) * 2021-04-23 2021-07-16 北京达佳互联信息技术有限公司 Method, device, equipment and computer-readable storage medium for generating comments
CN113127628B (en) * 2021-04-23 2024-03-19 北京达佳互联信息技术有限公司 Method, apparatus, device and computer readable storage medium for generating comments
CN113778301A (en) * 2021-08-16 2021-12-10 盒马(中国)有限公司 Emotion interaction method based on content service and electronic equipment
CN113938739A (en) * 2021-09-09 2022-01-14 广州虎牙科技有限公司 Information display method and device, electronic equipment and storage medium
CN113938739B (en) * 2021-09-09 2024-04-19 广州虎牙科技有限公司 Information display method, information display device, electronic equipment and storage medium

Also Published As

Publication number Publication date
CN109474845B (en) 2021-11-16

Similar Documents

Publication Publication Date Title
CN109474845A (en) Bullet screen control method, bullet screen processing server and computer readable storage medium
US11259066B2 (en) System and method for enhancing content using brain-state data
US11720949B2 (en) Method and device for recommending gift and mobile terminal
US8418193B2 (en) Information processing terminal, information processing method, and program
US9122752B2 (en) Personalizing content based on mood
TWI681315B (en) Data transmission system and method thereof
CN112399200A (en) Method, device and storage medium for recommending information in live broadcast
CN104750387B (en) A kind of information processing method and electronic equipment
US20140108309A1 (en) Training a predictor of emotional response based on explicit voting on content and eye tracking to verify attention
CN107003797A (en) Intelligent automation assistant in media environment
CN106604066A (en) Improved personalized recommendation method and system applied to video application
US20120310971A1 (en) Fitness Device
CN106454536B (en) Method and device for determining information recommendation degree
CN110505491A (en) A kind of processing method of live streaming, device, electronic equipment and storage medium
CN106294831B (en) Information recommendation method and electronic equipment
CN108919953A (en) Music adjusting method, device and storage medium
US20090144071A1 (en) Information processing terminal, method for information processing, and program
CN109508427A (en) Information recommendation method, server and voice interaction terminal
CN106302471B (en) Method and device for recommending virtual gift
CN108848416A (en) The evaluation method and device of audio-video frequency content
CN109657236A (en) Guidance information acquisition methods, device, electronic device and storage medium
US20200286153A1 (en) Information recommendation method and server
CN112883209A (en) Recommendation method and processing method, device, equipment and readable medium for multimedia data
CN106792171A (en) Personalized recommendation method and system in intelligent video app
CN106649655A (en) Personalized recommending method and system in video app

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant