CN112135187B - Multimedia data generation method, intercepting method, device, equipment and storage medium - Google Patents

Multimedia data generation method, intercepting method, device, equipment and storage medium Download PDF

Info

Publication number
CN112135187B
CN112135187B CN202010751053.2A CN202010751053A CN112135187B CN 112135187 B CN112135187 B CN 112135187B CN 202010751053 A CN202010751053 A CN 202010751053A CN 112135187 B CN112135187 B CN 112135187B
Authority
CN
China
Prior art keywords
event information
control event
control
instruction
multimedia data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202010751053.2A
Other languages
Chinese (zh)
Other versions
CN112135187A (en
Inventor
肖亮亮
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangzhou Cubesili Information Technology Co Ltd
Original Assignee
Guangzhou Cubesili Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangzhou Cubesili Information Technology Co Ltd filed Critical Guangzhou Cubesili Information Technology Co Ltd
Priority to CN202010751053.2A priority Critical patent/CN112135187B/en
Publication of CN112135187A publication Critical patent/CN112135187A/en
Application granted granted Critical
Publication of CN112135187B publication Critical patent/CN112135187B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44213—Monitoring of end-user related data
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/4508—Management of client data or end-user data
    • H04N21/4532—Management of client data or end-user data involving end-user characteristics, e.g. viewer profile, preferences
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Social Psychology (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Management Or Editing Of Information On Record Carriers (AREA)
  • Television Signal Processing For Recording (AREA)

Abstract

The invention relates to the field of data processing, and provides a multimedia data generation method, an interception method, a device, equipment and a storage medium; acquiring first control event information and second control event information in the control event information set according to a preset matching rule; generating intercepted multimedia data according to the first control event information and the second control event information; and displaying the multimedia video to the user in a preset display mode. The method and the device can improve the timeliness of the user for recording the live video.

Description

Multimedia data generation method, intercepting method, device, equipment and storage medium
Technical Field
The present invention relates to the field of data processing, and in particular, to a method, an intercepting method, an apparatus, a device, and a storage medium for generating multimedia data.
Background
The recording of live video is to store the video data to be played during live video, and record the required video file according to the time and the video stream information by the stored video data, so as to provide the physical video file for subsequent editing and review.
With the continuous development of internet technology, the demand for live video sharing in real time is increasing. When a television channel or live is playing a highlight, users need to release the video just played to the internet in time so that more users can see the highlight video clip just played.
However, the existing live video recording method is complex in recording flow, poor in timeliness of live video recording and incapable of meeting the requirement of users for timely publishing live videos. Therefore, how to improve the timeliness of live video recording becomes a technical problem to be solved.
Disclosure of Invention
The invention mainly aims to provide a multimedia data generation method, a multimedia data interception device, multimedia data interception equipment and a multimedia data storage medium, and aims to solve the problem of improving the timeliness of live video recording.
To achieve the above object, a first aspect provides a multimedia data generating method, including:
receiving a control instruction, generating corresponding control event information according to the control instruction, and storing the control event information into a control event information set;
acquiring first control event information and second control event information in the control event information set according to a preset matching rule;
Generating the multimedia data according to the first control event information and the second control event information;
and displaying the multimedia video to a user in a preset display mode.
Preferably, the step of generating the corresponding control event information according to the control instruction includes:
generating control instruction information comprising identification information for identifying the control instruction according to the control instruction;
and when the control instruction information meets the instruction verification rule, generating corresponding control event information.
Preferably, after the step of "when the control instruction information satisfies the instruction verification rule", the method further includes:
and when the control instruction corresponding to the control instruction information is a preset cancel instruction, finding the last piece of control event information of the control instruction information from the control event information set, and deleting the last piece of control event information if the control instruction corresponding to the last piece of control event information is a preset start instruction.
Preferably, the step of generating the multimedia data from the first control event information and the second control event information includes:
generating a multimedia data interception instruction according to the first control event information and the second control event information;
And intercepting and generating corresponding multimedia data according to the multimedia intercepting instruction.
Preferably, the step of acquiring the first control event information and the second control event information in the control event information set according to a preset matching rule includes:
and acquiring first control event information from the control event information set, and deleting the first control event information when a control instruction corresponding to the first control event information is a preset ending instruction.
Preferably, the step of acquiring the first control event information and the second control event information in the control event information set according to a preset matching rule includes:
and acquiring first control event information from the control event information set, acquiring a second control event message when a control instruction corresponding to the first control event information is the preset start instruction, and deleting the first control event message when the control instruction corresponding to the second control event information is the preset start instruction.
Preferably, the step of acquiring the first control event information and the second control event information in the control event information set according to a preset matching rule includes:
And acquiring first control event information from the control event information set, acquiring a second control event message when a control instruction corresponding to the first control event information is the preset start instruction, and generating the multimedia data according to the first control event information and the second control event information when the control instruction corresponding to the second control event information is the preset end instruction.
The second aspect of the present invention provides a multimedia data interception method for intercepting multimedia data displayed on a user interaction interface, including:
receiving a control instruction, and generating control instruction information comprising identification information for identifying the control instruction according to the control instruction;
when the control instruction information meets an instruction verification rule, generating corresponding control event information, and storing the control event information into a control event information set;
acquiring first control event information and second control event information in the control event information set according to a preset matching rule;
and generating intercepted multimedia data according to the first control event information and the second control event information.
Preferably, the step of generating intercepted multimedia data according to the first control event information and the second control event information includes:
Generating a multimedia data interception instruction according to the first control event information and the second control event information;
and intercepting and generating corresponding multimedia data according to the multimedia intercepting instruction.
Preferably, after the step of "when the control instruction information satisfies the instruction verification rule", the method further includes:
and when the control instruction corresponding to the control instruction information is a preset cancel instruction, finding the last piece of control event information of the control instruction information from the control event information set, and deleting the last piece of control event information when the control instruction corresponding to the last piece of control event information is a preset start instruction.
Preferably, the step of acquiring the first control event information and the second control event information in the control event information set according to a preset matching rule includes:
and acquiring first control event information from the control event information set, and deleting the first control event information when a control instruction corresponding to the first control event information is a preset ending instruction.
Preferably, the step of acquiring the first control event information and the second control event information in the control event information set according to a preset matching rule includes:
And acquiring first control event information from the control event information set, acquiring a second control event message when a control instruction corresponding to the first control event information is the preset start instruction, and deleting the first control event message when the control instruction corresponding to the second control event information is the preset start instruction.
Preferably, the step of acquiring the first control event information and the second control event information in the control event information set according to a preset matching rule includes:
and acquiring first control event information from the control event information set, acquiring a second control event message when a control instruction corresponding to the first control event information is the preset starting instruction, and generating a multimedia data interception instruction according to the first control event information and the second control event information when the control instruction corresponding to the second control event information is the preset ending instruction.
To achieve the above object, a third aspect of the present invention provides a multimedia data generating apparatus, comprising:
the receiving module is used for receiving a control instruction, generating corresponding control event information according to the control instruction, and storing the control event information into a control event information set;
The acquisition module is used for acquiring first control event information and second control event information in the control event information set according to a preset matching rule;
the generation module is used for generating the multimedia data according to the first control event information and the second control event information;
and the display module is used for displaying the multimedia video to a user in a preset display mode.
In order to achieve the above object, a fourth aspect of the present invention provides an electronic device including a memory and a processor, the memory storing a multimedia data generating program, which when executed by the processor, implements the steps of the multimedia data generating method as described above.
To achieve the above object, a fifth aspect of the present invention provides a computer-readable storage medium having stored thereon a multimedia data generating program executable by one or more processors to implement the steps of the multimedia data generating method as described above.
To achieve the above object, a sixth aspect of the present invention provides a computer-readable storage medium having stored thereon a multimedia data interception program executable by one or more processors to implement the steps of the multimedia data interception method as described above.
The method, the device, the equipment and the storage medium for generating the multimedia data are characterized in that a control instruction is received, corresponding control event information is generated according to the control instruction, and the control event information is stored in a control event information set; acquiring first control event information and second control event information in the control event information set according to a preset matching rule; generating intercepted multimedia data according to the first control event information and the second control event information; and displaying the multimedia video to the user in a preset display mode. The method and the device can improve the timeliness of the user for recording the live video.
Drawings
Fig. 1 is a schematic diagram of a network deployment architecture of a multimedia data generation method according to an embodiment of the present invention;
fig. 2 is a flowchart illustrating a method for generating multimedia data according to an embodiment of the present invention;
fig. 3 is a schematic diagram of a user interface operation of an electronic device for implementing a method for generating multimedia data according to an embodiment of the present invention;
fig. 4 is a flowchart illustrating a method for capturing multimedia data according to an embodiment of the present invention;
fig. 5 is a schematic block diagram of a multimedia data generating apparatus according to an embodiment of the present invention;
Fig. 6 is a schematic diagram of an internal structure of an electronic device for implementing a method for generating multimedia data according to an embodiment of the present invention.
The achievement of the objects, functional features and advantages of the present invention will be further described with reference to the accompanying drawings, in conjunction with the embodiments.
Detailed Description
In order to make the objects, technical embodiments and advantages of the present invention more apparent, the present invention will be further described in detail with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
It should be noted that the description of "first", "second", etc. in this disclosure is for descriptive purposes only and is not to be construed as indicating or implying a relative importance or implying an indication of the number of technical features being indicated. Thus, a feature defining "a first" or "a second" may explicitly or implicitly include at least one such feature. In addition, the technical embodiments of the present embodiments may be combined with each other, but it is necessary that the combination of the technical embodiments should be considered that the combination of the technical embodiments does not exist or is not within the scope of protection claimed in the present invention when the combination of the technical embodiments contradicts or cannot be realized on the basis of the implementation of the technical embodiments by persons of ordinary skill in the art.
Fig. 1 is a schematic diagram of a network deployment architecture according to an embodiment of the present invention. The client 01 is installed with a multimedia data generation program 10. The plurality of clients 01 are connected to the server 03 via the network 02. The network 02 may be a local area network, a wide area network, a metropolitan area network, a personal area network, or the like; may be a wired network or a wireless network. The client 01 may be a desktop computer, a notebook computer, a tablet computer, a mobile phone, or other terminal devices with application software installed thereon, and may communicate with the server 03 through the network 02.
Because the existing live video recording method is complex in recording flow, the timeliness of live video recording is poor, and the requirement of users for timely publishing live videos cannot be met.
Accordingly, in order to solve the above-mentioned problems, an aspect of the present invention provides a multimedia data generation method. Fig. 2 is a flowchart illustrating a method for generating multimedia data according to an embodiment of the invention. The method may be performed by an apparatus, which may be implemented in software and/or hardware.
S110, receiving a control instruction, generating corresponding control event information according to the control instruction, and storing the control event information into a control event information set.
In this embodiment, in order to make the present embodiment more clear, the present scheme is further explained by taking as an example how to intercept, according to the preference of the user, the video generated in the live broadcast process on the live broadcast platform APP in time, and taking the client as the execution subject, where the client refers to a computer or a mobile phone or other electronic devices capable of installing the live broadcast platform APP. Specifically, the control instruction may be triggered by detecting an operation of the client by the user, for example, by inputting text information on a keyboard of the client; the control actions of the user can be detected to trigger, such as waving hands or moving fingers, twisting fingers, opening palms, turning wrists, gazing or shifting vision, moving heads and bodies; the user's voice information may also be detected by detecting a user's voice input to trigger, e.g., by a microphone, etc.
In a specific embodiment, the control instruction may be that a piece of data is input in the input area 002 of the operation interface 001 of the client by the user, and then the control area 003 is clicked to confirm to trigger, for example, "SSS", and a text bullet screen is generated and displayed on the display area 004 of the client. Referring to fig. 3, a schematic operation diagram of a user interface of an electronic device implementing a method for generating multimedia data according to an embodiment of the present invention is shown.
When the client receives a control instruction sent by a user, the client generates control instruction information including identification information (e.g. UID: unique identification of the user) for identifying the control instruction according to the control instruction, namely, the intention of the user is identified through the control instruction information, for example, different control instructions can indicate that the user wants to start video capturing operation at a certain time point, end video capturing operation at a certain time point or cancel video capturing operation at a certain time point. Identity information of the user (e.g., UID: unique identification of the user) may also be identified by the control instruction information.
Further, since the live platform belongs to a public platform facing to the audience, any user can log in the live platform and send a control instruction to the client. If all users can randomly intercept videos generated in the live broadcast process and issue small videos by sending control instructions, the same live broadcast video can be led to derive a plurality of small videos with different quality, and the overall quality of the small videos is affected. Therefore, in the present embodiment, it is necessary to specify that when it is judged that the received control instruction information satisfies the instruction verification rule, the corresponding control event information is generated and the control event information is stored in the control event information set.
Wherein the verification rule includes:
judging whether the identification information corresponding to the control instruction information is contained in a pre-established white list, and if so, generating control event information corresponding to the control instruction information.
The white list records identification information (such as UID) with specified authority, namely the authority controls the client to perform operations such as video interception, stopping video interception, canceling video interception and the like through a control instruction.
In another embodiment, the method further comprises:
and when the control instruction corresponding to the control instruction information is a preset cancel instruction, finding the last piece of control event information of the control instruction information from the control event information set, and deleting the last piece of control event information if the control instruction corresponding to the last piece of control event information is a preset start instruction.
In order to meet the requirement that the user can cancel the control instruction sent at this time according to the actual situation after sending the control instruction which wants to carry out the video capturing operation. In this embodiment, the control instruction may be further configured as an instruction capable of controlling the client to cancel the video capturing operation. Specifically, when the client receives a control instruction sent by the user as a preset cancel instruction (for example, "CCC"), the client first finds the last piece of control event information of the control instruction information from the control event information set, and if the control instruction corresponding to the last piece of control event information is a preset start instruction (for example, "SSS"), deletes the last piece of control event information, namely cancels the video capturing operation.
S120, acquiring first control event information and second control event information in the control event information set according to a preset matching rule.
In this embodiment, the invalid control instruction is automatically filtered by using the preset matching rule, and it is specified that only the first control event and the second control event that simultaneously satisfy the matching rule can intercept and generate the multimedia data.
Specifically, the implementation process how to obtain the first control event information and the second control event information according to the preset matching rule may be implemented by the following steps:
and acquiring first control event information from the control event information set, and deleting the first control event information when a control instruction corresponding to the first control event information is a preset ending instruction. For example, when the control instruction corresponding to the first control event information is a preset end instruction "EEE", because there is no preset start instruction matching with the first control event information, the first control event information is directly deleted, or is included in the to-be-deleted event list, and waits for deletion.
It can also be realized by the following steps:
and acquiring first control event information from the control event information set, acquiring a second control event message when a control instruction corresponding to the first control event information is the preset start instruction, and deleting the first control event message when the control instruction corresponding to the second control event information is the preset start instruction. For example, when the control instruction corresponding to the first control event information is a preset start instruction "SSs", a second control event message is acquired, and when the control instruction corresponding to the second control event information is the preset start instruction "SSs" like the first control event information, the first control event message needs to be deleted at this time, and the first control event information is directly deleted, or is included in an event list to be deleted, and waits for deletion. And reserving a preset starting instruction closest to the current event, namely second control event information.
It can also be realized by the following steps:
and acquiring first control event information from the control event information set, acquiring a second control event message when a control instruction corresponding to the first control event information is the preset starting instruction, and generating a multimedia data interception instruction according to the first control event information and the second control event information when the control instruction corresponding to the second control event information is the preset ending instruction. For example, when the control instruction corresponding to the first control event information is a preset start instruction "SSS", a second control event message is obtained, and when the control instruction corresponding to the second control event information is a preset end instruction "EEE", the first control event information and the second control event information are paired just successfully at this time, and a multimedia data (for example, a video generated in a live broadcast process) intercepting instruction can be generated according to the first control event information and the second control event information.
In another embodiment, the method further comprises:
acquiring first control event information from the control event information set, and acquiring grouping information corresponding to the first control event information, wherein the grouping information is included in the control event information;
And acquiring second control event information of the same group from the control event information set according to the group information.
In this embodiment, the first control event information and the second control event information corresponding to the same user need to be grouped and categorized, so as to avoid confusion of pairing of the first control event information and the second control event information of different users.
And S130, generating the multimedia data according to the first control event information and the second control event information.
In this embodiment, when the first control event information and the second control event information in the control event information set are obtained by using the preset matching rule and can be paired successfully, a multimedia data interception instruction may be generated according to the first control event information and the second control event information, and corresponding multimedia data (for example, a video generated in a live broadcast process) may be intercepted and generated according to the multimedia interception instruction.
In another embodiment, the method further comprises the steps of:
screening a plurality of multimedia data interception instructions according to a preset interception instruction screening rule, and reserving one multimedia data interception instruction from the plurality of multimedia data interception instructions with similarity larger than or equal to a preset threshold value.
In order to make the embodiment more clear, the scheme is further explained by taking the example of how to intercept the video generated in the live broadcast process on the live broadcast platform APP in time according to the preference of the user. Because a plurality of users contained in the white list can simultaneously carry out video interception operation on the same live video, and the video content obtained after interception is just similar, the whole quality of the video can be affected if the de-duplication processing is not carried out.
In order to solve the above problem, in this embodiment, by screening a plurality of multimedia data interception instructions, only one of the multimedia data interception instructions is reserved, and the specific implementation process includes:
and respectively carrying out pairwise similarity value calculation on all the multimedia data interception instructions, and reserving one multimedia data interception instruction from a plurality of multimedia data interception instructions with similarity greater than or equal to a preset threshold value. The specific similarity value calculation algorithm can adopt a conventional cosine similarity algorithm.
In another embodiment, the method further comprises the steps of:
screening out a multimedia data interception instruction with the interval time length between the first control event information and the second control event information being longer than or equal to a first preset time length;
And delaying the time point corresponding to the first control event information by the time point obtained by the first preset duration to obtain the time point of the second control event information.
In this embodiment, by limiting the maximum duration of data interception, the video release failure caused by the fact that the duration of the video recorded by the user exceeds the maximum duration specified by the video is avoided. Specifically, a multimedia data interception instruction with the interval time length between the first control event information and the second control event information being longer than or equal to a first preset time length is screened out, and a time point obtained by delaying a time point corresponding to the first control event information by the first preset time length is taken as a time point of the second control event information. For example, the time point corresponding to the first control event information is 15:20:00, the time point corresponding to the second control event information is 15:26:23, the first preset duration is 5 minutes, and the time point corresponding to the second control event information already exceeds the first preset duration, so that the actual time point corresponding to the second control event information is 15:25:00 after the time point corresponding to the first control event information is delayed by the first preset duration.
In another embodiment, the method further comprises the steps of:
And judging whether the multimedia data accords with the auditing rule.
To prevent illegal information, such as sensitive information, from being present in the intercepted video, the video distribution fails. Therefore, in this embodiment, after the video capturing is completed, it needs to be determined whether the multimedia data meets the auditing rule, and the specific auditing rule can refer to the current legal rule for video publishing.
In another embodiment, the time point corresponding to the first control event information or the time point corresponding to the second control event information is obtained by converting a preset expression rule;
wherein, the preset expression rule comprises:
the time point corresponding to the first control event information is equal to the time when the control instruction corresponding to the first control event information is sent out, and the time is increased or decreased by a second preset time length; or (b)
The time corresponding to the second control event information is equal to the third preset time length increased or decreased at the time point when the control instruction corresponding to the second control event information is sent.
Since in practice, the user may not recall that the video capturing operation is performed until a certain period of time elapses from the highlight of the multimedia data, it is not enough to issue the video capturing instruction at this time. Therefore, in order to make the scheme more suitable for the actual situation of the user, in this embodiment, the time point corresponding to the first control event information or the time point corresponding to the second control event information may be obtained through transformation of the preset expression rule.
For example, when the control instruction issued by the user is "SSS-10s", the time point of the control event information correspondingly generated is the current time-10 s.
For another example, when the control instruction issued by the user is "sss+10s", the current time at the point in time of the corresponding generation of the control event information is +10s.
And S140, displaying the multimedia video to a user in a preset display mode.
In this embodiment, after the multimedia data is generated, the multimedia data (such as a video generated in a live broadcast process) may be displayed to the user through a preset display manner. The display mode may be to directly play the generated multimedia data on the client (for example, a mobile phone or a computer), or send a reminding message of "successful data interception" to be displayed on the client to remind the user that the data has been generated.
The invention also provides a multimedia data interception method for intercepting the multimedia data displayed on the user interaction interface. Fig. 4 is a flowchart illustrating a multimedia data interception method according to an embodiment of the invention. The method may be performed by an apparatus, which may be implemented in software and/or hardware.
In this embodiment, the multimedia data interception method includes:
s210, receiving a control instruction, and generating control instruction information comprising identification information for identifying the control instruction according to the control instruction.
In this embodiment, in order to make the present embodiment more clear, the present scheme is further explained by taking as an example how to intercept, according to the preference of the user, the video generated in the live broadcast process on the live broadcast platform APP in time, and taking the client as the execution subject, where the client refers to a computer or a mobile phone or other electronic devices capable of installing the live broadcast platform APP. Specifically, the control instruction may be triggered by detecting an operation of the client by the user, for example, by inputting text information on a keyboard of the client; the control actions of the user can be detected to trigger, such as waving hands or moving fingers, twisting fingers, opening palms, turning wrists, gazing or shifting vision, moving heads and bodies; the user's voice information may also be detected by detecting a user's voice input to trigger, e.g., by a microphone, etc.
In a specific embodiment, the control instruction may be that a piece of data is input in the input area 002 of the operation interface 001 of the client by the user, and then the control area 003 is clicked to confirm to trigger, for example, "SSS", and a text bullet screen is generated and displayed on the display area 004 of the client. Referring to fig. 3, a schematic operation diagram of a user interface of an electronic device implementing a method for generating multimedia data according to an embodiment of the present invention is shown.
When the client receives a control instruction sent by a user, the client generates control instruction information including identification information (e.g. UID: unique identification of the user) for identifying the control instruction according to the control instruction, namely, the intention of the user is identified through the control instruction information, for example, different control instructions can indicate that the user wants to start video capturing operation at a certain time point, end video capturing operation at a certain time point or cancel video capturing operation at a certain time point. Identity information of the user (e.g., UID: unique identification of the user) may also be identified by the control instruction information.
And S220, when the control instruction information meets the instruction verification rule, generating corresponding control event information, and storing the control event information into a control event information set.
In this embodiment, in order to make the present embodiment more clear, the present solution is further explained by taking the foregoing example of how to intercept, according to the preference of the user, the video generated in the live broadcast process on the live broadcast platform APP in time, and taking the client as the execution subject, where the client refers to a computer or a mobile phone or other electronic devices capable of installing the live broadcast platform APP. Specifically, since the live platform belongs to a public platform facing to audience, any user can log in the live platform and send a control instruction to the client. If all users can randomly intercept videos generated in the live broadcast process and issue small videos by sending control instructions, the same live broadcast video can be led to derive a plurality of small videos with different quality, and the overall quality of the small videos is affected. Therefore, in the present embodiment, it is necessary to specify that when it is judged that the received control instruction information satisfies the instruction verification rule, the corresponding control event information is generated and the control event information is stored in the control event information set.
Wherein the verification rule includes:
judging whether the identification information corresponding to the control instruction information is contained in a pre-established white list, and if so, generating control event information corresponding to the control instruction information.
The white list records identification information (such as UID) with specified authority, namely the authority controls the client to perform operations such as video interception, stopping video interception, canceling video interception and the like through a control instruction.
In another embodiment, the method further comprises:
and when the control instruction corresponding to the control instruction information is a preset cancel instruction, finding the last piece of control event information of the control instruction information from the control event information set, and deleting the last piece of control event information if the control instruction corresponding to the last piece of control event information is a preset start instruction.
In order to meet the requirement that the user can cancel the control instruction sent at this time according to the actual situation after sending the control instruction which wants to carry out the video capturing operation. In this embodiment, the control instruction may be further configured as an instruction capable of controlling the client to cancel the video capturing operation. Specifically, when the client receives a control instruction sent by the user as a preset cancel instruction (for example, "CCC"), the client first finds the last piece of control event information of the control instruction information from the control event information set, and if the control instruction corresponding to the last piece of control event information is a preset start instruction (for example, "SSS"), deletes the last piece of control event information, namely cancels the video capturing operation.
S230, acquiring first control event information and second control event information in the control event information set according to a preset matching rule.
In this embodiment, the invalid control instruction is automatically filtered by using the preset matching rule, and it is specified that only the first control event and the second control event that simultaneously satisfy the matching rule can intercept and generate the multimedia data.
Specifically, the implementation process how to obtain the first control event information and the second control event information according to the preset matching rule may be implemented by the following steps:
and acquiring first control event information from the control event information set, and deleting the first control event information when a control instruction corresponding to the first control event information is a preset ending instruction. For example, when the control instruction corresponding to the first control event information is a preset end instruction "EEE", because there is no preset start instruction matching with the first control event information, the first control event information is directly deleted, or is included in the to-be-deleted event list, and waits for deletion.
It can also be realized by the following steps:
and acquiring first control event information from the control event information set, acquiring a second control event message when a control instruction corresponding to the first control event information is the preset start instruction, and deleting the first control event message when the control instruction corresponding to the second control event information is the preset start instruction. For example, when the control instruction corresponding to the first control event information is a preset start instruction "SSs", a second control event message is acquired, and when the control instruction corresponding to the second control event information is the preset start instruction "SSs" like the first control event information, the first control event message needs to be deleted at this time, and the first control event information is directly deleted, or is included in an event list to be deleted, and waits for deletion. And reserving a preset starting instruction closest to the current event, namely second control event information.
It can also be realized by the following steps:
and acquiring first control event information from the control event information set, acquiring a second control event message when a control instruction corresponding to the first control event information is the preset starting instruction, and generating a multimedia data interception instruction according to the first control event information and the second control event information when the control instruction corresponding to the second control event information is the preset ending instruction. For example, when the control instruction corresponding to the first control event information is a preset start instruction "SSS", a second control event message is obtained, and when the control instruction corresponding to the second control event information is a preset end instruction "EEE", the first control event information and the second control event information are paired just successfully at this time, and a multimedia data (for example, a video generated in a live broadcast process) intercepting instruction can be generated according to the first control event information and the second control event information.
In another embodiment, the method further comprises:
acquiring first control event information from the control event information set, and acquiring grouping information corresponding to the first control event information, wherein the grouping information is included in the control event information;
And acquiring second control event information of the same group from the control event information set according to the group information.
In this embodiment, the first control event information and the second control event information corresponding to the same user need to be grouped and categorized, so as to avoid confusion of pairing of the first control event information and the second control event information of different users.
S240, generating intercepted multimedia data according to the first control event information and the second control event information.
In this embodiment, when the first control event information and the second control event information in the control event information set are obtained by using the preset matching rule and can be paired successfully, a multimedia data interception instruction may be generated according to the first control event information and the second control event information, and corresponding multimedia data (for example, a video generated in a live broadcast process) may be intercepted and generated according to the multimedia interception instruction.
In another embodiment, the method further comprises the steps of:
screening a plurality of multimedia data interception instructions according to a preset interception instruction screening rule, and reserving one multimedia data interception instruction from the plurality of multimedia data interception instructions with similarity larger than or equal to a preset threshold value.
In order to make the embodiment more clear, the scheme is further explained by taking the example of how to intercept the video generated in the live broadcast process on the live broadcast platform APP in time according to the preference of the user. Because a plurality of users contained in the white list can simultaneously carry out video interception operation on the same live video, and the video content obtained after interception is just similar, the whole quality of the video can be affected if the de-duplication processing is not carried out.
In order to solve the above problem, in this embodiment, by screening a plurality of multimedia data interception instructions, only one of the multimedia data interception instructions is reserved, and the specific implementation process includes:
and respectively carrying out pairwise similarity value calculation on all the multimedia data interception instructions, and reserving one multimedia data interception instruction from a plurality of multimedia data interception instructions with similarity greater than or equal to a preset threshold value. The specific similarity value calculation algorithm can adopt a conventional cosine similarity algorithm.
In another embodiment, the method further comprises the steps of:
screening out a multimedia data interception instruction with the interval time length between the first control event information and the second control event information being longer than or equal to a first preset time length;
And delaying the time point corresponding to the first control event information by the time point obtained by the first preset duration to obtain the time point of the second control event information.
In this embodiment, by limiting the maximum duration of data interception, the video release failure caused by the fact that the duration of the video recorded by the user exceeds the maximum duration specified by the video is avoided. Specifically, a multimedia data interception instruction with the interval time length between the first control event information and the second control event information being longer than or equal to a first preset time length is screened out, and a time point obtained by delaying a time point corresponding to the first control event information by the first preset time length is taken as a time point of the second control event information. For example, the time point corresponding to the first control event information is 15:20:00, the time point corresponding to the second control event information is 15:26:23, the first preset duration is 5 minutes, and the time point corresponding to the second control event information already exceeds the first preset duration, so that the actual time point corresponding to the second control event information is 15:25:00 after the time point corresponding to the first control event information is delayed by the first preset duration.
In another embodiment, the method further comprises the steps of:
And judging whether the multimedia data accords with the auditing rule.
To prevent illegal information, such as sensitive information, from being present in the intercepted video, the video distribution fails. Therefore, in this embodiment, after the video capturing is completed, it needs to be determined whether the multimedia data meets the auditing rule, and the specific auditing rule can refer to the current legal rule for video publishing.
In another embodiment, the time point corresponding to the first control event information or the time point corresponding to the second control event information is obtained by converting a preset expression rule;
wherein, the preset expression rule comprises:
the time point corresponding to the first control event information is equal to the time when the control instruction corresponding to the first control event information is sent out, and the time is increased or decreased by a second preset time length; or (b)
The time corresponding to the second control event information is equal to the third preset time length increased or decreased at the time point when the control instruction corresponding to the second control event information is sent.
Since in practice, the user may not recall that the video capturing operation is performed until a certain period of time elapses from the highlight of the multimedia data, it is not enough to issue the video capturing instruction at this time. Therefore, in order to make the scheme more suitable for the actual situation of the user, in this embodiment, the time point corresponding to the first control event information or the time point corresponding to the second control event information may be obtained through transformation of the preset expression rule.
For example, when the control instruction issued by the user is "SSS-10s", the time point of the control event information correspondingly generated is the current time-10 s.
For another example, when the control instruction issued by the user is "sss+10s", the current time at the point in time of the corresponding generation of the control event information is +10s.
In another embodiment, the method further comprises the steps of:
and displaying the multimedia video to a user in a preset display mode.
In this embodiment, after the multimedia data is generated, the multimedia data (such as a video generated in a live broadcast process) may be displayed to the user through a preset display manner. The display mode may be to directly play the generated multimedia data on the client (for example, a mobile phone or a computer), or send a reminding message of "successful data interception" to be displayed on the client to remind the user that the data has been generated.
For a detailed description of the above steps, please refer to the following fig. 5 for a schematic diagram of the program modules of the embodiment of the multimedia data generation program 10 and fig. 2 for a schematic diagram of the method flow chart of the embodiment of the multimedia data generation method.
As shown in fig. 5, a functional block diagram of the multimedia data generating apparatus 100 according to the present invention is shown.
The multimedia generating apparatus 100 according to the present invention may be installed in the electronic device 1. The multimedia generating device 100 may include a receiving module 110, an obtaining module 120, a generating module 130, and a displaying module 140 according to the implemented functions. The module according to the invention, which may also be referred to as a unit, refers to a series of computer program segments, which are stored in the memory of the electronic device 1, capable of being executed by the processor of the electronic device 1 and of performing a fixed function.
In the present embodiment, the functions concerning the respective modules/units are as follows:
the receiving module 110 is configured to receive a control instruction, generate corresponding control event information according to the control instruction, and store the control event information in a control event information set.
In this embodiment, in order to make the present embodiment more clear, the present scheme is further explained by taking as an example how to intercept, according to the preference of the user, the video generated in the live broadcast process on the live broadcast platform APP in time, and taking the client as the execution subject, where the client refers to a computer or a mobile phone or other electronic devices capable of installing the live broadcast platform APP. Specifically, the control instruction may be triggered by detecting an operation of the client by the user, for example, by inputting text information on a keyboard of the client; the control actions of the user can be detected to trigger, such as waving hands or moving fingers, twisting fingers, opening palms, turning wrists, gazing or shifting vision, moving heads and bodies; the user's voice information may also be detected by detecting a user's voice input to trigger, e.g., by a microphone, etc.
In a specific embodiment, the control instruction may be that a piece of data is input in the input area 002 of the operation interface 001 of the client by the user, and then the control area 003 is clicked to confirm to trigger, for example, "SSS", and a text bullet screen is generated and displayed on the display area 004 of the client. Referring to fig. 3, a schematic operation diagram of a user interface of an electronic device implementing a method for generating multimedia data according to an embodiment of the present invention is shown.
When the client receives a control instruction sent by a user, the client generates control instruction information including identification information (e.g. UID: unique identification of the user) for identifying the control instruction according to the control instruction, namely, the intention of the user is identified through the control instruction information, for example, different control instructions can indicate that the user wants to start video capturing operation at a certain time point, end video capturing operation at a certain time point or cancel video capturing operation at a certain time point. Identity information of the user (e.g., UID: unique identification of the user) may also be identified by the control instruction information.
Further, since the live platform belongs to a public platform facing to the audience, any user can log in the live platform and send a control instruction to the client. If all users can randomly intercept videos generated in the live broadcast process and issue small videos by sending control instructions, the same live broadcast video can be led to derive a plurality of small videos with different quality, and the overall quality of the small videos is affected. Therefore, in the present embodiment, it is necessary to specify that when it is judged that the received control instruction information satisfies the instruction verification rule, the corresponding control event information is generated and the control event information is stored in the control event information set.
Wherein the verification rule includes:
judging whether the identification information corresponding to the control instruction information is contained in a pre-established white list, and if so, generating control event information corresponding to the control instruction information.
The white list records identification information (such as UID) with specified authority, namely the authority controls the client to perform operations such as video interception, stopping video interception, canceling video interception and the like through a control instruction.
In another embodiment, the apparatus further comprises a deletion module for:
and when the control instruction corresponding to the control instruction information is a preset cancel instruction, finding the last piece of control event information of the control instruction information from the control event information set, and deleting the last piece of control event information if the control instruction corresponding to the last piece of control event information is a preset start instruction.
In order to meet the requirement that the user can cancel the control instruction sent at this time according to the actual situation after sending the control instruction which wants to carry out the video capturing operation. In this embodiment, the control instruction may be further configured as an instruction capable of controlling the client to cancel the video capturing operation. Specifically, when the client receives a control instruction sent by the user as a preset cancel instruction (for example, "CCC"), the client first finds the last piece of control event information of the control instruction information from the control event information set, and if the control instruction corresponding to the last piece of control event information is a preset start instruction (for example, "SSS"), deletes the last piece of control event information, namely cancels the video capturing operation.
The obtaining module 120 is configured to obtain the first control event information and the second control event information in the control event information set according to a preset matching rule.
In this embodiment, the invalid control instruction is automatically filtered by using the preset matching rule, and it is specified that only the first control event and the second control event that simultaneously satisfy the matching rule can intercept and generate the multimedia data.
Specifically, the implementation process how to obtain the first control event information and the second control event information according to the preset matching rule may be implemented by the following steps:
and acquiring first control event information from the control event information set, and deleting the first control event information when a control instruction corresponding to the first control event information is a preset ending instruction. For example, when the control instruction corresponding to the first control event information is a preset end instruction "EEE", because there is no preset start instruction matching with the first control event information, the first control event information is directly deleted, or is included in the to-be-deleted event list, and waits for deletion.
It can also be realized by the following steps:
and acquiring first control event information from the control event information set, acquiring a second control event message when a control instruction corresponding to the first control event information is the preset start instruction, and deleting the first control event message when the control instruction corresponding to the second control event information is the preset start instruction. For example, when the control instruction corresponding to the first control event information is a preset start instruction "SSs", a second control event message is acquired, and when the control instruction corresponding to the second control event information is the preset start instruction "SSs" like the first control event information, the first control event message needs to be deleted at this time, and the first control event information is directly deleted, or is included in an event list to be deleted, and waits for deletion. And reserving a preset starting instruction closest to the current event, namely second control event information.
It can also be realized by the following steps:
and acquiring first control event information from the control event information set, acquiring a second control event message when a control instruction corresponding to the first control event information is the preset starting instruction, and generating a multimedia data interception instruction according to the first control event information and the second control event information when the control instruction corresponding to the second control event information is the preset ending instruction. For example, when the control instruction corresponding to the first control event information is a preset start instruction "SSS", a second control event message is obtained, and when the control instruction corresponding to the second control event information is a preset end instruction "EEE", the first control event information and the second control event information are paired just successfully at this time, and a multimedia data (for example, a video generated in a live broadcast process) intercepting instruction can be generated according to the first control event information and the second control event information.
In another embodiment, the apparatus further comprises a grouping module for:
acquiring first control event information from the control event information set, and acquiring grouping information corresponding to the first control event information, wherein the grouping information is included in the control event information;
And acquiring second control event information of the same group from the control event information set according to the group information.
In this embodiment, the first control event information and the second control event information corresponding to the same user need to be grouped and categorized, so as to avoid confusion of pairing of the first control event information and the second control event information of different users.
And a generating module 130, configured to generate the multimedia data according to the first control event information and the second control event information.
In this embodiment, when the first control event information and the second control event information in the control event information set are obtained by using the preset matching rule and can be paired successfully, a multimedia data interception instruction may be generated according to the first control event information and the second control event information, and corresponding multimedia data (for example, a video generated in a live broadcast process) may be intercepted and generated according to the multimedia interception instruction.
In another embodiment, the apparatus further comprises a first screening module for:
screening a plurality of multimedia data interception instructions according to a preset interception instruction screening rule, and reserving one multimedia data interception instruction from the plurality of multimedia data interception instructions with similarity larger than or equal to a preset threshold value.
In order to make the embodiment more clear, the scheme is further explained by taking the example of how to intercept the video generated in the live broadcast process on the live broadcast platform APP in time according to the preference of the user. Because a plurality of users contained in the white list can simultaneously carry out video interception operation on the same live video, and the video content obtained after interception is just similar, the whole quality of the video can be affected if the de-duplication processing is not carried out.
In order to solve the above problem, in this embodiment, by screening a plurality of multimedia data interception instructions, only one of the multimedia data interception instructions is reserved, and the specific implementation process includes:
and respectively carrying out pairwise similarity value calculation on all the multimedia data interception instructions, and reserving one multimedia data interception instruction from a plurality of multimedia data interception instructions with similarity greater than or equal to a preset threshold value. The specific similarity value calculation algorithm can adopt a conventional cosine similarity algorithm.
In another embodiment, the apparatus further comprises a second screening module for:
screening out a multimedia data interception instruction with the interval time length between the first control event information and the second control event information being longer than or equal to a first preset time length;
And delaying the time point corresponding to the first control event information by the time point obtained by the first preset duration to obtain the time point of the second control event information.
In this embodiment, by limiting the maximum duration of data interception, the video release failure caused by the fact that the duration of the video recorded by the user exceeds the maximum duration specified by the video is avoided. Specifically, a multimedia data interception instruction with the interval time length between the first control event information and the second control event information being longer than or equal to a first preset time length is screened out, and a time point obtained by delaying a time point corresponding to the first control event information by the first preset time length is taken as a time point of the second control event information. For example, the time point corresponding to the first control event information is 15:20:00, the time point corresponding to the second control event information is 15:26:23, the first preset duration is 5 minutes, and the time point corresponding to the second control event information already exceeds the first preset duration, so that the actual time point corresponding to the second control event information is 15:25:00 after the time point corresponding to the first control event information is delayed by the first preset duration.
In another embodiment, the apparatus further comprises an auditing module for:
And judging whether the multimedia data accords with the auditing rule.
To prevent illegal information, such as sensitive information, from being present in the intercepted video, the video distribution fails. Therefore, in this embodiment, after the video capturing is completed, it needs to be determined whether the multimedia data meets the auditing rule, and the specific auditing rule can refer to the current legal rule for video publishing.
In another embodiment, the time point corresponding to the first control event information or the time point corresponding to the second control event information is obtained by converting a preset expression rule;
wherein, the preset expression rule comprises:
the time point corresponding to the first control event information is equal to the time when the control instruction corresponding to the first control event information is sent out, and the time is increased or decreased by a second preset time length; or (b)
The time corresponding to the second control event information is equal to the third preset time length increased or decreased at the time point when the control instruction corresponding to the second control event information is sent.
Since in practice, the user may not recall that the video capturing operation is performed until a certain period of time elapses from the highlight of the multimedia data, it is not enough to issue the video capturing instruction at this time. Therefore, in order to make the scheme more suitable for the actual situation of the user, in this embodiment, the time point corresponding to the first control event information or the time point corresponding to the second control event information may be obtained through transformation of the preset expression rule.
For example, when the control instruction issued by the user is "SSS-10s", the time point of the control event information correspondingly generated is the current time-10 s.
For another example, when the control instruction issued by the user is "sss+10s", the current time at the point in time of the corresponding generation of the control event information is +10s.
And the display module 140 is used for displaying the multimedia video to a user in a preset display mode.
In this embodiment, after the multimedia data is generated, the multimedia data (such as a video generated in a live broadcast process) may be displayed to the user through a preset display manner. The display mode may be to directly play the generated multimedia data on the client (for example, a mobile phone or a computer), or send a reminding message of "successful data interception" to be displayed on the client to remind the user that the data has been generated.
Fig. 6 is a schematic structural diagram of an electronic device for implementing the method for generating multimedia data according to the present invention.
The electronic device 1 may comprise a processor 12, a memory 11 and a bus, and may further comprise a computer program, such as a multimedia data generating program 10, stored in the memory 11 and executable on the processor 12.
Wherein the memory 11 comprises at least one type of readable storage medium having stored thereon a multimedia data generating program executable by one or more processors. The readable storage medium includes flash memory, a removable hard disk, a multimedia card, a card type memory (e.g., SD or DX memory, etc.), a magnetic memory, a magnetic disk, an optical disk, etc. The memory 11 may in some embodiments be an internal storage unit of the electronic device 1, such as a removable hard disk of the electronic device 1. The memory 11 may in other embodiments also be an external storage device of the electronic device 1, such as a plug-in mobile hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card) or the like, which are provided on the electronic device 1. Further, the memory 11 may also include both an internal storage unit and an external storage device of the electronic device 1. The memory 11 may be used not only for storing application software installed in the electronic device 1 and various types of data, such as codes of the multimedia data generating program 10, but also for temporarily storing data that has been output or is to be output.
The processor 12 may be comprised of integrated circuits in some embodiments, for example, a single packaged integrated circuit, or may be comprised of multiple integrated circuits packaged with the same or different functions, including one or more central processing units (Central Processing unit, CPU), microprocessors, digital processing chips, graphics processors, combinations of various control chips, and the like. The processor 12 is a Control Unit (Control Unit) of the electronic device 1, connects respective components of the entire electronic device 1 using various interfaces and lines, executes or executes programs or modules (e.g., a multimedia data generation program, etc.) stored in the memory 11, and invokes data stored in the memory 11 to perform various functions of the electronic device 1 and process data.
The bus may be a peripheral component interconnect standard (peripheral component interconnect, PCI) bus or an extended industry standard architecture (extended industry standard architecture, EISA) bus, among others. The bus may be classified as an address bus, a data bus, a control bus, etc. The bus is arranged to enable a connection communication between the memory 11 and at least one processor 12 etc.
Fig. 6 shows only an electronic device 1 with components, it being understood by a person skilled in the art that the structure shown in fig. 6 does not constitute a limitation of the electronic device 1, and may comprise fewer or more components than shown, or may combine certain components, or may be arranged in different components.
For example, although not shown, the electronic device 1 may further include a power source (such as a battery) for powering the various components, and the power source may be logically connected to the at least one processor 12 via a power management system, thereby implementing functions such as charge management, discharge management, and power consumption management via the power management system. The power supply may also include one or more of any of a direct current or alternating current power supply, a recharging system, a power failure detection circuit, a power converter or inverter, a power status indicator, and the like. The electronic device 1 may further include various sensors, bluetooth modules, wi-Fi modules, etc., which will not be described herein.
Further, the electronic device 1 may further comprise a network interface 13, optionally the network interface 13 may comprise a wired interface and/or a wireless interface (e.g. WI-FI interface, bluetooth interface, etc.), typically used for establishing a communication connection between the electronic device 1 and other electronic devices 1.
The electronic device 1 may optionally further comprise a user interface, which may be a Display, an input unit, such as a Keyboard (Keyboard), or a standard wired interface, a wireless interface. Alternatively, in some embodiments, the display may be an LED display, a liquid crystal display, a touch-sensitive liquid crystal display, an OLED (Organic Light-Emitting Diode) touch, or the like. The display may also be referred to as a display screen or display unit, as appropriate, for displaying information processed in the electronic device 1 and for displaying a visual user interface.
It should be understood that the embodiments described are for illustrative purposes only and are not limited to this configuration in the scope of the patent application.
The multimedia data generating program 10 stored in the memory 11 of the electronic device 1 is a combination of instructions that, when executed in the processor 12, may implement:
receiving a control instruction, generating corresponding control event information according to the control instruction, and storing the control event information into a control event information set;
acquiring first control event information and second control event information in the control event information set according to a preset matching rule;
Generating the multimedia data according to the first control event information and the second control event information;
and displaying the multimedia video to a user in a preset display mode.
In another embodiment, the program further performs the steps comprising:
screening a plurality of multimedia data interception instructions according to a preset interception instruction screening rule, and reserving one multimedia data interception instruction from the plurality of multimedia data interception instructions with similarity larger than or equal to a preset threshold value.
In another embodiment, the program further performs the steps comprising:
screening out a multimedia data interception instruction with the interval time length between the first control event information and the second control event information being longer than or equal to a first preset time length;
and delaying the time point corresponding to the first control event information by the time point obtained by the first preset duration to obtain the time point of the second control event information.
In another embodiment, the program further performs the steps comprising:
and judging whether the multimedia data accords with the auditing rule.
In another embodiment, the program further performs the steps comprising:
and when the control instruction corresponding to the control instruction information is a preset cancel instruction, finding the last piece of control event information of the control instruction information from the control event information set, and deleting the last piece of control event information if the control instruction corresponding to the last piece of control event information is a preset start instruction.
Specifically, the specific implementation method of the above instructions by the processor 11 may refer to the description of the relevant steps in the corresponding embodiment of fig. 2, which is not repeated herein.
Further, the modules/units integrated in the electronic device 1 may be stored in a computer readable storage medium if implemented in the form of software functional units and sold or used as separate products. The computer readable medium may include: any entity or system capable of carrying the computer program code, a recording medium, a U disk, a removable hard disk, a magnetic disk, an optical disk, a computer Memory, a Read-Only Memory (ROM).
In the several embodiments provided by the present invention, it should be understood that the disclosed apparatus, system and method may be implemented in other manners. For example, the system embodiments described above are merely illustrative, e.g., the division of the modules is merely a logical function division, and other manners of division may be implemented in practice.
The modules described as separate components may or may not be physically separate, and components shown as modules may or may not be physical units, may be located in one place, or may be distributed over multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
In addition, each functional module in the embodiments of the present invention may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units can be realized in a form of hardware or a form of hardware and a form of software functional modules.
It will be evident to those skilled in the art that the invention is not limited to the details of the foregoing illustrative embodiments, and that the present invention may be embodied in other specific forms without departing from the spirit or essential characteristics thereof.
The present embodiments are, therefore, to be considered in all respects as illustrative and not restrictive, the scope of the invention being indicated by the appended claims rather than by the foregoing description, and all changes which come within the meaning and range of equivalency of the claims are therefore intended to be embraced therein. Any reference signs in the claims shall not be construed as limiting the claim concerned.
Furthermore, it is evident that the word "comprising" does not exclude other elements or steps, and that the singular does not exclude a plurality. Multiple units or systems as set forth in the system claims may also be implemented by means of one unit or system in software or hardware. The terms second, etc. are used to denote a name, but not any particular order.
Finally, it should be noted that the above-mentioned embodiments are merely for illustrating the technical solution of the present invention and not for limiting the same, and although the present invention has been described in detail with reference to the preferred embodiments, it should be understood by those skilled in the art that modifications and equivalents may be made to the technical solution of the present invention without departing from the spirit and scope of the technical solution of the present invention.

Claims (14)

1. A method for generating multimedia data, comprising:
receiving a control instruction, generating corresponding control event information according to the control instruction, and storing the control event information into a control event information set;
acquiring first control event information and second control event information in the control event information set according to a preset matching rule;
generating the multimedia data according to the first control event information and the second control event information, wherein the multimedia data is a video generated in a live broadcast process;
displaying the multimedia data to a user in a preset display mode;
the step of obtaining the first control event information and the second control event information in the control event information set according to a preset matching rule includes:
acquiring first control event information from the control event information set, acquiring a second control event message when a control instruction corresponding to the first control event information is a preset starting instruction, and generating a multimedia data interception instruction according to the first control event information and the second control event information when the control instruction corresponding to the second control event information is a preset ending instruction;
The step of generating the multimedia data according to the first control event information and the second control event information includes:
screening a plurality of multimedia data interception instructions according to a preset interception instruction screening rule, and reserving one multimedia data interception instruction from the plurality of multimedia data interception instructions with similarity larger than or equal to a preset threshold value;
and intercepting and generating the corresponding multimedia data according to the reserved multimedia data intercepting instruction.
2. The method of generating multimedia data according to claim 1, wherein the step of generating corresponding control event information according to the control instruction includes:
generating control instruction information comprising identification information for identifying the control instruction according to the control instruction;
and when the control instruction information meets the instruction verification rule, generating corresponding control event information.
3. The method of generating multimedia data according to claim 2, wherein after the step of "when the control instruction information satisfies an instruction verification rule", the method further comprises:
and when the control instruction corresponding to the control instruction information is a preset cancel instruction, finding the last piece of control event information of the control instruction information from the control event information set, and deleting the last piece of control event information if the control instruction corresponding to the last piece of control event information is a preset start instruction.
4. The method of generating multimedia data according to claim 1, wherein the step of acquiring the first control event information and the second control event information in the control event information set according to a preset matching rule comprises:
and acquiring first control event information from the control event information set, and deleting the first control event information when a control instruction corresponding to the first control event information is a preset ending instruction.
5. The method of generating multimedia data according to claim 1, wherein the step of acquiring the first control event information and the second control event information in the control event information set according to a preset matching rule comprises:
and acquiring first control event information from the control event information set, acquiring a second control event message when a control instruction corresponding to the first control event information is the preset start instruction, and deleting the first control event information when the control instruction corresponding to the second control event information is the preset start instruction.
6. A multimedia data interception method for intercepting multimedia data displayed on a user interaction interface, comprising:
Receiving a control instruction, and generating control instruction information comprising identification information for identifying the control instruction according to the control instruction;
when the control instruction information meets an instruction verification rule, generating corresponding control event information, and storing the control event information into a control event information set;
acquiring first control event information and second control event information in the control event information set according to a preset matching rule;
generating intercepted multimedia data according to the first control event information and the second control event information, wherein the multimedia data is a video generated in a live broadcast process;
the step of obtaining the first control event information and the second control event information in the control event information set according to a preset matching rule includes:
acquiring first control event information from the control event information set, acquiring a second control event message when a control instruction corresponding to the first control event information is a preset starting instruction, and generating a multimedia data interception instruction according to the first control event information and the second control event information when the control instruction corresponding to the second control event information is a preset ending instruction;
The step of generating the multimedia data according to the first control event information and the second control event information includes:
screening a plurality of multimedia data interception instructions according to a preset interception instruction screening rule, and reserving one multimedia data interception instruction from the plurality of multimedia data interception instructions with similarity larger than or equal to a preset threshold value;
and intercepting and generating the corresponding multimedia data according to the reserved multimedia data intercepting instruction.
7. The method of claim 6, wherein the step of generating intercepted multimedia data based on the first control event information and the second control event information comprises:
generating a multimedia data interception instruction according to the first control event information and the second control event information;
and intercepting and generating corresponding multimedia data according to the multimedia data intercepting instruction.
8. The method of claim 7, wherein after the step of "when the control instruction information satisfies an instruction verification rule", the method further comprises:
and when the control instruction corresponding to the control instruction information is a preset cancel instruction, finding the last piece of control event information of the control instruction information from the control event information set, and deleting the last piece of control event information if the control instruction corresponding to the last piece of control event information is a preset start instruction.
9. The method of claim 6, wherein the step of acquiring the first control event information and the second control event information in the control event information set according to a preset matching rule comprises:
and acquiring first control event information from the control event information set, and deleting the first control event information when a control instruction corresponding to the first control event information is a preset ending instruction.
10. The method of claim 6, wherein the step of acquiring the first control event information and the second control event information in the control event information set according to a preset matching rule comprises:
and acquiring first control event information from the control event information set, acquiring a second control event message when a control instruction corresponding to the first control event information is the preset start instruction, and deleting the first control event information when the control instruction corresponding to the second control event information is the preset start instruction.
11. A multimedia data generating apparatus, comprising:
the receiving module is used for receiving a control instruction, generating corresponding control event information according to the control instruction, and storing the control event information into a control event information set, wherein the generating the corresponding control event information according to the control instruction comprises: generating control instruction information comprising identification information for identifying the control instruction according to the control instruction; when the control instruction information meets the instruction verification rule, corresponding control event information is generated;
The acquisition module is used for acquiring first control event information and second control event information in the control event information set according to a preset matching rule; when the control instruction corresponding to the first control event information is a preset start instruction and the control instruction corresponding to the second control event information is a preset end instruction, the acquisition module generates a multimedia data interception instruction according to the first control event information and the second control event information;
the generation module is used for generating the multimedia data according to the first control event information and the second control event information; the generation module comprises a first screening module, wherein the first screening module is used for screening a plurality of multimedia data interception instructions according to a preset interception instruction screening rule, and one multimedia data interception instruction is reserved from the plurality of multimedia data interception instructions with similarity greater than or equal to a preset threshold value; the generation module intercepts and generates the corresponding multimedia data according to the reserved multimedia data interception instruction;
and the display module is used for displaying the multimedia data to a user in a preset display mode.
12. An electronic device comprising a memory and a processor, wherein the memory has stored thereon a multimedia data generating program which, when executed by the processor, implements the steps of the multimedia data generating method according to any of claims 1-5.
13. A computer-readable storage medium, having stored thereon a multimedia data generation program executable by one or more processors to implement the steps of the multimedia data generation method of any of claims 1-5.
14. A computer readable storage medium having stored thereon a multimedia data interception program executable by one or more processors to implement the steps of the multimedia data interception method of any one of claims 6-10.
CN202010751053.2A 2020-07-30 2020-07-30 Multimedia data generation method, intercepting method, device, equipment and storage medium Active CN112135187B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010751053.2A CN112135187B (en) 2020-07-30 2020-07-30 Multimedia data generation method, intercepting method, device, equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010751053.2A CN112135187B (en) 2020-07-30 2020-07-30 Multimedia data generation method, intercepting method, device, equipment and storage medium

Publications (2)

Publication Number Publication Date
CN112135187A CN112135187A (en) 2020-12-25
CN112135187B true CN112135187B (en) 2023-07-28

Family

ID=73851352

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010751053.2A Active CN112135187B (en) 2020-07-30 2020-07-30 Multimedia data generation method, intercepting method, device, equipment and storage medium

Country Status (1)

Country Link
CN (1) CN112135187B (en)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101123716A (en) * 2006-08-11 2008-02-13 三星电子株式会社 Multimedia playback control apparatus and method
CN110830847A (en) * 2019-10-24 2020-02-21 杭州威佩网络科技有限公司 Method and device for intercepting game video clip and electronic equipment

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7188088B2 (en) * 1999-12-07 2007-03-06 Matsushita Electric Industrial Co., Ltd. Video editing apparatus, video editing method, and recording medium
US20090317051A1 (en) * 2008-06-18 2009-12-24 Millington Daniel K Mobile Timestamp Systems and Methods of Use
EP2775731A1 (en) * 2013-03-05 2014-09-10 British Telecommunications public limited company Provision of video data
GB2520041A (en) * 2013-11-07 2015-05-13 Ibm Automated multimedia content editing
CN103647991A (en) * 2013-12-23 2014-03-19 乐视致新电子科技（天津）有限公司 Method and system for sharing video in intelligent television
US9711181B2 (en) * 2014-07-25 2017-07-18 Shindig. Inc. Systems and methods for creating, editing and publishing recorded videos
WO2016095071A1 (en) * 2014-12-14 2016-06-23 深圳市大疆创新科技有限公司 Video processing method, video processing device and playing device
US20170171630A1 (en) * 2015-12-14 2017-06-15 International Business Machines Corporation Sharing Portions of a Video
CN106550264A (en) * 2016-12-08 2017-03-29 腾讯科技（深圳）有限公司 A kind of intercept method and device of television video
CN107276981B (en) * 2017-05-05 2019-11-26 中广热点云科技有限公司 A kind of local video sharing method
CN109710779A (en) * 2018-12-24 2019-05-03 北京金山安全软件有限公司 Multimedia file intercepting method, device, equipment and storage medium
CN110650375A (en) * 2019-10-18 2020-01-03 腾讯科技（深圳）有限公司 Video processing method, device, equipment and storage medium

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101123716A (en) * 2006-08-11 2008-02-13 三星电子株式会社 Multimedia playback control apparatus and method
CN110830847A (en) * 2019-10-24 2020-02-21 杭州威佩网络科技有限公司 Method and device for intercepting game video clip and electronic equipment

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
Content based sports video sequences analysis and synthesis;Ye-peng Guan et al.;《2011 International Conference on Computer Science and Service System (CSSS)》;1-3 *
基于内容的视频镜头边界检测及关键帧提取;赵晖;《中国学位论文全文数据库》;全文 *
基于多特征分层的视频摘要提取算法;周巨等;《五邑大学学报(自然科学版)》;第34卷(第2期);34-45 *

Also Published As

Publication number Publication date
CN112135187A (en) 2020-12-25

Similar Documents

Publication Publication Date Title
US9621950B2 (en) TV program identification method, apparatus, terminal, server and system
US8955153B2 (en) Privacy control in a social network
WO2021143497A1 (en) Infringement evidence storage method, apparatus, and device based on evidence storage blockchain
JP6293269B2 (en) Content viewing confirmation apparatus and method
CN111723727A (en) Cloud monitoring method and device based on edge computing, electronic equipment and storage medium
US20170118205A1 (en) User biological feature authentication method and system
CN111601115B (en) Video detection method, related device, equipment and storage medium
CN108182211B (en) Video public opinion acquisition method and device, computer equipment and storage medium
EP3176719B1 (en) Methods and devices for acquiring certification document
CN112104626A (en) Block chain-based data access verification method and device, electronic equipment and medium
US9607088B2 (en) Method and apparatus for detecting multimedia content change, and resource propagation system
WO2015062224A1 (en) Tv program identification method, apparatus, terminal, server and system
CN110740088B (en) Method, device, terminal and medium for recommending and adding social resources
US8856944B2 (en) Obscuring sensitive portions of universal resource locator
CN105830079A (en) Authentication information management system, authentication information management device, program, recording medium, and authentication information management method
CN114268461A (en) User identity authentication method, device, server, terminal and storage medium
US20230386255A1 (en) Method and system for verifying image identification
CN112135187B (en) Multimedia data generation method, intercepting method, device, equipment and storage medium
WO2018021764A1 (en) Method for managing notification relating to application and electronic device therefor
WO2021017277A1 (en) Image capture method and apparatus, and computer storage medium
CN110232267A (en) Business card display methods, device, electronic equipment and storage medium
CN114265759A (en) Tracing method and system after data information leakage and electronic equipment
CN111031354B (en) Multimedia playing method, device and storage medium
CN113368494A (en) Cloud equipment distribution method and device, electronic equipment and storage medium
US20200169615A1 (en) Controlling content delivery

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right
TA01 Transfer of patent application right

Effective date of registration: 20210126

Address after: 511400 3108, 79 Wanbo 2nd Road, Nancun Town, Panyu District, Guangzhou City, Guangdong Province

Applicant after: GUANGZHOU CUBESILI INFORMATION TECHNOLOGY Co.,Ltd.

Address before: 511400 24 / F, building B-1, Wanda Plaza North, Wanbo business district, 79 Wanbo 2nd Road, Nancun Town, Panyu District, Guangzhou City, Guangdong Province (office use only)

Applicant before: GUANGZHOU HUADUO NETWORK TECHNOLOGY Co.,Ltd.

EE01 Entry into force of recordation of patent licensing contract
EE01 Entry into force of recordation of patent licensing contract

Application publication date: 20201225

Assignee: GUANGZHOU HUADUO NETWORK TECHNOLOGY Co.,Ltd.

Assignor: GUANGZHOU CUBESILI INFORMATION TECHNOLOGY Co.,Ltd.

Contract record no.: X2021440000054

Denomination of invention: Multimedia data generation method, interception method, device, device and storage medium

License type: Common License

Record date: 20210208

GR01 Patent grant
GR01 Patent grant