CN112087657B - Data processing method and device - Google Patents

Data processing method and device Download PDF

Info

Publication number
CN112087657B
CN112087657B CN202010995206.8A CN202010995206A CN112087657B CN 112087657 B CN112087657 B CN 112087657B CN 202010995206 A CN202010995206 A CN 202010995206A CN 112087657 B CN112087657 B CN 112087657B
Authority
CN
China
Prior art keywords
content
video
note
playing
video content
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202010995206.8A
Other languages
Chinese (zh)
Other versions
CN112087657A (en
Inventor
黄海兵
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tencent Technology Shenzhen Co Ltd
Original Assignee
Tencent Technology Shenzhen Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tencent Technology Shenzhen Co Ltd filed Critical Tencent Technology Shenzhen Co Ltd
Priority to CN202010995206.8A priority Critical patent/CN112087657B/en
Publication of CN112087657A publication Critical patent/CN112087657A/en
Application granted granted Critical
Publication of CN112087657B publication Critical patent/CN112087657B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
    • H04N21/4334—Recording operations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/462—Content or additional data management, e.g. creating a master electronic program guide from data received from the Internet and a Head-end, controlling the complexity of a video stream by scaling the resolution or bit-rate based on the client capabilities
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application

Abstract

The application provides a data processing method and device, responding to a video playing instruction, and displaying a video playing area and a note function area of a playing interface in a display area; playing video contents pointed by the video playing instruction in the video playing area; in the video content playing process, acquiring note content corresponding to the video content by utilizing a note function area, and displaying the note content in the note function area; according to the note content, the note corresponding to the video content is obtained, so that the note corresponding to the video content can be obtained by utilizing a note function area in a playing interface in the video playing process, the links of recording by other electronic equipment and operating the recorded content by a user are omitted on the premise of changing the playing interface, the note generating process is simplified, the note corresponding to the video content can be obtained in the video content playing process, the note is generated in the video content playing process, and the note generating efficiency is improved.

Description

Data processing method and device
Technical Field
The application belongs to the technical field of data processing, and particularly relates to a data processing method and device.
Background
With the development of networks, videos can be played online, such as online education and live education with the development of networks, and education videos are played through online education software or live education software to enable users to learn online, such as by installing online education software or live education software through electronic devices, and running online education software or live education software on the electronic devices.
In the process of online playing the education video through the network, if the online playing education video is recorded, the online playing education video needs to be recorded on paper by other electronic equipment or a user. For example, in the process of online playing the educational video through a computer, the educational video can be recorded by means of a mobile phone, after the educational video is played, the content recorded on the mobile phone is synchronized into the computer by a user, then the user establishes association between the synchronized content and the educational video on the computer, and notes corresponding to the educational video are formed, so that the note generation process is complicated, and the note generation efficiency is reduced.
Disclosure of Invention
In view of the foregoing, an object of the present application is to provide a data processing method and apparatus, which can obtain a note corresponding to video content by setting a note function area in a playing interface, simplify a note generation process, and improve note generation efficiency.
In one aspect, the present application provides a data processing method, the method including:
responding to the video playing instruction, and displaying a video playing area and a note function area of a playing interface in the display area;
playing the video content pointed by the video playing instruction in the video playing area;
in the video content playing process, acquiring note content corresponding to the video content by utilizing the note function area, and displaying the note content in the note function area;
and obtaining notes corresponding to the video content according to the note content.
Optionally, the obtaining, by using the note function area, the note content corresponding to the video content during the playing process of the video content includes:
receiving a screenshot starting instruction in the video content playing process, wherein the screenshot starting instruction is generated based on a screenshot control in the note function area;
responding to the screenshot starting instruction, performing screenshot processing on the video content until responding to a screenshot ending instruction, so as to obtain image content played by the video content within the time from responding to the screenshot starting instruction to responding to the screenshot ending instruction;
And obtaining the note content based on the image content.
Optionally, the obtaining the note content based on the image content includes:
compressing the image content, and determining the compressed image content as the note content;
or alternatively, the first and second heat exchangers may be,
and acquiring remark content of a user aiming at the image content, and determining the remark content and the image content corresponding to the remark content as the note content.
Optionally, the obtaining, by using the note function area, the note content corresponding to the video content during the playing process of the video content includes:
receiving a recording starting instruction in the video content playing process, wherein the recording starting instruction is generated based on a recording control in the note function area;
responding to the recording start instruction, starting an audio acquisition component, and recording through the audio acquisition component until responding to a recording end instruction so as to obtain audio content corresponding to the video content in the time from responding to the recording start instruction to responding to the recording end instruction;
and obtaining the note content based on the audio content.
Optionally, the method further comprises: and closing the audio acquisition component under the condition of responding to the recording termination instruction.
Optionally, the obtaining the note content based on the audio content includes:
compressing the audio content, and determining the compressed audio content as the note content;
or alternatively, the first and second heat exchangers may be,
and converting the audio content into text content, and determining the text content as the note content.
Optionally, the method further comprises:
associating the note with the video content to display the note in the note function area during playback of the video content in the video playback area while a next responsive video playback instruction is still directed to the video content;
or alternatively, the first and second heat exchangers may be,
further comprises:
the remark content corresponding to the video content is obtained, and the remark content corresponding to the video content indicates knowledge points of the video content and playing time of the knowledge points in the video content;
determining remark content corresponding to the video content as a label of the video content;
and if a response instruction aiming at the tag is received, playing at least one of the video contents corresponding to the knowledge point and the knowledge point corresponding to the playing time in the video playing area.
In another aspect, the present application provides a data processing apparatus, the apparatus comprising:
The display unit is used for responding to the video playing instruction and displaying a video playing area and a note function area of the playing interface in the display area;
the playing unit is used for playing the video content pointed by the video playing instruction in the video playing area;
the acquisition unit is used for acquiring the note content corresponding to the video content by utilizing the note function area in the video content playing process, and triggering the display unit to display the note content in the note function area;
and the obtaining unit is used for obtaining notes corresponding to the video content according to the note content.
In yet another aspect, the present application provides an electronic device, including: a display screen and a processor;
the processor is used for responding to the video playing instruction, and displaying a video playing area and a note function area of a playing interface in a display area of the display screen; the video content pointed by the video playing instruction is played in the video playing area, and in the video content playing process, the note function area is utilized to obtain note content corresponding to the video content, and the note content is displayed in the note function area; and obtaining notes corresponding to the video content according to the note content.
In yet another aspect, the present application provides a storage medium having stored therein computer program code which, when executed, implements the above-described data processing method.
According to the data processing method and device, the video playing area and the note function area of the playing interface are displayed in the display area in response to the video playing instruction; playing video contents pointed by the video playing instruction in the video playing area; in the video content playing process, acquiring note content corresponding to the video content by utilizing a note function area, and displaying the note content in the note function area; according to the note content, the note corresponding to the video content is obtained, so that the note corresponding to the video content can be obtained by utilizing the note function area in the playing interface in the video playing process, the video content can be recorded by utilizing the note function area, the links of recording by other electronic equipment and operating the recorded content by a user on the premise of changing the playing interface are omitted, the note generating process is simplified, the note corresponding to the video content can be obtained in the video content playing process, the note can be generated in the video content playing process, and the note generating efficiency is improved.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings that are required in the embodiments or the description of the prior art will be briefly described, and it is obvious that the drawings in the following description are some embodiments of the present application, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a flow chart of a data processing method according to an embodiment of the present application;
fig. 2 is a schematic diagram of a playing interface according to an embodiment of the present application;
FIG. 3 is a schematic diagram of another playback interface according to an embodiment of the present disclosure;
fig. 4 is a schematic diagram of a playback interface of an educational video according to an embodiment of the present application;
FIG. 5 is a flowchart for obtaining note content according to an embodiment of the present application;
FIG. 6 is a flowchart of another method for obtaining note content according to an embodiment of the present application;
FIG. 7 is a flow chart of another data processing method provided in an embodiment of the present application;
FIG. 8 is a flow chart of yet another data processing method provided in an embodiment of the present application;
FIG. 9 is a schematic diagram of a data processing apparatus according to an embodiment of the present application;
FIG. 10 is a schematic diagram of another data processing apparatus according to an embodiment of the present application;
FIG. 11 is a schematic diagram of a structure of a further data processing apparatus according to an embodiment of the present application;
fig. 12 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
Detailed Description
For the purposes of making the objects, technical solutions and advantages of the embodiments of the present application more clear, the technical solutions of the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is apparent that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments, which can be made by one of ordinary skill in the art without undue burden from the present disclosure, are within the scope of the present disclosure.
Referring to fig. 1, a flowchart of a data processing method provided in an embodiment of the present application may include the following steps:
101: and responding to the video playing instruction, and displaying a video playing area and a note function area of the playing interface in the display area.
The video playing areas are arranged in the current playing interfaces, most of the playing interfaces comprise a video playing area, a video introduction area, a comment area and a video recommendation area besides the video playing area, the video playing area is used for playing video content, the video introduction area is used for introducing the video content played in the video playing area, the comment area is used as an interaction area for users watching the video content, the users can evaluate the wonderful degree of the video content and the like and interact with the users, and the video recommendation area is used for recommending some video content related to the video content.
Although the evaluation area in the playing interface can provide the user with the evaluation to the video content, the playing interface does not provide the user with a functional area capable of taking notes in the playing process of the video content, and in this regard, the present embodiment changes the existing playing interface, and a note functional area is set in the playing interface, as shown in fig. 2, which shows a comparison schematic diagram of the existing playing interface and the playing interface of the present embodiment, and on the basis of the existing playing interface, a note functional area is added, and the note functional area has the function of enabling the user to obtain notes corresponding to the video content by using the note functional area, that is, the note functional area is the area where the user takes notes in the playing process of the video content, so as to obtain notes corresponding to the video content, and enable the user to take notes while watching the video content.
In this embodiment, one way to improve the playback interface is: on the premise of reserving the original area of the playing interface, adding a note function area in the playing interface; another way is: if the playing interface comprises other functional areas besides the video playing area, only the video playing area in the playing interface is reserved, and a note function area is added.
The relationship between the video playing area and the note function area in the playing interface may be, but is not limited to: the note-taking function area is located at one side of the video playing area and the size of the note-taking function area is smaller than that of the video playing area, so that a user can take notes while watching video contents.
As shown in fig. 3, the note function area is located on the right side of the video playing area, accords with the habit of taking notes of the user, and can conveniently watch video content while taking notes on the right side. The height of the note function area is the same as that of the video playing area, but the width of the note function area is smaller than that of the video playing area, for example, the ratio between the width of the note function area and the width of the video playing area is a preset ratio, so that the width of the note function area and the width of the video playing area can be determined according to the preset ratio in the displaying process of any display area, and the size relationship between the video playing area and the note function area can enable the video content to occupy a larger area by setting the size relationship of the video playing area and the note function area in the above manner, so that the complete and clear display of the video content is ensured.
The video playing instruction may be generated when the video identifier is triggered, so as to instruct to play the video content pointed by the video identifier. For example, for online education or live education, online education software or live education software may be installed in the electronic device, after the online education software or live education software is run, each education video may be displayed in a display area, when a user clicks any education video, a video playing instruction indicating to play the education video is generated, in response to the video playing instruction, a playing interface as shown in fig. 4 is displayed in the display area, the playing interface includes a video playing area and a note function area, the video playing area plays video content, the note function area is empty, and notes corresponding to the video content are obtained by using the note function area.
102: and playing the video content pointed by the video playing instruction in the video playing area. Because the video playing instruction is generated when a video is played according to the triggering video made by the video, the video identification, such as the video name, of the video can be obtained when the video is triggered, the video can be uniquely pointed to a video content through the video identification, and then the video content is played in the video playing area.
103: in the video content playing process, the note function area is utilized to acquire the note content corresponding to the video content, and the note content is displayed in the note function area, so that a user can check the note content, and the error probability of the note content is reduced.
In this embodiment, the note function area is used as a function area for a user to take notes, and the note function area may have at least one function of an input function, a screenshot function and a recording function, so that the user can obtain note content corresponding to video content by using at least one function of the input function, the screenshot function and the recording function.
The manner of acquiring note content using the above-described functions in the note function area includes, but is not limited to, the following:
in one mode, user information is acquired through an acquisition device, and if the user information is matched with preset user information, at least one of a screenshot function and a recording function in a note function area is utilized to operate currently played video content, so that note content is obtained.
The preset user information is user information indicating to trigger at least one of screenshot and recording of the video content currently played, and may include, but is not limited to: at least one of user gesture information, user expression information, user voice information, and user operation information for currently played video content. For example, the user gesture information is used to indicate the user gesture of currently watching the video content, for example, the user gesture information is used to indicate the user to make a specific gesture (such as an ok gesture), if the user information collected by the collecting device indicates that the user makes a specific gesture corresponding to the preset user information, the screenshot operation is performed on the video content by using the screenshot function in the note function area so as to at least obtain an image in the video content, the recording operation is performed on the video content by using the recording function in the note function area so as to at least obtain a voice in the video content, and of course, the screenshot operation may be performed on the video content by using the screenshot function in the note function area and the recording operation may be performed on the video content by using the recording function in the note function area.
In the process of operating the video content by using at least one of the screenshot function and the recording function, the duration of operating the video content can be set, for example, the duration of operating the video content is set to be the total duration of the video content, the preset percentage is a preset duration of operating the video content, for example, 10%, so that the duration of operating the video content is different for video content with different total durations, and of course, a fixed duration can be set, so that the operation with the same duration can be performed for each video content. Or preset user information for stopping the operation on the video content is set to terminate the operation on the video content, for example, the user gesture information for stopping the operation on the video content is different from gesture information for triggering the start of the operation on the video content, for example, the stop gesture is made by the user gesture information representation but not limited to the stop gesture.
The user expression information is used for indicating the user to make a specific expression (such as a confused expression), if the user information acquired by the acquisition device indicates that the current expression of the user is the specific expression corresponding to the preset user information, at least one of a screenshot function and a recording function in the note function area is utilized to operate the currently played video content to obtain the note content, and the process is described in detail herein without reference to the description of the user gesture information.
The user voice information is used for indicating the user to give specific voice, such as specific keywords, if the user information collected by the collecting device indicates that the user gives the specific keywords currently, the currently played video content is operated by at least one of the screenshot function and the recording function in the note function area to obtain the note content, and the process is referred to the description of the user gesture information and is not described in detail herein.
The operation information of the user for the currently played video content includes, but is not limited to: at least one of playback and slow speed of the currently played video content is performed by the user, if the user information acquired through the acquisition device indicates that the user performs at least one of playback and slow speed of the currently played video content, the currently played video content is operated by utilizing at least one of a screenshot function and a recording function in the note function area to obtain the note content, and the process is described in detail herein without reference to the description of the user gesture information. But differ from the above-described user posture information and user expression information in a point: if the video content currently played is played back, the operation of playing back the video content by using the note function area may be that of playing back the corresponding video content, and because the possibility that the playing back the corresponding video content as a user needs to understand the content with emphasis is relatively high, the operation is performed on the part of the content to obtain notes of the part of the content, so that the user can understand the part of the content by means of the notes.
In another mode, knowledge points are collected in advance, the knowledge points are at least one of important knowledge points obtained by summarizing historical video contents and frequently-made error knowledge points obtained by summarizing historical test questions, and the knowledge points can be used for summarizing the historical video contents watched by the current user and the historical test questions of the current user, or can be used for summarizing the historical video contents watched by a plurality of users and the historical test questions of the current user. And if the currently played video content contains a knowledge point, operating the currently played video content by utilizing at least one of a screenshot function and a recording function in the note function area to obtain the note content. For example, at least one of capturing and recording the content of the video content that matches the knowledge point, and ending the operation on the video content if it is determined by monitoring the video content that the content that matches the knowledge point is terminated.
For the two modes, if at least one of the screenshot function and the recording function in the note function area is triggered to be utilized to operate the currently played video content, prompt information can be output in the display area to prompt the currently played video content to operate; if an instruction for prohibiting the operation of the video content is obtained, prohibiting the operation of the video content which is currently played by utilizing the note function area; and if an instruction for allowing the operation on the video content is acquired, the currently played video content is operated by utilizing the note function area.
For example, the prompt information may include: yes and no controls, if yes, acquiring an instruction for allowing operation on the video content; if the trigger is not, acquiring an instruction for prohibiting the operation on the video content.
The mode of combining the two modes with the prompt information can enable the note content to be the content expected by the user currently watching the video content, and the consistency of the note content and the user requirement is improved.
In this embodiment, corresponding to the input function, the screenshot function, and the recording function, the note function area is provided with an input control, a screenshot control, and a recording control, as shown in fig. 4 above. The input control is used for enabling a user to input content into the note function area, the input control can display a virtual keyboard in the note function area, the user can input the content by using the virtual keyboard, the input control can also have a voice input function, the user can input voice by using the input control, the manual text input process is omitted, and the content acquisition efficiency is improved; the screenshot control is used for screenshot the video content in the video content playing process to obtain image content in the video content, such as obtaining at least one image in the video content; the recording control is used for recording in the video content playing process, the recording can be used for recording the audio content in the video content and/or recording the user in the video content playing process to obtain summarized content of the video content by the user, so that at least one control of the input control, the screenshot control and the recording control can be used for obtaining the note content, the note content can be obtained while watching the video content, the experience of watching the video content by the user is improved,
104: and obtaining notes corresponding to the video content according to the note content. For example, the note content is stored in a file, the file is used as a note corresponding to the video content, wherein the storing of the note content can be performed when a completion control in a note function area is triggered, and when the completion control is triggered to indicate that a user completes a note taking operation on the video content, the note content can be stored in the file to obtain the note corresponding to the video content.
The notes corresponding to the video content can be stored locally and synchronized to the cloud for storage, or the notes stored locally are synchronized to the cloud for storage at a preset time after being stored locally, and the notes synchronized to the cloud are not stored locally any more, so that the local storage space can be saved. The preset time is the maximum effective duration of the locally stored notes, the locally stored notes are calculated from the locally stored notes, the locally stored notes are synchronized to the cloud storage after the preset time, and if the locally stored notes are synchronized to the cloud storage by means of user operation before the preset time, the notes synchronized to the cloud storage can be deleted locally. In addition, under the condition that video content is not watched, the user can acquire the notes from the cloud end so as to view the notes at any time.
In the data processing method, responding to the video playing instruction, displaying a video playing area and a note function area of a playing interface in a display area; playing video contents pointed by the video playing instruction in the video playing area; in the video content playing process, acquiring note content corresponding to the video content by utilizing a note function area, and displaying the note content in the note function area; according to the note content, the note corresponding to the video content is obtained, so that the note corresponding to the video content can be obtained by utilizing the note function area in the playing interface in the video playing process, the video content can be recorded by utilizing the note function area, the links of recording by other electronic equipment and operating the recorded content by a user on the premise of changing the playing interface are omitted, the note generating process is simplified, the note corresponding to the video content can be obtained in the video content playing process, the note can be generated in the video content playing process, and the note generating efficiency is improved. The note generation efficiency can be improved by utilizing the note function area, so that a user can conveniently and quickly obtain notes corresponding to video content, the frequency of using a playing interface with the note function area by the user is increased, and the user viscosity is increased.
The following describes a manner of acquiring note content corresponding to video content using a note function area in the present embodiment, including but not limited to the following manner:
one way to obtain the note content is to obtain the note content by using a screenshot control in a note function area, where the process is as shown in fig. 5, and may include the following steps:
201: and in the video content playing process, receiving a screenshot starting instruction, wherein the screenshot starting instruction is generated based on a screenshot control in the note function area.
The screenshot control is used for screenshot the video content in the video content playing process to obtain image content in the video content, for example, at least one image in the video content is obtained, that is, the screenshot control can be used for obtaining one image or intercepting one section of the video content to obtain a video short-circuit, the video short-circuit can be represented in a dynamic image mode, and therefore one still image or dynamic image can be obtained through the screenshot control, and the still image or the dynamic image is regarded as the image content in the video content playing process. Because the static image is one image and the dynamic image is composed of a plurality of images, the acquisition of the static image and the dynamic image can be different, and further, in the process of acquiring the static image and the dynamic image, the screenshot starting instruction can be different, for example, a certain moment corresponding to the screenshot starting instruction for acquiring the static image is indicated, and a duration corresponding to the screenshot starting instruction for acquiring the dynamic image is indicated, wherein the corresponding duration can be a fixed duration or is based on the operation of the screenshot control.
If the screenshot starting instruction is generated based on the first operation on the screenshot control, the first operation executed on the screenshot control is different in the process of generating the screenshot starting instruction for indicating to acquire the static image and the screenshot starting instruction for indicating to acquire the dynamic image.
The first operation corresponding to the static image may be, but is not limited to, a clicking operation for the screenshot control, a down (pressing) event and an up (lifting) event are monitored during the clicking operation for the screenshot control, and then the generation of the screenshot starting instruction is described when the down event for the screenshot control is monitored; upon monitoring an up event for the screenshot control, the generation of a screenshot termination instruction is described.
The first operation corresponding to the dynamic image may be, but is not limited to, a long-press operation for the screenshot control, in which a keep event (down maintenance) of the down event is monitored in addition to the down event and up event during the long-press operation for the screenshot control, and when the down event for the screenshot control is monitored, the screenshot starting instruction is generated; when a keep event aiming at a screenshot control is monitored, a screenshot starting instruction is stated to be maintained so as to continuously screenshot video contents; upon monitoring an up event for the screenshot control, the generation of a screenshot termination instruction is described.
202: responding to the screenshot starting instruction, performing screenshot processing on the video content until responding to the screenshot ending instruction, so as to obtain the image content played by the video content in the time from responding to the screenshot starting instruction to responding to the screenshot ending instruction.
In this embodiment, when a screenshot start instruction is received to respond to the screenshot start instruction, an automatic screenshot function bound with a screenshot control is triggered, and the automatic screenshot function performs screenshot processing on video content currently played in a video playing area to obtain a frame image currently played. If the screenshot ending instruction is received, the automatic screenshot function ends execution, so that the image content played by the video content in the time from responding to the screenshot starting instruction to responding to the screenshot ending instruction is obtained through the automatic screenshot function. The automatic screenshot function can automatically position a video playing area in the executing process, and automatically performs screenshot processing on the video content currently played in the video playing area under the condition of no user participation.
If the first operation indicates that the time between the screenshot starting instruction and the screenshot ending instruction of one frame of image of the screenshot video content is shorter, the time taken by the automatic screenshot function to intercept one image is smaller than or equal to the time between the screenshot starting instruction and the screenshot ending instruction, so that the automatic screenshot function can intercept one frame of image; if the first operation indicates to capture multiple frames of images of the video content to obtain a dynamic image, the automatic capture function continuously captures the video content before receiving the capture termination instruction.
The automatic screenshot function can be implemented by a drawImage function in canvas (a drawing plug-in), the principle of which is: a canvas is created, and image rendering is obtained from the video content into the canvas.
203: the note content is obtained based on the image content. The manner in which the note content is obtained includes, but is not limited to, the following:
the first way, confirm the image content as the note content; the second way is to compress the image content, and determine the compressed image content as the note content, so that the data volume of the note content can be reduced, and the storage space required by the note content can be reduced, for example, the image content is compressed by a lossless compression algorithm; in a third mode, remark content of a user for the image content is acquired, and the remark content and the image content corresponding to the remark content are determined to be note content. That is, after the image content is obtained, the image content is edited (after the editing control in the note function area is triggered), for example, the key content in the image content is remarked, for example, the key content in the image content is highlighted (for example, the key content is highlighted in a circling manner) or the text annotation content is added to the image content, and the highlighted key content and the text annotation content can be used as remarked content, and the remarked content and the image content are used as note content. The editing of the image content can be performed on a canvas, the canvas can be displayed in a note function area, so that the video playing area can still normally play the video content in the process of editing the image content by the canvas, and the edited image content is obtained through a storage function after the editing in the canvas is completed.
In this embodiment, another way to obtain the note content is to obtain the note content by using a screenshot control in a note function area, where the process is as shown in fig. 6, and the method may include the following steps:
301: and in the video content playing process, a recording starting instruction is received, and the recording starting instruction is generated based on a recording control in the note function area.
The recording control is used for recording in the video content playing process, for example, recording can be carried out on video content, or recording can be carried out on a user, and therefore the audio content is acquired through triggering of the recording control.
Because the recording is to collect audio content within a period of time, the recording start instruction may set a duration of collecting audio content or trigger generation of the recording start instruction for a second operation of the recording control based on a second operation of the recording control, the second operation indicating collection of sound within a period of time. For example, the second operation may be, but is not limited to, a long press operation for the recording control, a down event, a keep time and an up event may be monitored for the long press operation for the recording control, and a record start instruction is generated when the down event for the recording control is monitored; when a keep event aiming at a recording control is monitored, a recording starting instruction is stated to be maintained so as to continuously record; and when an up event for the recording control is monitored, the generation of a recording termination instruction is described. Or the second operation may be, but is not limited to, a clicking operation for the recording control, and if an up event for the recording control is detected under the clicking operation, the embodiment may delay the response of the preset time to the recording termination instruction to collect the audio content in the preset time, and the duration of the preset time is not limited in this embodiment.
302: and responding to the recording start instruction, starting the audio acquisition component, and recording through the audio acquisition component until responding to the recording end instruction so as to obtain the audio content corresponding to the video content in the time from responding to the recording start instruction to responding to the recording end instruction.
When a recording starting instruction is received and responded, the recording starting instruction triggers an audio acquisition component in the electronic equipment to switch from a closed state to an operating state, so that the audio acquisition component is activated through the recording starting instruction, and therefore the audio acquisition component is in a starting state under the condition of recording, and resource consumption is reduced.
If the second operation is a long-press operation for the recording control, the recording duration can be controlled by the user through the long-press operation, so that the user can freely control the duration of the audio content; if the second operation is a click operation for the recording control, the corresponding recording duration is fixed, and thus the duration of the audio content is also fixed.
In addition, the audio collection assembly can be closed under the condition of responding to the recording termination instruction, the audio collection assembly is switched from the running state to the closing state, and the audio collection assembly is closed through the recording termination instruction, so that the running time of the audio collection assembly corresponds to the recording time, and the audio collection assembly can be automatically closed under the condition of not recording, and the resource consumption is reduced.
303: the note content is obtained based on the audio content. The manner in which the note content is obtained includes, but is not limited to, the following:
the first way, confirm the audio frequency content as the note content; the second way is to compress the audio content and determine the compressed audio content as the note content, so that the data volume of the note content can be reduced to reduce the storage space required by the note content; in a third way, the audio content is converted into text content, which is determined to be note content.
In the process of obtaining the note content by utilizing the recording control, a microphone in the electronic equipment can be started by using a navigator technology in HTML5 (Hyper Text Markup Language, a fifth edition of hypertext markup language), the microphone collects audio content according to a preset collection frequency, and the audio content can be compressed and converted into the audio content in WAV format or converted into text content by using some voice conversion text technology. The preset acquisition frequency indicates the sampling times of the sound signal in one second, and the higher the acquisition frequency is, the more true and natural the restoration is, thus indicating that the obtained audio content is more accurate.
In addition to obtaining the note content by using the screenshot control and the recording control, the embodiment may also be obtained by using the input control, where the obtaining the note content corresponding to the video content by using the note function area includes: and in the video content playing process, acquiring the content input by the user by utilizing the input control in the note function area, and determining the input content as the note content.
For example, the virtual keyboard is activated by using the input control, text is manually input by the user by using the virtual keyboard, or voice input is performed by using the input control, and the content input by the user can be obtained. In this embodiment, the note content may be obtained by using at least two of the screenshot control, the recording control and the input control, for example, the screenshot control may be used to obtain image content, the recording control may be used to obtain audio content, and then the note content may be obtained based on the image content and the audio content, for example, the image content and the audio content may be determined to be the note content, or the image content and the audio content may be compressed, and the compressed image content and the compressed audio content may be determined to be the note content.
Referring to fig. 7, a flowchart of another data processing method provided in an embodiment of the present application is shown, and the data processing method shown in fig. 1 may further include the following steps:
105: the note is associated with the video content such that the note is displayed in the note function area during playback of the video content in the video playback area while the next responsive video playback instruction is still directed to the video content.
The note and the video content are associated, so that the note and the video content are bound, when the video playing instruction is received again, if the video playing instruction is still directed to the video content, the note is displayed in the note function area while the video content is played in the video playing area, synchronous display of the video content and the note is realized, and convenience is brought to a user to check the previously made note.
Judging whether the video content pointed by the video playing instruction is associated with a note or not under the condition that the video playing instruction is received, and if the note is associated with the video content, displaying the note in the note function area while playing the video content in the video playing area; if no note is associated, video content is played in the video play area but the note function area display content is empty.
In order to judge whether the video content pointed by the video playing instruction is associated with notes, in the process of associating the notes with the video content, a corresponding relation table of the notes and video identifications of the video content can be established, so that after the video playing instruction is received, whether the notes corresponding to the video identifications carried in the video playing instruction are found from the corresponding relation table according to the video identifications carried in the video playing instruction, if so, the notes are associated with the video content, and if not, the notes are not associated with the video content; or after associating the note with the video content, adding a mark to the video content, for example, a special attribute can be added to the video content, wherein the special attribute indicates that the note is associated with the video content, so that after the video playing instruction is received again, whether the note is associated with the video content is indicated by checking whether the video content has the special attribute or not, and if the note is not indicated, the note is not associated with the video content.
If the video content is associated with notes, the notes associated with the video content can be acquired from the local and cloud sides to display the notes in a note function area. For example, firstly, whether the notes corresponding to the video content are stored locally or not is searched, if the notes corresponding to the video content are extracted from the data stored in the body, whether the notes corresponding to the video content are stored in the cloud is not searched.
According to the data processing method, after the notes are obtained, the notes are associated with the video content, so that when the video playing instruction is received again, if the video playing instruction is still directed to the video content, the notes are displayed in the note function area while the video content is played in the video playing area, synchronous display of the video content and the notes is realized, and convenience is brought to a user to check the notes made before.
Referring to fig. 8, a flowchart of another data processing method according to an embodiment of the present application is shown, and the method further includes the following steps based on the data processing method shown in fig. 1:
106: and acquiring remark content corresponding to the video content, wherein the remark content corresponding to the video content indicates knowledge points of the video content and playing time of the knowledge points in the video content. The remark content corresponding to the video content is a summary of the video content during the process of watching the video content by a user, for example, during the process of playing the educational video in the video playing area, students can summarize key content and/or error-prone content in the educational video, and play time (such as start time to end time) of the original content corresponding to the knowledge point in the video content can also be remarked.
One way to obtain the play time is that the play time may be manually input by the user; in another obtaining manner, if the remark content is a summary of the content obtained by capturing and recording, and the corresponding start time and end time can be obtained in the capturing and recording process, the playing time can be automatically obtained in the summary of the content obtained by capturing and recording, for example, the automatically obtained start time and end time are taken as the playing time.
107: and determining remark content corresponding to the video content as a label of the video content. I.e. to set a tag for the video content, the tag functions similarly to a bookmark function to quickly locate the content that the user wishes to view by means of the tag. For example, one remark content is marked with a knowledge point 1 in 10 minutes 10 seconds to 12 minutes, the other remark content is marked with a knowledge point 2 corresponding to 20 minutes to 25 minutes, and the remark content is used as a label of the video content, so that the label of the video content can be displayed while the video content is displayed, the knowledge point corresponding to the video content and the playing time corresponding to the knowledge point can be understood as soon as possible through the label of the video content, and jump playing of the video content can be controlled to accelerate playing of the video content, and the jump to the knowledge point can be directly carried out.
The tag of the video content may be displayed in at least one of the note function area and the video play area, if displayed in the video play area, the display of the video content in the video play area may be affected when the remark content as the tag of the video content is displayed in its entirety, for which purpose the tag of the video content may be displayed in the video play area in a hidden display manner, such as setting a floating entry corresponding to the tag of the video content in the video play area, in the case where an operation for the floating entry is acquired, displaying the tag of the video content (i.e., the remark content) in the video play area, if an operation for the floating entry is not acquired, hiding the tag of the video content, wherein the floating entry may be set in a menu area in the video play area or a progress bar of the video play area, preventing the display of the video content from being affected, and if the tag may be displayed at a progress bar corresponding to the play time (e.g., a start time) of the remark content as the tag of the video content in the video play area.
The operation for hovering the portal may be a click, gesture, etc., and the present embodiment is not limited. Of course, in the process of displaying the tag of the video content in the video playing area, the transparency of the tag of the video content can also be set, so that the tag can be seen in the process of displaying the tag on the video content, and the display of the video content can not be affected.
108: and if a response instruction aiming at the tag is received, playing at least one of the knowledge point corresponding to the playing time and the video content corresponding to the knowledge point in the video playing area, so as to realize the jump playing of the video content.
According to the data processing method, the remark content corresponding to the video content is determined to be the label of the video content, so that the knowledge point corresponding to the video content and the playing time corresponding to the knowledge point can be understood as soon as possible, the jump playing of the video content can be controlled, the playing of the video content is quickened, and at least one of the knowledge point and the video content corresponding to the knowledge point can be directly jumped to be played.
The data processing method in the above embodiment may be applied to an educational video, for example, in a process of playing an educational video or a live educational video by an electronic device, where a playing interface corresponding to the educational video may include a video playing area and a note function area, as shown in fig. 3, so that in the process of playing the educational video by the electronic device, the video playing area plays video content corresponding to the educational video, and the note function area is used to obtain note content corresponding to the video content, for example, at least one of an input control, a screenshot control and a recording control in the note function area shown in fig. 4 is used to obtain the note content, for example, the note content input by a user is obtained through the input control, an intercepted image or video is obtained through the screenshot control, an audio content is obtained through the recording control, and the like.
After the note content is acquired, the note content is displayed in the note function area, so that a user can view the note content in real time in the video content playing process, and the note content can be corrected. And then storing the note content in a file to obtain notes corresponding to the video content, and realizing the completion of note recording by using the note function area.
For the foregoing method embodiments, for simplicity of explanation, the same is shown as a series of acts, but it should be understood by those skilled in the art that the present application is not limited by the order of acts described, as some steps may be performed in other order, concurrently or in combination with each other or with each other, depending on the application. Further, those skilled in the art will also appreciate that the embodiments described in the specification are all preferred embodiments, and that the acts and modules referred to are not necessarily required in the present application.
Corresponding to the above method embodiment, the embodiment of the present application further provides a data processing device, where the structure of the data processing device is shown in fig. 9, and the data processing device may include: a display unit 10, a playback unit 20, an acquisition unit 30, and an acquisition unit 40.
And a display unit 10 for displaying a video playing area and a note function area of the playing interface in the display area in response to the video playing instruction. The function of the note function area is to enable a user to obtain a note corresponding to the video content by using the note function area, that is, the note function area is an area where the user takes notes in the playing process of the video content, so as to obtain the note corresponding to the video content, and enable the user to take notes while watching the video content.
And a playing unit 20 for playing the video content pointed by the video playing instruction in the video playing area. Because the video playing instruction is generated when a video is played according to the triggering video made by the video, the video identification, such as the video name, of the video can be obtained when the video is triggered, the video can be uniquely pointed to a video content through the video identification, and then the video content is played in the video playing area.
The acquiring unit 30 is configured to acquire, during the playing of the video content, the note content corresponding to the video content using the note function area, and trigger the display unit to display the note content in the note function area.
In this embodiment, the note function area is used as a function area for a user to take notes, and the note function area may have at least one function of an input function, a screenshot function and a recording function, so that the user can obtain note content corresponding to video content by using at least one function of the input function, the screenshot function and the recording function.
And corresponding to the input function, the screenshot function and the recording function, an input control, a screenshot control and a recording control are arranged in the note function area. The input control is used for enabling a user to input content into the note function area, the input control can display a virtual keyboard in the note function area, the user can input the content by using the virtual keyboard, the input control can also have a voice input function, the user can input voice by using the input control, the manual text input process is omitted, and the content acquisition efficiency is improved; the screenshot control is used for screenshot the video content in the video content playing process to obtain image content in the video content, such as obtaining at least one image in the video content; the recording control is used for recording in the video content playing process, the recording can be used for recording audio content in the video content and/or recording a user in the video content playing process, and summary content of the video content is obtained for the user, so that at least one control of the input control, the screenshot control and the recording control can be used for obtaining the note content, the note content can be obtained while the user views the video content, and experience of the user viewing the video content is improved. The following describes that the acquisition unit 30 acquires note content corresponding to video content using a note function area:
In one way, the obtaining unit 30 receives a screenshot starting instruction in the process of playing the video content, wherein the screenshot starting instruction is generated based on a screenshot control in the note function area; responding to the screenshot starting instruction, performing screenshot processing on the video content until responding to the screenshot ending instruction to obtain image content played by the video content in the time from responding to the screenshot starting instruction to responding to the screenshot ending instruction; the note content is obtained based on the image content.
Wherein obtaining note content based on the image content includes: compressing the image content, and determining the compressed image content as note content; or acquiring remark content of the user aiming at the image content, and determining the remark content and the image content corresponding to the remark content as note content.
Alternatively, the obtaining unit 30 receives a recording start instruction during the video content playing process, where the recording start instruction is generated based on a recording control in the note function area; responding to the recording start instruction, starting the audio acquisition component, recording through the audio acquisition component until responding to the recording end instruction, and obtaining audio content corresponding to the video content in the time from responding to the recording start instruction to responding to the recording end instruction; the note content is obtained based on the audio content.
Wherein deriving note content based on the audio content comprises: compressing the audio content, and determining the compressed audio content as note content; or converting the audio content into text content, and determining the text content as note content.
For other ways of obtaining the note content, please refer to the above embodiments, and are not described herein.
The obtaining unit 30 is further configured to close the audio collection assembly in response to a recording termination instruction, so that the operation duration of the audio collection assembly corresponds to the recording duration, and thus the audio collection assembly can be automatically closed without recording, and resource consumption is reduced.
In still another manner, the acquiring unit 30 acquires the content input by the user using the input control in the note function area and determines the input content as the note content during the video content playing.
For example, the virtual keyboard is activated by using the input control, text is manually input by the user by using the virtual keyboard, or voice input is performed by using the input control, and the content input by the user can be obtained. In this embodiment, the note content may be obtained by using at least two of the screenshot control, the recording control and the input control, for example, the screenshot control may be used to obtain image content, the recording control may be used to obtain audio content, and then the note content may be obtained based on the image content and the audio content, for example, the image content and the audio content may be determined to be the note content, or the image content and the audio content may be compressed, and the compressed image content and the compressed audio content may be determined to be the note content.
For the process of acquiring the note content by the acquiring unit 30, please refer to the method embodiment, which is not described in detail.
And an obtaining unit 40 for obtaining notes corresponding to the video content according to the note content. For example, the note content is stored in a file, the file is used as a note corresponding to the video content, wherein the storing of the note content can be performed when a completion control in a note function area is triggered, and when the completion control is triggered to indicate that a user completes a note taking operation on the video content, the note content can be stored in the file to obtain the note corresponding to the video content.
The notes corresponding to the video content can be stored locally and synchronized to the cloud for storage, or the notes stored locally are synchronized to the cloud for storage at a preset time after being stored locally, and the notes synchronized to the cloud are not stored locally any more, so that the local storage space can be saved. The preset time is the maximum effective duration of the locally stored notes, the locally stored notes are calculated from the locally stored notes, the locally stored notes are synchronized to the cloud storage after the preset time, and if the locally stored notes are synchronized to the cloud storage by means of user operation before the preset time, the notes synchronized to the cloud storage can be deleted locally. In addition, under the condition that video content is not watched, the user can acquire the notes from the cloud end so as to view the notes at any time.
The data processing device responds to the video playing instruction and displays a video playing area and a note function area of the playing interface in the display area; playing video contents pointed by the video playing instruction in the video playing area; in the video content playing process, acquiring note content corresponding to the video content by utilizing a note function area, and displaying the note content in the note function area; according to the note content, the note corresponding to the video content is obtained, so that the note corresponding to the video content can be obtained by utilizing the note function area in the playing interface in the video playing process, the video content can be recorded by utilizing the note function area, the links of recording by other electronic equipment and operating the recorded content by a user on the premise of changing the playing interface are omitted, the note generating process is simplified, the note corresponding to the video content can be obtained in the video content playing process, the note can be generated in the video content playing process, and the note generating efficiency is improved. The note generation efficiency can be improved by utilizing the note function area, so that a user can conveniently and quickly obtain notes corresponding to video content, the frequency of using a playing interface with the note function area by the user is increased, and the user viscosity is increased.
Referring to fig. 10, a structure of another data processing apparatus according to an embodiment of the present application is shown, and may further include, on the basis of the data processing apparatus shown in fig. 9: and an association unit 50 for associating the note with the video content to display the note in the note function area during the playing of the video content in the video playing area in case that the video playing instruction of the next response is directed to the video content.
The note and the video content are associated, so that the note and the video content are bound, when the video playing instruction is received again, if the video playing instruction is still directed to the video content, the note is displayed in the note function area while the video content is played in the video playing area, synchronous display of the video content and the note is realized, and convenience is brought to a user to check the previously made note.
Referring to fig. 11, a structure of a further data processing apparatus according to an embodiment of the present application is shown, and may further include, on the basis of the data processing apparatus shown in fig. 9: a determining unit 60. With respect to the data processing apparatus shown in fig. 11, the obtaining unit 30 is further configured to obtain remark content corresponding to video content, where the remark content corresponding to the video content indicates a knowledge point of the video content and a playing time of the knowledge point in the video content. The remark content corresponding to the video content is a summary of the video content during the process of watching the video content by a user, for example, during the process of playing the educational video in the video playing area, students can summarize key content and/or error-prone content in the educational video, and play time (such as start time to end time) of the original content corresponding to the knowledge point in the video content can also be remarked.
A determining unit 60, configured to determine remark content corresponding to the video content as a tag of the video content. I.e. to set a tag for the video content, the tag functions similarly to a bookmark function to quickly locate the content that the user wishes to view by means of the tag. For example, one remark content is marked with a knowledge point 1 in 10 minutes 10 seconds to 12 minutes, the other remark content is marked with a knowledge point 2 corresponding to 20 minutes to 25 minutes, and the remark content is used as a label of the video content, so that the label of the video content can be displayed while the video content is displayed, the knowledge point corresponding to the video content and the playing time corresponding to the knowledge point can be understood as soon as possible through the label of the video content, and jump playing of the video content can be controlled to accelerate playing of the video content, and the jump to the knowledge point can be directly carried out.
The playing unit 20 is further configured to play at least one of the knowledge point corresponding to the playing time and the video content corresponding to the knowledge point in the video playing area if the response instruction for the tag is received, so as to implement skip playing of the video content.
According to the data processing device, the remark content corresponding to the video content is determined to be the label of the video content, so that the knowledge point corresponding to the video content and the playing time corresponding to the knowledge point can be understood as soon as possible, the jump playing of the video content can be controlled, the playing of the video content is quickened, and at least one of the knowledge point and the video content corresponding to the knowledge point can be directly jumped to be played.
The embodiment of the application also provides an electronic device, the structure of which is shown in fig. 12, the electronic device comprising: a display screen 100 and a processor 200. The display 100 and the processor 200 may communicate via, but are not limited to, a bus.
A processor 200 for displaying a video playing area and a note function area of a playing interface in a display area of the display screen 100 in response to a video playing instruction; the method comprises the steps that video content pointed by a video playing instruction is played in a video playing area, in the process of playing the video content, note content corresponding to the video content is obtained by utilizing a note function area, and the note content is displayed in the note function area; and obtaining notes corresponding to the video content according to the note content. For the execution of the processor 200, please refer to the above method embodiment, and the description is omitted here.
The embodiment of the application also provides a storage medium, wherein the storage medium stores computer program codes, and the computer program codes realize the data processing method when being executed.
It should be noted that, each embodiment in the present specification may be described in a progressive manner, and features described in each embodiment in the present specification may be replaced or combined with each other, and each embodiment is mainly described as different from other embodiments, and identical and similar parts between the embodiments are referred to each other. For the apparatus class embodiments, the description is relatively simple as it is substantially similar to the method embodiments, and reference is made to the description of the method embodiments for relevant points.
Finally, it is further noted that relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the application. Thus, the present application is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
The foregoing is merely a preferred embodiment of the present application and it should be noted that modifications and adaptations to those skilled in the art may be made without departing from the principles of the present application and are intended to be comprehended within the scope of the present application.

Claims (13)

1. A method of data processing, the method comprising:
responding to a video playing instruction, and displaying a video playing area and a note function area of a playing interface in a display area, wherein the note function area comprises at least one control of a screenshot control and a recording control;
playing the video content pointed by the video playing instruction in the video playing area;
in the video content playing process, when the user information acquired by the acquisition device indicates that the current expression of the user is a specific expression corresponding to preset user information, acquiring the note content corresponding to the video content by utilizing at least one control in the note function area, and displaying the note content in the note function area, wherein the preset user information comprises at least one of user gesture information, user expression information, user voice information and operation information of the user for the currently played video content;
Obtaining notes corresponding to the video content according to the note content;
if the control is the screenshot control, and the user information acquired by the acquisition device indicates that the current expression of the user is a specific expression corresponding to preset user information in the video content playing process, the step of acquiring the note content corresponding to the video content by using at least one control in the note function area includes:
receiving a screenshot starting instruction in the video content playing process, wherein the screenshot starting instruction is generated based on a screenshot control in the note function area;
responding to the screenshot starting instruction, performing screenshot processing on the video content until the screenshot ending instruction is responded to obtain image content played by the video content within the time from responding to the screenshot starting instruction to responding to the screenshot ending instruction, wherein a canvas is created by triggering a drawImage function in a canvas bound with a screenshot control, and an image is acquired from the video content and drawn into the canvas;
obtaining the note content based on the image content, wherein the note content comprises: the method comprises the steps of obtaining remark content of a user aiming at image content, determining the remark content and the image content corresponding to the remark content as note content, remarking key content in the image content in the process of editing the image content by a canvas, highlighting the key content in the image content or adding text annotation content into the image content, taking the highlighted key content or the text annotation content as the remark content, normally playing video content in a video playing area in the process of editing the image content by the canvas, and obtaining the edited image content through a storage function after editing in the canvas.
2. The method of claim 1, wherein the deriving the note content based on the image content comprises:
compressing the image content, and determining the compressed image content as the note content;
or alternatively, the first and second heat exchangers may be,
and acquiring remark content of a user aiming at the image content, and determining the remark content and the image content corresponding to the remark content as the note content.
3. The method of claim 1, wherein during the playing of the video content, obtaining the note content corresponding to the video content using the at least one control in the note function area comprises:
receiving a recording starting instruction in the video content playing process, wherein the recording starting instruction is generated based on a recording control in the note function area;
responding to the recording start instruction, starting an audio acquisition component, and recording through the audio acquisition component until responding to a recording end instruction so as to obtain audio content corresponding to the video content in the time from responding to the recording start instruction to responding to the recording end instruction;
and obtaining the note content based on the audio content.
4. A method according to claim 3, further comprising: and closing the audio acquisition component under the condition of responding to the recording termination instruction.
5. The method of claim 3, wherein the deriving the note content based on the audio content comprises:
compressing the audio content, and determining the compressed audio content as the note content;
or alternatively, the first and second heat exchangers may be,
and converting the audio content into text content, and determining the text content as the note content.
6. The method according to any one of claims 1 to 5, further comprising:
associating the note with the video content to display the note in the note function area during playback of the video content in the video playback area while a next responsive video playback instruction is still directed to the video content;
or alternatively, the first and second heat exchangers may be,
further comprises:
the remark content corresponding to the video content is obtained, and the remark content corresponding to the video content indicates knowledge points of the video content and playing time of the knowledge points in the video content;
determining remark content corresponding to the video content as a label of the video content;
And if a response instruction aiming at the tag is received, playing at least one of the video contents corresponding to the knowledge point and the knowledge point corresponding to the playing time in the video playing area.
7. A data processing apparatus, the apparatus comprising:
the display unit is used for responding to the video playing instruction, and displaying a video playing area and a note function area of the playing interface in the display area, wherein the note function area comprises at least one control of a screenshot control and a recording control;
the playing unit is used for playing the video content pointed by the video playing instruction in the video playing area;
the acquisition unit is used for acquiring the note content corresponding to the video content by utilizing at least one control in the note function area and triggering the display unit to display the note content in the note function area when the user information acquired by the acquisition device indicates that the current expression of the user is a specific expression corresponding to preset user information in the video content playing process, wherein the preset user information comprises at least one of user gesture information, user expression information, user voice information and operation information of the user for the currently played video content;
The obtaining unit is used for obtaining notes corresponding to the video content according to the note content;
if the control is the screenshot control, the obtaining unit is specifically configured to:
receiving a screenshot starting instruction in the video content playing process, wherein the screenshot starting instruction is generated based on a screenshot control in the note function area;
responding to the screenshot starting instruction, performing screenshot processing on the video content until the screenshot ending instruction is responded to obtain image content played by the video content within the time from responding to the screenshot starting instruction to responding to the screenshot ending instruction, wherein a canvas is created by triggering a drawImage function in a canvas bound with a screenshot control, and an image is acquired from the video content and drawn into the canvas;
obtaining the note content based on the image content, wherein the note content comprises: the method comprises the steps of obtaining remark content of a user aiming at image content, determining the remark content and the image content corresponding to the remark content as note content, remarking key content in the image content in the process of editing the image content by a canvas, highlighting the key content in the image content or adding text annotation content into the image content, taking the highlighted key content or the text annotation content as the remark content, normally playing video content in a video playing area in the process of editing the image content by the canvas, and obtaining the edited image content through a storage function after editing in the canvas.
8. The apparatus of claim 7, wherein the acquisition unit is further configured to:
compressing the image content, and determining the compressed image content as the note content;
or alternatively, the first and second heat exchangers may be,
and acquiring remark content of a user aiming at the image content, and determining the remark content and the image content corresponding to the remark content as the note content.
9. The apparatus of claim 7, wherein the acquisition unit is specifically configured to:
receiving a recording starting instruction in the video content playing process, wherein the recording starting instruction is generated based on a recording control in the note function area;
responding to the recording start instruction, starting an audio acquisition component, and recording through the audio acquisition component until responding to a recording end instruction so as to obtain audio content corresponding to the video content in the time from responding to the recording start instruction to responding to the recording end instruction;
and obtaining the note content based on the audio content.
10. The apparatus of claim 9, wherein the acquisition unit is further configured to: and closing the audio acquisition component under the condition of responding to the recording termination instruction.
11. The apparatus according to any one of claims 7 to 10, characterized in that the apparatus further comprises:
the association unit is used for associating the note with the video content so as to display the note in the note function area in the process of playing the video content in the video playing area under the condition that a next responding video playing instruction still points to the video content;
or alternatively, the first and second heat exchangers may be,
the apparatus further comprises:
the obtaining unit is further configured to obtain remark content corresponding to the video content, where the remark content corresponding to the video content indicates a knowledge point of the video content and a playing time of the knowledge point in the video content;
a determining unit, configured to determine remark content corresponding to the video content as a tag of the video content;
and the playing unit is also used for playing at least one of the knowledge points corresponding to the playing time and the video contents corresponding to the knowledge points in the video playing area if a response instruction for the tag is received.
12. An electronic device, the electronic device comprising: a display screen and a processor;
The processor is used for responding to a video playing instruction, and displaying a video playing area and a note function area of a playing interface in a display area of the display screen, wherein the note function area comprises at least one control of a screenshot control and a recording control; the video content pointed by the video playing instruction is played in the video playing area, when the user information acquired through the acquisition device indicates that the current expression of the user is a specific expression corresponding to preset user information in the video content playing process, at least one control in the note function area is utilized to acquire the note content corresponding to the video content, the note content is displayed in the note function area, and the preset user information comprises at least one of user gesture information, user expression information, user voice information and operation information of the user aiming at the currently played video content; obtaining notes corresponding to the video content according to the note content;
if the control is the screenshot control, and the user information acquired by the acquisition device indicates that the current expression of the user is a specific expression corresponding to preset user information in the video content playing process, the step of acquiring the note content corresponding to the video content by using at least one control in the note function area includes: receiving a screenshot starting instruction in the video content playing process, wherein the screenshot starting instruction is generated based on a screenshot control in the note function area; responding to the screenshot starting instruction, performing screenshot processing on the video content until the screenshot ending instruction is responded to obtain image content played by the video content within the time from responding to the screenshot starting instruction to responding to the screenshot ending instruction, wherein a canvas is created by triggering a drawImage function in a canvas bound with a screenshot control, and an image is acquired from the video content and drawn into the canvas; obtaining the note content based on the image content, wherein the note content comprises: the method comprises the steps of obtaining remark content of a user aiming at image content, determining the remark content and the image content corresponding to the remark content as note content, remarking key content in the image content in the process of editing the image content by a canvas, highlighting the key content in the image content or adding text annotation content into the image content, taking the highlighted key content or the text annotation content as the remark content, normally playing video content in a video playing area in the process of editing the image content by the canvas, and obtaining the edited image content through a storage function after editing in the canvas.
13. A storage medium having stored therein computer program code which, when executed, implements the data processing method of any of claims 1 to 6.
CN202010995206.8A 2020-09-21 2020-09-21 Data processing method and device Active CN112087657B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010995206.8A CN112087657B (en) 2020-09-21 2020-09-21 Data processing method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010995206.8A CN112087657B (en) 2020-09-21 2020-09-21 Data processing method and device

Publications (2)

Publication Number Publication Date
CN112087657A CN112087657A (en) 2020-12-15
CN112087657B true CN112087657B (en) 2024-02-09

Family

ID=73740130

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010995206.8A Active CN112087657B (en) 2020-09-21 2020-09-21 Data processing method and device

Country Status (1)

Country Link
CN (1) CN112087657B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112764636A (en) * 2021-01-29 2021-05-07 北京达佳互联信息技术有限公司 Video processing method, video processing device, electronic equipment and computer-readable storage medium
CN116708888A (en) * 2022-11-22 2023-09-05 荣耀终端有限公司 Video recording method and related device

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106303723A (en) * 2016-08-11 2017-01-04 网易（杭州）网络有限公司 Method for processing video frequency and device
CN106445144A (en) * 2016-09-27 2017-02-22 宇龙计算机通信科技(深圳)有限公司 Note taking method, device and terminal
CN110381382A (en) * 2019-07-23 2019-10-25 腾讯科技（深圳）有限公司 Video takes down notes generation method, device, storage medium and computer equipment
CN111556371A (en) * 2020-05-20 2020-08-18 维沃移动通信有限公司 Note recording method and electronic equipment
WO2021054525A1 (en) * 2019-09-16 2021-03-25 주식회사 산타 Method for inputting memo in video player and server using same

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140033040A1 (en) * 2012-07-24 2014-01-30 Apple Inc. Portable device with capability for note taking while outputting content

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106303723A (en) * 2016-08-11 2017-01-04 网易（杭州）网络有限公司 Method for processing video frequency and device
CN106445144A (en) * 2016-09-27 2017-02-22 宇龙计算机通信科技(深圳)有限公司 Note taking method, device and terminal
CN110381382A (en) * 2019-07-23 2019-10-25 腾讯科技（深圳）有限公司 Video takes down notes generation method, device, storage medium and computer equipment
WO2021054525A1 (en) * 2019-09-16 2021-03-25 주식회사 산타 Method for inputting memo in video player and server using same
CN111556371A (en) * 2020-05-20 2020-08-18 维沃移动通信有限公司 Note recording method and electronic equipment

Also Published As

Publication number Publication date
CN112087657A (en) 2020-12-15

Similar Documents

Publication Publication Date Title
US11151892B2 (en) Internet teaching platform-based following teaching system
CN108924608B (en) Auxiliary method for video teaching and intelligent equipment
CN106971009B (en) Voice database generation method and device, storage medium and electronic equipment
CN106227335B (en) Interactive learning method for preview lecture and video course and application learning client
JP6384474B2 (en) Information processing apparatus and information processing method
CN112087657B (en) Data processing method and device
JP6467554B2 (en) Message transmission method, message processing method, and terminal
JP2006349782A (en) Information distribution system
CN111209437B (en) Label processing method and device, storage medium and electronic equipment
US20110171620A1 (en) System and method for audio/video interaction
CN112188267A (en) Video playing method, device and equipment and computer storage medium
CN109040842A (en) Video spectators' emotional information capturing analysis method, device, system and storage medium
TW201624272A (en) Recording and playing script system and method
CN106713973A (en) Program searching method and device
CN112286617A (en) Operation guidance method and device and electronic equipment
CN107770377A (en) A kind of method of the establishment interactive voice mobile phone news client based on HTML5
KR20150112113A (en) Method for managing online lecture contents based on event processing
CN113223520B (en) Voice interaction method, system and platform for software operation live-action semantic understanding
JP2003316801A (en) Answering system, answering device, answering method and answering program
WO2021142607A1 (en) Vehicle diagnosis process playback method, apparatus, and readable storage medium
JP2014153990A (en) Information processing apparatus, information processing method, and program
CN109343761B (en) Data processing method based on intelligent interaction equipment and related equipment
WO2020125253A1 (en) Recording information processing method and display device
CN114554297B (en) Page screenshot method and device, electronic equipment and storage medium
CN114363650B (en) Live broadcast room public screen text display method, electronic equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant