WO2019196204A1 - 多屏互动的网络教学方法以及装置 - Google Patents

多屏互动的网络教学方法以及装置 Download PDF

Info

Publication number
WO2019196204A1
WO2019196204A1 PCT/CN2018/092775 CN2018092775W WO2019196204A1 WO 2019196204 A1 WO2019196204 A1 WO 2019196204A1 CN 2018092775 W CN2018092775 W CN 2018092775W WO 2019196204 A1 WO2019196204 A1 WO 2019196204A1
Authority
WO
WIPO (PCT)
Prior art keywords
video source
teaching video
network teaching
display device
network
Prior art date
Application number
PCT/CN2018/092775
Other languages
English (en)
French (fr)
Inventor
卢启伟
刘善果
滕凯
Original Assignee
深圳市鹰硕技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市鹰硕技术有限公司 filed Critical 深圳市鹰硕技术有限公司
Priority to US16/467,475 priority Critical patent/US11398207B2/en
Publication of WO2019196204A1 publication Critical patent/WO2019196204A1/zh

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/40Scenes; Scene-specific elements in video content
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B5/00Electrically-operated educational appliances
    • G09B5/06Electrically-operated educational appliances with both visual and audible presentation of the material to be studied
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1423Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/40Scenes; Scene-specific elements in video content
    • G06V20/41Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/40Scenes; Scene-specific elements in video content
    • G06V20/46Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/14Display of multiple viewports
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2320/00Control of display operating conditions
    • G09G2320/06Adjustment of display parameters
    • G09G2320/0613The adjustment depending on the type of the information to be displayed
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00Aspects of display data processing
    • G09G2340/14Solving problems related to the presentation of information to be displayed
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2360/00Aspects of the architecture of display systems
    • G09G2360/16Calculation or use of calculated indices related to luminance levels in display data
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2370/00Aspects of data communication
    • G09G2370/20Details of the management of multiple sources of image data

Definitions

  • the present disclosure relates to the field of computer technologies, and in particular, to a multi-screen interactive network teaching method, apparatus, electronic device, and computer readable storage medium.
  • Patent Application No. CN200910136925.8 discloses a video playback device comprising: a video data input device for inputting video data, a level data input/generation device for inputting or generating level data, wherein video data is in accordance with importance a scene division level; a playback scene determination parameter input device that inputs a parameter when determining a scene to be played back according to importance; a parameter input device for determining the level data and the playback scene; and based on the level data and the playback scene determination parameter A playback scene determining device that determines a playback scene; and a display device that displays the playback scene.
  • the important level of the video in the application disclosure is realized by presetting the important level data and the level of the scene of the video data. It is a qualified condition to realize the recognition of the important level of the video source, and cannot realize the importance of all the videos. Intelligent recognition of grades.
  • the patent application with the application number CN201510027445.3 discloses a stereoscopic video frame importance evaluation method, which cross-analyzes the error concealment distortion and the error loss distortion of the left and right viewpoint images of the stereo image in the image group, and calculates The total distortion of the stereo image, and thus the importance of the stereo video frame.
  • This application is for the importance analysis of image frames in stereo images, and is not an analysis of the importance of online teaching video sources, that is, online teaching content.
  • the patent application with the application number CN201510312241.8 discloses an intelligent video analysis system and method for logically selecting only time-dependent surveillance cameras by intelligent video analysis methods and systems and assigning different levels to the selected surveillance cameras according to their importance. Later, more video analytics resources are assigned to the high importance surveillance cameras to perform video analytics quickly and efficiently. The focus is on linking event analysis and importance, and allocating more surveillance camera resources based on the decision results, and not achieving intelligent recognition of all video importance levels.
  • the purpose of the present disclosure is to provide a multi-screen interactive network teaching method, apparatus, electronic device, and computer readable storage medium, thereby at least partially obviating one or more problems due to limitations and disadvantages of the related art.
  • a multi-screen interactive network teaching method including:
  • each of the network teaching video sources is important to each network teaching video source
  • the level is sorted to correspond to the priority of the terminal display device display.
  • the plurality of network teaching video sources are analyzed according to a preset analysis algorithm, and the action frequency of the plurality of network teaching video sources is determined according to the analysis result, including:
  • the conversion factor C is derived from the custom shadow:
  • Calculating the gray value G according to the gray level mean A and the conversion factor C includes:
  • Math.round is a rounding function
  • the grayscale comparison value and value H are used to characterize the frequency of action of the instructional video source.
  • the network teaching video source is ranked according to an action frequency of the plurality of network teaching video sources, including:
  • the network teaching video source that determines the average grayscale comparison value and the largest value has the highest importance level.
  • the preset analysis algorithm is a custom grayscale shadow comparison method.
  • the method further includes:
  • each of the network teaching video sources is respectively displayed by a terminal display device that is prioritized with an important level of each network teaching video source, including:
  • the video source with the highest importance level is displayed by the highest priority terminal display device.
  • the method further includes:
  • the playback device that performs the network teaching video source After receiving the response signal, if the playback device that performs the network teaching video source is determined to be switched according to the response information carried in the response signal, the corresponding relationship between the updated preset priority and the important level of the video source is performed.
  • the network teaching video source is switched in the corresponding terminal display device.
  • the method further includes:
  • the corresponding teaching video source is displayed by the to-be-switched terminal display device according to the teaching video source identifier and the corresponding information of the to-be-switched terminal display device.
  • the method further includes:
  • the terminal displays the teaching video source identifier carried in the device switching instruction and the corresponding information of the terminal device to be switched, including:
  • the terminal display device switching instruction carries information corresponding to multiple teaching video source identifiers and corresponding information of a terminal device to be switched;
  • the terminal displays the teaching video source identifier carried in the device switching instruction and the corresponding information of the terminal device to be switched, including:
  • the terminal displays the device switching instruction carrying information as a teaching video source identifier and corresponding information of the plurality of to-be-switched terminal display devices;
  • one teaching video source is respectively displayed on the plurality of to-be-switched terminal display devices.
  • the number of associated video sources is the same as the number of associated terminal display devices.
  • a multi-screen interactive network teaching apparatus including:
  • a signal receiving module configured to receive a plurality of network teaching video source signals, where the plurality of network teaching video sources are associated video sources;
  • a video source analysis module configured to analyze the plurality of network teaching video sources according to a preset analysis algorithm, and determine an action frequency of the plurality of network teaching video sources according to the analysis result;
  • a ranking module configured to perform an important ranking of the network teaching video source according to the action frequency of the plurality of network teaching video sources
  • an electronic device comprising:
  • a memory having stored thereon computer readable instructions that, when executed by the processor, implement the method of any of the above.
  • a computer readable storage medium having stored thereon a computer program, the computer program being executed by a processor, implements the method of any of the above.
  • the multi-screen interactive network teaching method in the exemplary embodiment of the present disclosure receives a plurality of network teaching video source signals, where the plurality of network teaching video sources are associated video sources, and the plurality of networks are configured according to a preset analysis algorithm.
  • the teaching video source is analyzed, and the action frequency of the plurality of network teaching video sources is determined according to the analysis result, and the network teaching video source is sorted according to the action frequency of the plurality of network teaching video sources, and the plurality of associated terminals are acquired. Displaying a correspondence between the preset priority of the device and the importance ranking of the video source, and according to the corresponding relationship, respectively, the respective network teaching video sources are respectively prioritized by ranking with important levels of each network teaching video source.
  • the terminal displays the device display.
  • the motion frequency of each network teaching video source is quickly analyzed, and then the important level of the video source is obtained, and the shadow value is customized, and the teaching scene is eliminated to some extent.
  • Different recognition of the important level of the video source is an efficient and accurate important level recognition algorithm for the network teaching video source; on the other hand, by prioritizing the display devices of the user terminal and corresponding to the important level of the network teaching video source The method enables users to achieve continuous tracking of important teaching content, greatly enhancing the user experience.
  • FIG. 1 illustrates a flow chart of a multi-screen interactive web-based teaching method in accordance with an exemplary embodiment of the present disclosure
  • FIGS. 2A-2C illustrate schematic diagrams of important rankings of network instructional video sources, in accordance with an exemplary embodiment of the present disclosure
  • 3A-3B are schematic diagrams showing a multi-screen interactive network teaching device application scenario according to an exemplary embodiment of the present disclosure
  • FIG. 4 shows a schematic block diagram of a multi-screen interactive network teaching device according to an exemplary embodiment of the present disclosure
  • FIG. 5 schematically illustrates a block diagram of an electronic device in accordance with an exemplary embodiment of the present disclosure
  • FIG. 6 schematically illustrates a schematic diagram of a computer readable storage medium in accordance with an exemplary embodiment of the present disclosure.
  • a multi-screen interactive network teaching method is first provided, which can be applied to an electronic device such as a computer; as shown in FIG. 1, the multi-screen interactive network teaching method may include the following steps:
  • the action frequency of each network teaching video source is quickly analyzed by using a custom gray-scale shadow comparison method, thereby obtaining an important level of the video source, and
  • the recognition of the important level of the video source is eliminated to a certain extent, which is an efficient and accurate important level recognition algorithm for the network teaching video source; on the other hand, by displaying to the user terminal
  • the method of prioritizing the devices and corresponding to the important levels of the network teaching video source enables the user to continuously track important teaching content and greatly enhance the user experience.
  • step S110 a plurality of network teaching video source signals may be received, where the plurality of network teaching video sources are associated video sources.
  • the network teaching is a teaching content spread through the network, and the user is not limited by the place and the time, so the form is also diverse, and the content displayed to the user is also richer, so these online teaching contents often pass A plurality of content related network teaching video sources are transmitted to the user for viewing and learning.
  • the plurality of network teaching video sources may be analyzed according to a preset analysis algorithm, and an action frequency of the plurality of network teaching video sources is determined according to the analysis result.
  • the user when the user receives a network teaching video source in which a plurality of content are related to each other, the user may select to view one or more video sources, and generally, in order to improve the learning effect, the network teaching video with high importance of the teaching content is preferentially viewed. source.
  • the frequency of actions in the network teaching video source In the absence of a preset, often the higher the frequency of actions in the network teaching video source, the higher the importance level of the network teaching video source. Therefore, by analyzing the frequency of actions in the network teaching video source, we can get an important level of the network teaching video source, and quickly sort the important levels of the network teaching video source.
  • the frame image is de-colorized to obtain a frame image including brightness and darkness.
  • the specific method is to analyze the color values of red, green, and blue of each pixel in the frame image, and sum The mean is then calculated, which is the gray level mean A of the frame image.
  • the shadow value N of the scene information is preset to exclude the influence of the scene background light source on the brightness and darkness.
  • the shadow value N can be set to 180-240
  • the scene of the network teaching video source is the teaching blackboard
  • the shadow value N can be set to 10-80
  • the network teaching video source When the scene is a general teaching scene such as a teacher, the shadow value N can be set to 100-200.
  • the conversion factor C: C 255 / (N - 1) is derived from the custom shading, which is used to calculate the gray value in conjunction with the gray mean.
  • the grayscale comparison value and the value H are used to represent the action frequency of the teaching video source, and the action frequency of the teaching video source is higher, and the content of the network teaching video source signal frame image is changed to a high degree.
  • the comparison value and the value H are also larger, so the gray scale comparison value and value are positively related to the action frequency of the teaching video source.
  • step S130 an important level ranking of the network teaching video source may be performed according to the action frequency of the plurality of network teaching video sources.
  • the direct response is the importance of the current teaching content, so according to the network teaching video source
  • the action frequency can reflect the important level of the network teaching video source, and can sort the important levels of the network teaching video source according to the action frequency of the network teaching video source.
  • 2A-2C are gray level comparison values and values and importance level rankings of a plurality of related video sources corresponding to a certain network teaching content.
  • the ranking of the network teaching video source according to the action frequency of the plurality of network teaching video sources is performed, and the average gray level comparison value and the value of the network teaching video source are sorted.
  • the average grayscale comparison value and value of the network teaching video source are positively correlated with the important level of the network teaching video source.
  • the preset analysis algorithm is a custom grayscale shadow comparison method.
  • the shadow value N corresponding to the scene information is preset, and the shadow value may be used to exclude the influence of the scene background light source on the brightness and darkness, and the optimization is different. Comparison of grayscale shadows of frame images.
  • This preset analysis algorithm is a custom grayscale shadow comparison method.
  • the corresponding relationship between the preset priority of the plurality of associated terminal display devices and the important level of the video source may be obtained, and the respective network teaching video sources are separately passed according to the corresponding relationship entries.
  • Each network teaching video source has an important level ranking corresponding to the priority terminal display device display.
  • the network teaching video source corresponding to the important level is displayed on the terminal display device of the corresponding priority for the user to watch and learn.
  • the method further includes: receiving and saving a preset priority of the terminal display device preset by the user, where the terminal display device may be a television, a PC display, or the like, for receiving the network teaching video source.
  • the terminal display device may be a television, a PC display, or the like, for receiving the network teaching video source.
  • the mobile phone, the Pad, and the like, the display device of the polyline terminal is used by the user in a different situation depending on the size, the location, and the occasion. Therefore, the priority of the terminal display device is different in different scenarios, and the terminal is acquired. After the preset priority of the device is displayed, the corresponding relationship between the preset priority and the important level of the video source is established in combination with the current scenario.
  • the respective network teaching video sources are respectively displayed by the terminal display device corresponding to the priority level of each network teaching video source, including: displaying the video source with the highest priority level through the terminal with the highest priority. The device is displayed. After establishing the correspondence between the preset priority and the important level of the video source, the important level of the network teaching video source is corresponding to the preset priority of the terminal display device, and the network teaching video source is Displayed on the corresponding terminal display device.
  • the method further includes: after detecting an important level change of the teaching video source, or changing a priority of the terminal display device, updating a correspondence relationship between the preset priority and the video source important level ranking
  • the current most important online teaching video source is the teacher's oral teaching.
  • the teacher verbally teaches the teaching the content of the teaching courseware placed on the projector screen is transferred, according to the preset analysis algorithm.
  • the video source of the courseware teaching in the plurality of network teaching video sources is analyzed to become the video source with the highest level of importance, and the corresponding relationship between the preset priority and the important level of the video source is updated at this time;
  • the user watches the network teaching content on the PC display, there is something to go to other rooms temporarily, it is not convenient to continue to watch the network teaching content on the current PC display, but the network teaching content can be viewed on the portable device such as the Pad, then the user can actively adjust
  • the terminal displays the priority of the device, and adjusts the priority of the Pad to the highest priority, and The new preset correspondence table item priority ranking of the video source is important.
  • the device After receiving the update information of the correspondence between the preset priority and the important level of the video source, the device sends a device switching prompt message to the terminal with the highest priority, as shown in FIG. 3A, when the network teaching scene is The user with the highest priority displays the device switching prompt signal received on the device. If the user clicks “Yes”, the user sends a response signal confirming the switching terminal display device.
  • FIG. 3B is a schematic diagram after switching the terminal display device.
  • the method further includes: after detecting the terminal display device switching instruction triggered by the user, acquiring the corresponding information of the teaching video source identifier carried in the terminal display device switching instruction and the display device to be switched;
  • the corresponding teaching video source is displayed by the to-be-switched terminal display device according to the teaching video source identifier and the corresponding information of the to-be-switched terminal display device.
  • the method further includes: recording and collecting corresponding information of the teaching video source identifier carried in the terminal display device switching instruction triggered by the user and the display device of the terminal to be switched, to obtain a statistical result; and updating the Correspondence relationship between the preset priority and the important level of the video source.
  • all users will default to the same teaching video source identifier and the corresponding information of the terminal display device to be switched. At that time, due to the actual teaching, there will be different user personal preferences, terminal display device restrictions and other factors.
  • the switching between the default teaching video source identifier and the corresponding information of the display device to be switched is performed, and the switching operation is recorded and counted. When the switching operation exceeds the preset value, it is determined that the switched terminal display device is the current user.
  • the default terminal display device can further update the correspondence between the preset priority and the video source importance level.
  • the terminal displays the teaching video source identifier carried in the device switching instruction and the corresponding information of the display device to be switched, and includes: if the terminal displays the device switching instruction, the information carried in the device switching instruction is multiple teaching video source identifiers. Corresponding information with a terminal device to be switched; displaying a plurality of corresponding teaching video sources through the one to be switched terminal display device. If the scene of the user's online teaching learning has multiple rooms, and each room has a terminal display device, the user can set each terminal display device to receive only the network teaching video source signal with the highest level of importance, which is convenient for the user in multiple rooms. When walking, the network teaching video source signal can also be conveniently viewed.
  • the terminal displays the teaching video source identifier carried in the device switching instruction and the corresponding information of the display device to be switched, including: if the terminal display device switching instruction carries the information as a teaching video source identifier and Corresponding information of the plurality of to-be-switched terminal display devices is displayed on the plurality of to-be-switched terminal display devices. For example, if the user conducts network learning and learning, there is only one terminal display device. At this time, the user can display the network teaching video source signal with the highest level of importance, or set the preset number of the important rankings. The network teaching video source signal is simultaneously displayed on the currently unique terminal display device.
  • the number of associated video sources is the same as the number of associated terminal display devices. If the scenario in which the user conducts the network learning learning is that there are multiple terminal display devices, and the number of the terminal display devices is the same as the number of the network teaching video sources, each network teaching video source may be separately displayed on each terminal display device. The important level of the network teaching video source corresponds to the priority of the terminal display device.
  • the multi-screen interactive network teaching apparatus 400 may include: a signal receiving module 410, a video source analyzing module 420, a ranking module 430, and a multi-screen display module 440. among them:
  • the signal receiving module 410 is configured to receive a plurality of network teaching video source signals, where the plurality of network teaching video sources are associated video sources;
  • the video source analysis module 420 is configured to analyze the plurality of network teaching video sources according to a preset analysis algorithm, and determine an action frequency of the plurality of network teaching video sources according to the analysis result;
  • the ranking module 430 is configured to perform an important ranking of the network teaching video source according to the action frequency of the plurality of network teaching video sources;
  • the multi-screen display module 440 is configured to obtain a corresponding relationship between the preset priority of the plurality of associated terminal display devices and the important level of the video source, and according to the corresponding relationship, the respective network teaching video sources are respectively
  • the terminal display device display is performed by sorting the priority levels corresponding to the important levels of the respective network teaching video sources.
  • modules or units of the multi-screen interactive network teaching device 400 are mentioned in the above detailed description, such division is not mandatory. Indeed, in accordance with embodiments of the present disclosure, the features and functions of two or more modules or units described above may be embodied in one module or unit. Conversely, the features and functions of one of the modules or units described above may be further divided into multiple modules or units.
  • an electronic device capable of implementing the above method is also provided.
  • aspects of the present invention can be implemented as a system, method, or program product. Accordingly, aspects of the present invention may be embodied in the form of a complete hardware embodiment, a complete software embodiment (including firmware, microcode, etc.), or a combination of hardware and software aspects, which may be collectively referred to herein. "Circuit,” “module,” or “system.”
  • FIG. 5 An electronic device 500 in accordance with such an embodiment of the present invention is described below with reference to FIG. 5 is merely an example and should not impose any limitation on the function and scope of use of the embodiments of the present invention.
  • electronic device 500 is embodied in the form of a general purpose computing device.
  • the components of the electronic device 500 may include, but are not limited to, the at least one processing unit 510, the at least one storage unit 520, the bus 530 connecting the different system components (including the storage unit 520 and the processing unit 510), and the display unit 540.
  • the storage unit stores program code, which can be executed by the processing unit 510, such that the processing unit 510 performs various exemplary embodiments according to the present invention described in the "Exemplary Method" section of the present specification.
  • the processing unit 510 can perform steps S110 to S140 as shown in FIG. 1.
  • the storage unit 520 can include a readable medium in the form of a volatile storage unit, such as a random access storage unit (RAM) 5201 and/or a cache storage unit 5202, and can further include a read only storage unit (ROM) 5203.
  • RAM random access storage unit
  • ROM read only storage unit
  • the storage unit 520 can also include a program/utility 5204 having a set (at least one) of the program modules 5205, such as but not limited to: an operating system, one or more applications, other program modules, and program data, Implementations of the network environment may be included in each or some of these examples.
  • a program/utility 5204 having a set (at least one) of the program modules 5205, such as but not limited to: an operating system, one or more applications, other program modules, and program data, Implementations of the network environment may be included in each or some of these examples.
  • Bus 530 may be representative of one or more of several types of bus structures, including a memory unit bus or memory unit controller, a peripheral bus, a graphics acceleration port, a processing unit, or a local area using any of a variety of bus structures. bus.
  • the electronic device 500 can also communicate with one or more external devices 570 (eg, a keyboard, pointing device, Bluetooth device, etc.), and can also communicate with one or more devices that enable the user to interact with the electronic device 500, and/or with Any device (eg, router, modem, etc.) that enables the electronic device 500 to communicate with one or more other computing devices. This communication can take place via an input/output (I/O) interface 550. Also, electronic device 500 can communicate with one or more networks (e.g., a local area network (LAN), a wide area network (WAN), and/or a public network, such as the Internet) via network adapter 560. As shown, network adapter 560 communicates with other modules of electronic device 500 via bus 530.
  • network adapter 560 communicates with other modules of electronic device 500 via bus 530.
  • the exemplary embodiments described herein may be implemented by software, or may be implemented by software in combination with necessary hardware. Therefore, the technical solution according to an embodiment of the present disclosure may be embodied in the form of a software product, which may be stored in a non-volatile storage medium (which may be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network.
  • a non-volatile storage medium which may be a CD-ROM, a USB flash drive, a mobile hard disk, etc.
  • a number of instructions are included to cause a computing device (which may be a personal computer, server, terminal device, or network device, etc.) to perform a method in accordance with an embodiment of the present disclosure.
  • a computer readable storage medium having stored thereon a program product capable of implementing the above method of the present specification.
  • aspects of the present invention may also be embodied in the form of a program product comprising program code for causing said program product to run on a terminal device The terminal device performs the steps according to various exemplary embodiments of the present invention described in the "Exemplary Method" section of the present specification.
  • a program product 600 for implementing the above method which may employ a portable compact disk read only memory (CD-ROM) and includes program code, and may be in a terminal device, is illustrated in accordance with an embodiment of the present invention.
  • CD-ROM portable compact disk read only memory
  • the program product of the present invention is not limited thereto, and in the present document, the readable storage medium may be any tangible medium containing or storing a program that can be used by or in connection with an instruction execution system, apparatus or device.
  • the program product can employ any combination of one or more readable media.
  • the readable medium can be a readable signal medium or a readable storage medium.
  • the readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the above. More specific examples (non-exhaustive lists) of readable storage media include: electrical connections with one or more wires, portable disk, hard disk, random access memory (RAM), read only memory (ROM), erasable Programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the foregoing.
  • the computer readable signal medium may include a data signal that is propagated in the baseband or as part of a carrier, carrying readable program code. Such propagated data signals can take a variety of forms including, but not limited to, electromagnetic signals, optical signals, or any suitable combination of the foregoing.
  • the readable signal medium can also be any readable medium other than a readable storage medium that can transmit, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
  • Program code embodied on a readable medium can be transmitted using any suitable medium, including but not limited to wireless, wireline, optical cable, RF, etc., or any suitable combination of the foregoing.
  • Program code for performing the operations of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, C++, etc., including conventional procedural Programming language—such as the "C" language or a similar programming language.
  • the program code can execute entirely on the user computing device, partially on the user device, as a stand-alone software package, partially on the remote computing device on the user computing device, or entirely on the remote computing device or server. Execute on.
  • the remote computing device can be connected to the user computing device via any kind of network, including a local area network (LAN) or wide area network (WAN), or can be connected to an external computing device (eg, provided using an Internet service) Businesses are connected via the Internet).
  • LAN local area network
  • WAN wide area network
  • Businesses are connected via the Internet.
  • the motion frequency of each network teaching video source is quickly analyzed, and then the important level of the video source is obtained, and the shadow value is customized, and the teaching scene is eliminated to some extent.
  • Different recognition of the important level of the video source is an efficient and accurate important level recognition algorithm for the network teaching video source; on the other hand, by prioritizing the display devices of the user terminal and corresponding to the important level of the network teaching video source The method enables users to achieve continuous tracking of important teaching content, greatly enhancing the user experience.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Educational Administration (AREA)
  • Business, Economics & Management (AREA)
  • Educational Technology (AREA)
  • Multimedia (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Human Computer Interaction (AREA)
  • Computational Linguistics (AREA)
  • Software Systems (AREA)
  • User Interface Of Digital Computer (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Electrically Operated Instructional Devices (AREA)

Abstract

本公开是关于一种多屏互动的网络教学方法、装置、电子设备以及存储介质,该方法包括:接收多个网络教学视频源信号,所述多个网络教学视频源为关联视频源,按照预设分析算法对所述多个网络教学视频源进行分析,根据分析结果确定所述多个网络教学视频源的动作频率,根据所述多个网络教学视频源的动作频率对网络教学视频源进行重要等级排序,获取多个关联的终端显示设备的预设优先级与视频源重要等级排序的对应关系表项,根据所述对应关系表项将各个网络教学视频源分别通过与各网络教学视频源重要等级排序对应优先级的终端显示设备显示。本公开可以通过对网络教学视频源的分析实现对重点教学内容的优先显示。

Description

多屏互动的网络教学方法以及装置 技术领域
本公开涉及计算机技术领域,具体而言,涉及一种多屏互动的网络教学方法、装置、电子设备以及计算机可读存储介质。
背景技术
在网络教学场景中,常因用户只能观看一个终端显示设备的指定视频源使得用户不能有身临其境的教学感受,进而也会影响教学效果,随着人们生活水平的提高,现在往往将多个网络教学视频源在用户的多个终端显示设备上显示,扩展了网络教学的教学场景映射。
然而,当用户使用多个终端显示设备观看学习多个网络教学视频源时,往往不能确定所述网络教学视频源的重要等级,而出现需要同时观看多个终端显示设备,才能逐渐确定较高重要等级的网络教学视频源,这个过程反而降低了用户体验,给用户观看学习带来了不便。
在现有技术中,围绕网络教学视频源重要等级的识别和显示这个主题,现有技术中已经有一些专利申请进行了有益的尝试,比如:
申请号为CN200910136925.8的专利申请公开了一种视频重放设备,包括:输入视频数据的视频数据输入装置,输入或生成等级数据的等级数据输入/生成装置,其中依照重要性对视频数据的场景划分等级;在依照重要性确定要重放的场景时输入参数的重放场景确定参数输入装置;在等级数据和重放场景确定参数输入装置;在等级数据和重放场景确定参数的基础上确定重放场景的重放场景确定装置;以及显示重放场景的显示装置。该申请公开中视频的重要等级是通过预设的重要等级数据以及对视频数据的场景划分等级来实现的,是有限定条件的实现了对视频源重要等级的识别,并不能实现对所有视频重要等级的智能识别。
申请号为CN201510027445.3的专利申请公开了一种立体视频帧重要性评估方法,所述方法对图像组中立体图像的左、右视点图像的错误隐藏 失真、错误失散失真分别交叉分析,计算出了立体图像的总失真,并由此得出立体视频帧重要性。该申请是针对立体图像中图像帧的重要性分析,并非对于网络教学视频源也就是网络教学内容的重要程度的分析。
申请号为CN201510312241.8的专利申请公开了智能视频分析***和方法,通过智能视频分析方法和***逻辑上仅选择与时间相关的监控相机并根据其重要性为选择的监控相机分配不同的等级。之后,更多的视频分析资源被分配给高重要性的监控相机,从而快速且有效地执行视频分析。其关注的是将事件分析和重要性挂钩,并根据判定结果分配更多的监控相机资源,并不能实现对所有视频重要等级的智能识别。
现有技术中,关于网络教学视频源重要等级的识别和显示还存在以下问题:
1、不通过重要等级识别数据的划分,自动对视频源的重要等级识别;
2、不能通过对网络教学视频源的重要等级分析得出网络教学视频源对应教学内容的重要等级;
3、不通过具体事件特征或者时间逻辑特征,自动对视频源的重要等级识别。
因此,需要提供一种或多种至少能够解决上述问题的技术方案。
需要说明的是,在上述背景技术部分公开的信息仅用于加强对本公开的背景的理解,因此可以包括不构成对本领域普通技术人员已知的现有技术的信息。
发明内容
本公开的目的在于提供一种多屏互动的网络教学方法、装置、电子设备以及计算机可读存储介质,进而至少在一定程度上克服由于相关技术的限制和缺陷而导致的一个或者多个问题。
根据本公开的一个方面,提供一种多屏互动的网络教学方法,包括:
接收多个网络教学视频源信号,所述多个网络教学视频源为关联视频 源;
按照预设分析算法对所述多个网络教学视频源进行分析,根据分析结果确定所述多个网络教学视频源的动作频率;
根据所述多个网络教学视频源的动作频率对网络教学视频源进行重要等级排序;
获取多个关联的终端显示设备的预设优先级与视频源重要等级排序的对应关系表项,根据所述对应关系表项,将所述各个网络教学视频源分别通过与各网络教学视频源重要等级排序对应优先级的终端显示设备显示。
在本公开的一种示例性实施例中,按照预设分析算法对所述多个网络教学视频源进行分析,根据分析结果确定所述多个网络教学视频源的动作频率,包括:
定时提取网络教学视频源信号中的帧图像,计算所述帧图像的灰度均值A,其中:A=(Red+Green+Blue)/3;
获取所述网络教学视频源场景信息,根据所述场景信息预设阴影值N;
根据自定义阴影值得出转换因子C:
C=255/(N-1);
根据所述灰度均值A以及转换因子C计算灰度值G,包括:
G=Math.round((A/C)+0.5)*C
其中,Math.round为取整函数;
根据所述灰度值G计算所述网络教学视频源的灰度比较值和值H:
Figure PCTCN2018092775-appb-000001
其中,
Figure PCTCN2018092775-appb-000002
为所述网络教学视频源信号的灰度值均值;
所述灰度比较值和值H用于表征所述教学视频源的动作频率。
在本公开的一种示例性实施例中,根据所述多个网络教学视频源的动作频率对网络教学视频源进行重要等级排序,包括:
对所述网络教学视频源的平均灰度比较值和值进行排序;
确定平均灰度比较值和值最大的网络教学视频源的重要等级最高。
在本公开的一种示例性实施例中,所述预设分析算法为自定义灰度阴影比较法。
在本公开的一种示例性实施例中,所述方法还包括:
接收并保存用户预先设置的终端显示设备的预设优先级;
建立所述预设优先级与视频源重要等级排序的对应关系表项。
在本公开的一种示例性实施例中,将所述各个网络教学视频源分别通过与各网络教学视频源重要等级排序对应优先级的终端显示设备显示,包括:
将重要等级最高的视频源通过优先级最高的终端显示设备显示。
在本公开的一种示例性实施例中,所述方法还包括:
在检测到教学视频源的重要等级变化,或者终端显示设备的优先级变化后,更新所述预设优先级与视频源重要等级排序的对应关系表项;
向优先级最高的终端显示设备发送设备切换提示信号;
在接收到响应信号后,如果根据所述响应信号中携带的响应信息确定进行网络教学视频源的播放设备切换,根据更新后的预设优先级与视频源重要等级排序的对应关系表项进行多个网络教学视频源在对应终端显示设备的切换。
在本公开的一种示例性实施例中,所述方法还包括:
在检测到用户触发的终端显示设备切换指令后,获取所述终端显示设备切换指令中携带的教学视频源标识与待切换终端显示设备的对应信息;
根据所述教学视频源标识与待切换终端显示设备的对应信息将对应的教学视频源通过所述待切换终端显示设备显示。
在本公开的一种示例性实施例中,所述方法还包括:
记录并统计用户触发的终端显示设备切换指令中携带的教学视频源标 识与待切换终端显示设备的对应信息,得到统计结果;
根据统计结果更新所述预设优先级与视频源重要等级排序的对应关系表项。
在本公开的一种示例性实施例中,所述终端显示设备切换指令中携带的教学视频源标识与待切换终端显示设备的对应信息,包括:
若所述终端显示设备切换指令中携带信息为多个教学视频源标识与一个待切换终端显示设备的对应信息;
将对应的多个教学视频源通过所述一个待切换终端显示设备显示。
在本公开的一种示例性实施例中,所述终端显示设备切换指令中携带的教学视频源标识与待切换终端显示设备的对应信息,包括:
若所述终端显示设备切换指令中携带信息为一个教学视频源标识与多个待切换终端显示设备的对应信息;
将对应的一个教学视频源分别在所述多个待切换终端显示设备显示。
在本公开的一种示例性实施例中,所述关联视频源数量与多个关联的终端显示设备数量相同。
在本公开的一个方面,提供一种多屏互动的网络教学装置,包括:
信号接收模块,用于接收多个网络教学视频源信号,所述多个网络教学视频源为关联视频源;
视频源分析模块,用于按照预设分析算法对所述多个网络教学视频源进行分析,根据分析结果确定所述多个网络教学视频源的动作频率;
等级排序模块,用于根据所述多个网络教学视频源的动作频率对网络教学视频源进行重要等级排序;
多屏显示模块,用于获取多个关联的终端显示设备的预设优先级与视频源重要等级排序的对应关系表项,根据所述对应关系表项,将所述各个网络教学视频源分别通过与各网络教学视频源重要等级排序对应优先级的终端显示设备显示。在本公开的一个方面,提供一种电子设备,包括:
处理器;以及
存储器,所述存储器上存储有计算机可读指令,所述计算机可读指令被所述处理器执行时实现根据上述任意一项所述的方法。
在本公开的一个方面,提供一种计算机可读存储介质,其上存储有计算机程序,所述计算机程序被处理器执行时实现根据上述任意一项所述的方法。
本公开的示例性实施例中的多屏互动的网络教学方法,接收多个网络教学视频源信号,所述多个网络教学视频源为关联视频源,按照预设分析算法对所述多个网络教学视频源进行分析,根据分析结果确定所述多个网络教学视频源的动作频率,根据所述多个网络教学视频源的动作频率对网络教学视频源进行重要等级排序,获取多个关联的终端显示设备的预设优先级与视频源重要等级排序的对应关系表项,根据所述对应关系表项,将所述各个网络教学视频源分别通过与各网络教学视频源重要等级排序对应优先级的终端显示设备显示。一方面,通过自定义灰度阴影比较法,快速的分析各网络教学视频源的动作频率,进而得到所述视频源的重要等级,且通过自定义了阴影值,一定程度上消除了教学场景的不同对视频源重要等级的识辨,是一种高效准确的网络教学视频源的重要等级识别算法;另一方面,通过对用户终端显示设备的优先级排序并与网络教学视频源的重要等级对应的方法,使用户可以实现对重要教学内容的持续跟踪,极大的增强了用户体验。
应当理解的是,以上的一般描述和后文的细节描述仅是示例性和解释性的,并不能限制本公开。
附图说明
通过参照附图来详细描述其示例实施例,本公开的上述和其它特征及优点将变得更加明显。
图1示出了根据本公开一示例性实施例的多屏互动的网络教学方法的流程图;
图2A-2C示出了根据本公开一示例性实施例的网络教学视频源的重要等级排序的示意图;
图3A-3B示出了根据本公开一示例性实施例的多屏互动的网络教学装置应用场景的示意图;
图4示出了根据本公开一示例性实施例的多屏互动的网络教学装置的示意框图;
图5示意性示出了根据本公开一示例性实施例的电子设备的框图;以及
图6示意性示出了根据本公开一示例性实施例的计算机可读存储介质的示意图。
具体实施方式
现在将参考附图更全面地描述示例实施例。然而,示例实施例能够以多种形式实施,且不应被理解为限于在此阐述的实施例;相反,提供这些实施例使得本公开将全面和完整,并将示例实施例的构思全面地传达给本领域的技术人员。在图中相同的附图标记表示相同或类似的部分,因而将省略对它们的重复描述。
此外,所描述的特征、结构或特性可以以任何合适的方式结合在一个或更多实施例中。在下面的描述中,提供许多具体细节从而给出对本公开的实施例的充分理解。然而,本领域技术人员将意识到,可以实践本公开的技术方案而没有所述特定细节中的一个或更多,或者可以采用其它的方法、组元、材料、装置、步骤等。在其它情况下,不详细示出或描述公知结构、方法、装置、实现、材料或者操作以避免模糊本公开的各方面。
附图中所示的方框图仅仅是功能实体,不一定必须与物理上独立的实体相对应。即,可以采用软件形式来实现这些功能实体,或在一个或多个软件硬化的模块中实现这些功能实体或功能实体的一部分,或在不同网络和/或处理器装置和/或微控制器装置中实现这些功能实体。
在本示例实施例中,首先提供了一种多屏互动的网络教学方法,可以应用于计算机等电子设备;参考图1中所示,该多屏互动的网络教学方法可以包括以下步骤:
S110.接收多个网络教学视频源信号,所述多个网络教学视频源为关联视频源;
S120.按照预设分析算法对所述多个网络教学视频源进行分析,根据分析结果确定所述多个网络教学视频源的动作频率;
S130.根据所述多个网络教学视频源的动作频率对网络教学视频源进行重要等级排序;
S140.获取多个关联的终端显示设备的预设优先级与视频源重要等级排序的对应关系表项,根据所述对应关系表项,将所述各个网络教学视频源分别通过与各网络教学视频源重要等级排序对应优先级的终端显示设备显示。
根据本示例实施例中的多屏互动的网络教学方法,一方面,通过自定义灰度阴影比较法,快速的分析各网络教学视频源的动作频率,进而得到所述视频源的重要等级,且通过自定义了阴影值,一定程度上消除了教学场景的不同对视频源重要等级的识辨,是一种高效准确的网络教学视频源的重要等级识别算法;另一方面,通过对用户终端显示设备的优先级排序并与网络教学视频源的重要等级对应的方法,使用户可以实现对重要教学内容的持续跟踪,极大的增强了用户体验。
下面,将对本示例实施例中的多屏互动的网络教学方法进行进一步的说明。
在步骤S110中,可以接收多个网络教学视频源信号,所述多个网络教学视频源为关联视频源。
本示例实施方式中,网络教学是通过网络传播的教学内容,用户不受场所和时间的限制,所以其形式也多种多样,展现给用户的内容也更为丰富,所以这些网络教学内容往往通过多个内容相互关联网络教学视频源传输至用户,供用户观看学习。
在步骤S120中,可以按照预设分析算法对所述多个网络教学视频源进行分析,根据分析结果确定所述多个网络教学视频源的动作频率。
本示例实施方式中,当用户接收到多个内容相互关联的网络教学视频源时,可以选择观看一个或者多个视频源,一般为了提高学习效果,优先观看教学内容重要性较高的网络教学视频源。在没有预设的情况下,往往是网络教学视频源中的动作频率越高,所述网络教学视频源的重要等级也越高。所以分析网络教学视频源中的动作频率,就可以得出网络教学视频源的重要等级,快速的为网络教学视频源的重要等级排序。
本示例实施方式中,按照预设分析算法对所述多个网络教学视频源进行分析,根据分析结果确定所述多个网络教学视频源的动作频率,包括:定时提取网络教学视频源信号中的帧图像,计算所述帧图像的灰度均值A,其中:A=(Red+Green+Blue)/3,对所述网络教学视频源信号中的帧图像进行灰度均值计算,是为了将所述帧图像去色彩化处理,获得包含明暗度的帧图像,具体方法为,分析所述帧图像中每个像素的红(Red)、绿(Green)、蓝(Blue)的色值,求和后计算均值,既为所述帧图像的灰度均值A。
在计算得到所述帧图像的灰度均值的同时,还需获取所述网络教学视频源场景信息,根据所述场景信息预设阴影值N。因不同教学场景的背景光源不同,所以所述帧图像的明暗度也会有误差,所以要预设所述场景信息的阴影值N,用来排除场景背景光源对明暗度的影响。如网络教学视频源的场景为教学用白板时,阴影值N可以设置为180-240,网络教学视频源的场景为教学用黑板时,阴影值N可以设置为10-80,网络教学视频源的场景为教师等普通教学场景时,阴影值N可以设置为100-200。
根据自定义阴影值得出转换因子C:C=255/(N-1),所述转换因子用来结合灰度均值来计算灰度值。
根据所述灰度均值A以及转换因子C计算灰度值G,包括:G=Math.round((A/C)+0.5)*C,其中,Math.round为取整函数,方便灰度值为整数参与后续的设置或运算,式中0.5为取整经验常数,是为了在 灰度值较小时,尽可能的减少取整函数对灰度值的误差影响。
根据所述灰度值G计算所述网络教学视频源的灰度比较值和值H:
Figure PCTCN2018092775-appb-000003
其中,
Figure PCTCN2018092775-appb-000004
为所述网络教学视频源信号的灰度值均值,式中G k的变化范围为G 1到G n。因网络教学视频源信号帧图像中内容的变化必然引起图像的明暗度变化,也就是会改变图像的灰度值,计算所述网络教学视频源的灰度比较值和值,就可以统计出所述网络教学视频源信号帧图像中内容变化程度。
所述灰度比较值和值H用于表征所述教学视频源的动作频率,所述教学视频源的动作频率越大,所述网络教学视频源信号帧图像中内容变化程度就高,灰度比较值和值H也就越大,所以灰度比较值和值与教学视频源的动作频率是正相关的关系。
在步骤S130中,可以根据所述多个网络教学视频源的动作频率对网络教学视频源进行重要等级排序。
本示例实施方式中,由于在网络教学实际场景中,教学者的动作频率、板书或者课件的变动频率等的高低,直接反应的就是当前教学内容的重要程度,所以根据所述网络教学视频源的动作频率可以反应出网络教学视频源的重要等级,可以根据所述网络教学视频源的动作频率对网络教学视频源的重要等级排序。如图2A-2C分别为某网络教学内容对应的多个相关视频源的灰度比较值和值及重要等级排序。
本示例实施方式中,根据所述多个网络教学视频源的动作频率对网络教学视频源进行重要等级排序,包括:对所述网络教学视频源的平均灰度比较值和值进行排序。根据前述逻辑关系,所述网络教学视频源的平均灰度比较值和值与网络教学视频源的重要等级正相关。同时,还可以确定平均灰度比较值和值最大的网络教学视频源的重要等级最高。
本示例实施方式中,所述预设分析算法为自定义灰度阴影比较法。由于在前述方法中,根据不同的网络教学视频源场景信息,预设所述场景信 息对应的阴影值N,通过所述阴影值,可以用来排除场景背景光源对明暗度的影响,优化对不同帧图像的灰度阴影的比较,此预设分析算法为自定义灰度阴影比较法。
在步骤S140中,可以获取多个关联的终端显示设备的预设优先级与视频源重要等级排序的对应关系表项,根据所述对应关系表项,将所述各个网络教学视频源分别通过与各网络教学视频源重要等级排序对应优先级的终端显示设备显示。
本示例实施方式中,在通过预算算法获得所述网络教学视频源的重要等级排序后,根据多个关联的终端显示设备的预设优先级与视频源重要等级排序的对应关系表项,可以将对应重要等级的网络教学视频源在对应优先级的终端显示设备上显示,供用户观看学习。
本示例实施方式中,所述方法还包括:接收并保存用户预先设置的终端显示设备的预设优先级,所述终端显示设备可以是用于接收所述网络教学视频源的电视、PC显示器、手机、Pad等,折线终端显示设备由于大小、位置、场合不同,被用户单一或者同时使用在不同的场景,所以在不同的场景所述终端显示设备的优先级也不相同,在获取所述终端显示设备的预设优先级后,结合当前场景,建立所述预设优先级与视频源重要等级排序的对应关系表项。
本示例实施方式中,将所述各个网络教学视频源分别通过与各网络教学视频源重要等级排序对应优先级的终端显示设备显示,包括:将重要等级最高的视频源通过优先级最高的终端显示设备显示。在建立所述预设优先级与视频源重要等级排序的对应关系表项后,按照所述网络教学视频源的重要等级与终端显示设备的预设优先级对应,并将所述网络教学视频源在对应的终端显示设备上显示。
本示例实施方式中,所述方法还包括:在检测到教学视频源的重要等级变化,或者终端显示设备的优先级变化后,更新所述预设优先级与视频源重要等级排序的对应关系表项,如某教学场景中,当前重要等级最高的网络教学视频源为老师口头讲授教学,当老师口头讲授教学结束后,转而 教学投影仪幕布上投放的教学课件的内容,根据预设分析算法,会分析出多个网络教学视频源中课件教学的视频源变为重要等级最高的视频源,此时就会更新所述预设优先级与视频源重要等级排序的对应关系表项;又如用户在PC显示器上观看网络教学内容时,临时有事需要去其它房间,不方便继续在当前PC显示器上观看网络教学内容了,但是可以在便携式设备如Pad上观看网络教学内容,那么用户可以主动调整终端显示设备的优先级,将Pad的优先级调到最高优先级,并更新所述预设优先级与视频源重要等级排序的对应关系表项。
接收到所述预设优先级与视频源重要等级排序的对应关系表项的更新信息后,向优先级最高的终端显示设备发送设备切换提示信号,如图3A所示,为某网络教学场景时,用户的优先级最高的终端显示设备上接收到到的设备切换提示信号,用户若点击“是”,则发送确认切换终端显示设备的响应信号。
在接收到响应信号后,如果根据所述响应信号中携带的响应信息确定进行网络教学视频源的播放设备切换,根据更新后的预设优先级与视频源重要等级排序的对应关系表项进行多个网络教学视频源在对应终端显示设备的切换,如图3B为切换终端显示设备后的示意图。
本示例实施方式中,所述方法还包括:在检测到用户触发的终端显示设备切换指令后,获取所述终端显示设备切换指令中携带的教学视频源标识与待切换终端显示设备的对应信息;根据所述教学视频源标识与待切换终端显示设备的对应信息将对应的教学视频源通过所述待切换终端显示设备显示。当有多个网络教学视频源或多个终端显示设备,特别是有多个较繁琐的切换设备操作时,对网络教学视频源进行标识,可以有序快速的实现切换操作。
本示例实施方式中,所述方法还包括:记录并统计用户触发的终端显示设备切换指令中携带的教学视频源标识与待切换终端显示设备的对应信息,得到统计结果;根据统计结果更新所述预设优先级与视频源重要等级排序的对应关系表项。在一些网络教学场景中,会默认所有用户为相同的教学视频源标识与待切换终端显示设备的对应信息,当时由于实际教学中, 会有不同的用户的个人喜好,终端显示设备限制等因素,多次对默认的教学视频源标识与待切换终端显示设备的对应信息进行切换操作,记录并统计切换操作,当此切换操作数超过预设值时,则判断切换后的终端显示设备为当前用户的默认终端显示设备,进而可以更新所述预设优先级与视频源重要等级排序的对应关系表项。
本示例实施方式中,所述终端显示设备切换指令中携带的教学视频源标识与待切换终端显示设备的对应信息,包括:若所述终端显示设备切换指令中携带信息为多个教学视频源标识与一个待切换终端显示设备的对应信息;将对应的多个教学视频源通过所述一个待切换终端显示设备显示。如用户进行网络教学学习的场景有多个房间,每个房间均有终端显示设备,则用户可以设置每个终端显示设备都只接收重要等级最高的网络教学视频源信号,方便用户在多个房间走动时,也可以方便的观看所述网络教学视频源信号。
本示例实施方式中,所述终端显示设备切换指令中携带的教学视频源标识与待切换终端显示设备的对应信息,包括:若所述终端显示设备切换指令中携带信息为一个教学视频源标识与多个待切换终端显示设备的对应信息;将对应的一个教学视频源分别在所述多个待切换终端显示设备显示。如用户进行网络教学学习的场景为只有一个终端显示设备,此时用户既可以让所述终端显示设备显示重要等级最高的网络教学视频源信号,也可以设置接收重要等级排序靠前的预设数量的网络教学视频源信号在当前唯一的终端显示设备上同时显示。
本示例实施方式中,所述关联视频源数量与多个关联的终端显示设备数量相同。如用户进行网络教学学习的场景为有多个终端显示设备,且终端显示设备与所述网络教学视频源的数量相同,则可以将每个网络教学视频源分别在各个终端显示设备上显示,所述网络教学视频源的重要等级与所述终端显示设备的优先级对应。
需要说明的是,尽管在附图中以特定顺序描述了本公开中方法的各个步骤,但是,这并非要求或者暗示必须按照该特定顺序来执行这些步骤,或是必须执行全部所示的步骤才能实现期望的结果。附加的或备选的,可 以省略某些步骤,将多个步骤合并为一个步骤执行,以及/或者将一个步骤分解为多个步骤执行等。
此外,在本示例实施例中,还提供了一种多屏互动的网络教学装置。参照图4所示,该多屏互动的网络教学装置400可以包括:信号接收模块410、视频源分析模块420、等级排序模块430以及多屏显示模块440。其中:
信号接收模块410,用于接收多个网络教学视频源信号,所述多个网络教学视频源为关联视频源;
视频源分析模块420,用于按照预设分析算法对所述多个网络教学视频源进行分析,根据分析结果确定所述多个网络教学视频源的动作频率;
等级排序模块430,用于根据所述多个网络教学视频源的动作频率对网络教学视频源进行重要等级排序;
多屏显示模块440,用于获取多个关联的终端显示设备的预设优先级与视频源重要等级排序的对应关系表项,根据所述对应关系表项,将所述各个网络教学视频源分别通过与各网络教学视频源重要等级排序对应优先级的终端显示设备显示。
上述中各多屏互动的网络教学装置模块的具体细节已经在对应的音频段落识别方法中进行了详细的描述,因此此处不再赘述。
应当注意,尽管在上文详细描述中提及了多屏互动的网络教学装置400的若干模块或者单元,但是这种划分并非强制性的。实际上,根据本公开的实施方式,上文描述的两个或更多模块或者单元的特征和功能可以在一个模块或者单元中具体化。反之,上文描述的一个模块或者单元的特征和功能可以进一步划分为由多个模块或者单元来具体化。
此外,在本公开的示例性实施例中,还提供了一种能够实现上述方法的电子设备。
所属技术领域的技术人员能够理解,本发明的各个方面可以实现为***、方法或程序产品。因此,本发明的各个方面可以具体实现为以下形式, 即:完全的硬件实施例、完全的软件实施例(包括固件、微代码等),或硬件和软件方面结合的实施例,这里可以统称为“电路”、“模块”或“***”。
下面参照图5来描述根据本发明的这种实施例的电子设备500。图5显示的电子设备500仅仅是一个示例,不应对本发明实施例的功能和使用范围带来任何限制。
如图5所示,电子设备500以通用计算设备的形式表现。电子设备500的组件可以包括但不限于:上述至少一个处理单元510、上述至少一个存储单元520、连接不同***组件(包括存储单元520和处理单元510)的总线530、显示单元540。
其中,所述存储单元存储有程序代码,所述程序代码可以被所述处理单元510执行,使得所述处理单元510执行本说明书上述“示例性方法”部分中描述的根据本发明各种示例性实施例的步骤。例如,所述处理单元510可以执行如图1中所示的步骤S110至步骤S140。
存储单元520可以包括易失性存储单元形式的可读介质,例如随机存取存储单元(RAM)5201和/或高速缓存存储单元5202,还可以进一步包括只读存储单元(ROM)5203。
存储单元520还可以包括具有一组(至少一个)程序模块5205的程序/实用工具5204,这样的程序模块5205包括但不限于:操作***、一个或者多个应用程序、其它程序模块以及程序数据,这些示例中的每一个或某种组合中可能包括网络环境的实现。
总线530可以为表示几类总线结构中的一种或多种,包括存储单元总线或者存储单元控制器、***总线、图形加速端口、处理单元或者使用多种总线结构中的任意总线结构的局域总线。
电子设备500也可以与一个或多个外部设备570(例如键盘、指向设备、蓝牙设备等)通信,还可与一个或者多个使得用户能与该电子设备500交互的设备通信,和/或与使得该电子设备500能与一个或多个其它计算设备进行通信的任何设备(例如路由器、调制解调器等等)通信。这种通信可以通过输入/输出(I/O)接口550进行。并且,电子设备500还可以通 过网络适配器560与一个或者多个网络(例如局域网(LAN),广域网(WAN)和/或公共网络,例如因特网)通信。如图所示,网络适配器560通过总线530与电子设备500的其它模块通信。应当明白,尽管图中未示出,可以结合电子设备500使用其它硬件和/或软件模块,包括但不限于:微代码、设备驱动器、冗余处理单元、外部磁盘驱动阵列、RAID***、磁带驱动器以及数据备份存储***等。
通过以上的实施例的描述,本领域的技术人员易于理解,这里描述的示例实施例可以通过软件实现,也可以通过软件结合必要的硬件的方式来实现。因此,根据本公开实施例的技术方案可以以软件产品的形式体现出来,该软件产品可以存储在一个非易失性存储介质(可以是CD-ROM,U盘,移动硬盘等)中或网络上,包括若干指令以使得一台计算设备(可以是个人计算机、服务器、终端装置、或者网络设备等)执行根据本公开实施例的方法。
在本公开的示例性实施例中,还提供了一种计算机可读存储介质,其上存储有能够实现本说明书上述方法的程序产品。在一些可能的实施例中,本发明的各个方面还可以实现为一种程序产品的形式,其包括程序代码,当所述程序产品在终端设备上运行时,所述程序代码用于使所述终端设备执行本说明书上述“示例性方法”部分中描述的根据本发明各种示例性实施例的步骤。
参考图6所示,描述了根据本发明的实施例的用于实现上述方法的程序产品600,其可以采用便携式紧凑盘只读存储器(CD-ROM)并包括程序代码,并可以在终端设备,例如个人电脑上运行。然而,本发明的程序产品不限于此,在本文件中,可读存储介质可以是任何包含或存储程序的有形介质,该程序可以被指令执行***、装置或者器件使用或者与其结合使用。
所述程序产品可以采用一个或多个可读介质的任意组合。可读介质可以是可读信号介质或者可读存储介质。可读存储介质例如可以为但不限于电、磁、光、电磁、红外线、或半导体的***、装置或器件,或者任意以上的组合。可读存储介质的更具体的例子(非穷举的列表)包括:具有一个或多个导线的电连接、便携式盘、硬盘、随机存取存储器(RAM)、只读 存储器(ROM)、可擦式可编程只读存储器(EPROM或闪存)、光纤、便携式紧凑盘只读存储器(CD-ROM)、光存储器件、磁存储器件、或者上述的任意合适的组合。
计算机可读信号介质可以包括在基带中或者作为载波一部分传播的数据信号,其中承载了可读程序代码。这种传播的数据信号可以采用多种形式,包括但不限于电磁信号、光信号或上述的任意合适的组合。可读信号介质还可以是可读存储介质以外的任何可读介质,该可读介质可以发送、传播或者传输用于由指令执行***、装置或者器件使用或者与其结合使用的程序。
可读介质上包含的程序代码可以用任何适当的介质传输,包括但不限于无线、有线、光缆、RF等等,或者上述的任意合适的组合。
可以以一种或多种程序设计语言的任意组合来编写用于执行本发明操作的程序代码,所述程序设计语言包括面向对象的程序设计语言—诸如Java、C++等,还包括常规的过程式程序设计语言—诸如“C”语言或类似的程序设计语言。程序代码可以完全地在用户计算设备上执行、部分地在用户设备上执行、作为一个独立的软件包执行、部分在用户计算设备上部分在远程计算设备上执行、或者完全在远程计算设备或服务器上执行。在涉及远程计算设备的情形中,远程计算设备可以通过任意种类的网络,包括局域网(LAN)或广域网(WAN),连接到用户计算设备,或者,可以连接到外部计算设备(例如利用因特网服务提供商来通过因特网连接)。
此外,上述附图仅是根据本发明示例性实施例的方法所包括的处理的示意性说明,而不是限制目的。易于理解,上述附图所示的处理并不表明或限制这些处理的时间顺序。另外,也易于理解,这些处理可以是例如在多个模块中同步或异步执行的。
本领域技术人员在考虑说明书及实践这里公开的发明后,将容易想到本公开的其他实施例。本申请旨在涵盖本公开的任何变型、用途或者适应性变化,这些变型、用途或者适应性变化遵循本公开的一般性原理并包括本公开未公开的本技术领域中的公知常识或惯用技术手段。说明书和实施 例仅被视为示例性的,本公开的真正范围和精神由权利要求指出。
应当理解的是,本公开并不局限于上面已经描述并在附图中示出的精确结构,并且可以在不脱离其范围进行各种修改和改变。本公开的范围仅由所附的权利要求来限。
工业实用性
一方面,通过自定义灰度阴影比较法,快速的分析各网络教学视频源的动作频率,进而得到所述视频源的重要等级,且通过自定义了阴影值,一定程度上消除了教学场景的不同对视频源重要等级的识辨,是一种高效准确的网络教学视频源的重要等级识别算法;另一方面,通过对用户终端显示设备的优先级排序并与网络教学视频源的重要等级对应的方法,使用户可以实现对重要教学内容的持续跟踪,极大的增强了用户体验。

Claims (15)

  1. 一种多屏互动的网络教学方法,其特征在于,所述方法包括:
    接收多个网络教学视频源信号,所述多个网络教学视频源为关联视频源;
    按照预设分析算法对所述多个网络教学视频源进行分析,根据分析结果确定所述多个网络教学视频源的动作频率;
    根据所述多个网络教学视频源的动作频率对网络教学视频源进行重要等级排序;
    获取多个关联的终端显示设备的预设优先级与视频源重要等级排序的对应关系表项,根据所述对应关系表项,将所述各个网络教学视频源分别通过与各网络教学视频源重要等级排序对应优先级的终端显示设备显示。
  2. 如权利要求1所述的方法,其特征在于,按照预设分析算法对所述多个网络教学视频源进行分析,根据分析结果确定所述多个网络教学视频源的动作频率,包括:
    定时提取网络教学视频源信号中的帧图像,计算所述帧图像的灰度均值A,其中:A=(Red+Green+Blue)/3;
    获取所述网络教学视频源场景信息,根据所述场景信息预设阴影值N;
    根据自定义阴影值得出转换因子C:
    C=255/(N-1);
    根据所述灰度均值A以及转换因子C计算灰度值G,包括:
    G=Math.round((A/C)+0.5)*C
    其中,Math.round为取整函数;
    根据所述灰度值G计算所述网络教学视频源的灰度比较值和值H:
    Figure PCTCN2018092775-appb-100001
    其中,
    Figure PCTCN2018092775-appb-100002
    为所述网络教学视频源信号的灰度值均值;
    所述灰度比较值和值H用于表征所述教学视频源的动作频率。
  3. 如权利要求2所述的方法,其特征在于,根据所述多个网络教学视频源的动作频率对网络教学视频源进行重要等级排序,包括:
    对所述网络教学视频源的平均灰度比较值和值进行排序;
    确定平均灰度比较值和值最大的网络教学视频源的重要等级最高。
  4. 如权利要求1所述的方法,其特征在于,所述预设分析算法为自定义灰度阴影比较法。
  5. 如权利要求1所述的方法,其特征在于,所述方法还包括:
    接收并保存用户预先设置的终端显示设备的预设优先级;
    建立所述预设优先级与视频源重要等级排序的对应关系表项。
  6. 如权利要求1所述的方法,其特征在于,将所述各个网络教学视频源分别通过与各网络教学视频源重要等级排序对应优先级的终端显示设备显示,包括:
    将重要等级最高的视频源通过优先级最高的终端显示设备显示。
  7. 如权利要求1所述的方法,其特征在于,所述方法还包括:
    在检测到教学视频源的重要等级变化,或者终端显示设备的优先级变化后,更新所述预设优先级与视频源重要等级排序的对应关系表项;
    向优先级最高的终端显示设备发送设备切换提示信号;
    在接收到响应信号后,如果根据所述响应信号中携带的响应信息确定进行网络教学视频源的播放设备切换,根据更新后的预设优先级与视频源重要等级排序的对应关系表项进行多个网络教学视频源在对应终端显示设备的切换。
  8. 如权利要求1所述的方法,其特征在于,所述方法还包括:
    在检测到用户触发的终端显示设备切换指令后,获取所述终端显示设备切换指令中携带的教学视频源标识与待切换终端显示设备的对应信息;
    根据所述教学视频源标识与待切换终端显示设备的对应信息将对应的教学视频源通过所述待切换终端显示设备显示。
  9. 如权利要求8所述的方法,其特征在于,所述方法还包括:
    记录并统计用户触发的终端显示设备切换指令中携带的教学视频源标识与待切换终端显示设备的对应信息,得到统计结果;
    根据统计结果更新所述预设优先级与视频源重要等级排序的对应关系表项。
  10. 如权利要求8所述的方法,其特征在于,所述终端显示设备切换指令中携带的教学视频源标识与待切换终端显示设备的对应信息,包括:
    若所述终端显示设备切换指令中携带信息为多个教学视频源标识与一个待切换终端显示设备的对应信息;
    将对应的多个教学视频源通过所述一个待切换终端显示设备显示。
  11. 如权利要求8所述的方法,其特征在于,所述终端显示设备切换指令中携带的教学视频源标识与待切换终端显示设备的对应信息,包括:
    若所述终端显示设备切换指令中携带信息为一个教学视频源标识与多个待切换终端显示设备的对应信息;
    将对应的一个教学视频源分别在所述多个待切换终端显示设备显示。
  12. 如权利要求1所述的方法,其特征在于,所述关联视频源数量与多个关联的终端显示设备数量相同。
  13. 一种多屏互动的网络教学装置,其特征在于,所述装置包括:
    信号接收模块,用于接收多个网络教学视频源信号,所述多个网络教学视频源为关联视频源;
    视频源分析模块,用于按照预设分析算法对所述多个网络教学视频源进行分析,根据分析结果确定所述多个网络教学视频源的动作频率;
    等级排序模块,用于根据所述多个网络教学视频源的动作频率对网络教学视频源进行重要等级排序;
    多屏显示模块,用于获取多个关联的终端显示设备的预设优先级与视频源重要等级排序的对应关系表项,根据所述对应关系表项,将所述各个网络 教学视频源分别通过与各网络教学视频源重要等级排序对应优先级的终端显示设备显示。
  14. 一种电子设备,其特征在于,包括:
    处理器;以及
    存储器,所述存储器上存储有计算机可读指令,所述计算机可读指令被所述处理器执行时实现根据权利要求1至12中任一项所述的方法。
  15. 一种计算机可读存储介质,其上存储有计算机程序,所述计算机程序被处理器执行时实现根据权利要求1至12中任一项所述方法。
PCT/CN2018/092775 2018-04-09 2018-06-26 多屏互动的网络教学方法以及装置 WO2019196204A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US16/467,475 US11398207B2 (en) 2018-04-09 2018-06-26 Multi-screen interactive network teaching method and apparatus

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201810308947.7 2018-04-09
CN201810308947.7A CN108549859B (zh) 2018-04-09 2018-04-09 多屏互动的网络教学方法以及装置

Publications (1)

Publication Number Publication Date
WO2019196204A1 true WO2019196204A1 (zh) 2019-10-17

Family

ID=63514405

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/092775 WO2019196204A1 (zh) 2018-04-09 2018-06-26 多屏互动的网络教学方法以及装置

Country Status (3)

Country Link
US (1) US11398207B2 (zh)
CN (1) CN108549859B (zh)
WO (1) WO2019196204A1 (zh)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110276998A (zh) * 2019-07-02 2019-09-24 武汉慧通云信息科技有限公司 一种多屏互动的网络教学方法
CN110392308A (zh) * 2019-07-08 2019-10-29 深圳市轱辘汽车维修技术有限公司 一种视频推荐方法、视频推荐装置及服务器
CN113409093A (zh) * 2021-07-13 2021-09-17 神策网络科技(北京)有限公司 一种指标关联性分析方法
CN115565479A (zh) * 2022-09-20 2023-01-03 杭州海康慧影科技有限公司 一种多显示屏图像显示方法、装置及存储介质

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101021859A (zh) * 2006-02-13 2007-08-22 国际商业机器公司 控制窗口显示的***及其方法
CN103150134A (zh) * 2013-03-26 2013-06-12 深圳市杰和科技发展有限公司 一种多屏幕显示切换***及方法
CN105094737A (zh) * 2015-08-07 2015-11-25 北京橙鑫数据科技有限公司 多媒体信息显示方法及装置
US9448756B2 (en) * 2007-12-31 2016-09-20 Invention Science Fund I, Llc Managing obstructed views of multiple display surfaces
CN107371029A (zh) * 2017-06-28 2017-11-21 上海大学 基于内容的视频包优先级分配方法

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101060618A (zh) * 2006-04-21 2007-10-24 孟智平 智能电视墙监控***及其存储***
US8435038B2 (en) * 2006-10-17 2013-05-07 Apollo Finance, Llc Methods and systems for teaching a practical skill to learners at geographically separate locations
CN102360503B (zh) * 2011-10-09 2013-04-03 西安电子科技大学 基于空间贴近度和像素相似性的sar图像变化检测方法
JP2013207769A (ja) * 2012-03-29 2013-10-07 Toshiba Corp 映像処理装置及び映像処理方法
CN103826121B (zh) * 2013-12-20 2017-05-10 电子科技大学 低延迟视频编码基于场景切换检测的码率控制方法
CN105872813A (zh) * 2015-12-10 2016-08-17 乐视网信息技术(北京)股份有限公司 热点视频展示方法及装置
CN106937114B (zh) * 2015-12-30 2020-09-25 株式会社日立制作所 用于对视频场景切换进行检测的方法和装置
US9996310B1 (en) * 2016-09-15 2018-06-12 Amazon Technologies, Inc. Content prioritization for a display array
US20200090536A1 (en) * 2018-08-25 2020-03-19 Actiontec Electronics, Inc. Classroom assistance system
AU2019367831B2 (en) * 2018-09-04 2021-04-08 DraftKings, Inc. Systems and methods for dynamically adjusting display content and parameters on a display device

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101021859A (zh) * 2006-02-13 2007-08-22 国际商业机器公司 控制窗口显示的***及其方法
US9448756B2 (en) * 2007-12-31 2016-09-20 Invention Science Fund I, Llc Managing obstructed views of multiple display surfaces
CN103150134A (zh) * 2013-03-26 2013-06-12 深圳市杰和科技发展有限公司 一种多屏幕显示切换***及方法
CN105094737A (zh) * 2015-08-07 2015-11-25 北京橙鑫数据科技有限公司 多媒体信息显示方法及装置
CN107371029A (zh) * 2017-06-28 2017-11-21 上海大学 基于内容的视频包优先级分配方法

Also Published As

Publication number Publication date
US20210407462A1 (en) 2021-12-30
CN108549859B (zh) 2021-04-06
US11398207B2 (en) 2022-07-26
CN108549859A (zh) 2018-09-18

Similar Documents

Publication Publication Date Title
WO2019196204A1 (zh) 多屏互动的网络教学方法以及装置
CN109783178B (zh) 一种界面组件的颜色调整方法、装置、设备和介质
WO2019237657A1 (zh) 用于生成模型的方法和装置
JP4482348B2 (ja) リアルタイムホワイトボードストリーミングのためのシステムおよび方法
US9661208B1 (en) Enhancing video conferences
US11483574B2 (en) Systems and methods for emotion and perception based video compression and video perception enhancement
US10237324B1 (en) System and method for web conferencing presentation pre-staging
CN112822529A (zh) 电子设备及其控制方法
WO2022001027A1 (zh) 网络教学中投屏画面自适应的方法以及装置
CN108665769B (zh) 基于卷积神经网络的网络教学方法以及装置
US10497396B2 (en) Detecting and correcting whiteboard images while enabling the removal of the speaker
US9432617B2 (en) White balance adjustment of an image at an information handling system
US20210209562A1 (en) Analytics and Device Management Platform for Human Interaction
CN111161592B (zh) 课堂监督方法和督课终端
US10534973B2 (en) Methods, systems, and media for color palette extraction for video content items
US9813748B2 (en) Coordination of video and/or audio recording
US20230370565A1 (en) Visual image management
US11756302B1 (en) Managing presentation of subject-based segmented video feed on a receiving device
US9992407B2 (en) Image context based camera configuration
WO2021226821A1 (en) Systems and methods for detection and display of whiteboard text and/or an active speaker
US10373290B2 (en) Zoomable digital images
US11589006B1 (en) Dynamic camera presets
WO2022246653A1 (zh) 一种图像处理***、云服务端及方法
US20220391044A1 (en) Dynamic presentation adjustment
CN118212305A (zh) 颜色确定方法、装置、介质和计算设备

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18914498

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18914498

Country of ref document: EP

Kind code of ref document: A1