CN1787036A - System for multi media real-time synchronous teaching based on network - Google Patents
System for multi media real-time synchronous teaching based on network Download PDFInfo
- Publication number
- CN1787036A CN1787036A CN 200510031052 CN200510031052A CN1787036A CN 1787036 A CN1787036 A CN 1787036A CN 200510031052 CN200510031052 CN 200510031052 CN 200510031052 A CN200510031052 A CN 200510031052A CN 1787036 A CN1787036 A CN 1787036A
- Authority
- CN
- China
- Prior art keywords
- audio
- video
- synchronous
- data
- time
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Landscapes
- Electrically Operated Instructional Devices (AREA)
Abstract
The invention is a network-based multimedia synchronous teaching system in the field of network technique, comprising: audio/video collecting tool, electronic document collecting tool, synchronous teaching support platform, and synchronous courseware browsing tool, where the audio/video collecting tool takes charge of collecting and compressing audio/video signals in the schoolteaching field and transmitting the compressed audio/video signals to the synchronous teaching support platform; the electronic document collecting tool takes charge of real-time collecting on-screen schoolteaching data of a teacher and compresses them into web pictures and transmitting the web picture to the synchronous teaching support platform; the synchronous teaching support platform receives the compressed and packet audio/video schoolteaching field data and receives the on-screen schoolteaching data, and synchronously organizes audio data, video data and on-screen data and after fluidizing, provides living broadcast service for the synchronous courseware browsing tool and provides programme ordering service. The invention achieves the characters of powerful functions, high efficiency and short cut, simple and convenient operation, friendly man-machine interface, etc.
Description
Technical field
The present invention relates to a kind of system of networking technology area, specifically is the real-time sync instruction of a kind of based on network multiple medium system.
Background technology
In in the past 5 years, the software market of the Web education of China is always to surpass 40% growth rate in rapid expansion.But the Web education present situation of China also has sizable gap apart from world developed country level, and the Web education of China still has huge growth potential.Make a general survey of the product in domestic and international Web education field, most network multimedia technology platforms that all are based on the Windows operating system and the external copyright of Microsoft.Support energetically in country under the overall background of homemade operating system and various corresponding supporting application systems that research and development are of great importance based on the Web education platform tool of homemade Linux.The Linux platform has and has the not available advantage of other platforms, characteristics such as, easy care low as open source code, customizable expansion, cost, and the user that significant proportion has been arranged at present is at the platform software that uses based on Linux.On the whole, research and development Linux multimedia net work teaching software kit has profound significance, has a extensive future, and especially in western part, has incomparable advantage.Especially at the real-time sync instruction of network multimedia system,, all be on Windows and external main current flow media platform, to move, lack the platform and the product of independent intellectual property right from present home market.
Find through literature search prior art, Chinese patent (application) number: CN02139372.9, title: based on the multimedia of the IP network system of giving lessons in real time, multimedia interactive and the writing on the blackboard of teacher's nature were given lessons during this system can support to impart knowledge to students in real time, have intuitive and convenient, multi-mode, the collaborative communication function of extendible teachers and students, adopt many granularities, shifty class management mechanism, and have that multimedia classroom real-time recording, streaming media courseware generate automatically, function such as courseware resource retrieval and Content Management.The advantage of this system is to support fairly large giving lessons in real time, and interactivity is stronger, and its deficiency is to depend on hardware MCU significantly, from gathering, be distributed to broadcast mainly based on the steaming media platform of Windows and external main flow.
Summary of the invention
The present invention is directed to the deficiencies in the prior art, the real-time sync instruction of a kind of based on network multiple medium system is provided, make it be used on homemade Linux platform, implementing multiple media sync teaching and later stage courseware VOD in real time.The present invention uses the MPEG4IP kit of open source code to develop on homemade Linux platform, realized real-time collection compression audio, video data, and with the teachers' instruction desktop data seamless connection of real-time collection, carry out live synchronously by IP network, the student receives direct broadcast service by courseware browser access stream media server on the linuxn client platform, system supports automatic recording and issue courseware simultaneously, immediately program request and later stage compilation after live, finally reach real-time teaching of independent intellectual property right and the courseware recording system on the homemade operating system and the MPEG4 stream media technology support of increasing income fully, broken away from this field product always in the restriction of windows platform and external property right stream media system exploitation and operation, guaranteed opening simultaneously with their system compatibles.
The present invention is achieved by the following technical solutions, the present invention includes: audio-video collection instrument, electronic document sampling instrument, sync instruction supporting platform, synchronous courseware browser.The audio-video collection instrument is responsible for gathering the audio-video signal at the compression scene of giving lessons, and sends to the sync instruction supporting platform; The electronic document sampling instrument is responsible for gathering in real time the on-screen data of teachers' instruction, is compressed into the Web picture and sends to the sync instruction supporting platform; The sync instruction supporting platform receives the audio-video collection instrument and gathers the audio frequency and video of the compressed package sent field data of giving lessons, receive the teachers' instruction on-screen data that the electronic document sampling instrument is gathered simultaneously, carry out the synchronous tissue of audio, video data and three kinds of medium of on-screen data, carry out carrying out direct broadcast service to synchronous courseware browser after the fluidisation, and order program service is provided.
Described audio-video collection instrument, behind the audio-video signal by the camera picked-up scene of giving lessons, utilizing Video4linux2 to drive detection automatically and drive video frequency collection card gathers, audio frequency and video are compressed into the mpeg4 form, mp4live among the employing MPEG4IP of system is sent to the Darwin streaming media server (DSS) in the sync instruction supporting platform in real time, audio frequency and video adopt the clean culture Real-time Transport Protocol to the transmission of DSS, the present invention has designed timed sending time and has stabbed stream (text flow) mode, in the RTP packing process, constantly add and timed sending time stamp stream (text flow), be used for the real-time same step calibration of audio, video data and three kinds of medium of on-screen data in the live process.Need to carry out the courseware audio-video frequency content in real time in the live process simultaneously and record, after live finishing, the audio frequency and video MP4 file of recording is uploaded to the ftp server of sync instruction supporting platform by FTP.
Described electronic document sampling instrument runs on the teachers' instruction machine.The electronic document sampling instrument adopts Socket mode and the communication of audio-video collection instrument when starting, carry out time calibration and server setting, the Ksnapshot screen interception plug-in unit that adopts QT4.0 to carry then carries out the on-screen data collection, be compressed into Web picture formats such as PNG, JPG, adopt the FTP connected mode to upload on-screen data in real time.In order to realize the synchronous Presentation Function of audio, video data and teacher computer on-screen data, system carries out tackling problems in key technologies, added and be used for the synthetic time script flow of multiple media sync together, script flow adopts XML normative document descriptor format, the relevant information of three kinds of media sync relations of record tone video and screenshotss.
Described sync instruction supporting platform is by Darwin streaming media server (Darwin StreamingServer, DSS) and Apache Web server and ftp server form, DSS is responsible for receiving the RTP audio/video flow that the audio-video collection instrument sends in real time with mode of unicast, is distributed to the synchronous courseware browser of client continuously with the packing of RTSP form afterwards and carries out live play.After live finishing, the audio-video collection instrument is recorded and cut apart packing according to the RTSP/RTP standard by the mp4 that FTP uploads, form the files in stream media of standard, become among the DSS courseware resource for program request.Apache Web server reading displayed is live visits for the learner with the program request tabulation, teachers' instruction screen shots that collection is uploaded to the electronic document sampling instrument and live program request synchronous documents manage simultaneously, and the Apache Web server is intercepted the synchronous courseware browser of acceptance and adopted Http Get mode to obtain synchronous documents and screen shots file from it.The ftp server that is arranged on the Apache receives teachers' instruction screen shots that the electronic document sampling instrument gathers in real time and description document synchronously in live process in the FTP mode, is positioned at ftp server on the DSS and receives the audio-video collection instrument in the FTP mode upload mp4 audio frequency and video courseware after live ends after live.
Described synchronous courseware browser moves at student terminal, and its major function is that the student passes through its to receive teaching in real time live, also can the program request courseware.This instrument adopts gmp4player to carry out the decoding and the broadcast of audio, video data; Adopt Http Get mode to obtain the synchronized multimedia description document simultaneously from server, simultaneously synchronous documents is resolved, corresponding relation according to each time point audio frequency and video and teacher's on-screen data in the synchronous documents, the same Http Get mode that adopts is obtained teacher's screenshot capture data of corresponding time point in real time from Web server, plays with the audio frequency and video data sync of giving lessons in the screen shots display box.
The present invention is based on homemade Linux platform, the Linux platform has and has the not available advantage of other platforms, characteristics such as, easy care low as open source code, customizable expansion, cost, there is not big obstacle at the platform software that uses based on Linux in the user that significant proportion has been arranged at present and promote yet in high-level user.For this reason, operating system of the present invention has been selected the red flag Linux and the general magnificent Linux of acceptance of the bid of domestic main flow for use, all adopts homemade Linux from the server end to the client.
The present invention is based on increase income MPEG4IP and Darwin, powerful: MPEG4IP realizes as a kind of typical C/S model, can be divided into server end mp4live and client mp4player/gmp4player (gui version of mp4player) from functional role.MPEG4IP mp4live is used for going up the encoding multimedia data that obtains in real time by Video4Linux from audio-video collection equipment (as camera, microphone etc.), and to become the video format of needs be that MPEG4, audio format are the live data streams of AAC/MP3 and carry out Network Transmission by Real-time Transport Protocol.For guarantee the user can be before having access in the future live media data in real time, must live data be preserved and issue once more with the form of program request in future.The present invention has increased one deck design again in the middle of the C/S of script MPEG4IP model, used the Darwin streaming media server (DSS) of increasing income of Apple to carry out the transfer of live data and the storage of mp4 file, no matter do like this can so that be live or program request, and client mp4player/gmp4player can obtain required media data from the Darwin server.Again live data unloading is in real time become the media file of mp4 form when for this reason, mp4live carries out network direct broadcasting.Therefore, the live data that mp4live produces not is directly to be received by client mp4player/gmp4player, but earlier be transferred to the Darwin streaming media server in the mode of clean culture RTP, use the RTSP agreement to be relayed to each client by this server in the mode of broadcast or multicast again, and the mp4 file that is used for program request in the future that produces immediately after the live end of mp4live promptly is uploaded to the Darwin server by the mode of FTP.
Mp4live carry out audio frequency and video live in, the screenshotss data that comprise the teachers' instruction content also must be gathered and synchronous transmission simultaneously with above audio, video data.The mechanism of synchronous transmission is to rely on Socket between audio-video collection main frame (operation mp4live) and the screenshotss data collection host to communicate by letter to guarantee.The Ksnapshot screen interception plug-in unit that the QT4.0 that the screenshotss data are installed on by teacher computer when teachers' instruction carries is gathered, and the image file that is converted into the JPEG form in real time transmits.In like manner, the screenshotss data are not directly to transfer to client mp4player/gmp4player yet, but the WEB/FTP mix server in the middle of being uploaded to earlier preserves, again by client mp4player/gmp4player according to current live/the progress situation of program request downloads and shows from server sync.
The courseware browser is used for final media playback synchronously, comprises from the MPEG4+AAC/MP3 stream of Darwin server reception and the screenshotss data of downloading from the WEB/FTP mix server, thereby realizes live/program request function of browse.
The present invention's middle pitch Video service of imparting knowledge to students in real time has preferably QoS and ensures.At present the audio frequency of looking of system adopts the MPEG4 coding, reach the 40M-120M/ road/hour, be 1/10 of the MPEG1 of homogenous quantities or MJPEG courseware; Support every 100ms to send corresponding time flow data, guarantee that synchronism deviation is within 100ms～500ms; Support is provided with indexs such as audio, video data compressed format, size, code streams; Support the live SDP file that begins to upload, upload the MP4 file during live end; At present the bandwidth that takies when Network Transmission of the courseware of system stream is 1/10 of the MPEG1 of homogenous quantities and MJEPG; On the bandwidth of 256-512Kbps, image all reaches CIF (352X288), in real time (25 frame/second) effect.System is lower to the transmission requirement of present teaching network, and it is little influenced by transmission error code and packet loss, only has slight edge fog when the network bit error rate reaches 1%; When Network Transmission has moment during the packet loss phenomenon, only need 1-3 to recover second.
The present invention has realized the real time calibration technology of multiple media sync in the real-time teaching.The collection terminal of teacher computer on-screen data moves under background mode fully, do not influencing under the teachers' instruction process prerequisite, can undertaken live by network real-time ground the bishop chamber teacher computer on-screen data of giving lessons (comprising lantern slide, OFFICE document, electronic whiteboard writing on the blackboard, computer desktop etc.) information; In order to realize the synchronous Presentation Function of audio, video data and teacher computer on-screen data, system carries out tackling problems in key technologies, added and be used for the synthetic time script flow of multiple media sync together, because system has realized real time calibration, can effectively prevent shake and drift, synchronous error＜0.5 of the audio frequency and video that obtain after the performance test and teacher's on-screen data second.Support of the present invention is provided with 30% ~ 100% to the quality of on-screen data compression; Support data acquisition, compression, the last transfer performance of per second 1 frame to per second 3 frames; Adopt the xml normative document to describe synchronous documents, describe the information in audio, video data source and on-screen data source; Support regularly to generate synchronous documents syn.xml, prevent the data degradation that fortuitous event causes; Support the operation of no interface or can be arranged to background mode; The realization of the synchronous courseware browser of Linux student terminal adopts gmp4player to carry out the decoding and the broadcast of audio, video data; Adopt Http Get mode to obtain synchrodata information (livingsyn.xml or syn.xml) and on-screen data from server; Adopt the double buffering technology display screen data, prevent to dodge the screen phenomenon; Adopt among the Mozilla corresponding insert is installed, activate local client browser.
System of the present invention does not have a lot of requirements to linuxn client, only needs to install synchronous courseware browser.The Mozilla browser that the student carries by linux system enters in the Web learning portal, on courseware study interface, check live tabulation or program request tabulation, select corresponding live or program request courseware item, in order to strengthen user's experience, allow the user with the same at windows platform, can in browser, directly activate the synchronized multimedia display interface, we use the XPCOM technology to carry out secondary development, Javascript and XUL (extending user interface languages) application program are combined, realization is surveyed the broadcast tool path automatically by browser, calls the function of broadcast instrument.
Compatibility of the present invention is good.Though (SuSE) Linux OS has increasing user, but Windows still has most desktop user, for this reason, when supporting from the client to the server end, all to be Linux, can support client operation windows platform based on the real-time sync instruction of the multiple medium system of homemade Linux.Because courseware has used the standard XML form to describe synchronous documents synchronously, and the video described in the synchronous documents, audio frequency, on-screen data all adopt the MPEG and the jpeg format compression of standard, so just can learn the courseware that generates on the interface program request Linux platform by Web as long as window client courseware browser by analyzing XML, uses simultaneously as MediaPlayer/Real Player player plug-in unit.The compatibility of simultaneity factor also is embodied in server end, because on windows platform, itself accumulated abundant courseware resource, if one has the Linux platform that the school that enriches Windows courseware resource uses the present invention's operation, system supports Windows to go up the transplanting of the media resource of extensively accumulation to Linux, comprise of media conversion and the format of the peculiar media formatss of Windows such as WMV, WMA, MS Office, also reached good compatibility at server end like this to Linux.
The present invention tries out, on probation stable, operation result shows, native system can be stablized collection and live teacher's the scene of giving lessons in real time for a long time, client receives live or order program data has reached good real-time performance and synchronous effect, synchronous error was per hour recorded courseware less than 200MB less than 0.5 second.System has realized powerful, efficient quick, simple to operate, and characteristics such as man-machine interface friendliness, Web-based instruction teachers and students are quite satisfied with to the overall result of use of system.
Description of drawings
Fig. 1 system architecture synoptic diagram of the present invention
Embodiment
As shown in Figure 1, the present invention includes: audio-video collection instrument, electronic document sampling instrument, sync instruction supporting platform, synchronous courseware browser.The audio-video collection instrument is responsible for gathering the audio-video signal at the compression scene of giving lessons, and sends to the sync instruction supporting platform.The electronic document sampling instrument is responsible for gathering in real time the on-screen data of teachers' instruction, is compressed into the Web picture and sends to the sync instruction supporting platform.The sync instruction supporting platform receives audio frequency and video scene of giving lessons and teachers' instruction on-screen data, carries out the synchronous tissue of audio, video data and three kinds of medium of on-screen data, carries out carrying out direct broadcast service to synchronous courseware browser after the fluidisation, and order program service is provided.
The hardware of audio-video collection instrument comprises video frequency collection card, audio-video collection PC, camera, microphone.After the on-the-spot audio-video signal of giving lessons is absorbed by camera, gather by automatic detection of Video4linux2 driving and driving video frequency collection card, video compress adopts the ffmpeg among the MPEG4IP, after audio frequency is obtained by microphone, drive the sound card audio frequency acquiring, the faac among the MPEG4IP is adopted in audio compression, be compressed into the mpeg4 form, mp4live among the employing MPEG4IP of system is sent to the Darwin streaming media server (DSS) in the sync instruction supporting platform in real time, audio frequency and video adopt the clean culture Real-time Transport Protocol to the transmission of DSS, and the audio-visual synchronization among the RTP has adopted absolute time to stab method.The present invention has developed timed sending time and has stabbed stream (text flow) mode, constantly adds and timed sending time stamp stream (text flow) in the RTP packing process, is used for the real-time same step calibration of audio, video data and three kinds of medium of on-screen data in the live process.Need to carry out the courseware audio-video frequency content in real time in the live process simultaneously and record, after live finishing, the audio frequency and video MP4 file of recording is uploaded to the ftp server of sync instruction supporting platform by FTP.
The electronic document sampling instrument runs on the teachers' instruction machine, the electronic document sampling instrument adopts Socket mode and the communication of audio-video collection instrument when starting, carry out time calibration and server setting, the Ksnapshot screen interception plug-in unit that adopts QT4.0 to carry then carries out the on-screen data collection, be compressed into Web picture formats such as PNG, JPG, adopt the FTP connected mode to upload on-screen data in real time.In order to realize the synchronous Presentation Function of audio, video data and teacher computer on-screen data, system carries out tackling problems in key technologies, added and be used for the synthetic time script flow of multiple media sync together, script flow adopts XML normative document descriptor format, the relevant information of three kinds of media sync relations of record tone video and screenshotss, livingsyn.xml is live synchronous service (only preserving live 300 last frame data synchronizing informations), syn.xml is program request synchronous service (preserving whole screenshotss data synchronization information), and source.xml is courseware editing service (writing down the data message that all can be edited).
The sync instruction supporting platform is made up of Darwin streaming media server (DSS) and Apache Web server and ftp server.DSS is responsible for receiving the RTP audio/video flow that the audio-video collection instrument sends in real time with mode of unicast, is distributed to the synchronous courseware browser of client continuously with the packing of RTSP form afterwards and carries out live play.After live finishing, the audio-video collection instrument is recorded and cut apart packing according to the RTSP/RTP standard by the mp4 that FTP uploads, form the files in stream media of standard, become among the DSS courseware resource for program request.The Apache Web server reads live and program request tabulation learner visit, teachers' instruction screen shots that collection is uploaded to the electronic document sampling instrument and live program request synchronous documents (livingsyn.xml or syn.xml) manage simultaneously, the Apache Web server is intercepted at 80 ports, accepts synchronous courseware browser and adopts Http Get mode to obtain synchronous documents and screen shots file from it.The ftp server that is arranged on the Apache receives teachers' instruction screen shots that the electronic document sampling instrument gathers in real time and description document synchronously in live process in the FTP mode, is positioned at ftp server on the DSS and receives the audio-video collection instrument in the FTP mode upload mp4 audio frequency and video courseware after live ends after live.
The courseware browser moves at student terminal synchronously, adopts gmp4player to carry out the decoding and the broadcast of audio, video data; Adopt Http Get mode to obtain synchronized multimedia description document (livingsyn.xml or syn.xml) simultaneously from server, simultaneously synchronous documents is resolved, corresponding relation according to each time point audio frequency and video and teacher's on-screen data in the synchronous documents, the same Http Get mode that adopts is obtained teacher's screenshot capture data of corresponding time point in real time from Web server, plays with the audio frequency and video data sync of giving lessons in the screen shots display box.The broadcast of screenshot capture adopts the double buffering mode to show, has overcome to dodge the screen phenomenon.
Instantiation is as follows:
This example comprises: the audio-video collection machine of audio-video collection instrument operation; The teachers' instruction machine of electronic document sampling instrument operation; The sync instruction supporting platform comprises Darwin streaming media server DSS (and having disposed ftp server), Apache Web server and ftp server, the student terminal machine of courseware browser operation synchronously.The processing procedure of data stream is divided into parallel expansion and two staggered to some extent flow processs, i.e. following steps 1---6 and step 1 '---5 ', wherein step 5 and step 5 ' staggered carrying out.
Step 1---6 is described below:
1: the seizure of the audio-video signal on the audio-video collection machine is adopted the Video4linux2 driver to survey automatically and is driven video frequency collection card and gathers video data, and YUYV (YUV2) formatted data is converted to the exportable static images of RGB, drive by the sound card audio frequency acquiring with OSS, SDL storehouse realization video is dynamically exported.
2: system adopts mp4live to carry out the audio frequency and video compression, is compressed into mpeg4 form (the video coding adopts ffmpeg, and audio coding adopts faac).
3: the audio, video data of gathering the compression scene of giving lessons, send to Darwin streaming media server (Darwin Streaming Server when live, DSS), Real-time Transport Protocol is adopted in the transmission of audio/video flow from the harvester to DSS, and the audio-visual synchronization among the RTP has adopted absolute time to stab method.On harvester, carry out simultaneously constantly adding in the RTP packing process and timed sending time is stabbed and flowed (text flow), be used for audio, video data in the live process and on-screen data is synchronous.
4: in live process, audio/video flow is play being distributed to the synchronous courseware browser of student terminal continuously after by RTSP on the DSS platform.
The synchronous courseware browser of 5:Linux student terminal adopts the gmp4player that increases income to carry out the decodes and plays of audio, video data, carry out flow process 5 ' simultaneously, after the synchronous documents parsing, adopt Http Get mode to obtain synchronous teacher's on-screen data in real time, with the sound screen audio, video data synchronous playing of giving lessons from Web server.
6: need to carry out in real time courseware recording in the live process simultaneously, after live finishing, upload, can carry out the streaming program request in order to make the courseware of recording by FTP, must be earlier with its fluidisation.According to the RTSP/RTP standard mp4 that uploads is cut apart packing, form files in stream media, become DSS program request courseware resource.
Step 1 '---5 ' is described below:
1 ': the electronic document sampling instrument runs on the teachers' instruction machine, adopts Socket mode and the communication of audio-video collection machine, carries out time calibration, the server parameter setting.
2 ': adopt Ksnapshot to carry out the collection of teacher's on-screen data, be compressed into Web picture formats such as png, jpg.
3 ': adopt the ftp connected mode to go up pulpiteer's screenshotss Web image data in real time and arrive ftp server with the Apache one.
4 ': in order to realize the synchronous Presentation Function of audio, video data and teacher computer on-screen data, system carries out tackling problems in key technologies, added and be used for the synthetic time script flow of multiple media sync together, system adopts XML normative document descriptor format, record tone video and on-screen data synchronized relation descriptor, livingsyn.xml is live synchronous service, in live process, bring in constant renewal in and send, but only preserve live 300 last frame data, syn.xml is the program request synchronous service, in live process, constantly generate and send, it has preserved whole audio frequency and video and screenshotss data synchronization information till the live end, and source.xml is courseware editing service (writing down the data message that all can be edited).
5 ': the synchronous courseware browser of Linux student terminal is when carrying out flow process 5 (adopting gmp4player to carry out the decoding and the broadcast of audio, video data), adopt Http Get mode to obtain synchrodata information (livingsyn.xml or syn.xml) from server, simultaneously synchronous documents is resolved, corresponding relation according to each time point audio frequency and video and teacher's on-screen data in the synchronous documents, the same Http Get mode that adopts is obtained teacher's on-screen data in real time from Web server, plays with the audio frequency and video data sync of giving lessons in the screen shots display box.
Claims (8)
1, the real-time sync instruction of a kind of based on network multiple medium system, comprise: audio-video collection instrument, electronic document sampling instrument, sync instruction supporting platform, synchronous courseware browser, it is characterized in that, the audio-video collection instrument is responsible for gathering the audio-video signal at the compression scene of giving lessons, and sends to the sync instruction supporting platform; The electronic document sampling instrument is responsible for gathering in real time the on-screen data of teachers' instruction, is compressed into the Web picture and sends to the sync instruction supporting platform; The sync instruction supporting platform receives the audio-video collection instrument and gathers the audio frequency and video of the compressed package sent field data of giving lessons, receive the teachers' instruction on-screen data that the electronic document sampling instrument is gathered simultaneously, carry out the synchronous tissue of audio, video data and three kinds of medium of on-screen data, carry out carrying out direct broadcast service to synchronous courseware browser after the fluidisation, and order program service is provided.
2, the real-time sync instruction of based on network multiple medium according to claim 1 system, it is characterized in that, described audio-video collection instrument, behind the audio-video signal by the camera picked-up scene of giving lessons, utilizing Video4linux2 to drive detection automatically and drive video frequency collection card gathers, audio frequency and video are compressed into the mpeg4 form, mp4live among the employing MPEG4IP of system is sent to the Darwin streaming media server in the sync instruction supporting platform in real time, and audio frequency and video adopt the clean culture Real-time Transport Protocol to the transmission of DSS.
3, according to claim 1 or the real-time sync instruction of 2 described based on network multiple medium system, it is characterized in that, the audio-video signal of audio-video collection instrument collection sends to the sync instruction supporting platform, adopt timed sending time to stab the stream mode, in the RTP packing process, constantly add and timed sending time stamp stream, the real-time same step calibration that is used for audio, video data and three kinds of medium of on-screen data in the live process, needing to carry out the courseware audio-video frequency content in real time in the live process simultaneously records, after live finishing, the audio frequency and video MP4 file of recording is uploaded to the ftp server of sync instruction supporting platform by FTP.
4, the real-time sync instruction of based on network multiple medium according to claim 1 system, it is characterized in that, described electronic document sampling instrument runs on the teachers' instruction machine, the electronic document sampling instrument adopts Socket mode and the communication of audio-video collection instrument when starting, carry out time calibration and server setting, the Ksnapshot screen interception plug-in unit that adopts QT4.0 to carry then carries out the on-screen data collection, is compressed into the Web picture format, adopts the FTP connected mode to upload on-screen data in real time.
5, the real-time sync instruction of based on network multiple medium according to claim 4 system, it is characterized in that, in order to realize the synchronous demonstration of audio, video data and teacher computer on-screen data, employing is used for the synthetic time script flow of multiple media sync, script flow adopts XML normative document descriptor format, the relevant information of three kinds of media sync relations of record tone video and screenshotss.
6, the real-time sync instruction of based on network multiple medium according to claim 1 system, it is characterized in that, described sync instruction supporting platform, form by Darwin streaming media server and Apache Web server and ftp server, the Darwin streaming media server is responsible for receiving the RTP audio/video flow that the audio-video collection instrument sends in real time with mode of unicast, be distributed to the synchronous courseware browser of client continuously with the packing of RTSP form afterwards and carry out live play, after live finishing, the audio-video collection instrument is recorded and cut apart packing according to the RTSP/RTP standard by the mp4 that FTP uploads, the files in stream media of formation standard becomes the courseware resource that supplies program request among the DSS; Apache Web server reading displayed is live visits for the learner with the program request tabulation, teachers' instruction screen shots that collection is uploaded to the electronic document sampling instrument and live program request synchronous documents manage simultaneously, and the Apache Web server is intercepted the synchronous courseware browser of acceptance and adopted Http Get mode to obtain synchronous documents and screen shots file from it; The ftp server that is arranged on the Apache receives teachers' instruction screen shots that the electronic document sampling instrument gathers in real time and description document synchronously in live process in the FTP mode, is positioned at ftp server on the DSS and receives the audio-video collection instrument in the FTP mode upload mp4 audio frequency and video courseware after live ends after live.
7, the real-time sync instruction of based on network multiple medium according to claim 1 system is characterized in that, described synchronous courseware browser adopts gmp4player to carry out the decoding and the broadcast of audio, video data; Adopt Http Get mode to obtain the synchronized multimedia description document simultaneously from server, simultaneously synchronous documents is resolved, corresponding relation according to each time point audio frequency and video and teacher's on-screen data in the synchronous documents, the same Http Get mode that adopts is obtained teacher's screenshot capture data of corresponding time point in real time from Web server, plays with the audio frequency and video data sync of giving lessons in the screen shots display box.
8, according to claim 1 or the real-time sync instruction of 7 described based on network multiple medium system, it is characterized in that described synchronous courseware browser moves at student terminal, the student receives the live or program request courseware of teaching in real time by it.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB2005100310526A CN100535959C (en) | 2005-10-21 | 2005-10-21 | System for multi media real-time synchronous teaching based on network |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB2005100310526A CN100535959C (en) | 2005-10-21 | 2005-10-21 | System for multi media real-time synchronous teaching based on network |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN1787036A true CN1787036A (en) | 2006-06-14 |
| CN100535959C CN100535959C (en) | 2009-09-02 |
Family
ID=36784475
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNB2005100310526A Expired - Fee Related CN100535959C (en) | 2005-10-21 | 2005-10-21 | System for multi media real-time synchronous teaching based on network |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN100535959C (en) |
Cited By (34)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101316356B (en) * | 2007-05-29 | 2010-12-08 | 北京大学 | Blackboard writing dynamic image compression method facing remote education |
| CN101980499A (en) * | 2010-11-04 | 2011-02-23 | 上海融讯电子有限公司 | Asynchronous interaction method for information |
| CN102005142A (en) * | 2010-11-04 | 2011-04-06 | 上海融讯电子有限公司 | Information interaction method for teaching |
| CN102568260A (en) * | 2010-12-31 | 2012-07-11 | 上海久隆信息工程有限公司 | Video information processing method based on three-split screen courseware recording |
| CN102646346A (en) * | 2012-05-10 | 2012-08-22 | 北京中熙正保远程教育技术有限公司 | Mobile video playing system and method for remote instruction |
| CN102682639A (en) * | 2012-05-17 | 2012-09-19 | 江苏中科梦兰电子科技有限公司 | Method for improving synchronous display efficiency of electronic classroom resources |
| CN102723104A (en) * | 2012-07-04 | 2012-10-10 | 深圳锐取信息技术股份有限公司 | Multimedia recorded broadcast system based on moving picture experts group 4 (MP4) file packaging format |
| WO2013091434A1 (en) * | 2011-12-23 | 2013-06-27 | Liu Zhuochen | Intelligent interaction system for video teaching |
| CN103246752A (en) * | 2013-05-30 | 2013-08-14 | 北京瑞翔恒宇科技有限公司 | System for associating ppt document with audio |
| CN103413472A (en) * | 2013-08-14 | 2013-11-27 | 苏州阔地网络科技有限公司 | Method and system for achieving network synchronous classroom |
| CN103428441A (en) * | 2013-05-27 | 2013-12-04 | 王�锋 | Course recording method and course recording device used for on-line teaching |
| CN103581569A (en) * | 2013-09-07 | 2014-02-12 | 国家电网公司 | Method and system for recording electric power system teaching courseware |
| CN103761983A (en) * | 2014-01-09 | 2014-04-30 | 南京迅云网络科技有限公司 | Method and system for achieving real-time recorded broadcasting in education system |
| CN103761894A (en) * | 2014-01-28 | 2014-04-30 | 成都恒轩汇智科技有限公司 | Interaction classroom implementing method and interactive platform |
| CN104090771A (en) * | 2014-07-22 | 2014-10-08 | 华中师范大学 | Linux-oriented three-split-screen courseware transplantation system and method |
| CN104376753A (en) * | 2014-11-18 | 2015-02-25 | 合肥宏基电子有限公司 | 3D real-time record and playback practical teaching system |
| CN104463695A (en) * | 2014-11-25 | 2015-03-25 | 国家电网公司 | Dispatching anti-accident simulating system for electric power system and method thereof |
| CN105427693A (en) * | 2015-12-31 | 2016-03-23 | 天津浩之杉教育科技有限公司 | Remote studying system |
| CN105916039A (en) * | 2016-05-06 | 2016-08-31 | 亿瑞互动科技（北京）有限公司 | Online teaching method and device, and associated device |
| CN106303437A (en) * | 2016-08-23 | 2017-01-04 | 北京汉博信息技术有限公司 | A kind of visualization data file generation method |
| CN106790226A (en) * | 2017-01-15 | 2017-05-31 | 刘小艳 | A kind of Portable audio frequency and video teaching interaction equipment |
| CN106952519A (en) * | 2017-04-28 | 2017-07-14 | 河南财政税务高等专科学校 | A kind of ideological and political education intelligent tutoring system |
| CN107801104A (en) * | 2016-08-30 | 2018-03-13 | 山大鲁能信息科技有限公司 | The assisted teaching system and method recorded based on curriculum video |
| WO2018072390A1 (en) * | 2016-10-19 | 2018-04-26 | 深圳市鹰硕技术有限公司 | Classroom teaching recording and requesting method and system |
| CN108305513A (en) * | 2018-02-07 | 2018-07-20 | 商丘职业技术学院 | Net work teaching system with speech identifying function and method |
| CN109191962A (en) * | 2018-10-11 | 2019-01-11 | 四川生学教育科技有限公司 | A kind of optimization method and system under fixed-bandwidth with frequency frame per second |
| CN109547831A (en) * | 2018-11-19 | 2019-03-29 | 网宿科技股份有限公司 | A kind of method, apparatus, calculating equipment and the storage medium of blank and audio video synchronization |
| CN109640108A (en) * | 2018-12-13 | 2019-04-16 | 广州易方信息科技股份有限公司 | Interaction data and audio, video data synchronous method and system is broadcast live based on document class |
| CN109754652A (en) * | 2019-03-14 | 2019-05-14 | 河南城建学院 | English-Assisted Instruction multimedia audio-video playing device |
| CN109889859A (en) * | 2019-03-11 | 2019-06-14 | 杭州雅顾科技有限公司 | A kind of synchronous method of live video and document page turning |
| CN109982134A (en) * | 2019-02-27 | 2019-07-05 | 深圳市轱辘汽车维修技术有限公司 | A kind of video teaching method based on diagnostic device, diagnostic device and system |
| CN110446113A (en) * | 2019-07-23 | 2019-11-12 | 广州易方信息科技股份有限公司 | The method for playing back ppt and video flowing |
| CN112135156A (en) * | 2020-09-16 | 2020-12-25 | 广州华多网络科技有限公司 | Live broadcast method, education live broadcast method, system, equipment and storage medium |
| CN115190340A (en) * | 2021-04-01 | 2022-10-14 | 华为终端有限公司 | Live broadcast data transmission method, live broadcast equipment and medium |
-
2005
- 2005-10-21 CN CNB2005100310526A patent/CN100535959C/en not_active Expired - Fee Related
Cited By (43)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101316356B (en) * | 2007-05-29 | 2010-12-08 | 北京大学 | Blackboard writing dynamic image compression method facing remote education |
| CN101980499B (en) * | 2010-11-04 | 2014-04-02 | 上海心意答融讯电子有限公司 | Asynchronous interaction method for information |
| CN101980499A (en) * | 2010-11-04 | 2011-02-23 | 上海融讯电子有限公司 | Asynchronous interaction method for information |
| CN102005142A (en) * | 2010-11-04 | 2011-04-06 | 上海融讯电子有限公司 | Information interaction method for teaching |
| CN102568260A (en) * | 2010-12-31 | 2012-07-11 | 上海久隆信息工程有限公司 | Video information processing method based on three-split screen courseware recording |
| WO2013091434A1 (en) * | 2011-12-23 | 2013-06-27 | Liu Zhuochen | Intelligent interaction system for video teaching |
| CN102646346A (en) * | 2012-05-10 | 2012-08-22 | 北京中熙正保远程教育技术有限公司 | Mobile video playing system and method for remote instruction |
| CN102646346B (en) * | 2012-05-10 | 2014-05-07 | 北京中熙正保远程教育技术有限公司 | Mobile video playing system and method for remote instruction |
| CN102682639A (en) * | 2012-05-17 | 2012-09-19 | 江苏中科梦兰电子科技有限公司 | Method for improving synchronous display efficiency of electronic classroom resources |
| CN102723104A (en) * | 2012-07-04 | 2012-10-10 | 深圳锐取信息技术股份有限公司 | Multimedia recorded broadcast system based on moving picture experts group 4 (MP4) file packaging format |
| CN103428441A (en) * | 2013-05-27 | 2013-12-04 | 王�锋 | Course recording method and course recording device used for on-line teaching |
| CN103246752A (en) * | 2013-05-30 | 2013-08-14 | 北京瑞翔恒宇科技有限公司 | System for associating ppt document with audio |
| CN103413472A (en) * | 2013-08-14 | 2013-11-27 | 苏州阔地网络科技有限公司 | Method and system for achieving network synchronous classroom |
| CN103413472B (en) * | 2013-08-14 | 2015-05-27 | 苏州阔地网络科技有限公司 | Method and system for achieving network synchronous classroom |
| CN103581569A (en) * | 2013-09-07 | 2014-02-12 | 国家电网公司 | Method and system for recording electric power system teaching courseware |
| CN103761983A (en) * | 2014-01-09 | 2014-04-30 | 南京迅云网络科技有限公司 | Method and system for achieving real-time recorded broadcasting in education system |
| CN103761983B (en) * | 2014-01-09 | 2017-01-04 | 南京迅云网络科技有限公司 | Method and system for realizing real-time recording and broadcasting in education system |
| CN103761894A (en) * | 2014-01-28 | 2014-04-30 | 成都恒轩汇智科技有限公司 | Interaction classroom implementing method and interactive platform |
| CN104090771A (en) * | 2014-07-22 | 2014-10-08 | 华中师范大学 | Linux-oriented three-split-screen courseware transplantation system and method |
| CN104090771B (en) * | 2014-07-22 | 2017-02-22 | 华中师范大学 | Linux-oriented three-split-screen courseware transplantation system and method |
| CN104376753A (en) * | 2014-11-18 | 2015-02-25 | 合肥宏基电子有限公司 | 3D real-time record and playback practical teaching system |
| CN104463695A (en) * | 2014-11-25 | 2015-03-25 | 国家电网公司 | Dispatching anti-accident simulating system for electric power system and method thereof |
| CN105427693A (en) * | 2015-12-31 | 2016-03-23 | 天津浩之杉教育科技有限公司 | Remote studying system |
| CN105916039A (en) * | 2016-05-06 | 2016-08-31 | 亿瑞互动科技（北京）有限公司 | Online teaching method and device, and associated device |
| CN106303437A (en) * | 2016-08-23 | 2017-01-04 | 北京汉博信息技术有限公司 | A kind of visualization data file generation method |
| CN107801104A (en) * | 2016-08-30 | 2018-03-13 | 山大鲁能信息科技有限公司 | The assisted teaching system and method recorded based on curriculum video |
| WO2018072390A1 (en) * | 2016-10-19 | 2018-04-26 | 深圳市鹰硕技术有限公司 | Classroom teaching recording and requesting method and system |
| CN106790226A (en) * | 2017-01-15 | 2017-05-31 | 刘小艳 | A kind of Portable audio frequency and video teaching interaction equipment |
| CN106952519A (en) * | 2017-04-28 | 2017-07-14 | 河南财政税务高等专科学校 | A kind of ideological and political education intelligent tutoring system |
| CN108305513A (en) * | 2018-02-07 | 2018-07-20 | 商丘职业技术学院 | Net work teaching system with speech identifying function and method |
| CN109191962A (en) * | 2018-10-11 | 2019-01-11 | 四川生学教育科技有限公司 | A kind of optimization method and system under fixed-bandwidth with frequency frame per second |
| CN109547831A (en) * | 2018-11-19 | 2019-03-29 | 网宿科技股份有限公司 | A kind of method, apparatus, calculating equipment and the storage medium of blank and audio video synchronization |
| CN109547831B (en) * | 2018-11-19 | 2021-06-01 | 网宿科技股份有限公司 | Method and device for synchronizing white board and video, computing equipment and storage medium |
| CN109640108A (en) * | 2018-12-13 | 2019-04-16 | 广州易方信息科技股份有限公司 | Interaction data and audio, video data synchronous method and system is broadcast live based on document class |
| CN109640108B (en) * | 2018-12-13 | 2020-10-30 | 广州易方信息科技股份有限公司 | Method and system for synchronizing interactive data and audio-video data based on document live broadcast |
| CN109982134A (en) * | 2019-02-27 | 2019-07-05 | 深圳市轱辘汽车维修技术有限公司 | A kind of video teaching method based on diagnostic device, diagnostic device and system |
| CN109889859A (en) * | 2019-03-11 | 2019-06-14 | 杭州雅顾科技有限公司 | A kind of synchronous method of live video and document page turning |
| CN109754652A (en) * | 2019-03-14 | 2019-05-14 | 河南城建学院 | English-Assisted Instruction multimedia audio-video playing device |
| CN109754652B (en) * | 2019-03-14 | 2021-02-02 | 河南城建学院 | Multimedia audio and video playing device for English auxiliary teaching |
| CN110446113A (en) * | 2019-07-23 | 2019-11-12 | 广州易方信息科技股份有限公司 | The method for playing back ppt and video flowing |
| CN112135156A (en) * | 2020-09-16 | 2020-12-25 | 广州华多网络科技有限公司 | Live broadcast method, education live broadcast method, system, equipment and storage medium |
| CN115190340A (en) * | 2021-04-01 | 2022-10-14 | 华为终端有限公司 | Live broadcast data transmission method, live broadcast equipment and medium |
| CN115190340B (en) * | 2021-04-01 | 2024-03-26 | 华为终端有限公司 | Live broadcast data transmission method, live broadcast equipment and medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN100535959C (en) | 2009-09-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN100535959C (en) | System for multi media real-time synchronous teaching based on network | |
| CN101902580A (en) | Network multimedia tracking system for teaching | |
| US8373616B2 (en) | Locating and displaying method upon a specific video region of a computer screen | |
| KR101311015B1 (en) | Method and apparatus for media data transmission | |
| US20190259124A1 (en) | System and Method of Data Transfer In-Band in Video via Optically Encoded Images | |
| CN102752667B (en) | Multi-stream media live broadcast interaction system and live broadcast interaction method | |
| US20110202967A1 (en) | Apparatus and Method to Broadcast Layered Audio and Video Over Live Streaming Activities | |
| TWI727186B (en) | Processing media data using file tracks for web content | |
| KR20170109036A (en) | Multimedia file live broadcasting method, system and server | |
| CN1240216C (en) | Video playback device with real-time on-line viewer feedback capability and method of operation | |
| CN102821308A (en) | Multi-scene streaming media courseware recording and direct-broadcasting method | |
| US10582232B1 (en) | Transcoding frame-synchronous metadata for segmented video delivery | |
| CN101155089A (en) | Wireless multimedia real-time learning system and method | |
| CN101848367B (en) | File-based video live webcasting method | |
| Ziewer et al. | Transparent teleteaching. | |
| Ma et al. | T-cube: A multimedia authoring system for elearning | |
| WO2021101024A1 (en) | Cloud-based video virtual studio service system | |
| CN108665749A (en) | The display device and multimedia education system of multimedia education system under cloud desktop | |
| CN1529504A (en) | Television programme on-line broad casting method | |
| KR20000049612A (en) | An internet service that offered the natural view by real-time in web site | |
| CN110502649B (en) | Multimedia service classification method and device | |
| CN113965706A (en) | Multifunctional remote recorded broadcast teaching system for interactive teaching | |
| CN1306817C (en) | Live telecasting method for SNG network mobile photostudio and system thereof | |
| CN1157896C (en) | Remote mirroring education system based on broadband network for school | |
| Cymbalák et al. | Next generation IPTV solution for educational purposes |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| C17 | Cessation of patent right | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20090902 Termination date: 20131021 |