CN1783795A - Device and method for transmission - Google Patents
Device and method for transmission Download PDFInfo
- Publication number
- CN1783795A CN1783795A CN 200510126987 CN200510126987A CN1783795A CN 1783795 A CN1783795 A CN 1783795A CN 200510126987 CN200510126987 CN 200510126987 CN 200510126987 A CN200510126987 A CN 200510126987A CN 1783795 A CN1783795 A CN 1783795A
- Authority
- CN
- China
- Prior art keywords
- content
- application program
- user terminal
- image
- client terminal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/02—Details
- H04L12/16—Arrangements for providing special services to substations
- H04L12/18—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast
- H04L12/1813—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast for computer conferences, e.g. chat rooms
- H04L12/1822—Conducting the conference, e.g. admission, detection, selection or grouping of participants, correlating users to one or more conference sessions, prioritising transmission
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/238—Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
- H04N21/2381—Adapting the multiplex stream to a specific network, e.g. an Internet Protocol [IP] network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/61—Network physical structure; Signal processing
- H04N21/6106—Network physical structure; Signal processing specially adapted to the downstream path of the transmission network
- H04N21/6125—Network physical structure; Signal processing specially adapted to the downstream path of the transmission network involving transmission via Internet
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
- H04N7/147—Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- General Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The present invention relates to a sending apparatus that efficiently sends content provided by a viewer/listener to a sender and that performs live distribution using the content. Program content to be live-distributed by a user terminal (10) serving as the sender and sender specific information for specifying the user terminal (10) on the Internet (11) are distributed to a client terminal (12) via a streaming distribution server (13). Content provided by the client terminal (12) is directly sent to the user terminal (10) on the basis of the sender specific information. The user terminal (10) performs live distribution using the content that has been sent from the client terminal (12).
Description
Present patent application is dividing an application of following patent application:
Application number: 02803524.0
The applying date: on September 13rd, 2002
Denomination of invention: dispensing device, sending method, content delivery system, content delivery method and program thereof
Technical field
The present invention relates to a kind of content delivery system, it comprises several computers and service unit, it is connected to network, and distributed contents, it is sent to the computer of viewer/listener through service unit by the 1st computer that serves as the sender, also relate to content delivery method, and relate to the content router, it implements this content delivery system.
Background technology
So-called internet has been widely used in containing the computer network of many computers that couple together.The internet makes computer can use variety of protocol (interconnected formality) freely to transmit various information each other, and a kind of typical agreement is TCP/IP (TCP).
Catch the motion image that instrument is caught by images such as digital cameras, it uses the internet to be distributed to many viewer/listener, and this becomes possibility by following method.
Particularly, the 1st kind of method comprises that a file that contains motion image is uploaded to service unit from sender's computer, and in order to respond the downloading request that another computer is signed and issued to service unit, also will make the transmission file fit and can download.This computer that makes viewer/listener to use to be connected to the internet, download motion image from service unit, and in the display frame of computer this motion image of reading.
The 2nd kind of method comprises that the sender by motion image gets service unit ready, and containing the file of motion image with Downloadable state storage.As in the 1st kind of method, service unit can be distributed to motion image the computer of viewer/listener.
Get in the occasion of service unit the motion image file that the editor that can provide and deliver finishes ready the sender.Image is caught computer that instrument is connected to service unit or sender to be connected to service unit and to allow in real time the immediate distribution image to catch the motion image that instrument is caught.
This immediate distribution is to use variously banishs that feed technique realizes, that is, this technology can be used to sequential ground and plays the motion image data that deposit service unit in, and machine network download motion image data as calculated simultaneously.The example of banising feed technique has " the Real System " of Real Network Inc., " the QuickTime Streaming Server " of Apple Computer and " the Windows MediaTechnology " of Microsoft.
Motion images etc. are restricted through network immediate distribution in the above described manner, and promptly an immediate distribution only allows a sender.The inapplicable dispensing of this immediate distribution comprises: the motion image that the strange land supplier away from the sender is supplied with imports the program of immediate distribution and is connected to place, number place with relaying technique.
For example, the message of viewer/listener and viewpoint are reflected in the program of immediate distribution need a kind of system that carries out immediate distribution that is different from.Particularly, for example, the message of viewer/listener and viewpoint are to obtain with the form of character and static images, and this need use the application software that realizes Email and chat, and character that obtains and static images are read into the system that carries out immediate distribution.In addition, need to use the application software that realizes Email and chat to come exchange message and viewpoint, operate simultaneously with the system that carries out immediate distribution.
For as stated above, when carrying out immediate distribution with viewer/listener exchange message and viewpoint, several do not have the very application software of contact each other to need operation, the result makes complicated operation.Can not avoid not having the chat message of very getting in touch with the motion image of immediate distribution.The sender of motion image and viewer/listener are difficult to exchange message and viewpoint swimmingly each other.When writing down the motion image of immediate distribution, only can not realize single programs by this motion image.
In view of above-mentioned background situation, the purpose of this invention is to provide dispensing device, sending method, content delivery system, content delivery method and program thereof, so that the sender can freely use content, for example motion image, static images or text that viewer/listener provided.
Summary of the invention
Dispensing device of the present invention is such dispensing device: it is connected to the service unit of distributed contents and several of receiving by the content of service unit dispensing watch/listening device through network, and this dispensing device comprises:
Communicator is used for communicating by letter with another device through network; With
Control device, with generate content, it is distributed to through service unit and watches/listening device,
Wherein control device obtains the 1st content, it is distributed to through service unit and watches/listening device; From another device that is connected to network directly obtain the 2nd content, it is distributed to through service unit and watches/listening device; Use the 1st content and the 2nd content to generate the transmission content, it is sent to service unit; And through communicator the transmission content be sent to service unit.
Sending method of the present invention is such sending method: it is used for through the service unit of distributed contents content converting being watched/listening device to several, and this sending method comprises:
Obtain the step of the 1st content, the 1st content is distributed to through service unit and watches/listening device; Obtain the step of the 2nd content from another device that is connected to network, the 2nd content is distributed to through service unit and watches/listening device; Use the 1st content and the 2nd content to generate the step of transmission content, this transmission content is sent to service unit; With the step that the transmission content is sent to service unit.
Program of the present invention is such program: its be used for command device, it is connected to the service unit of distributed contents through network, and the instruction number platform watch/listening device, it receives the content by the service unit dispensing, sends and handles to carry out content, this program comprises:
Control with obtain the 1st content, it is distributed to through service unit and watches/listening device; Control with the device that is connected to network from another directly obtain the 2nd content, it is distributed to through service unit and watches/listening device; Control is transmitted content to use the 1st content and the 2nd content to generate, it is sent to service unit; Be sent to service unit with control with a transmission content.
Content delivery system of the present invention is to be connected to several through network and to watch/content delivery system of listening device, comprising:
Dispenser is used for a content converting to watch/listening device to several; And generating apparatus, with generate content, it is distributed to through dispenser and watches/listening device, wherein generating apparatus obtains the 1st content, it is distributed to through dispenser and watches/listening device; From another device that is connected to network directly obtain the 2nd content, it is distributed to through dispenser and watches/listening device; With use the 1st content and the 2nd content to generate distributed contents, it is distributed to through dispenser and watches/listening device, and
Wherein dispenser is distributed to several to the distributed contents that generating apparatus generated and watches/listening device.
Content delivery method of the present invention is such content delivery method, it is used for distributed contents in content delivery system, this content delivery system comprises dispenser, being used for a content converting watches/listening device and generating apparatus to several, with generate content, it is distributed to through dispenser and watches/listening device, this content delivery method comprises:
Obtain the step of the 1st content, the 1st content is distributed to through dispenser and watches/listening device; Obtain the step of the 2nd content from another device that is connected to network, the 2nd content is distributed to through dispenser and watches/listening device; Use the 1st content and the 2nd content to generate the step of distributed contents, this distributed contents is distributed to through dispenser and watches/listening device; With the distributed contents that dispenser generated be distributed to several watch/step of listening device.
Program of the present invention is such program, its be used for instructing a kind of system, it comprises dispenser, being used for a content converting watches/listening device and generating apparatus to several, with generate content, it is distributed to through dispenser and watches/listening device, send processing to carry out content, this program comprises:
Obtain the 1st content, the 1st content is distributed to through dispenser and watches/listening device; Obtain the 2nd content from another device that is connected to network, the 2nd content is distributed to through dispenser and watches/listening device; Use the 1st content and the 2nd content to generate distributed contents, this distributed contents is distributed to through dispenser and watches/listening device; With the distributed contents that dispenser generated be distributed to several watch/listening device.
According to one aspect of the invention, a kind of dispensing device is provided, it is via a plurality of watching/listening device that network is connected to the server unit of distributed contents and receives the content of being provided and delivered by server unit, and this dispensing device comprises: communication component is used for communicating by letter with another device via network; And control assembly, with generating the content that will be dispensed into described watching/listening device via server unit, wherein this control assembly is carried out following the processing, and comprising: acquisition will be dispensed into the 1st content of described watching/listening device via server unit; Install the 2nd content that direct acquisition will be dispensed into described watching/listening device via server unit from described another that is connected to network; Use the 1st content and the 2nd content to generate the transmission content that will be sent to server unit; With via communication component the transmission content be sent to server unit.
According to the present invention on the other hand, the sending method of using in a kind of dispensing device also is provided, this dispensing device is connected to the server unit of distributed contents via network and receives a plurality of watching/listening device of the content of being provided and delivered by server unit, and this sending method may further comprise the steps: (a) communicate by letter with another device via network; (b) generate the content that will be dispensed into described watching/listening device via server unit, wherein this step (b) is further comprising the steps of: the 1st content that (b1) obtains to be dispensed into via server unit described watching/listening device; (b2) install the 2nd content that direct acquisition will be dispensed into described watching/listening device via server unit from described another that is connected to network; (b3) use the 1st content and the 2nd content to generate the transmission content that will be sent to server unit; (b4) the transmission content is sent to server unit.
Description of drawings
Fig. 1 is a key diagram, and expression is according to the basic comprising of all content delivery systems of the embodiment of the invention.
Fig. 2 is a functional block diagram, the user terminal that uses in the expression content delivery system.
Fig. 3 is a key diagram, the shown main viewfinder of being carried out by user terminal in the expression content delivery system of immediate distribution application program.
Fig. 4 is a key diagram, user terminal in the expression content delivery system and the annexation between the client terminal.
Fig. 5 is a key diagram, expression display frame, and wherein communication application program is in the state that is activated by the immediate distribution application program of being carried out by user terminal in the content delivery system.
Fig. 6 is a key diagram, the example of the display frame of expression client terminal, and the content by the content delivery system dispensing is watched/listened to this client terminal.
Fig. 7 is a key diagram, the example of expression communication form, and it is created by the communication application program of being carried out by user terminal in the content delivery system.
Fig. 8 is a key diagram, and the content that be illustrated in the example of display frame in the following occasion, promptly sends from client terminal is inserted content delivery system by user terminal.
Fig. 9 is a key diagram, and content is watched/listened to the example of display frame of expression client terminal, this client terminal, it contains the content of being inserted content delivery system by user terminal.
Figure 10 is a key diagram, be illustrated in display frame in the following occasion example, be the state that communication application program has been imported text data, this communication application program runs on the client terminal of content delivery system.
Figure 11 is a key diagram, and the text data of be illustrated in the example of display frame in the following occasion, promptly importing from client terminal is obtained by the user terminal in the content delivery system and uses.
Figure 12 is a key diagram, be illustrated in the example of display frame in the following occasion, promptly from client terminal watch/listen to content, it contains the text data that is inserted content delivery system by user terminal.
Figure 13 is a flow chart, the example of the processing that the communication application program of being carried out by user terminal in the expression content delivery system is performed.
Figure 14 is a flow chart, sets up the example of the processing of session by the communication application program preparation in the expression content delivery system.
Figure 15 is a key diagram, the example of the transmission customizing messages (connection data) that is used by communication application program in the expression content delivery system.
Figure 16 is a flow chart, is added the example of participant's processing in the expression content delivery system by communication application program.
Figure 17 is a flow chart, selects the participant to appear at the example of the processing on the program by communication application program in the expression content delivery system.
Figure 18 is a flow chart, in the expression content delivery system character or image is sent to the example of the processing of immediate distribution application program from communication application program.
Figure 19 is a flow chart, inserts the example of the processing of content by the immediate distribution application program in the expression content delivery system.
Figure 20 is a key diagram, be illustrated in display frame in the following occasion example, be that several contents are inserted into content delivery system.
Figure 21 is a key diagram, represent the communication form that the display frame of client terminal in the following occasion is shown example, be that several contents are inserted into content delivery system.
Figure 22 is a key diagram, the example of expression display frame, and at this moment, client terminal has been signed and issued the requirement that merges the types of facial makeup in Beijing operas and mark, and this is the occasion that is inserted into content delivery system in several contents.
Figure 23 is a key diagram, the example of expression display frame, at this moment, from the character and the merging of former image of particular participant input, and the image after the dispensing merging, this is the occasion that is inserted into content delivery system in several contents.
Figure 24 is a key diagram, be illustrated in the memory territory of distributing in the RAM of user terminal in the following occasion content, be that several contents are inserted into content delivery system.
Figure 25 is a flow chart, be illustrated in the following occasion processing of carrying out by the immediate distribution application program example, be that several contents are inserted into content delivery system.
Figure 26 is a flow chart, and the expression appearance begins to handle, this processing is that this is the occasion that is inserted into content delivery system in several contents by the part of the processing of immediate distribution application program execution.
Figure 27 is a flow chart, and example, this processing that expression appearance cancellation is handled is that this is the occasion that is inserted into content delivery system in several contents by the part of the processing of immediate distribution application program execution.
Figure 28 is a flow chart, and expression change identification process, this processing are that this is the occasion that is inserted into content delivery system in several contents by the part of the processing of immediate distribution application program execution.
Figure 29 is a flow chart, and the expression image upgrades timer processing, this processing is that this is the occasion that is inserted into content delivery system in several contents by the part of the processing of immediate distribution application program execution.
Figure 30 is a flow chart, and expression is processing, this processing that content is sent to the immediate distribution application program that this is the occasion that is inserted into content delivery system in several contents by the part of the processing of immediate distribution application program execution.
Figure 31 is a flow chart, and expression is that this is the occasion that is inserted into content delivery system in several contents by the part of the processing of immediate distribution application program execution preparing content, with processing, this processing that is sent to the immediate distribution application program.
Embodiment
Describe embodiments of the invention with reference to the accompanying drawings in detail.The present invention is suitable for this occasion, uses several computer and the service units that are connected to computer network that is:, and the 1st content that computer generated of serving as the sender is distributed to the computer of viewer/listener through service unit.The formation of the fundamental system of distributed contents in this way is described now.
(1) basic comprising of content delivery system
As shown in Figure 1, the content delivery system that this example is recorded and narrated is for example carried out, and content is several client terminal 12a extremely, 12b, and 12c ... the immediate distribution of 11 computer networks such as grade through the internet.Content comprises video signal data or audio communication data, it is caught by user terminal 10, and this user terminal 10 comprises personal computer, and built-in or external digital video information camera (DV camera) is arranged; In perhaps can comprise text data, it is from the input of the input units such as keyboard of user terminal 10.
Here user terminal 10 of Ji Shuing and client terminal 12a, 12b, 12c ... be personal computer, PDA (personal digital assistant), the cell phone of communication function etc. is arranged.By the content of being provided and delivered be preedited video signal data, audio communication data or text data, it deposits user terminal 10 in.
1 li of content delivery system, user terminal 10 has many window functions, to show several forms simultaneously in display frame.Especially, user terminal 10 makes the user at the form that serves as main viewfinder and serve as between the form of setting window and seamlessly move, this main viewfinder is that each function of the application program carried out when carrying out content converting is presented in the display frame, this setting window is that the user carries out various settings in the above, this is related with regard to clear and definite main viewfinder and setting window, and the interface of easy understanding is provided for the user.Particularly, user terminal 10 is introduced the notion of panel form, and the panel form is to generate according to each the function vertical segmentation main viewfinder in the display frame, and purpose is the various functions of representing in the display frame.This benefits from implementing maneuverable individual and throws service.
Before describing user terminal 10 in detail, the basic whole of explanation content delivery system 1 constitutes earlier.
As shown in Figure 1, content delivery system 1 comprises user terminal 10, its distributed contents, several client terminal 12a, 12b, 12c ..., its reception and the content of watching/listening to user terminal 10 to be provided and delivered, reservation management center 14, its managing reserved information are used in service, so that user terminal 10 can the content converting function, it is provided by following stream delivery server 13 and the content converting that flows delivery server 13, its user terminal 10 dispensings to several client terminal 12a, 12b, 12c ...
Particularly, user terminal 10 is in this environment: promptly user terminal 10 can be connected to internet 11, it can be through ISP (Internet service provider) and public's loop network 15, and it comprises telephone network 15a, cable TV network 15b or ADSL (asymmetric digital subscribe link) network 15c.This connection can be wired or wireless, all can make user terminal 10 be connected to internet 11.For example, user terminal 10 can be connected to internet 11 through so-called personal handy phone system (hereinafter being called PHS).
Before sending content, user terminal 10 need use the 14 contents of appointment dispensing of reservation management center in service.User terminal 10 uses reservation management center 14 through public's loop network 15 and internet 11 access services, and the predetermined subscription information of login, comprise: the date and time of hope, be used for using content to banish sending function, it provides by stream delivery server 13, the fixed qty of viewer/listener and the password of viewer/listener.
After accepting reservation, user terminal 10 is sent to stream delivery server 13 to content through public's loop network 15 and internet 11.User terminal 10 is for example set up through public's loop network 15 is connected dedicated network 16 with server access port, and PPP (point-to-point protocol) connects, and nationality is to be set up to the transmission road of stream delivery server 13.Thereby user terminal 10 can be sent to stream delivery server 13 to content through the transmission road.In case of necessity, user terminal 10 can be the record cells such as content typing hard disk that sent.
Client terminal 12a, 12b, 12c ... be information processor, for example personal computer or PDA, it is in the environment that can be connected to internet 11.By the predetermined informations such as password of input viewer/listener, client terminal 12a, 12b, 12c ... all as watch/listen to terminal and participate in content delivery system 1.In content converting Start Date and the time that user terminal 10 is preengage and logined, content 11 is distributed to each client terminal 12a through the internet, 12b, and 12c ....Each client terminal 12a, 12b, 12c ... receive distributed contents, received content is decoded in real time, and use output contents such as display frame, loud speaker.
1 li of foregoing delivery system, the user has served as the distributor of content and has used reservation management center 14 through user terminal 10 access services, and logins above-mentioned subscription information, and nationality is with the immediate distribution of content of appointment.
Particularly, 1 li of content delivery system, the WWW (World Wide Web (WWW)) of the display frame display web page of user terminal 10 browses form, and this webpage provides the service of content delivery system 1.The user carries out user's login through user terminal 10 at content delivery system 1, and logins content delivery system 1 by given user ID (identity) and the password of input.Thereby the display frame of user terminal 10 shows predetermined form, provides and delivers with content of appointment.
The user is through the shown form input predetermined information of the display frame of user terminal 10.When the user imports credit card number etc., as a result during authentication success, promptly preengage at the immediate distribution of the content of scheduled date and time.1 li of content delivery system, when accepting the reservation of immediate distribution, use reservation management center 14 that the book setting file is downloaded to user terminal 10 from service.The book setting file comprises default subscription information, IP (Internet protocol) address and carries out the port of the stream delivery server 13 of immediate distribution, user ID, password etc.
1 li of content delivery system, immediate distribution application program (following) is carried out by user terminal 10, to read in these information automatically, does not promptly carry out immediate distribution thereby need to ask the user to carry out complicated setting.
1 li of content delivery system, user terminal 10 obtains reservation to be confirmed, promptly confirms whether really to carry out the immediate distribution of reservation, and it is to use the scheduled time of reservation management center 14 before dispensing Start Date and time, for example about 3 hours from service.Particularly, 1 li of content delivery system, user terminal 10 shows that in display frame WWW browses form, is used for access services to use reservation management center 14.When the user imports predetermined information on form, promptly obtained reservation and confirmed.1 li of content delivery system, the user must be the essential information of watching/listen to content such as the viewer/listener password client's (being watched/listen to the people of content by customer requirements) that (promptly before dispensing Start Date and time) hoped that gives advance notice.
1 li of content delivery system, user terminal 10 connects with stream delivery server 13, and it is the scheduled time before dispensing Start Date and time, for example about 5 minutes.In dispensing Start Date and time, user terminal 10 is caught video signal data and audio communication data by built-in or external digital video information camera.User terminal 10 is sent to stream delivery server 13 to video signal data and audio communication data simultaneously, and compresses video signal data and audio communication data in real time based on the predictive encoding form.1 li of content delivery system, the client who serves as viewer/listener can be through client terminal 12a, 12b, and 12c ... receive and watch/listen to content, this need import predetermined informations such as viewer/listener password.
As mentioned above, content delivery system 1 content through the internet 11 immediate distributions to client terminal 12a, 12b, 12c ....Content comprises the text data that the input unit of video signal data or the audio communication data that user terminal 10 is caught, the preedited video signal data that deposits user terminal 10 in or audio communication data, use user terminal 10 is imported etc.In other words, content delivery system 1 is implemented so-called individual and is thrown service, and it makes the user can be the content immediate distribution to several viewer/listener.
1 li of content delivery system, after user terminal 10 has been made the reservation of above-mentioned immediate distribution and finished setting, before reality dispensing beginning, can at first set and login the archives group etc. of the hard disk of the effect group of program necessity and typing user terminal 10.User terminal 10 uses the predetermined various settings of guide's function executing.1 li of content delivery system, beyond subscription time, user terminal 10 can use record cell such as hard disk to carry out and be caught by the test of immediate distribution content.In reality dispensing, user terminal 10 can be various effects applications in content, or by the video signal data of the digital video information camera capturing video gained that serves as optional input source or audio communication data, and deposit between the video signal data of hard disk or the audio communication data and switch.
1 li of content delivery system, in the following state, promptly: user terminal 10 and stream set up between the delivery server 13 be connected and content by immediate distribution, when user's executable operations with add effect, when switching file etc., this operation is reflected in the stream of providing and delivering according to operation.As a result, this operation is reflected in each client terminal 12a, 12b, 12c ... display frame in.
1 li of content delivery system, in the dispensing termination time, content converting is finished automatically, and at each client terminal 12a, 12b, 12c ... display frame on the program that is through with.1 li of content delivery system, about the information of the content of finishing dispensing with the photograph album form by the record cells such as hard disk of typing user terminal 10.The details and the distributed contents of dispensing record can be read and browse to user terminal 10.
(2) formation of user terminal
The following describes the formation of the user terminal 10 that foregoing delivery system 1 includes.Be simplified illustration, provided the user terminal 10 that contains digital video information camera.In addition, the digital video information camera as external unit can be connected to user terminal 10 wired or wirelessly.In addition, user terminal 10 can use digital video information camera, it is connected directly to LAN (local area network (LAN)) etc. and has connected the computer network of user terminal 10, and obtain video signal data that digital video information camera catches or audio communication data and as calculated the machine network it is written into user terminal 10.
As shown in Figure 2, user terminal 10 comprises CPU (CPU) 20, it carries out the calculation of various mathematics and control each assembly; RAM (random access memory) 21, its service area as CPU20; ROM (read-only memory) 22, its stored information comprise the various programs that CPU20 carries out; HDD (hard disk drive) 23, it writes down various programs, and for example operating system and the application program carried out of CPU20, and the various data of read/write comprises distributed contents; Display unit 24, it shows various information; Display interface 25, it can exchange data between display unit 24 and CPU20; Operating unit 26 is imported various information, instruction and operation with the cause user; Operation-interface 27 is used for making data to exchange between operating unit 26 and CPU20; Network interface 28, it can exchange data with external unit, and this external unit is connected to internet 11 or server connects dedicated network 16 through above-mentioned public's loop network 15; Digital video information camera 29, it catches the image of things and obtains video signal data or the audio communication data; MPEG2 encoding and decoding 30, it carries out compressed encoding and decoding based on so-called MPEG2 (the 2nd grade of Motion Picture Experts Group).
10 li of user terminals, the CPU20 in these assemblies, RAM21, ROM22, HDD23, display interface 25, operation-interface 27, network interface 28, digital video information camera 29, MPEG2 encoding and decoding 30 are connected to each other through bus 31.
The digital video information camera 29 that user terminal is 10 li may not be built in user terminal 10.On the contrary, for example, digital video information camera 29 can be connected to bus 31 through predetermined interface, is used for connecting with external unit, network interface 28 etc.In case of necessity, HDD23 not only, also have for example removable read/write cell also built-in or be external to user terminal 10, this removable read/write cell carries out read/write to removable recording medium.Can carry out write and read to various data by this read/write cell.
CPU20 is connected to RAM21, ROM22, HDD23, display interface 25, operation-interface 27, network interface 28, digital video information camera 29 and MPEG2 encoding and decoding 30 through bus 31.CPU20 controls each assembly and carries out operating system and the various application program of typing HDD23 etc.Especially, CPU20 handles and is controlled at service and uses the reservation of the content converting at reservation management center 14, content is sent to stream delivery server 13 and the content typing HDD23 that has sent.
RAM21 when CPU20 carries out various program as the service area of CPU20.Under the control of CPU20, the temporary transient store various kinds of data of RAM21.
ROM22 stores various programs and set information, and this is that the activation of user terminal 10 is necessary.The various programs and the set information that deposit ROM22 in are to read when the activation of user terminal 10, and are used by CPU20.
Under the control of CPU20, the various programs of HDD23 read/write, for example operating system and application program, data etc.And HDD23 can store the content that has sent.And HDD23 can also write down preedited content, and under the control of CPU20, reads content when dispensing.
Display unit 24 is formed by for example LCD (liquid crystal display screen).Under the control of CPU20, display unit 24 shows various information, for example data of typing HDD23 in display frame.Especially, under the control of CPU20, display unit 24 shows predetermined graphic user interface in display frame, comprise the WWW browser window, be used for access services and use reservation management center 14 and stream delivery server 13, with predetermined form, be used for carrying out various application programs, to carry out various processing, comprise the content that processing sends.
Display interface 25 can exchange data between CPU20 and display unit 24.In other words, display interface 25 offers display unit 24 to the various information of supplying with from CPU20 through bus 31.
Operating unit 26 accepts to use user's operation of user interface, and user interface comprises: for example, and pointing device, for example keyboard or Genius mouse; Or the rotary manipulation switch, for example so-called roller, and a control signal of indication details of operation offers CPU20 through operation-interface 27.
Operation-interface 27 can exchange data between CPU20 and operating unit 26.In other words, operation-interface 27 offers CPU20 to the control signal of supplying with from operating unit 26 through bus 31.
Under the control of CPU20, network interface 28 serves as external communication interface.In other words, be provided with network interface 28 data are exchanged between user terminal 10 and external unit, this external unit is connected to internet 11 or server connection dedicated network 16 through public's loop network 15.Especially, under the control of CPU20, that network interface 28 sends content externally is concurrent/receive various information, comprise above-mentioned subscription information, reservation ID etc.
Digital video information camera 29 is formed by the predetermined optical system of the image that is used for catching things, CCD optical-electrical converters such as (charge coupled devices) etc.Under the control of CPU20, digital video information camera 29 capturing videos and the video signal data or the audio communication data that obtain offer MPEG2 encoding and decoding 30 through bus 31.
Under the control of CPU20, MPEG2 encoding and decoding 30 are compressed video signal data or audio communication data based on the MPEG2 form and are encoded, and this compression and coding provide from digital video information camera 29 through bus 31.Under the control of CPU20, MPEG2 encoding and decoding 30 are compressed video signal data or audio communication data in real time and are encoded.And MPEG2 encoding and decoding 30 can be decoded to compressing with coded data based on the MPEG2 form.
(3) immediate distribution application program
The following describes the immediate distribution application program of carrying out by above-mentioned user terminal 10.The immediate distribution application program is made of a series of program groups, and it has merged several and has realized the module of independent function.For example, the immediate distribution application program is by the HDD23 of typing user terminal 10.User terminal 10 is by being carried out the immediate distribution of content by CPU20, thereby carries out the immediate distribution application program.The immediate distribution application program can be provided by the booking situation medium, transmission mediums such as for example so-called CD or internet.
Carrying out the immediate distribution application program makes the display unit 24 of user terminal 10 for example can show form as shown in Figure 3.
As shown in Figure 3, form is created main viewfinder 50 on primary module, this primary module serves as the trunk of immediate distribution application program, and this form comprises guide's bar 51 and the status bar 52 that primary module is created, and several panel forms 53a that creates by the corresponding function module, 53b, 53c, 53d, and 53e.
In Fig. 3, comprised the panel form of following demonstration: acoustic panels form 53a is used for carrying out acoustic operation; Camera input panel form 53b is used for carrying out the operation of relevant video signal data, and this video signal data is by the digital video information camera 29 capturing video gained that serve as optional input source; The main panel form 53c that monitors is used for carrying out the operation of the content of relevant immediate distribution; File input panel form 53d is used for carrying out the operation of relevant video signal data, and this video signal data is the HDD23 that optional input source is served as in typing; With effect panel form 53e, be used for carrying out the operation of relevant effect, this effects applications is in the content of being provided and delivered.
Guide's bar 51 provides several buttons, is used for importing the instruction of various operations.The user is with the button of 51 li demonstrations of Genius mouse click guide's bar, to carry out various operations on the immediate distribution application program.
Status bar 52 provides the viewing area, has for example shown the electric wave state when above-mentioned PHS is used to connect internet 11, the connection status when setting up above-mentioned PPP and connect, the residual charge of 10 li contained batteries of user terminal, or the residual capacity of HDD23.
Acoustic panels form 53a comprises several icons 53a1, be used for audio communication/music datas such as display waveform file, the background music of being play when it logs on as immediate distribution, button 53a2, be used for selecting one of these icons, button 53a3, be used for playing or stopping audio communication/music data corresponding to selected icon, etc.In acoustic panels form 53a, can in inventory, freely add other audio communication/music datas, but or audio communication/music data of in inventory, logining of cancellation.
Camera input panel form 53b provides preview area 53b1, it shows preview image, is used for the preview video signal data, and this video signal data is by the digital video information camera 29 capturing video gained that serve as optional input source; Button 53b2 is used for being set to the input source of video signal data, and this video signal data is by digital video information camera 29 capturing video gained; Button 53b3 is used for using so-called back record, that is, and and the video signal data merging of the HDD23 that optional input source is served as in the audio communication data of digital video information camera 29 capturing video gained and typing; Button 53b4 is used for activating the setting application program that is used for digital video information camera 29; Deng.
The main panel form 53c that monitors provides preview area 53c1, has been used for the content of preview immediate distribution, button 53c2, be used for beginning that test is caught or actual dispensing, button 53c3, be used for suspending and play or the dispensing of content, button 53c4, be used for to the noise reduction of audio communication data, time showing zone 53c5, its demonstration dispensing institute's time-consuming or residual time, etc.
File input panel form 53d provides thumbnail zone 53d1, it shows thumbnail, be used for representing that typing serves as the video signal data inventory of the HDD23 of optional input source, preview area 53d2, its demonstration preview image, be used for the preview video signal data, button 53d3, be used for selecting an Abbreviative image in the Abbreviative image in the inventory, button 53d4, be used for playing or stopping video signal data corresponding to selected Abbreviative image, etc.
Effect panel form 53e provides thumbnail zone 53e1, it shows thumbnail, be used for representing being applied to the inventory of various effect material of the content of immediate distribution, button 53e2, be used for selecting an Abbreviative image, button 53e3, be used for carrying out or cancelling this effect corresponding to selected Abbreviative image, box 53e4, user be input of character string therein, with be shown as captions in real time, it serves as the effect on the video signal data, etc.In effect panel form 53e, can add other effect material in the inventory, but or the effect material in inventory, logined of cancellation.
As mentioned above, in order to represent various function tasks, user terminal 10 shows the horizontal form 53a that separates, 53b, 53c, 53d, and 53e corresponding to function, on display unit 24.This makes the user can detect related according between each function operations and the necessary button groups easily intuitively.For example, when the user wanted to carry out the operation of relevant effect, the user only noted effect panel form 53e.
Use above-mentioned immediate distribution application program, user terminal 10 freely merges video signal data, audio communication data, text data etc., to create the content of being provided and delivered.The content of being created through the internet 11 or server connect dedicated network 16 and be sent to stream delivery server 13.Stream delivery server 13 content converting to client terminal 12a, 12b, 12c ...
(4) be used for from the content delivery system of viewer/listener acquisition content
Based on the basic comprising of foregoing delivery system 1, below with reference to Fig. 4 a kind of occasion is described, that is: user terminal 10 directly obtains content, also uses the content that is obtained to carry out immediate distribution from the client terminal that serves as viewer/listener.
Fig. 4 shows a kind of occasion, that is: the digital video information camera (DV camera) 29 that serves as the external unit of user terminal 10 is connected to user terminal 10.
1 li of content delivery system, as mentioned above, when user terminal 10 is carried out immediate distribution, shown in the arrow A 1 of Fig. 4, content through the internet 11 from user terminal 10 be sent to stream delivery server 13, this content is created by the immediate distribution application program that runs on the user terminal 10.Stream delivery server 13 is content converting several client terminals 12 extremely, shown in arrow A among the figure 2.
Be not only above-mentioned immediate distribution application program, also have communication application program, it is used for the content that obtains and use calm family terminal to send, also run on the user terminal 10.
Communication application program is identical with the immediate distribution application program, all for example deposits the HDD23 of user terminal 10 in.By come the executive communication application program by CPU20, user terminal 10 can obtain and use the content of sending from client terminal.Communication application program can be provided by the booking situation medium, transmission mediums such as for example so-called CD or internet.
As described below, communication application program and above-mentioned immediate distribution application program closely cooperate and operate.Communication application program can be independent of the immediate distribution application program and carry out.
1 li of content delivery system, client terminal 12 can be divided into substantially: only for the terminal of the usefulness of watching/listening to, be used for watching/listen to content from 13 dispensings of stream delivery server, and can be sent to the user terminal 10 of carrying out immediate distribution to content.
Only can carry out application programs such as web browser, the content that is used for watching/listening to dispensing for 12 need of client terminal of the usefulness of watching/listening to.
The client terminal 12 that can send content has built-in or external DV camera 29 shown in Figure 4, as 10 li of user terminals.The content (for example web browser) that application program is not only arranged, be used for watching/listening to dispensing, client terminal 12 are at least also wanted can the executive communication application program, be used for content is sent to user terminal 10.
12 li of the client terminals that can send content, wherein content is for example, video signal data of catching by DV camera 29 or audio communication data or from the text data of the input unit input of client terminal 12, shown in the arrow A 3 of Fig. 4, directly 11 be sent to user terminal 10 through the internet, and without stream delivery server 13.
1 li of content delivery system, content directly is sent to user terminal 10 from client terminal 12 realizes by following method.
Particularly, user terminal 10 is sent to stream delivery server 13 to the content of immediate distribution and the sender's customizing messages that is used for indicating the user terminal 10 on the internet 11.Banish to take and be engaged in 13 content and sender's customizing messages being sent to each client terminal 12.
Sender's customizing messages for example comprises, distribute to user terminal 10 and on network unique information, for example IP address or port numbers, it is used by the communication application program on the user terminal 10, to receive the content from client terminal 12.
Based on sender's customizing messages, its corresponding to from stream delivery server 13 content provide and deliver, the client terminal 12 that content is sent to user terminal 10 indicates the user terminal 10 on the internet 11, and connect (session), with to carrying out sending out/receiving of content on the user terminal on the internet 11 10.With different through stream delivery server 13, client terminal 12 directly is sent to user terminal 10 to content through so-called peer-to-peer communications.In other words, client terminal 12 is sent to user terminal 10 to content, rather than is sent to the particular server on the network.
1 li of content delivery system, as mentioned above, client terminal 12 is sent to user terminal 10 to content based on sender's customizing messages, and without specific service units such as stream delivery servers 13.This makes between client terminal 12 and the user terminal 10 exchanging contents glibly, and need not consider the load of service unit.
(5) exchange of the actual content between client terminal and the user terminal
Will be explained in more detail a kind of occasion below, that is, as mentioned above, user terminal 10 has obtained the content of sending from client terminal 12 and has used this content to carry out immediate distribution.
When user terminal 10 want to use the content sent from client terminal 12, when also carrying out above-mentioned immediate distribution application program simultaneously, user terminal 10 is selected communication application program activator button 51a, it is presented at 51 li of guide's bars of main viewfinder 50, as shown in Figure 3.
Response therewith 10 li of user terminals, cooperates the immediate distribution application program and the communication application program operated is activated.As shown in Figure 5, the communication form of being created by communication application program 70 is presented at the bottom of the main viewfinder 50 of immediate distribution application program.
Communication application program activator button 51a is presented at 51 li of guide's bars of main viewfinder 50, and this activator button 51a is only when just selecting when client terminal 12 has been sent content.When content not when client terminal 12 is sent, communication application program activator button 51a can be shown as and can not select.
As shown in Figure 5, preview area 71 is placed in communication form 70, and this preview area 71 is used for show image, and it is that catch and be sent to user terminal 10 by the DV camera 29 of each client terminal 12.At each images of 71 li demonstrations of preview area all is that catch and be sent to user terminal 10 by the DV camera 29 of each client terminal 12.Each image all is motion image or static images.
Image in 71 li demonstrations of preview area for example comprises, client terminal 12 operators' face, and it is caught by corresponding D V camera 29.Each client terminal 12 not only allows the video image that DV camera 29 is caught is sent to user terminal 10, also allow for example to send, video signal data, it is caught and record by DV camera 29, image data, it creates application programs by various images and creates, or the image data of getting ready in advance, it is that this will describe following in the communication application program performed by client terminal 12.
70 li of communication forms, inserting start button 72 can be used to select the video image of each image of 71 li demonstrations of preview area (image of sending from client terminal 12) insertion immediate distribution, insert the video image that stop button 73 can be used to stop the image of sending from client terminal 12 is inserted immediate distribution, help can be used to the help information of the relevant communication application program of reference with reference to button 74, and conclusion button 75 can be used to finish communication application program, and these buttons all are in the bottom of preview area 71.
In state shown in Figure 5, the image of being caught by the DV camera 29 of user terminal 10 is presented at the preview area 53b1 of camera input panel form 53b of the main viewfinder 50 of immediate distribution application program.This image is selected as immediate distribution, thereby is also shown in the main preview area 53c1 that monitors panel form 53c.In state shown in Figure 5, the video image that is presented at preview area 53c1 is sent to stream delivery server 13 from user terminal 10, and immediate distribution.
The video image that is presented at preview area 53c1 for example comprises, user terminal 10 operators' face, that is, the sender's of the program of immediate distribution face, it is to be caught by the DV camera 29 of user terminal 10.
1 li of content delivery system, on each client terminal 12, all activated web browser.As shown in Figure 6, the form of being created by web browser 80 is presented in the display frame.Web browser on the client terminal 12 receives from the content of stream delivery server 13 dispensings.Web browser shows predetermined details based on HTML (HTML) file that obtains from stream delivery server 13 for 80 li at form.
Web browser is provided with predetermined plug-in card program, is used for the display/play content, comprises from motion image, static images and the audio communication data of 13 dispensings of stream delivery server.Be presented at the precalculated position of the form of creating by web browser 80 by the viewing area 81 of plug-in card program establishment.
Because the content of dispensing is presented at 80 li of the forms of web browser, so needn't prepare the program that immediate distribution was watched/listened to special application program.Because content is presented at 80 li of the forms of web browser, so show the information etc. of relevant content of providing and delivering easily.And various information all can offer client terminal 12 from stream delivery server 13.Variation and content flexibly so provided and delivered.
Because content is presented at 80 li of the forms of web browser, thus might reliably and contentedly watch/listen to content, and do not mind the environment that determines by operating system on the client terminal 12 etc.
The content of sending from user terminal 10 is in 81 li display/play of content display region.As a result, from the content that user terminal 10 is sent, that is, this content has been presented at the main preview area 53c1 that monitors panel form 53c of user terminal 10, and immediate distribution; This content is presented at 81 li of the content display region of client terminal 12.
Be not only the content display region 81 that above-mentioned plug-in card program is created, the form 80 that also has web browser also the program of the 81 li demonstrations in displaying contents viewing area details or show relevant sender's information with the form of text or image.Client terminal 12 can obtain the details of program, relevant sender's information etc. with the form of html file from stream delivery server 13.
80 li of the forms of web browser, participate in operator that button 82 can be used to make client terminal 12 and can participate in program by 13 dispensings of stream delivery server, this button 82 is presented at the bottom of content display region 81.When selecting to participate in button 82, on client terminal 12, activated communication application program, also had web browser.
Can directly exchange various data with the communication application program that on user terminal 10, activates at the communication application program that activates on the client terminal 12.The communication application program that activates on client terminal 12 can be the program of separating, and it also can be equivalent to the communication application program that activates corresponding to the communication application program that activates on user terminal 10 on user terminal 10.When performed communication application program was shared with user terminal 10 by client terminal 12, the enable mode of communication application program can be suitably specified or by state decision and changing automatically by the user.
When activating communication application program on the client terminal 12, as shown in Figure 7, the communication form of being created by communication application program 90 is presented in the display frame of client terminal 12.The form 80 of communication form 90 and web browser can be simultaneously displayed in the display frame or once show one.
As shown in Figure 7, communication form 90 comprises the image that portrait viewing area 91, its demonstration are caught by client terminal 12 built-in or external DV cameras 29.Around portrait viewing area 91, placed several buttons 92a and even 92g, be used for selecting various instructions and operation.In several buttons 92a and even 92g periphery, placed the image that several image viewing area 93 its demonstrations are sent from client terminal 12.
Button 92a and even 92g have following function.
Web browser activator button 92a can be used to activate web browser.When selecting web browser activator button 92a, the external web page browser just is touched and is activated, or activates the built-in web browser of communication application program.
Mood button 92b can be used to the effect of the various moods of representative is added the image of the 91 li demonstrations in portrait viewing area.When selecting mood button 92b, various moods for example, " sobbings ", " laughter ", " melancholy " be by adding effect representative, this effect comprises animation and audio, it is added into the image of the 91 li demonstrations in portrait viewing area.
Help button 92d can be used to the help information with reference to relevant communication application program.When selecting help button 92d, opened the form that shows help information.The user can read various operating instructions and confirm establishing method etc.
Return push-button 92e can be used to finish communication application program or takes a step back a supreme menu step display.When selecting return push-button 92e, can finish communication application program, or show the supreme menu step display that takes a step back, the last step display in showing to menu of promptly taking a step back, this menu demonstration is a hierarchical structure.
Image/audio communication button 92f can be used to select the image of the 91 li demonstrations in portrait viewing area.When selecting image/audio communication button 92f, from selecting in advance image, motion image to be presented at 91 li of portrait viewing areas or to select to be caught by the DV camera 29 that is connected to client terminal 12 once again in the types of facial makeup in Beijing operas of logining in the communication application program, it serves as portrait, to be presented at 91 li of portrait viewing areas.When selecting the motion image of catching, can set from the output level of the sound of DV camera 29 inputs by DV camera 29.
Chat log button 92g can be used to the show log data, has used so-called chat feature this moment.As described below, chat feature relates to from the text data of communication application program input and the exchange of user terminal 10 or other client terminals 12.
At client terminal 12 places, be presented at form 80, this web browser of creating by web browser and select this button 82 when activating communication application program and display communication form 90 as shown in Figure 6 when participating in button 82, communication application program is based on sender's customizing messages of sending from stream delivery server 13, directly exchange various data with user terminal 10, and the motion image of the 91 li demonstrations in portrait viewing area or static images are sent to user terminal 10.
Thereby as shown in Figure 5, motion image of sending from client terminal 12 or static images are presented at 71 li of the preview areas of communication form 70, and this communication form 70 is presented on the display unit 24 of user terminal 10.
71 li of preview areas, as shown in Figure 5, shown the content inventory that client terminal 12 is provided.So seeing, the user of operation user terminal 10 shows that also easily definite who participant can participate in the program of immediate distribution.The user can select one (several) position participant intuitively, and it gets permission to participate in program.
10 li of user terminals, when the insertion start button 72 of selecting communication form 70, when being presented at the types of facial makeup in Beijing operas of 71 li of preview areas side by side with selection, as shown in Figure 8, the selected types of facial makeup in Beijing operas are inserted into the pre-position of image, and this image is presented in the preview area 53c1 of main supervision panel form 53c.
In Fig. 8, image is presented at 91 li of the portrait viewing areas of the communication form 90 of client terminal 12, and as shown in Figure 7, this image is reflected as the types of facial makeup in Beijing operas 71a in one of preview area 71 of communication form 70.By selecting types of facial makeup in Beijing operas 71a, types of facial makeup in Beijing operas 71a is used as the types of facial makeup in Beijing operas 100 and inserts in the preview area 53c1 of main supervision panel form 53c.
When the types of facial makeup in Beijing operas of sending from client terminal 12 100 inserted the image of original dispensing by user terminal 10, the motion image that contains the types of facial makeup in Beijing operas 100 that insert wherein was sent to stream delivery server 13, and motion image by immediate distribution to client terminal 12.In other words, 12 li of each client terminals, as shown in Figure 9, motion image is corresponding to the image in the preview area 53c1 that is presented at main supervision panel form 53c, as shown in Figure 8, this motion image is presented at 81 li of the content display region of the form 80 of web browser, and this web browser is used for browsing the program of being provided and delivered.
In the performed communication application program of client terminal 12, for example, when Genius mouse pointer movement during to portrait viewing area 91, as shown in figure 10, corresponding to the position display of portrait viewing area 91 text key in box 91a.
Below this occasion will be described, that is: the types of facial makeup in Beijing operas of client terminal 12 by user terminal 10 select, inserting the motion image of immediate distribution, this client terminal 12 uses keyboards etc. to key in input unit input text data, for example " he in the box 91a at text! ".
At this moment, the performed communication application program of client terminal 12 is based on by sender's customizing messages of stream delivery server 13 dispensings, the user terminal 10 on the specifies Internet 11, and keys in the text data of box 91a and directly be sent to user terminal 10 keying in text.
Response therewith, user terminal 10 merge image and text data " he of sending from client terminal 12 in the preview area 53c1 that shows main supervision panel form 53c as shown in figure 11! ", as mentioned above, text data have been inserted into image.
Thereby, as shown in figure 12, contain the types of facial makeup in Beijing operas 100 and text data " he! " motion image, both have been inserted into motion image all, this motion image is presented at 81 li of the content display region of form 80 of the web browser of each client terminal 12.
1 li of the content delivery system that is equipped with as mentioned above, client terminal 12 serves as the viewer/listener of the program of immediate distribution, this client terminal 12 based on sender's customizing messages, contents such as image or text directly be sent to user terminal 10, it serves as the sender.User terminal 10 freely uses the content of sending from client terminal 12, and content is reflected in the program of immediate distribution.
According to content delivery system 1, so-called audience participates in program and uses the internet in very simple and easy, user-friendly mode and realize.For example, propose many problems or test, and use text to show their answer to viewer/listener.Thereby immediate distribution variation and program easily flexibly.For example, viewer/listener is away from the distant place capturing video of the user terminal 10 that serves as the sender or key in text, and the image that this is caught or the text of key entry are freely merged with motion image, this motion image is by user terminal 10 immediate distributions.Thereby this program is provided and delivered by this way: connected place, several place by relaying technique seemingly, this program is to use the internet to realize.
(6) processing of communication application program
Below with reference to flow chart, a series of processing are described chronologically, it is to be carried out by the above-mentioned communication application program on the user terminal 10.
Communication application program can be for example, be activated with enter different conditions, promptly between two kinds of occasions: activate and activate by the immediate distribution application program on the user terminal 10 by the web browser on the client terminal 12.In two kinds of occasions, can carry out different functions at this.Provide explanation below, as Fig. 5, shown in 8 and 11, the processing series of the communication application program in the occasion that activates by the immediate distribution application program.Implementing the following series of handling needs to carry out various mathematics calculations and control the operation of each assembly according to each stream handled that writes communication application program by the CPU20 by user terminal 10.
When communication application program was activated by the immediate distribution application program, shown in the step S10 of flow chart, communication application program prepared to set up session as shown in figure 13.At step S10 place, communication application program and immediate distribution application program exchange various data, to prepare the contents such as the types of facial makeup in Beijing operas that acquisition is sent from client terminal 12.The back also will describe the processing of step S10 in detail.
At step S11 place, judge and whether received connection request from the communication application program of client terminal 12 activation.In other words, at step S11 place, judge contents such as whether having sent the types of facial makeup in Beijing operas 100 from client terminal 12.When connection request has been received in judgement, handle advancing to step S12.When not receiving connection request, handle advancing to step S13.
At step S12 place, the contents of sending from client terminal 12 such as the types of facial makeup in Beijing operas are added into certain preview area 71 of communication form 70.Preparing below has the participant to participate in the program of sending from user terminal 10.The back also will describe the processing of step S12 in detail.
At step S13 place, judge the insertion start button 72 whether selected to be in communication form 70 so that new participant can appear on the program.When insertion start button 72 has been selected in judgement, handle advancing to step S14.When not selecting to insert start button 72, handle advancing to step S15.
At step S14 place, judge 71 li of the preview areas of communication form 70 content of having selected which content, having inserted immediate distribution as the program participant.The back also will describe the processing of step S14 in detail.
At step S15 place, judge the insertion stop button 73 whether selected to be in 70 li of communication forms, with cancellation in the insertion of the content of step S14 place insertion.In other words, when the program participant from client terminal 12 has been inserted into the program of immediate distribution, judges and whether cancel this participant's appearance.When insertion stop button 73 has been selected in judgement, handle advancing to step S16.When not selecting to insert stop button 73, handle advancing to step S17.
At step S16 place, sent first message with the appearance that requires immediate distribution application program cancellation participant, program that this participant has been inserted into immediate distribution.That is, the immediate distribution application program is required to cancel the content of insertion from client terminal 12.So the immediate distribution application program has been cancelled the program of sending from user terminal 10 from the content insertion of client terminal 12.
At step S17 place, judge that whether having sent fresh content, these client terminals 12 such as image data or text data from client terminal 12 is the content source of inserting the program of immediate distribution, and judge and whether received this fresh content.Handle advancing to step S18 when judging when appearing at client terminal 12 on the program at present and received fresh content.When not receiving fresh content, handle advancing to step S19.
At step S18 place, fresh contents such as image data of receiving from the client terminal 12 that appears at present on the program or text data are sent to the immediate distribution application program.Thereby the immediate distribution application program is inserted the program of immediate distribution to fresh content, and shows the program that contains fresh content.
At step S19 place, fresh contents such as image data of receiving from the client terminal 12 that appears at present on the program or text data are sent and be sent to the immediate distribution application program, thereby upgrade the content in the program that inserts immediate distribution.
At step S20 place, the judgement user is whether the operator of user terminal 10 has signed and issued the requirement that finishes communication application program.This requirement for example is, signs and issues by the conclusion button of selecting to be in 70 li of communication forms, or the requirement that comes the end of input communication application program by the operating unit 26 that comprises keyboard for example etc.Sign and issue when finishing beam request when judgement, finish communication application program and communication close form 70.Display frame enters state shown in Figure 3.When not signing and issuing when finishing to require, handle and return step S11, and carry out the step of above-mentioned series continuously.
Preparation is set up in the session that above-mentioned steps S10 place is described below with reference to Figure 14.
When the processing of step S10 began, shown at the step S30 of Figure 14, user terminal 10 obtained IP address under it from the immediate distribution application program.The IP address is the information that is used for indicating user terminal 10 on internet 11.Usually, the IP address is represented by 4 piece of digital, and shape is as " 134.55.22.33 ".
At step S31 place, generated connect data, it is that client terminal 12 connects the communication application program that runs on the user terminal 10, also is sender's customizing messages.Sender's customizing messages is transferred into the immediate distribution application program.
Sender's customizing messages for example comprises, as shown in figure 15, access key, be used for when attempt visit runs on communication application program on the user terminal 10, authenticating etc., the port numbers of the network interface 28 of user terminal 10, it uses by communication application program, be used for being connected to the IP address number of communication application program, be used for being connected to a series of IP address of communication application program, etc.
At step S32 place, communication application program begun server process, to ensure and being connected of client terminal 12.Thereby user terminal 10 can obtain the content sent from client terminal 12, or user terminal 10 can exchange various data each other with client terminal 12.
Set up the series of steps of preparation when the session of having carried out step S10 place as mentioned above after, handle and return step S11.
The participant that above-mentioned steps S12 place is described below with reference to Figure 16 adds processing.
When the participant of step S12 adds the processing beginning, step S40 place at Figure 16, whether the contained access key of the access key that the data of sending from client terminal 12 are contained and sender's customizing messages shown in Figure 15 compares, consistent with the access key that communication application program is created to judge the former access key.That is, judge whether the content of sending from client terminal 12 is sent out and is used by communication application program.When judging that two access keys are consistent each other, handle advancing to step S41.When two access keys were not inconsistent each other, the participant at cancellation step S12 place added processing, advanced to step S13 and handle.
At step S41 place, the content of sending from client terminal 12 is added into and logins in participant's inventory.Participant's inventory is corresponding to the inventory of the contents such as the types of facial makeup in Beijing operas of 71 li of the preview areas that is presented at communication form 70.
At step S42 place, contents such as the types of facial makeup in Beijing operas 100 and login name have been obtained from client terminal 12.At step S43 place, the types of facial makeup in Beijing operas 100 and the login name that obtain at step S42 place are presented at 71 li of preview areas.In other words, based on participant's inventory, the preview area 71 of communication form 70 shows the details of the content of login in participant's inventory.
After the participant who has carried out step S12 place as mentioned above adds the series of steps of processing, handle and return step S13.
Illustrate that below with reference to Figure 17 the participant at above-mentioned steps S14 place selects to handle.
When the participant of step S14 selects to handle beginning, shown at the step S50 of Figure 17, handle this pattern that enters, that is: from the contents such as several the types of facial makeup in Beijing operas of 71 li of the preview areas that are placed on communication form 70, select a content.
At step S51 place, judge from the contents such as several the types of facial makeup in Beijing operas that are placed on 71 li of preview areas, to have selected which content.Selecting a content is by for example, uses the contained Genius mouse of the operating unit 26 of user terminal 10 etc. to click certain and opens types of facial makeup in Beijing operas.When a content has been selected in judgement, handle advancing to step S52.When not having chosen content, handle advancing to step S55.
At step S52 place, the content of selecting at step S51 place is stored as the participant, it is inserted into the program of immediate distribution and occurs on program.At step S53 place, the details of content, the transmission source that this client terminal 12 is contents have been obtained from client terminal 12.At step S54 place, the relevant information that gets content in step S53 place is transferred into the immediate distribution application program.Thereby the immediate distribution application program is inserted the content of sending from client terminal 12 program of immediate distribution.Behind completing steps S54, handle advancing to step S56.
At step S55 place, judge and whether to use the contained Genius mouse of operating unit 26 etc. to click place beyond the contents such as several the types of facial makeup in Beijing operas that are placed on 71 li of preview areas.Beyond content has been clicked in judgement local time, handle advancing to step S56.In the local time not clicking this, handle and return step S51.In other words, judge whether cancel the pattern of selecting contents such as the types of facial makeup in Beijing operas at step S55 place.
At step S56 place, cancelled the pattern of selecting contents such as the types of facial makeup in Beijing operas, return step S15 and handle.
Illustrate that below with reference to Figure 18 above-mentioned steps S19 place is sent to content the processing of immediate distribution application program.
When the processing that content is sent to the immediate distribution application program at step S19 place begins, shown at the step S60 of Figure 18, judge the size of contents such as whether the immediate distribution application program has made inquiry, inserted with inquiry text data or image data.The big I of being inquired for example is expressed as the level of the content of being inserted and the quantity of vertical pixel.When inquiry has been made in judgement, handle advancing to step S61.When not making inquiry, handle advancing to step S62.
At step S61 place, calculate the size of the content of being inserted, it is by the immediate distribution application asks, and the size of calculating a notice immediate distribution application program.Thereby the immediate distribution application program judge to be inserted the size of content of the program of immediate distribution, received content then, thus carry out various pre-treatments.
At step S62 place, whether judge exchange message, this information-related memory of sharing with communication application program by the immediate distribution application program (shared drive) by the immediate distribution application program.The information of relevant shared drive for example comprises, the start address in the user terminal 10 contained RAM21 is distributed to the amount of the piece of shared drive in the RAM21, etc.When judgement has exchanged the information of relevant shared drive, handle advancing to step S63.When not exchanging this information, the processing that content is sent to the immediate distribution application program is moved to end from step S19 backward, advance to step S20 and handle.
At step S63 place, the contents of sending from client terminal 12 such as the types of facial makeup in Beijing operas have been obtained.At step S64 place, the details of the content that obtains at step S63 place is deposited in shared drive, and this content for example contains image datas such as the types of facial makeup in Beijing operas or text data.At step S65 place, the memory block of distributing to shared drive in the RAM21 is released (closing), advances to step S20 and handle.
As mentioned above, 10 li of user terminals, a series of processing have been carried out by communication application program.By above-mentioned a series of processing of being carried out by communication application program, user terminal 10 has been received the content sent from client terminal 12 and this content has been sent to the immediate distribution application program.
(7) processing of immediate distribution application program
Below with reference to the flow chart of Figure 19 illustrate that the insertion of the content of sending from client terminal 12 is handled, it is the part of a series of processing of carrying out of the above-mentioned immediate distribution application program on user terminal 10.Implement the operation that following series of steps need are carried out various mathematics calculations by the CPU20 by user terminal 10 and controlled each assembly according to each stream handled that writes communication application program.
When inserting from content that client terminal 12 is sent, activate the immediate distribution application programs at user terminal 10 simultaneously, at the step S70 place of Figure 19, whether judgement has sent contents such as image data or text data from communication application program.Step S70 is corresponding to the processing of communication application program at step S18 place.When communication application program is sent, handle advancing to step S71 when judging the content inserted.When not sending this content, handle advancing to step S76.
At step S71 place, to communication application program make inquiry, with the size of contents such as the text data that inserted of inquiry or image data.The processing at step S71 place is corresponding to the processing of communication application program at step S60 place.After the size of the content that has obtained from communication application program to be inserted, handle advancing to step S72.
At step S72 place, based on the size of the content that obtains at step S72 place, the shared drive of capacity enough being stored this content is distributed in the RAM21.
At step S73 place, the information of relevant shared drive is transferred into communication application program.The processing at step S73 place is corresponding to the processing of communication application program at step S62 place.
After the details of the content of sending from client terminal 12 deposits shared drive in by communication application program, at step S74 place, from shared drive, read content, thereby and by the program of this content and immediate distribution being merged the insertion program.At step S75 place, the memory block of distributing to shared drive is released, and advances to step S76 and handle.
At step S76 place, whether judge from communication application program to have sent the appearance of message first with participant in the program that requires to cancel immediate distribution.Step S76 is corresponding to the processing of communication application program at step S16 place.When judging the message that has sent requirement cancellation appearance, handle advancing to step S77.When not sending this message, suspend the insertion that has sent content and handle, and continue to carry out other processing.
In the various processing of immediate distribution application program, series of steps shown in Figure 19 is handled corresponding to the insertion that sends content.By predetermined period or at interval repeat processing backward on schedule, carry out other various processing simultaneously from step S70.
At step S77 place, the insertion of the content that transmits from communication application program of being through with is handled.The content that the execution of immediate distribution need use the content that deposits user terminal 10 in advance in or user terminal 10 built-in or external DV cameras 29 to be caught.
The example of picture when (8) inserting several contents
In above explanation, this occasion has been described, that is: selected one of types of facial makeup in Beijing operas, it is presented at 71 li of the preview areas of the communication form 70 of user terminal 10 as inventory, and containing the motion image immediate distribution of the selected types of facial makeup in Beijing operas to client terminal 12.
1 li of content delivery system, when obtaining content such as the types of facial makeup in Beijing operas when user terminal 10 from several client terminals 12 and generating the content of immediate distribution, user terminal 10 can insert these contents.
The following describes this occasion, that is: promptly carry out immediate distribution, simultaneously several contents are inserted the former image of being provided and delivered.At this moment, for example, in state shown in Figure 5, this occasion is described, that is: has selected three types of facial makeup in Beijing operas of 71 li demonstrations of preview area of communication form 70 with reference to Figure 20.
Selecting several the types of facial makeup in Beijing operas is by for example, uses Genius mouse to click the types of facial makeup in Beijing operas by the user of user terminal 10, and it is presented at 71 li of preview areas as inventory.Petty, for example, can near preview area 71, show " all a participating in " button, it is similar to above-mentioned insertion start button 72.When the user selects " all participating in " button, all be inserted into the image of immediate distribution corresponding to whole types of facial makeup in Beijing operas of the user who sets up session with it.
When having selected several the types of facial makeup in Beijing operas by this way, as shown in figure 20, the selected types of facial makeup in Beijing operas are inserted into the main precalculated position that monitors the preview area 53c1 of panel form 53c.Figure 20 has described this occasion, has selected three types of facial makeup in Beijing operas 100a that is:, 100b, and 100c also inserts preview area 53c1.
As three types of facial makeup in Beijing operas 100a that send from client terminal 12, when 100b, 100c are inserted into the former image of being provided and delivered, contain the image of being provided and delivered that inserts image and be sent to stream delivery server 13 and immediate distribution to client terminal 12.Thereby client terminal 12 is browsed and is contained three insertion types of facial makeup in Beijing operas 100a, 100b, the dispensing image of 100c.
As mentioned above, because content delivery system 1 can be carried out immediate distribution, this is to be from several client terminals 12 (types of facial makeup in Beijing operas 100a by content is inserted image, this content provided and delivered, 100b, 100c) obtain, so content delivery system 1 for example, makes several users can participate in program with facilitation or meeting.So carried out more diversified and the immediate distribution of content flexibly.The specific examples of the occasion of facilitation by this way or meeting will be described below.
Provide a kind of explanation of occasion below, that is: the communication application program that runs on the client terminal 12 has this function, the various marks (images such as symbol, chart) and the types of facial makeup in Beijing operas that are sent to user terminal 10 is merged, and send this merging image.At this moment, by communication application program be shown on the client terminal 12 communication form 90 for example, be in state shown in Figure 21.Communication form 90 shown in Figure 21 is similar to shown in Figure 7.In the state shown in Figure 21, realize that the functional module of mark pooling function runs on the communication application program with modular.
As shown in figure 21, button 94a and even 94f have replaced button 92a and even 92g shown in Figure 7, and are arranged in around the portrait viewing area 91.Button 94a and even 94f are corresponding to following function.
Round button 94a, * button 94b, the triangle button 94c, quadrangle button 94d correspond respectively to the function that " circle " mark, " * " mark, " triangle " mark and " quadrangle " mark and the types of facial makeup in Beijing operas that are presented at portrait viewing area 91 merge.When the user selects one of these buttons, promptly merge with the types of facial makeup in Beijing operas corresponding to the mark of selected button.Contain the types of facial makeup in Beijing operas that merge mark and be sent to user terminal 10.The function of help button 94e and return push-button 94f corresponds respectively to help button 92d shown in Figure 7 and return push-button 92e.
For example, when the round button 94a of 90 li of communication forms shown in Figure 21 was chosen by client terminal 12, " circle " mark promptly merged with the types of facial makeup in Beijing operas of sending from client terminal 12, and was sent to user terminal 10 merging image.The types of facial makeup in Beijing operas of Fa Songing are obtained by the communication application program on the user terminal 10 by this way.As shown in figure 22, the types of facial makeup in Beijing operas that have merging " circle " mark are presented at 71 li of certain preview areas of communication form 70.
Because the immediate distribution application program obtains the types of facial makeup in Beijing operas inserted from communication application program, be inserted into former image and be presented in the preview area 53c1 that leads supervision panel form 53c so have the types of facial makeup in Beijing operas 100a of mergings " circle " mark.Image in the preview area 53c1 comprises and has the types of facial makeup in Beijing operas that merge mark, and this image is distributed to client terminal 12, as mentioned above.
1 li of content delivery system, as mentioned above, various marks can merge with the types of facial makeup in Beijing operas of immediate distribution.For example, when answering a question, the participant that the person's of being sent out requirement is answered a question indicates the respective markers of oneself, for example " circle ", " * " etc.By this way, can preside over test pulling force, meeting or discussion.Establishment and the more flexible and diversified audience of dispensing participate in program easily.
Below explanation provided a kind of occasion, wherein user terminal 10 obtains the text data sent from client terminal 12, several the types of facial makeup in Beijing operas are inserted into former image simultaneously.Below explanation is corresponding to the occasion of reference Figure 10 and even Figure 12 explanation.
At this moment, as described in reference Figure 10, when text data (text " he for example! ") when input ran on communication application program on the intended client terminal 12, the communication application program on the client terminal 12 was sent to communication application program on the user terminal 10 to text data.
The communication application program on the user terminal 10 shows gained text data (" he as shown in figure 23! ") content, its display position is corresponding to the corresponding types of facial makeup in Beijing operas of communication form 70 li client terminals 12.
The immediate distribution application program obtains text data from communication application program.The immediate distribution application program is text data (" he as shown in figure 23! ") insert preview area 53c1, and show the types of facial makeup in Beijing operas that have text data.
Be more preferably by the immediate distribution application program desired effects such as amplification are applied to user's the types of facial makeup in Beijing operas, it is corresponding to the text data source of being inserted (types of facial makeup in Beijing operas 100b in this example).Thereby, can detect easily be on earth which corresponding to types of facial makeup in Beijing operas 100a, 100b, the user of 100c have imported text data, it inserts the image of immediate distribution.The effect that is applied to the types of facial makeup in Beijing operas is not limited to amplification.As long as can detect easily is which user has imported text data on earth, and this effect is just enough.This effect for example can be, animation effect that the distortion of the types of facial makeup in Beijing operas, application are scheduled to or modified tone etc.
(9) processing when inserting several contents
When carrying out immediate distribution, while when inserting several contents in the above described manner, with reference to flow chart, a series of processing of being carried out by the communication application program on the user terminal 10 will illustrate chronologically.
10 li of user terminals, it serves as the sender of 1 li of content delivery system, the content of the memory block of distributing in RAM21 is used for carrying out immediate distribution, below with reference to Figure 24 this content is described.As shown in figure 24, the content of memory block can be classified as memory block 200 as the working region of communication application program, as the memory block 201 and the memory block 202 of sharing with the immediate distribution application program of the working region of immediate distribution application program by communication application program.
Information about each participant in participant's inventory for example comprises, the text data (character) that is used for discerning participant's participant ID, participant's name, participant's the corresponding types of facial makeup in Beijing operas, types of facial makeup in Beijing operas change sign that whether the indication types of facial makeup in Beijing operas change, sends from the participant, the character change sign whether pointing character changes, the mark of sending from the participant, the mark change sign whether cue mark changes, etc.
In the RAM21 of user terminal 10, distribute in the above-mentioned memory block, when instant dispensing application program activates communication application program, shown in the step S100 of flow process in Figure 25, communication application program and immediate distribution application program exchange various data to prepare to obtain content, for example types of facial makeup in Beijing operas of sending from client terminal 12.Because the processing of step S100 is equivalent to the processing of step S30 shown in Figure 14 and even S32, so omitted its explanation in this example.
At step S101 place, judge and whether received connection request from the communication application program of client terminal 12 activation.In other words, at step S101 place, judge contents such as whether having sent the types of facial makeup in Beijing operas 100 from client terminal 12.When connection request has been received in judgement, handle advancing to step S102.When not receiving connection request, handle advancing to step S103.
At step S102 place, the contents of sending from client terminal 12 such as the types of facial makeup in Beijing operas 100 are added into certain preview area 71 of communication form 70.Prepare the program that new participant's participation is sent from user terminal 10 below.Because the processing of step S102 is equivalent to the processing of step S40 shown in Figure 16 and even S43, so omitted its explanation in this example.
At step S103 place, judge whether require the whole users that set up session by communication application program with it all to participate in needing to select to be placed on " all participating in " button of 70 li of communication forms by for example by program, this participation of the dispensing of immediate distribution application program.When judgement requires whole users all to participate in program, handle advancing to step S104.When not requiring whole users all to participate in program, handle advancing to step S105.
At step S104 place, prepare to make the user (participant) of each client terminal 12 to participate in (appearing at) program by the dispensing of immediate distribution application program.The back also will describe the processing of step S104 in detail.
At step S105 place, judge the appearance whether require to cancel each participant who begins to participate in program at step S104 place.This cancellation needs to be selected to be placed on the insertion stop button 73 of 70 li of communication forms by the user by for example.When judging that the requirement cancellation appears on the scene, handle advancing to step S106.When not requiring cancellation to appear on the scene, handle advancing to step S107.
At step S106 place, cancellation has begun to participate in each participant's of program appearance at step S104 place.The back also will describe the processing of step S106 in detail.
At step S107 place, judge whether the content of sending from client terminal 12 (for example types of facial makeup in Beijing operas, text, mark etc.) has changed.When judging this content alteration, handle advancing to step S108.When this content does not change, handle advancing to step S109.
At step S108 place, change shown in Figure 24 sign, be that types of facial makeup in Beijing operas change sign, character change sign and/or mark change sign have changed.According to the processing of step S108, upgraded the content detail of inserting the immediate distribution application program.The back also will describe the processing of step S108 in detail.
At step S109 place, carry out the processing of upgrading timer about image.According to the processing of step S109, the content (being the types of facial makeup in Beijing operas, text, mark etc.) that obtains from client terminal 12 is sent to the immediate distribution application program at interval by preset time.The processing of user terminal 10 is loaded in order to avoid meaningless rising.The back also will describe the processing of step S109 in detail.
At step S110 place, the content that obtains from client terminal 12 is by the actual immediate distribution application program that is sent to.The back also will describe the processing of step S110 in detail.
At step S111 place, whether judge that the sender who promptly operates user terminal 10 by the user has signed and issued the requirement that finishes communication application program.When judge to require finishing, promptly by for example, communication close form 70 and finish communication application program.When not requiring to finish, handle and return step S101 place, and repeat above-mentioned series of steps.
Illustrate that below with reference to Figure 26 the appearance at above-mentioned steps S104 place begins to handle.
When the processing of step S104 begins, shown at the step S120 of Figure 26, change sign, be that types of facial makeup in Beijing operas change identifies, the character change identifies and/or mark change sign is initialised (zero clearing).At step S121 place, image is upgraded message be sent to the immediate distribution application program, upgrade image to require insertion.At step S122 place, begun image and upgraded timer.It is to be used at interval the content that obtains from client terminal 12 being sent on schedule the timer of immediate distribution application program that image upgrades timer.For example, image upgrades timer to be realized by variable, and its counting adds up on schedule at interval.When the processing at completing steps S122 place, handle advancing to step S105.
The appearance cancellation that above-mentioned steps S106 place is described below with reference to Figure 27 is handled.
When the processing of step S106 begins, shown at the step S130 of Figure 27, stopped image and upgraded timer.At step S131 place, change sign, be that types of facial makeup in Beijing operas change identifies, the character change identifies and/or mark change sign is cleared.At step S132 place, export first message, insert content to require the cancellation of immediate distribution application program.After the processing at completing steps S132 place, handle advancing to step S107.
The change identification process at above-mentioned steps S108 place is described below with reference to Figure 28.
When the processing of step S108 begins, shown at the step S140 of Figure 28, with reference to participant's inventory with the types of facial makeup in Beijing operas, the text of judging each participant and/or mark whether to have changed.Obtain the participant's of experience change participant ID.Hereinafter the participant ID of gained is called " participant IDx ".
At step S141 place, judge whether the types of facial makeup in Beijing operas have changed.When the types of facial makeup in Beijing operas have changed, handle advancing to step S142.When the types of facial makeup in Beijing operas do not change, handle advancing to step S143.
At step S142 place, set types of facial makeup in Beijing operas change sign corresponding to participant IDx in participant's inventory.Hereinafter " setting identification " speech refers to the value of sign is become " 1 " from " 0 ".After the processing at step S142 place, handle advancing to step S143.
At step S143 place, judge whether character has changed.When character has changed, handle advancing to step S144.When character does not change, handle advancing to step S147.
At step S144 place, set character change sign corresponding to participant IDx in participant's inventory.At step S145 place, character is upgraded message be sent to the immediate distribution application program, obtained text data (character) from the participant, and require the immediate distribution application program that character and the image of being provided and delivered are merged with indication.At step S146 place, image is upgraded message be sent to the immediate distribution application program.After the processing at completing steps S146 place, handle advancing to step S147.
At step S147 place, whether marker for determination has changed.When mark has changed, handle advancing to step S148.When mark does not change, promptly finished the change mark and handled, advance to step S109 and handle.
At step S148 place, set mark change sign corresponding to participant IDx in participant's inventory.At step S149 place, set types of facial makeup in Beijing operas change sign corresponding to participant IDx in participant's inventory.After the processing at completing steps S149 place, promptly finished the change mark and handled, advance to step S109 and handle.
The image that above-mentioned steps S109 place is described below with reference to Figure 29 upgrades timer processing.
When the processing of step S109 begins, shown at the step S150 of Figure 29, judge that whether having begun image upgrades timer.When judging that image renewal timer does not begin as yet, do not upgrade the image that inserts the immediate distribution application program.Upgrade timer processing so finished image, advance to step S110 and handle.When image renewal timer has begun, handle advancing to step S151.
At step S151 place, upgrade the value of timer with reference to image and judged since last time, image upgraded timer processing whether passed the scheduled time (being 1 second in this example).When judgement does not pass the scheduled time as yet, do not upgrade the image that inserts the immediate distribution application program.Upgrade timer processing so finished image, advance to step S110 and handle.When having passed the scheduled time, handle advancing to step S152.
At step S152 place, search with reference to participant's inventory and to have any participant who sets types of facial makeup in Beijing operas change sign.When judgement has this participant, handle advancing to step S153.When not having this participant, handle advancing to step S155.
At step S153 place, image is upgraded message be sent to the immediate distribution application program.At step S154 place, the types of facial makeup in Beijing operas change sign in participant's inventory is cleared.After the processing at completing steps S154 place, handle advancing to step S155.
At step S155 place, judged since setting character change sign whether passed the scheduled time (being 10 seconds in this example).When judgement has passed the scheduled time, handle advancing to step S156.When not passing the scheduled time as yet, handle advancing to step S110.According to the processing of step S155, when character was inserted the former image of immediate distribution, character only showed the scheduled time (10 second).
At step S156 place, image is upgraded message be sent to the immediate distribution application program.At step S157 place, the character change sign in participant's inventory is cleared.After the processing at completing steps S157 place, handle advancing to step S110.
The processing at above-mentioned steps S110 place is described below with reference to Figure 30.
When the processing of step S110 begins, shown at the step S160 of Figure 30, judge whether to have made inquiry, with the size (character) of inquiry text or the size (for example level and Vertical number of pixels) of image, to insert image by the dispensing of immediate distribution application program.When this inquiry has been made in judgement, handle advancing to step S161.When not making this inquiry, handle advancing to step S163.
At step S161 place, carry out and handle to prepare that character or image are sent to the immediate distribution application program.After finishing this processing, handle advancing to step S162.The back also will describe the processing of step S161 in detail.
At step S162 place, the number of characters or the image size that are transmitted by subsequent treatment are notified to the immediate distribution application program.So the immediate distribution application program is learnt number of characters or image size in advance.After the processing at completing steps S162 place, handle advancing to step S163.
At step S163 place, from immediate distribution application program address acquisition information (information of the address of indication shared drive etc.), to judge the address of whether having set shared drive, this shared drive is used for transmitting content between communication application program and immediate distribution application program, for example character or image.When this address has been set in judgement, handle advancing to step S164.When not setting this address, finish content and transmit, advance to step S111 and handle.
At step S164 place, based on the address that sets addressable (opening) shared drive.At step S165 place, the character or the image that are sent to the immediate distribution application program from communication application program are prepared memory or image preparation memory transmission (copy) to shared drive from character.At step S166 place, finish (closing) visit to the shared drive opened at step S164 place.
As mentioned above, by being sent to the character of immediate distribution application program or image copies to shared drive, the immediate distribution application program is by with reference to shared drive, can obtain the content that must obtain from communication application program.After the processing at completing steps S164 place, handle advancing to step S111.
The processing at above-mentioned steps S161 place is described below with reference to Figure 31.
When the processing of step S161 begins, shown at the step S170 of Figure 31, judge and whether prepare character is sent to the immediate distribution application program.When judging that it is got ready, handle advancing to step S171.When not getting ready, in the time of maybe needn't transmitting character, handling advancing to step S172.
At step S171 place, the text (character) that is sent to the immediate distribution application program is copied into character and prepares memory.After the processing at completing steps S171 place, handle advancing to step S162.
At step S172 place, the value of variable i is set as " 0 ", this variable i is used for each participant who appears in the image is carried out a series of subsequent step.At step S173 place, with reference to participant's inventory to obtain the corresponding types of facial makeup in Beijing operas of i participant (hereinafter referred is participant i).These types of facial makeup in Beijing operas are deposited in image and are prepared memory.
At step S174 place, identify to judge the respective symbols change of whether having set participant i with reference to participant's inventory.When this character change sign has been set in judgement, handle advancing to step S175.When not setting this character change sign, handle advancing to step S176.
At step S175 place, the types of facial makeup in Beijing operas, its quilt of amplifying participant i are deposited in image and are prepared memory.According to the processing of step S175, as shown in figure 23, amplify and show participant's the types of facial makeup in Beijing operas, this participant serves as the transmission source of inserting character.After the processing at completing steps S175 place, handle advancing to step S176.
At step S176 place, identify to judge the respective markers change of whether having set participant i with reference to participant's inventory.When this mark change sign has been set in judgement, handle advancing to step S177.When not setting this mark change sign, handle advancing to step S178.
At step S177 place, the types of facial makeup in Beijing operas, its quilt of predetermined labels being fused into participant i are deposited in image preparation memory.After the processing at completing steps S177 place, handle advancing to step S178.
At step S178 place, the currency of variable i is added 1.At step S179 place, whether the participant's number on the program whether value of decision variable i provides and delivers less than appearing at promptly, has all finished the processing backward from step S173 for whole participants.When all not finishing processing as yet, handle and return step S173 for whole participants.Carry out from step S173 processing backward for next participant.When all having finished processing, handle advancing to step S162 for whole participants.
1 li of content delivery system, communication application program is carried out above-mentioned processing, is sent to the immediate distribution application program with the content that communication application program is obtained from several client terminals 12.Thereby the immediate distribution application program can be inserted the image of being provided and delivered to several contents.
In the explanation in front, communication application program uses image to prepare the image that memory merges whole participants, and after this, communication application program is sent to the immediate distribution application program to the image that merges.Therefore, the immediate distribution application program is carried out two merging processing.A processing relates to all participant's preceding image of merging and former image merge.Another processing relates to " he that obtains from communication application program! " wait merging text (character) and former image to merge.
1 li of content delivery system, by among communication application program and the immediate distribution application program any one, carry out with any degree and merge to handle.
(10) conclusion
As mentioned above, according to content delivery system 1, immediate distribution application program and communication application program closely cooperate, and this feasible content of sending from client terminal 12 can be inserted the content by user terminal 10 immediate distributions.Implement the execution that cooperates that above-mentioned a series of processing is not limited to immediate distribution application program and communication application program.For example, above-mentioned a series of processing can be implemented by single application program.
1 li of foregoing delivery system, content delivery system comprises user terminal 10, it receives content of sending from client terminal 12 and the content that generates immediate distribution, and flowing delivery server 13, its content converting to client terminal 12, this content is generated with immediate distribution by user terminal 10.Petty, user terminal 10 can comprise service function, promptly the content converting of immediate distribution to several client terminal 12a, 12b, 12c ....At this moment, the user terminal 10 that serves as the sender freely is provided by the contents such as motion image, static images or text that provided by each client terminal 12, and this content of providing and delivering.Can with the viewer/listener of distributed contents exchange message and viewpoint glibly.
In addition, software program can be used to instruct the electronic equipment of wishing to carry out processing, this processing corresponding to above-mentioned communication application program and the performed processing of immediate distribution application program, this software program can be provided by various recording mediums, has stored this software program on this recording medium.
According to the present invention, content directly is sent to sender's device from another device.So the content of distributed contents is inserted in exchange glibly.According to the present invention, the device that serves as the sender inserts content and this content of providing and delivering that is sent to the content that viewer/listener is sent.The contents such as motion image, static images or text that sender's device freely uses the device by viewer/listener to provide, and this content of providing and delivering.So can be between the sender of distributed contents and viewer/listener exchange message and viewpoint very glibly.
According to the present invention, content converting relates to the motion image that the strange land supplier away from the sender is supplied with and imports the program of immediate distribution and be connected to place, number place with relaying technique, can easily become possibility.
Claims (4)
1. dispensing device, it is connected to the server unit of distributed contents via network and receives a plurality of watching/listening device by the content of server unit dispensing, and this dispensing device comprises:
Communication component is used for communicating by letter with another device via network; With
Control assembly is used to generate the content that will be dispensed into described watching/listening device via server unit,
Wherein this control assembly is carried out following the processing, comprising:
Acquisition will be dispensed into the 1st content of described watching/listening device via server unit;
Install the 2nd content that direct acquisition will be dispensed into described watching/listening device via server unit from described another that is connected to network;
Use the 1st content and the 2nd content to generate the transmission content that will be sent to server unit; With
Via communication component the transmission content is sent to server unit.
2. according to the dispensing device of claim 1, wherein, control assembly obtains the 2nd content via communication component from one of described watching/listening device, and one of described watching/listening device receives the content by the server unit dispensing that is connected to network.
3. the sending method of using in the dispensing device, this dispensing device are connected to the server unit of distributed contents via network and receive a plurality of watching/listening device by the content of server unit dispensing, and this sending method may further comprise the steps:
(a) communicate by letter with another device via network; With
(b) generate the content that will be dispensed into described watching/listening device via server unit,
Wherein this step (b) is further comprising the steps of:
(b1) acquisition will be dispensed into the 1st content of described watching/listening device via server unit;
(b2) install the 2nd content that direct acquisition will be dispensed into described watching/listening device via server unit from described another that is connected to network;
(b3) use the 1st content and the 2nd content to generate the transmission content that will be sent to server unit; With
(b4) the transmission content is sent to server unit.
4. according to the sending method of claim 3, wherein, in step (b), obtain the 2nd content from one of described watching/listening device, one of described watching/listening device receives the content by the server unit dispensing that is connected to network.
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP284192/01 | 2001-09-18 | ||
JP2001284192 | 2001-09-18 | ||
JP023376/02 | 2002-01-31 |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CNB028035240A Division CN1237806C (en) | 2001-09-18 | 2002-09-13 | Device and method for transmission, system and method for contents distribution and program |
Publications (1)
Publication Number | Publication Date |
---|---|
CN1783795A true CN1783795A (en) | 2006-06-07 |
Family
ID=32012258
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN 200510126987 Pending CN1783795A (en) | 2001-09-18 | 2002-09-13 | Device and method for transmission |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN1783795A (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101520719B (en) * | 2008-02-27 | 2013-06-05 | 威盛电子股份有限公司 | System and method for sharing display information |
-
2002
- 2002-09-13 CN CN 200510126987 patent/CN1783795A/en active Pending
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101520719B (en) * | 2008-02-27 | 2013-06-05 | 威盛电子股份有限公司 | System and method for sharing display information |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN1237806C (en) | Device and method for transmission, system and method for contents distribution and program | |
CN1200364C (en) | Server use method, server use reservation management apparatus, and program storage medium | |
CN1167270C (en) | Content distribution method, reservation management device and program storage medium | |
CN1258291C (en) | Multimedia information communication service system, user terminal program, and recording medium | |
CN1263302C (en) | Remote meeting system, supporting method of same, and computer program | |
CN1293504C (en) | Information recording device and method, information processing terminal, method and equipment and recording medium | |
CN1171456C (en) | Content distribution reservation method, content distribution method reservation management device, and program storage medium | |
CN1231061C (en) | Broadcast and reception system, and conditional access system therefor | |
CN100352271C (en) | Device and method for processing image | |
CN1277389C (en) | Information distribution system and distribution server | |
CN1518699A (en) | Information image utilization system, information image management apparatus, information image management method, user information image, program, and recording medium | |
CN1231016C (en) | Communication infrastructure arrangement for multiuser | |
CN1254097C (en) | Program recording system, remote control appts., method, and program | |
CN1777273A (en) | Information processing apparatus and method, recording medium, and program | |
CN1248129C (en) | Communication system and its server, communicatron method and record medium | |
CN101057237A (en) | Method and system for correlating content with linear media | |
CN100348021C (en) | Information processing apparatus | |
CN1522407A (en) | Information image utilizing system, information image managing server, information image managing method, apparatus information image, program and recording medium | |
CN1755695A (en) | Information processing device, method, and program | |
CN1539250A (en) | Device control apparatus and device control system | |
CN1744692A (en) | Information processing system, recording apparatus, communication apparatus, information processing method | |
CN1326638A (en) | Television set-top box with configurable functionality | |
CN1615646A (en) | Communication apparatus | |
CN1728817A (en) | Information-processing apparatus, information-processing methods, recording mediums, and programs | |
CN1756173A (en) | Audio signal transmission system, audio signal transmission method, server, network terminal device, and recording medium |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
C12 | Rejection of a patent application after its publication | ||
RJ01 | Rejection of invention patent application after publication |
Open date: 20060607 |