CN110557674A

CN110557674A - Intelligent screen projection playing and transmitting method and device

Info

Publication number: CN110557674A
Application number: CN201810541003.4A
Authority: CN
Inventors: 王焕煜; 刘斌; 李宗亮; 刘强
Original assignee: Global Tiancheng Technology (beijing) Co Ltd
Current assignee: Global Tiancheng Technology (beijing) Co Ltd
Priority date: 2018-05-30
Filing date: 2018-05-30
Publication date: 2019-12-10

Abstract

The application discloses intelligent screen projection playing and transmitting methods and devices. The method comprises the following steps: displaying program content of a predetermined type on a program selection interface of a large-screen media application; responding to the selection of the program content of the preset type, and searching a small-screen terminal which is in the same local area network with the large-screen terminal and is consistent with a media stream sharing protocol; sending a screen-casting playing instruction to one of the searched small-screen terminals, wherein the screen-casting playing instruction is used for instructing one of the mobile terminals to cast screen-casting the program content of the preset type to the large-screen terminal based on the media stream sharing protocol; and receiving the resource information of the program content of the preset type fed back by one of the small screen terminals and playing the program content of the preset type. According to the scheme, the large-screen terminal is not limited by the media content which can be watched by the broadcast control platform any more, and more possibilities are provided for the media content of the large-screen terminal.

Description

Intelligent screen projection playing and transmitting method and device

Technical Field

The invention belongs to the technical field of screen projection, and particularly relates to an intelligent screen projection playing and transmitting method and device.

background

In the prior art, interaction between a large-screen terminal such as a television and a mobile terminal such as a mobile phone is still limited to the situation that the mobile terminal unilaterally initiates network interconnection to realize a media transmission state, and the capability of a user to actively pull and display media data on the large-screen terminal cannot be met.

the existing DLNA (Digital Living Network Alliance) screen projection function is only initiated by a mobile phone in the video industry, and the television end is mainly passively accepted. The method mainly establishes a screen projection function by directly using equipment and equipment through a standard DLNA, and more is realized by the functions of a technical level.

the inventor finds that in the process of implementing the application, the prior art does not make corresponding optimization aiming at the user requirements and the user experience. Because the screen-casting operation is initiated by the mobile phone end, the use habit of the traditional television watching crowd is not met, and the use condition of the old and children can not be met frequently.

Disclosure of Invention

The embodiment of the invention provides an intelligent screen projection playing and transmitting method and device, which are used for solving at least one of the technical problems.

in a first aspect, an embodiment of the present invention provides an intelligent screen projection playing method for a large-screen terminal, including: displaying program content of a predetermined type on a program selection interface of a large-screen media application, wherein the program content of the predetermined type comprises: applying program contents which are not authorized in the large-screen media but authorized in the small-screen media, wherein the small-screen media application and the large-screen media application belong to associated applications provided by a service provider, and the small-screen media application is suitable for a small-screen terminal; responding to the selection of the program content of the preset type, and searching a small-screen terminal which is in the same local area network with the large-screen terminal and is consistent with a media stream sharing protocol; sending a screen-casting playing instruction to one of the searched small-screen terminals, wherein the screen-casting playing instruction is used for instructing one of the mobile terminals to cast screen-casting the program content of the preset type to the large-screen terminal based on the media stream sharing protocol; and receiving the resource information of the program content of the preset type fed back by one of the small screen terminals and playing the program content of the preset type.

in a second aspect, an embodiment of the present invention provides an intelligent screen projection transmission method for a small-screen terminal, including: starting a local area network connection sharing process based on the installed small-screen media application; after establishing local area network connection with a large-screen terminal installed with a large-screen media application based on the local area network connection sharing process and passing verification, receiving a screen projection playing instruction of program contents of a preset type from the large-screen terminal, wherein the small-screen terminal and the large-screen terminal are in the same local area network and the media stream sharing protocol is consistent, and the screen projection playing instruction comprises program information of the program contents of the preset type; searching whether the program content of the preset type exists or not based on the program information; and if the preset type of program content exists, feeding back the resource information of the preset type of program content to the large-screen terminal.

In a third aspect, an embodiment of the present invention provides an intelligent screen projection playing device, which is used for a large-screen terminal, and includes: a presentation module configured to present a predetermined type of program content on a program selection interface of a large screen media application, wherein the predetermined type of program content comprises: applying program contents which are not authorized in the large-screen media but authorized in the small-screen media, wherein the small-screen media application and the large-screen media application belong to associated applications provided by a service provider, and the small-screen media application is suitable for a small-screen terminal; the searching module is configured to respond to the selection of the program content of the preset type and search for a small-screen terminal which is in the same local area network with the large-screen terminal and is consistent with a media stream sharing protocol; the instruction module is configured to send a screen-casting playing instruction to one of the searched small-screen terminals, wherein the screen-casting playing instruction is used for instructing one of the mobile terminals to screen-cast and play the program content of the preset type to the large-screen terminal based on the media stream sharing protocol; and the playing module is configured to receive the resource information of the program content of the preset type fed back by the one of the small-screen terminals and play the program content of the preset type.

In a fourth aspect, an embodiment of the present invention provides an intelligent screen projection transmission device, which is used for a small-screen terminal, and includes: the process starting module is configured to start a local area network connection sharing process based on the installed small-screen media application; the receiving module is configured to receive a screen-casting playing instruction of a program content of a preset type from a large-screen terminal after the local area network connection is established and verified with the large-screen terminal installed with a large-screen media application based on the local area network connection sharing process, wherein the small-screen terminal and the large-screen terminal are in the same local area network and the media stream sharing protocol is consistent, and the screen-casting playing instruction comprises program information of the program content of the preset type; the searching module is configured to search whether the program content of the preset type exists or not based on the program information; and the feedback module is configured to feed back the resource information of the program contents of the preset type to the large-screen terminal if the resource information exists.

In a fifth aspect, an embodiment of the present invention provides an intelligent screen projection system, which includes the intelligent screen projection playing device according to the third aspect and the intelligent screen projection transmission device according to the fourth aspect.

In a sixth aspect, an embodiment of the present invention further provides an electronic device, which includes: the system comprises at least one processor and a memory which is in communication connection with the at least one processor, wherein the memory stores instructions which can be executed by the at least one processor, and the instructions are executed by the at least one processor, so that the at least one processor can execute the steps of the intelligent screen projection playing method and/or the intelligent screen projection transmission method of any embodiment of the invention.

In a seventh aspect, the present invention further provides a computer program product, where the computer program product includes a computer program stored on a non-volatile computer-readable storage medium, where the computer program includes program instructions, and when the program instructions are executed by a computer, the computer is caused to execute the steps of the smart screen projection playing method and/or the smart screen projection transmission method according to any embodiment of the present invention.

The embodiment of the invention can enable a user to select the large-screen media to apply unauthorized programs by displaying the program contents of the preset type on the program selection interface, and then ask for resources from the small-screen terminal by searching the small-screen terminal which is under the same local area network and has the same media stream sharing protocol, so that the program library of the large-screen terminal can be expanded, and the user experience is better. Further, the large-screen terminal is not limited to the media content which can be watched by the broadcast control platform, and more possibilities are provided for the media content of the large-screen terminal.

drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on the drawings without creative efforts.

Fig. 1 is a flowchart of an intelligent screen projection playing method according to an embodiment of the present invention;

Fig. 2 is a flowchart of another intelligent screen projection playing method according to an embodiment of the present invention;

fig. 3 is a flowchart of an intelligent screen projection transmission method according to an embodiment of the present invention;

fig. 4 is a flowchart of another intelligent screen projection transmission method according to an embodiment of the present invention;

Fig. 5 is a flowchart of another intelligent screen projection transmission method according to an embodiment of the present invention;

Fig. 6a and fig. 6b are service logic diagrams of two application scenarios of the intelligent screen projection scheme according to an embodiment of the present invention, respectively;

Fig. 7 is a block diagram of an intelligent screen projection playing device according to an embodiment of the present invention;

Fig. 8 is a block diagram of an intelligent screen projection transmission device according to an embodiment of the present invention;

Fig. 9 is a block diagram of an intelligent screen projection system according to an embodiment of the present invention;

Fig. 10 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.

Detailed Description

In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

It should be noted that the embodiments and features of the embodiments in the present application may be combined with each other without conflict.

The invention may be described in the general context of computer-executable instructions, such as program modules, being executed by a computer. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform particular tasks or implement particular abstract data types. The invention may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in both local and remote computer storage media including memory storage devices.

as used herein, a "module," "system," and the like are intended to refer to a computer-related entity, either hardware, a combination of hardware and software, or software in execution. In particular, for example, an element may be, but is not limited to being, a process running on a processor, an object, an executable, a thread of execution, a program, and/or a computer. Also, an application or script running on a server, or a server, may be an element. One or more elements may be in a process and/or thread of execution and an element may be localized on one computer and/or distributed between two or more computers and may be operated by various computer-readable media. The elements may also communicate by way of local and/or remote processes based on a signal having one or more data packets, e.g., from a data packet interacting with another element in a local system, distributed system, and/or across a network in the internet with other systems by way of the signal.

Finally, it should be further noted that the terms "comprises" and "comprising," when used herein, include not only those elements but also other elements not expressly listed or inherent to such processes, methods, articles, or devices. Without further limitation, an element defined by the phrase "comprising … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.

Referring to fig. 1, a flowchart of an embodiment of an intelligent screen-projection playing method according to the present invention is shown, where the intelligent screen-projection playing method of the present embodiment is applicable to an intelligent screen-projection playing platform or an intelligent screen-projection playing device, and is mainly used in a large-screen terminal.

As shown in fig. 1, in step 101, program content of a predetermined type is presented on a program selection interface of a large-screen media application;

In step 102, in response to the selection of the program content of the preset type, searching a small-screen terminal which is in the same local area network with the large-screen terminal and has the same media stream sharing protocol;

In step 103, a screen-casting playing instruction is sent to one of the searched small-screen terminals, wherein the screen-casting playing instruction is used for instructing one of the mobile terminals to cast screen-casting a program content of a predetermined type to the large-screen terminal based on a media stream sharing protocol;

In step 104, receiving the resource information of the program content of the predetermined type fed back by one of the small-screen terminals and playing the program content of the predetermined type.

In this embodiment, for step 101, the smart screen-projection playing apparatus presents program contents of a predetermined type on a program selection interface of a large-screen media application, where the program contents of the predetermined type include: the program content which is not authorized is applied to the large-screen media, but authorized program content is applied to the small-screen media, the small-screen media application and the large-screen media application belong to associated applications provided by a service provider, and the small-screen media application is suitable for the small-screen terminal. For example, the large-screen media application may be a television video application, the small-screen media application may be a television assistant installed on a cell phone, the television video application and the television assistant on the cell phone are associated applications, and the predetermined type of program content may be a program that is unauthorized on the television but authorized on the cell phone. The display mode may be a mode in which a special primary or secondary interface displays the program of the predetermined type, or may be a mode in which the program is displayed together with a program authorized by a general large-screen media application, or may be a mode in which the program in which the authorized program is displayed in an extended key, which is not limited herein. Further, the user may be made completely unaware of the source of the program if presented with the authorized program, or may be made aware of the additional functionality of the large-screen media application if presented separately in an otherwise more eye-catching manner, each of which may be advantageous or disadvantageous, and the present application is not limited in this respect. It should be noted that, the large-screen terminal and the small-screen terminal are opposite, the large-screen terminal may further include other devices with a larger screen, such as a computer, and the small-screen terminal may further include a tablet, and the application is not limited in this respect.

Then, for step 102, the intelligent screen-casting playing device searches for a small-screen terminal under the same local area network and having a consistent media stream sharing protocol in response to the user clicking on the program content of the predetermined type. For example, when a user clicks program contents of a predetermined type on a television video application, first, whether a mobile phone with an associated television assistant is installed under a local area network where the television is located may be searched, if not, the user may be prompted to download the corresponding television assistant, if so, the process may jump to step 103, and the intelligent screen-casting playing device sends a screen-casting playing instruction to one of the searched small-screen terminals, where the screen-casting playing instruction is used to instruct one of the mobile terminals to screen-cast and play the program contents of the predetermined type to the large-screen terminal based on a media stream sharing protocol. The media stream sharing protocol is, for example, the DLNA protocol, or other known or future developed protocol. One of the small-screen terminals is, for example, the small-screen terminal which is most stable in connection signal, fastest in transmission speed, most frequently used and/or idle among the searched small-screen terminals. For example, three small-screen terminals are found in the same local area network, and one of the small-screen terminals that is frequently used before can be selected according to the history information, the transmission speed or stability of each device can be tested, and the most stable or fastest transmission speed can be selected, or whether the small-screen terminal is idle or not can be detected by using, for example, a television assistant, and the idle one can be selected, which is not limited in this respect.

Then, for step 104, the intelligent screen-projection playing device receives the resource information of the program content of the predetermined type fed back by the one of the small-screen terminals and plays the program content of the predetermined type. In some optional embodiments, the small-screen terminal may feed back a local Resource or a URL (Uniform Resource Locator), which is not limited herein.

According to the method, the program content of the preset type is displayed on the program selection interface, the user can select the unauthorized program of the large-screen media application, and then the small-screen terminal under the same local area network and consistent in media stream sharing protocol is searched to ask for resources from the small-screen terminal, so that the program library of the large-screen terminal can be expanded, and the user experience is better.

Further referring to fig. 2, which shows a flowchart of another embodiment of the intelligent screen-casting playing method according to the present invention, the intelligent screen-casting playing method of the present embodiment may be applied to an intelligent screen-casting playing platform or an intelligent screen-casting playing apparatus.

As shown in fig. 2, in step 201, in the process of playing the program content of the predetermined type, in response to the large-screen terminal being disconnected from the small-screen terminal, recording a playing interruption point of the program content of the predetermined type, and determining a continuous playing start position of the program content of the predetermined type based on the playing interruption point;

in step 202, a small-screen terminal which is in the same local area network as the large-screen terminal and has the same media stream sharing protocol is searched again;

In step 203, sending an interruption continuous playing instruction to one of the searched small-screen terminals, wherein the interruption continuous playing instruction is used for indicating that the one of the searched small-screen terminals starts playing from a starting position when the screen is projected;

In step 204, the resource information of the program content of the predetermined type fed back by one of the searched small-screen terminals is received and the program content of the predetermined type is played.

in this embodiment, as to step 201, in the process of playing a program, if an abnormal condition occurs and the connection between the large-screen terminal and the small-screen terminal is disconnected, the intelligent screen-casting playing apparatus may record a terminal point of playing the program, and then determine a start position of continuous playing in the next continuous playing according to the interrupted point. In some optional embodiments, the interruption point may be located on an intermediate frame of one of the multiple code streams of the program, and at this time, a first frame of the one code stream may be used as a resume start position, or an end frame of the one code stream may be used as a resume start position, which is not limited in this respect. Then, in step 202, due to the connection interruption, the small-screen terminal that is in the same local area network as the large-screen terminal and that is consistent with the media stream sharing protocol needs to be searched again. In some optional embodiments, if the search is not available, a prompt message such as "connection failure" may be displayed on the play interface of the large-screen terminal, and if the search is available, a prompt message such as "buffering" may be displayed, which is not limited herein. It should be noted that, the abnormal condition may be that the small-screen terminal fails or leaves the same local area network, which results in disconnection, and the re-search after disconnection may be a new small-screen terminal or the same small-screen terminal as that in the previous play, and the application is not limited in this respect.

then, for step 203, after the small-screen terminal is searched, an interruption continuous playing instruction may be sent to the re-searched one of the small-screen terminals to instruct the small-screen terminal to start playing from the continuous playing start position when the small-screen terminal casts a screen. Finally, step 204 is the same as step 104 in fig. 1, and is not described herein again.

in some optional embodiments, the resource information of the program content of the predetermined type mentioned in the above and subsequent embodiments includes a local resource of the program content of the predetermined type of one of the small screen terminals or a URL of the program content of the predetermined type.

According to the scheme of the embodiment, the breakpoint continuous playing is carried out according to the connection interruption condition, so that the user does not need to restart the playing due to a network problem, and the user can have the same viewing experience as watching the authorized video of the large-screen terminal in a reconnection mode.

Referring to fig. 3, a flowchart of an intelligent screen projection transmission method according to an embodiment of the present invention is shown. The intelligent screen projection playing method can be suitable for an intelligent screen projection transmission platform or an intelligent screen projection transmission device and is mainly used for small-screen terminals.

As shown in fig. 3, in step 301, based on the installed small-screen media application, a local area network connection sharing process is started;

in step 302, after establishing a local area network connection with a large-screen terminal installed with a large-screen media application based on a local area network connection sharing process and passing verification, receiving a screen projection playing instruction of a program content of a preset type from the large-screen terminal;

In step 303, based on the program information, searching whether program contents of a predetermined type exist;

In step 304, if yes, feeding back resource information of program contents of a predetermined type to the large-screen terminal.

In this embodiment, for step 301, after the small-screen media application is installed, the smart screen-projection transmission apparatus may keep a background lan connection sharing process in an on state, for example, com. Then, for step 302, after the small-screen terminal and the large-screen terminal establish a connection through the lan connection sharing process and pass security verification, a screen-casting playing instruction of a predetermined type of program content from the large-screen terminal may be received, where the small-screen terminal and the large-screen terminal are in the same lan and the media stream sharing protocol is consistent, the screen-casting playing instruction includes program information of the predetermined type of program content, and the predetermined type of program content includes: the program content which is not authorized is applied to the large-screen media, but authorized program content is applied to the small-screen media, the small-screen media application and the large-screen media application belong to associated applications provided by a service provider, and the small-screen media application is suitable for the small-screen terminal. The large-screen media application is, for example, a television video application, the small-screen media application is, for example, a television assistant installed on the mobile phone, the television video application and the television assistant on the mobile phone are associated applications, and the program content of the predetermined type may be a program that is not authorized on the television but is authorized on the mobile phone. The program information may include a program ID.

Then, in step 303, the intelligent screen transmission device may search whether the program content exists in the program library according to the program information. Finally, in step 304, if the library contains the program content of the predetermined type, the resource information of the program content is fed back to the large-screen terminal. Further, the program library may include a local program library, and may also include a program library on the server side. The resource information may be a data file of the program content, or may be address information, such as a URL, storing the program content.

according to the scheme of the embodiment, after the small-screen media application is installed on the small-screen terminal, the background is started to connect and share the local area network, so that the small-screen terminal can be searched under the same local area network at any time, and further, the resource information of the required program content transmitted to the large-screen terminal can be received by the instruction of the large-screen terminal, therefore, the user only needs to click the wanted program on the large-screen terminal, the large-screen terminal sends the instruction to enable the small-screen terminal to reversely throw the screen, the small-screen terminal is not aware in the whole process, screen throwing operation is simplified, and the screen throwing operation can be suitable for more extensive crowds.

With further reference to fig. 4, a flowchart of another intelligent screen projection transmission method provided by an embodiment of the present invention is shown. This embodiment is mainly directed to the case of a resume after a connection interruption.

as shown in fig. 4, in step 401, an interruption resuming instruction from the large-screen terminal is received, where the interruption resuming instruction includes program information of a predetermined type of program content and a resuming start position;

In step 402, the program content of the predetermined type is searched based on the program information, and the resource information of the program content of the predetermined type including the resume start position is fed back to the large-screen terminal.

in this embodiment, for step 401, the intelligent screen-casting transmission device receives an interruption continuous playing instruction of the large-screen terminal, then in step 402, searches the program content of the predetermined type in the database according to the program information in the interruption continuous playing instruction, and then feeds back the resource information of the program content with the continuous playing start position to the large-screen terminal. The resource information may be a data file, or may be a storage address such as a URL, and the application is not limited herein.

the method of the embodiment can realize continuous playing from the determined continuous playing starting position related to the interruption under the condition that the user does not perceive by receiving the interruption continuous playing instruction from the large-screen terminal.

With further reference to fig. 5, a flowchart of another intelligent screen projection transmission method provided by an embodiment of the present invention is shown. The flow chart is primarily a flow chart of steps further refined with respect to step 303 in fig. 3.

As shown in fig. 5, in step 501, based on the program information, it is searched whether program contents of a predetermined type exist in a local program library of the small-screen terminal;

In step 502, if not, it is searched whether program contents of a predetermined type exist in a server program library of the small-screen terminal.

In this embodiment, for step 501, when searching the database according to the program information, the intelligent screen projection transmission device may first search whether related resources exist in the local program library of the small-screen terminal, and if so, may directly transmit the resources to the large-screen terminal. Then for 502, if there are no relevant resources in the local program library, then a search in the program library of the server is needed. If the program library of the server does not exist, the prompting information such as 'no relevant resource can be found' can be fed back to the large-screen terminal, and if the relevant resource exists, the storage address of the resource, such as a URL (uniform resource locator), can be fed back to the large-screen terminal. According to the scheme of the embodiment, because the local database is searched, if the local database exists, the transmission efficiency can be improved to a certain extent, and if the local database does not exist, the local database can be quickly transmitted through the same local area network, and an address can be sent to enable the large-screen terminal to find the local database.

In some optional embodiments, if the program content of the predetermined type exists in the local program library, transmitting a local resource of the program content of the predetermined type to the large-screen terminal; or if the program content of the preset type does not exist in the local program library and the program content of the preset type exists in the server program library, feeding back the URL of the program content of the preset type to the large-screen terminal.

It should be noted that for simplicity of explanation, the foregoing method embodiments are described as a series of acts or combination of acts, but those skilled in the art will appreciate that the present invention is not limited by the order of acts, as some steps may occur in other orders or concurrently in accordance with the invention. Further, those skilled in the art should also appreciate that the embodiments described in the specification are preferred embodiments and that the acts and modules referred to are not necessarily required by the invention.

in the foregoing embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.

Fig. 6a and fig. 6b are service logic diagrams of two application scenarios of the intelligent screen projection scheme according to an embodiment of the present invention. The scheme of the present application is described below with an example of a specific application scenario, which is only for better illustrating the scheme of the present application, and the scheme of the present application can also be used in other similar application scenarios, and is not described herein again. Although the large-screen terminal is limited to be a television and the small-screen terminal is a mobile phone in the example of the specific application scenario, a person skilled in the art can know that other combinations are also possible, and the application is not limited in this respect.

In the prior art, roles of a client and an intelligent device are defined by the DLNA standard: when the mobile phone only projects the network video to the television, the Control Point is played by the mobile phone, and the rendering device or the playing device is played by the television or the set-top box. The method specifically comprises the following steps:

1. Addressing:

the address is a basic condition for the entire UPnP system to operate, and each device should be a client of a DHCP (Dynamic Host Configuration Protocol). After the equipment establishes connection with the network for the first time, the equipment obtains an IP address by using DHCP service. This IP address may be specified by the DHCP system or may be selected by the device.

2. the following are found:

The method can be divided into two cases, wherein one case is that whether corresponding available equipment exists or not is searched in the current network after a control request exists; another situation is that after accessing the network and obtaining the IP address, a device starts to "broadcast" to the network that it has entered the network, i.e. looks for a control request.

3. the following steps are described:

In brief, this is the device that declares "itself" what it is, e.g., name, manufacturer, serial number, etc. Just after "discovering" a device, the control point has little "knowledge" of the device, and needs to find the device's description files according to ULR, and read more description information from these files. The descriptive information is of a wide range and is typically provided by the manufacturer of the device. The main description items are: the schema name and number of the control, the equipment serial number, the manufacturer name, the ULR of the manufacturer's WEB, etc. These are typically stored in a special XML file.

4. Controlling:

after the control point finds the device description, the control point "abstracts" the operations to be performed from the description and learns all the services; these descriptions must be very precise and detailed for each UPnP device, and may contain command or action lists, service response information, parameters used, and so on. For each action of the service, there is also accompanying descriptive information: mainly variables, data types of variables, available value ranges and characteristics of events during the whole service process.

To control a device, the control point must first send a control action request requesting the device to start service, and then send corresponding control messages, i.e., those SOAP-formatted messages placed in an XML file, according to the ULR of the device. Finally, the service returns a response indicating whether the service succeeded or failed.

5. Event:

Whenever a variable value changes or the state of a pattern changes during the entire time the service is running, an event is generated and the system will modify the content of the above mentioned event list. The event server then broadcasts the event throughout the network. On the other hand, the control point can also reserve the event information to the event server in advance, and the events interested by the control point are ensured to be transmitted timely and accurately.

Broadcast or subscribe to events, which are all transmitted as event messages, which are also placed in an XML file, in the format GENA. The initialization process, which is the preparation of the device before it is put into operation, is also an event, and the various information required for initialization is also transmitted using event messages. The content of the method is mainly as follows: variable initial values, initial state of the mode, etc.

6. and (3) displaying:

once the ULR of a device is obtained, the ULR of the device expression page can be retrieved and then this expression can be incorporated into the user's local browser. This section also includes the interface to talk to the user and the process of conducting a conversation with the user.

The inventor finds that the prior art has at least the following defects:

1. the existing DLNA screen projection function is only initiated by a mobile phone in the video industry, and the television end is mainly passively accepted. The screen projection function is mainly established by the equipment through the standard DLNA, more functions in the technical level are realized, and the user requirements and the user experience are not correspondingly optimized.

2. Because the screen-casting operation is initiated by the mobile phone end, the use habit of the traditional television watching crowd is not met, and the use condition of the old and children can not be met frequently.

the inventor mainly changes the screen projection form under the use scene and the family scene in the current screen projection process. The original mode that the mobile terminal initiatively casts the screen is changed into a mode that the television terminal initiatively initiates a screen casting instruction, the mobile phone terminal provides a URL address, and finally the television terminal plays a reverse request operation. The operation is the same as the traditional screen projection in the final result, the wanted content is displayed at the television end, and in the operation process, the reverse screen projection can be completed only by operating the television end compared with the traditional voting, and the operation does not need to be performed by using a mobile phone end, so that the operation which can be completed by simultaneously operating a plurality of devices is further simplified.

One embodiment of the application adopts a DLNA protocol, a large screen terminal is used as a Digital Media Controller (DMC) to search for a mobile terminal device of a Digital Media Server (DMS) that can provide Digital Media content sharing in the same local area network, a Media file that can be played on the DMS is searched through the DMC, and then the Media file is assigned to the large screen terminal to play the content, where the large screen terminal is the Digital Media Server (DMS) and also a Digital Media Player (DMP), thereby completing the operation of reversely projecting the screen of the large screen terminal. For improvement of a television end, only service needs to be written in an application layer of the television, and the service does not have a separate process, so when a user uses the app of the embodiment of the application, the related service cannot be killed by other applications, which is a mechanism of an android system layer.

Fig. 6a shows an application scenario of the smart screen projection scheme.

as shown in fig. 6a, when a user designates an APP using an internet tv, a mobile terminal device of a Digital Media Server (DMS) that can provide digital media content sharing in a local area network is searched by a Digital Media Controller (DMC) in the DLNA protocol, the internet tv terminal APP searches for a media archive playable on the digital media service through the Digital Media Controller (DMC), and when a program that the user browses and tries to watch in the internet tv terminal APP is found and found, the Digital Media Controller (DMC) notifies the internet tv terminal APP: the searched programs can be played on the internet television APP by a Digital Media Player (DMP).

Specifically, after the television terminal APP is started, the search service can be started, the network self-adaption function is achieved, and when the network connection changes, the service can be automatically restarted. Following the DLNA protocol. When a user browses a channel list in an internet television terminal APP, but the internet television terminal does not have the program source data, the method and the device can search the APP with the program source data in the mobile terminal equipment in the same local area network and screen the APP reversely to the internet television terminal for playing under the condition that the user does not sense the APP. When the corresponding local area network equipment is not searched, a channel list and a program list are provided, and after the user clicks, the user is prompted to download a mobile phone APP (a television assistant in the figure). When the program without the program source data is displayed in the television terminal APP, the program can be a single application page, belongs to a secondary page below a launcher, and exists in an application form.

after a user clicks a program without program source data of the large-screen terminal, the processing steps of the television terminal and the mobile phone terminal are as follows: 1. the television end sends a playing request which comprises program information (searching for the mobile phone equipment, a user may need to wait, and when the mobile phone equipment cannot be found, a playing failure is prompted); 2. transmitting the request to the mobile terminal via the WiFi private protocol; 3. the mobile phone end finds the program from the program library; 4. the mobile phone end casts the URL to the television end through a DLNA protocol (the screen casting function is that a user may need to wait); 5. the tv-side plays the URL (possibly prompting the play buffer).

fig. 6b shows another application scenario of the smart screen projection scheme.

As shown in fig. 6b, when the television terminal detects that the mobile phone providing the service has a problem and cannot continue to provide the service, the television terminal stores the current program information, then sends SEARCH broadcast message to the local area network to SEARCH for a new mobile phone, if the new mobile phone is searched, establishes connection with the new mobile phone, sends a play request to the mobile phone terminal according to the program information, starts playing, sends a SEEK request to the mobile phone terminal, and jumps to a specified position to play. The television end can display the buffering prompt in the whole process without exiting or resetting the operation. Thereby realizing seamless connection. Furthermore, the APP at the mobile phone end can also play/pause, fast forward and fast backward through a DLNA control protocol.

In the process of implementing the application, the inventor mainly adopts the following technologies: 1. the large-screen terminal is used as a mobile terminal device technology for DMC active discovery of other DLNA supported mobile terminals in the local area network; 2. the large screen terminal searches a media file technology in a DMS (mobile terminal) by using the DMC; 3. and the large screen terminal reversely casts the media files in the mobile terminal into the large screen terminal.

Due to the adoption of the technical scheme, when the large-screen terminal equipment plays the media content from the mobile terminal equipment, the large-screen terminal is not limited by the media content which can be watched by the playing control platform any more, and more possibilities are provided for the media content of the large-screen terminal.

fig. 7 is a block diagram of an intelligent screen projection playing device according to an embodiment of the present invention. As shown in fig. 7, the smart screen-projection playing device 700, which is used for a large-screen terminal, includes a presentation module 710, a search module 720, an instruction module 730, and a playing module 740.

the presentation module 710 is configured to present program contents of a predetermined type on a program selection interface of a large-screen media application, where the program contents of the predetermined type include: the method comprises the steps that program contents which are not authorized are applied to large-screen media, but authorized program contents are applied to small-screen media, the small-screen media application and the large-screen media application belong to associated applications provided by a service provider, and the small-screen media application is suitable for a small-screen terminal; a searching module 720, configured to search for a small-screen terminal that is in the same local area network as the large-screen terminal and that is consistent with the media stream sharing protocol, in response to selection of a predetermined type of program content; the instruction module 730 is configured to send a screen-casting playing instruction to one of the searched small-screen terminals, where the screen-casting playing instruction is used to instruct one of the mobile terminals to screen-cast and play program content of a predetermined type to the large-screen terminal based on a media stream sharing protocol; and a playing module 740 configured to receive the resource information of the program content of the predetermined type fed back by one of the small-screen terminals and play the program content of the predetermined type.

fig. 8 is a block diagram of an intelligent screen projection transmission device according to an embodiment of the present invention. As shown in fig. 8, the intelligent screen projection transmission apparatus 800 is used for a small-screen terminal, and includes a process starting module 810, a receiving module 820, a searching module 830, and a feedback module 840.

the process starting module 810 is configured to start a local area network connection sharing process based on the installed small-screen media application; a receiving module 820 configured to receive a screen-casting playing instruction of a program content of a predetermined type from a large-screen terminal after establishing a local area network connection with the large-screen terminal installed with a large-screen media application based on a local area network connection sharing process and passing verification, wherein the small-screen terminal and the large-screen terminal are in the same local area network and the media stream sharing protocol is consistent, and the screen-casting playing instruction includes program information of the program content of the predetermined type; a searching module 830 configured to search whether there is a predetermined type of program content based on the program information; and a feedback module 840 configured to feed back resource information of a predetermined type of program content to the large-screen terminal, if any.

Fig. 9 is a block diagram of an intelligent screen projection system according to an embodiment of the present invention. As shown in fig. 9, the intelligent screen projection system 900 includes the intelligent screen projection playing device 700 and the intelligent screen projection transmission device 800 according to the above embodiment.

it should be understood that the modules depicted in fig. 7 and 8 correspond to various steps in the methods described with reference to fig. 1 and 3. Thus, the operations and features described above for the method and the corresponding technical effects are also applicable to the modules in fig. 7 and 8, and are not described again here.

it is noted that the modules in the embodiments of the present disclosure are not intended to limit the aspects of the present disclosure, and for example, the presentation module may be described as a module for presenting a predetermined type of program content on a program selection interface of a large-screen media application. In addition, the related functional modules may also be implemented by a hardware processor, for example, the display module may also be implemented by a processor, which is not described herein again.

In other embodiments, an embodiment of the present invention further provides a non-volatile computer storage medium, where the computer storage medium stores computer-executable instructions, and the computer-executable instructions may execute the intelligent screen-casting playing method or the intelligent screen-casting transmission method in any of the above method embodiments;

as one embodiment, a non-volatile computer storage medium of the present invention stores computer-executable instructions configured to:

displaying program content of a predetermined type on a program selection interface of a large-screen media application, wherein the program content of the predetermined type comprises: applying program contents which are not authorized in the large-screen media but authorized in the small-screen media, wherein the small-screen media application and the large-screen media application belong to associated applications provided by a service provider, and the small-screen media application is suitable for a small-screen terminal;

Responding to the selection of the program content of the preset type, and searching a small-screen terminal which is in the same local area network with the large-screen terminal and is consistent with a media stream sharing protocol;

sending a screen-casting playing instruction to one of the searched small-screen terminals, wherein the screen-casting playing instruction is used for instructing one of the mobile terminals to cast screen-casting the program content of the preset type to the large-screen terminal based on the media stream sharing protocol;

and receiving the resource information of the program content of the preset type fed back by one of the small screen terminals and playing the program content of the preset type.

As another embodiment, a non-volatile computer storage medium of the present invention stores computer-executable instructions configured to:

Starting a local area network connection sharing process based on the installed small-screen media application;

After establishing local area network connection with a large-screen terminal installed with a large-screen media application based on the local area network connection sharing process and passing verification, receiving a screen projection playing instruction of program contents of a preset type from the large-screen terminal, wherein the small-screen terminal and the large-screen terminal are in the same local area network and the media stream sharing protocol is consistent, and the screen projection playing instruction comprises program information of the program contents of the preset type;

searching whether the program content of the preset type exists or not based on the program information;

and if so, feeding back the resource information of the program content of the preset type to the large-screen terminal.

as a non-volatile computer-readable storage medium, the non-volatile computer-readable storage medium can be used to store a non-volatile software program, a non-volatile computer-executable program, and modules, such as program instructions/modules corresponding to the intelligent screen projection playing method or the intelligent screen projection transmission method in the embodiment of the present invention. One or more program instructions are stored in a non-transitory computer readable storage medium, which when executed by a processor, perform a smart screen projection playing method or a smart screen projection transmission method in any of the above-described method embodiments.

The non-volatile computer-readable storage medium may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data created according to use of the smart screen projection playback device, and the like. Further, the non-volatile computer-readable storage medium may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device. In some embodiments, the non-transitory computer readable storage medium optionally includes a memory remotely located from the processor, and the remote memory may be connected to the smart screen projection playing device or the smart screen projection transmission device via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.

an embodiment of the present invention further provides a computer program product, where the computer program product includes a computer program stored on a non-volatile computer-readable storage medium, and the computer program includes program instructions, and when the program instructions are executed by a computer, the computer is caused to execute any one of the above-mentioned smart screen projection playing method or the smart screen projection transmission apparatus.

Fig. 10 is a schematic structural diagram of an electronic device according to an embodiment of the present invention, and as shown in fig. 10, the electronic device includes:

One or more processors 1010 and a memory 1020, one processor 1010 being illustrated in fig. 10.

The device of the intelligent screen projection playing method or the intelligent screen projection transmission device may further include: an input device 1030 and an output device 1040.

The processor 1010, the memory 1020, the input device 1030, and the output device 1040 may be connected by a bus or other means, and fig. 10 illustrates an example of connection by a bus.

The memory 1020 is a non-volatile computer-readable storage medium as described above.

The processor 1010 executes various functional applications and data processing of the server by running the nonvolatile software programs, instructions and modules stored in the memory 1020, that is, the intelligent screen projection playing method or the intelligent screen projection transmission method of the above method embodiments are implemented.

The input device 1030 may receive input numeric or character information and generate key signal inputs related to user settings and function controls of the information delivery device. Output device 1040 may include a display device such as a display screen.

The product can execute the method provided by the embodiment of the invention, and has corresponding functional modules and beneficial effects of the execution method. For technical details that are not described in detail in this embodiment, reference may be made to the method provided by the embodiment of the present invention.

as an implementation manner, the electronic device applied to the intelligent screen projection playing platform includes: at least one processor; and a memory communicatively coupled to the at least one processor; wherein the memory stores instructions executable by the at least one processor to cause the at least one processor to:

As another embodiment, the electronic device applied to the intelligent screen projection transmission platform includes: at least one processor; and a memory communicatively coupled to the at least one processor; wherein the memory stores instructions executable by the at least one processor to cause the at least one processor to:

the electronic device of the embodiments of the present application exists in various forms, including but not limited to:

(1) A mobile communication device: such devices are characterized by mobile communications capabilities and are primarily targeted at providing voice, data communications. Such terminals include smart phones (e.g., iphones), multimedia phones, functional phones, and low-end phones, among others.

(2) ultra mobile personal computer device: the equipment belongs to the category of personal computers, has calculation and processing functions and generally has the characteristic of mobile internet access. Such terminals include: PDA, MID, and UMPC devices, etc., such as ipads.

(3) a portable entertainment device: such devices can display and play multimedia content. Such devices include audio, program players (e.g., ipods), handheld game consoles, electronic books, as well as smart toys and portable car navigation devices.

(4) The server is similar to a general computer architecture, but has higher requirements on processing capability, stability, reliability, safety, expandability, manageability and the like because of the need of providing highly reliable services.

(5) And other electronic devices with data interaction functions.

The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment.

through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment can be implemented by software plus a general hardware platform, and certainly can also be implemented by hardware. Based on such understanding, the above technical solutions substantially or contributing to the related art may be embodied in the form of a software product, which may be stored in a computer-readable storage medium, such as ROM/RAM, magnetic disk, optical disk, etc., and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the method according to the embodiments or some parts of the embodiments.

Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, and not to limit the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions in the embodiments of the present application.

Claims

1. An intelligent screen projection playing method is used for a large-screen terminal and comprises the following steps:

2. The method of claim 1, wherein the method further comprises:

In the process of playing the program content of the preset type, responding to the disconnection between the large-screen terminal and the small-screen terminal, recording a playing interruption point of the program content of the preset type, and determining a continuous playing starting position of the program content of the preset type based on the playing interruption point;

searching a small-screen terminal which is in the same local area network with the large-screen terminal and has the same media stream sharing protocol;

sending an interruption continuous playing instruction to one of the searched small-screen terminals, wherein the interruption continuous playing instruction is used for indicating that the one of the searched small-screen terminals starts playing from the starting position when the screen is projected;

And receiving the resource information of the program content of the preset type fed back by the searched one of the small-screen terminals, and playing the program content of the preset type.

3. The method according to claim 1 or 2, wherein the resource information of the program content of the predetermined type includes a local resource of the program content of the predetermined type of the one of the small-screen terminals or a URL of the program content of the predetermined type.

4. an intelligent screen projection transmission method is used for a small-screen terminal and comprises the following steps:

5. the method of claim 4, further comprising:

receiving an interruption continuous playing instruction from the large-screen terminal, wherein the interruption continuous playing instruction comprises program information of the program contents of the preset type and a continuous playing starting position;

And searching the program content of the preset type based on the program information, and feeding back resource information of the program content of the preset type containing the continuous playing initial position to the large-screen terminal.

6. the method of claim 4 or 5, wherein said finding whether the predetermined type of program content exists based on the program information comprises:

searching whether the program content of the preset type exists in a local program library of the small-screen terminal or not based on the program information;

and if not, searching whether the program content of the preset type exists in a server program library of the small-screen terminal.

7. The method of claim 6, wherein the feeding back resource information of the predetermined type of program content to the large-screen terminal, if any, comprises:

if the program content of the preset type exists in the local program library, transmitting a local resource of the program content of the preset type to the large-screen terminal; or

And if the program content of the preset type does not exist in the local program library and the program content of the preset type exists in the server program library, feeding back the URL of the program content of the preset type to the large-screen terminal.

8. the utility model provides a screen play device is thrown to intelligence for large screen terminal includes:

A presentation module configured to present a predetermined type of program content on a program selection interface of a large screen media application, wherein the predetermined type of program content comprises: applying program contents which are not authorized in the large-screen media but authorized in the small-screen media, wherein the small-screen media application and the large-screen media application belong to associated applications provided by a service provider, and the small-screen media application is suitable for a small-screen terminal;

The searching module is configured to respond to the selection of the program content of the preset type and search for a small-screen terminal which is in the same local area network with the large-screen terminal and is consistent with a media stream sharing protocol;

the instruction module is configured to send a screen-casting playing instruction to one of the searched small-screen terminals, wherein the screen-casting playing instruction is used for instructing one of the mobile terminals to screen-cast and play the program content of the preset type to the large-screen terminal based on the media stream sharing protocol;

And the playing module is configured to receive the resource information of the program content of the preset type fed back by the one of the small-screen terminals and play the program content of the preset type.

9. The utility model provides a screen transmission device is thrown to intelligence for little screen terminal includes:

The process starting module is configured to start a local area network connection sharing process based on the installed small-screen media application;

The receiving module is configured to receive a screen-casting playing instruction of a program content of a preset type from a large-screen terminal after the local area network connection is established and verified with the large-screen terminal installed with a large-screen media application based on the local area network connection sharing process, wherein the small-screen terminal and the large-screen terminal are in the same local area network and the media stream sharing protocol is consistent, and the screen-casting playing instruction comprises program information of the program content of the preset type;

the searching module is configured to search whether the program content of the preset type exists or not based on the program information;

And the feedback module is configured to feed back the resource information of the program contents of the preset type to the large-screen terminal if the resource information exists.

10. An intelligent screen projection system, comprising the intelligent screen projection playing device according to claim 8 and the intelligent screen projection transmission device according to claim 9.