CN113992958A - Multi-window same-screen interaction method, terminal and storage medium - Google Patents
Multi-window same-screen interaction method, terminal and storage medium Download PDFInfo
- Publication number
- CN113992958A CN113992958A CN202111212804.4A CN202111212804A CN113992958A CN 113992958 A CN113992958 A CN 113992958A CN 202111212804 A CN202111212804 A CN 202111212804A CN 113992958 A CN113992958 A CN 113992958A
- Authority
- CN
- China
- Prior art keywords
- screen
- window
- instruction
- display
- interaction
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000003993 interaction Effects 0.000 title claims abstract description 119
- 238000000034 method Methods 0.000 title claims abstract description 53
- 230000002452 interceptive effect Effects 0.000 claims abstract description 27
- 230000006870 function Effects 0.000 claims description 43
- 238000009434 installation Methods 0.000 claims description 7
- 238000005266 casting Methods 0.000 description 15
- 230000008569 process Effects 0.000 description 11
- 238000004590 computer program Methods 0.000 description 5
- 238000010586 diagram Methods 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000006872 improvement Effects 0.000 description 1
- 230000000717 retained effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
- H04N21/43072—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen of multiple content streams on the same device
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44016—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving splicing one content stream with another content stream, e.g. for substituting a video clip
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D30/00—Reducing energy consumption in communication networks
- Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- User Interface Of Digital Computer (AREA)
- Controls And Circuits For Display Device (AREA)
Abstract
The invention discloses a multi-window one-screen interaction method, a terminal and a storage medium, wherein the method comprises the following steps: acquiring display content of a screen projection end; starting a same-screen interaction function according to a user operation instruction, and creating a first display window, a second display window, a first instruction interval area and a second instruction interval area in a display area; displaying the display content of the screen projection end in a first display window, acquiring an operation instruction of the screen projection end through a first instruction interval area, and executing corresponding operation in the first display window; and acquiring an operation instruction of the terminal through the second instruction interval area, and executing corresponding operation in the second display window. According to the invention, a plurality of display windows and a plurality of instruction interval areas are established in the display area, the screen projection content and the interactive content are respectively displayed by utilizing the corresponding display windows, and the instructions of the screen projection end and the terminal are separated by the instruction interval areas, so that the function of multi-window same-screen interaction is realized under the situation of multi-window same-screen display.
Description
Technical Field
The invention relates to the field of intelligent screen application, in particular to a multi-window one-screen interaction method, a terminal and a storage medium.
Background
With the upgrade of hardware, an intelligent screen (intelligent television) is gradually developed from a traditional single-window scheduling system to a multi-window and multi-task scheduling system; based on the multi-window and multi-task intelligent screen system, richer user scenes are brought to the user.
Traditional wisdom screen passes screen service, for example: the game only can simply project the content of the mobile phone screen to the intelligent screen for displaying, but has no scene interaction (namely, the game scene in the intelligent screen interacts with the game scene in the mobile phone screen); because the smart screen and the mobile phone screen do not have corresponding interactive functions, along with the improvement of the system performance of the smart screen, an interactive scene and a control method are needed, wherein the interactive function of the smart screen and the mobile phone screen can be realized, so that the smart screen and the mobile phone screen interact together.
Therefore, the prior art has yet to be improved.
Disclosure of Invention
The invention provides a multi-window one-screen interaction method, a terminal and a storage medium, aiming at solving the technical problem that the traditional intelligent screen transmission service cannot perform scene interaction.
The technical scheme adopted by the invention for solving the technical problem is as follows:
in a first aspect, the present invention provides a multi-window on-screen interaction method, which includes the following steps:
acquiring display content of a screen projection end;
starting a same-screen interaction function according to a user operation instruction, and creating a first display window, a second display window, a first instruction interval area and a second instruction interval area in a display area; the first display window and the first instruction interval area respectively correspond to the screen projection end, and the second display window and the second instruction interval area respectively correspond to the terminal;
displaying the display content of the screen projection end in the first display window, acquiring an operation instruction of the screen projection end through the first instruction interval area, and executing corresponding operation in the first display window;
and acquiring an operation instruction of the terminal through the second instruction interval area, and executing corresponding operation in the second display window.
In one implementation, the acquiring the display content of the screen projection end previously includes:
acquiring equipment information and state information of the screen projection end;
and acquiring a corresponding screen projection protocol according to the equipment information, and establishing connection with the screen projection end according to the screen projection protocol and the state information.
In one implementation manner, the acquiring the display content of the screen projection end includes:
detecting the starting state of the application to be projected in the screen projection end;
and if the application to be screen-projected is started, acquiring an operation interface and/or display area content in the application to be screen-projected according to the screen-projecting protocol.
In one implementation manner, the starting the on-screen interaction function according to the user operation instruction, and creating a first display window, a second display window, a first instruction interval region, and a second instruction interval region in the display region includes:
starting the on-screen interaction function according to the user operation instruction;
creating a multi-window spliced screen, and setting the first display window and the second display window in the multi-window spliced screen;
and respectively setting the first instruction interval area and the second instruction interval area according to the screen projection protocol.
In one implementation, the user operation instruction includes: any one of a key operation instruction, a voice control instruction and an image gesture instruction.
In one implementation manner, the displaying the display content of the screen projection end in the first display window, acquiring the operation instruction of the screen projection end through the first instruction interval area, and executing a corresponding operation in the first display window includes:
acquiring an application name of a screen application to be projected in the screen projection end, and starting the screen application to be projected in the terminal;
displaying the display content of the screen projection end in the first display window;
and acquiring the operation instruction of the screen projection end in the first instruction interval area according to the feature code, and executing corresponding operation in the first display window.
In one implementation manner, the obtaining an operation instruction of the terminal through a second instruction interval region, and executing a corresponding operation in the second display window includes:
acquiring an operation instruction of the terminal through the second instruction interval area;
determining the interaction state of the terminal and the screen projection end;
executing corresponding operation in the second display window according to the operation instruction of the terminal and the interaction state;
and displaying the state after the interaction and the interactive content after the operation instruction of the terminal is executed in the second display window.
In one implementation, the method further comprises:
starting the same-screen interaction function according to the user operation instruction, and displaying a two-dimensional code in a display area of the terminal; wherein, the two-dimensional code includes: the name, the installation package path and the connection request of the application to be screened;
and establishing connection with the screen projection end according to the scanning result and the connection request sent by the screen projection end, and performing same-screen interaction with the screen projection end based on the second display window and the second instruction interval area.
In a second aspect, the present invention provides a terminal, comprising: the multi-window on-screen interaction method comprises a processor and a memory, wherein the memory stores a multi-window on-screen interaction program, and the multi-window on-screen interaction program is used for realizing the multi-window on-screen interaction method in the first aspect when being executed by the processor.
In a third aspect, the present invention provides a storage medium, where a multi-window on-screen interaction program is stored, and the multi-window on-screen interaction program is used to implement the multi-window on-screen interaction method according to the first aspect when executed by a processor.
The invention adopts the technical scheme and has the following effects:
according to the method, the same-screen interaction function is started according to the user operation instruction, a plurality of display windows and a plurality of instruction interval areas are established in the display area, and the screen-casting content and the interaction content are respectively displayed by utilizing different display windows, so that a user can view the interaction content sent by a screen-casting end when viewing the screen-casting content; in addition, the function of multi-window co-screen interaction is realized under the situation of multi-window co-screen display through the instruction of the instruction interval area for separating the screen projection end from the terminal.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the structures shown in the drawings without creative efforts.
FIG. 1 is a flow chart of a multi-window on-screen interaction method in one implementation of the present invention.
Fig. 2 is a schematic view of a window before an on-screen interaction function is started in an implementation manner of the present invention.
Fig. 3 is a schematic view of a window after the on-screen interaction function is started in an implementation manner of the present invention.
Fig. 4 is a schematic view of a window for two-dimensional code connection in an implementation manner of the present invention.
Fig. 5 is a functional schematic of a terminal in one implementation of the invention.
The implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention clearer and clearer, the present invention is further described in detail below with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
Exemplary method
As shown in fig. 1, an embodiment of the present invention provides a multi-window on-screen interaction method, where the multi-window on-screen interaction method includes the following steps:
and S100, acquiring the display content of the screen projection end.
In this embodiment, the multi-window on-screen interaction method is applied to a terminal, where the terminal is a terminal device for receiving and displaying the screen-shot content of this embodiment, and the terminal includes but is not limited to: mobile terminals such as smart screen (smart television), cell-phone, panel computer and wearable equipment.
In this embodiment, the screen projection end is also used as a sending end of the screen projection content, and the screen projection end includes but is not limited to: mobile terminals such as mobile phones, smart screens (smart televisions), tablet computers, wearable devices and the like; for convenience of understanding and distinction, the present embodiment uses a mobile phone as the screen projection terminal, and uses an intelligent screen as the terminal to describe the present embodiment.
In this embodiment, the user can project an application (e.g., a game) to the smart screen through a screen transmission service at the mobile phone end; then, the user can input operation instructions in the mobile phone and the intelligent screen respectively, so that on the basis of the respective operation instructions, on-screen interaction or on-screen competition is realized; moreover, when the same-screen interaction is realized, the mobile phone or the smart screen can install and start the same application program from a mobile phone channel (such as application push installation) or a smart screen channel (such as an application store) according to the application name corresponding to the screen projection content, so as to start the multi-window same-screen interaction function.
Furthermore, under the scene of starting multi-window one-screen interaction, a plurality of instruction interval areas are arranged in the smart screen, and through the corresponding instruction interval areas, a display window of the screen projection content of the mobile phone only receives the control instruction sent by the mobile phone end, and an application starting window of the smart screen only receives the control instruction of the smart screen, so that under the condition of one-screen interaction, each window obtains the required control instruction without being interfered by other control instructions; and in the scene of quitting the same-screen interaction function, the limitation of the instruction interval is only required to be removed.
Specifically, when multi-window one-screen interaction is realized, a wired connection or a wireless connection (such as WiFi, bluetooth, NFC, etc.) needs to be established between the smart screen and the mobile phone; in the process of establishing connection, the smart screen acquires the equipment information and the state information of the mobile phone, wherein the equipment information comprises: information such as device name (e.g. mobile phone model number) and device address (e.g. port number, bluetooth address); the state information refers to the connection state (for example, wireless connection state or wired connection state) information of the mobile phone.
Further, after the information of the mobile phone is acquired, a corresponding screen projection protocol is acquired according to the device information of the mobile phone, for example: the wireless screen projection protocol of the mobile phone is a Digital Living Network Alliance (DLNA) protocol; after acquiring a corresponding screen projection protocol, determining whether the mobile phone is in a connection state, namely determining whether the mobile phone is in screen projection connection with other equipment; if the screen projecting function of the mobile phone is started and the mobile phone is not connected with other equipment in a screen projecting mode, the intelligent screen is connected with the mobile phone end according to the acquired screen projecting protocol so as to be used for subsequent screen projecting and sharing services.
That is, in one implementation manner of the present embodiment, step S100 includes the following steps before:
step S001, acquiring equipment information and state information of the screen projection end;
and S002, acquiring a corresponding screen projection protocol according to the equipment information, and establishing connection with the screen projection end according to the screen projection protocol and the state information.
In this embodiment, after the smart screen is connected to the mobile phone, a user may start an application program that needs to be projected on the mobile phone, and the smart screen may detect a start state of the application program in the mobile phone in real time; if the mobile phone has successfully started the application program, the mobile phone transmits screen display content to the smart screen through a screen-casting protocol, and the smart screen acquires and displays the display content of the application program at the mobile phone end, for example: an operation interface of an application program, contents of a display area in the application program, and the like.
That is, in an implementation manner of this embodiment, step S100 specifically includes the following steps:
step S110, detecting the starting state of the application to be projected in the screen projection end;
and step S120, if the application to be screen-projected is started, acquiring an operation interface and/or display area content in the application to be screen-projected according to the screen-projecting protocol.
According to the embodiment, by detecting the starting state of the application program at the mobile phone end, when the application program is started at the mobile phone end, the content of the operation interface and/or the display area of the application program in the mobile phone can be obtained and displayed in the display area of the smart screen, so that the screen projection function between the mobile phone and the smart screen is realized.
As shown in fig. 1, in an implementation manner of the embodiment of the present invention, the multi-window on-screen interaction method further includes the following steps:
step S200, starting the same-screen interaction function according to the user operation instruction, and creating a first display window, a second display window, a first instruction interval area and a second instruction interval area in the display area.
In this embodiment, after the smart screen obtains and displays the screen-casting content of the mobile phone, the screen-casting function is only implemented in the display area of the smart screen, and the display interface is as shown in fig. 2; if the interaction function is to be realized on the basis of the screen projection function, a user is required to input a co-screen interaction instruction at the intelligent screen end, and the co-screen interaction function in the intelligent screen is started through the co-screen interaction instruction; and the on-screen interaction instruction is an operation instruction for starting an interaction function by a user.
Further, the on-screen interaction instruction includes but is not limited to: any one of a key operation instruction, a voice control instruction and an image gesture instruction; the key operation instruction is an interactive function key on the intelligent screen body or a remote controller; the voice control instruction is a control instruction realized by a remote controller language function or a far-field voice function; the image gesture instruction is through the gesture instruction that the user that the camera of wisdom screen was gathered put out, for example: a Y gesture instruction or other self-defined gesture instructions which are put out by the two hands of the user.
Further, after a user inputs a same-screen interaction instruction, the intelligent screen starts a same-screen interaction function, a multi-window spliced screen is created, and a corresponding display window is arranged in the multi-window spliced screen; the multi-window spliced screen is a spliced screen formed by a plurality of windows, and the number of the windows of the multi-window spliced screen is the sum of the number of screen-casting mobile phones plus one; for example: two mobile phones are projecting screens with the intelligent screen, and the number of the windows of the multi-window splicing screen is three.
As shown in fig. 3, in one embodiment, the smart screen opens two display windows when the multi-window mosaic screen is created; the window A is used for displaying screen projection content of the mobile phone, and the window B is used for displaying same-screen interactive content, interactive state and the like.
Further, after the multi-window spliced screen is created, the intelligent screen sets a corresponding instruction interval area according to the property of the display window, namely sets a corresponding instruction interval area according to the effect of the display window, wherein the instruction interval area is used for distinguishing operation instructions between screen projection equipment and screen projection equipment so as to avoid the situation of operation instruction conflict and further avoid the interactive function disorder of the intelligent screen; correspondingly, each instruction interval area is only used for receiving the equipment operation instruction of the corresponding display window; for example, the window a is used for receiving an operation instruction input by a mobile phone.
As shown in fig. 3, in one embodiment, when the smart screen creates the command interval area, the window a is used to receive a control command of a screen-casting mobile phone, such as: a game control instruction input by a user in the mobile phone; the window B is used for receiving a control instruction of the non-screen-projection mobile phone, for example: and game control instructions input by the user in the intelligent screen.
That is, in an implementation manner of this embodiment, the step S200 specifically includes the following steps:
step S210, starting the same-screen interaction function according to the user operation instruction;
step S220, a multi-window spliced screen is created, and the first display window and the second display window are arranged in the multi-window spliced screen;
step S230, respectively setting the first instruction interval area and the second instruction interval area according to the screen projection protocol.
In the embodiment, when a user inputs a same-screen interaction instruction, a plurality of display windows and a plurality of instruction interval areas are arranged in a multi-window spliced screen by starting a same-screen interaction function, so that a mobile phone can send a control instruction to an intelligent screen when the mobile phone is projected; and moreover, the intelligent screen can input a control instruction when displaying screen projection content, and the intelligent screen can interact with the mobile phone.
As shown in fig. 1, in an implementation manner of the embodiment of the present invention, the multi-window on-screen interaction method further includes the following steps:
step S300, displaying the display content of the screen projection end in the first display window, acquiring the operation instruction of the screen projection end through the first instruction interval area, and executing corresponding operation in the first display window.
In this embodiment, after a plurality of display windows and a plurality of instruction interval areas are created, the smart screen may obtain a screen-casting application name, that is, an application name of the mobile phone that is casting a screen; by acquiring the application name of the screen projection, the same application program can be started in the intelligent screen, and the interaction with the mobile phone end is realized by using the same application program.
Specifically, after the smart screen acquires the name of the screen-projected application, whether the application program is installed in the smart screen is firstly inquired, and if the application program is installed, the smart screen directly opens the application program and displays the application program in a corresponding display window; if the application program is not installed, the intelligent screen searches and downloads the application program in an application mall of the intelligent screen; and after downloading is finished, automatically installing and starting the application program.
Further, if the smart screen does not inquire the corresponding application program in the self-contained application mall, the prompt information that the application cannot be found is fed back to the mobile phone, the user is prompted to download the application mall at the mobile phone end, the downloaded application installation package is pushed to the smart screen, and the application program is automatically started after the smart screen receives and installs the application installation package.
Further, after the same application program is started on the smart screen, the smart screen displays corresponding content in a corresponding display window, and displays the screen projection content of the mobile phone, for example: displaying the screen projection content of the mobile phone in the window A, and displaying the same-screen interactive content, the interactive state and the like in the window B; and when the corresponding content is displayed, carrying out interaction according to the control instructions of different devices.
Specifically, in the interaction process, the smart screen distinguishes the mobile phone control instruction and the self control instruction according to the feature code; the feature code is carried by the mobile phone when sending the control instruction, and is used for identifying that the control instruction comes from the mobile phone; if the control instruction has the identifier, acquiring the control instruction from the mobile phone end through an instruction interval area corresponding to the mobile phone so as to execute corresponding operation in a display window of the screen projected by the mobile phone; for example: and acquiring a game operation instruction input in the mobile phone by a user through a mobile phone instruction interval area so as to execute game operation in a mobile phone screen projection window.
That is, in an implementation manner of this embodiment, the step S300 specifically includes the following steps:
step S310, acquiring the application name of the application to be screen-projected in the screen projection end, and starting the application to be screen-projected in the terminal;
step S320, displaying the display content of the screen projection end in the first display window;
step S330, obtaining the operation instruction of the screen projection end in the first instruction interval area according to the feature code, and executing corresponding operation in the first display window.
According to the method, the application program which is the same as the screen projection application can be automatically started at the intelligent screen end by acquiring the name of the application program; and moreover, the control instructions are distinguished through the feature codes, so that the control instructions from the mobile phone end can act on a screen projection display window of the mobile phone in the interaction process, and the influence of the control instructions of the mobile phone on the intelligent screen is avoided.
As shown in fig. 1, in an implementation manner of the embodiment of the present invention, the multi-window on-screen interaction method further includes the following steps:
step S400, obtaining an operation instruction of the terminal through the second instruction interval region, and executing a corresponding operation in the second display window.
In this embodiment, in the interaction process, in addition to the control command from the mobile phone terminal, there is also a control command input by the user in the smart screen, and the control command of this part includes: a control instruction for interacting with the mobile phone and a control instruction for controlling the smart screen operation interface or function (for example, a control instruction for quitting the same screen interaction function)
Specifically, after the same application program is opened on the intelligent screen, interactive content and an interactive state are displayed in an interactive window; at the moment, the intelligent screen acquires an operation instruction input by a user at the terminal through an instruction interval area corresponding to the terminal; then, determining the current interaction state of the smart screen and the mobile phone, and executing corresponding control operation in the interaction window according to the operation instruction of the terminal and the interaction state; for example: the intelligent screen and the mobile phone are in the same-screen competition state, and the competition control instruction is executed in the interactive display window according to the obtained competition control instruction input by the user in the intelligent screen.
That is, in an implementation manner of this embodiment, the step S400 specifically includes the following steps:
step S410, obtaining an operation instruction of the terminal through the second instruction interval area;
step S420, determining the interaction state of the terminal and the screen projection end;
step S430, according to the operation instruction of the terminal and the interaction state, executing corresponding operation in the second display window;
step S440, displaying the state after the interaction and the interactive content after executing the operation instruction of the terminal in the second display window.
In the interaction process, the mobile phone end is mainly used as a screen projection content sending end, the screen projection content of the mobile phone is displayed in the intelligent screen, and the interaction between the mobile phone and the intelligent screen is carried out in the intelligent screen; in other implementation manners, the screen projection content of the intelligent screen can be displayed in the mobile phone end, and interaction between the intelligent screen and the mobile phone end is carried out in the mobile phone end.
In another implementation manner of this embodiment, the mobile phone can further perform the same-screen interaction with the smart screen through the two-dimensional code, specifically as follows:
firstly, an application program needing interaction is started in the intelligent screen, such as: playing a game; then, the user is prompted to input an on-screen interaction instruction in the smart screen, and the on-screen interaction function is started (the process is as described above).
Further, after the same-screen interaction function is started, a plurality of instruction interval areas are created (the process is as described above), an interaction two-dimensional code is set in the display area of the smart screen (as shown in fig. 4), and interaction connection is established with the mobile phone through the two-dimensional code; wherein, the two-dimensional code includes: name of application that needs interaction, installation package path, and connection request.
Further, a multi-window splicing screen mode is started in the smart screen, 2 display windows are opened, the scanning result of the mobile phone and the connection state of the mobile phone are displayed in a window A, an application program started by the smart screen is displayed in a window B, and an instruction area corresponding to the window is established in the smart screen to respond to a control instruction sent by corresponding equipment (the window A only receives the control instruction of a screen-casting mobile phone, and the window B only receives the control instruction of a non-screen-casting mobile phone).
Further, a user scans the two-dimensional code in the smart screen through a mobile phone to acquire information such as an application name and an installation package path in the two-dimensional code, installs and starts an application at the mobile phone end, and displays screen projection content of the mobile phone in a screen projection window of the smart screen.
After the multi-window display task with the same-screen interaction function is completed, interaction can be carried out according to control instructions of different devices; if the user selects to quit the same-screen interaction function, inquiring whether the user needs to uninstall the application installed in the current same-screen interaction mode in the intelligent screen; if the user chooses to approve, uninstalling the application installed in the interactive process; if the user chooses not to agree, the application is retained.
That is, in an implementation manner of this embodiment, the method further includes the following steps:
step S510, starting the same-screen interaction function according to the user operation instruction, and displaying a two-dimensional code in a display area of the terminal;
step S520, according to the scanning result and the connection request sent by the screen projection end, connection is established with the screen projection end, and the same-screen interaction is carried out with the screen projection end based on the second display window and the second instruction interval area.
Certainly, in other implementation manners of this embodiment, except that foretell two-dimensional code is connected and the interactive mode, can also bump one through NFC and bump the function realization such as the cell-phone with throw between the wisdom screen and connect to and realize the interactive process of same screen on the basis of connecting.
In the embodiment, the same-screen interaction function is started according to the user operation instruction, a plurality of display windows and a plurality of instruction interval areas are established in the display area, and the screen-casting content and the interaction content are respectively displayed by using different display windows, so that a user can view the interaction content sent by a screen-casting end when viewing the screen-casting content; in addition, the function of multi-window co-screen interaction is realized under the situation of multi-window co-screen display through the instruction of the instruction interval area for separating the screen projection end from the terminal.
Exemplary device
Based on the above embodiments, the present invention further provides a terminal, and a schematic block diagram thereof may be as shown in fig. 5.
The terminal includes: the system comprises a processor, a memory, an interface, a display screen and a communication module which are connected through a system bus; wherein the processor of the terminal is configured to provide computing and control capabilities; the memory of the terminal comprises a storage medium and an internal memory; the storage medium stores an operating system and a computer program; the internal memory provides an environment for the operation of an operating system and a computer program in the storage medium; the interface is used for connecting external terminal equipment, such as: mobile terminals and computers; the display screen is used for displaying corresponding multi-window same-screen interaction information; the communication module is used for communicating with a cloud server or a mobile terminal.
The computer program is used for realizing a multi-window same-screen interaction method when being executed by a processor.
It will be understood by those skilled in the art that the block diagram of fig. 5 is a block diagram of only a portion of the structure associated with the inventive arrangements and is not intended to limit the terminals to which the inventive arrangements may be applied, and that a particular terminal may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.
In one embodiment, a terminal is provided, which includes: the multi-window and screen interaction method comprises a processor and a memory, wherein the memory stores a multi-window and screen interaction program, and the multi-window and screen interaction program is used for realizing the multi-window and screen interaction method when being executed by the processor.
In one embodiment, a storage medium is provided, wherein the storage medium stores a multi-window on-screen interactive program, and the multi-window on-screen interactive program is used for implementing the multi-window on-screen interactive method when being executed by a processor.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware related to instructions of a computer program, which can be stored in a non-volatile computer-readable storage medium, and when executed, the computer program can include the processes of the embodiments of the methods described above. Any reference to memory, storage, databases, or other media used in embodiments provided herein may include non-volatile and/or volatile memory.
In summary, the present invention provides a multi-window one-screen interaction method, a terminal and a storage medium, wherein the method comprises: acquiring display content of a screen projection end; starting a same-screen interaction function according to a user operation instruction, and creating a first display window, a second display window, a first instruction interval area and a second instruction interval area in a display area; displaying the display content of the screen projection end in a first display window, acquiring an operation instruction of the screen projection end through a first instruction interval area, and executing corresponding operation in the first display window; and acquiring an operation instruction of the terminal through the second instruction interval area, and executing corresponding operation in the second display window. According to the invention, a plurality of display windows and a plurality of instruction interval areas are established in the display area, the screen projection content and the interactive content are respectively displayed by utilizing the corresponding display windows, and the instructions of the screen projection end and the terminal are separated by the instruction interval areas, so that the function of multi-window same-screen interaction is realized under the situation of multi-window same-screen display.
It is to be understood that the invention is not limited to the examples described above, but that modifications and variations may be effected thereto by those of ordinary skill in the art in light of the foregoing description, and that all such modifications and variations are intended to be within the scope of the invention as defined by the appended claims.
Claims (10)
1. A multi-window one-screen interaction method is characterized by comprising the following steps:
acquiring display content of a screen projection end;
starting a same-screen interaction function according to a user operation instruction, and creating a first display window, a second display window, a first instruction interval area and a second instruction interval area in a display area; the first display window and the first instruction interval area respectively correspond to the screen projection end, and the second display window and the second instruction interval area respectively correspond to the terminal;
displaying the display content of the screen projection end in the first display window, acquiring an operation instruction of the screen projection end through the first instruction interval area, and executing corresponding operation in the first display window;
and acquiring an operation instruction of the terminal through the second instruction interval area, and executing corresponding operation in the second display window.
2. The method for multi-window co-screen interaction according to claim 1, wherein the acquiring the display content of the screen projection end comprises:
acquiring equipment information and state information of the screen projection end;
and acquiring a corresponding screen projection protocol according to the equipment information, and establishing connection with the screen projection end according to the screen projection protocol and the state information.
3. The method for multi-window co-screen interaction according to claim 1, wherein the acquiring the display content of the screen projection end comprises:
detecting the starting state of the application to be projected in the screen projection end;
and if the application to be screen-projected is started, acquiring an operation interface and/or display area content in the application to be screen-projected according to the screen-projecting protocol.
4. The method for multi-window on-screen interaction according to claim 1, wherein the starting of the on-screen interaction function according to the user operation instruction and the creation of the first display window, the second display window, the first instruction interval area and the second instruction interval area in the display area comprise:
starting the on-screen interaction function according to the user operation instruction;
creating a multi-window spliced screen, and setting the first display window and the second display window in the multi-window spliced screen;
and respectively setting the first instruction interval area and the second instruction interval area according to the screen projection protocol.
5. The multi-window on-screen interaction method according to claim 4, wherein the user operation instruction comprises: any one of a key operation instruction, a voice control instruction and an image gesture instruction.
6. The multi-window same-screen interaction method according to claim 1, wherein the displaying content of the screen projection end is displayed in the first display window, the operation instruction of the screen projection end is obtained through the first instruction interval area, and corresponding operation is executed in the first display window, and the method comprises:
acquiring an application name of a screen application to be projected in the screen projection end, and starting the screen application to be projected in the terminal;
displaying the display content of the screen projection end in the first display window;
and acquiring the operation instruction of the screen projection end in the first instruction interval area according to the feature code, and executing corresponding operation in the first display window.
7. The multi-window on-screen interaction method according to claim 1, wherein the obtaining of the operation instruction of the terminal through the second instruction interval region and the execution of the corresponding operation in the second display window comprise:
acquiring an operation instruction of the terminal through the second instruction interval area;
determining the interaction state of the terminal and the screen projection end;
executing corresponding operation in the second display window according to the operation instruction of the terminal and the interaction state;
and displaying the state after the interaction and the interactive content after the operation instruction of the terminal is executed in the second display window.
8. The multi-window on-screen interaction method of claim 1, further comprising:
starting the same-screen interaction function according to the user operation instruction, and displaying a two-dimensional code in a display area of the terminal; wherein, the two-dimensional code includes: the name, the installation package path and the connection request of the application to be screened;
and establishing connection with the screen projection end according to the scanning result and the connection request sent by the screen projection end, and performing same-screen interaction with the screen projection end based on the second display window and the second instruction interval area.
9. A terminal, comprising: a processor and a memory, wherein the memory stores a multi-window on-screen interaction program, and the multi-window on-screen interaction program is used for realizing the multi-window on-screen interaction method according to any one of claims 1 to 8 when being executed by the processor.
10. A storage medium storing a multi-window on-screen interactive program, wherein the multi-window on-screen interactive program is used for implementing the multi-window on-screen interactive method according to any one of claims 1 to 8 when executed by a processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111212804.4A CN113992958B (en) | 2021-10-18 | 2021-10-18 | Multi-window same-screen interaction method, terminal and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111212804.4A CN113992958B (en) | 2021-10-18 | 2021-10-18 | Multi-window same-screen interaction method, terminal and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113992958A true CN113992958A (en) | 2022-01-28 |
| CN113992958B CN113992958B (en) | 2023-07-18 |
Family
ID=79739229
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111212804.4A Active CN113992958B (en) | 2021-10-18 | 2021-10-18 | Multi-window same-screen interaction method, terminal and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113992958B (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114786058A (en) * | 2022-04-27 | 2022-07-22 | 南京欧珀软件科技有限公司 | Multimedia data display method, device, terminal and storage medium |
| CN114979756A (en) * | 2022-05-13 | 2022-08-30 | 北京字跳网络技术有限公司 | Method, device and equipment for realizing one-to-many independent screen projection display and interaction |
| CN115562696A (en) * | 2022-02-24 | 2023-01-03 | 荣耀终端有限公司 | Software upgrading method, control equipment and intelligent screen |
| CN116048341A (en) * | 2022-07-28 | 2023-05-02 | 荣耀终端有限公司 | Multi-screen cooperation method and electronic equipment |
Citations (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102630057A (en) * | 2012-04-25 | 2012-08-08 | 青岛海信电器股份有限公司 | Multi-screen interactive system, intelligent terminal and multi-screen interactive control method |
| US20140009394A1 (en) * | 2012-07-06 | 2014-01-09 | Lg Electronics Inc. | Mobile terminal, image display device and user interface provision method using the same |
| CN104965632A (en) * | 2015-05-29 | 2015-10-07 | 深圳市金立通信设备有限公司 | Projection method and terminal |
| CN105892977A (en) * | 2016-05-30 | 2016-08-24 | 乐视控股（北京）有限公司 | Multi-screen system interaction method, multi-screen system interaction device and smart television |
| CN108475184A (en) * | 2016-02-16 | 2018-08-31 | 三星电子株式会社 | Electronic equipment and its apply data display method |
| CN108513008A (en) * | 2018-03-28 | 2018-09-07 | 努比亚技术有限公司 | control right transfer method, mobile terminal and computer readable storage medium |
| CN110471639A (en) * | 2019-07-23 | 2019-11-19 | 华为技术有限公司 | Display methods and relevant apparatus |
| CN110597474A (en) * | 2019-09-12 | 2019-12-20 | 联想(北京)有限公司 | Information processing method and electronic equipment |
| CN110659007A (en) * | 2019-08-22 | 2020-01-07 | 上海赫千电子科技有限公司 | Multi-screen interaction method applied to automobile |
| CN111399789A (en) * | 2020-02-20 | 2020-07-10 | 华为技术有限公司 | Interface layout method, device and system |
| CN111601120A (en) * | 2020-04-21 | 2020-08-28 | 江苏大学 | Wireless screen transmission display system and display method |
| CN111880870A (en) * | 2020-06-19 | 2020-11-03 | 维沃移动通信有限公司 | Method and device for controlling electronic equipment and electronic equipment |
| CN112333474A (en) * | 2020-10-28 | 2021-02-05 | 深圳创维－Rgb电子有限公司 | Screen projection method, system, equipment and storage medium |
| CN112905089A (en) * | 2021-02-07 | 2021-06-04 | 北京小米移动软件有限公司 | Equipment control method and device |
| CN113504883A (en) * | 2021-07-08 | 2021-10-15 | 北京字节跳动网络技术有限公司 | Window control method and device, electronic equipment and storage medium |
-
2021
- 2021-10-18 CN CN202111212804.4A patent/CN113992958B/en active Active
Patent Citations (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102630057A (en) * | 2012-04-25 | 2012-08-08 | 青岛海信电器股份有限公司 | Multi-screen interactive system, intelligent terminal and multi-screen interactive control method |
| US20140009394A1 (en) * | 2012-07-06 | 2014-01-09 | Lg Electronics Inc. | Mobile terminal, image display device and user interface provision method using the same |
| CN104965632A (en) * | 2015-05-29 | 2015-10-07 | 深圳市金立通信设备有限公司 | Projection method and terminal |
| CN108475184A (en) * | 2016-02-16 | 2018-08-31 | 三星电子株式会社 | Electronic equipment and its apply data display method |
| CN105892977A (en) * | 2016-05-30 | 2016-08-24 | 乐视控股（北京）有限公司 | Multi-screen system interaction method, multi-screen system interaction device and smart television |
| CN108513008A (en) * | 2018-03-28 | 2018-09-07 | 努比亚技术有限公司 | control right transfer method, mobile terminal and computer readable storage medium |
| CN110471639A (en) * | 2019-07-23 | 2019-11-19 | 华为技术有限公司 | Display methods and relevant apparatus |
| CN110659007A (en) * | 2019-08-22 | 2020-01-07 | 上海赫千电子科技有限公司 | Multi-screen interaction method applied to automobile |
| CN110597474A (en) * | 2019-09-12 | 2019-12-20 | 联想(北京)有限公司 | Information processing method and electronic equipment |
| CN111399789A (en) * | 2020-02-20 | 2020-07-10 | 华为技术有限公司 | Interface layout method, device and system |
| CN111601120A (en) * | 2020-04-21 | 2020-08-28 | 江苏大学 | Wireless screen transmission display system and display method |
| CN111880870A (en) * | 2020-06-19 | 2020-11-03 | 维沃移动通信有限公司 | Method and device for controlling electronic equipment and electronic equipment |
| CN112333474A (en) * | 2020-10-28 | 2021-02-05 | 深圳创维－Rgb电子有限公司 | Screen projection method, system, equipment and storage medium |
| CN112905089A (en) * | 2021-02-07 | 2021-06-04 | 北京小米移动软件有限公司 | Equipment control method and device |
| CN113504883A (en) * | 2021-07-08 | 2021-10-15 | 北京字节跳动网络技术有限公司 | Window control method and device, electronic equipment and storage medium |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115562696A (en) * | 2022-02-24 | 2023-01-03 | 荣耀终端有限公司 | Software upgrading method, control equipment and intelligent screen |
| CN115562696B (en) * | 2022-02-24 | 2023-09-08 | 荣耀终端有限公司 | Software upgrading method, control equipment and intelligent screen |
| CN114786058A (en) * | 2022-04-27 | 2022-07-22 | 南京欧珀软件科技有限公司 | Multimedia data display method, device, terminal and storage medium |
| CN114786058B (en) * | 2022-04-27 | 2024-02-06 | 南京欧珀软件科技有限公司 | Multimedia data display method, device, terminal and storage medium |
| CN114979756A (en) * | 2022-05-13 | 2022-08-30 | 北京字跳网络技术有限公司 | Method, device and equipment for realizing one-to-many independent screen projection display and interaction |
| CN114979756B (en) * | 2022-05-13 | 2024-05-07 | 北京字跳网络技术有限公司 | Method, device and equipment for realizing one-to-many screen-throwing independent display and interaction |
| CN116048341A (en) * | 2022-07-28 | 2023-05-02 | 荣耀终端有限公司 | Multi-screen cooperation method and electronic equipment |
| CN116048341B (en) * | 2022-07-28 | 2023-09-15 | 荣耀终端有限公司 | Multi-screen cooperation method and electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113992958B (en) | 2023-07-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11068249B2 (en) | Downloading and launching an app on a second device from a first device | |
| CN113992958A (en) | Multi-window same-screen interaction method, terminal and storage medium | |
| CN111741372B (en) | Screen projection method for video call, display device and terminal device | |
| CN111050199B (en) | Display device and scheduling method of Bluetooth communication resources of display device | |
| CN110888615A (en) | Multi-input equipment interaction method, device and medium for double-screen different display of Android system | |
| CN112272417B (en) | double-Bluetooth sound box reconnection method and display device | |
| KR101249719B1 (en) | Method for executing clone applications, computer readable recording medium for the same, and clone devices for the same | |
| US11671556B2 (en) | Method of performing video call and display device | |
| CN110675872A (en) | Voice interaction method based on multi-system display equipment and multi-system display equipment | |
| CN112230943A (en) | Application processing method and device and electronic equipment | |
| CN112217671B (en) | Method and equipment for performing interface display on front-end micro-service based on split deployment | |
| CN116366796A (en) | Video call method and display device | |
| CN113784200A (en) | Communication terminal, display device and screen projection connection method | |
| WO2021120586A1 (en) | Account synchronization method, mobile device and smart television | |
| CN112436986A (en) | Network distribution method and device, network distribution equipment and computer readable storage medium | |
| CN116235522A (en) | Display method and display device | |
| EP3748492A1 (en) | Downloading and launching an app on a second device from a first device | |
| CN112351334A (en) | File transmission progress display method and display equipment | |
| CN108600838B (en) | Information source switching method and device for Android television, Android television and readable storage medium | |
| CN112911359A (en) | Resource display method, display equipment and remote controller | |
| CN110868640A (en) | Resource transfer method, device, equipment and storage medium | |
| CN112449245B (en) | Method for displaying application upgrading progress of dual-system display equipment and display equipment | |
| US20240179364A1 (en) | Display apparatus, terminal device and communication connection method | |
| CN113641423B (en) | Display device and system starting method | |
| CN109032651B (en) | Application updating method, intelligent terminal and computer readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |