CN113687748A - Application control method, device, equipment and storage medium - Google Patents

Application control method, device, equipment and storage medium Download PDF

Info

Publication number
CN113687748A
CN113687748A CN202111022928.6A CN202111022928A CN113687748A CN 113687748 A CN113687748 A CN 113687748A CN 202111022928 A CN202111022928 A CN 202111022928A CN 113687748 A CN113687748 A CN 113687748A
Authority
CN
China
Prior art keywords
application
interface
display screen
target
interaction component
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202111022928.6A
Other languages
Chinese (zh)
Inventor
李法镜
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tencent Technology Shenzhen Co Ltd
Original Assignee
Tencent Technology Shenzhen Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tencent Technology Shenzhen Co Ltd filed Critical Tencent Technology Shenzhen Co Ltd
Priority to CN202111022928.6A priority Critical patent/CN113687748A/en
Publication of CN113687748A publication Critical patent/CN113687748A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04817—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance using icons
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/451—Execution arrangements for user interfaces

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • Multimedia (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • General Health & Medical Sciences (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The application relates to the technical field of information, is applied to a vehicle-mounted scene, and provides an application control method, an application control device, computer equipment and a storage medium. The application can realize that a user uses the same application on multiple screens controlled by the same operating system, and comprises the following steps: displaying a first application interface of a target application on a first display screen of the driving end, and displaying a second application interface of the target application on a second display screen of the driving end; receiving an application control operation for a target application; when the application control operation is the application control operation aiming at the first display screen, determining a first interface interaction component corresponding to the first display screen from the candidate interface interaction component set corresponding to the target application, and responding to the application control operation through the first interface interaction component; and when the application control operation is the application control operation aiming at the second display screen, determining a second interface interaction component corresponding to the second display screen from the candidate interface interaction component set, and responding to the application control operation through the second interface interaction component.

Description

Application control method, device, equipment and storage medium
Technical Field
The present application relates to the field of information technology, and in particular, to an application control method, apparatus, computer device, and storage medium.
Background
With the development of science and technology, people are more and more popular to use automobiles in daily life for going out, and vehicle-mounted application programs are also increased explosively. An in-vehicle application is a tool that provides an in-vehicle information service to a user, and is widely used in a driving scene, for example, in which the user can operate a music playing application displayed on a display screen through the display screen installed in a vehicle to listen to music.
In the conventional technology, different display screens on a vehicle have different functions, so that the corresponding applications are different, if a passenger or a driver on the vehicle needs to use a certain function, the passenger or the driver needs to operate the display screen, and the application control efficiency is low.
Disclosure of Invention
In view of the above, it is necessary to provide an application control method, apparatus, computer device and storage medium for solving the above technical problems.
An application control method, the method comprising: displaying a first application interface of a target application on a first display screen of a driving end, and displaying a second application interface of the target application on a second display screen of the driving end; receiving an application control operation for the target application; when the application control operation is the application control operation aiming at the first display screen, determining a first interface interaction component corresponding to the first display screen from a candidate interface interaction component set corresponding to the target application, and responding to the application control operation through the first interface interaction component to update the interface of the first application interface; the candidate interface interaction component set comprises interface interaction components of different display screens corresponding to the target application in a driving operation system of the driving end; when the application control operation is the application control operation aiming at the second display screen, determining a second interface interaction component corresponding to the second display screen from the candidate interface interaction component set, and responding to the application control operation through the second interface interaction component to update the second application interface.
An application control apparatus, the apparatus comprising: the application interface display module is used for displaying a first application interface of a target application on a first display screen of a driving end and displaying a second application interface of the target application on a second display screen of the driving end; an application control operation receiving module, configured to receive an application control operation for the target application; a first interface updating module, configured to determine, when the application control operation is an application control operation for the first display screen, a first interface interaction component corresponding to the first display screen from a candidate interface interaction component set corresponding to the target application, and perform interface updating on the first application interface by responding to the application control operation through the first interface interaction component; the candidate interface interaction component set comprises interface interaction components of different display screens corresponding to the target application in a driving operation system of the driving end; and the second interface updating module is used for determining a second interface interaction component corresponding to the second display screen from the candidate interface interaction component set when the application control operation is the application control operation aiming at the second display screen, and responding to the application control operation through the second interface interaction component to update the interface of the second application interface.
In some embodiments, the second interface updating module is further configured to, when the application control operation is an application control operation for the second display screen, use the set of interface interaction components corresponding to the application process of the first display screen as the set of candidate interface interaction components; acquiring interface interaction components corresponding to the second display screen and the target application from the candidate interface interaction component set to serve as second interface interaction components; and responding to the application control operation through the second interface interaction assembly to perform interface updating on the second application interface to obtain an updated second application interface, and projecting the updated second application interface into the second display screen.
In some embodiments, the application interface display module is further configured to receive an application start operation for a target application of the second display screen; responding to the application starting operation, and creating a second interface interaction component corresponding to the target application; adding the second interface interaction component into an interface interaction component set corresponding to the application process of the first display screen, and establishing a corresponding relation between the second display screen and the target application and the second interface interaction component; and displaying a second application interface of the target application on the second display screen through the second interface interaction component.
In some embodiments, the first interface updating module is further configured to, when the application control operation is a play operation for first multimedia content, play the first multimedia content on the first application interface, and stop playing second multimedia content on the second application interface.
In some embodiments, the first interface updating module is further configured to generate play stop indication information for the second interface interaction component; the playing stop indication information is used for indicating the second interface interaction component to stop playing the second multimedia content; generating content playing end information based on the playing stop indication information through the second interface interaction component; the content playing end information is generated after the playing of the second multimedia content currently played on the second application interface is finished, or generated after receiving a playing stop operation aiming at the second multimedia content; and when the content playing ending information is received, playing the first multimedia content on the first application interface.
In some embodiments, the apparatus further includes a content playing end information generating module, configured to display a playing stop prompt message on the second application interface in response to the playing stop indication message; generating the content playback end information in response to a playback stop operation for the playback stop instruction information.
In some embodiments, the application interface display module is further configured to receive an application launch operation for the target application on a second display screen; and responding to the application starting operation, and displaying a second application interface which has a content association relation with the first application interface in the target application on a second display screen of the driving end.
In some embodiments, the application interface display module is further configured to, in response to the application start operation, take a forward application page as a second application interface having a content association relationship with the first application interface; the forward application page is a forward application page of the first application interface in the target application; and displaying the second application interface on a second display screen of the driving end.
In some embodiments, the application interface display module is further configured to display a first application interface of a target application on a first display screen of a driving end, and receive a content selection operation for the first application interface; and when the target content selected by the content selection operation is the content corresponding to the second display screen, displaying a second application interface of the target application on the second display screen of the driving end, and displaying the target content through the second application interface.
In some embodiments, the application interface display module is further configured to display a second application interface of the target application on a second display screen corresponding to the target driving identity information in the driving terminal when the target content selected by the content selection operation is content corresponding to the target driving identity information, and display the target content through the second application interface.
In some embodiments, the application interface display module is further configured to display a first application interface of the target application on a first display screen of the driving end; receiving application starting operation of a target application of a second display screen; and responding to the application starting operation, displaying a second application interface of the target application on the second display screen, and displaying interface display prompt information of the target application on the second application interface, wherein the interface display prompt information is used for prompting that the first application interface is displayed on the first display screen.
A computer device comprising a memory storing a computer program and a processor implementing the steps of the application control method described above when executing the computer program.
A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the above-mentioned application control method.
A computer program product comprising a computer program which, when executed by a processor, carries out the steps of the above-mentioned application control method.
According to the application control method, the application control device, the computer equipment and the storage medium, the first application interface of the target application is displayed on the first display screen of the driving end, and the second application interface of the target application is displayed on the second display screen of the driving end; receiving an application control operation for a target application; when the application control operation is the application control operation aiming at the first display screen, determining a first interface interaction component corresponding to the first display screen from a candidate interface interaction component set corresponding to the target application, responding to the application control operation through the first interface interaction component, and updating an interface of the first application interface; the candidate interface interaction component set comprises interface interaction components of different display screens corresponding to the target application in a driving operation system of a driving end; and when the application control operation is the application control operation aiming at the second display screen, determining a second interface interaction component corresponding to the second display screen from the candidate interface interaction component set, and responding to the application control operation through the second interface interaction component to update the interface of the second application interface. Because the candidate interface interaction component set comprises interface interaction components of different display screens corresponding to the target application in the driving operation system of the driving end, when different display screens display the application interface of the same application, if the application control operation aiming at the target application is received, the interface interaction component corresponding to the display screen corresponding to the application control operation can be judged, and the operated application interface is updated according to the determined interface interaction component responding to the application control operation.
Drawings
FIG. 1 is a diagram of an application scenario in which a control method is applied in one embodiment;
FIG. 2 is a flow diagram illustrating an exemplary implementation of a control method;
FIG. 3 is a diagram of a user opening a small scene centric application on a different screen in one embodiment;
FIG. 4 is a diagram illustrating processing of interface interaction components for small scenes for small scene centric applications for different screens in one embodiment;
FIG. 5 is a diagram that illustrates processing of interface interaction components for a navigation application for different screens in one embodiment;
FIG. 6 is a diagram illustrating a user being prompted to stop playing multimedia content for a second screen in one embodiment;
FIG. 7 is a diagram illustrating interface hopping for the same application for different screens in one embodiment;
FIG. 8 is a schematic diagram of interface hopping for the same application on different screens in another embodiment;
FIG. 9 is an Activity projection diagram between the center control screen and the secondary screen of the pilot's head in one embodiment;
FIG. 10 is a diagram of a development framework for a small scenario in one embodiment;
FIG. 11 is a block diagram showing the structure of an application control device according to an embodiment;
FIG. 12 is a diagram illustrating an internal structure of a computer device according to an embodiment.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.
Reference in the specification to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the specification. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is explicitly and implicitly understood by one skilled in the art that the embodiments described herein can be combined with other embodiments.
The application control method provided by the application control method can be applied to a driving end, wherein the driving end is provided with a plurality of display screens controlled by the same operation system, for example, the driving end of a vehicle and the like is provided with at least one of a main driving screen, a central control screen or a secondary driving screen controlled by the same operation system. Hereinafter, the first display screen, the second display screen, the third display screen, and the like are used to distinguish the display screens. In some schemes, if a user needs to open an application on a second display screen after opening the application on a first display screen, since the first display screen and the second display screen are both controlled by the same operating system, the application on the first display screen needs to be closed first, and then the application needs to be opened on the second display screen, so that the user cannot simultaneously operate the same application on multiple screens. In the application control method provided by the application, for a plurality of display screens controlled by the same operating system, a user can input operation for the same application to each display screen respectively, and use the application on each display screen simultaneously, so that the application control efficiency is improved.
Illustratively, the operating system 102 shown in FIG. 1 controls a first display screen 104 and a second display screen 106; the first display screen and the second display screen show a plurality of application icons (different applications are represented by "1", "2", "3", "4", "5", and "6"). If a user wants to open an application corresponding to the application icon "6" on the first display screen 104 and the second display screen 106, the user can click the application icon "6" displayed on the first display screen 104 and the second display screen 106, or send a voice command of "please open xx applications of the first display screen 104 and the second display screen 106", after receiving the click operation or the voice command, the operating system 102 can create an interface interaction component (i) in the first display screen 104 and an interface interaction component (ii) in the second display screen 106, the two interface interaction components are interaction components corresponding to xx applications, taking the xx application as a gourmet application as an example, an interaction interface of nearby gourmet can be displayed on the first display screen 104 through the interface interaction component (i), and an interaction interface of nearby gourmet can be displayed on the second display screen 106 through the interface interaction component (ii).
Then, after the first display screen 104 and the second display screen 106 display the corresponding interactive interfaces, if the user clicks a "shop c" control of the interactive interface displayed by the first display screen 104, a rating and location detail interface of the shop c is displayed on the first display screen 104; if the user can click on the "shop b" control of the interactive interface displayed on the second display 106, a rating and location details interface for shop b is displayed on the first display 104. Therefore, control operation on the same application can be triggered on different display screens, and application interfaces displayed on different display screens can be different.
The application is a software program for providing services for users, such as a navigation application, a food searching application, or a song playing application; the above application may be: parent or child applications, etc.; a child application is commonly referred to as an applet or a small scene, and is an application that can be implemented in the environment provided by a parent application. The parent application is an application for bearing the child application, and provides an environment for implementing the child application. The parent application is a native application. A native application is an application that can run directly on an operating system. For example, the parent application may be an instant messaging application, and the child application may be a file management application, a mail application, or a game application, among others. After the sub application program is released, the icon of the sub application program can be displayed in the page corresponding to the parent application program, and after the user clicks the icon, the sub application program can be run in the environment provided by the parent application program, for example, the game application program can be run, so that the user can enter the game without installing the game application program in a driving end in advance.
In one embodiment, as shown in fig. 2, there is provided an application control method, which may be performed by a driving end, including the steps of:
step S202, a first application interface of the target application is displayed on a first display screen of the driving end, and a second application interface of the target application is displayed on a second display screen of the driving end.
The driving end can be a driving tool such as a vehicle, an airplane or a ship, the driving end can be provided with at least two display screens, and each display screen can be used for displaying an application interface, for example, the vehicle is provided with at least two display screens of a main driving screen, a central control screen or an auxiliary driving screen. The driving end can be further provided with at least one operating system, and different display screens can be controlled by the same operating system.
The application is a software program for providing a service to a user, and may be provided in the driver's end. Among a plurality of applications installed at the driver end, an application that the user wants to use may be referred to as a target application, and the target application may be started in response to a user operation; the target application may be a parent application or a child application, for example, the parent application may be a small-scene central application in a driving end, and the small-scene central application integrates a plurality of small-scene inlets to provide an operating environment for implementing a small scene; for another example, the sub-application may be a small-scene application that can be used without being installed in the driver side. The small scene center application can provide various vehicle-mounted information service application entrances in the driving scene. The small-scene application is an application for improving information services in a driving scene. For example, it may be an application that enhances a food service or an application that enhances a navigation service.
The application interface is used for providing corresponding information for the user, for example, the application interface of the food searching application can display the content related to food, such as at least one of pictures, texts or videos. The first application interface and the second application interface are application interfaces of the same application. The first application interface is displayed in response to an operation directed to the first display screen; the second application interface is presented in response to an operation directed to the second display screen. The information displayed on the first application interface and the second application interface may be different.
In the embodiment of the application, the first application interface can be displayed in response to an operation on the target application on the first display screen. And displaying the second application interface in response to the operation of the target application on the second display screen. The operation for the target application may be an operation of clicking a control of the display screen by the user, or an operation of sending a voice instruction by the user, and the operation of triggering and displaying the application interface may be an operation of starting the application.
The user can make operations aiming at the target applications on the first display screen and the second display screen at the same time or in sequence; in order to ensure the timeliness of response, when a user simultaneously performs corresponding operations on target applications of the first display screen and the second display screen, the operating system can simultaneously display corresponding application interfaces displayed on the first display screen and the second display screen; when the user performs corresponding operations on the target applications of the first display screen and the second display screen, the corresponding application interfaces displayed on the first display screen and the second display screen can be displayed in sequence. In order to distinguish the application interfaces displayed on the first display screen and the second display screen, the first application interface and the second application interface are used for distinguishing.
In step S204, an application control operation for the target application is received.
Wherein the application control operation is an operation for controlling an application; for example, the start-play operation for an application such as music is music for starting the play of the application, so that the user can acquire a song playing service provided by the application. The application control operation may be triggered by at least one of speech or gestures. For example, the application control operation may be characterized by a control click operation on the display screen or by a voice command.
The step is described by taking the representation of application control operation through control clicking operation as an example: after a first application interface of a target application is displayed on a first display screen and a second application interface of the target application is displayed on a second display screen, if a user clicks a control of the first application interface of the target application on the first display screen, the control is input from the first display screen according to the clicking operation of the control, and the application control operation aiming at the target application can be determined to be aiming at the first display screen; if the user clicks a control of the second application interface of the target application on the second display screen, the application control operation for the target application can be determined to be for the second display screen according to the input from the second display screen by the control clicking operation.
In step S206, the display screen to which the control operation is applied is determined.
Because the driving end is provided with a plurality of display screens, after receiving the application control operation of the target application, the display screen to which the application control operation is directed can be determined, and if the application control operation is directed to the first display screen, the step S208 is performed; if the operation is an application control operation for the second display screen, the process proceeds to step S210.
In one embodiment, when the application control operation is a touch operation for a display screen, the display screen operated by the touch operation may be used as the display screen for the application control operation. For example, if a user clicks a control of a first application interface of a target application on a first display screen, it may be determined that the display screen targeted by the application control operation is the first display screen; for another example, if the user clicks a control of the second application interface of the target application on the second display screen, it may be determined that the display screen targeted by the application control operation is the second display screen.
In one embodiment, for the voice operation, the display screen to which the control operation is applied may be determined based on at least one of display screen indication information in the voice information or a correspondence relationship between a voice user corresponding to the voice information and the display screen. For example, indication information related to the display screen in the voice information may be acquired, and the display screen corresponding to the voice operation may be determined based on the indication information. For example, assuming that the voice message is "the gourmet application on the secondary screen enters the xx page", based on the display screen indication message "the secondary screen" in the voice message, it may be determined that the display screen to which the application controls the operation is the secondary screen. For another example, a correspondence relationship between the user and the display screen may be established, when voice information is received, a corresponding voice operation user may be determined based on voiceprint information in the voice information, and a display screen to which the voice operation is directed may be determined based on the voice operation user and the correspondence relationship between the user and the display screen. The corresponding relation between the user and the display screen can be established by receiving the operation of the user on the display screen, and the position of the user is relatively fixed in each driving process, so that the flow for establishing the corresponding relation between the user and the display screen can be automatically triggered if the operation of the user on the display screen is received in each driving process, and in the flow, the voice information of the user is obtained, the voiceprint characteristics of the voice information of the user are extracted and stored, and the corresponding relation between the user and the display screen is established. In this way, when the voice operation is subsequently received, the voiceprint features corresponding to the voice operation are compared with the stored voiceprint features, the user corresponding to the matched voiceprint features is taken as the voice operation user, and the display screen corresponding to the voice operation user is taken as the display screen for the application control operation.
Step S208, when the application control operation is the application control operation for the first display screen, determining a first interface interaction component corresponding to the first display screen from the candidate interface interaction component set corresponding to the target application, and responding to the application control operation through the first interface interaction component to update the interface of the first application interface.
The interface interaction component is used for displaying the content of the corresponding application interface on the display screen and responding to the user operation of the content of the application interface; the interface interaction component can comprise the content of the application interface to be displayed, the monitoring event of the content of the application interface and the like; the interface interaction component can be an Activity container, a fragment container, or the like. Different interface interaction components can be created for the application interfaces of the display screens to respond to user operations on the different display screens. Activity is an application component responsible for interacting with a user and displaying specified controls through a view.
The candidate interface interaction component set comprises interface interaction components of different display screens corresponding to the target application in a driving operation system of a driving end; the interface interaction components of different display screens corresponding to the target application refer to interface interaction components of application interfaces of the target application displayed on different display screens, for example, an interface interaction component of a first application interface of the target application displayed on a first display screen, an interface interaction component of a third application interface of the target application displayed on the first display screen, an interface interaction component of a second application interface of the target application displayed on a second display screen, and an interface interaction component of a fourth application interface of the target application displayed on the second display screen.
In order to improve the determination efficiency of the interface interaction component corresponding to the first application interface, the newly created interface interaction components for each display screen can be added into the candidate interface interaction component set; illustratively, if an interface interaction component (i) and an interface interaction component (iii) are created for the first display screen, the creation time of the interface interaction component (i) is later than that of the interface interaction component (iii), and the interface interaction component (i) belongs to the interface interaction component newly created for the first display screen, so the interface interaction component (i) is added into the candidate interface interaction component set; similarly, for the processing modes of the interface interaction components of other display screens, the interface interaction components included in the candidate interface interaction component set can be in one-to-one correspondence with the display screens according to the processing mode of the interface interaction component of the first display screen, so that the condition that a plurality of interface interaction components of one display screen are all brought into the candidate interface interaction component set is avoided, and the determination efficiency of the interface interaction component corresponding to the first application interface is improved.
The interface update refers to updating an application interface displayed on a display screen, such as opening a new application interface, closing a currently displayed application interface, or changing the content of the currently displayed application interface.
In this step, if the application control operation is for the first display screen, the first interface interaction component corresponding to the first display screen may be determined from the candidate interface interaction component set corresponding to the target application, and the first application interface may be updated in response to the application control operation through the first interface interaction component; as shown in fig. 1, after the first display screen displays the interface of the near food of the application corresponding to the application icon "6", the user clicks the "shop c" control, and jumps to display the detailed interface such as the score and the place of the shop on the first display screen, thereby updating the interface of the near food.
Step S210, when the application control operation is the application control operation for the second display screen, determining a second interface interaction component corresponding to the second display screen from the candidate interface interaction component set, responding to the application control operation through the second interface interaction component, and performing interface updating on the second application interface.
In this step, if the application control operation is for the second display screen, the second interface interaction component corresponding to the second display screen may be determined from the candidate interface interaction component set corresponding to the target application, and the second application interface may be updated in response to the application control operation through the second interface interaction component; as shown in fig. 1, after the second display screen displays the interface of the near food of the application corresponding to the application icon "6", the user clicks the "shop b" control, and jumps to display the detailed interface such as the score and the place of the shop on the second display screen, thereby updating the interface of the near food.
In the application control method, because the candidate interface interaction component set comprises interface interaction components of different display screens corresponding to the target application in the driving operation system of the driving end, when different display screens display an application interface of the same application, if an application control operation aiming at the target application is received, the interface interaction component corresponding to the display screen corresponding to the application control operation can be judged, and the operated application interface is updated according to the determined interface interaction component response application control operation, so that the same operation system can also receive the operation aiming at the different display screens, and the application interface aiming at the display screen aiming at the operation is updated, so that a user can use the same application on multiple screens according to respective needs, and the application control efficiency is improved.
In some embodiments, as shown in fig. 3, the first display screen and the second display screen both display a plurality of application icons, and if the user clicks the application icon "6" and the application corresponding to the application icon "6" is a small scene center application belonging to the parent application, icons of small scenes 61, 62, and 63 may be displayed on the first display screen and the second display screen; and then, when the same small scene or different small scenes are opened on different display screens, the corresponding interface interaction component of the small scene interface is maintained in the process of the small scene center application.
If the small scene center application is installed corresponding to the first display screen, the creation of the process of the small scene center application can be triggered through the first display screen, namely, the process corresponds to the first display screen; correspondingly, the interface interaction component of each small scene interface is also maintained in the process of the small scene center application corresponding to the first display screen. In this case, the step S210 may specifically include the following steps:
when the application control operation is the application control operation aiming at the second display screen, taking the interface interaction component set corresponding to the application process of the first display screen as a candidate interface interaction component set; acquiring interface interaction components corresponding to the second display screen and the target application from the candidate interface interaction component set to serve as second interface interaction components; and responding to the application control operation through the second interface interaction assembly to update the interface of the second application interface to obtain the updated second application interface, and projecting the updated second application interface into the second display screen.
If the target application is a child application, the application process is a process of a parent application on which the child application depends, for example, the target application is a small scene, and the application process is a process of a small scene center application; the application process may maintain interface interaction components of application interfaces of the same small scene or different small scenes opened on different display screens.
The projection is mainly used for displaying and processing application interfaces among different display screens controlled by the same operating system; when the process corresponding to the first display screen maintains the interface interaction component of the second display screen, the application interface corresponding to the interface interaction component of the second display screen maintained by the process corresponding to the first display screen can be displayed on the second display screen in a projection mode.
Taking the case that the process of the small scene center application corresponds to the first display screen as an example, the above steps are introduced: after the small scene center application corresponding to the application icon "6" of the first display screen and the second display screen is opened, a process of the small scene center application corresponding to the first display screen can be created; after the icons of the small scenes 61, and 63 are displayed on the first display screen and the second display screen, if the user clicks the icon of the small scene 63 on the first display screen and clicks the icon of the small scene 62 on the second display screen, the interface interaction component of the application interface of the small scene 61 displayed on the first display screen and the interface interaction component of the application interface of the small scene 62 displayed on the second display screen may be maintained in the above process.
When the user clicks a control in the application interface of the small scene 62 on the second display screen, in the above process, an interface interaction component with the second display screen and the application interface of the small scene 62 may be determined; and responding to the control clicking operation of the small scene 62 of the second display screen through the interface interaction component, updating the application interface of the small scene 62, and projecting the updated second application interface to the second display screen.
In the above embodiment, when the application process of the interface interaction component of the maintenance target application on different display screens corresponds to the first display screen and the application control operation is directed to the second display screen, the updated application interface is displayed on the second display screen in a projection manner, and the response to the application control operation of the user on the second display screen is ensured without creating the application process corresponding to the second display screen.
In some embodiments, the displaying the second application interface of the target application on the second display screen of the driving end may specifically include: receiving application starting operation of a target application of a second display screen; responding to the application starting operation, and creating a second interface interaction component corresponding to the target application; adding the second interface interaction component into the interface interaction component set corresponding to the application process of the first display screen, and establishing a corresponding relation between the second display screen and the target application and the second interface interaction component; and displaying a second application interface of the target application on a second display screen through a second interface interaction component.
The application starting operation for the target application is an application interface for starting the target application and opening the target application, and the application starting operation may include a click operation on a control of an application icon, and may also include issuing a voice instruction of "opening an application".
Taking the small scene center corresponding to the first display screen as an example, the above steps are introduced: as shown in fig. 3, after the user clicks the application icon "6" of the first display screen, the small scene center application is opened and a process of the small scene center application corresponding to the first display screen is created; correspondingly, the interface of the icons jumping to the small scenes 61, 62 and 63 is displayed on the first display screen; if the user clicks the application icon "6" of the second display screen, the interface of the icon of the small scene 61, 62, and 63 is skipped to display on the second display screen, at this time, in order to save computational resources, a process of the small scene center application corresponding to the second display screen may not be created, and the interface interaction component of the interface of the icon of the small scene 61, 62, and 63 displayed on the second display screen is maintained in the process of the small scene center application corresponding to the first display screen.
As shown in fig. 4, after the first display screen displays the interfaces of the icons 61, 62, and 63, if the user clicks the icon of the small scene 63, a corresponding interface interaction component (i) and a corresponding relationship between the interface interaction component (i) and the first display screen and the small scene 63 may be created, and a next interface is displayed on the first display screen through the interface interaction component (i); the interface interaction component (r) may be maintained in the process of the above-described small-scene-centric application corresponding to the first display screen.
After the second display screen displays the interfaces of the icons 61, 62 and 63, if a user clicks the icon of the small scene 62, a corresponding interface interaction component II can be created, the corresponding relationship between the interface interaction component II and the first display screen and the small scene 62 is also created, and the next interface is displayed on the first display screen through the interface interaction component II; meanwhile, the interface interaction component II can be maintained in the process of the small scene center application corresponding to the first display screen.
In the embodiment, the interface interaction components of the same application on different display screens are maintained in the same process, so that resources are saved, and a user can use the same application on multiple screens.
In some embodiments, as shown in fig. 5, a plurality of application icons are displayed on both the first display screen and the second display screen, if a user clicks the application icon "6" of the first display screen and the application corresponding to the application icon "6" is a navigation application belonging to a parent application, a process of the navigation application corresponding to the first display screen may be created, and a corresponding interface interaction component (r) is created, and the application interface corresponding to the interface interaction component (r) is displayed on the first display screen by jumping through the interface interaction component (r); the interface interaction component (r) is maintained in progress in a navigation application corresponding to the first display screen.
Then, if the user clicks an application icon '6' of the second display screen and the application corresponding to the application icon '6' is a navigation application belonging to the parent application, a process of the navigation application corresponding to the second display screen can be created, a corresponding interface interaction component is created, and the application interface corresponding to the interface interaction component is displayed on the second display screen in a skipping mode through the interface interaction component; the interface interaction component is maintained in progress of the navigation application corresponding to the second display screen.
In the above embodiment, when the target application belongs to the parent application, corresponding processes are created for different display screens for the operation of the user on the same application on different display screens, and after the user closes the target application on the first display screen, the target application can still be operated on the second display screen, so that the application operations of the display screens are ensured to be independent from each other.
In some embodiments, the interface updating of the first application interface may specifically include the following steps: and when the application control operation is a playing operation aiming at the first multimedia content, playing the first multimedia content on the first application interface, and stopping playing the second multimedia content on the second application interface.
The multimedia content may include at least one of audio, video, or audio-video. The first application interface and the second application interface displayed on different display screens correspond to different multimedia contents and are distinguished by the first multimedia contents and the second multimedia contents. The playing operation for the multimedia content may be clicking a playing control on an application interface of the display screen, or sending a corresponding voice instruction to the display screen.
Specifically, if the driving end is playing a first multimedia content corresponding to a second application interface of the second display screen, and the user clicks a play control of the first multimedia content on the first application interface of the first display screen, the first multimedia content corresponding to the first application interface of the first display screen may be played, and the playing of the second multimedia content corresponding to the second application interface of the second display screen may be stopped.
In the above embodiment, when the multimedia content corresponding to one of the display screens is being played, if the user wants to play the multimedia content corresponding to the other display screen, the playing of the multimedia content corresponding to one of the display screens may be stopped, and the multimedia content corresponding to the other display screen may be played, so as to avoid audio mixing.
In some embodiments, playing the first multimedia content on the first application interface and stopping playing the second multimedia content on the second application interface may specifically include: generating play stop indication information aiming at the second interface interaction component; generating content playing end information based on the playing stop indication information through a second interface interaction component; and when the content playing ending information is received, playing the first multimedia content on the first application interface.
The playing stop instruction information is used for instructing the second interface interaction component to stop playing the second multimedia content, the playing stop instruction information can be generated by the first interface interaction component, and the first interface interaction component responds to the playing operation of the first multimedia content to generate the playing stop instruction information; specifically, the playing stop instruction information may be used to instruct the second interface interaction component to stop playing the second multimedia content immediately at present, or may be used to instruct the second interface interaction component to stop playing the second multimedia content again after the playing of the second multimedia content is finished. And if the content playing ending information is not received, the first multimedia content is not played on the first application interface.
The content playing end information may be generated after the playing of the second multimedia content currently played on the second application interface is ended, for example, when the user clicks the audio/video playing control on the first application interface of the first display screen, if the audio/video corresponding to the second display screen is being played, the content playing end information may be generated after the audio/video playing corresponding to the second display screen is ended; and responding to the content playing ending information, and playing the audio and video corresponding to the first application interface of the first display screen.
The content playing end information may also be generated by receiving a playing stop operation for the second multimedia content, where the playing stop operation may be a control operation of a user clicking an application interface of the second display screen, or a voice instruction issued by the user. When a user clicks the audio and video playing control on the first application interface of the first display screen, if the audio and video corresponding to the second display screen is being played, the user can input playing stopping operation towards the second display screen, and content playing ending information can be generated at the moment; and responding to the content playing ending information, and playing the audio and video corresponding to the first application interface of the first display screen.
In the above embodiment, the generation timing of the content playing end information may be that the second multimedia content is played end or that the user manually determines, so as to improve the fluency and comfort of multimedia viewing for the user.
In some embodiments, the following steps may also be included: responding to the playing stop indication information, and displaying playing stop prompt information on a second application interface; in response to a play stop operation for the play stop instruction information, content play end information is generated.
The playing stop prompt information is used for prompting a user whether to stop playing the multimedia content of the corresponding display screen based on the playing operation on the first display screen for the first multimedia content, and the playing stop information can be prompted by characters or by voice. The playing stop instruction operation is used for representing that the user confirms that the playing of the corresponding multimedia content is stopped, and the playing stop instruction operation may include an operation of clicking a control or an operation of issuing a voice instruction.
As shown in fig. 6, when a user clicks an audio/video playing control on a first application interface of a first display screen, if a second display screen is playing audio/video, a play stop prompt message "the first display screen needs to play voice, the vehicle space is small, and please confirm whether to stop playing" to avoid voice mixing "may be displayed on a second application interface of the second display screen; if the user clicks the "yes" control, content playing end information can be generated. If not, the playing can be continued.
In the above embodiment, by playing the stop prompt information and the play stop operation for the play stop indication information, the user can determine whether to stop playing the multimedia content of the second display screen according to actual requirements, so as to improve the multimedia viewing experience of the user.
In some embodiments, displaying the second application interface of the target application on the second display screen of the driving end may specifically include: receiving an application starting operation aiming at a target application on a second display screen; and responding to the application starting operation, and displaying a second application interface which has content association relation with the first application interface in the target application on a second display screen of the driving end.
The two application interfaces have a content association relationship, which may mean that the two application interfaces have a forward relationship or a backward relationship, for example, one application interface is a forward application interface of the other application interface, for example, one application page is a previous page of the other application interface. The two application interfaces have a content association relationship, and the content of the two application interfaces can be viewed in a matching manner, for example, one application interface is a poem, and the other application interface is a white-word paraphrase corresponding to the poem. The content association relationship may be determined from a jump relationship of the page or set in response to a user operation.
After the first application interface of the target application is displayed on the first display screen, when the user starts the target application on the second display screen, the second application interface having a content association relation with the first application interface can be displayed on the second display screen.
In the embodiment, when the user operates the same application on different display screens, the application interfaces with the content association relationship are displayed on the two display screens, so that the user can conveniently watch the interface content.
In some embodiments, in response to the application starting operation, displaying, on a second display screen of the driving end, a second application interface having a content association relationship with the first application interface in the target application, may specifically include: responding to the application starting operation, and taking the forward application page as a second application interface having a content association relation with the first application interface; the forward application page is a forward application page of a first application interface in the target application; and displaying a second application interface on a second display screen of the driving end.
The above steps are described with reference to fig. 7: after clicking an application icon '6' on the first display screen by a user, displaying a corresponding application interface by the first display screen, and skipping to display the corresponding application interface on the first display screen in response to the fact that the user clicks the application interface displayed on the first display screen for multiple times; when the first display screen displays a recommended dish interface of shop c, the user clicks the application icon "6" on the second display screen, and at this time, a rating and place interface of shop c, which is a forward application interface of the recommended dish interface, may be displayed on the second display screen. At this time, the user can view the recommended dish interface of the store c on the first display screen and view the rating and location interface of the store c on the second display screen, so that the user can conveniently view the associated content on multiple screens.
In the above embodiment, when the user operates the target application of the second display screen, the forward application interface of the first application interface of the target application displayed on the first display screen is determined, and the forward application interface is displayed on the second display screen, so that the user can view the associated content of the target application in multiple screens.
In some scenarios as shown in fig. 8, after the user clicks the application icon "6" on the first display screen, the first display screen displays the corresponding application interface, and in response to the user performing multiple click operations on the application interface displayed on the first display screen, the application interface displayed on the first display screen is jumped to be displayed on the first display screen; when the first display screen displays the rating and location interface of store c; if the user still operates on the first display screen, the backward application interface of the rating and location interface of the shop c may be displayed on the second display screen, that is, the recommended dish interface of the shop c is displayed on the second display screen. At this time, the user can view the rating and location interface of the store c on the first display screen and view the recommended dish interface of the store c on the second display screen, so that the user can conveniently view the associated content in multiple screens.
In the above embodiment, when the user operates the target application of the first display screen, the backward application interface of the first application interface of the target application displayed on the first display screen is determined, and the backward application interface is displayed on the second display screen, so that the user can view the associated content of the target application in a multi-screen manner.
When the target application is opened on the first display screen, a process of the target application corresponding to the first display screen can be created, and the process is used for maintaining an interface interaction component of an application interface displayed by the first display screen; when the target application is opened on the second display screen, a process of the target application corresponding to the second display screen can be created, and the process is used for maintaining an interface interaction component of an application interface displayed by the second display screen.
In the embodiment, different processes for the same application are created for different display screens, so that the user can operate the same application of different display screens independently, and even if the process of the target application on one display screen is closed, the user can perform application operation on the process of the target application on the other display screen, thereby improving the application control efficiency.
In some embodiments, step S202 may specifically include the following steps: displaying a first application interface of a target application on a first display screen of a driving end, and receiving content selection operation aiming at the first application interface; and when the target content selected by the content selection operation is the content corresponding to the second display screen, displaying a second application interface of the target application on the second display screen of the driving end, and displaying the target content through the second application interface.
The application interface can display various contents, such as navigation routes, travel duration and the like; the content displayed by the application interface can be set to be displayed on a specific display screen, for example, the content of the navigation route is set to be displayed on a second display screen. The corresponding relationship between the content and the display screen may be preset, or may be automatically determined according to the content viewer identity corresponding to the content. For example, it is preset that the navigation path has a correspondence relationship with the driving screen. Still alternatively, when it is detected that the content to be displayed based on the operation is the information relating to driving, it may be automatically determined that the content viewer corresponding to the content is the driver, and the content is displayed on the driving screen. It is to be appreciated that the target content can also be displayed at the first application interface at the same time.
For example, a first application interface of the target application displayed on a first display screen of the driving end comprises the contents of a navigation route and a travel time length; if the user selects the content of the navigation route of the first application interface and the content of the navigation route is set to be displayed on the second display screen, the navigation route can be displayed on the second application interface of the second display screen, and the navigation route is displayed through the second application interface.
In the above embodiment, if the content selected by the user in the first application interface displayed on the first display screen is the content corresponding to the second display screen, the content may be displayed through the second application interface of the second display screen, so that the flexibility of the user in viewing the content is improved. That is, by operating on one display screen, the corresponding information is automatically displayed on the other display screen according to the corresponding relationship between the content corresponding to the operation and the display screen.
In some embodiments, when the target content selected by the content selection operation is a content corresponding to the second display screen, displaying a second application interface of the target application on the second display screen of the driving end, and displaying the target content through the second application interface includes: and when the target content selected by the content selection operation is the content corresponding to the target driving identity information, displaying a second application interface of the target application on a second display screen corresponding to the target driving identity information in the driving end, and displaying the target content through the second application interface.
The users at the driving ends of the vehicles and the like have different identities, such as a driver who sits on the driving seat and is responsible for driving and a user who sits on the copilot seat, and correspondingly, each display screen at the driving end faces the users with different identities, wherein the main driving screen and the central control screen mainly face the driver, and the copilot screen mainly faces the user who sits on the copilot seat.
The steps are described by taking the first display screen as a pilot screen and the second display screen as a central control screen as an example: if the content selected by the user on the second application interface of the secondary driving screen is the navigation route, the content accords with the driving identity of a driver in charge of driving on the driving seat, and the navigation route can be displayed through the second application interface of the central control screen because the central control screen faces the driver.
In the embodiment, the display screen for displaying the content selected by the user is determined according to the driving identity information, so that the use requirement of the driving scene is better met.
In some embodiments, step S202 may specifically include the following steps: displaying a first application interface of a target application on a first display screen of a driving end; receiving application starting operation of a target application of a second display screen; and responding to the application starting operation, displaying a second application interface of the target application on the second display screen, and displaying interface display prompt information of the target application on the second application interface.
The interface display prompt information is used for prompting that the first application interface is displayed on the first display screen; the interface display prompt message can be characterized by characters or voice. For example, after the user clicks the application icon "6" of the first display screen, and after the first application interface corresponding to the application icon "6" is displayed on the first display screen, if the user clicks the application icon "6" of the second display screen, after the second application interface corresponding to the application icon "6" is displayed on the second display screen, the corresponding interface display prompt information may be displayed on the second application interface, and the user is prompted that the application is opened on the first display screen.
In the above embodiment, after the user opens the application on one of the display screens, if the application is opened on the other display screen, the corresponding prompt information may be displayed to prompt the user that the application is already opened on one of the display screens, so that the user can know that the same application is currently operated on multiple screens.
In order to better understand the above method, an application example of the application control method of the present application is described in detail below with reference to fig. 9 and 10. In the application example, the driving end is a vehicle, and the vehicle is provided with a central control screen and a secondary driving screen which are controlled by the same operating system. And the target application is a small scene, the small scene runs in the operating system by relying on a small scene center application, and the small scene center application is installed corresponding to the central control screen. In fig. 9, View refers to a View component, an interface interaction component corresponds to the View component, app (application) refers to an application program, ui (user interface) refers to a user interface, a screen projection scheduling module is used for projecting, a list of small-scene applications can be projected onto an auxiliary driving screen, so that a small-scene application function on the auxiliary driving screen is controlled through a touch screen, and in addition, an SDK (Software Development Kit) can be called to project an application interface of a small scene onto the auxiliary driving screen for displaying. The small scenes may be developed according to the framework shown in fig. 10, and in the development framework shown in fig. 10, APP services represent small scene centers, may be 1, and are mainly used for providing corresponding operating environments for the small scenes; the PageView is an application interface of a small scene, the number of the PageView can be N, the WXML is a set of label language designed by a framework, and a page structure can be constructed by combining a basic component and an event system. WXSS is a set of style language and is used for describing the component style of the WXML, and the WXSS is used for determining how the components of the WXML should be displayed; WXA Framework is a progressive applet development Framework. Webview refers to a web page view. JSAPI refers to an application programming interface, and JS Engine refers to a JavaScript Engine. JavaScript is called JS for short, and is a lightweight, interpreted or just-in-time compiled programming language with function priority. The JS Bridge is a Bridge connecting the two. The small scene obtained according to the development framework shown in fig. 10 can run on an operating system by relying on a small scene center application. The small-scene application can run independently in view and activity.
The application example mainly comprises the following steps:
and step S902, after the vehicle is started, the operating system automatically creates a small scene center application process corresponding to the central control screen.
Step S904, when the user opens the 'find food' small scene on the central control screen, creating an Activity (r) of a first application interface of the 'find food' small scene corresponding to the central control screen, displaying a corresponding application interface on the central control screen through the Activity (r), and maintaining the Activity (r) in a process of central application of the small scene corresponding to the central control screen;
step S906, when a user clicks an icon of a 'food finding' small scene on the secondary driving screen (belonging to application starting operation on the 'food finding' small scene), creating Activity of a forward application interface (hereinafter referred to as a second application interface) of the first application interface, and adding the Activity to a process of a small scene center application corresponding to the middle control screen for maintenance, wherein the Activity is used as a second interface interaction component; the process of the small scene center application corresponding to the central control screen maintains a plurality of Activities, and the Activities form an Activity set (equivalent to an interface interaction component set); besides, Activity is related to the assistant driving screen and the small scene of finding food.
And step S908, displaying a second application interface on the secondary driving screen through Activity.
Step S910, under the condition that a first application interface of a 'food searching' small scene is displayed on a central control screen through Activity (I), and a second application interface is displayed on a secondary driving screen through Activity (II), if application control operation of a user on the central control screen is received, the Activity (I) corresponding to the central control screen and the 'food searching' small scene is determined from a plurality of activities maintained by processes of a small scene central application corresponding to the central control screen, and the first application interface is subjected to interface updating through the Activity (I) in response to the application control operation.
Step S912, under the condition that a first application interface of a 'food searching' small scene is displayed on a central control screen through Activity and a second application interface is displayed on a secondary driving screen through Activity, if application control operation of a user on the secondary driving screen is received, the Activity corresponding to the central control screen and the 'food searching' small scene is determined from a plurality of activities maintained by a process of a small scene central application corresponding to the central control screen, interface updating is carried out on the second application interface through the Activity responding to the application control operation, an updated second application interface is obtained, and the updated second application interface is projected into the secondary driving screen.
Specifically, through the Activity container interface calling module shown in fig. 9, the Activity corresponding to the assistant driving screen and the small scene of finding food is called, and the Activity is projected to the assistant driving screen for display through the screen projection scheduling module.
The application control operation in the above embodiment is mainly used for controlling the operation of a 'searching for food' small scene to provide services required by a user; the application control operation may be to input related information on the corresponding application interface, open a forward application interface/a backward application interface of the currently displayed application interface, or close the currently displayed application interface.
In the above embodiment, because the candidate interface interaction component set includes interface interaction components of different display screens corresponding to the target application in the driving operation system at the driving end, when different display screens display an application interface of the same application, if an application control operation for the target application is received, the interface interaction component corresponding to the display screen corresponding to the application control operation can be determined, and the operated application interface is updated based on the determined interface interaction component in response to the application control operation, therefore, based on the same operation system, operations for the same application on different display screens can also be received, and the application interface on the display screen corresponding to the operation is updated, so that a user can use the same application on multiple screens according to respective needs, and the application control efficiency is improved; when the application process of the interface interaction component of the maintenance target application on different display screens corresponds to the first display screen and the application control operation is directed to the second display screen, displaying the updated application interface to the second display screen in a projection mode, and ensuring the response to the application control operation of the user on the second display screen under the condition that the application process corresponding to the second display screen does not need to be created; in addition, interface interaction components of the same application on different display screens are maintained in the same process, so that resources are saved, and a user can use the same application in multiple screens; in addition, when the user operates the target application of the second display screen, the forward application interface of the first application interface of the target application displayed on the first display screen is determined, and the forward application interface is displayed on the second display screen, so that the user can conveniently view the associated content of the target application in a multi-screen mode.
The application control operation can be an audio and video playing operation, namely, an audio and video corresponding to an application interface currently displayed by a display screen is played; in this case, the present application example may further include the steps of:
step S914, under the condition that the first application interface of the 'find food' small scene is displayed on the middle control screen through Activity (I), and the second application interface is displayed on the copilot screen through Activity (II), if an operation of playing the audio and video corresponding to the first application interface displayed on the middle control screen is received, the Activity (I) corresponding to the middle control screen and the 'find food' small scene is determined from a plurality of activities maintained by the process of the small scene center application corresponding to the middle control screen, and the audio and video corresponding to the first application interface is played through the Activity (I).
Step S916, in the process of playing the audio and video corresponding to the first application interface displayed by the central control screen, if an operation of playing the audio and video corresponding to the second application interface of the secondary driving screen is received, pausing the playing of the audio and video corresponding to the first application interface through Activity:, determining Activity ± > corresponding to the secondary driving screen and the "find food" small scene from a plurality of activities maintained by the process of the small scene central application corresponding to the central control screen, and playing the audio and video corresponding to the second application interface through Activity ±.
In the above embodiment, when the audio and video corresponding to the application interface displayed on the center control screen is played, if an operation of playing the audio and video corresponding to the application interface displayed on the secondary driving screen is received, the playing of the audio and video corresponding to the application interface displayed on the center control screen is suspended, so that the audio mixing situation is avoided.
It should be understood that, although the steps in the flowcharts of fig. 1 to 10 are shown in sequence as indicated by the arrows, the steps are not necessarily performed in sequence as indicated by the arrows. The steps are not performed in the exact order shown and described, and may be performed in other orders, unless explicitly stated otherwise. Moreover, at least some of the steps in fig. 1 to 10 may include multiple steps or multiple stages, which are not necessarily performed at the same time, but may be performed at different times, and the order of performing the steps or stages is not necessarily sequential, but may be performed alternately or alternately with other steps or at least some of the other steps or stages.
In some embodiments, as shown in fig. 11, there is provided an application control apparatus including:
an application interface display module 1102, configured to display a first application interface of a target application on a first display screen of a driving end, and display a second application interface of the target application on a second display screen of the driving end;
an application control operation receiving module 1104, configured to receive an application control operation for the target application;
a first interface updating module 1106, configured to, when the application control operation is an application control operation for the first display screen, determine a first interface interaction component corresponding to the first display screen from a candidate interface interaction component set corresponding to the target application, and perform interface updating on the first application interface by responding to the application control operation through the first interface interaction component; the candidate interface interaction component set comprises interface interaction components of different display screens corresponding to the target application in a driving operation system of the driving end;
a second interface updating module 1108, configured to determine, when the application control operation is an application control operation for the second display screen, a second interface interaction component corresponding to the second display screen from the candidate interface interaction component set, and perform interface updating on the second application interface by responding to the application control operation through the second interface interaction component.
In some embodiments, the second interface updating module 1108 is further configured to, when the application control operation is an application control operation for the second display screen, use the set of interface interaction components corresponding to the application process of the first display screen as the set of candidate interface interaction components; acquiring interface interaction components corresponding to the second display screen and the target application from the candidate interface interaction component set to serve as second interface interaction components; and responding to the application control operation through the second interface interaction assembly to perform interface updating on the second application interface to obtain an updated second application interface, and projecting the updated second application interface into the second display screen.
In some embodiments, the application interface display module 1102 is further configured to receive an application start operation for a target application of the second display screen; responding to the application starting operation, and creating a second interface interaction component corresponding to the target application; adding the second interface interaction component into an interface interaction component set corresponding to the application process of the first display screen, and establishing a corresponding relation between the second display screen and the target application and the second interface interaction component; and displaying a second application interface of the target application on the second display screen through the second interface interaction component.
In some embodiments, the first interface updating module 1106 is further configured to play the first multimedia content on the first application interface and stop playing the second multimedia content on the second application interface when the application control operation is a play operation for the first multimedia content.
In some embodiments, the first interface updating module 1106 is further configured to generate play stop indication information for the second interface interaction component; the playing stop indication information is used for indicating the second interface interaction component to stop playing the second multimedia content; generating content playing end information based on the playing stop indication information through the second interface interaction component; the content playing end information is generated after the playing of the second multimedia content currently played on the second application interface is finished, or generated after receiving a playing stop operation aiming at the second multimedia content; and when the content playing ending information is received, playing the first multimedia content on the first application interface.
In some embodiments, the apparatus further includes a content playing end information generating module, configured to display a playing stop prompt message on the second application interface in response to the playing stop indication message; generating the content playback end information in response to a playback stop operation for the playback stop instruction information.
In some embodiments, the application interface display module is further configured to receive an application launch operation for the target application on a second display screen; and responding to the application starting operation, and displaying a second application interface which has a content association relation with the first application interface in the target application on a second display screen of the driving end.
In some embodiments, the application interface display module 1102 is further configured to, in response to the application start operation, take the forward application page as a second application interface having a content association relationship with the first application interface; the forward application page is a forward application page of the first application interface in the target application; and displaying the second application interface on a second display screen of the driving end.
In some embodiments, the application interface display module 1102 is further configured to display a first application interface of a target application on a first display screen of a driving end, and receive a content selection operation for the first application interface; and when the target content selected by the content selection operation is the content corresponding to the second display screen, displaying a second application interface of the target application on the second display screen of the driving end, and displaying the target content through the second application interface.
In some embodiments, the application interface display module 1102 is further configured to display a second application interface of the target application on a second display screen corresponding to the target driving identity information in the driving terminal when the target content selected by the content selection operation is content corresponding to the target driving identity information, and display the target content through the second application interface.
In some embodiments, the application interface display module 1102 is further configured to display a first application interface of the target application on a first display screen of the driving end; receiving application starting operation of a target application of a second display screen; and responding to the application starting operation, displaying a second application interface of the target application on the second display screen, and displaying interface display prompt information of the target application on the second application interface, wherein the interface display prompt information is used for prompting that the first application interface is displayed on the first display screen.
For the specific definition of the application control device, reference may be made to the above definition of the application control method, which is not described herein again. The modules in the application control device can be implemented wholly or partially by software, hardware and a combination thereof. The modules can be embedded in a hardware form or independent from a processor in the computer device, and can also be stored in a memory in the computer device in a software form, so that the processor can call and execute operations corresponding to the modules.
In some embodiments, a computer device is provided, the internal structure of which may be as shown in fig. 12. The computer device includes a processor, a memory, and a network interface connected by a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program, and a database. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The database of the computer device is used for storing application operation data. The network interface of the computer device is used for communicating with an external terminal through a network connection. The computer program is executed by a processor to implement an application control method.
Those skilled in the art will appreciate that the architecture shown in fig. 12 is merely a block diagram of some of the structures associated with the disclosed aspects and is not intended to limit the computing devices to which the disclosed aspects apply, as particular computing devices may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.
In some embodiments, a computer device is provided, comprising a memory and a processor, the memory storing a computer program, the processor implementing the steps of the above-described method embodiments when executing the computer program.
In some embodiments, a computer-readable storage medium is provided, on which a computer program is stored, which computer program, when being executed by a processor, carries out the steps of the respective method embodiments described above.
In some embodiments, a computer program product is provided, comprising a computer program which, when executed by a processor, performs the steps of the various method embodiments described above.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware instructions of a computer program, which can be stored in a non-volatile computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. Any reference to memory, storage, database or other medium used in the embodiments provided herein can include at least one of non-volatile and volatile memory. Non-volatile Memory may include Read-Only Memory (ROM), magnetic tape, floppy disk, flash Memory, optical storage, or the like. Volatile Memory can include Random Access Memory (RAM) or external cache Memory. By way of illustration and not limitation, RAM can take many forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM), among others.
The technical features of the above embodiments can be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the above embodiments are not described, but should be considered as the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
The above examples only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present patent shall be subject to the appended claims.

Claims (16)

1. An application control method, characterized in that the method comprises:
displaying a first application interface of a target application on a first display screen of a driving end, and displaying a second application interface of the target application on a second display screen of the driving end;
receiving an application control operation for the target application;
when the application control operation is the application control operation aiming at the first display screen, determining a first interface interaction component corresponding to the first display screen from a candidate interface interaction component set corresponding to the target application, and responding to the application control operation through the first interface interaction component to update the interface of the first application interface; the candidate interface interaction component set comprises interface interaction components of different display screens corresponding to the target application in a driving operation system of the driving end;
when the application control operation is the application control operation aiming at the second display screen, determining a second interface interaction component corresponding to the second display screen from the candidate interface interaction component set, and responding to the application control operation through the second interface interaction component to update the second application interface.
2. The method according to claim 1, wherein when the application control operation is an application control operation for the second display screen, determining a second interface interaction component corresponding to the second display screen from the candidate interface interaction component set, and performing interface update on the second application interface through the second interface interaction component in response to the application control operation includes:
when the application control operation is the application control operation aiming at the second display screen, taking the interface interaction component set corresponding to the application process of the first display screen as the candidate interface interaction component set;
acquiring interface interaction components corresponding to the second display screen and the target application from the candidate interface interaction component set to serve as second interface interaction components;
and responding to the application control operation through the second interface interaction assembly to perform interface updating on the second application interface to obtain an updated second application interface, and projecting the updated second application interface into the second display screen.
3. The method of claim 2, wherein displaying the second application interface of the target application on the second display screen of the steering end comprises:
receiving an application starting operation aiming at a target application of the second display screen;
responding to the application starting operation, and creating a second interface interaction component corresponding to the target application;
adding the second interface interaction component into an interface interaction component set corresponding to the application process of the first display screen, and establishing a corresponding relation between the second display screen and the target application and the second interface interaction component;
and displaying a second application interface of the target application on the second display screen through the second interface interaction component.
4. The method of claim 1, wherein the interface updating the first application interface comprises:
and when the application control operation is a playing operation aiming at first multimedia content, playing the first multimedia content on the first application interface, and stopping playing second multimedia content on the second application interface.
5. The method of claim 4, wherein playing the first multimedia content on the first application interface and stopping playing the second multimedia content on the second application interface comprises:
generating play stop indication information aiming at the second interface interaction component; the playing stop indication information is used for indicating the second interface interaction component to stop playing the second multimedia content;
generating content playing end information based on the playing stop indication information through the second interface interaction component; the content playing end information is generated after the playing of the second multimedia content currently played on the second application interface is finished, or generated after receiving a playing stop operation aiming at the second multimedia content;
and when the content playing ending information is received, playing the first multimedia content on the first application interface.
6. The method of claim 5, further comprising:
responding to the playing stop indication information, and displaying playing stop prompt information on the second application interface;
generating the content playback end information in response to a playback stop operation for the playback stop instruction information.
7. The method of claim 1, wherein displaying the second application interface of the target application on the second display screen of the driving end comprises:
receiving an application starting operation aiming at the target application on a second display screen;
and responding to the application starting operation, and displaying a second application interface which has a content association relation with the first application interface in the target application on a second display screen of the driving end.
8. The method according to claim 7, wherein the displaying, on a second display screen of the driving end, a second application interface having a content association relationship with the first application interface in the target application in response to the application starting operation comprises:
responding to the application starting operation, and taking the forward application page as a second application interface having a content association relation with the first application interface; the forward application page is a forward application page of the first application interface in the target application;
and displaying the second application interface on a second display screen of the driving end.
9. The method of claim 1, wherein displaying a first application interface of a target application on a first display screen of a driving end and a second application interface of the target application on a second display screen of the driving end comprises:
displaying a first application interface of a target application on a first display screen of a driving end, and receiving content selection operation aiming at the first application interface;
and when the target content selected by the content selection operation is the content corresponding to the second display screen, displaying a second application interface of the target application on the second display screen of the driving end, and displaying the target content through the second application interface.
10. The method according to claim 9, wherein when the target content selected by the content selection operation is content corresponding to a second display screen, displaying a second application interface of the target application on the second display screen of the driving end, and displaying the target content through the second application interface, includes:
and when the target content selected by the content selection operation is the content corresponding to the target driving identity information, displaying a second application interface of the target application on a second display screen corresponding to the target driving identity information in the driving end, and displaying the target content through the second application interface.
11. The method of claim 1, wherein displaying a first application interface of a target application on a first display screen of a driving end and a second application interface of the target application on a second display screen of the driving end comprises:
displaying a first application interface of a target application on a first display screen of a driving end;
receiving application starting operation of a target application of a second display screen;
and responding to the application starting operation, displaying a second application interface of the target application on the second display screen, and displaying interface display prompt information of the target application on the second application interface, wherein the interface display prompt information is used for prompting that the first application interface is displayed on the first display screen.
12. An application control apparatus, characterized in that the apparatus comprises:
the application interface display module is used for displaying a first application interface of a target application on a first display screen of a driving end and displaying a second application interface of the target application on a second display screen of the driving end;
an application control operation receiving module, configured to receive an application control operation for the target application;
a first interface updating module, configured to determine, when the application control operation is an application control operation for the first display screen, a first interface interaction component corresponding to the first display screen from a candidate interface interaction component set corresponding to the target application, and perform interface updating on the first application interface by responding to the application control operation through the first interface interaction component; the candidate interface interaction component set comprises interface interaction components of different display screens corresponding to the target application in a driving operation system of the driving end;
and the second interface updating module is used for determining a second interface interaction component corresponding to the second display screen from the candidate interface interaction component set when the application control operation is the application control operation aiming at the second display screen, and responding to the application control operation through the second interface interaction component to update the interface of the second application interface.
13. The apparatus of claim 12, wherein the second interface update module is configured to:
when the application control operation is the application control operation aiming at the second display screen, taking the interface interaction component set corresponding to the application process of the first display screen as the candidate interface interaction component set;
acquiring interface interaction components corresponding to the second display screen and the target application from the candidate interface interaction component set to serve as second interface interaction components;
and responding to the application control operation through the second interface interaction assembly to perform interface updating on the second application interface to obtain an updated second application interface, and projecting the updated second application interface into the second display screen.
14. A computer device comprising a memory and a processor, the memory storing a computer program, characterized in that the processor implements the method of any one of claims 1 to 11 when executing the computer program.
15. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the method of any one of claims 1 to 11.
16. A computer program product comprising a computer program, characterized in that the computer program realizes the method of any of claims 1 to 11 when executed by a processor.
CN202111022928.6A 2021-09-01 2021-09-01 Application control method, device, equipment and storage medium Pending CN113687748A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111022928.6A CN113687748A (en) 2021-09-01 2021-09-01 Application control method, device, equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111022928.6A CN113687748A (en) 2021-09-01 2021-09-01 Application control method, device, equipment and storage medium

Publications (1)

Publication Number Publication Date
CN113687748A true CN113687748A (en) 2021-11-23

Family

ID=78584899

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111022928.6A Pending CN113687748A (en) 2021-09-01 2021-09-01 Application control method, device, equipment and storage medium

Country Status (1)

Country Link
CN (1) CN113687748A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114615546A (en) * 2022-02-08 2022-06-10 武汉光庭信息技术股份有限公司 Video playing method and device, electronic equipment and storage medium
CN115509372A (en) * 2022-08-15 2022-12-23 北京罗克维尔斯科技有限公司 Text input method and device, electronic equipment and storage medium
CN115550498A (en) * 2022-08-03 2022-12-30 阿波罗智联(北京)科技有限公司 Screen projection method, device, equipment and storage medium

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160063947A1 (en) * 2014-09-02 2016-03-03 Quanta Storage Inc. System and method for interacting multi-screen in a car
CN109407931A (en) * 2018-10-30 2019-03-01 东风汽车有限公司 Control method of vehicle-mounted control touch screen and electronic control equipment
WO2019041978A1 (en) * 2017-09-01 2019-03-07 中兴通讯股份有限公司 Multi-screen terminal and application display control method and device thereof
CN109491624A (en) * 2017-09-11 2019-03-19 上海博泰悦臻网络技术服务有限公司 Multi-screen control method and device, storage medium and the vehicle device of onboard system
CN110045939A (en) * 2019-04-18 2019-07-23 维沃移动通信有限公司 A kind of multi-screen control method and terminal
CN110386089A (en) * 2019-06-24 2019-10-29 惠州市德赛西威汽车电子股份有限公司 A kind of vehicle device multi-screen interactive display system
CN110618800A (en) * 2019-09-25 2019-12-27 北京梧桐车联科技有限责任公司 Interface display method, device, equipment and storage medium
CN111976479A (en) * 2019-05-24 2020-11-24 北京车和家信息技术有限公司 Display screen display control system
CN112416277A (en) * 2020-11-04 2021-02-26 上海郡码智能科技有限公司 Multi-screen display method and device of vehicle-mounted system, vehicle-mounted system and storage medium

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160063947A1 (en) * 2014-09-02 2016-03-03 Quanta Storage Inc. System and method for interacting multi-screen in a car
WO2019041978A1 (en) * 2017-09-01 2019-03-07 中兴通讯股份有限公司 Multi-screen terminal and application display control method and device thereof
CN109491624A (en) * 2017-09-11 2019-03-19 上海博泰悦臻网络技术服务有限公司 Multi-screen control method and device, storage medium and the vehicle device of onboard system
CN109407931A (en) * 2018-10-30 2019-03-01 东风汽车有限公司 Control method of vehicle-mounted control touch screen and electronic control equipment
CN110045939A (en) * 2019-04-18 2019-07-23 维沃移动通信有限公司 A kind of multi-screen control method and terminal
CN111976479A (en) * 2019-05-24 2020-11-24 北京车和家信息技术有限公司 Display screen display control system
CN110386089A (en) * 2019-06-24 2019-10-29 惠州市德赛西威汽车电子股份有限公司 A kind of vehicle device multi-screen interactive display system
CN110618800A (en) * 2019-09-25 2019-12-27 北京梧桐车联科技有限责任公司 Interface display method, device, equipment and storage medium
CN112416277A (en) * 2020-11-04 2021-02-26 上海郡码智能科技有限公司 Multi-screen display method and device of vehicle-mounted system, vehicle-mounted system and storage medium

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114615546A (en) * 2022-02-08 2022-06-10 武汉光庭信息技术股份有限公司 Video playing method and device, electronic equipment and storage medium
CN114615546B (en) * 2022-02-08 2024-04-12 武汉光庭信息技术股份有限公司 Video playing method and device, electronic equipment and storage medium
CN115550498A (en) * 2022-08-03 2022-12-30 阿波罗智联(北京)科技有限公司 Screen projection method, device, equipment and storage medium
CN115550498B (en) * 2022-08-03 2024-04-02 阿波罗智联(北京)科技有限公司 Screen projection method, device, equipment and storage medium
CN115509372A (en) * 2022-08-15 2022-12-23 北京罗克维尔斯科技有限公司 Text input method and device, electronic equipment and storage medium

Similar Documents

Publication Publication Date Title
CN113687748A (en) Application control method, device, equipment and storage medium
CN110874202B (en) Interaction method, device, medium and operating system
US7451088B1 (en) System and method of handling problematic input during context-sensitive help for multi-modal dialog systems
EP2980744A1 (en) Mirroring deeplinks
CN112231021B (en) Method and device for guiding new functions of software
EP2857265B1 (en) On-board information system, information terminal, and application execution method
CN108349450B (en) Method and device for providing an advisory signal for controlling at least one function in a vehicle
CN109491624A (en) Multi-screen control method and device, storage medium and the vehicle device of onboard system
US20220368798A1 (en) Method and device for displaying video playback interface, terminal device, and storage medium
US20210065685A1 (en) Apparatus and method for providing voice assistant service
CN112748977A (en) Method, device and system for displaying driving scene
CN111722905A (en) Interaction method, information processing method, vehicle and server
CN111246245B (en) Method and device for pushing video aggregation page, server and terminal equipment
CN109471440A (en) Robot control method, device, smart machine and storage medium
CN110308840A (en) Method and device for setting message notification icon of mobile terminal application program
CN114238673A (en) Content display method, device, equipment and storage medium
CN110764724A (en) Display equipment control method, device, equipment and storage medium
US20190044985A1 (en) Method, system and non-transitory computer-readable recording medium for providing a multilateral communication service
US10306316B2 (en) Attention diverter responsive to determination of viewer and content
WO2023221791A1 (en) Chat channel display method and apparatus, device, readable storage medium, and product
KR101890620B1 (en) Mobile terminal and method for controlling a vehicle using the same
CN110908629A (en) Electronic equipment operation method and device, electronic equipment and storage medium
KR20190074344A (en) Dialogue processing apparatus and dialogue processing method
US11620994B2 (en) Method for operating and/or controlling a dialog system
US20180262811A1 (en) Electronic device and electronic device operation method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
REG Reference to a national code

Ref country code: HK

Ref legal event code: DE

Ref document number: 40056111

Country of ref document: HK