CN116893806A

CN116893806A - Flow editor, flow editing method, electronic device and storage medium

Info

Publication number: CN116893806A
Application number: CN202310560063.1A
Authority: CN
Inventors: 黄晨升; 张晨露; 柴金祥
Original assignee: Shanghai Movu Technology Co Ltd; Mofa Shanghai Information Technology Co Ltd
Current assignee: Shanghai Movu Technology Co Ltd; Mofa Shanghai Information Technology Co Ltd
Priority date: 2023-05-17
Filing date: 2023-05-17
Publication date: 2023-10-17

Abstract

The application provides a process editor, a process editing method, electronic equipment and a storage medium, which are used for configuring an explanation process of a target virtual object, wherein the process editor comprises the following components: the content configuration module is used for configuring the explanation content of the target virtual object; the script configuration module is used for configuring the explanation sequence of the target virtual object; and the catalog configuration module is used for configuring the display catalog of the target virtual object. The application provides a flow editor for virtual object interactive application, which can better meet the client requirements of the virtual object interactive application. The application of the existing flow editor in the virtual object interactive application is limited, developers are required to conduct secondary development according to the requirements of specific clients, and the technical scheme provides the flow editor specially aiming at the virtual object interactive application, secondary development is not required, and editing efficiency is greatly improved.

Description

Flow editor, flow editing method, electronic device and storage medium

Technical Field

The present application relates to the technical field of virtual man, interactive design, and artificial intelligence, and in particular, to a flow editor, a flow editing method, an electronic device, and a computer-readable storage medium.

Background

The virtual objects include virtual humans, virtual animals, virtual cartoon figures, and the like. The virtual person is a personified image constructed by CG technology and operated in a code form, and has various interaction modes such as language communication, expression, action display and the like. The technology of the dummy person has been rapidly developed in the field of artificial intelligence and has been applied in many technical fields such as video, media, games, finance, travel, education, medical and so on.

Most of the existing flow editors are applicable to the traditional field and cannot well meet the client requirements of virtual object interactive application. Based on this, the present application provides a flow editor, a flow editing method, an electronic device, and a computer-readable storage medium to improve the prior art.

Disclosure of Invention

The application aims to provide a flow editor, a flow editing method, electronic equipment and a computer readable storage medium, which can better meet the client requirements of virtual object interactive application.

The application adopts the following technical scheme:

in a first aspect, the present application provides a process editor for configuring an explanation process of a target virtual object, the process editor comprising:

The content configuration module is used for configuring the explanation content of the target virtual object;

the script configuration module is used for configuring the explanation sequence of the target virtual object;

and the catalog configuration module is used for configuring the display catalog of the target virtual object.

The beneficial effect of this technical scheme lies in: the flow editor for the virtual object interactive application is used for configuring the explanation content, the explanation sequence and the display catalogue of the target virtual object, and can better meet the client requirements of the virtual object interactive application. The application of the existing flow editor in the virtual object interactive application is limited, a developer is required to carry out secondary development according to the requirements of specific clients, the technical scheme provides the flow editor specially aiming at the virtual object interactive application, a configurator only needs to carry out configuration through a content configuration module, a script configuration module and a catalog configuration module, secondary development is not required, and editing efficiency is greatly improved. The development of the virtual man technology enables the virtual object to display rich contents in various modes and be applied to the fields of film and television, media, games, finance, travel, education, medical treatment and the like. The method and the device have the advantages that the interaction process of the virtual object is required to have clear flow and catalogues, users of clients can know interactive steps and contents conveniently, and the catalogue configuration module is provided.

In some possible implementations, the content configuration module includes a new lecture content button and an lecture content configuration interface; the explanation content configuration interface comprises a content name text input box, a virtual object drop-down menu, an explanation node adding button, an explanation node adding interface and an explanation content display area; the added explanation node interface comprises a node name text input box and a node content drop-down menu;

the newly added explanation content button is used for displaying an explanation content configuration interface after being clicked;

the content name text input box is used for receiving the names of the explanation contents input by the configurator;

the virtual object drop-down menu is used for displaying a plurality of virtual objects, receiving selection operation of a configurator for one of the virtual objects, and taking the selected virtual object as the target virtual object;

the added explanation node button is used for displaying the added explanation node interface after being clicked;

the node name text input box is used for receiving the node name of the corresponding node identifier input by the configurator;

the node content drop-down menu is used for displaying node contents corresponding to the target virtual object, receiving a selection operation of a configurator for one of the node contents, and taking the selected node content as the node content corresponding to the node identifier;

The explanation content display area is used for displaying node content corresponding to the explanation content.

The beneficial effect of this technical scheme lies in: a visual background configuration interface of the explanation content is provided, so that a configurator can create an explanation flow by inputting the name of the explanation content, selecting a target virtual object and node content. The specific operation flow comprises the following steps: first, a configurator clicks a "newly added explanation content button" to open a "explanation content configuration interface", in which the configurator can input the name of the explanation content through a content name text input box, select a target virtual object to be configured through a virtual object drop-down menu, and add node content. When node contents are added, a configurator can open an adding explanation node interface by clicking an adding explanation node button, input a node name in the adding explanation node interface through a node name text input box, display all node contents corresponding to a target virtual object through a node content drop-down menu, and take the node contents selected by the configurator as node contents corresponding to the node identification. In the explanation content display area, the configurator can check the node content corresponding to the already configured explanation content.

In some possible implementations, the content configuration module further includes an explanation content preview interface; the explanation content preview interface comprises an information display area and a progress display area; the progress display area comprises a node editing button and a name editing text input box corresponding to each node identifier;

the information display area is used for displaying the names of the explanation contents and the names of the target virtual objects;

the progress display area is used for displaying node names of node identifiers corresponding to the explanation content;

each node editing button is used for displaying a name editing text input box of the corresponding node identifier after being clicked;

each name editing text input box is used for receiving a display name corresponding to the node identification, which is input by a configurator.

The beneficial effect of this technical scheme lies in: a visual lecture content preview interface is provided that includes an information presentation area and a progress presentation area. The information display area is used for displaying the names of the explanation contents and the names of the target virtual objects, the progress display area is used for displaying the node contents corresponding to the explanation contents, and a node editing button and a name editing text input box are provided for configuration personnel to edit each node. Specifically, each node editing button is used for displaying a name editing text input box of a corresponding node identifier, and the name editing text input box is used for receiving a display name of the node identifier, which is input by a configurator, to the outside.

The node name is entered by the configurator when the lecture node is added, and the display name is entered by the configurator when each node is edited in the lecture content preview interface. By separately inputting and editing the node names and the display names, configuration personnel can control the display effect of the nodes more flexibly so as to achieve better display effect. For example, the node name of a node may be longer, less easily understood, or less suitable for presentation to a user (e.g., with the addition of a remark to a configurator), but may be made more understandable or more suitable for presentation to a user by editing the display name, improving the user experience. In addition, separating node names from display names also enhances maintainability of the configuration process. If the node name and the display name are synchronized, the node name needs to be modified when the display name needs to be changed, and the change of the node name usually involves maintenance operation of the core database, which may be difficult to complete due to complex business logic or cause excessive access pressure to the core database. By separating the node name from the display name, the node name can pay more attention to the business logic and functions of the node, and the display name is determined by design and user experience, so that better code multiplexing and maintenance effects are achieved.

In some possible implementations, the script configuration module includes a new guest guide button, a play interrupt old guest guide button, a play end old guest guide button, an explanation sequence button, an end content button, a first add explanation content interface, and a second add explanation content interface; the first added explanation content interface comprises an explanation content single selection frame; the second added explanation content interface comprises a first explanation content check box;

any one of the new guest guide button, the play interrupt old guest guide button, the play end old guest guide button and the end content button is used for displaying the first adding explanation content interface after being clicked;

the explanation content single selection box is used for receiving the selection operation of the configurator for one of the explanation contents, and the selected one of the explanation contents is used as the explanation content of the playing interface corresponding to the clicked button;

the explanation sequence button is used for displaying the second added explanation content interface after being clicked;

the first explanation content check box is used for receiving a first selection operation of a configurator for one or more explanation contents, adding the selected one or more explanation contents to the explanation contents corresponding to the target virtual object, and taking the adding sequence as the explanation sequence of the target virtual object.

The beneficial effect of this technical scheme lies in: the script configuration module is used for enabling configuration personnel to set the playing sequence of the explanation contents and maintaining the corresponding explanation contents of new guests, old guests and the like of the target virtual object. The new guest guiding button, the playing interruption old guest guiding button, the playing ending old guest guiding button and the ending content button are used for triggering the first adding explanation content interface so as to enable the configurator to select the corresponding new guest, the playing interruption old guest, the playing ending old guest and the ending content. The explanation content radio selection box is used for selecting one explanation content as the explanation content of the playing interface corresponding to the clicked button, so that the selected explanation content can be played by the playing interface corresponding to the new guest, the playing interrupt old guest, the playing end old guest and the end content. The lecture sequence button is used to trigger a second add lecture content interface. The second adding explanation content interface comprises a first explanation content check box, and is used for enabling a configurator to select one or more explanation contents to be added into the explanation contents corresponding to the target virtual object, and the adding sequence is used as the explanation sequence of the target virtual object. Thus, the configurator can set different explanation contents for different virtual objects according to the needs and set the play sequence of the virtual objects according to the needs, thereby better meeting the needs of users. Therefore, the technical scheme can improve the user experience and usability of the virtual object interactive application, so that configuration personnel can set explanation contents and play sequences more conveniently, and the functions and performances of the virtual object interactive application are improved, thereby better meeting the requirements of users.

In some possible implementations, the catalog configuration module includes a catalog configuration button, a catalog configuration interface, and a catalog presentation area; the catalog configuration interface comprises a second explanation content check box; the catalog display area comprises a dragging button corresponding to each explanation content;

the catalog configuration button is used for displaying the catalog configuration interface after being clicked;

the second explanation content check box is used for receiving a second selection operation of the configurator for one or more explanation contents, and adding the selected one or more explanation contents to the display catalog of the target virtual object;

and each dragging button is used for adjusting the display sequence of the corresponding explanation content in the display catalog in a dragging mode.

The beneficial effect of this technical scheme lies in: configuration and presentation functions for a display catalog are provided. The configurator enters the catalog configuration interface through the catalog configuration buttons, one or more explanation contents can be added into the display catalog of the target virtual object by selecting the second explanation content check box, then each explanation content corresponds to one dragging button in the catalog display area, and the display sequence of the explanation contents in the display catalog can be adjusted through the dragging buttons. The method has the advantages that configuration personnel can conveniently configure and manage the display catalogue of the target virtual object, and can add or delete the explanation content in the display catalogue according to the requirement, and adjust the display sequence of the explanation content in the display catalogue, so that the requirement of a user can be met more flexibly. In addition, the technical scheme can also improve the working efficiency of configuration personnel, avoid the complicated process of manually writing the catalogue and simplify the configuration flow.

In a second aspect, an embodiment of the present application provides a process editing method, configured to configure an explanation process of a target virtual object by using any one of the process editors, where the process editors include a content configuration module, a script configuration module, and a directory configuration module, and the method includes:

configuring the explanation content of the target virtual object by utilizing the content configuration module;

configuring the explanation sequence of the target virtual object by utilizing the script configuration module;

and configuring a display catalog of the target virtual object by utilizing the catalog configuration module.

The beneficial effect of this technical scheme lies in: a flow editing method is provided for configuring an explanation flow of a target virtual object. The method includes three modules using a flow editor: the system comprises a content configuration module, a script configuration module and a catalog configuration module. In the content configuration module, the configurator may define the respective lectures of the target virtual object and assign names and other related information thereto. In the script configuration module, a configurator can set the play order of the explanation contents. In the directory configuration module, a configurator may set a display directory for the target virtual object. The method has the advantages that a configurator can conveniently manage the explanation flow of the target virtual object, and can easily configure the explanation content, the explanation sequence and the display catalogue of the target virtual object by using three modules of the flow editor, and can be modified and edited at any time. In addition, the method can also improve the configuration efficiency and reduce the configuration cost, thereby promoting the development of virtual object interactive application.

the configuring the explanation content of the target virtual object by using the content configuration module comprises the following steps:

responding to clicking operation of the newly added explanation content button, and displaying an explanation content configuration interface;

receiving the names of the explanation contents input by the configurator by utilizing the content name text input box;

displaying a plurality of virtual objects by utilizing the virtual object drop-down menu, receiving the selection operation of a configurator for one of the virtual objects, and taking the selected virtual object as the target virtual object;

responding to clicking operation of the adding explanation node button, and displaying the adding explanation node interface;

receiving the node name of the corresponding node identifier input by the configurator by utilizing the node name text input box;

Displaying the node content corresponding to the target virtual object by using the node content drop-down menu, receiving the selection operation of configuration personnel on one of the node contents, and taking the selected node content as the node content corresponding to the node identifier;

and displaying the node content corresponding to the explanation content by utilizing the explanation content display area.

The beneficial effect of this technical scheme lies in: the configurator clicks a new explanation content button, and an explanation content configuration interface is displayed; the configurator inputs the name of the explanation content in the content name text input box; the virtual object drop-down menu displays a plurality of virtual objects, and a configurator selects one of the virtual objects as a target virtual object; the configurator clicks an add explanation node button, and an add explanation node interface is displayed; the configurator inputs the node name corresponding to the node identification in the node name text input box; the node content drop-down menu displays node contents corresponding to the target virtual object, and a configurator selects one of the node contents as the node content corresponding to the node identifier; and the explanation content display area displays node contents corresponding to the explanation content. The method has the advantage of allowing a configurator to configure the explanation content for the target virtual object through various controls provided in the visual background configuration interface, so that the configuration of the explanation content is more flexible and accurate. In addition, by providing the explanation node adding button and the explanation node adding interface, the method can quickly and conveniently add new nodes, and improves the working efficiency.

the configuring the explanation content of the target virtual object by using the content configuration module further includes:

displaying the names of the explanation contents and the names of the target virtual objects by utilizing the information display area;

displaying node names of the node identifiers corresponding to the explanation contents by utilizing the progress display area;

responding to clicking operation of each node editing button, and displaying a name editing text input box of the corresponding node identifier;

and receiving the display name corresponding to the node identifier, which is input by the configurator, by utilizing each name editing text input box.

The beneficial effect of this technical scheme lies in: the explanation content preview interface of the content configuration module comprises an information display area and a progress display area. The progress presentation area includes a node edit button and a name edit text entry box corresponding to each node (identity) for further adjustment of the node by the configurator.

When the content configuration module is used for configuring the explanation content of the target virtual object, a new explanation content button is used for opening an explanation content configuration interface, and the name of the explanation content and the selection target virtual object are input. Then, the nodes are added by adding an explanation node button, and the node contents are selected. At this point, the explanation content presentation area will display the content of the selected node. After the editing is completed, the name of the explanation content, the name of the target virtual object and the node names of the nodes can be checked by using the explanation content preview interface. By clicking on each node edit button, a corresponding name edit text entry box may be displayed for the configurator to modify the displayed name of the node.

The method has the advantages that the visual background configuration interface is provided for configuring the explanation content of the target virtual object, so that configuration personnel can complete the configuration of the explanation content more conveniently and rapidly. In addition, through the node editing buttons and the name editing text input boxes in the progress display area, configuration personnel can modify the display names externally displayed by all nodes in the explanation content at any time so as to better meet the demands of users.

the configuring the explanation sequence of the target virtual object by using the script configuration module comprises the following steps:

displaying the first adding explanation content interface in response to a click operation for any one of the new guest guide button, the play interrupt old guest guide button, the play end old guest guide button and the end content button;

responding to the selection operation of the explanation content radio frame, and taking the selected one explanation content as the explanation content of the playing interface corresponding to the clicked button;

responsive to a click operation for the lecture sequence button, displaying the second add lecture content interface;

in response to a first selection operation for the first explanation content check box, adding the selected one or more explanation contents to the explanation contents corresponding to the target virtual object, and taking the addition order as the explanation order of the target virtual object.

The beneficial effect of this technical scheme lies in: the script configuration module comprises buttons for guiding new guests, guiding playing interrupt old guests, guiding playing end old guests, explaining sequence, ending content and the like, and a first added explanation content interface and a second added explanation content interface. When the configurator clicks a button other than the explanation sequence button, a first explanation content adding interface is opened, a selectable explanation content radio selection frame is displayed, the configurator selects one explanation content, and the explanation content is used as the explanation content of the playing interface corresponding to the button. When the configurator clicks the explanation sequence button, a second explanation adding content interface is opened, a first explanation content check box which can be selected is displayed, the configurator selects one or more explanation contents and adds the explanation contents to the explanation contents corresponding to the target virtual object, and the addition sequence is taken as the explanation sequence. The method has the advantages that the script configuration module is used for configuring the explanation sequence, the target virtual object can be conveniently compiled, and the explanation sequence can be flexibly adjusted, so that the requirements of different users can be better met. Meanwhile, different playing interfaces are provided for different users, so that user experience can be improved, and interactivity and operability are enhanced. Specifically, different play pages may be provided to the user, for example, according to the play type (i.e., the play progress type) of the user of the virtual object interactive application. When the playing type of the user is not played, an initial playing page is displayed, so that the user plays a plurality of explanation contents according to the explanation sequence. When the playing type of the user is the playing interruption, an interruption playing page which is interrupted for playing the last time is displayed, so that the user continues to play the explanation contents corresponding to the interruption playing page and the explanation contents which follow the interruption playing page in the explanation sequence. And when the playing type of the user is that the playing is finished, displaying the explanation content corresponding to the finished playing page. Therefore, the user can directly reach the proper playing page according to the playing progress of the user, and better viewing experience is obtained. By recording the playing state and the position of the user, playing a plurality of explanation contents according to the explanation sequence and supporting the functions of continuous watching after interrupting playing, the watching experience of the user can be improved, the video watching duration can be prolonged, the video playing efficiency can be improved, and the use value and the competitiveness of the virtual object interactive application can be improved.

the configuring, by the directory configuration module, a display directory of the target virtual object includes:

responding to clicking operation of the catalog configuration button, and displaying the catalog configuration interface;

in response to a second selection operation for the second lecture content check box, adding the selected one or more lecture contents to a display directory of the target virtual object;

and adjusting the display sequence of the corresponding explanation content in the display catalogue in a dragging mode by utilizing each dragging button.

The beneficial effect of this technical scheme lies in: the directory configuration module allows a configurator to configure a display directory of the target virtual object. The catalog configuration module comprises a catalog configuration button, a catalog configuration interface and a catalog display area. When the configurator clicks on the catalog configuration button, the catalog configuration interface will be displayed. In the catalog configuration interface, the configurator selects one or more explanation contents through the second explanation content check box and adds the explanation contents to the display catalog of the target virtual object. The catalog display area displays the display catalog of the target virtual object, wherein each explanation content corresponds to one dragging button. By dragging the buttons, the configurator can rearrange the display order of the explanatory content in the display directory. The method has the advantages that a flexible way is provided for managing and rearranging the display catalogs, a configurator can conveniently configure the display catalogs of the target virtual objects, so that the configurator can add, delete or reorder the explanation contents according to the needs, the explanation effect and accessibility of the explanation contents are improved, and the user experience and learning effect are improved.

In some possible implementations, the method further includes:

acquiring historical data of the target virtual object in a preset time period;

aiming at each user identifier in the historical data, acquiring the playing sequence of the explanation content corresponding to each user identifier;

respectively acquiring the similarity between the explanation sequence of the target virtual object and the play sequence corresponding to each user identifier;

calculating the proportion of users with similarity smaller than the preset similarity to the total number of users corresponding to the historical data;

and when the proportion is larger than a preset proportion, sending prompt information to first terminal equipment of the configurator so as to prompt the configurator to adjust the explanation sequence of the target virtual object.

The beneficial effect of this technical scheme lies in: an explanation sequence optimizing method based on historical data is provided. Firstly, acquiring historical data of a target virtual object in a preset time period, and then acquiring the playing sequence of the explanation content corresponding to each user identifier aiming at each user identifier in the historical data. And then, calculating the similarity between the explanation sequence of the target virtual object and the play sequence corresponding to each user identifier, and calculating the proportion of the users with the similarity smaller than the preset similarity to the total number of users corresponding to the historical data. And when the ratio is larger than the preset ratio, sending prompt information to the first terminal equipment of the configurator so as to prompt the configurator to adjust the explanation sequence of the target virtual object. The method has the advantages that the explanation sequence of the user on the preference and the actual demand of different explanation contents can be known by analyzing the real play sequence of the user in the historical data, and the explanation sequence is optimized according to the preference and the actual demand, so that the explanation effect and the user satisfaction of the target virtual object are improved. By prompting configuration personnel to adjust the explanation sequence, the explanation sequence of the target virtual object can be closer to the requirements and preferences of the user, so that the user experience and learning effect are improved.

In some possible implementations, the obtaining the similarity between the explanation sequence of the target virtual object and the play sequence corresponding to each user identifier includes:

for each user identifier, the following processing is performed:

acquiring the playing number N of the explanation content corresponding to the user identification, wherein N is a positive integer;

and obtaining the similarity between the explanation sequence of the first N explanation contents and the playing sequence corresponding to the user identifier, and taking the similarity as the similarity between the explanation sequence of the target virtual object and the playing sequence corresponding to the user identifier.

The beneficial effect of this technical scheme lies in: for each user identifier, firstly, the playing number N of the explanation contents corresponding to the user identifier is obtained, then, for the playing sequence of the N explanation contents corresponding to the user identifier, similarity calculation is carried out on the N explanation contents and the explanation sequence of the first N explanation contents of the target virtual object, and a similarity value is obtained. It should be noted that the N lectures corresponding to the user identification may be the same as or different from the first N lectures of the target virtual object (in the lecture order). Because the user may not play in order of explanation, but may have skip play, etc. The similarity can reflect the preference degree and the demand degree of the user for the explanation sequence of the target virtual object. For each user, a similarity can be calculated. After the similarity of the explanation sequence of each user to the target virtual object is obtained, whether a certain proportion of users in the historical data are dissatisfied with the explanation sequence of the target virtual object or not can be judged according to the similarity, so that configuration personnel are prompted to carry out corresponding adjustment. Therefore, the requirements of users can be better met, the user experience is improved, and the competitiveness of the clients is improved.

In a third aspect, the present application provides an electronic device for configuring an explanation process of a target virtual object using any one of the above process editors, the process editors including a content configuration module, a script configuration module, and a catalog configuration module, the electronic device including a memory and at least one processor, the memory storing a computer program, the at least one processor being configured to implement the following steps when executing the computer program:

In a fourth aspect, the present application provides a computer-readable storage medium storing a computer program which, when executed by at least one processor, performs the steps of any of the methods or performs the functions of any of the electronic devices described above.

Drawings

The application will be further described with reference to the drawings and embodiments.

Fig. 1 is a schematic structural diagram of a flow editor according to an embodiment of the present application.

Fig. 2 is a flow chart of a flow editing method according to an embodiment of the present application.

Fig. 3 is a schematic flow chart of a configuration explanation according to an embodiment of the present application.

Fig. 4 is a schematic flow chart of configuring display names according to an embodiment of the present application.

Fig. 5 is a schematic flow chart of a configuration script according to an embodiment of the present application.

Fig. 6 is a schematic flow chart of a configuration display directory according to an embodiment of the present application.

Fig. 7 is a schematic flow chart of adjusting the explanation sequence according to an embodiment of the present application.

Fig. 8 is a schematic flow chart of obtaining similarity according to an embodiment of the present application.

Fig. 9 is a block diagram of an electronic device according to an embodiment of the present application.

Fig. 10 is a schematic structural diagram of a program product according to an embodiment of the present application.

Detailed Description

The technical scheme of the present application will be described below with reference to the drawings and the specific embodiments of the present application, and it should be noted that, on the premise of no conflict, new embodiments may be formed by any combination of the embodiments or technical features described below.

In embodiments of the application, words such as "exemplary" or "such as" are used to mean serving as an example, instance, or illustration. Any implementation or design described as "exemplary" or "e.g." in the examples of this application should not be construed as preferred or advantageous over other implementations or designs. Rather, the use of words such as "exemplary" or "such as" is intended to present related concepts in a concrete fashion.

The technical field and related terms of the embodiments of the present application are briefly described below.

The virtual objects include virtual humans, virtual animals, virtual cartoon figures, and the like. The virtual person is a personified image constructed by CG technology and operated in a code form, and has various interaction modes such as language communication, expression, action display and the like. The technology of virtual persons has been rapidly developed in the field of artificial intelligence and has been applied in many technical fields such as video, media, games, finance, travel, education, medical treatment, etc., and not only can a virtual host, a virtual anchor, a virtual even image, a virtual customer service, a virtual lawyer, a virtual financial advisor, a virtual teacher, a virtual doctor, a virtual instructor, a virtual assistant, etc. be customized, but also a video can be generated through text or audio one-key. In the virtual people, the service type virtual people mainly have the functions of replacing real people to serve and provide daily accompaniment, are the virtualization of service type roles in reality, and have the industrial value of mainly reducing the cost of the existing service type industry and enhancing the cost reduction of the stock market.

Artificial intelligence (Artificial Intelligence, AI) is the theory, method, technique and application system that uses a digital computer or a machine controlled by a digital computer to simulate, extend and extend human intelligence, sense the environment, acquire knowledge and use the knowledge to obtain optimal results. In other words, artificial intelligence is an integrated technology of computer science that attempts to understand the essence of intelligence and to produce a new intelligent machine that can react in a similar way to human intelligence. The design principle and the implementation method of various intelligent machines are researched by artificial intelligence, so that the machines have the functions of perception, reasoning and decision. The artificial intelligence technology is a comprehensive subject, and relates to the technology with wide fields, namely the technology with a hardware level and the technology with a software level. Artificial intelligence infrastructure technologies generally include technologies such as sensors, dedicated artificial intelligence chips, cloud computing, distributed storage, big data processing technologies, operation/interaction systems, mechatronics, and the like. The artificial intelligence software technology mainly comprises a computer vision technology, a voice processing technology, a natural language processing technology, machine learning/deep learning, automatic driving, intelligent traffic and other directions.

Machine Learning (ML) is a multi-domain interdisciplinary, involving multiple disciplines such as probability theory, statistics, approximation theory, convex analysis, algorithm complexity theory, etc. The computer program may learn experience E given a certain class of tasks T and performance metrics P, and increase with experience E if its performance in task T happens to be measured by P. Machine learning is specialized in studying how a computer simulates or implements learning behavior of a human to acquire new knowledge or skills, reorganizing existing knowledge structures to continually improve its own performance. Machine learning is the core of artificial intelligence, a fundamental approach to letting computers have intelligence, which is applied throughout various areas of artificial intelligence.

Deep learning is a special machine learning by which the world is represented using a hierarchy of nested concepts, each defined as being associated with a simple concept, and achieving great functionality and flexibility, while a more abstract representation is computed in a less abstract way. Machine learning and deep learning typically include techniques such as artificial neural networks, belief networks, reinforcement learning, transfer learning, induction learning, teaching learning, and the like.

The virtual object interaction application is used for providing virtual object interaction functions. The virtual human interactive application may simulate human communication and behavior and interact with the user. Such software (referred to as virtual human interactive applications) is typically driven by artificial intelligence and natural language processing techniques and is capable of interacting with a user by means of text, speech, images, forms, etc.

The scheme provided by the embodiment of the application relates to technologies such as virtual man, interactive design, artificial intelligence, 3D modeling, cloud computing and the like, and is specifically described by the following embodiment. The following description of the embodiments is not intended to limit the preferred embodiments.

(flow editor)

Referring to fig. 1, fig. 1 is a schematic structural diagram of a flow editor according to an embodiment of the present application.

The embodiment of the application provides a process editor for configuring an explanation process of a target virtual object, which comprises the following steps:

In an embodiment of the present application, the virtual object includes one or more of a virtual person, a virtual animal, and a virtual cartoon character. As one example, the virtual object is a virtual person "JING" (chinese name: mirror). As one example, the name of the virtual object interactive application is "company a_jing".

In the embodiment of the application, the content configuration module, the script configuration module and the catalog configuration module can be provided with independent background configuration interfaces; or the content configuration module, the script configuration module and the catalog configuration module can also adopt an integrated background configuration interface, so that the configurator can realize the functions of content configuration, script configuration, catalog configuration and the like through the same background configuration interface.

The configurator is typically a customer's staff, whose work content includes configuration explanation flows. The client refers to a client of a virtual object interactive application, typically a B-end client of an enterprise, a organization, a bank, a school, a hospital, etc., and also a small number of C-end clients. A user in this context generally refers to a user of the above-mentioned client, not a user of the present flow editor (i.e. a configurator).

The explanation content in the embodiment of the application can comprise one or more node contents, wherein the node contents are in the form of composite video of virtual objects. The synthetic video may be obtained, for example, by using a text to drive a mouth shape and an action of the virtual object, so as to render each frame of image corresponding to the synthetic video. Or, the synthetic video may be obtained by using a text to drive a mouth shape of the virtual object, and rendering each frame of image corresponding to the synthetic video in combination with one or more actions configured by the configurator for the virtual object. Alternatively, the synthetic video may be obtained by using a mouth shape of a text-driven virtual object, and rendering each frame of image corresponding to the synthetic video in combination with one or more actions obtained by capturing actions of the action capturing person.

For example, the virtual person "JING" corresponds to 3 explanation contents including "fast learning virtual person", "how to create a virtual person", and "application scene of virtual person", and the explanation sequence is "fast learning virtual person" → "how to create a virtual person" → "application scene of virtual person", and the display directory includes "1", "fast learning virtual person", "2", "how to create a virtual person", "3", application scene of virtual person ". The explanation of how to create a virtual person includes 10 node contents of "create image", "create native language", "create tone", "create gesture", "create clothing", "create scene", "create place", "create map", "create prop", "create shot".

The virtual human "Xiaoming" corresponds to 3 explanatory matters, including "how to write a good composition? How do "how do it promote mathematical answer efficiency? How quickly do "and" back the word? "how to write a work composition? How? How quickly, "→" is the word back? "how do the display catalog include" 1, how do a work of well written? "how does" 2 improve the efficiency of mathematical questions? "," 3, how fast back word? ".

The user can learn various service information of an enterprise in the explanation content of the enterprise service virtual man, learn knowledge and answering skills of textbooks in the explanation content of the virtual teacher, learn medical knowledge such as disease symptoms in the explanation content of the virtual doctor, or learn historical background, cultural significance, artistic value and the like of the cultural relics of the museum in the explanation content of the virtual lecturer.

Therefore, the flow editor for the virtual object interactive application is provided, and is used for configuring the explanation content, the explanation sequence and the display catalogue of the target virtual object, so that the client requirements of the virtual object interactive application can be better met. The application of the existing flow editor in the virtual object interactive application is limited, a developer is required to carry out secondary development according to the requirements of specific clients, the technical scheme provides the flow editor specially aiming at the virtual object interactive application, a configurator only needs to carry out configuration through a content configuration module, a script configuration module and a catalog configuration module, secondary development is not required, and editing efficiency is greatly improved. The development of the virtual man technology enables the virtual object to display rich contents in various modes and be applied to the fields of film and television, media, games, finance, travel, education, medical treatment and the like. The method and the device have the advantages that the interaction process of the virtual object is required to have clear flow and catalogues, users of clients can know interactive steps and contents conveniently, and the catalogue configuration module is provided.

In some embodiments, the content configuration module includes a new lecture content button and an lecture content configuration interface; the explanation content configuration interface comprises a content name text input box, a virtual object drop-down menu, an explanation node adding button, an explanation node adding interface and an explanation content display area; the added explanation node interface comprises a node name text input box and a node content drop-down menu;

Thus, a visual background configuration interface of the explanation content is provided, so that a configurator can create an explanation flow by inputting the name of the explanation content, selecting a target virtual object and node content. The specific operation flow comprises the following steps: first, a configurator clicks a "newly added explanation content button" to open a "explanation content configuration interface", in which the configurator can input the name of the explanation content through a content name text input box, select a target virtual object to be configured through a virtual object drop-down menu, and add node content. When node contents are added, a configurator can open an adding explanation node interface by clicking an adding explanation node button, input a node name in the adding explanation node interface through a node name text input box, display all node contents corresponding to a target virtual object through a node content drop-down menu, and take the node contents selected by the configurator as node contents corresponding to the node identification. In the explanation content display area, the configurator can check the node content corresponding to the already configured explanation content.

In some embodiments, the content configuration module further includes an explanation content preview interface; the explanation content preview interface comprises an information display area and a progress display area; the progress display area comprises a node editing button and a name editing text input box corresponding to each node identifier;

Thus, a visual explanation content preview interface is provided, which comprises an information display area and a progress display area. The information display area is used for displaying the names of the explanation contents and the names of the target virtual objects, the progress display area is used for displaying the node contents corresponding to the explanation contents, and a node editing button and a name editing text input box are provided for configuration personnel to edit each node. Specifically, each node editing button is used for displaying a name editing text input box of a corresponding node identifier, and the name editing text input box is used for receiving a display name of the node identifier, which is input by a configurator, to the outside.

In some embodiments, the script configuration module includes a new guest guide button, a play interrupt old guest guide button, a play end old guest guide button, an explanation sequence button, an end content button, a first add explanation content interface, and a second add explanation content interface; the first added explanation content interface comprises an explanation content single selection frame; the second added explanation content interface comprises a first explanation content check box;

Therefore, the script configuration module is used for enabling configuration personnel to set the play sequence of the explanation contents and maintaining the corresponding explanation contents of new guests, old guests and the like of the target virtual object. The new guest guiding button, the playing interruption old guest guiding button, the playing ending old guest guiding button and the ending content button are used for triggering the first adding explanation content interface so as to enable the configurator to select the corresponding new guest, the playing interruption old guest, the playing ending old guest and the ending content. The explanation content radio selection box is used for selecting one explanation content as the explanation content of the playing interface corresponding to the clicked button, so that the selected explanation content can be played by the playing interface corresponding to the new guest, the playing interrupt old guest, the playing end old guest and the end content. The lecture sequence button is used to trigger a second add lecture content interface. The second adding explanation content interface comprises a first explanation content check box, and is used for enabling a configurator to select one or more explanation contents to be added into the explanation contents corresponding to the target virtual object, and the adding sequence is used as the explanation sequence of the target virtual object. Thus, the configurator can set different explanation contents for different virtual objects according to the needs and set the play sequence of the virtual objects according to the needs, thereby better meeting the needs of users. Therefore, the technical scheme can improve the user experience and usability of the virtual object interactive application, so that configuration personnel can set explanation contents and play sequences more conveniently, and the functions and performances of the virtual object interactive application are improved, thereby better meeting the requirements of users.

In some embodiments, the catalog configuration module includes a catalog configuration button, a catalog configuration interface, and a catalog presentation area; the catalog configuration interface comprises a second explanation content check box; the catalog display area comprises a dragging button corresponding to each explanation content;

Thereby, configuration and presentation functions for the display catalog are provided. The configurator enters the catalog configuration interface through the catalog configuration buttons, one or more explanation contents can be added into the display catalog of the target virtual object by selecting the second explanation content check box, then each explanation content corresponds to one dragging button in the catalog display area, and the display sequence of the explanation contents in the display catalog can be adjusted through the dragging buttons. The method has the advantages that configuration personnel can conveniently configure and manage the display catalogue of the target virtual object, and can add or delete the explanation content in the display catalogue according to the requirement, and adjust the display sequence of the explanation content in the display catalogue, so that the requirement of a user can be met more flexibly. In addition, the technical scheme can also improve the working efficiency of configuration personnel, avoid the complicated process of manually writing the catalogue and simplify the configuration flow.

In a specific application scenario, the embodiment of the present application further provides a process editor, configured to configure an explanation process of a target virtual object, where the process editor includes:

The content configuration module comprises a newly added explanation content button, an explanation content configuration interface and an explanation content preview interface; the explanation content configuration interface comprises a content name text input box, a virtual object drop-down menu, an explanation node adding button, an explanation node adding interface and an explanation content display area; the added explanation node interface comprises a node name text input box and a node content drop-down menu; the explanation content preview interface comprises an information display area and a progress display area; the progress display area comprises a node editing button and a name editing text input box corresponding to each node identifier;

the explanation content display area is used for displaying node content corresponding to the explanation content;

The script configuration module comprises a new guest guide button, a play interrupt old guest guide button, a play end old guest guide button, an explanation sequence button, an end content button, a first added explanation content interface and a second added explanation content interface; the first added explanation content interface comprises an explanation content single selection frame; the second added explanation content interface comprises a first explanation content check box;

The catalog configuration module comprises a catalog configuration button, a catalog configuration interface and a catalog display area; the catalog configuration interface comprises a second explanation content check box; the catalog display area comprises a dragging button corresponding to each explanation content;

(flow editing method)

Referring to fig. 2, fig. 2 is a flow chart of a flow editing method according to an embodiment of the present application.

The embodiment of the application also provides a flow editing method, the specific embodiment of which is consistent with the embodiment recorded in the embodiment of the flow editor and the achieved technical effect, and part of the contents are not repeated.

The process editing method is used for configuring the explanation process of the target virtual object by using any one of the process editors, and the process editors comprise a content configuration module, a script configuration module and a catalog configuration module, and the method comprises the following steps:

step S101: configuring the explanation content of the target virtual object by utilizing the content configuration module;

step S102: configuring the explanation sequence of the target virtual object by utilizing the script configuration module;

step S103: and configuring a display catalog of the target virtual object by utilizing the catalog configuration module.

The flow editing method can be operated on the electronic equipment, the electronic equipment and the first terminal equipment used by the configurator can be independent, and the electronic equipment and the first terminal equipment can be integrated. When the electronic device and the first terminal device are independent, the electronic device may be a computer, a server, or the like having computing power. The first terminal device used by the configuration personnel is not limited in the embodiment of the application, and may be, for example, an intelligent terminal device with a display screen, such as a mobile phone, a tablet computer, a notebook computer, a desktop computer, an intelligent wearable device, or the first terminal device may be a workstation or a console with a display screen. The display screen may be a touch display screen or a non-touch display screen, and is configured to display one or more configuration interfaces corresponding to the flow editor.

Thus, a flow editing method is provided for configuring the explanation flow of the target virtual object. The method includes three modules using a flow editor: the system comprises a content configuration module, a script configuration module and a catalog configuration module. In the content configuration module, the configurator may define the respective lectures of the target virtual object and assign names and other related information thereto. In the script configuration module, a configurator can set the play order of the explanation contents. In the directory configuration module, a configurator may set a display directory for the target virtual object. The method has the advantages that a configurator can conveniently manage the explanation flow of the target virtual object, and can easily configure the explanation content, the explanation sequence and the display catalogue of the target virtual object by using three modules of the flow editor, and can be modified and edited at any time. In addition, the method can also improve the configuration efficiency and reduce the configuration cost, thereby promoting the development of virtual object interactive application.

Referring to fig. 3, fig. 3 is a schematic flow chart of a configuration explanation according to an embodiment of the present application.

The configuring the explanation content of the target virtual object by using the content configuration module (i.e. step S101) includes:

step S201: responding to clicking operation of the newly added explanation content button, and displaying an explanation content configuration interface;

step S202: receiving the names of the explanation contents input by the configurator by utilizing the content name text input box;

step S203: displaying a plurality of virtual objects by utilizing the virtual object drop-down menu, receiving the selection operation of a configurator for one of the virtual objects, and taking the selected virtual object as the target virtual object;

step S204: responding to clicking operation of the adding explanation node button, and displaying the adding explanation node interface;

step S205: receiving the node name of the corresponding node identifier input by the configurator by utilizing the node name text input box;

step S206: displaying the node content corresponding to the target virtual object by using the node content drop-down menu, receiving the selection operation of configuration personnel on one of the node contents, and taking the selected node content as the node content corresponding to the node identifier;

step S207: and displaying the node content corresponding to the explanation content by utilizing the explanation content display area.

Thus, the configurator clicks the newly added explanation content button, and the explanation content configuration interface is displayed; the configurator inputs the name of the explanation content in the content name text input box; the virtual object drop-down menu displays a plurality of virtual objects, and a configurator selects one of the virtual objects as a target virtual object; the configurator clicks an add explanation node button, and an add explanation node interface is displayed; the configurator inputs the node name corresponding to the node identification in the node name text input box; the node content drop-down menu displays node contents corresponding to the target virtual object, and a configurator selects one of the node contents as the node content corresponding to the node identifier; and the explanation content display area displays node contents corresponding to the explanation content. The method has the advantage of allowing a configurator to configure the explanation content for the target virtual object through various controls provided in the visual background configuration interface, so that the configuration of the explanation content is more flexible and accurate. In addition, by providing the explanation node adding button and the explanation node adding interface, the method can quickly and conveniently add new nodes, and improves the working efficiency.

Referring to fig. 4, fig. 4 is a schematic flow chart of configuring display names according to an embodiment of the present application.

the configuring the explanation content of the target virtual object by using the content configuration module (i.e. step S101) further includes:

step S208: displaying the names of the explanation contents and the names of the target virtual objects by utilizing the information display area;

step S209: displaying node names of the node identifiers corresponding to the explanation contents by utilizing the progress display area;

step S210: responding to clicking operation of each node editing button, and displaying a name editing text input box of the corresponding node identifier;

step S211: and receiving the display name corresponding to the node identifier, which is input by the configurator, by utilizing each name editing text input box.

Thus, the explanation content preview interface of the content configuration module includes an information presentation area and a progress presentation area. The progress presentation area includes a node edit button and a name edit text entry box corresponding to each node (identity) for further adjustment of the node by the configurator.

For example, the configurator needs to configure a new explanation content for a virtual object named "Virtual Assistant", and the content configuration flow is as follows:

the configurator enters the content configuration module, clicks a newly added explanation content button, and the explanation content configuration interface pops up;

the configurator inputs the name of the explanation content, for example, "how to use Virtual Assistant", in the content name text input box;

the configurator selects 'Virtual Assistant' as a target virtual object in the virtual object drop-down menu;

the configurator clicks the add explanation node button, and the add explanation node interface pops up;

the configurator inputs the node name of the node identifier in a node name text input box, for example, "open Virtual Assistant";

the configurator selects the process of opening Virtual Assistant in the node content drop-down menu as the node content corresponding to the node identification;

the configurator clicks a confirm button on the interface of the added explanation node, and the node is added into the explanation content;

the configurator continues to add more nodes, such as "basic functionality of Virtual Assistant", "how to use voice recognition functionality", etc.;

After the configurator finishes adding all nodes, returning to the explanation content configuration interface, and seeing that all added node contents are displayed in the explanation content display area;

the configurator can click on the explanation content preview interface button to enter the explanation content preview interface;

in the information display area, the configurator can see the names of the explanation contents and the names of the target virtual objects;

in the progress display area, a configurator can see the node names of all the node identifiers and click each node editing button to display a name editing text input box corresponding to the node identifier;

the configurator may enter a custom display name in the name edit text entry box, e.g., change "open Virtual Assistant" to "launch Virtual Assistant";

after the configurator completes editing all node names, the configurator can click a save button to save the explanation content configuration.

Through the configuration flow, a configurator can quickly create a new explanation content and apply the new explanation content to the appointed virtual object, so that the efficient configuration and management of the content are realized.

Referring to fig. 5, fig. 5 is a schematic flow chart of a configuration script according to an embodiment of the present application.

the configuring the explanation sequence of the target virtual object by using the script configuration module (i.e. step S102) includes:

step S301: displaying the first adding explanation content interface in response to a click operation for any one of the new guest guide button, the play interrupt old guest guide button, the play end old guest guide button and the end content button;

step S302: responding to the selection operation of the explanation content radio frame, and taking the selected one explanation content as the explanation content of the playing interface corresponding to the clicked button;

step S303: responsive to a click operation for the lecture sequence button, displaying the second add lecture content interface;

step S304: in response to a first selection operation for the first explanation content check box, adding the selected one or more explanation contents to the explanation contents corresponding to the target virtual object, and taking the addition order as the explanation order of the target virtual object.

Thus, the script configuration module comprises buttons for guiding new guests, guiding playing interruption old guests, guiding playing ending old guests, explaining sequence, ending content and the like, and a first added explanation content interface and a second added explanation content interface. When the configurator clicks any button except the explanation sequence button, a first explanation adding content interface is opened, a selectable explanation content single selection frame is displayed, and the configurator selects one explanation content which is used as the explanation content of the playing interface corresponding to the clicked button. When the configurator clicks the explanation sequence button, a second explanation adding content interface is opened, a first explanation content check box which can be selected is displayed, the configurator selects one or more explanation contents and adds the explanation contents to the explanation contents corresponding to the target virtual object, and the addition sequence is taken as the explanation sequence. The method has the advantages that the script configuration module is used for configuring the explanation sequence, the target virtual object can be conveniently compiled, and the explanation sequence can be flexibly adjusted, so that the requirements of different users can be better met. Meanwhile, different playing interfaces are provided for different users, so that user experience can be improved, and interactivity and operability are enhanced. Specifically, different play pages may be provided to the user, for example, according to the play type (i.e., the play progress type) of the user of the virtual object interactive application. When the playing type of the user is not played, an initial playing page is displayed, so that the user plays a plurality of explanation contents according to the explanation sequence. When the playing type of the user is the playing interruption, an interruption playing page which is interrupted for playing the last time is displayed, so that the user continues to play the explanation contents corresponding to the interruption playing page and the explanation contents which follow the interruption playing page in the explanation sequence. And when the playing type of the user is that the playing is finished, displaying the explanation content corresponding to the finished playing page. Therefore, the user can directly reach the proper playing page according to the playing progress of the user, and better viewing experience is obtained. By recording the playing state and the position of the user, playing a plurality of explanation contents according to the explanation sequence and supporting the functions of continuous watching after interrupting playing, the watching experience of the user can be improved, the video watching duration can be prolonged, the video playing efficiency can be improved, and the use value and the competitiveness of the virtual object interactive application can be improved.

For example, a configurator needs to configure the playing order of the explanation content for a virtual object named "Smart Home", where the virtual object is used in the Smart Home control system, and the script configuration flow is as follows:

the configurator opens a background configuration page of a virtual object 'Smart Home', sees a new guest guide button, a play interrupt old guest guide button, a play end old guest guide button, an explanation sequence button and an end content button in a script configuration module, clicks the new guest guide button to select new guest guide explanation content;

the first added explanation content interface pops up, the configurator can see different explanation contents which can be selected, selects an appropriate explanation content through the explanation content single selection box, and then clicks a 'confirm' button;

the configurator clicks the explanation sequence button, the second added explanation content interface pops up, the configurator can see different explanation contents available for selection, select the explanation content to be added to the virtual object 'Smart Home' through the first explanation content check box, and click the 'confirm' button by taking the addition sequence as the explanation sequence of the target virtual object; the adding sequence refers to the sequence of the explanation contents added to the target virtual object, and the explanation sequence is the display sequence of the first explanation content check box aiming at a plurality of explanation contents added in the same batch.

Thus, the configurator configures the explanation order of the explanation contents for the virtual object "Smart Home". The user can access and understand different intelligent home control system functions according to the configured explanation sequence.

Referring to fig. 6, fig. 6 is a schematic flow chart of a configuration display directory according to an embodiment of the present application.

the configuring the display directory of the target virtual object by using the directory configuration module (i.e. step S103) includes:

step S401: responding to clicking operation of the catalog configuration button, and displaying the catalog configuration interface;

step S402: in response to a second selection operation for the second lecture content check box, adding the selected one or more lecture contents to a display directory of the target virtual object;

step S403: and adjusting the display sequence of the corresponding explanation content in the display catalogue in a dragging mode by utilizing each dragging button.

Thus, the directory configuration module allows a configurator to configure the display directory of the target virtual object. The catalog configuration module comprises a catalog configuration button, a catalog configuration interface and a catalog display area. When the configurator clicks on the catalog configuration button, the catalog configuration interface will be displayed. In the catalog configuration interface, the configurator selects one or more explanation contents through the second explanation content check box and adds the explanation contents to the display catalog of the target virtual object. The catalog display area displays the display catalog of the target virtual object, wherein each explanation content corresponds to one dragging button. By dragging the buttons, the configurator can rearrange the display order of the explanatory content in the display directory. The method has the advantages that a flexible way is provided for managing and rearranging the display catalogs, a configurator can conveniently configure the display catalogs of the target virtual objects, so that the configurator can add, delete or reorder the explanation contents according to the needs, the explanation effect and accessibility of the explanation contents are improved, and the user experience and learning effect are improved.

For example, the configurator needs to configure a display directory of the explanation content for a virtual object named "JING", where the virtual object is used to show the interactive function of the virtual person, and the directory configuration flow is as follows:

Opening a background configuration interface of a virtual object 'JING';

clicking a catalog configuration button to enter a catalog configuration interface;

in the catalog configuration interface, the explanation content which needs to be added into the display catalog is checked through a second explanation content check box, for example, the explanation content is 'fast understanding virtual person', 'how to create a virtual person' and 'application scene of the virtual person';

clicking a 'ok' button to add the selected 3 lecture contents to the display catalog;

in the catalog display area, all the explanation contents in the display catalog and the dragging buttons corresponding to each explanation content can be seen, and the display sequence of the explanation contents in the display catalog can be adjusted through the dragging buttons;

after confirming that the directory configuration is completed, the save button is clicked, and the configured display directory is associated with the virtual object "JING".

Through the steps, the configurator successfully configures a display catalog for the virtual object 'JING', and can conveniently manage and configure the explanation content of the virtual object.

Referring to fig. 7, fig. 7 is a schematic flow chart for adjusting the explanation sequence according to an embodiment of the present application.

In some embodiments, the method further comprises:

Step S104: acquiring historical data of the target virtual object in a preset time period;

step S105: aiming at each user identifier in the historical data, acquiring the playing sequence of the explanation content corresponding to each user identifier;

step S106: respectively acquiring the similarity between the explanation sequence of the target virtual object and the play sequence corresponding to each user identifier;

step S107: calculating the proportion of users with similarity smaller than the preset similarity to the total number of users corresponding to the historical data;

step S108: and when the proportion is larger than a preset proportion, sending prompt information to first terminal equipment of the configurator so as to prompt the configurator to adjust the explanation sequence of the target virtual object.

In some embodiments, the method further comprises step S109: and when the proportion is not greater than the preset proportion, no operation is performed.

The preset time period is not limited in the embodiment of the present application, and may be, for example, the last week, the last month, the last three months, the last year, the specified time period, and the like. As an example, the start time of the preset time period is 2023, 1 month, 1 day, 00:00, and the end time is 2023, 2 months, 1 day, 00:00.

The embodiment of the application does not limit the preset similarity, and can be 30%, 50%, 60%, 80% and the like.

The preset ratio is not limited in the embodiment of the present application, and may be, for example, 5%, 10%, 30%, 50%, etc.

For example, a company produces a smart Speaker, a configurator of the company creates a virtual person "AI Speaker" using a virtual object interactive application, and the company wants to improve user experience and learning effect by optimizing the explanation sequence of "AI Speaker", which is as follows:

the company first collects user data of 'AI Speaker' in the past month, including the explanation content and the playing sequence played by each user when using 'AI Speaker';

according to the user identification in the historical data, the company acquires the playing sequence of the explanation content corresponding to each user identification;

next, the company calculates the similarity between the explanation sequence of the AI Speaker and the playing sequence corresponding to each user identifier, and screens out users with the similarity smaller than the preset similarity;

when the proportion of the screened users to the total number of users corresponding to the historical data is larger than a preset proportion, the company sends prompt information to the first terminal equipment of the configurator so as to prompt the configurator to adjust the explanation sequence of the AI Speaker.

The prompt information is, for example: "historical data for month 2 of 2023 shows that 50% of users are dissatisfied with the AI Speaker's instruction sequence, please optimize the instruction sequence. "

In this way, the company can optimize the explanation sequence of the 'AI Speaker' based on the historical data to make the explanation sequence more close to the requirements and preferences of the user, thereby improving the user experience and learning effect.

In the embodiment of the application, the form and implementation mode of sending the prompt information depend on the type and communication mode of the first terminal equipment of the configurator. For example, it may be to send an email or a short message notification, to send an application notification, to send an instant message, etc.

If the notification is sent through an email or a short message, a mail or a short message template is required to be set, and when preset prompting conditions are met, prompting information is automatically generated based on the template, and the prompting information is sent to a mailbox or a mobile phone of a configurator. This approach requires the contact information of the configurator to be acquired in advance and ensures the correctness of the mailbox or the phone number thereof.

If a configurator uses a particular application to manage the order of interpretation of virtual objects, a notification may be sent to the configurator through the application. This approach requires adding a corresponding notification function to the application and ensuring that the configurator has installed and logged in the application.

If the configurator is using an instant messaging tool (e.g., weChat, QQ, etc.) while using the virtual object, a prompt may be sent to the configurator via instant messaging. This approach requires the acquisition of the instant messaging account number of the configurator and the pre-addition of the corresponding contact information.

In either way, a prompt condition (as a trigger condition) and a corresponding prompt message template are required to be preset, so as to ensure prompt messages to be sent to configuration personnel timely and accurately.

Thus, an explanation sequence optimizing method based on historical data is provided. Firstly, acquiring historical data of a target virtual object in a preset time period, and then acquiring the playing sequence of the explanation content corresponding to each user identifier aiming at each user identifier in the historical data. And then, calculating the similarity between the explanation sequence of the target virtual object and the play sequence corresponding to each user identifier, and calculating the proportion of the users with the similarity smaller than the preset similarity to the total number of users corresponding to the historical data. And when the ratio is larger than the preset ratio, sending prompt information to the first terminal equipment of the configurator so as to prompt the configurator to adjust the explanation sequence of the target virtual object. The method has the advantages that the explanation sequence of the user on the preference and the actual demand of different explanation contents can be known by analyzing the real play sequence of the user in the historical data, and the explanation sequence is optimized according to the preference and the actual demand, so that the explanation effect and the user satisfaction of the target virtual object are improved. By prompting configuration personnel to adjust the explanation sequence, the explanation sequence of the target virtual object can be closer to the requirements and preferences of the user, so that the user experience and learning effect are improved.

Referring to fig. 8, fig. 8 is a schematic flow chart of obtaining similarity according to an embodiment of the present application.

In some embodiments, the step of obtaining the similarity between the explanation sequence of the target virtual object and the play sequence corresponding to each user identifier (i.e. step S106) includes:

for each user identifier, the following processing is performed:

step S501: acquiring the playing number N of the explanation content corresponding to the user identification, wherein N is a positive integer;

step S502: and obtaining the similarity between the explanation sequence of the first N explanation contents and the playing sequence corresponding to the user identifier, and taking the similarity as the similarity between the explanation sequence of the target virtual object and the playing sequence corresponding to the user identifier.

Therefore, for each user identifier, the playing number N of the explanation contents corresponding to the user identifier is firstly obtained, then for the playing sequence of the N explanation contents corresponding to the user identifier, the similarity calculation is carried out on the N explanation contents and the explanation sequence of the first N explanation contents of the target virtual object, and a similarity value is obtained. It should be noted that the N lectures corresponding to the user identification may be the same as or different from the first N lectures of the target virtual object (in the lecture order). Because the user may not play in order of explanation, but may have skip play, etc. The similarity can reflect the preference degree and the demand degree of the user for the explanation sequence of the target virtual object. For each user, a similarity can be calculated. After the similarity of the explanation sequence of each user to the target virtual object is obtained, whether a certain proportion of users in the historical data are dissatisfied with the explanation sequence of the target virtual object or not can be judged according to the similarity, so that configuration personnel are prompted to carry out corresponding adjustment. Therefore, the requirements of users can be better met, the user experience is improved, and the competitiveness of the clients is improved.

For example, a school creates a virtual person "quincuncial teacher" using a virtual object interactive application for providing extracurricular coaching for students, the "quincuncial teacher" corresponding to a plurality of lectures. The use condition of each user (such as student, parent or real teacher) for the virtual person 'plum blossom teacher' in 2 months of 2023 is recorded, including the played explanation content and the play sequence of the explanation content. It is now necessary to calculate for each user identity the similarity of the play order of that user to the explanation order of the virtual person "quincuncial teacher".

Assume that a student whose User is identified as "User1" and that he plays 3 explanation contents, namely "Content1", "Content2" and "Content5", respectively, in the corresponding play order of "Content1" → "Co ntent2" → "Content5" when using the virtual person "quincuncial teacher". The similarity between the play sequence of the User 'User 1' and the explanation sequence of the virtual person 'plum blossom teacher' needs to be calculated.

Firstly, according to the playing quantity (3) of the explanation contents corresponding to the user identification, the similarity between the explanation sequence of the first 3 explanation contents and the playing sequence corresponding to the user identification is obtained. The similarity between the play orders of the 3 contents of "Content1", "Content2", and "Content5" (i.e., "Content1" → "Content2" → "Content 5") and the play orders of the first 3 contents of the explanation ("Content 1" → "Content2" → "Content 3") needs to be calculated. This similarity can be calculated by comparing the order of the lectures involved in the two sequences with a similarity model. The similarity model may be, for example, a similarity model based on deep learning, and is obtained by training a preset deep learning model by using a training set.

Assuming that the calculated similarity is 83%, the similarity reflects the preference degree and the degree to which the demands of the User 'User 1' for the explanation sequence of the virtual person 'plum teacher' are satisfied. If the preset similarity is 50%, the similarity of the User "User1" is greater than the preset similarity, and the User "User1" can be considered to be (relatively) satisfied with the explanation sequence of the virtual person "quincuncial teacher". By calculating the similarity of all users, whether a certain proportion of users are dissatisfied with the explanation sequence of the virtual human 'plum blossom teacher' can be judged, and if the dissatisfied users occupy a relatively high proportion, the configuration personnel is prompted to carry out corresponding adjustment.

In a specific application scenario, the embodiment of the application also provides a process editing method, which is used for configuring the explanation process of the target virtual object by using any one of the process editors, wherein the process editors comprise a content configuration module, a script configuration module and a catalog configuration module;

the content configuration module comprises an explanation content adding button, an explanation content configuration interface and an explanation content preview interface; the explanation content configuration interface comprises a content name text input box, a virtual object drop-down menu, an explanation node adding button, an explanation node adding interface and an explanation content display area; the added explanation node interface comprises a node name text input box and a node content drop-down menu; the explanation content preview interface comprises an information display area and a progress display area; the progress display area comprises a node editing button and a name editing text input box corresponding to each node identifier;

The script configuration module comprises a new guest guide button, a play interrupt old guest guide button, a play end old guest guide button, an explanation sequence button, an end content button, a first added explanation content interface and a second added explanation content interface; the first added explanation content interface comprises an explanation content single selection frame; the second added explanation content interface comprises a first explanation content check box; the new guest guiding button, the play interruption old guest guiding button, the play ending old guest guiding button and the ending content button are used for displaying a first adding explanation content interface after being clicked; the explanation content radio selection box is used for selecting explanation content corresponding to the clicked button; the explanation sequence button is used for displaying a second added explanation content interface after being clicked; the first explanation content check box is used for adding explanation contents to the corresponding explanation contents of the virtual object and determining the explanation sequence;

the catalog configuration module comprises a catalog configuration button, a catalog configuration interface and a catalog display area; the catalogue configuration interface comprises a second explanation content check box; the catalog display area comprises a dragging button corresponding to each explanation content; the catalog configuration button is used for displaying a catalog configuration interface; a second explanation content check box for selecting explanation contents to be added to the catalog display area;

The method comprises the following steps:

displaying node contents corresponding to the explanation contents by utilizing the explanation content display area;

receiving display names corresponding to the node identifications input by configuration personnel by utilizing each name editing text input box;

in response to a first selection operation for the first explanation content check box, adding the selected one or more explanation contents to the explanation contents corresponding to the target virtual object, and taking the addition order as the explanation order of the target virtual object;

in response to a second selection operation for the second explanation content check box, adding the selected one or more explanation contents to a display catalog of the target virtual object, and taking an addition order as a display order of the display catalog;

utilizing each dragging button to adjust the display sequence of the corresponding explanation content in the display catalog in a dragging mode;

acquiring historical data of the target virtual object in a preset time period;

for each user identifier, the following processing is performed: acquiring the playing number N of the explanation content corresponding to the user identification, wherein N is a positive integer; acquiring the similarity between the explanation sequence of the first N explanation contents and the play sequence corresponding to the user identifier, and taking the similarity as the similarity between the explanation sequence of the target virtual object and the play sequence corresponding to the user identifier;

In the embodiment of the application, the interface displayed after being clicked can be displayed by a floating layer, a popup window or the like.

In the embodiment of the application, the added explanation node interface can comprise a node identification display area, a node content configuration area, a node play configuration area and a node display configuration area.

The node identifier display area is used for displaying the node identifier.

The node content configuration area comprises a node name text input box, a node content drop-down menu and an upper node drop-down menu. The upper node drop down menu is used to associate the node to a target node such that the node becomes a lower node of the target node.

The node play configuration area includes a "whether or not can be recorded as a jump-out point" single box, a "play next video setting" single box, a "show branching card" single box, and a "connect standby" single box. The "if it can be noted as a jump-out point" box is used to set whether the node corresponding to the node identification can be noted as a jump-out point. The "play next video setting" single box is used to set the node "unconditional automatic play", "enter standby, wait for user instruction" or "conditional automatic play". The "whether to display a branching card" box is used to set whether the node displays a branching card. The "whether standby" radio box is used to set the node "pick up video" or "play back the last frame of the video in a loop".

The node presentation configuration area includes a "if it is a directory node" radio box for setting whether the node is a directory node.

The right side of each node content in the lecture content presentation area may display a video configuration icon, an add child node button, an edit button, a delete button, a copy ID button, a generate pointing link button, and a node drag button. The video configuration icon is used to indicate whether the node content has been associated with a composite video. The add child node button is used for opening an add explanation node interface of a child node corresponding to the node, wherein the upper node has selected the node. The edit button is used for opening the corresponding added explanation node interface of the node. The delete button is used to delete the node content from the lecture content. The copy ID button is used to copy the node identification of the node. The generate pointing links button is used to generate pointing links. The node dragging button is used for adjusting the sequence of the node in the current explanation content in a dragging mode. In the embodiment of the application, the dragging mode is a dragging mode.

The right side of the new guest guiding button, the playing interruption old guest guiding button, the playing ending old guest guiding button, the explanation sequence button and the ending content button can display a corresponding editing button and a corresponding deleting button for editing or deleting the corresponding explanation content.

The catalog display area also comprises an editing button and a deleting button corresponding to each explanation content, and the editing button and the deleting button are used for editing or deleting the corresponding explanation content.

The embodiment of the application also provides a virtual reality-based explanation system which is used for providing cultural relic explanation service for the museum by utilizing a virtual interpreter, and comprises virtual reality equipment, a server, a first terminal equipment used by configuration personnel and a second terminal equipment used by a user. The server is provided with a virtual object interaction application, and the virtual object interaction application is used for creating a virtual interpreter and configuring the interpretation flow of the virtual interpreter. The virtual object interactive application provides a flow editor and a corresponding background configuration interface, and configuration personnel can configure the explanation flow of the virtual interpreter by using the flow editor through the visual background configuration interface and store the obtained configuration information as an explanation flow configuration file.

When a user wears the virtual reality device, a virtual interpreter is presented in a virtual scene by using the virtual reality device, and the execution of the interpretation flow is controlled according to the interpretation flow configuration file, so that the interpretation of each cultural relic in the museum is realized. Specifically, the virtual lecturer is presented in the field of view of the user, and when the user is detected to be a new guest, the user is presented with a corresponding playing interface for guiding the new guest, and a plurality of preset lecture contents are played from scratch according to the lecture sequence, wherein each lecture content corresponds to a piece of cultural relic or a group of cultural relic. The user can call out the display catalog through voice control, and can further jump the display catalog to the explanation content of the cultural relics of interest through voice control. For example, the virtual interpreter can show the explanation content corresponding to the Tang dynasty porcelain of interest to the user, and introduce the historical background, the manufacturing process, the cultural significance and other relevant information of the porcelain through a plurality of node contents in the explanation content.

In the whole process, the virtual lecturer can dynamically adjust the played explanation content according to the feedback and the requirements of the user so as to provide more personalized and rich cultural relic explanation service. The explanation system based on the virtual reality can provide deeper, vivid and interesting cultural relic explanation service for users, and meanwhile, the visiting experience and service level of the museum can be improved.

The second terminal device used by the user is not limited in the embodiment of the application, and can be, for example, an intelligent terminal device with a display screen, such as a mobile phone, a tablet computer, a notebook computer, a desktop computer, an intelligent wearable device and the like.

(electronic device)

The embodiment of the application also provides an electronic device, the specific embodiment of which is consistent with the embodiment described in the method embodiment and the achieved technical effect, and part of the contents are not repeated.

The electronic device is used for configuring the explanation process of the target virtual object by using any process editor, the process editor comprises a content configuration module, a script configuration module and a catalog configuration module, the electronic device comprises a memory and at least one processor, the memory stores a computer program, and the at least one processor is configured to realize the following steps when executing the computer program:

the at least one processor is configured to configure the content of the target virtual object with the content configuration module when executing the computer program in the following manner:

the at least one processor, when configured to execute the computer program, further configures the content of the target virtual object with the content configuration module in the following manner:

the at least one processor is configured to configure the order of interpretation of the target virtual object with the script configuration module when executing the computer program in the following manner:

the at least one processor is configured to configure a display directory of the target virtual object with the directory configuration module when executing the computer program in the following manner:

In some embodiments, the at least one processor is configured to execute the computer program to further implement the steps of:

acquiring historical data of the target virtual object in a preset time period;

In some embodiments, the at least one processor is configured to, when executing the computer program, obtain the similarity between the interpretation order of the target virtual object and the play order corresponding to each of the user identities, respectively, in the following manner:

For each user identifier, the following processing is performed:

Referring to fig. 9, fig. 9 is a block diagram of an electronic device 10 according to an embodiment of the present application.

The electronic device 10 may for example comprise at least one memory 11, at least one processor 12 and a bus 13 connecting the different platform systems.

Memory 11 may include readable media in the form of volatile memory, such as Random Access Memory (RAM) 111 and/or cache memory 112, and may further include Read Only Memory (ROM) 113.

The memory 11 also stores a computer program executable by the processor 12 to cause the processor 12 to implement the steps of any of the methods described above.

Memory 11 may also include utility 114 having at least one program module 115, such program modules 115 include, but are not limited to: an operating system, one or more application programs, other program modules, and program data, each or some combination of which may include an implementation of a network environment.

Accordingly, the processor 12 may execute the computer programs described above, as well as may execute the utility 114.

The processor 12 may employ one or more application specific integrated circuits (ASICs, application Specific Integrated Circui t), DSPs, programmable logic devices (PLD, programmableLogic devices), complex programmable logic devices (CPLDs, complex Programmable Logic Device), field programmable gate arrays (FPGAs, fields-Programmable Gate Array), or other electronic components.

Bus 13 may be a local bus representing one or more of several types of bus structures including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, a processor, or any of a variety of bus architectures.

The electronic device 10 may also communicate with one or more external devices such as a keyboard, pointing device, bluetooth device, etc., as well as one or more devices capable of interacting with the electronic device 10 and/or with any device (e.g., router, modem, etc.) that enables the electronic device 10 to communicate with one or more other computing devices. Such communication may be via the input-output interface 14. Also, the electronic device 10 may communicate with one or more networks such as a Local Area Network (LAN), a Wide Area Network (WAN) and/or a public network, such as the Internet, through a network adapter 15. The network adapter 15 may communicate with other modules of the electronic device 10 via the bus 13. It should be appreciated that although not shown, other hardware and/or software modules may be used in connection with the electronic device 10 in actual applications, including, but not limited to: microcode, device drivers, redundant processors, external disk drive arrays, RAID systems, tape drives, data backup storage platforms, and the like.

(computer-readable storage Medium)

The embodiment of the application also provides a computer readable storage medium, and the specific embodiment of the computer readable storage medium is consistent with the embodiment recorded in the method embodiment and the achieved technical effect, and part of the contents are not repeated.

The computer readable storage medium stores a computer program which, when executed by at least one processor, performs the steps of any of the methods or performs the functions of any of the electronic devices described above.

Referring to fig. 10, fig. 10 is a schematic structural diagram of a program product according to an embodiment of the present application.

The program product is for implementing the steps of any of the methods described above or for implementing the functions of any of the electronic devices described above. The program product may take the form of a portable compact disc read-only memory (CD-ROM) and comprises program code and may be run on a terminal device, such as a personal computer. However, the program product of the present application is not limited thereto, and in the embodiments of the present application, the readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The program product may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium can be, for example, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium would include the following: an electrical connection having one or more wires, a portable disk, a hard disk, random Access Memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

The computer readable storage medium may include a data signal propagated in baseband or as part of a carrier wave, with readable program code embodied therein. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A readable storage medium may also be any readable medium that can transmit, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a readable storage medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing. Program code for carrying out operations of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, C++ or the like and conventional procedural programming languages, such as the C programming language or similar programming languages. The program code may execute entirely on the user's computing device, partly on the user's device, as a stand-alone software package, partly on the user's computing device, partly on a remote computing device, or entirely on the remote computing device or server. In the case of remote computing devices, the remote computing device may be connected to the user computing device through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computing device (e.g., connected via the Internet using an Internet service provider).

The present application has been described in terms of its purpose, performance, advancement, and novelty, and the like, and is thus adapted to the functional enhancement and use requirements highlighted by the patent statutes, but the description and drawings are not limited to the preferred embodiments of the present application, and therefore, all equivalents and modifications that are included in the construction, apparatus, features, etc. of the present application shall fall within the scope of the present application.

Claims

1. A process editor for configuring an explanation process of a target virtual object, the process editor comprising:

2. The process editor of claim 1 wherein the content configuration module comprises a new lecture content button and an lecture content configuration interface; the explanation content configuration interface comprises a content name text input box, a virtual object drop-down menu, an explanation node adding button, an explanation node adding interface and an explanation content display area; the added explanation node interface comprises a node name text input box and a node content drop-down menu;

3. The process editor of claim 2 wherein the content configuration module further comprises an explanation content preview interface; the explanation content preview interface comprises an information display area and a progress display area; the progress display area comprises a node editing button and a name editing text input box corresponding to each node identifier;

4. The process editor of claim 1 wherein the script configuration module comprises a new guest boot button, a play interrupt old guest boot button, a play end old guest boot button, an explanation sequence button, an end content button, a first add explanation content interface, and a second add explanation content interface; the first added explanation content interface comprises an explanation content single selection frame; the second added explanation content interface comprises a first explanation content check box;

5. The process editor of claim 1, wherein the catalog configuration module comprises a catalog configuration button, a catalog configuration interface, and a catalog presentation area; the catalog configuration interface comprises a second explanation content check box; the catalog display area comprises a dragging button corresponding to each explanation content;

6. A process editing method, characterized in that it is used for configuring an explanation process of a target virtual object by using the process editor of any one of claims 1-5, the process editor comprising a content configuration module, a script configuration module, and a catalog configuration module, the method comprising:

7. The process editing method according to claim 6, wherein the content configuration module comprises a newly added explanation content button and an explanation content configuration interface; the explanation content configuration interface comprises a content name text input box, a virtual object drop-down menu, an explanation node adding button, an explanation node adding interface and an explanation content display area; the added explanation node interface comprises a node name text input box and a node content drop-down menu;

8. The process editing method according to claim 7, wherein said content configuration module further comprises an explanation content preview interface; the explanation content preview interface comprises an information display area and a progress display area; the progress display area comprises a node editing button and a name editing text input box corresponding to each node identifier;

9. The process editing method according to claim 6, wherein the script configuration module comprises a new guest guide button, a play interrupt old guest guide button, a play end old guest guide button, an explanation sequence button, an end content button, a first add explanation content interface, and a second add explanation content interface; the first added explanation content interface comprises an explanation content single selection frame; the second added explanation content interface comprises a first explanation content check box;

10. The process editing method according to claim 6, wherein the catalog configuration module comprises a catalog configuration button, a catalog configuration interface, and a catalog presentation area; the catalog configuration interface comprises a second explanation content check box; the catalog display area comprises a dragging button corresponding to each explanation content;

11. The flow editing method according to claim 6, wherein the method further comprises:

acquiring historical data of the target virtual object in a preset time period;

12. The process editing method according to claim 11, wherein the obtaining the similarity between the interpretation sequence of the target virtual object and the play sequence corresponding to each user identifier includes:

for each user identifier, the following processing is performed:

13. An electronic device for configuring an explanation process of a target virtual object using the process editor of any one of claims 1-5, the process editor comprising a content configuration module, a script configuration module, and a catalog configuration module, the electronic device comprising a memory and at least one processor, the memory storing a computer program, the at least one processor being configured to implement the following steps when executing the computer program:

14. A computer-readable storage medium, characterized in that it stores a computer program which, when executed by at least one processor, implements the steps of the method of any of claims 6-12 or the functions of the electronic device of claim 13.