CN113342866A - Keyword updating method and device, computer equipment and storage medium - Google Patents
Keyword updating method and device, computer equipment and storage medium Download PDFInfo
- Publication number
- CN113342866A CN113342866A CN202110689774.XA CN202110689774A CN113342866A CN 113342866 A CN113342866 A CN 113342866A CN 202110689774 A CN202110689774 A CN 202110689774A CN 113342866 A CN113342866 A CN 113342866A
- Authority
- CN
- China
- Prior art keywords
- data
- keyword
- information
- data table
- keywords
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2457—Query processing with adaptation to user needs
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2282—Tablespace storage structures; Management thereof
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/23—Updating
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2455—Query execution
- G06F16/24552—Database cache management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/06—Buying, selling or leasing transactions
- G06Q30/0601—Electronic shopping [e-shopping]
- G06Q30/0623—Item investigation
- G06Q30/0625—Directed, with specific intent or strategy
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- General Engineering & Computer Science (AREA)
- Business, Economics & Management (AREA)
- Finance (AREA)
- Computational Linguistics (AREA)
- Accounting & Taxation (AREA)
- Software Systems (AREA)
- Development Economics (AREA)
- Economics (AREA)
- Marketing (AREA)
- Strategic Management (AREA)
- General Business, Economics & Management (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The application discloses a keyword updating method, a keyword updating device, computer equipment and a storage medium, wherein the keyword updating method comprises the following steps: determining corresponding changed data according to the characteristic information of the changed data source in the material database carried by the external notification message, and correspondingly updating mapping relation data formed by the characteristic information of the changed data source and the changed data in the index data table according to the change type of the changed data source carried by the external notification message; constructing an operation expression according to the differential information before and after the index data table is updated; executing an operation expression, and updating data of a corresponding type on the cache data table according to the differential type in the operation expression; and counting the total number of the keywords mapped by different characteristic information in the cache data table, and updating the keyword list according to the judgment event of the total number. When a large number of keywords are updated, the difference updating can be efficiently completed only by modifying the mapping relation data in each data table, and data replacement or reconstruction is not needed.
Description
Technical Field
The embodiment of the invention relates to the technical field of e-commerce, in particular to a keyword updating method and device, computer equipment and a storage medium.
Background
At present, a e-commerce service platform extracts keywords meeting business requirements from a commodity title governed by the platform by using a keyword extraction algorithm and stores the keywords in a search word bank, so that the platform provides online shopping service to platform users by calling the bank, for example, when the platform searches commodities, commodity association service is provided for the users, when the users place advertisements, corresponding commodities and user figures are provided for the users, commodity recommendation service is provided for the users, and the like, but when the platform extracts new keywords or replaces other keyword extraction algorithms, the platform can only carry out full replacement by using the search word bank constructed by the platform, as is well known, the data operation of full update is time-consuming, while the response of e-commerce service is often millisecond-level, the platform needs to respond to multiple interactions within a short time, in the process, once the search word bank is replaced, the search word bank takes a long time, data acquisition errors of the interaction events of the platform may be caused, so that a platform user cannot use related services, online shopping experience of the user is poor, and revenue and earnings of the platform are affected. Therefore, how to update the search lexicon without affecting the quality of service of the platform becomes a technical problem to be solved by those skilled in the art.
Disclosure of Invention
The application aims to provide a keyword updating method, a keyword updating device, computer equipment and a storage medium.
In order to realize the purpose of the application, the following technical scheme is adopted:
a keyword updating method adapted to one of the objectives of the present application, includes the following steps:
determining corresponding changed data according to the feature information of a changed data source in a material database carried by an external notification message, and correspondingly updating mapping relation data formed by the feature information of the changed data source and the changed data in an index data table according to the change type of the changed data source carried by the external notification message, wherein the changed data comprises one or more keywords obtained by executing data portrayal on image-text information contained in the data source by calling a data portrayal interface, and the index data table is used for storing the mapping relation data between the feature information of each data source and the one or more keywords;
constructing an operation expression according to the differential information embodied before and after the index data table is updated, wherein the operation expression comprises characteristic information embodied in the differential information mapping relation data, a differential type corresponding to the characteristic information and a differential keyword, the differential type represents that the keyword embodied in the mapping relation data of the corresponding characteristic information is added or deleted before and after the index data table is updated, and the differential keyword represents the added or deleted keyword;
executing the operation expression, and updating data of corresponding types to a cache data table according to the dispersion type in the operation expression, so that the cache data table represents the change of mapping relation data between each keyword and feature information mapped by the keyword in the dispersion information of the variable data source, wherein the cache data table is used for storing the mapping relation data between each keyword and one or more feature information;
and counting the total number of the keywords mapped by different characteristic information in the cache data table, and executing updating operation on a keyword list according to a judgment event for switching between zero and non-zero, and correspondingly deleting or adding the keywords, wherein the keyword list is used for storing the keywords.
In a further embodiment, determining the corresponding changed data according to the feature information of the changed data source in the material database carried by the external notification message, and updating the mapping relationship data formed by the feature information of the changed data source and the changed data in the index data table according to the change type of the changed data source carried by the external notification message includes:
receiving an external notification message, wherein the external notification message carries characteristic information of a changed data source and a change type representing deletion operation, and is used for representing that the corresponding deletion operation is executed on a data source pointed by the characteristic information in a material database;
inquiring an index data table to obtain one or more keywords corresponding to the characteristic information of the external notification message as the changed data of the changed data source corresponding to the characteristic information;
and deleting the mapping relation data corresponding to the characteristic information of the external notification message in the index data table according to the change type.
In a further embodiment, determining the corresponding changed data according to the feature information of the changed data source in the material database carried by the external notification message, and updating the mapping relationship data formed by the feature information of the changed data source and the changed data in the index data table according to the change type of the changed data source carried by the external notification message includes:
receiving an external notification message, wherein the external notification message carries characteristic information of a changed data source and a change type representing a newly-added operation and is used for representing that a data source pointed by the characteristic information is newly added into a material database;
calling a data portrait interface, and extracting one or more keywords from the image-text information of the data source pointed by the characteristic information by the data portrait interface as the variable data of the variable data source pointed by the characteristic information;
and adding mapping relation data formed by the characteristic information of the external notification message and one or more keywords extracted through a data portrait interface into the index data table according to the change type.
In a further embodiment, constructing the operation expression according to the delta information before and after the index data table is updated includes:
determining updated difference information according to the updated mapping relation data in the index data table, wherein the updated difference information comprises the feature information contained in the updated mapping relation data, the changed keywords corresponding to each feature information contained in the updated mapping relation data, and the operation type of each changed keyword;
merging a plurality of differential information embodied by one or more updating operations of mapping relation data pointed by the same characteristic information into the same differential information;
and constructing the operation expression according to the final differential information, wherein the characteristic information contained in the updated mapping relation data in the differential information is taken as the characteristic information in the operation expression, the keyword which corresponds to the contained characteristic information and changes in the differential information is taken as the differential keyword of the corresponding characteristic information in the operation expression, and the operation type of the keyword which changes in the differential information is taken as the differential type of the corresponding keyword in the operation expression.
In a further embodiment, executing the operation expression, and updating data of a corresponding type to a cache data table according to a delta type in the operation expression, so that the cache data table represents a change of mapping relationship data between each keyword and feature information mapped thereto in delta information of the changed data source, includes:
inquiring a cache data table according to each differential keyword in the operation expression, and positioning to mapping relation data to which each differential keyword belongs;
according to the corresponding differential type of each differential keyword in the operation expression, when the differential type represents a new operation, the feature information in the operation expression is recorded in the mapping relation data in an activated state so as to represent that the differential keyword and the feature information have a mapping relation; when the delta type represents deletion operation, feature information in the operation expression is recorded in the mapping relation data in an inactivated state so as to represent that the delta keyword and the feature information do not have a mapping relation.
In a further embodiment, counting the total number of the keywords mapped by different feature information in the cache data table, and performing an update operation on the keyword list according to a determination event for switching between zero and non-zero, wherein the deleting or adding the keyword correspondingly comprises:
calling the cache data table, and counting the total number of each keyword pointed by different characteristic information;
judging whether the total number of each keyword changes from non-zero to zero or changes from zero to non-zero, and triggering a corresponding judgment event;
and in response to the judgment event, deleting the keyword from the keyword list when the total number of the keywords mapped by the different feature information changes from non-zero to zero, and inserting the keyword into the keyword list when the total number of the keywords mapped by the different feature information changes from zero to non-zero.
In a further embodiment, the corresponding change data is determined according to the feature information of the change data source in the material database carried by the external notification message, the mapping relationship data formed by the feature information of the change data source and the change data in the index data table is updated according to the change type of the change data source carried by the external notification message, the change data includes one or more keywords obtained by executing data imaging on the image-text information included in the data source by calling a data imaging interface, the index data table is used for storing the mapping relationship data between the feature information of each data source and the one or more keywords thereof, and the following steps are replaced:
and calling a data portrait interface to extract keywords from image-text information in a full data source in the material database, constructing the characteristic information of each data source and one or more corresponding keywords as mapping relation data, and updating an index data table by using the mapping relation data in a full manner, wherein the index data table is used for storing the mapping relation data between the characteristic information of each data source and one or more keywords of the data source.
A keyword updating apparatus adapted to an object of the present application, comprising:
the index data table updating module is used for determining corresponding variable data according to the characteristic information of the variable data source in the material database carried by the external notification message, correspondingly updating the mapping relation data formed by the characteristic information of the variable data source and the variable data in the index data table according to the variation type of the variable data source carried by the external notification message, wherein the variable data comprises one or more keywords obtained by calling a data image interface to perform data image on image-text information contained in the data source, and the index data table is used for storing the mapping relation data between the characteristic information of each data source and the one or more keywords;
an operation expression construction module, configured to construct an operation expression according to the delta information before and after the index data table is updated, where the operation expression includes feature information included in the delta information mapping relationship data, a delta type corresponding to the feature information, and a delta keyword, where the delta type represents that a keyword included in the mapping relationship data in which the corresponding feature information is located is added or deleted before and after the index data table is updated, and the delta keyword represents the added or deleted keyword;
an operation expression execution module, configured to execute the operation expression, and execute data update of a corresponding type on a cache data table according to a delta type in the operation expression, so that the cache data table represents a change of mapping relationship data between each keyword and feature information mapped thereto in delta information of the varied data source, where the cache data table is used to store mapping relationship data between each keyword and one or more feature information;
and the keyword list updating module is used for counting the total number of the keywords in the cache data table mapped by different characteristic information, executing updating operation on the keyword list according to a judgment event for switching between zero and non-zero, and correspondingly deleting or newly adding the keywords, wherein the keyword list is used for storing the keywords.
In a further embodiment, the index data table updating module includes:
the external notification message receiving unit is used for receiving an external notification message, the external notification message carries characteristic information of a changed data source and a change type representing deletion operation, and the external notification message is used for representing that the corresponding deletion operation is executed on the data source pointed by the characteristic information in the material database;
an index data table query unit configured to query an index data table and obtain one or more keywords corresponding to the feature information of the external notification message as the modified data of the modified data source corresponding to the feature information;
and a mapping relation data deleting unit, configured to delete, according to the change type, mapping relation data corresponding to the feature information of the external notification message in the index data table.
In a preferred embodiment, the index data table updating module further includes:
the external notification message receiving unit is used for receiving an external notification message, wherein the external notification message carries characteristic information of a changed data source and a change type representing a newly added operation and is used for representing that a data source pointed by the characteristic information is newly added into a material database;
the data image interface calling unit is used for calling a data image interface, and one or more keywords are extracted from the image-text information of the data source pointed by the characteristic information by the data image interface and are used as the variable data of the variable data source pointed by the characteristic information;
and a mapping relation data adding unit for adding mapping relation data formed by the feature information of the external notification message and one or more keywords extracted by the data portrait interface to the index data table according to the change type.
In a further embodiment, the operation expression construction module comprises:
a difference information determining unit, configured to determine updated difference information according to updated mapping relationship data in the index data table, where the updated difference information includes feature information included in the updated mapping relationship data, a keyword that corresponds to each feature information included in the updated mapping relationship data and changes, and an operation type of each keyword that changes;
a differential information merging unit, configured to merge a plurality of differential information, which are reflected by one or more update operations for mapping relationship data pointed by the same feature information, into the same differential information;
and the operation expression constructing unit is used for constructing the operation expression according to the final difference information, wherein the characteristic information contained in the updated mapping relation data in the difference information is taken as the characteristic information in the operation expression, the keyword which corresponds to the contained characteristic information and changes in the difference information is taken as the difference keyword of the corresponding characteristic information in the operation expression, and the operation type of the keyword which changes in the difference information is taken as the difference type of the corresponding keyword in the operation expression.
In a further embodiment, the operation expression execution module includes:
the cache data table query unit is used for querying the cache data table according to each differential keyword in the operation expression and positioning the mapping relation data to which each differential keyword belongs;
the operation expression execution unit is used for recording the feature information in the operation expression in an activated state in the mapping relation data according to the corresponding delta type of each delta keyword in the operation expression when the delta type represents a newly added operation so as to represent that the mapping relation exists between the delta keyword and the feature information; when the delta type represents deletion operation, feature information in the operation expression is recorded in the mapping relation data in an inactivated state so as to represent that the delta keyword and the feature information do not have a mapping relation.
In a further embodiment, the keyword list updating module includes:
the total number counting unit is used for calling the cache data table and counting the total number of each keyword pointed by different characteristic information;
the judgment event triggering unit is used for judging whether the total number of each keyword changes from nonzero to zero or from zero to nonzero and triggering a corresponding judgment event;
a judgment event response unit for responding the judgment event, deleting a keyword from the keyword list when the total number of the keywords mapped by the different feature information changes from non-zero to zero, and inserting the keyword into the keyword list when the total number of the keywords mapped by the different feature information changes from zero to non-zero.
In order to solve the above technical problem, an embodiment of the present invention further provides a computer device, including a memory and a processor, where the memory stores computer-readable instructions, and the computer-readable instructions, when executed by the processor, cause the processor to execute the steps of the keyword updating method.
In order to solve the above technical problem, an embodiment of the present invention further provides a storage medium storing computer-readable instructions, which, when executed by one or more processors, cause the one or more processors to perform the steps of the keyword updating method.
The embodiment of the invention has the beneficial effects that:
the application provides a novel keyword list updating technology, which constructs an operation expression for a data source needing keyword updating, and updates mapping relation data of each keyword and the data source according to the expression so as to determine the change quantity of each keyword and update the keywords stored in a keyword list.
The method comprises the steps of pre-constructing an index data table and a cache data table to pre-record mapping relation data between each data source and a keyword, wherein the mapping relation data in the index data table is used for representing whether the data source has a certain keyword or not, the mapping relation data in the cache data table is used for representing whether the keyword exists in a certain data source or not, when a large number of data sources need to be updated by the keyword, the activation state of the mapping relation data between the data sources and the updated keyword in the index data table is modified, an operation expression is constructed according to differential information before and after the updating of the index data table to update the activation state of the mapping relation data between the updated keyword and the data source in the cache data table, and finally, only the total amount of the corresponding data source existing in each keyword in the cache data table needs to be counted, the method has the advantages that the keywords stored in the keyword list can be updated by judging whether the total amount of the keywords is zero, when the keywords of a large number of data sources are updated, the whole keyword list does not need to be subjected to large-amount data replacement or keyword list reconstruction to complete the updating of the keywords, the updating time of the keyword list can be greatly shortened, and the problem that the user experience is influenced due to the fact that the electricity business service with the help of the keyword list cannot be normally used due to too long updating time is solved, so that the problem of the operation condition of a platform is caused.
In addition, the index data table and the cache data table constructed by the method can be used for neural network training which depends on mapping between data sources and keywords, such as commodity portrait construction training or user portrait construction training, and the like.
Drawings
The foregoing and/or additional aspects and advantages of the present application will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:
fig. 1 is a schematic diagram of a typical network deployment architecture related to implementing the technical solution of the present application;
FIG. 2 is a flowchart illustrating an exemplary embodiment of a keyword update method according to the present application;
FIG. 3 is a schematic diagram of an index data table of the present application;
FIG. 4 is a schematic flowchart illustrating a specific step of step S11 in FIG. 2;
FIG. 5 is another schematic flow chart illustrating the specific step of step S11 in FIG. 2;
FIG. 6 is a schematic flowchart illustrating a specific step of step S12 in FIG. 2;
FIG. 7 is a schematic diagram of a cache data table according to the present application;
FIG. 8 is a schematic flowchart illustrating a specific step of step S13 in FIG. 2;
FIG. 9 is a schematic diagram of a cache data table updated according to an operation expression according to the present application;
FIG. 10 is a schematic flowchart illustrating a specific step of step S14 in FIG. 2;
FIG. 11 is a flowchart illustrating an alternative step of step S11 in FIG. 2 according to an embodiment of the keyword updating method of the present application;
FIG. 12 is a functional block diagram of an exemplary embodiment of a keyword update apparatus of the present application;
fig. 13 is a block diagram of a basic structure of a computer device according to an embodiment of the present application.
Detailed Description
Reference will now be made in detail to embodiments of the present application, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the drawings are exemplary only for the purpose of explaining the present application and are not to be construed as limiting the present application.
As used herein, the singular forms "a", "an", "the" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms "comprises" and/or "comprising," when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof. It will be understood that when an element is referred to as being "connected" or "coupled" to another element, it can be directly connected or coupled to the other element or intervening elements may also be present. Further, "connected" or "coupled" as used herein may include wirelessly connected or wirelessly coupled. As used herein, the term "and/or" includes all or any element and all combinations of one or more of the associated listed items.
It will be understood by those within the art that, unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the prior art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.
As will be appreciated by those skilled in the art, "client," "terminal," and "terminal device" as used herein include both devices that are wireless signal receivers, which are devices having only wireless signal receivers without transmit capability, and devices that are receive and transmit hardware, which have receive and transmit hardware capable of two-way communication over a two-way communication link. Such a device may include: cellular or other communication devices such as personal computers, tablets, etc. having single or multi-line displays or cellular or other communication devices without multi-line displays; PCS (Personal Communications Service), which may combine voice, data processing, facsimile and/or data communication capabilities; a PDA (Personal Digital Assistant), which may include a radio frequency receiver, a pager, internet/intranet access, a web browser, a notepad, a calendar and/or a GPS (Global Positioning System) receiver; a conventional laptop and/or palmtop computer or other device having and/or including a radio frequency receiver. As used herein, a "client," "terminal device" can be portable, transportable, installed in a vehicle (aeronautical, maritime, and/or land-based), or situated and/or configured to operate locally and/or in a distributed fashion at any other location(s) on earth and/or in space. The "client", "terminal Device" used herein may also be a communication terminal, a web terminal, a music/video playing terminal, such as a PDA, an MID (Mobile Internet Device) and/or a Mobile phone with music/video playing function, and may also be a smart tv, a set-top box, and the like.
The hardware referred to by the names "server", "client", "service node", etc. is essentially an electronic device with the performance of a personal computer, and is a hardware device having necessary components disclosed by the von neumann principle such as a central processing unit (including an arithmetic unit and a controller), a memory, an input device, an output device, etc., a computer program is stored in the memory, and the central processing unit calls a program stored in an external memory into the internal memory to run, executes instructions in the program, and interacts with the input and output devices, thereby completing a specific function.
It should be noted that the concept of "server" as referred to in this application can be extended to the case of a server cluster. According to the network deployment principle understood by those skilled in the art, the servers should be logically divided, and in physical space, the servers may be independent from each other but can be called through an interface, or may be integrated into one physical computer or a set of computer clusters. Those skilled in the art will appreciate this variation and should not be so limited as to restrict the implementation of the network deployment of the present application.
Referring to fig. 1, the hardware basis required for implementing the related art embodiments of the present application may be deployed according to the architecture shown in the figure. The server 80 is deployed at the cloud end, and serves as a business server, and is responsible for further connecting to a related data server and other servers providing related support, so as to form a logically associated server cluster to provide services for related terminal devices, such as a smart phone 81 and a personal computer 82 shown in the figure, or a third-party server (not shown in the figure). Both the smart phone and the personal computer can access the internet through a known network access mode, and establish a data communication link with the cloud server 80 so as to run a terminal application program related to the service provided by the server.
The application program refers to an application program running on a server or a terminal device, the application program implements the related technical scheme of the application in a programming mode, a program code of the application program can be saved in a nonvolatile storage medium which can be identified by a computer in a form of a computer executable instruction, and is called into a memory by a central processing unit to run, and the related device of the application is constructed by running the application program on the computer.
For the server, the application program is usually constructed as a service process, and a corresponding program interface is opened for remote call of the application program running on various terminal devices.
The solution in the present application, which is suitable for implementation in a terminal device, may also be programmed to be built into an application providing a merchant transaction, as a part of which the functionality is extended. The e-commerce transaction refers to an online transaction service displayed based on the network deployment structure.
The person skilled in the art will know this: although the various methods of the present application are described based on the same concept so as to be common to each other, they may be independently performed unless otherwise specified. In the same way, for each embodiment disclosed in the present application, it is proposed based on the same inventive concept, and therefore, concepts of the same expression and concepts of which expressions are different but are appropriately changed only for convenience should be equally understood.
Referring to fig. 2, in an exemplary embodiment of a keyword updating method of the present application, the method includes the following steps:
step S11, determining the corresponding changed data according to the feature information of the changed data source in the material database carried by the external notification message, and updating the mapping relationship data formed by the feature information of the changed data source and the changed data in the index data table according to the change type of the changed data source carried by the external notification message, where the changed data includes one or more keywords obtained by executing data image on the image-text information included in the data source by calling a data image interface, and the index data table is used to store the mapping relationship data between the feature information of each data source and the one or more keywords thereof:
the server receives the external notification message pushed by the E-commerce service platform establishing a data communication link with the server, analyzes one or more changed data sources in a material database carried by the external notification message, determines changed data corresponding to the notification messages of the changed data sources, and correspondingly updates the mapping relation data formed by the feature messages and the changed data corresponding to the changed data sources in the index data table according to the changed types of the changed data sources.
The e-commerce service platform acquires one or more change data sources (commodity titles, commodity pictures or commodity introduction information) from the e-commerce service platform or other e-commerce service platforms through a crawler algorithm, an NER mining algorithm or a manual method, and constructs the material database by taking the characteristic information as a label.
When the change type is represented as a new addition operation, the server extracts keywords from the change data source pointed by the change type through the data portrait interface, obtains the keywords of the change data source as the change data, and constructs the mapping relation data between the change data source and the change data to be stored in the index data table so as to complete the updating operation of the index data table, so that the e-commerce service platform provides e-commerce services such as commodity retrieval service, commodity recommendation service or commodity classification for platform users, and optimizes the e-commerce experience of the users.
The change type is used for representing the adding operation or the deleting operation of the change data source, so that the server performs the adding operation or the deleting operation on the mapping relation data of the change data source corresponding to the change data in the index data table according to the change type of each change data source.
After the E-commerce service platform completes construction of the material database, the change types corresponding to the change data sources are constructed according to newly adding or deleting operations required to be executed by the change data sources in the material database, the change types and the material database construction are used as external notification information and pushed to a server, and therefore the server can update mapping relation data formed by feature information and change data of the change data sources of the material database in the index data table according to the material database carried by the external notification information.
The server extracts keywords from image-text information contained in one or more variable data sources through the data image interface, acquires one or more keywords as the variable data corresponding to the variable data sources, classifies and encapsulates the variable data sources and the variable data, and constructs the index data table; and each variable data source in the index data table takes the characteristic information as a label, so that the server determines the variable data of each variable data source from the index data table according to the characteristic information of the external notification information.
The data representation interface generally refers to an algorithm for extracting keywords of the variable data source, for example, the data representation interface may be a TermWeight algorithm, a CNN convolutional neural network, or a FlashText algorithm, or other known keyword extraction algorithms.
The feature information is used as a label of each variable data source, so that the server determines the variable data corresponding to each variable data source in the material database according to the feature information corresponding to each variable data source, and queries the mapping relation data of each variable data source corresponding to the variable data in the index data table.
The index data table stores the mapping relation data between one or more change data sources and the change data (keywords) corresponding to the change data sources; the mapping relation data is used for representing whether a certain changed data (keyword) exists in the changed data source, the mapping relation data generally exists in two states, one represents that the changed data source has a certain changed data (keyword) and generally uses non-zero as a state representation, the other represents that the changed data source does not have a certain changed data (keyword) and generally uses zero as a state representation, and a person skilled in the art can design a representation mode for representing existence and absence of a certain changed design (keyword) through flexibly designing the mapping relation, which is not repeated.
Referring to fig. 3, specifically, as shown in fig. 3, when a Keyword1 does not exist in the feature information Id1, the mapping relationship data between the feature information and the Keyword is Keyword1[0], and when a Keyword3 exists in the feature information Id1, the mapping relationship data between the feature information and the Keyword is Keyword3[1 ].
Referring to fig. 4, when the deletion operation of the change type indicator is performed, the server updates the specific implementation of each mapping relation design in the index data table according to the external notification information, which includes the following specific steps:
step S111, receiving an external notification message, where the external notification message carries feature information of a changed data source and a change type representing a deletion operation, and is used to represent that a corresponding deletion operation is performed on a data source pointed to by the feature information in a material database:
and the server receives the external notification message, the change type of the change data source carried by the external notification message represents the change type of the deletion operation, and the server executes the deletion operation on the change data corresponding to the change data source according to the deletion operation represented by the change type.
Step S112, querying an index data table, and obtaining one or more keywords corresponding to the feature information of the external notification message as the changed data of the changed data source corresponding to the feature information:
and the server inquires one or more keywords corresponding to the variable data source in the index data table according to the characteristic data of the variable data source, wherein the keywords are used as the variable data of the variable data source corresponding to the characteristic information.
Step S113, according to the change type, deleting mapping relationship data corresponding to the feature information of the external notification message in the index data table:
and the server deletes the mapping relation data between the changed data source and the changed data pointed by the changed type according to the deletion operation represented by the changed type, wherein the deletion operation generally means that the state of the mapping relation data is changed to zero to represent that the changed data does not exist in the changed data source, or the server can delete the mapping relation data from an index data table.
Referring to fig. 5, when a new operation represented by the change type is performed, the server updates, according to the external notification information, a specific implementation manner of each mapping relationship design in the index data table, which includes the following specific steps:
step S111', receiving an external notification message, where the external notification message carries feature information of a changed data source and a change type representing a new addition operation, and is used to represent that a data source pointed by the feature information is newly added to a material database:
and the server receives the external notification message, the change type of the change data source carried by the external notification message represents the change type of the new adding operation, and the server executes the corresponding new adding operation for the change data source according to the new adding operation represented by the change type.
Step S112', a data image interface is called, and the data image interface extracts one or more keywords from the image-text information of the data source pointed by the feature information as the variable data of the variable data source pointed by the feature information:
the server calls the data portrait interface, one or more keywords are proposed from the image-text information of the data source pointed by the characteristic information through the data portrait interface, and the keywords are used as the variable data of the variable data source pointed by the characteristic information.
Step S113', adding mapping relationship data composed of the feature information of the external notification message and one or more keywords extracted through the data representation interface to the index data table according to the variation type:
and after acquiring the change data of the change data source, the server constructs the mapping relation data between the change data source and one or more change data, and stores the mapping relation data into the index data table to finish the new operation represented by the change type.
Step S12, constructing an operation expression according to the delta information before and after the index data table is updated, where the operation expression includes feature information included in the delta information mapping relationship data, and a delta type and a delta keyword corresponding to the feature information, the mapping relationship data in which the delta type represents the corresponding feature information is included is added or deleted before and after the index data table is updated, and the delta keyword represents the added or deleted keyword:
and after the server finishes updating the index data table, constructing the operation expression according to the feature information represented by one or more pieces of mapping relation data updated in the index data table and the differential information embodied by the newly adding or deleting operation of the keywords.
The operation expression test includes the delta keyword and a delta type, the delta keyword is a keyword representing one or more keywords for performing addition or deletion operations in the feature information pointed by the delta information, that is, a keyword for performing an update, and the delta type is used for representing an update operation (addition or deletion operation) performed before and after the update of the keyword.
Specifically, when the index data table finishes deleting the mapping relationship data between a certain feature information and a corresponding keyword, the difference information includes the feature information, the keyword and an operation type for deleting the keyword, and the server constructs an operation expression according to the difference information, wherein the difference keyword is the keyword for deleting, and the difference type represents that the keyword is the keyword for deleting; when the mapping relation data between a certain feature information and a corresponding keyword is newly added in the index data table, the differential information comprises the feature information, the keyword and an operation type for performing newly added operation on the keyword, and in an operation expression constructed by the server according to the differential information, the differential keyword is the newly added keyword, and the differential type represents that the newly added operation is performed on the keyword.
Referring to fig. 6, the specific implementation steps of constructing the operation expression by the server are as follows:
step S121, determining updated difference information according to the updated mapping relationship data in the index data table, where the updated difference information includes feature information included in the updated mapping relationship data, a keyword corresponding to each feature information included in the updated mapping relationship data and changing, and an operation type of each keyword changing:
the server determines the corresponding feature information and the corresponding key word of each mapping relation data according to the mapping relation data according to one or more mapping relation data which are updated in the index data table, constructs the differential information corresponding to each mapping relation data according to the respective implemented operation types (adding or deleting operations) of the mapping relation data, and records the implemented operation types of the key words corresponding to the mapping relation data, wherein the differential information comprises the feature information and the key word corresponding to the pointed mapping relation data.
Step S122, merging a plurality of differential information reflected by one or more update operations on the mapping relationship data pointed by the same feature information into the same differential information:
when a certain feature information in the index data table is subjected to updating operation of a plurality of mapping relation data, the server combines the differential information formed by the updating operation of the plurality of mapping relation data of the feature information into the same differential information, and the differential information comprises the keywords corresponding to the mapping relation data and the updating operation carried out on the keywords.
Step S123, constructing the operation expression according to the final difference information, wherein the feature information included in the updated mapping relationship data in the difference information is used as the feature information in the operation expression, the keyword corresponding to the included feature information and changing in the difference information is used as the difference keyword of the corresponding feature information in the operation expression, and the operation type of the keyword changing in the difference information is used as the difference type of the corresponding keyword in the operation expression:
after the server completes the construction of each difference information, the server constructs the operation expressions corresponding to each difference information according to the difference information, the feature information contained in the difference information is used as the feature information in the operation expression, the keyword contained in the difference information is used as the difference keyword in the operation expression, and the operation type recorded by the difference information and implemented by each keyword is used as the implementation difference type in the operation expression.
Step S13, executing the operation expression, and updating data of a corresponding type to a cache data table according to a delta type in the operation expression, so that the cache data table represents a change of mapping relationship data between each keyword and feature information mapped thereto in delta information of the varied data source, where the cache data table is used to store mapping relationship data between each keyword and one or more feature information:
after the server finishes the operation expression, the operation expression is executed, data updating represented by the dispersion type is executed on the cache data table according to the dispersion type contained in the operation expression, and mapping relation data between feature information and dispersion data contained in the operation expression in the cache data table is updated.
Referring to fig. 7, the cache data table stores mapping relationship data between each keyword and one or more feature information, the cache data table classifies each keyword by feature information as compared to the index data table, the cache data table classifies each feature information by the keyword, the mapping relation data stored in the cache data table is used for characterizing feature information (data source) of each keyword, specifically, as shown in fig. 7, when the Keyword1 does not exist in the feature information id1, the mapping relation data of the key word and the characteristic information is id1[0], when the key word Keyword1 exists in the characteristic information id2, the mapping relation data of the key word and the characteristic information is id2[1], that is, the implementation mapping relation data generally represents that a certain keyword is absent in certain feature information with zero, and represents that a certain keyword is present in certain feature information with non-zero.
Fig. 7 to 9 show specific implementation steps of the embodiment in which the server updates the cache data table according to the operation expression, including:
step S131, inquiring a cache data table according to each differential keyword in the operation expression, and positioning mapping relation data to which each differential keyword belongs:
the server inquires the mapping relation data of the delta keywords in the cache data table according to the delta keywords contained in the implementation operation expression.
Step S131, according to the corresponding delta type of each delta keyword in the operation expression, when the delta type represents a new operation, the feature information in the operation expression is recorded in the mapping relation data in an activated state to represent that the delta keyword and the feature information have a mapping relation; when the delta type represents deletion operation, the feature information in the operation expression is recorded in the mapping relation data in an inactive state to represent that the delta keyword and the feature information do not have a mapping relation:
and the server updates the corresponding mapping relation data in the cache data table according to the execution updating operation (adding or deleting) operation of certain characteristic information represented by each differential type and certain differential keyword in the operation expression.
When the delta type in the operation expression is characterized as that a new adding operation is executed on a certain feature information and a certain delta keyword, modifying the mapping relation data of the delta keyword and the feature information in the cache data table into the activated state so as to represent that the mapping relation exists between the delta keyword and the feature information; when the delta type in the operation expression is characterized as the execution deletion operation of certain characteristic information and certain delta key word, modifying the mapping relation data of the delta key word and the characteristic information in the cache data table into the non-activated state so as to represent that the mapping relation does not exist between the delta key word and the characteristic information; when the delta type representation exists in the operation expression and is a newly added operation of executing a certain feature information and a certain delta keyword, and the cache data table does not have the delta keyword, the server constructs mapping relation data of the keyword and the feature information and stores the mapping relation data into the cache data, wherein the mapping relation data is in the activated state.
Referring to fig. 7 and 9, specifically, when the feature information Id1 and the difference Keyword1 with difference type representation in the operation expression perform an addition operation, the mapping relationship data of the difference Keyword1 and the feature information Id1 is modified from Id1[0] in fig. 7 to Id1[1] in fig. 9, so as to represent that the difference Keyword1 has a mapping relationship with the feature information Id 1; when deletion operation is performed on the feature information Id2 and the difference Keyword Keyword2 with difference type representation in the operation expression, the mapping relation data of the difference Keyword Keyword2 and the feature information Id2 is modified from Id2[1] in FIG. 7 to Id2[0] in FIG. 9, so that no mapping relation exists between the difference Keyword Keyword2 and the feature information Id2 with representation; when the feature information Id1 and the differential Keyword4 with the differential type representation exist in the operation expression to perform a new addition operation, and the mapping relationship data of the differential keywords Keyword4 and Id1 do not exist in the cache data, the server stores the mapping relationship data of the construction Keyword4 and the feature information Id1 into the cache data table, so that the cache data table is updated from fig. 7 to the cache data table shown in fig. 8.
Step S14, counting the total number of the keywords mapped by different feature information in the cache data table, and according to a determination event for switching between zero and non-zero, performing an update operation on a keyword list, and correspondingly deleting or adding the keyword, where the keyword list is used to store the keywords:
the server counts the total number of the keywords mapped by different feature information according to the mapping relation data between the keywords and different feature information in the cache data table, and judges whether the total number of the keywords which are counted is zero or non-zero according to the keywords stored in the keyword list so as to generate the keywords to carry out corresponding judgment events, so that the server triggers the judgment events, executes corresponding updating operation on the keyword list, and adds corresponding keywords to the keyword list or deletes corresponding keywords from the keyword list.
The server can extract corresponding keywords in search words input by a user of the E-commerce service platform during commodity search according to the keyword list, and perform search word association service according to the keywords, or construct corresponding commodity figures and user figures according to the keyword list, so as to provide corresponding commodity advertisement delivery service for commodities submitted by a seller user of the platform, or provide commodity recommendation service for buyer users of the platform. By updating the keywords in the keyword list, the e-commerce service platform can be optimized according to the e-commerce service provided by the keyword list, and the use experience of platform users can be improved.
Referring to fig. 7 and 9, specifically, fig. 7 is the cache data table before performing updating, fig. 9 is the cache data table after performing updating, and the server statistically obtains, according to the mapping relationship data between each Keyword and different feature information in fig. 9, that the total number of the keywords Keyword1 is 3, the total number of the keywords Keyword2 is 0, the total number of the keywords Keyword3 is 1, and the total number of the keywords Keyword4 is 1. Since the total number of the Keyword2 is 0 and the total number thereof in the cache data table of fig. 7 is 1, the judgment event of the Keyword2 changes from non-zero to zero, and the server responds to the trigger event and deletes the Keyword2 from the Keyword list; because the Keyword4 is a newly added Keyword in the cache data table, a judgment event that the generated Keyword4 is switched from zero to non-zero is generated, and the server responds to the judgment event and adds the Keyword4 to the Keyword list.
Referring to fig. 10, the specific implementation steps of the embodiment of counting the total number of the keywords in the cache data table by the server and updating the keyword list according to the total number are as follows:
step S141, calling the cache data table, and counting the total number of each keyword pointed by different feature information:
and calling an implementation cache data table by the server, and counting the total number of the keywords pointed by different characteristic information according to the mapping relation data between the keywords and the different characteristic information in the cache data table.
Step S142, determining whether the total number of each keyword changes from non-zero to zero, or from zero to non-zero, and triggering a corresponding determination event:
and the server determines whether the total number of the keywords which are counted is changed from nonzero to zero or from zero to nonzero according to the keywords stored in the keyword table so as to trigger the corresponding judgment event.
Step S143, in response to the determination event, when the total number of the different feature information mapped to one keyword changes from non-zero to zero, deleting the keyword from the keyword list, and when the total number of the different feature information mapped to one keyword changes from zero to non-zero, inserting the keyword into the keyword list:
the server responds to the judgment event, when the total number of the different characteristic information mappings representing a certain keyword of the judgment event changes from non-zero to zero, the server deletes the keyword from the keyword list, and when the total number of the different characteristic information mappings representing the certain keyword of the judgment event changes from zero to non-zero, the server adds the keyword into the keyword list.
The above exemplary embodiments and variations thereof fully disclose the embodiments of the keyword updating method of the present application, but many variations thereof can be deduced by transforming and augmenting some technical means, and other embodiments are briefly described as follows:
in an embodiment, referring to fig. 11, the method further includes a replacing step, where the keyword updating method includes a step S11' for replacing the step S11 in the previous embodiment, and the replacing step is as follows:
step S11', invoking the data portrait interface to extract keywords from the graphics context information in the full data sources in the material database, constructing the feature information of each data source and one or more corresponding keywords as mapping relationship data, and updating the index data table with the mapping relationship data, where the index data table is used to store the mapping relationship data between the feature information of each data source and one or more keywords thereof:
the server calls the data portrait interface to extract keywords from the image-text information in the full data sources in the material database, constructs the characteristic information of the data sources and one or more search keywords corresponding to the characteristic information into mapping relation data, and updates the mapping relation data into the index data table in a full scale mode.
The execution of the full update generally refers to an updating mode implemented by the server calling other data representation interfaces to perform keyword extraction on the image-text information in the full data source in the material database, the server updates the keywords in the keyword list by calling other data representation interfaces to optimize the e-commerce service provided by the e-commerce service platform through the keyword list, for example, the platform constructs a more comprehensive and specific commodity image and user image based on the keyword list to provide more precise commodity advertisement delivery service and commodity recommendation service, or the platform extracts the keywords extracted by the commodity search keywords input by the user according to the keyword list more accurately, so that the commodity associated with the platform is closely associated with the commodity search keywords, and the commodity search experience of the user is improved.
After the server obtains the mapping relation data, all the mapping relation data in the index data table are updated correspondingly, because the mapping relation data between each feature information and the key word are stored in the index data table, and the mapping relation data generally represent whether a certain key word exists in the feature information in a zero or non-zero mode, the server only needs to modify the mapping updating data needing zero or non-zero modification in the index data table correspondingly according to whether the feature information represented by the newly constructed mapping relation data exists in the zero or non-zero of a certain key word, or newly adds corresponding mapping relation data in the index data table, and does not need to construct a new index data table or replace all the mapping relation data in the index data table, and the time spent on data replacement or new creation of the index data table, the cache data table or the key word list is compared in the full updating mode, the full-amount updating mode can finish the updating of the index data table, the cache data table and the keyword list only by spending less time, so that the phenomenon that part of services of the E-commerce service platform cannot be used due to overlong updating time and the use experience of platform users is influenced is prevented.
And after the server finishes updating the index data table, constructing the operation expression according to the feature information represented by one or more pieces of mapping relation data updated in the index data table and the differential information embodied by the newly adding or deleting operation of the keywords.
After the server finishes the operation expression, the operation expression is executed, data updating represented by the dispersion type is executed on the cache data table according to the dispersion type contained in the operation expression, and mapping relation data between feature information and dispersion data contained in the operation expression in the cache data table is updated.
The server counts the total number of the keywords mapped by different feature information according to the mapping relation data between the keywords and different feature information in the cache data table, and judges whether the total number of the keywords which are counted is zero or non-zero according to the keywords stored in the keyword list so as to generate the keywords to carry out corresponding judgment events, so that the server triggers the judgment events, executes corresponding updating operation on the keyword list, and adds corresponding keywords to the keyword list or deletes corresponding keywords from the keyword list.
Further, a keyword updating apparatus of the present application can be constructed by functionalizing each step in the method disclosed in the above embodiments, according to this idea, please refer to fig. 12, in an exemplary embodiment of the keyword updating method, the apparatus includes: the system comprises an index data table updating module 11, an operation expression construction module 12, an operation expression execution module 13 and a keyword list updating module 14, wherein the index data table updating module 11 is used for determining the corresponding change data according to the feature information of the change data source in the material database carried by the external notification message, correspondingly updating the feature information of the change data source and the mapping relation data formed by the change data in the index data table according to the change type of the change data source carried by the external notification message, the change data comprises one or more keywords obtained by executing data imaging on image-text information contained in the data source by calling a data imaging interface, and the index data table is used for storing the mapping relation data between the feature information of each data source and the one or more keywords; an operation expression constructing module 12, configured to construct an operation expression according to the delta information before and after the index data table is updated, where the operation expression includes feature information included in the delta information mapping relationship data, and a corresponding delta type and a delta keyword, where the mapping relationship data in which the corresponding feature information is located is represented by the delta type, and the keyword is added or deleted before and after the index data table is updated, and the delta keyword represents the added or deleted keyword; an operation expression executing module 13, configured to execute the operation expression, and execute data update of a corresponding type on a cache data table according to a delta type in the operation expression, so that the cache data table represents a change of mapping relationship data between each keyword and feature information mapped thereto in delta information of the varied data source, where the cache data table is used to store mapping relationship data between each keyword and one or more feature information; and a keyword list updating module 14, configured to count a total number of the keywords in the cache data table mapped by different feature information, perform an updating operation on a keyword list according to a determination event that the total number is switched between zero and non-zero, and correspondingly delete or add the keyword, where the keyword list is used to store the keyword.
In one embodiment, the index data table updating module 11 includes: the external notification message receiving unit is used for receiving an external notification message, the external notification message carries characteristic information of a changed data source and a change type representing deletion operation, and the external notification message is used for representing that the corresponding deletion operation is executed on the data source pointed by the characteristic information in the material database; an index data table query unit configured to query an index data table and obtain one or more keywords corresponding to the feature information of the external notification message as the modified data of the modified data source corresponding to the feature information; and a mapping relation data deleting unit, configured to delete, according to the change type, mapping relation data corresponding to the feature information of the external notification message in the index data table.
In another embodiment, the index data table updating module 11 further includes: the external notification message receiving unit is used for receiving an external notification message, wherein the external notification message carries characteristic information of a changed data source and a change type representing a newly added operation and is used for representing that a data source pointed by the characteristic information is newly added into a material database; the data image interface calling unit is used for calling a data image interface, and one or more keywords are extracted from the image-text information of the data source pointed by the characteristic information by the data image interface and are used as the variable data of the variable data source pointed by the characteristic information; and a mapping relation data adding unit for adding mapping relation data formed by the feature information of the external notification message and one or more keywords extracted by the data portrait interface to the index data table according to the change type.
In one embodiment, the operational expression construction module comprises: a difference information determining unit, configured to determine updated difference information according to updated mapping relationship data in the index data table, where the updated difference information includes feature information included in the updated mapping relationship data, a keyword that corresponds to each feature information included in the updated mapping relationship data and changes, and an operation type of each keyword that changes; a differential information merging unit, configured to merge a plurality of differential information, which are reflected by one or more update operations for mapping relationship data pointed by the same feature information, into the same differential information; and the operation expression constructing unit is used for constructing the operation expression according to the final difference information, wherein the characteristic information contained in the updated mapping relation data in the difference information is taken as the characteristic information in the operation expression, the keyword which corresponds to the contained characteristic information and changes in the difference information is taken as the difference keyword of the corresponding characteristic information in the operation expression, and the operation type of the keyword which changes in the difference information is taken as the difference type of the corresponding keyword in the operation expression.
In one embodiment, the operation expression execution module includes: the cache data table query unit is used for querying the cache data table according to each differential keyword in the operation expression and positioning the mapping relation data to which each differential keyword belongs; the operation expression execution unit is used for recording the feature information in the operation expression in an activated state in the mapping relation data according to the corresponding delta type of each delta keyword in the operation expression when the delta type represents a newly added operation so as to represent that the mapping relation exists between the delta keyword and the feature information; when the delta type represents deletion operation, feature information in the operation expression is recorded in the mapping relation data in an inactivated state so as to represent that the delta keyword and the feature information do not have a mapping relation.
In one embodiment, the keyword list update module comprises: the total number counting unit is used for calling the cache data table and counting the total number of each keyword pointed by different characteristic information; the judgment event triggering unit is used for judging whether the total number of each keyword changes from nonzero to zero or from zero to nonzero and triggering a corresponding judgment event; a judgment event response unit for responding the judgment event, deleting a keyword from the keyword list when the total number of the keywords mapped by the different feature information changes from non-zero to zero, and inserting the keyword into the keyword list when the total number of the keywords mapped by the different feature information changes from zero to non-zero.
In order to solve the above technical problem, an embodiment of the present application further provides a computer device, configured to run a computer program implemented according to the keyword updating method. Referring to fig. 13, fig. 13 is a block diagram of a basic structure of a computer device according to the present embodiment.
As shown in fig. 13, the internal structure of the computer device is schematically illustrated. The computer device includes a processor, a non-volatile storage medium, a memory, and a network interface connected by a system bus. The non-volatile storage medium of the computer device stores an operating system, a database and computer readable instructions, the database can store control information sequences, and the computer readable instructions can enable the processor to realize a keyword updating method when being executed by the processor. The processor of the computer device is used for providing calculation and control capability and supporting the operation of the whole computer device. The memory of the computer device may have stored therein computer readable instructions that, when executed by the processor, cause the processor to perform a keyword update method. The network interface of the computer device is used for connecting and communicating with the terminal. Those skilled in the art will appreciate that the architecture shown in fig. 13 is merely a block diagram of some of the structures associated with the disclosed aspects and is not intended to limit the computing devices to which the disclosed aspects apply, as particular computing devices may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.
The processor in this embodiment is used to execute the specific functions of each module/sub-module in the keyword updating apparatus of the present invention, and the memory stores the program code and various data required for executing the above modules. The network interface is used for data transmission to and from a user terminal or a server.
The memory in this embodiment stores program codes and data necessary for executing all modules/sub-modules in the keyword updating apparatus, and the server can call the program codes and data of the server to execute the functions of all sub-modules.
The present application also provides a non-volatile storage medium, wherein the keyword updating method is written as a computer program and stored in the storage medium in the form of computer readable instructions, which when executed by one or more processors means the execution of the program in a computer, thereby causing the one or more processors to perform the steps of the keyword updating method of any of the above embodiments.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a computer-readable storage medium, and can include the processes of the embodiments of the methods described above when the computer program is executed. The storage medium may be a non-volatile storage medium such as a magnetic disk, an optical disk, a Read-Only Memory (ROM), or a Random Access Memory (RAM).
In summary, when a large number of keywords are updated, the delta update can be efficiently completed only by modifying the mapping relation data in each data table, data replacement or reconstruction is not needed, and particularly, when the programs of the related keyword extraction algorithm are updated, the database constructed by the old version algorithm does not need to be replaced completely, and only the delta update is needed.
It should be understood that, although the steps in the flowcharts of the figures are shown in order as indicated by the arrows, the steps are not necessarily performed in order as indicated by the arrows. The steps are not performed in the exact order shown and may be performed in other orders unless explicitly stated herein. Moreover, at least a portion of the steps in the flow chart of the figure may include multiple sub-steps or multiple stages, which are not necessarily performed at the same time, but may be performed at different times, which are not necessarily performed in sequence, but may be performed alternately or alternately with other steps or at least a portion of the sub-steps or stages of other steps.
Those of skill in the art will appreciate that the various operations, methods, steps in the processes, acts, or solutions discussed in this application can be interchanged, modified, combined, or eliminated. Further, other steps, measures, or schemes in various operations, methods, or flows that have been discussed in this application can be alternated, altered, rearranged, broken down, combined, or deleted. Further, steps, measures, schemes in the prior art having various operations, methods, procedures disclosed in the present application may also be alternated, modified, rearranged, decomposed, combined, or deleted.
The foregoing is only a partial embodiment of the present application, and it should be noted that, for those skilled in the art, several modifications and decorations can be made without departing from the principle of the present application, and these modifications and decorations should also be regarded as the protection scope of the present application.
Claims (10)
1. A keyword updating method is characterized by comprising the following steps:
determining corresponding changed data according to the feature information of a changed data source in a material database carried by an external notification message, and correspondingly updating mapping relation data formed by the feature information of the changed data source and the changed data in an index data table according to the change type of the changed data source carried by the external notification message, wherein the changed data comprises one or more keywords obtained by executing data portrayal on image-text information contained in the data source by calling a data portrayal interface, and the index data table is used for storing the mapping relation data between the feature information of each data source and the one or more keywords;
constructing an operation expression according to the differential information embodied before and after the index data table is updated, wherein the operation expression comprises characteristic information embodied in the differential information mapping relation data, a differential type corresponding to the characteristic information and a differential keyword, the differential type represents that the keyword embodied in the mapping relation data of the corresponding characteristic information is added or deleted before and after the index data table is updated, and the differential keyword represents the added or deleted keyword;
executing the operation expression, and updating data of corresponding types to a cache data table according to the dispersion type in the operation expression, so that the cache data table represents the change of mapping relation data between each keyword and feature information mapped by the keyword in the dispersion information of the variable data source, wherein the cache data table is used for storing the mapping relation data between each keyword and one or more feature information;
and counting the total number of the keywords mapped by different characteristic information in the cache data table, and executing updating operation on a keyword list according to a judgment event for switching between zero and non-zero, and correspondingly deleting or adding the keywords, wherein the keyword list is used for storing the keywords.
2. The method according to claim 1, wherein the determining the corresponding changed data according to the feature information of the changed data source in the material database carried by the external notification message, and updating the mapping relationship data formed by the feature information of the changed data source and the changed data in the index data table according to the change type of the changed data source carried by the external notification message comprises:
receiving an external notification message, wherein the external notification message carries characteristic information of a changed data source and a change type representing deletion operation, and is used for representing that the corresponding deletion operation is executed on a data source pointed by the characteristic information in a material database;
inquiring an index data table to obtain one or more keywords corresponding to the characteristic information of the external notification message as the changed data of the changed data source corresponding to the characteristic information;
and deleting the mapping relation data corresponding to the characteristic information of the external notification message in the index data table according to the change type.
3. The method according to claim 1, wherein the determining the corresponding changed data according to the feature information of the changed data source in the material database carried by the external notification message, and updating the mapping relationship data formed by the feature information of the changed data source and the changed data in the index data table according to the change type of the changed data source carried by the external notification message comprises:
receiving an external notification message, wherein the external notification message carries characteristic information of a changed data source and a change type representing a newly-added operation and is used for representing that a data source pointed by the characteristic information is newly added into a material database;
calling a data portrait interface, and extracting one or more keywords from the image-text information of the data source pointed by the characteristic information by the data portrait interface as the variable data of the variable data source pointed by the characteristic information;
and adding mapping relation data formed by the characteristic information of the external notification message and one or more keywords extracted through a data portrait interface into the index data table according to the change type.
4. The method of claim 1, wherein constructing the operation expression according to the delta information before and after the index data table is updated comprises:
determining updated difference information according to the updated mapping relation data in the index data table, wherein the updated difference information comprises the feature information contained in the updated mapping relation data, the changed keywords corresponding to each feature information contained in the updated mapping relation data, and the operation type of each changed keyword;
merging a plurality of differential information embodied by one or more updating operations of mapping relation data pointed by the same characteristic information into the same differential information;
and constructing the operation expression according to the final differential information, wherein the characteristic information contained in the updated mapping relation data in the differential information is taken as the characteristic information in the operation expression, the keyword which corresponds to the contained characteristic information and changes in the differential information is taken as the differential keyword of the corresponding characteristic information in the operation expression, and the operation type of the keyword which changes in the differential information is taken as the differential type of the corresponding keyword in the operation expression.
5. The method as claimed in claim 1, wherein executing the operation expression, and performing a corresponding type of data update on a cache data table according to a delta type in the operation expression, so that the cache data table represents a change of mapping relationship data between each keyword and feature information mapped thereto in delta information of the changed data source, includes:
inquiring a cache data table according to each differential keyword in the operation expression, and positioning to mapping relation data to which each differential keyword belongs;
according to the corresponding differential type of each differential keyword in the operation expression, when the differential type represents a new operation, the feature information in the operation expression is recorded in the mapping relation data in an activated state so as to represent that the differential keyword and the feature information have a mapping relation; when the delta type represents deletion operation, feature information in the operation expression is recorded in the mapping relation data in an inactivated state so as to represent that the delta keyword and the feature information do not have a mapping relation.
6. The method of claim 1, wherein counting a total number of the keywords mapped by different feature information in the cache data table, and performing an update operation on the keyword list according to a determination event for switching between zero and non-zero, and deleting or adding the keyword accordingly comprises:
calling the cache data table, and counting the total number of each keyword pointed by different characteristic information;
judging whether the total number of each keyword changes from non-zero to zero or changes from zero to non-zero, and triggering a corresponding judgment event;
and in response to the judgment event, deleting the keyword from the keyword list when the total number of the keywords mapped by the different feature information changes from non-zero to zero, and inserting the keyword into the keyword list when the total number of the keywords mapped by the different feature information changes from zero to non-zero.
7. The method according to any one of claims 4 to 6, wherein the change data corresponding to the change data source in the material database is determined according to the feature information of the change data source carried by the external notification message, and the mapping relationship data formed by the feature information of the change data source and the change data in the index data table is updated according to the change type of the change data source carried by the external notification message, wherein the change data includes one or more keywords obtained by performing data imaging on the image-text information included in the data source by calling a data imaging interface, and the index data table is used for storing the mapping relationship data between the feature information of each data source and the one or more keywords thereof, and is replaced by the following steps:
and calling a data portrait interface to extract keywords from image-text information in a full data source in the material database, constructing the characteristic information of each data source and one or more corresponding keywords as mapping relation data, and updating an index data table by using the mapping relation data in a full manner, wherein the index data table is used for storing the mapping relation data between the characteristic information of each data source and one or more keywords of the data source.
8. A keyword updating apparatus, comprising:
the index data table updating module is used for determining corresponding variable data according to the characteristic information of the variable data source in the material database carried by the external notification message, correspondingly updating the mapping relation data formed by the characteristic information of the variable data source and the variable data in the index data table according to the variation type of the variable data source carried by the external notification message, wherein the variable data comprises one or more keywords obtained by calling a data image interface to perform data image on image-text information contained in the data source, and the index data table is used for storing the mapping relation data between the characteristic information of each data source and the one or more keywords;
an operation expression construction module, configured to construct an operation expression according to the delta information before and after the index data table is updated, where the operation expression includes feature information included in the delta information mapping relationship data, a delta type corresponding to the feature information, and a delta keyword, where the delta type represents that a keyword included in the mapping relationship data in which the corresponding feature information is located is added or deleted before and after the index data table is updated, and the delta keyword represents the added or deleted keyword;
an operation expression execution module, configured to execute the operation expression, and execute data update of a corresponding type on a cache data table according to a delta type in the operation expression, so that the cache data table represents a change of mapping relationship data between each keyword and feature information mapped thereto in delta information of the varied data source, where the cache data table is used to store mapping relationship data between each keyword and one or more feature information;
and the keyword list updating module is used for counting the total number of the keywords in the cache data table mapped by different characteristic information, executing updating operation on the keyword list according to a judgment event for switching between zero and non-zero, and correspondingly deleting or newly adding the keywords, wherein the keyword list is used for storing the keywords.
9. A computer device comprising a memory and a processor, the memory having stored therein computer-readable instructions which, when executed by the processor, cause the processor to perform the steps of the keyword updating method as claimed in any one of claims 1 to 7.
10. A storage medium having computer-readable instructions stored thereon, which, when executed by one or more processors, cause the one or more processors to perform the steps of the keyword updating method as claimed in any one of claims 1 to 7.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202110689774.XA CN113342866B (en) | 2021-06-22 | 2021-06-22 | Keyword updating method and device, computer equipment and storage medium |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202110689774.XA CN113342866B (en) | 2021-06-22 | 2021-06-22 | Keyword updating method and device, computer equipment and storage medium |
Publications (2)
Publication Number | Publication Date |
---|---|
CN113342866A true CN113342866A (en) | 2021-09-03 |
CN113342866B CN113342866B (en) | 2022-06-21 |
Family
ID=77478702
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202110689774.XA Active CN113342866B (en) | 2021-06-22 | 2021-06-22 | Keyword updating method and device, computer equipment and storage medium |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN113342866B (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN114154005A (en) * | 2021-11-24 | 2022-03-08 | 东北大学 | Self-updating image-text retrieval method based on image-text network relation |
Citations (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20030149727A1 (en) * | 2002-02-07 | 2003-08-07 | Enow, Inc. | Real time relevancy determination system and a method for calculating relevancy of real time information |
US20150254714A1 (en) * | 2014-03-10 | 2015-09-10 | Yahoo! Inc. | Systems and methods for keyword suggestion |
CN106503091A (en) * | 2016-10-12 | 2017-03-15 | 济南浪潮高新科技投资发展有限公司 | A kind of implementation method of changeable data structure automatic synchronization coupling |
US20170357712A1 (en) * | 2016-06-13 | 2017-12-14 | Baidu Usa Llc | Method and system for searching and identifying content items in response to a search query using a matched keyword whitelist |
CN110134703A (en) * | 2019-05-21 | 2019-08-16 | 秒针信息技术有限公司 | A kind of keywords database update method and device |
CN111459987A (en) * | 2020-04-27 | 2020-07-28 | 恩亿科(北京)数据科技有限公司 | Cache updating method and device |
CN111753548A (en) * | 2020-03-04 | 2020-10-09 | 北京沃东天骏信息技术有限公司 | Information acquisition method and device, computer storage medium and electronic equipment |
CN111930899A (en) * | 2020-09-25 | 2020-11-13 | 成都数联铭品科技有限公司 | Keyword processing method and system and keyword searching method |
US10902009B1 (en) * | 2019-07-23 | 2021-01-26 | Dstillery, Inc. | Machine learning system and method to map keywords and records into an embedding space |
CN112328805A (en) * | 2020-10-29 | 2021-02-05 | 北京华云安信息技术有限公司 | Entity mapping method of vulnerability description information and database table based on NLP |
CN112948401A (en) * | 2021-01-12 | 2021-06-11 | 上海观察者信息技术有限公司 | Word segmentation word bank updating method, device and system and computer readable storage medium |
-
2021
- 2021-06-22 CN CN202110689774.XA patent/CN113342866B/en active Active
Patent Citations (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20030149727A1 (en) * | 2002-02-07 | 2003-08-07 | Enow, Inc. | Real time relevancy determination system and a method for calculating relevancy of real time information |
US20150254714A1 (en) * | 2014-03-10 | 2015-09-10 | Yahoo! Inc. | Systems and methods for keyword suggestion |
US20170357712A1 (en) * | 2016-06-13 | 2017-12-14 | Baidu Usa Llc | Method and system for searching and identifying content items in response to a search query using a matched keyword whitelist |
CN106503091A (en) * | 2016-10-12 | 2017-03-15 | 济南浪潮高新科技投资发展有限公司 | A kind of implementation method of changeable data structure automatic synchronization coupling |
CN110134703A (en) * | 2019-05-21 | 2019-08-16 | 秒针信息技术有限公司 | A kind of keywords database update method and device |
US10902009B1 (en) * | 2019-07-23 | 2021-01-26 | Dstillery, Inc. | Machine learning system and method to map keywords and records into an embedding space |
CN111753548A (en) * | 2020-03-04 | 2020-10-09 | 北京沃东天骏信息技术有限公司 | Information acquisition method and device, computer storage medium and electronic equipment |
CN111459987A (en) * | 2020-04-27 | 2020-07-28 | 恩亿科(北京)数据科技有限公司 | Cache updating method and device |
CN111930899A (en) * | 2020-09-25 | 2020-11-13 | 成都数联铭品科技有限公司 | Keyword processing method and system and keyword searching method |
CN112328805A (en) * | 2020-10-29 | 2021-02-05 | 北京华云安信息技术有限公司 | Entity mapping method of vulnerability description information and database table based on NLP |
CN112948401A (en) * | 2021-01-12 | 2021-06-11 | 上海观察者信息技术有限公司 | Word segmentation word bank updating method, device and system and computer readable storage medium |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN114154005A (en) * | 2021-11-24 | 2022-03-08 | 东北大学 | Self-updating image-text retrieval method based on image-text network relation |
Also Published As
Publication number | Publication date |
---|---|
CN113342866B (en) | 2022-06-21 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11755387B1 (en) | Updating code of an app feature based on a value of a query feature | |
EP1629403B1 (en) | Data importation and exportation for computing devices | |
US10853847B2 (en) | Methods and systems for near real-time lookalike audience expansion in ads targeting | |
US7353196B1 (en) | Configuring dynamic database packageset switching for use in processing business transactions | |
CN110134681B (en) | Data storage and query method and device, computer equipment and storage medium | |
US20240104088A1 (en) | Real time system for ingestion, aggregation, and identity association of data from user actions performed on websites or applications | |
CN113793182A (en) | Commodity object recommendation method and device, equipment, medium and product thereof | |
CN114925101A (en) | Data processing method and device, storage medium and electronic equipment | |
CN113342866B (en) | Keyword updating method and device, computer equipment and storage medium | |
US20220156254A1 (en) | Feature engineering system | |
CN113961643A (en) | Search engine updating method and device, equipment, medium and product thereof | |
CN112488803A (en) | Favorite storage access method and device, equipment and medium thereof | |
CN112347355A (en) | Data processing method, device, server and storage medium | |
US10019295B2 (en) | Method and system for managing and linking software applications | |
CN115168668A (en) | Information recommendation method and device, computer equipment and storage medium | |
CN115129804A (en) | Address association method, device, equipment, medium and product | |
CN114328555A (en) | Commodity information updating processing method and device, equipment, medium and product thereof | |
CN115348353B (en) | Content pushing method and server | |
CN113672371B (en) | Task engine execution method and device, equipment and medium thereof | |
CN113672648B (en) | Rule engine data call control and execution method and device, equipment and medium thereof | |
US20240119003A1 (en) | Low-latency machine learning model prediction cache for improving distribution of current state machine learning predictions across computer networks | |
US20230315787A1 (en) | Evolutionary Analysis of an Identity Graph Data Structure | |
CN112861036A (en) | User favorite access method and device, equipment and medium thereof | |
US10817901B2 (en) | Trailing communication flow integration | |
CN116578571A (en) | Method, device, computer equipment and storage medium for updating guest group data |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |