CN112000746A - Data management method and device and server - Google Patents
Data management method and device and server Download PDFInfo
- Publication number
- CN112000746A CN112000746A CN202011182233.XA CN202011182233A CN112000746A CN 112000746 A CN112000746 A CN 112000746A CN 202011182233 A CN202011182233 A CN 202011182233A CN 112000746 A CN112000746 A CN 112000746A
- Authority
- CN
- China
- Prior art keywords
- data table
- target data
- target
- source
- attribute
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/28—Databases characterised by their database models, e.g. relational or object models
- G06F16/283—Multi-dimensional databases or data warehouses, e.g. MOLAP or ROLAP
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computing Systems (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The application provides a data management method, a device and a server, wherein the method comprises the following steps: displaying a target data table attribute configuration interface; receiving the attribute configuration operation of the target data table through the attribute configuration interface of the target data table, and generating the table attribute parameters of the target data table; displaying a source data table attribute configuration interface; receiving a source data table attribute configuration operation through a source data table attribute configuration interface, and generating a source table attribute parameter of a source data table corresponding to the source data table; displaying a table structure configuration interface; receiving a table structure configuration operation through a table structure configuration interface, and generating a table structure parameter of a target data table; the table structure parameters comprise the incidence relation between the target fields of the target data table and the target fields of the target data table; processing data in the target data table to obtain a target data table; according to the data synchronization method and device, the source data in the source data table can be dynamically matched according to different data configuration requests, the target data table corresponding to the target data is determined, and the data synchronization efficiency is improved.
Description
Technical Field
The present application relates to the field of big data, and in particular, to a data management method, apparatus, and server.
Background
Currently, when a data warehouse is built by each big data management platform, a data table structure of each layer of the data warehouse is generally defined in a visual mode, and then data are synchronized into each data table of the data warehouse in a script writing mode.
Therefore, the current data management technology has the technical problems that the requirement of a data synchronization mode on a user is high and the efficiency is low in the data management process.
Disclosure of Invention
The embodiment of the application provides a data management method, a data management device and a server, which are used for solving the technical problems that the requirement on a user is high and the efficiency is low due to a data synchronization mode in a data management process in the current data management technology.
An embodiment of the present application provides a data management method, including:
displaying a target data table attribute configuration interface;
receiving the attribute configuration operation of the target data table through the attribute configuration interface of the target data table, and generating table attribute parameters of the target data table according to the attribute configuration operation of the target data table;
displaying a source data table attribute configuration interface;
receiving a source data table attribute configuration operation through the source data table attribute configuration interface, and generating a source table attribute parameter of the source data table corresponding to the target data table according to the source data table attribute configuration operation;
displaying a table structure configuration interface;
receiving a table structure configuration operation through the table structure configuration interface, and generating a table structure parameter of the target data table according to the table structure configuration operation; the table structure parameters comprise an incidence relation between a target field of the target data table and a target field of the target data table;
and processing the data in the target data table according to the table structure parameters of the target data table to obtain the target data table.
An embodiment of the present application further provides a data management apparatus, including: the data customizing device and the data center station;
the data customization equipment is used for displaying a target data table attribute configuration interface, receiving the target data table attribute configuration operation through the target data table attribute configuration interface, and generating a table attribute parameter of the target data table according to the target data table attribute configuration operation;
the data customization equipment is further used for displaying a source data table attribute configuration interface, receiving the source data table attribute configuration operation through the source data table attribute configuration interface, and generating a source table attribute parameter of the source data table corresponding to the target data table according to the source data table attribute configuration operation;
the data customization equipment is also used for displaying a table structure configuration interface, receiving table structure configuration operation through the table structure configuration interface and generating table structure parameters of the target data table according to the table structure configuration operation; the table structure parameters comprise the association relationship between the content field of the target data table and the content field of the source data table;
and the data center station processes the data in the source data table according to the table structure parameters of the target data table to obtain the target data table.
An embodiment of the present application further provides a server, including: the system comprises a processor, a memory, a bus and a computer program which is stored on the memory and can run on the processor, wherein the processor and the memory are communicated with each other through the bus; the memory processor, when executing the computer program, implements a data management method as in any one of the above.
Has the advantages that: the embodiment of the application provides a data management method, a device and a server, wherein the method comprises the following steps: displaying a target data table attribute configuration interface; receiving the attribute configuration operation of the target data table through the attribute configuration interface of the target data table, and generating table attribute parameters of the target data table according to the attribute configuration operation of the target data table; displaying a target data table attribute configuration interface; receiving a target data table attribute configuration operation through the target data table attribute configuration interface, and generating a source table attribute parameter of the target data table corresponding to the target data table according to the target data table attribute configuration operation; displaying a table structure configuration interface; receiving a table structure configuration operation through the table structure configuration interface, and generating a table structure parameter of the target data table according to the table structure configuration operation; the table structure parameters comprise an incidence relation between a target field of the target data table and a target field of the target data table; processing data in the target data table according to the table structure parameters of the target data table to obtain the target data table; according to the method and the device, the target data table of the source database can be dynamically matched according to the table structure parameters of different target data tables provided by the user, the data in the target data table is processed to obtain the target data table, programming operation is not needed in the whole process, the requirement on the user is lowered, and the efficiency of data synchronization is improved.
Drawings
The technical solution and other advantages of the present application will become apparent from the detailed description of the embodiments of the present application with reference to the accompanying drawings.
Fig. 1 is a scene schematic diagram of a data management method according to an embodiment of the present application.
Fig. 2 is a schematic flowchart of a data management method according to an embodiment of the present application.
Fig. 3 is a schematic view of a target data table configuration interface of the data customization device according to the embodiment of the present application.
Fig. 4 is a schematic view of a data source related configuration interface of a data customization device according to an embodiment of the present application.
Fig. 5 is a schematic view of a connection mode interface of the data customizing device according to the embodiment of the present application.
Fig. 6 is a schematic diagram of a table structure configuration interface of a data customization device according to an embodiment of the present application.
Fig. 7 is a schematic diagram of a data field creation interface of a data customization device according to an embodiment of the present application.
Fig. 8 is a schematic view of a business process creation interface of the data customization device according to the embodiment of the present application.
Fig. 9 is a schematic diagram of a main table design interface of a data customization device according to an embodiment of the present application.
Fig. 10 is a schematic structural diagram of a computer device according to an embodiment of the present application.
Fig. 11 is a schematic structural diagram of a server according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application. It is to be understood that the embodiments described are only a few embodiments of the present application and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
In the embodiment of the application, data management refers to a transportation-oriented service system which fully utilizes modern electronic information technologies such as internet of things, cloud computing, artificial intelligence, automatic control, mobile internet and the like in various big data fields; the service system can dynamically match the target field with the target data table according to different data configuration requests, determine and write data into the target data table corresponding to the target data, reduce the requirements on users and improve the efficiency of data synchronization. The data management method, the device and the server are described in detail below with reference to a data customization device of a certain online supermarket.
In the embodiments of the present application, the word "for example" is used to mean "serving as an example, instance, or illustration. Any embodiment described herein as "for example" is not necessarily to be construed as preferred or advantageous over other embodiments. The following description is presented to enable any person skilled in the art to make and use the invention. In the following description, details are set forth for the purpose of explanation. It will be apparent to one of ordinary skill in the art that the present invention may be practiced without these specific details. In other instances, well-known structures and processes are not shown in detail to avoid obscuring the description of the invention with unnecessary detail. Thus, the present invention is not intended to be limited to the embodiments shown, but is to be accorded the widest scope consistent with the principles and features disclosed herein.
It should be noted that, since the method in the embodiment of the present application is executed in a data management data customization device (for example, a data customization device), processing objects of each data management data customization device 2 all exist in the form of data or information, such as time, which is substantially time information, and it is understood that, if the size, the number, the position, and the like are mentioned in the subsequent embodiments, corresponding data exist, so as to process data in the data customization device, and details are not described herein.
Embodiments of the present application provide a data management method, an apparatus, and a server, which are described in detail below.
Referring to fig. 1, fig. 1 is a schematic view of a scenario of a data management method provided in an embodiment of the present application, where the data management method is applied to the data management apparatus, the system may include a data center station 1 and a data customization device 2, and the data center station 1 and the data customization device 2 may be connected and communicated through an internet formed by various gateways, such as a wide area network and a local area network, which are not described herein again. It can be understood that the data center 1 is a set of sustainable mechanisms for "making the data of the enterprise useful", and a strategic selection and organization form is that a set of mechanisms for continuously changing the data into assets and serving the businesses is constructed through tangible products and implementation methodology support according to the specific business mode and organization architecture of the enterprise. The data center station 1 mainly has 4 core capabilities of data aggregation and integration, data purification and processing, data service visualization and data value change. The data customizing device 2 is client equipment which is registered and authorized by the data center 1 system and has operation requirements on data and equipment in the system, and specifically comprises a client for an online supermarket, a client for developers and the like, the data center 1 in the application is a server and is used for processing user requests of the data customizing device 2, and a plurality of target data tables, namely a data warehouse, are arranged in the data center 1. The data customisation device 2 is a device for providing data customisation services to users of the business system and may be a device comprising both receiving and transmitting hardware, i.e. a device having receiving and transmitting hardware capable of performing two-way communication over a two-way communication link. Such a device may include: the cellular or other communication device, which has a single line display or a multi-line display or does not have a multi-line display, may specifically be one of the desktop data customizing device 2 or a mobile data customizing device, such as a mobile phone, a tablet computer, a notebook computer, and the like.
It should be further noted that the scenario diagram of the data management method shown in fig. 1 is only an example, and the data customization device and the scenario described in the embodiment of the present invention are for more clearly illustrating the technical solution of the embodiment of the present invention, and do not form a limitation on the technical solution provided in the embodiment of the present invention. The following are detailed below. It should be noted that the following description of the embodiments is not intended to limit the preferred order of the embodiments.
Please refer to fig. 2, which is a flowchart illustrating a data management method according to an embodiment of the present application. In one embodiment, a data management method is provided. The present embodiment is mainly illustrated by applying the method to the data customizing device 2 in fig. 1. Referring to fig. 2, the data management method specifically includes steps S110 to S170, and specifically includes the following steps:
and S110, displaying the attribute configuration interface of the target data table.
Specifically, through the target data table attribute configuration interface, a user may configure the relevant attributes of the target data table, generate a data configuration request, and prepare for subsequently generating the target data table.
The data configuration request refers to a configuration request for matching the target data table with the history of the data customization interface of the data customization device 2, so as to generate the data items to be matched by using the interface and display all the interfaces of the data items to be matched to the user.
It can be understood that the data configuration request in this embodiment is a request sent to the data center station 1 according to a requirement of customizing data required by a user, a target data table corresponding to target data is matched in the data center station 1, and data in the target data table is processed according to table structure parameters of the target data table to obtain the target data table, the user is not required to program in the whole process, the operation difficulty of the user is reduced, and the synchronization efficiency of a data warehouse in the data center station 1 is improved.
The configuration interface refers to an interface area for configuring data in the display interface.
The target data refers to data source data to be configured by the data configuration request, and the target data may refer to a certain kind of data or different parameters of a certain kind of data. The target data table is generated by the user according to the self requirement and comprises various table attribute parameters required to be used, and the user can call the target data table according to the self requirement at any time, so that the target data table is more convenient and quicker.
It is understood that in the supermarket system, the target data table represents the parameter attribute table of all relevant actions of a certain customer from logging in the supermarket to confirming the receipt, and may include: user login, user search, user order placing, user payment and user confirmation receiving.
Referring to fig. 3, a schematic diagram of a target data table configuration interface of the data customization device according to the embodiment of the present application is shown. The target data table configuration interface includes: a data source type area, a data source area, a database area, a table name area, a table type (namely English name) area and a description limiting area; the data source type area is used for limiting the data type of the target data table; for example, in an online supermarket system, if the time for a certain customer to log in the online supermarket system is required to be obtained, the data source type needs to be limited to be the user login time; if a certain customer wants to obtain an information list of purchasing commodities when entering the online supermarket system, the data source type is limited to be the type of the purchased commodities; if a certain customer wants to obtain the payment amount paid by the online supermarket, the data source type needs to be limited to the payment amount of the user.
The data source region is used for limiting the range of a data warehouse of the source data table matched with the target data table; for example, if a data warehouse range of a target data table matched with a target data table of a system time of a certain customer logging in a supermarket on the internet is required to be obtained, the data source is limited to be user logging time; if a certain customer wants to obtain a data warehouse range of a source data table matched with a target data table of a commodity information table purchased by the online supermarket system, the data source needs to be limited to be a purchased commodity class; if a customer wants to obtain the data warehouse range of the source data table matched with the target data table of the payment amount of the online supermarket, the data source needs to be limited to pay the amount of the user.
The database area is used for limiting the address range of the target data table; for example, if a customer wants to obtain a target data table address of the time when the customer logs in the online supermarket system, the database needs to be limited to be the user login time; if a certain customer wants to obtain a target data table address of a commodity information table purchased by a supermarket on the Internet system, the database is limited to be a purchased commodity class; if a customer wants to obtain a target data table address of the payment amount of a supermarket on the internet, the database is limited to pay the amount of the user.
The table name area is used for limiting the table name of the target data table; for example, if a customer wants to obtain a table name of a target data table of the time when the customer logs in the online supermarket system, the database needs to be limited to be the user login time; if a certain customer wants to obtain the table name of a target data table of a commodity information table purchased by a supermarket on the Internet system, the database is limited to be a purchased commodity class; if a customer wants to obtain the table name of the target data table of the payment amount of the online supermarket, the database needs to be limited to pay the amount of the user.
The English name area is used for limiting the table type of the target data table, and can be a dimension table or a detailed fact table and the like; for example, if a user wants to obtain a table type of a target data table of a system time of logging in a supermarket on the internet, the database needs to be limited to be the user login time; if a certain customer wants to obtain the table type of a target data table of a commodity information table purchased by a supermarket on the Internet system, the database is limited to be a purchased commodity type; if a customer wants to obtain the table type of the target data table of the payment amount of the online supermarket, the database needs to be limited to pay the amount of the user.
Describing a defined area for adding other defined target fields which are not related to the filled content of the area so as to further define the range of the target data table; for example, if a customer wants to further define the data source or data source type of the target data table when logging into the online supermarket system, other defined target fields of the target data table can be added in the description defined area.
Furthermore, the database area, the table name area and the table type area in the target data table attribute configuration interface are optional operation areas, that is, when configuring the target data table, a user must fill related source field contents in the database area, the table name area and the table type area to define the target data table; the data source type area, the data source area and the description limiting area are optional operation areas, that is, when the target data table is configured, a user can selectively fill related source field contents in the data source type area, the data source area and the description limiting area, so that the limiting range of the target data table can be further narrowed, and the target data table can be matched more accurately and quickly.
And S120, receiving the attribute configuration operation of the target data table through the attribute configuration interface of the target data table, and generating the table attribute parameters of the target data table according to the attribute configuration operation of the target data table.
Specifically, a plurality of setting areas related to the attributes of the target data table are arranged in the attribute configuration interface of the target data table, and a user can set related information such as a target field in each different table attribute setting area according to the information of the target data table which is desired to be obtained, so that the target data table can be matched with the source data table more easily.
Specifically, the display target data table attribute configuration interface; receiving the target data table attribute configuration operation through the target data table attribute configuration interface, and generating the table attribute parameters of the target data table according to the target data table attribute configuration operation, wherein the step comprises the following steps: displaying a target data table attribute configuration interface, wherein the target data table attribute configuration interface comprises a database address setting area, a table name setting area and a table type setting area; receiving the address attribute configuration operation of the target data table through the database address setting area, and generating the address table attribute parameters of the target data table according to the address attribute configuration operation of the target data table; receiving a table name attribute configuration operation of the target data table through the table name setting area, and generating a table name attribute parameter of the target data table according to the table name attribute configuration operation of the target data table; and receiving the table type attribute configuration operation of the target data table through the table type setting area, and generating the table type attribute parameters of the target data table according to the table type attribute configuration operation of the target data table.
For example, in a supermarket payment system, if the user wants to obtain purchase information of the user, corresponding attribute tables need to be established for table attribute parameters included in an action of logging in the supermarket system by the user, an action of placing an order by the user, an action of searching by the user, and an action of confirming receipt by the user, respectively, so as to be used for subsequent retrieval and calling by a supermarket administrator.
It is understood that the table attributes of the target data table include information such as action time, user name, etc. of each table, for example, when a customer logs in a supermarket on the internet, the data center 1 (i.e. the server here) automatically generates a user login information table, which includes: information such as a user login name, user login time, a host used for user login, a network end for user login and the like; when a customer searches in an online supermarket system, a data center station 1 automatically generates a user search information table, wherein the user search information table comprises: the method comprises the following steps that information such as a user login name, a user retrieval time period, a commodity type retrieved by a user, a host used by the user to retrieve the online supermarket, a network end used by the user to retrieve the online supermarket and the like is obtained; when a customer places an order in an online supermarket, the data center station 1 automatically generates an order information table of the user, and the order information table of the user comprises the following components: information such as a user login name, user ordering time, a commodity type searched by the user, a host used for searching in the online supermarket by the user, a network end used for searching in the online supermarket by the user and the like; when a customer places an order in an online supermarket, the data center station 1 automatically generates a user payment information table, wherein the user payment information table comprises: the system comprises information such as a user login name, user payment time, types and quantity of commodities purchased by a user, unit price and total price of commodities purchased by the user, a host used for payment of the user in an online supermarket, a network terminal used for payment of the user in the online supermarket and the like; when a customer confirms receiving in an online supermarket, the data center station 1 automatically generates a user confirmation receiving information table, and the user confirmation receiving information table comprises: the system comprises a user login name, a user confirmation receiving time, a host used for searching in the online supermarket by the user, a network end used for searching in the online supermarket by the user and the like.
S130, displaying the attribute configuration interface of the source data table.
Specifically, through the source data table attribute configuration interface, data displayed by the source data table attribute configuration interface are all data directly set in the data warehouse of the data center station 1, and a user can configure the relevant attributes of the source data table to limit the range of the source data table for the subsequent generation of the target data table.
The source data table refers to data information stored in a source database in the data center station 1, for example, in an online supermarket system, the data center station 1 records all users logging in for online supermarket retrieval and shopping, and establishes different data tables respectively, which may be purchase periods, hot-sold goods, user retrieval types, and the like of the users, so as to manage the online supermarket system in the following and count user requirements. The system can be called by following the self requirement at any time, and is more convenient and quicker. The target data table is generally created by the user according to the user's own needs in the data customizing device 2 (i.e., the terminal).
Fig. 4 is a schematic view of a data source related configuration interface of the data customizing device according to the embodiment of the present application. The source data table attribute configuration interface comprises: the data source comprises a data source type area, a data source area, a database area and a data table area; the data source type area of the source data table is used for limiting the data type of the source data table; the data source area of the source data table is used for limiting the data warehouse range of the source data; the database area of the source data table is used for limiting the address range of the source data table; the data table area of the source data table is used for limiting the table name of the source data table; for example, in a supermarket on the internet system, all source data are stored in the data center 1, and when target data in the source data table needs to be matched with source data in the target data table, the data source type, data source, database and data table in the source data table need to be defined first.
Furthermore, the database area and the data table area in the source data table attribute configuration interface are optional operation areas, that is, when configuring the source data table, a user must fill related source field contents in the source database area and the data table area to define the source data table; the data source type area and the data source area are optional operation areas, that is, when the source data table is configured, a user can selectively fill related source field contents in the source database area and the data table area, so that the limited range of the target data table can be further reduced, and the target data table can be matched more accurately and quickly.
S140, receiving a source data table attribute configuration operation through the source data table attribute configuration interface, and generating a source table attribute parameter of the source data table corresponding to the target data table according to the source data table attribute configuration operation.
Specifically, a plurality of setting areas related to the source data table attributes are arranged in the source data table attribute configuration interface, and a user can set related information such as a source field and the like in each different table attribute setting area according to the information of the target data table which is desired to be obtained, so as to reduce the range of the source data table matched with the target data table as much as possible.
Further, the display source data table attribute configuration interface; receiving a source data table attribute configuration operation through the source data table attribute configuration interface, and generating a source table attribute parameter of the source data table corresponding to the target data table according to the source data table attribute configuration operation, wherein the step comprises the following steps: displaying the source data table attribute configuration interface, wherein the source data table attribute configuration interface comprises a source database address setting area and a source data table name setting area; receiving a source database address table attribute configuration operation through the source database address setting area interface, and generating a source address table attribute parameter of the source data table corresponding to the target data table according to the source database address table attribute configuration operation; and receiving table name table attribute configuration operation of the source data table through the table name setting area interface of the source data table, and generating source table name attribute parameters of the source data table corresponding to the target data table according to the table name table attribute configuration operation of the source data table.
Further, when the number of the source tables of the source data table is more than one, showing a source data table attribute configuration interface; after the step of receiving the attribute configuration operation of the source data table through the attribute configuration interface of the source data table and generating the source table attribute parameters of the source data table corresponding to the target data table according to the attribute configuration operation of the source data table, the method comprises the following steps: displaying a connection mode configuration interface of a plurality of source data tables, wherein the plurality of source data tables comprise a master table and at least one slave table; and acquiring the user identifications of the source data tables according to the incidence relation between the attributes of the master table and the attributes of the slave table.
Specifically, the step of obtaining the user identifiers of the multiple target data tables through the association relationship between the master table attribute and the slave table attribute includes: and acquiring the user identifications of the target data tables through the association relationship between the source field of the master table and the target field of the slave table.
Fig. 5 is a schematic view of a connection mode interface of the data customizing device according to the embodiment of the present application. The connection mode configuration interface comprises: the system comprises a main table area, a connection mode area, a slave table area, a source field area, a target field area and an increase and decrease area of a slave table; if the number of the source tables of the target data table is two, selecting one table as a master table in the master table region, then selecting one slave table in the slave table region, setting the association relationship between the master table and the slave table in the connection mode region, such as left connection, right connection, internal connection or external connection, and the like, wherein the source field content of the master table corresponding to different connection modes is different from the target field content of the slave table; the contents in the source field area and the target field area can be automatically changed according to the connection mode selected in the connection mode area, or can be freely selected by a user, but the source field in the source field area corresponds to the data in the master table, and the target field in the target field area corresponds to the data in the slave table. The increase and decrease area of the slave table is used for changing according to the change of the number of the source tables of the target data table, and the number of the slave tables is always decreased by one from the number of the source tables of the target data table.
The object field refers to field information for identifying the object data, and the field information may include feature information and location information of the object data, that is, the type and characteristics of the object data are identified through the feature information, and the database and the data table where the object data is located are identified through the location information. Similarly, the source field refers to field information for identifying the source data, and the field information may include characteristic information and location information of the source data, that is, the type and characteristics of the source data are identified by the characteristic information, and the database and the data table where the source data is located are identified by the location information.
Specifically, a data configuration request for the target data sent by the data customizing device 2 is received, a target field of the target data is analyzed according to the data configuration request, and the feature information and the position information of the target data can be identified through the target field.
S150, displaying the table structure configuration interface.
Fig. 6 is a schematic diagram of a table structure configuration interface of the data customization device according to the embodiment of the present application. The table structure configuration interface includes: a source field area, a target field area, a comment area, a target field type area, a main key area and an operation area; the source field area is used for setting a source field of the source data table; the target field area is used for setting a target field of the target data table; the comment area is used for remarking and explaining the content in the target field; the target field type area is used for setting a target field type of the target data; the main key represents an identification code of a data table, corresponds to the target field and can be selected by a user according to requirements; the operation area is mainly used for deleting the matching condition between the source data table and the target data table which is not needed. I.e. matching the target field with the content of the source data in the source data table in station 1 in the data based on the target field, the type of target field and whether the primary key is used or not.
Further, in one embodiment, the target field is matched with the content of a target data table in the data center 1, and the target field is matched with the content of the target data table in the data center based on the target field, the target field type and the manner of checking the primary key; in another embodiment, the target field is matched with the content of a target data table in the data center station, and the target field is matched with the content of the target data table in the data center station in a mode of not checking the primary key based on the target field and the target field type.
The target data table comprises a plurality of fields and a plurality of field values of the target data, the fields represent attributes of the target data, and the field values are actual values corresponding to the attributes.
Further, some fields in the target data table, which serve as configuration conditions of a subsequent configuration interface, are set as configuration condition fields, and some fields in the target data table, which serve as configuration results of the subsequent configuration interface, are set as configuration result fields.
Specifically, a field in the target data table, which is required to be used as a configuration condition in a subsequent configuration interface, is configured as a configuration condition field, and a field, which is displayed as a configuration result, is used as a configuration result field, so that configuration parameters corresponding to the target data table are configured.
Specifically, configuration parameters are loaded on the general configuration interface, the configuration condition field is used as a field of the configuration condition to generate a configuration control, and the configuration result field is used as a field for displaying the configuration result to generate a display control, that is, the configuration control and the display control are generated through the general configuration interface, so that the general configuration interface generates a data configuration interface.
S160, receiving a table structure configuration operation through the table structure configuration interface, and generating a table structure parameter of the target data table according to the table structure configuration operation; the table structure parameter includes an association relationship between a content field of the target data table and a content field of the source data table.
Specifically, the table structure parameters include a target field of the target data table, a target field type of the target data table, and an association relationship between a primary key of the target data table and a source field of the target data table; receiving a table structure configuration operation through the table structure configuration interface, and generating a table structure parameter of the target data table according to the table structure configuration operation; the table structure parameter includes an association relationship between a target field of the target data table and a target field of the target data table, and includes: receiving a table structure configuration operation of a target field of the target data table through the table structure configuration interface, and generating a table structure parameter of the target field of the target data table according to the table structure configuration operation of the target field of the target data table; receiving a table structure configuration operation of a target field type of the target data table through the table structure configuration interface, and generating a table structure parameter of the target field type of the target data table according to the table structure configuration operation of the target field type of the target data table; and receiving the table structure configuration operation of the primary key of the target data table through the table structure configuration interface, and generating the table structure parameter of the primary key of the target data table according to the table structure configuration operation of the primary key of the target data table.
S170, processing the data in the source data table according to the table structure parameters of the target data table to obtain the target data table.
Specifically, the step of processing the data in the source data table according to the table structure parameter of the target data table to obtain the target data table includes: judging whether the target data table exists in the source data table or not according to the table structure parameters of the target data table; if the target data table exists in the source data table, processing the data in the source data table to obtain the target data table; and if the target data table does not exist in the source data table, creating the target data table in the source data table according to the relevant configuration and table structure definition of the target data table.
Further, displaying a target data table attribute configuration interface; before the step of receiving the target data table attribute configuration operation through the target data table attribute configuration interface and generating the table attribute parameters of the target data table according to the target data table attribute configuration operation, the method further includes:
displaying a data field creation interface;
and receiving attribute creating operation of a user login information table through the data domain creating interface, and generating table attribute parameters of the user login information table according to the attribute creating operation of the user login information table.
Referring to fig. 7, an interface schematic diagram for creating a data field of the data customizing device according to the embodiment of the present application is shown. The system comprises a data field, a data warehouse of a plurality of different application scenes and a source data table containing the plurality of different application scenes. Before the data center station 1 configures the source data table and the target data table, the user needs to complete the configuration of the target data after defining the data domain name and the data domain. In particular, the data fields represent a variety of different types of scenes, such as traffic systems, shopping malls, supermarkets, and so forth; the data domain name represents a specific data domain name in each of the different types of scenarios.
Further, displaying a target data table attribute configuration interface; before the step of receiving the attribute configuration operation of the target data table through the attribute configuration interface of the target data table and generating the table attribute parameters of the target data table according to the attribute configuration operation of the target data table, the method further comprises the following steps:
displaying a business process creation interface;
and receiving attribute creating operation of a user retrieval information table through the business process creating interface, and generating table attribute parameters of the user retrieval information table according to the attribute creating operation of the user retrieval information table.
Referring to fig. 8, a schematic diagram of a service process creation interface of the data customization device provided in the embodiment of the present application is shown. The business process refers to specific data information related to corresponding activities and actions in a certain data domain range. For example, in a supermarket on the internet system (the supermarket on the internet system is a data field herein), the corresponding actions include: user login, user search, user ordering, and receipt confirmation, etc. When the business process selects to be user login, the search range of the source data table in the station 1 in the data is limited to search only the source data table related to user login at different time periods in the database, and the source data table may include: specific information such as a user login account number, a host used by the user login account number, login time, a login channel and the like; when the business process is selected as user ordering, the search range of the source data table in the station 1 in the data is limited to only search the source data table related to pressing user ordering at different time periods in the database, and the source data table may include: the user order-placing account number and the used host computer, the order-placing time, the order-placing channel and other specific information.
Further, displaying a target data table attribute configuration interface; before the step of receiving the attribute configuration operation of the target data table through the attribute configuration interface of the target data table and generating the table attribute parameters of the target data table according to the attribute configuration operation of the target data table, the method further comprises the following steps:
a presentation form type creation interface;
and receiving attribute creating operation of the user ordering information table through the table type creating interface, and generating table attribute parameters of the user ordering information table according to the attribute creating operation of the user ordering information table.
Referring to fig. 9, a schematic diagram of a main table design interface of the data customization device according to the embodiment of the present application is shown. In one embodiment, the table types include dimension tables and detail fact tables; the English name of the dimension table is dim; the English name of the detail fact table is dwd.
It is understood that the detailed fact table is a general table associating various information under one data field; the dimension table is a sub-table for specifically subdividing each different information in the detail fact table, and when the user uses the dimension table, the detail fact table is associated with the dimension table by searching the key content field, so that the required information can be accurately and quickly acquired, and redundant information is removed.
Further, before receiving a data configuration request sent by the data customizing device 2, where the data configuration request carries an application identifier and a user identifier of target data, and the data configuration request includes a target field of a preset mapping relationship, and the data configuration request is generated by the data customizing device 2 when a target data table needs to be customized, the method further includes: and monitoring the updating and synchronizing conditions of all data by adopting data monitoring.
Specifically, a target data table corresponding to the target data is bound with the data configuration interface, so that the configuration control of the data configuration interface can configure the configuration condition field of the target data table, and the display control of the data configuration interface can display the configuration result field of the target data table.
Specifically, the target field is identification information for identifying the target data, and the embodiment of the present application sets a corresponding relationship between the target field and the target data table in advance, that is, the target data table corresponding to the target data can be determined by the target field.
In all of the above interfaces, the size of each of the different regions is not limited, nor is it fixed. The user can adjust the size of each area to a certain extent according to the use requirement of the user, but each area range always exists.
An embodiment of the present application provides a data management apparatus, including: the data customizing device and the data center station; the data customization equipment is used for displaying a target data table attribute configuration interface, receiving the target data table attribute configuration operation through the target data table attribute configuration interface, and generating a table attribute parameter of the target data table according to the target data table attribute configuration operation; the data customization equipment is also used for displaying a source data table attribute configuration interface, receiving source data table attribute configuration operation through the source data table attribute configuration interface, and generating source table attribute parameters of the source data table corresponding to the target data table according to the source data table attribute configuration operation; the data customization equipment is also used for displaying a table structure configuration interface, receiving table structure configuration operation through the table structure configuration interface and generating table structure parameters of the target data table according to the table structure configuration operation; the table structure parameters comprise the association relationship between the content field of the target data table and the content field of the source data table; and the data center station processes the data in the source data table according to the table structure parameters of the target data table to obtain the target data table.
In the above embodiment, the data management device provided by the invention can reduce the use difficulty of the user, avoid the user who cannot program the data management device from being unable to use the data management device, thereby not only expanding the use range of the user, but also improving the efficiency of data synchronization in the data warehouse.
In summary, for the specific limitations of the data management apparatus, reference may be made to the limitations of the data management method above, and details are not repeated here. The modules in the data management device can be wholly or partially implemented by software, hardware and a combination thereof. The modules can be embedded in a hardware form or independent of a second processor in the computer device, or can be stored in a second memory in the computer device in a software form, so that the second processor can call and execute operations corresponding to the modules.
In one embodiment, the present application further provides a computer device, which may be a data customization device, and its internal structure diagram may be as shown in fig. 10. The computer device includes a processor, a memory, a communication interface, a display screen, and an input device connected by a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The communication interface of the computer device is used for carrying out wired or wireless communication with external data customization devices, and the wireless communication can be realized through WIFI, an operator network, NFC (near field communication) or other technologies. The computer program is executed by a processor to implement a data management method. The display screen of the computer equipment can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer equipment can be a touch layer covered on the display screen, a key, a track ball or a touch pad arranged on the shell of the computer equipment, an external keyboard, a touch pad or a mouse and the like.
Those skilled in the art will appreciate that the architecture shown in fig. 10 is merely a block diagram of some of the structures associated with the disclosed aspects and is not intended to limit the computing devices to which the disclosed aspects apply, as particular computing devices may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.
In the foregoing embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.
It will be understood by those skilled in the art that all or part of the steps of the methods of the above embodiments may be performed by instructions or by hardware related to control of the instructions, which may be stored in a computer device and loaded and executed by a processor.
The present application further provides a server, and in an embodiment, referring to fig. 11, fig. 11 is a schematic structural diagram of the server provided in the embodiment of the present application, where the server includes a processor 101, a memory 102, a bus 103 (connected to a system bus in the computer device), and a computer program stored on the memory 102 and operable on the processor 101, where the processor 101 and the memory 102 complete communication with each other through the bus 103; the memory 102 stores program instructions executable by the processor 101, and the memory processor implements the data management method of any one of the above when executing the computer program, including: displaying a target data table attribute configuration interface; receiving the attribute configuration operation of the target data table through the attribute configuration interface of the target data table, and generating table attribute parameters of the target data table according to the attribute configuration operation of the target data table; displaying a source data table attribute configuration interface; receiving a source data table attribute configuration operation through the source data table attribute configuration interface, and generating a source table attribute parameter of the source data table corresponding to the target data table according to the source data table attribute configuration operation; displaying a table structure configuration interface; receiving a table structure configuration operation through the table structure configuration interface, and generating a table structure parameter of the target data table according to the table structure configuration operation; the table structure parameters comprise the incidence relation between the target field of the target data table and the content field of the source data table; and processing the data in the source data table according to the table structure parameters of the target data table to obtain the target data table.
Wherein, the memory and the second memory may include: read Only Memory (ROM), Random Access Memory (RAM), magnetic or optical disks, and the like.
Since the instructions stored in the first memory can execute the steps in any of the methods provided in the embodiments of the present application, the advantageous effects that can be achieved by any of the methods provided in the embodiments of the present application can be achieved, for details, see the foregoing embodiments, and are not described herein again.
The data management method, the data management device, and the data management server provided in the embodiments of the present application are described in detail above, and a specific example is applied in the description to explain the principle and the implementation of the present application, and the description of the embodiments above is only used to help understand the technical solution and the core idea of the present application; those of ordinary skill in the art will understand that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; such modifications or substitutions do not depart from the spirit and scope of the present disclosure as defined by the appended claims.
Claims (10)
1. A method for managing data, comprising:
displaying a target data table attribute configuration interface;
receiving the attribute configuration operation of the target data table through the attribute configuration interface of the target data table, and generating table attribute parameters of the target data table according to the attribute configuration operation of the target data table;
displaying a source data table attribute configuration interface;
receiving a source data table attribute configuration operation through the source data table attribute configuration interface, and generating a source table attribute parameter of the source data table corresponding to the target data table according to the source data table attribute configuration operation;
displaying a table structure configuration interface;
receiving a table structure configuration operation through the table structure configuration interface, and generating a table structure parameter of the target data table according to the table structure configuration operation; the table structure parameters comprise the incidence relation between the target field of the target data table and the content field of the source data table;
and processing the data in the source data table according to the table structure parameters of the target data table to obtain the target data table.
2. The data management method of claim 1, wherein the presentation target data table property configuration interface; receiving the target data table attribute configuration operation through the target data table attribute configuration interface, and generating the table attribute parameters of the target data table according to the target data table attribute configuration operation, wherein the step comprises the following steps:
displaying a target data table attribute configuration interface, wherein the target data table attribute configuration interface comprises a database address setting area, a table name setting area and a table type setting area;
receiving the address attribute configuration operation of the target data table through the database address setting area, and generating the address table attribute parameters of the target data table according to the address attribute configuration operation of the target data table;
receiving a table name attribute configuration operation of the target data table through the table name setting area, and generating a table name attribute parameter of the target data table according to the table name attribute configuration operation of the target data table;
and receiving the table type attribute configuration operation of the target data table through the table type setting area, and generating the table type attribute parameters of the target data table according to the table type attribute configuration operation of the target data table.
3. The data management method of claim 1, wherein the presentation source data table property configuration interface; receiving a source data table attribute configuration operation through the source data table attribute configuration interface, and generating a source table attribute parameter of the source data table corresponding to the target data table according to the source data table attribute configuration operation, wherein the step comprises the following steps:
displaying the source data table attribute configuration interface, wherein the source data table attribute configuration interface comprises a source database address setting area and a source data table name setting area;
receiving a source database address table attribute configuration operation through the source database address setting area interface, and generating a source address table attribute parameter of the source data table corresponding to the target data table according to the source database address table attribute configuration operation;
and receiving table name table attribute configuration operation of the source data table through the table name setting area interface of the source data table, and generating source table name attribute parameters of the source data table corresponding to the target data table according to the table name table attribute configuration operation of the source data table.
4. The data management method according to claim 1, wherein when the number of the source tables of the source data table is greater than one, a source data table attribute configuration interface is displayed; after the step of receiving the attribute configuration operation of the source data table through the attribute configuration interface of the source data table and generating the source table attribute parameters of the source data table corresponding to the target data table according to the attribute configuration operation of the source data table, the method comprises the following steps:
displaying a connection mode configuration interface of a plurality of source data tables, wherein the plurality of source data tables comprise a master table and at least one slave table;
and acquiring the user identifications of the source data tables according to the incidence relation between the attributes of the master table and the attributes of the slave table.
5. The data management method according to claim 4, wherein the step of obtaining the user identifiers of the source data tables through the association relationship between the master table attribute and the slave table attribute comprises:
and acquiring the user identifications of the source data tables through the association relationship between the source field of the master table and the target field of the slave table.
6. The data management method of claim 1, wherein the table structure parameters comprise a target field of the target data table, a target field type of the target data table, and an association relationship between a primary key of the target data table and a source field of the source data table; receiving a table structure configuration operation through the table structure configuration interface, and generating a table structure parameter of the target data table according to the table structure configuration operation; the table structure parameter includes an association relationship between the content field of the target data table and the content field of the source data table, and includes:
receiving a table structure configuration operation of a target field of the target data table through the table structure configuration interface, and generating a table structure parameter of the target field of the target data table according to the table structure configuration operation of the target field of the target data table;
receiving a table structure configuration operation of a target field type of the target data table through the table structure configuration interface, and generating a table structure parameter of the target field type of the target data table according to the table structure configuration operation of the target field type of the target data table;
and receiving the table structure configuration operation of the primary key of the target data table through the table structure configuration interface, and generating the table structure parameter of the primary key of the target data table according to the table structure configuration operation of the primary key of the target data table.
7. The data management method according to claim 6, wherein the step of receiving a table structure configuration operation of a target field type of the target data table through the table structure configuration interface and generating a table structure parameter of the target field type of the target data table according to the table structure configuration operation of the target field type of the target data table comprises:
through the table structure configuration interface, after the table structure parameters of the target field of the target data table are obtained, the table structure configuration operation of the target field type of the target data table corresponding to the target data table is directly generated according to the table structure parameters of the target field of the target data table, and then the table structure parameters of the target field type of the target data table are generated according to the table structure configuration operation of the target field type of the target data table;
or, after the table structure parameters of the target field of the target data table are acquired through the table structure configuration interface, selecting the table structure configuration operation of the target field type of the target data table corresponding to the target data table according to the table structure parameters of the target field of the target data table, and then generating the table structure parameters of the target field type of the target data table according to the table structure configuration operation of the target field type of the target data table.
8. The data management method according to claim 1, wherein the step of processing the data in the target data table according to the table structure parameter of the target data table to obtain the target data table comprises:
judging whether the target data table exists in the source data table or not according to the table structure parameters of the target data table;
if the target data table exists in the source data table, processing the data in the target data table to obtain the target data table;
and if the target data table does not exist in the source data table, creating the target data table in the target data table according to the relevant configuration and table structure definition of the target data table.
9. A data management apparatus, comprising: the data customizing device and the data center station;
the data customization equipment is used for displaying a target data table attribute configuration interface, receiving the target data table attribute configuration operation through the target data table attribute configuration interface and generating a table attribute parameter of the target data table;
the data customization equipment is further used for displaying a source data table attribute configuration interface, receiving a source data table attribute configuration operation through the source data table attribute configuration interface, and generating a source table attribute parameter of the source data table corresponding to the target data table;
the data customization equipment is also used for displaying a table structure configuration interface, receiving table structure configuration operation through the table structure configuration interface and generating table structure parameters of the target data table; the table structure parameters comprise the association relationship between the content field of the target data table and the content field of the source data table;
and the data center station processes the data in the source data table according to the table structure parameters of the target data table to obtain the target data table.
10. A server, comprising: the system comprises a processor, a memory, a bus and a computer program which is stored on the memory and can run on the processor, wherein the processor and the memory are communicated with each other through the bus; the memory processor, when executing the computer program, implements the data management method of any of claims 1 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011182233.XA CN112000746B (en) | 2020-10-29 | 2020-10-29 | Data management method and device and server |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011182233.XA CN112000746B (en) | 2020-10-29 | 2020-10-29 | Data management method and device and server |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112000746A true CN112000746A (en) | 2020-11-27 |
| CN112000746B CN112000746B (en) | 2021-01-19 |
Family
ID=73475806
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011182233.XA Active CN112000746B (en) | 2020-10-29 | 2020-10-29 | Data management method and device and server |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112000746B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113590593A (en) * | 2021-08-04 | 2021-11-02 | 浙江大华技术股份有限公司 | Method and device for generating data table information, storage medium and electronic device |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101222410A (en) * | 2008-01-22 | 2008-07-16 | 张建中 | Neighborhood-resource discovering method, device and system |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6009440A (en) * | 1997-09-19 | 1999-12-28 | Mci Communications Corporation | Method and system for automatic object refresh |
| CN101452481A (en) * | 2008-12-04 | 2009-06-10 | 金蝶软件（中国）有限公司 | Method and system for processing document |
| CN101702152A (en) * | 2009-10-28 | 2010-05-05 | 金蝶软件（中国）有限公司 | Intelligent data processing method, device and system |
| CN102024215A (en) * | 2011-01-22 | 2011-04-20 | 华东电网有限公司 | Method for publishing customizable trading information in power market |
| CN103778154B (en) * | 2012-10-24 | 2017-08-08 | 金蝶软件（中国）有限公司 | The retrography method and device of form attributes |
| CN106293712B (en) * | 2016-08-01 | 2019-06-25 | 浪潮金融信息技术有限公司 | A kind of implementation method of report processing cube model |
| CN107861926A (en) * | 2016-12-28 | 2018-03-30 | 平安科技（深圳）有限公司 | Document template configuration method and device |
-
2020
- 2020-10-29 CN CN202011182233.XA patent/CN112000746B/en active Active
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101222410A (en) * | 2008-01-22 | 2008-07-16 | 张建中 | Neighborhood-resource discovering method, device and system |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113590593A (en) * | 2021-08-04 | 2021-11-02 | 浙江大华技术股份有限公司 | Method and device for generating data table information, storage medium and electronic device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112000746B (en) | 2021-01-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20230088945A1 (en) | Systems, Methods, and Computer Program Products for Providing Data Use Options | |
| US11935068B1 (en) | Methods and apparatus for mobile device messaging-based communications using custom-generated deeplinks and based on the hyper text transfer protocol (HTTP) | |
| WO2022110694A1 (en) | Commodity processing method and component, electronic device, and computer-readable medium | |
| CN109791562A (en) | Interaction is applied after improving installation | |
| US10437440B2 (en) | Analytic data export tool | |
| WO2021183219A1 (en) | System for custom validations and scripts for mobile applications | |
| US11706585B2 (en) | Location based mobile messaging shopping network | |
| US10783010B2 (en) | Offline briefcase synchronization | |
| US20200126148A1 (en) | System and method for management and delivery of shoppable content data | |
| US10963946B2 (en) | Mixed cart solution for an in-store app | |
| CN112000746B (en) | Data management method and device and server | |
| CN108874836B (en) | Method and device for transferring electronic ticket | |
| AU2016215472A1 (en) | Universal business procurement | |
| JP2023507694A (en) | Merchandise processing methods and components, electronic devices, computer readable media | |
| JP2023516835A (en) | Systems and methods for cosmetic product retail displays | |
| CN113450170A (en) | Information display method and device | |
| US11763257B1 (en) | Group inventory management for a network traffic surge resistant platform | |
| CA2833699A1 (en) | Method and system for interfacing multiple retailer systems and multiple carrier systems in the requisition of telecommunication products for clients of the retailers | |
| CN108831012B (en) | Vending method and device of vending machine | |
| US11282118B2 (en) | Order management user interface | |
| TWI837492B (en) | Information processing system, information processing method, program and recording medium | |
| US20240020752A1 (en) | Inventory management system protection for network traffic surge resistant platform | |
| US11334849B2 (en) | Systems and methods for cosmetics products retail displays | |
| US11157989B2 (en) | Merchant-side integrated shopping cart recovery | |
| US10592309B2 (en) | Using smart data to forecast and track dual stage events |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |