CN116126818A - Retail data synchronization method, device, electronic equipment and computer readable medium - Google Patents

Retail data synchronization method, device, electronic equipment and computer readable medium Download PDF

Info

Publication number
CN116126818A
CN116126818A CN202310079292.1A CN202310079292A CN116126818A CN 116126818 A CN116126818 A CN 116126818A CN 202310079292 A CN202310079292 A CN 202310079292A CN 116126818 A CN116126818 A CN 116126818A
Authority
CN
China
Prior art keywords
data
retail
configuration information
analysis
user configuration
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202310079292.1A
Other languages
Chinese (zh)
Inventor
张建军
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Multipoint Shenzhen Digital Technology Co ltd
Original Assignee
Multipoint Shenzhen Digital Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Multipoint Shenzhen Digital Technology Co ltd filed Critical Multipoint Shenzhen Digital Technology Co ltd
Priority to CN202310079292.1A priority Critical patent/CN116126818A/en
Publication of CN116126818A publication Critical patent/CN116126818A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/17Details of further file system functions
    • G06F16/178Techniques for file synchronisation in file systems

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Cash Registers Or Receiving Machines (AREA)

Abstract

Embodiments of the present disclosure disclose retail data synchronization methods, apparatus, electronic devices, and computer readable media. One embodiment of the method comprises the following steps: acquiring retail user configuration information and retail business data configuration information to obtain a retail user configuration information set and retail business data configuration information; acquiring a remote server file from an initial data platform according to each retail user configuration information in the retail user configuration information set; carrying out data analysis processing on retail business data to be synchronized in a remote server file by utilizing retail business data configuration information to obtain an analysis data set; and publishing each piece of analysis data in the analysis data set to a corresponding service system in the target data platform. This implementation can improve synchronization efficiency and ensure data security.

Description

Retail data synchronization method, device, electronic equipment and computer readable medium
Technical Field
Embodiments of the present disclosure relate to the field of computer technology, and in particular, to a retail data synchronization method, apparatus, electronic device, and computer readable medium.
Background
Retail data synchronization is a technique for synchronizing retail data in a current data platform to a target data platform. Currently, in performing retail data synchronization, the following methods are generally adopted: manually exporting retail data from a current data platform and importing the retail data into a target data platform; or the retail data synchronization function is realized in the target data platform, so that retail data is grabbed in the current data platform to realize retail data synchronization.
However, when retail data synchronization is performed in the above manner, there are often the following technical problems:
firstly, retail data synchronization is performed manually, data leakage can be caused, and meanwhile, the workload is large, the time consumption is long, and the error rate is high;
secondly, the retail data synchronization function is independently realized in each target data platform, the development difficulty and the consumption are high, and the data processed by each target data platform is possibly inconsistent.
Third, there may be a difference between fields in different data platforms, which may cause errors in the synchronized data if the mapping of the fields between the two data platforms is inaccurate, resulting in difficulty in normal operation of the service in the target data platform.
Disclosure of Invention
The disclosure is in part intended to introduce concepts in a simplified form that are further described below in the detailed description. The disclosure is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used to limit the scope of the claimed subject matter.
Some embodiments of the present disclosure propose retail data synchronization methods, apparatuses, and electronic devices to address one or more of the technical problems mentioned in the background section above.
In a first aspect, some embodiments of the present disclosure provide a retail data synchronization method comprising: acquiring retail user configuration information and retail business data configuration information to obtain a retail user configuration information set and retail business data configuration information; acquiring a remote server file from an initial data platform according to each retail user configuration information in the retail user configuration information set, wherein the remote server file comprises retail business data to be synchronized; carrying out data analysis processing on the retail business data to be synchronized in the remote server file by utilizing the retail business data configuration information to obtain an analysis data set; and publishing each piece of analysis data in the analysis data set to a corresponding service system in the target data platform.
In a second aspect, some embodiments of the present disclosure provide a retail data synchronization device, the device comprising: the first acquisition unit is configured to acquire retail user configuration information and retail business data configuration information to obtain a retail user configuration information set and retail business data configuration information; a second obtaining unit configured to obtain a remote server file from the initial data platform according to each retail user configuration information in the retail user configuration information set, wherein the remote server file includes retail business data to be synchronized; the analysis unit is configured to perform data analysis processing on the retail business data to be synchronized in the remote server file by using the retail business data configuration information set to obtain an analysis data set; and the issuing unit is configured to issue each piece of analysis data in the analysis data set to a corresponding service system in the target data platform.
In a third aspect, some embodiments of the present disclosure provide an electronic device comprising: one or more processors; a storage device having one or more programs stored thereon, which when executed by one or more processors causes the one or more processors to implement the method described in any of the implementations of the first aspect above.
In a fourth aspect, some embodiments of the present disclosure provide a computer readable medium having a computer program stored thereon, wherein the program, when executed by a processor, implements the method described in any of the implementations of the first aspect above.
The above embodiments of the present disclosure have the following advantageous effects: the retail data synchronization method of some embodiments of the present disclosure can be applied to retail data synchronization between data platforms, and can improve the efficiency of retail data synchronization. Specifically, the reasons for long time consumption, high error rate, difficulty in development and large consumption are as follows: retail data synchronization is performed manually, or retail data synchronization functions are implemented individually in each target data platform. Based on this, retail data synchronization methods of some embodiments of the present disclosure first acquire retail user configuration information and retail business data configuration information, resulting in a retail user configuration information set and retail business data configuration information. And then, acquiring a remote server file from the initial data platform according to each retail user configuration information in the retail user configuration information set, wherein the remote server file comprises retail business data to be synchronized. And then, carrying out data analysis processing on the retail business data to be synchronized in the remote server file by utilizing the retail business data configuration information to obtain an analysis data set. Therefore, the data analysis processing of the retail business data to be synchronized can be realized by utilizing the retail business data configuration information. No human involvement is required and no separate development of retail data synchronization functions is required. And finally, each piece of analysis data in the analysis data set is issued to a corresponding service system in the target data platform. Therefore, the retail data synchronization method of some embodiments of the present disclosure not only can realize automatic retail data synchronization, avoid manual participation, improve synchronization efficiency and ensure data security, but also can be suitable for retail data synchronization between each data platform.
Drawings
The above and other features, advantages, and aspects of embodiments of the present disclosure will become more apparent by reference to the following detailed description when taken in conjunction with the accompanying drawings. The same or similar reference numbers will be used throughout the drawings to refer to the same or like elements. It should be understood that the figures are schematic and that elements and components are not necessarily drawn to scale.
FIG. 1 is a flow chart of some embodiments of a retail data synchronization method according to the present disclosure;
FIG. 2 is a schematic diagram of some embodiments of a retail data synchronization device of the present disclosure;
fig. 3 is a schematic structural diagram of an electronic device suitable for use in implementing some embodiments of the present disclosure.
Detailed Description
Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While certain embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete. It should be understood that the drawings and embodiments of the present disclosure are for illustration purposes only and are not intended to limit the scope of the present disclosure.
It should be noted that, for convenience of description, only the portions related to the present invention are shown in the drawings. Embodiments of the present disclosure and features of embodiments may be combined with each other without conflict.
It should be noted that the terms "first," "second," and the like in this disclosure are merely used to distinguish between different devices, modules, or units and are not used to define an order or interdependence of functions performed by the devices, modules, or units.
It should be noted that references to "one", "a plurality" and "a plurality" in this disclosure are intended to be illustrative rather than limiting, and those of ordinary skill in the art will appreciate that "one or more" is intended to be understood as "one or more" unless the context clearly indicates otherwise.
The names of messages or information interacted between the various devices in the embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of such messages or information.
The present disclosure will be described in detail below with reference to the accompanying drawings in conjunction with embodiments.
Fig. 1 illustrates a flow 100 of some embodiments of a retail data synchronization method according to the present disclosure. The retail data synchronization method comprises the following steps:
step 101, acquiring retail user configuration information and retail business data configuration information to obtain a retail user configuration information set and retail business data configuration information.
In some embodiments, the execution body of the retail data synchronization method may obtain retail user configuration information and retail business data configuration information, resulting in a retail user configuration information set and retail business data configuration information. Wherein, the retail user configuration information in the retail user configuration information set may include: whether or not data, a synchronization manner, a file name, a file type, and a synchronization frequency are required. The retail business data configuration information may include: a set of data field types, a set of data field mapping information.
The synchronization manner in the user configuration information may include, but is not limited to: active call and passive receiving. The file name may be the name of the file for which retail data synchronization is desired. Retail data synchronization may be an operation of transferring data stored in a current data platform into a target data platform. The file type may be the type of file that is required for retail data synchronization. The synchronization frequency may be the frequency at which retail data synchronization operations are performed. The data field mapping information in the data field mapping information set may characterize a matching correspondence between original field information in the current data platform and target field information in the target data platform.
In some optional implementations of some embodiments, before the acquiring the retail user configuration information and the retail business data configuration information, the executing body may further execute the following steps:
the method comprises the steps of firstly, inputting an original field information set and a target field information set into each field matching model in a field matching model set to generate at least one field matching information pair, and obtaining a field matching information pair set. Wherein, each field matching information pair in the field matching information pair set comprises a pair of original field information and target field information which are matched with each other. The original field information and the target field information in the original field information set and the target field information set may include: field name, data type, field length, null support.
And secondly, grouping the field matching information pairs in the field matching information pair set according to the difference of original field information in the field matching information pair to obtain at least one field matching information pair subset.
Third, for each of the at least one subset of field matching information pairs, performing the following data field mapping information determining step:
a first sub-step of determining the category number of the target field information in each field matching information pair in the field matching information pair.
And a second sub-step of determining any field matching information pair in the subset of field matching information pair as data field mapping information in response to determining that the category number is one.
And a third sub-step, in response to determining that the category number is greater than one and less than a preset value, classifying the field matching information pairs in the field matching information subset according to the difference of the target field information in the field matching information pairs to obtain a field matching information pair group set. And determining any field matching information pair in the field matching information pair group meeting the first preset condition in the field matching information pair group set as data field mapping information. The first preset condition may be that the number of field matching information pairs included in the field matching information pair group is the largest.
In practice, the preset values may be set according to practical application requirements, which is not limited herein. As an example, the preset value may be 3.
Optionally, the executing body may further execute the following steps:
in the first step, in response to determining that the category number is greater than or equal to the preset value, classifying the field matching information pairs in the field matching information subset according to the difference of target field information in the field matching information pairs to obtain a field matching information pair group set.
And a second step of selecting one field matching information pair from each field matching information pair group of the field matching information pair group set as a pending field matching information pair to obtain a pending field matching information pair set.
And thirdly, transmitting the set of the undetermined field matching information pairs to a target terminal.
And step four, receiving reply information of the set of the undetermined field matching information pair sent by the target terminal.
And fifthly, determining reply field matching information included in the reply information as data field mapping information.
And fifthly, in response to determining that undetermined field matching information matched with the reply field matching information included in the reply information does not exist in the undetermined field matching information pair set, adding the reply field matching information pair included in the reply information as a training field matching information pair into the training field matching information set, and updating a retraining count value. The retraining count value may be incremented by a preset step size.
Optionally, the executing body may further retrain each field matching model in the field matching model set by using the training field matching information set in response to determining that the retraining count value is equal to a preset count value, to obtain a retraining field matching model set, and determine the retraining field matching model set as a field matching model set.
In practice, the preset count value may be set according to actual application needs, which is not limited herein. As an example, the above-described preset count value may be 10.
The above steps are taken as an invention point of the embodiments of the present disclosure, and further solve the technical problem mentioned in the background art, that the fields in different data platforms may have differences, and if the field mapping between two data platforms is inaccurate, errors may occur in the synchronized data, so that the service in the target data platform is difficult to operate normally. Factors that cause the above technical problems are often as follows: the mapping of fields between two data platforms is inaccurate. If the above factors are solved, the effect of improving the data accuracy can be achieved. To achieve this effect, the present disclosure introduces a set of field matching models, matches an original set of field information with a target set of field information by a plurality of field matching models in the set of field matching models, and obtains a plurality of matching results. When the matching results obtained for the same original field information are the same, the matching result output by each field matching model can be used as final data field mapping information. If the matching results obtained for the same original field information are all different, the matching result with the largest number can be used as the final data field mapping information. Or sending the obtained various matching results to the target terminal for confirmation. Therefore, the field mapping relation can be accurately determined through the matching results of the field matching models, and the normal operation of the business in the target data platform is ensured.
Step 102, obtaining a remote server file from the initial data platform according to each retail user configuration information in the retail user configuration information set.
In some embodiments, the remote server file includes retail business data to be synchronized. The executing body may acquire the remote server file from the initial data platform according to each retail user configuration information in the retail user configuration information set, and may include the steps of:
and a first step of generating a data acquisition request according to the file name and the file type in response to determining whether the synchronous data is required. Wherein, the data acquisition request may include: file name and file type.
And a second step of transmitting the data acquisition request to the initial data platform through a first application programming interface in the synchronous frequency and the synchronous mode.
And thirdly, acquiring a remote server file returned by the initial data platform through a second application programming interface. Wherein the remote server file includes data matching a file name and a file type in the data acquisition request.
And 103, utilizing the retail business data configuration information set to perform data analysis processing on the retail business data to be synchronized in the remote server file, and obtaining an analysis data set.
In some embodiments, the executing body performs data analysis processing on the retail business data to be synchronized in the remote server file by using the retail business data configuration information set to obtain an analysis data set, and may include the following steps:
and the first step is to perform data filtering processing on the retail business data to be synchronized in the remote server file by using the data field type set to obtain a filtered business data set. The data filtering process may be selecting, from the retail business data to be synchronized in the remote server file, data having the same data type as any one of the data field types in the data field type set as the filtering business data.
And secondly, performing field mapping processing on the filtered service data in the filtered service data set by using the data field mapping information set to obtain a mapped service data set. The field mapping process may be to convert the field type of the service data into the field type of the target data platform by using the matching correspondence between the original field information in the current data platform and the target field information in the target data platform, which are represented by the data field mapping information, and the field type of the service data to obtain the mapped service data.
And thirdly, carrying out encapsulation processing on the mapping service data in the mapping service data set to obtain an encapsulation service data set. Wherein, the data format of the encapsulated service data in the encapsulated service data set is the same as the data format of the target data platform. The above-described encapsulation process may be a format conversion process.
And fourth, determining the encapsulation business data set as an analysis data set.
And 104, issuing each piece of analysis data in the analysis data set to a corresponding service system in the target data platform.
In some embodiments, the executing body issues each piece of resolved data in the resolved data set to a corresponding service system in the target data platform, and the method may include the following steps:
and the first step is to push the analysis data in the analysis data set to a message queue.
And secondly, according to the subscription information, publishing the analysis data in the information queue to a corresponding service system in the target data platform.
In some optional implementations of some embodiments, the executing body may further execute the following steps:
in the first step, in response to determining that the analysis data set has analysis data with failed release, the analysis data with failed release is stored in a target database. The target database is used for storing analysis data of release failure. The analysis data which is failed to be released can be analysis data which is not released to a corresponding service system in the target data platform within a preset time period.
And secondly, reissuing the analysis data stored in the target database.
Optionally, the re-publishing of the parsed data stored in the target database by the execution subject may include the following steps:
starting a thread from a thread pool to grab the analysis data in the target database to obtain retransmission analysis data.
And secondly, distributing the retransmission analysis data by using the started thread.
Optionally, the executing body may further execute the following steps:
in the first step, in response to determining that the analysis data meeting the preset conditions exist in the target database, the analysis data meeting the preset conditions is selected as abnormal analysis data, wherein the preset conditions are that the number of times of analysis data release failure is larger than the preset number of times.
In practice, the preset times may be set according to actual application needs, which is not limited herein. As an example, the preset number of times may be 3.
And secondly, acquiring log files of each release failure of the abnormal analysis data to obtain an abnormal log file set.
And thirdly, the abnormal log file set is sent to a target terminal.
And fourthly, responding to the received repair information returned by the target terminal, and performing repair processing on the abnormal analysis data by utilizing the repair information to obtain repair analysis data. The repair information may be format conversion processing, or incremental update information of the anomaly analysis data.
And fifthly, adding the repair analysis data into the target database again as analysis data.
The above embodiments of the present disclosure have the following advantageous effects: the retail data synchronization method of some embodiments of the present disclosure can be applied to retail data synchronization between data platforms, and can improve the efficiency of retail data synchronization. Specifically, the reasons for long time consumption, high error rate, difficulty in development and large consumption are as follows: retail data synchronization is performed manually, or retail data synchronization functions are implemented individually in each target data platform. Based on this, retail data synchronization methods of some embodiments of the present disclosure first acquire retail user configuration information and retail business data configuration information, resulting in a retail user configuration information set and retail business data configuration information. And then, acquiring a remote server file from the initial data platform according to each retail user configuration information in the retail user configuration information set, wherein the remote server file comprises retail business data to be synchronized. And then, carrying out data analysis processing on the retail business data to be synchronized in the remote server file by utilizing the retail business data configuration information to obtain an analysis data set. Therefore, the data analysis processing of the retail business data to be synchronized can be realized by utilizing the retail business data configuration information. No human involvement is required and no separate development of retail data synchronization functions is required. And finally, each piece of analysis data in the analysis data set is issued to a corresponding service system in the target data platform. Therefore, the retail data synchronization method of some embodiments of the present disclosure not only can realize automatic retail data synchronization, avoid manual participation, improve synchronization efficiency and ensure data security, but also can be suitable for retail data synchronization between each data platform.
With further reference to fig. 2, as an implementation of the method illustrated in the above figures, the present disclosure provides some embodiments of a retail data synchronization device, which correspond to those method embodiments illustrated in fig. 1, which may find particular application in a variety of electronic devices.
As shown in fig. 2, the retail data synchronization device 200 of some embodiments includes: a first acquisition unit 201, a second acquisition unit 202, a parsing unit 203, and a publication unit 204. Wherein, the first obtaining unit 201 is configured to obtain retail user configuration information and retail business data configuration information, and obtain a retail user configuration information set and retail business data configuration information; a second obtaining unit 202 configured to obtain a remote server file from the initial data platform according to each retail user configuration information in the retail user configuration information set, wherein the remote server file includes retail business data to be synchronized; an parsing unit 203 configured to perform data parsing processing on retail business data to be synchronized in the remote server file by using the retail business data configuration information to obtain a parsed data set; and the issuing unit 204 is configured to issue each piece of analysis data in the analysis data set to a corresponding service system in the target data platform.
It will be appreciated that the elements recited in retail data synchronization device 200 correspond to the various steps in the method described with reference to fig. 1. Thus, the operations, features, and benefits described above with respect to the method are equally applicable to the retail data synchronization device 200 and the units contained therein, and are not described in detail herein.
Referring now to fig. 3, a schematic diagram of an electronic device 300 suitable for use in implementing some embodiments of the present disclosure is shown. The electronic device shown in fig. 3 is merely an example and should not impose any limitations on the functionality and scope of use of embodiments of the present disclosure.
As shown in fig. 3, the electronic device 300 may include a processing means (e.g., a central processing unit, a graphics processor, etc.) 301 that may perform various suitable actions and processes in accordance with a program stored in a Read Only Memory (ROM) 302 or a program loaded from a storage means 308 into a Random Access Memory (RAM) 303. In the RAM303, various programs and data required for the operation of the electronic apparatus 300 are also stored. The processing device 301, the ROM 302, and the RAM303 are connected to each other via a bus 304. An input/output (I/O) interface 305 is also connected to bus 304.
In general, the following devices may be connected to the I/O interface 305: input devices 306 including, for example, a touch screen, touchpad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; an output device 307 including, for example, a Liquid Crystal Display (LCD), a speaker, a vibrator, and the like; and communication means 309. The communication means 309 may allow the electronic device 300 to communicate with other devices wirelessly or by wire to exchange data. While fig. 3 shows an electronic device 300 having various means, it is to be understood that not all of the illustrated means are required to be implemented or provided. More or fewer devices may be implemented or provided instead. Each block shown in fig. 3 may represent one device or a plurality of devices as needed.
In particular, according to some embodiments of the present disclosure, the processes described above with reference to flowcharts may be implemented as computer software programs. For example, some embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising program code for performing the method shown in the flow chart. In such embodiments, the computer program may be downloaded and installed from a network via communications device 309, or from storage device 308, or from ROM 302. The above-described functions defined in the methods of some embodiments of the present disclosure are performed when the computer program is executed by the processing means 301.
It should be noted that, the computer readable medium described in some embodiments of the present disclosure may be a computer readable signal medium or a computer readable storage medium, or any combination of the two. The computer readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples of the computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In some embodiments of the present disclosure, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In some embodiments of the present disclosure, however, the computer-readable signal medium may comprise a data signal propagated in baseband or as part of a carrier wave, with the computer-readable program code embodied therein. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, fiber optic cables, RF (radio frequency), and the like, or any suitable combination of the foregoing.
In some implementations, the clients, servers may communicate using any currently known or future developed network protocol, such as HTTP (HyperText Transfer Protocol ), and may be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), the internet (e.g., the internet), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future developed networks.
The computer readable medium may be contained in the electronic device; or may exist alone without being incorporated into the electronic device. The computer readable medium carries one or more programs which, when executed by the electronic device, cause the electronic device to: acquiring retail user configuration information and retail business data configuration information to obtain a retail user configuration information set and retail business data configuration information; acquiring a remote server file from an initial data platform according to each retail user configuration information in the retail user configuration information set, wherein the remote server file comprises retail business data to be synchronized; carrying out data analysis processing on the retail business data to be synchronized in the remote server file by utilizing the retail business data configuration information to obtain an analysis data set; and publishing each piece of analysis data in the analysis data set to a corresponding service system in the target data platform.
Computer program code for carrying out operations for some embodiments of the present disclosure may be written in one or more programming languages, including an object oriented programming language such as Java, smalltalk, C ++ and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computer (for example, through the Internet using an Internet service provider).
The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The units described in some embodiments of the present disclosure may be implemented by means of software, or may be implemented by means of hardware. The described units may also be provided in a processor, for example, described as: a processor includes a first acquisition unit, a second acquisition unit, a parsing unit, and a publication unit. Where the names of the units do not constitute a limitation on the unit itself in some cases, for example, the issue unit may also be described as a "parsed data issue unit".
The functions described above herein may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: a Field Programmable Gate Array (FPGA), an Application Specific Integrated Circuit (ASIC), an Application Specific Standard Product (ASSP), a system on a chip (SOC), a Complex Programmable Logic Device (CPLD), and the like.

Claims (9)

1. A retail data synchronization method, comprising:
acquiring retail user configuration information and retail business data configuration information to obtain a retail user configuration information set and retail business data configuration information;
acquiring a remote server file from an initial data platform according to each retail user configuration information in the retail user configuration information set, wherein the remote server file comprises retail business data to be synchronized;
carrying out data analysis processing on the retail business data to be synchronized in the remote server file by utilizing the retail business data configuration information to obtain an analysis data set;
and publishing each piece of analysis data in the analysis data set to a corresponding service system in the target data platform.
2. The method of claim 1, wherein the retail user configuration information in the set of retail user configuration information comprises: whether the data, the synchronization mode, the file name, the file type and the synchronization frequency are needed to be synchronized; and
the obtaining a remote server file from an initial data platform according to each retail user configuration information in the retail user configuration information set comprises:
generating a data acquisition request according to the file name and the file type in response to determining whether the synchronous data is needed;
sending the data acquisition request to the initial data platform in the synchronous frequency and the synchronous mode through a first application programming interface;
and acquiring a remote server file returned by the initial data platform through a second application programming interface.
3. The method of claim 1, wherein the retail business data configuration information includes: a data field type set, a data field mapping information set; and
and carrying out data analysis processing on the retail business data to be synchronized in the remote server file by utilizing the retail business data configuration information to obtain an analysis data set, wherein the analysis data set comprises the following steps:
performing data filtering processing on retail business data to be synchronized in the remote server file by using the data field type set to obtain a filtered business data set;
performing field mapping processing on the filtered service data in the filtered service data set by using the data field mapping information set to obtain a mapped service data set;
carrying out encapsulation processing on the mapping service data in the mapping service data set to obtain an encapsulation service data set, wherein the data format of the encapsulation service data in the encapsulation service data set is the same as the data format of the target data platform;
and determining the encapsulated service data set as an analysis data set.
4. The method of claim 1, wherein said publishing each piece of resolved data in the resolved dataset to a corresponding business system in a target data platform comprises:
pushing the analysis data in the analysis data set to a message queue;
and according to the subscription information, publishing the analysis data in the information queue to a corresponding service system in the target data platform.
5. The method of claim 1, wherein the method further comprises:
responding to the fact that the analysis data with the release failure exist in the analysis data set, and storing the analysis data with the release failure into a target database, wherein the target database is used for storing the analysis data with the release failure;
and reissuing the analysis data stored in the target database.
6. The method of claim 5, wherein the reissuing the parsed data stored in the target database comprises:
starting a thread from a thread pool to grab the analysis data in the target database to obtain retransmission analysis data;
and issuing the retransmission analysis data by using the started thread.
7. A retail data synchronization device, comprising:
the first acquisition unit is configured to acquire retail user configuration information and retail business data configuration information to obtain a retail user configuration information set and retail business data configuration information;
a second obtaining unit configured to obtain a remote server file from an initial data platform according to each retail user configuration information in the retail user configuration information set, wherein the remote server file comprises retail business data to be synchronized;
the analysis unit is configured to utilize the retail business data configuration information to perform data analysis processing on the retail business data to be synchronized in the remote server file to obtain an analysis data set;
and the issuing unit is configured to issue each piece of analysis data in the analysis data set to a corresponding service system in the target data platform.
8. An electronic device, comprising:
one or more processors;
a storage device having one or more programs stored thereon,
when executed by the one or more processors, causes the one or more processors to implement the method of any of claims 1-6.
9. A computer readable medium having stored thereon a computer program, wherein the program when executed by a processor implements the method of any of claims 1-6.
CN202310079292.1A 2023-01-16 2023-01-16 Retail data synchronization method, device, electronic equipment and computer readable medium Pending CN116126818A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310079292.1A CN116126818A (en) 2023-01-16 2023-01-16 Retail data synchronization method, device, electronic equipment and computer readable medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310079292.1A CN116126818A (en) 2023-01-16 2023-01-16 Retail data synchronization method, device, electronic equipment and computer readable medium

Publications (1)

Publication Number Publication Date
CN116126818A true CN116126818A (en) 2023-05-16

Family

ID=86302523

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310079292.1A Pending CN116126818A (en) 2023-01-16 2023-01-16 Retail data synchronization method, device, electronic equipment and computer readable medium

Country Status (1)

Country Link
CN (1) CN116126818A (en)

Similar Documents

Publication Publication Date Title
CN115640285B (en) Power abnormality information transmission method, device, electronic equipment and medium
CN113722055A (en) Data processing method and device, electronic equipment and computer readable medium
CN113190517B (en) Data integration method and device, electronic equipment and computer readable medium
CN111161072A (en) Block chain-based random number generation method, equipment and storage medium
CN111612434B (en) Method, apparatus, electronic device and medium for generating processing flow
CN115102992B (en) Data publishing method and device, electronic equipment and computer readable medium
CN115203977B (en) Power grid simulation system
CN112507676B (en) Method and device for generating energy report, electronic equipment and computer readable medium
CN113420400B (en) Routing relation establishment method, request processing method, device and equipment
CN112019406B (en) Flow monitoring method and device, electronic equipment and computer readable medium
CN116126818A (en) Retail data synchronization method, device, electronic equipment and computer readable medium
CN115022328A (en) Server cluster, server cluster testing method and device and electronic equipment
CN111414161B (en) Method, device, medium and electronic equipment for generating IDL file
CN110532115B (en) System, method and apparatus for developing smart contracts
CN113393288A (en) Order processing information generation method, device, equipment and computer readable medium
CN115277421B (en) Configuration information pushing method, device, electronic equipment and computer readable medium
CN113472565B (en) Method, apparatus, device and computer readable medium for expanding server function
CN112311833B (en) Data updating method and device
CN112036821B (en) Quantization method, quantization device, quantization medium and quantization electronic equipment based on grid map planning private line
CN113836151B (en) Data processing method, device, electronic equipment and computer readable medium
CN112073202B (en) Information generation method and device, electronic equipment and computer readable medium
CN111400322B (en) Method, apparatus, electronic device and medium for storing data
CN112883697B (en) Workflow form generation method, device, electronic equipment and computer readable medium
CN111930704B (en) Service alarm equipment control method, device, equipment and computer readable medium
CN114398437A (en) User information processing method and device, electronic equipment and computer readable medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination