CN113239679A - Bond position automatic detection technology based on deep learning - Google Patents
Bond position automatic detection technology based on deep learning Download PDFInfo
- Publication number
- CN113239679A CN113239679A CN202110414721.7A CN202110414721A CN113239679A CN 113239679 A CN113239679 A CN 113239679A CN 202110414721 A CN202110414721 A CN 202110414721A CN 113239679 A CN113239679 A CN 113239679A
- Authority
- CN
- China
- Prior art keywords
- bid
- bond
- intention
- data
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/20—Natural language analysis
- G06F40/205—Parsing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/10—Text processing
- G06F40/166—Editing, e.g. inserting or deleting
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/20—Natural language analysis
- G06F40/279—Recognition of textual entities
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Health & Medical Sciences (AREA)
- Health & Medical Sciences (AREA)
- Artificial Intelligence (AREA)
- Computational Linguistics (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Biomedical Technology (AREA)
- Molecular Biology (AREA)
- Computing Systems (AREA)
- Evolutionary Computation (AREA)
- Data Mining & Analysis (AREA)
- Mathematical Physics (AREA)
- Software Systems (AREA)
- Biophysics (AREA)
- Life Sciences & Earth Sciences (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The utility model provides a bond position-marking automatic detection technique based on deep learning, it relates to financial AI technical field, and it has included following specific module: the universal interface module is used for receiving the information provided by the chat system and carrying out simple processing treatment; the text analysis and identification module is used for identifying intentions of the user such as 'bidding, bid altering, bid withdrawing, newly adding' and the like and extracting corresponding elements; the reforming module is used for sorting the information provided by the user and the records in the historical database into a standard data form; the execution module executes specific operations of bidding, bid altering, bid removing and the like; the memory module stores the bidding information of the user, and the invention has the advantages that: the user intentions such as 'bid/bid-changing/bid-withdrawing/bid-increasing' in the chat are automatically detected, and the related specific operation is realized through a program; the human cost is reduced, a fusion model of intention identification and element extraction is adopted, and the experience characteristic information in the financial field is fused, so that the identification and analysis accuracy of the whole set of system reaches the level of more than 95% at present and basically reaches the commercial standard.
Description
Technical Field
The invention relates to the technical field of financial AI (Artificial intelligence), in particular to a bond position automatic detection technology based on deep learning.
Background
In bond investment, traders of securities traders or distributors usually communicate with investors through an instant chat tool IM to determine the operation of bidding, bidding modification or bid withdrawal of a bond by the investors.
The existing processing methods mainly include two methods, one is to manually arrange the bidding data of investors according to chat contents by manual combing, adopting excel and other office software, or is a semi-manual method, namely, a rule method is adopted, rules for detecting the bidding position are defined by expert combing, whether the bidding information is the bidding information or not and effective information contained in the bidding information are judged by some keywords and some rules, with the rise of deep learning technology, a deep learning algorithm for text classification and information extraction is gradually applied to text and digital processing in the financial field, and due to the difference of particularity and language expression in the private field, a technology which can be commercialized in a general field cannot achieve a good effect in the private field of finance.
In the prior art, firstly, a manual method or a rule method is adopted, a large number of professionals are required to carry out rule combing due to various rules, and a large amount of affair repeated labor is needed in the process, so that the method is a method which is labor-consuming and labor-consuming; however, it is difficult to constrain the linguistic expression of the user, and secondly, it is a feasible direction from the technical aspect by the emerging deep learning algorithm technology, the key technology of deep learning involved in the mark position detection can be decomposed into a series of subtasks such as text classification, intention identification, information extraction and the like, such as classification, intention identification having fasttext, textcnn or a classifier based on Bert, and the information extraction having various NER models, BiLSTM + CRF, Bert + LSTM + CRF, and the latest models developed for chinese such as Graph4CNER and the like, and the models of text classification, parsing and the like have good effects in the general domain, but have specificity for the financial domain, such as: multiple ambiguity problems can be distinguished only by professional knowledge; the financial field has high requirements for accuracy effect, and the existing scheme is difficult to achieve commercial effect.
Disclosure of Invention
The invention aims to provide a deep learning-based automatic detection technology for bond positions, aiming at the defects and shortcomings in the prior art, so that the purposes of automatically detecting user intentions such as 'bidding/bid alteration/bid withdrawal/increased delivery' in chatting are realized, and related specific operations are realized through a program; the human cost is reduced, a fusion model of intention identification and element extraction is adopted, and the experience characteristic information in the financial field is fused, so that the identification and analysis accuracy of the whole set of system reaches the level of more than 95% at present and basically reaches the commercial standard.
In order to achieve the purpose, the invention adopts the following technical scheme: a bond position automatic detection technology based on deep learning comprises the following specific modules: the universal interface module is used for receiving the information provided by the chat system and carrying out simple processing treatment; the text analysis and identification module is used for identifying intentions of the user such as 'bidding, bid altering, bid withdrawing, newly adding' and the like and extracting corresponding elements; the reforming module is used for sorting the information provided by the user and the records in the historical database into a standard data form; the execution module executes specific operations of bidding, bid altering, bid removing and the like; and the memory module stores the bidding information of the user.
More optimized: the universal interface module is used for receiving the dialogue information provided by the chat system, processing the dialogue information, providing a standard data input interface, receiving the text information, the sender, the receiver, the dialogue time and other information in the chat, reading the historical transaction record information of the user in the database according to the sender information, sorting the data, packaging and transmitting the data to the analysis and identification module.
More optimized: the text analysis and identification module: the method comprises the steps of identifying the intention of a user and extracting element information, wherein the core function is to judge the intention of an investor according to conversation linguistic data of chatting, the intentions mainly comprise four types, namely bidding, bid changing, bid withdrawing and bid adding, and secondly identify the elements provided by the user, namely fifteen element information related to bonds, such as bond names, bond codes, bid positions, scalar quantities, subject/bond item rating and the like, and the specific technical scheme of a text analysis and identification module adopts a combined model scheme, namely an intention identification scheme and an element extraction scheme, and a deep neural network algorithm is realized in one model.
More optimized: the reforming module: the data is arranged into a unified and executable module which is a set of logic library, completion information is arranged into a standard form according to the intention of a user and provided element information, when the intention of the user is 'bid/newly increased/withdrawn', the data is arranged into the forms of 'bond name, mark position and scalar', when the intention of the user is 'withdrawn', the data is arranged into the forms of 'bond name, mark position, scalar' withdrawn ', the data is arranged into the forms of' bond name, mark position and scalar ', when the intention is withdrawn', the data is arranged into the forms of 'bond name, mark position, scalar and withdrawn', and the detailed process of the rearrangement is as follows: grouping the intention of the message, identifying the intention of the whole sentence message by using a rule, and setting a main key: bond name and bond code, and secondary key: the editing mode and the time limit are used as entity list splitting keys to reasonably split and combine the entity list; then iteratively supplementing necessary entities which are possibly lost to the grouped entity list, firstly, carrying out prefix tree matching by using bond keywords and a bond type library, and secondly, mapping and supplementing the key entities such as the lost bond names, bond types and bond keywords and the like by associating the front and back relations; finally, the 'label changing' logic is distinguished, and the 'before change' and 'after change' entity lists are split.
More optimized: the execution module: the method comprises the steps of executing specific operations such as bidding, bid changing, bid removing and the like, executing specific operations such as bidding, bid changing and bid removing, directly linking a database when the intention is 'bidding', writing data into the database, dividing the database into a plurality of modes when the intention is 'bid changing', wherein the modes comprise four modification modes of 'more than one modification mode, one more than one modification mode and more than one modification mode', deleting data in the database, writing the modified data into the database, and deleting the data in the database and writing a new result into the database when the intention is 'increased investment'.
More optimized: the data storage module is used for storing order data of users, and includes but is not limited to SQL, Redis and other databases.
The working principle of the invention is as follows: the universal interface module receives information transmitted by the chat system, including text information of investment of senders, receivers and bonds, and the like, performs simple processing, and transmits the information to the text analysis and identification module, and the identification module judges the intention of a user on bidding, bid changing, bid withdrawing or newly increasing according to the text information and identifies specific information elements such as bond names, bid positions, scalar quantities, time limits and the like. Then the data are transmitted into a reforming module which is arranged into different expression forms based on different intents, wherein interface packaging, intention identification, element extraction, reforming, an execution module and a fused whole set of automatic position marking detection framework are carried out; a multitask joint model algorithm built again based on the classical model; and the data reforming scheme under different operation conditions of the optimization scheme bond with the 'empirical characteristics' fused into the deep learning model is a main mode method.
After the technical scheme is adopted, the invention has the beneficial effects that: the user intentions such as 'bid/bid-changing/bid-withdrawing/bid-increasing' in the chat are automatically detected, and the related specific operation is realized through a program; the human cost is reduced, a fusion model of intention identification and element extraction is adopted, and the experience characteristic information in the financial field is fused, so that the identification and analysis accuracy of the whole set of system reaches the level of more than 95% at present and basically reaches the commercial standard.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without creative efforts.
FIG. 1 is a business process diagram of the present invention.
Fig. 2 is a network architecture diagram of a text parsing and recognition module.
FIG. 3 is a schematic diagram of the reforming logic of the reforming module.
Detailed Description
Referring to fig. 1 to fig. 3, the technical solution adopted by the present embodiment is: the system comprises the following specific modules: the universal interface module is used for receiving the information provided by the chat system and carrying out simple processing treatment; the text analysis and identification module is used for identifying intentions of the user such as 'bidding, bid altering, bid withdrawing, newly adding' and the like and extracting corresponding elements; the reforming module is used for sorting the information provided by the user and the records in the historical database into a standard data form; the execution module executes specific operations of bidding, bid altering, bid removing and the like; and the memory module stores the bidding information of the user.
More optimized: the universal interface module is used for receiving the dialogue information provided by the chat system, processing the dialogue information, providing a standard data input interface, receiving the text information, the sender, the receiver, the dialogue time and other information in the chat, reading the historical transaction record information of the user in the database according to the sender information, sorting the data, packaging and transmitting the data to the analysis and identification module.
More optimized: the text analysis and identification module: the method comprises the steps of identifying the intention of a user and extracting element information, wherein the core function is to judge the intention of an investor according to conversation linguistic data of chatting, the intentions mainly comprise four types, namely bidding, bid changing, bid withdrawing and bid adding, and secondly identify the elements provided by the user, namely fifteen element information related to bonds, such as bond names, bond codes, bid positions, scalar quantities, subject/bond item rating and the like, and the specific technical scheme of a text analysis and identification module adopts a combined model scheme, namely an intention identification scheme and an element extraction scheme, and a deep neural network algorithm is realized in one model.
More optimized: the reforming module: the data is arranged into a unified and executable module which is a set of logic library, completion information is arranged into a standard form according to the intention of a user and provided element information, when the intention of the user is 'bid/newly increased/withdrawn', the data is arranged into the forms of 'bond name, mark position and scalar', when the intention of the user is 'withdrawn', the data is arranged into the forms of 'bond name, mark position, scalar' withdrawn ', the data is arranged into the forms of' bond name, mark position and scalar ', when the intention is withdrawn', the data is arranged into the forms of 'bond name, mark position, scalar and withdrawn', and the detailed process of the rearrangement is as follows: grouping the intention of the message, identifying the intention of the whole sentence message by using a rule, and setting a main key: bond name and bond code, and secondary key: the editing mode and the time limit are used as entity list splitting keys to reasonably split and combine the entity list; then iteratively supplementing necessary entities which are possibly lost to the grouped entity list, firstly, carrying out prefix tree matching by using bond keywords and a bond type library, and secondly, mapping and supplementing the key entities such as the lost bond names, bond types and bond keywords and the like by associating the front and back relations; finally, the 'label changing' logic is distinguished, and the 'before change' and 'after change' entity lists are split.
More optimized: the execution module: the method comprises the steps of executing specific operations such as bidding, bid changing, bid removing and the like, executing specific operations such as bidding, bid changing and bid removing, directly linking a database when the intention is 'bidding', writing data into the database, dividing the database into a plurality of modes when the intention is 'bid changing', wherein the modes comprise four modification modes of 'more than one modification mode, one more than one modification mode and more than one modification mode', deleting data in the database, writing the modified data into the database, and deleting the data in the database and writing a new result into the database when the intention is 'increased investment'.
More optimized: the data storage module is used for storing order data of users, and includes but is not limited to SQL, Redis and other databases.
The working principle of the invention is as follows: the universal interface module receives information transmitted by the chat system, including text information of investment of senders, receivers and bonds, and the like, performs simple processing, and transmits the information to the text analysis and identification module, and the identification module judges the intention of a user on bidding, bid changing, bid withdrawing or newly increasing according to the text information and identifies specific information elements such as bond names, bid positions, scalar quantities, time limits and the like. Then the data are transmitted into a reforming module which is arranged into different expression forms based on different intents, wherein interface packaging, intention identification, element extraction, reforming, an execution module and a fused whole set of automatic position marking detection framework are carried out; a multitask joint model algorithm built again based on the classical model; and the data reforming scheme under different operation conditions of the optimization scheme bond with the 'empirical characteristics' fused into the deep learning model is a main mode method.
The above description is only for the purpose of illustrating the technical solutions of the present invention and not for the purpose of limiting the same, and other modifications or equivalent substitutions made by those skilled in the art to the technical solutions of the present invention should be covered within the scope of the claims of the present invention without departing from the spirit and scope of the technical solutions of the present invention.
Claims (8)
1. The utility model provides a bond position automatic check out technique based on deep learning which characterized in that: the system comprises the following specific modules:
a) the universal interface module is used for receiving the information provided by the chat system and carrying out simple processing treatment;
b) the text analysis and identification module is used for identifying intentions of the user such as 'bidding, bid altering, bid withdrawing, newly adding' and the like and extracting corresponding elements;
c) the reforming module is used for sorting the information provided by the user and the records in the historical database into a standard data form;
d) the execution module executes specific operations of bidding, bid altering, bid removing and the like;
e) and the memory module stores the bidding information of the user.
2. The deep learning based bond position automatic detection technology according to claim 1, characterized in that: the universal interface module is used for receiving the dialogue information provided by the chat system, processing the dialogue information, providing a standard data input interface, receiving the text information, the sender, the receiver, the dialogue time and other information in the chat, reading the historical transaction record information of the user in the database according to the sender information, sorting the data, packaging and transmitting the data to the analysis and identification module.
3. The deep learning based bond position automatic detection technology according to claim 1, characterized in that: the text analysis and identification module: the method comprises the steps of identifying the intention of a user and extracting element information, wherein the core function is to judge the intention of an investor according to conversation linguistic data of chatting, and the intention mainly comprises four types of element information, namely bidding, bid changing, bid withdrawing and bid adding, and secondly identifies the elements provided by the user, namely fifteen element information related to bonds, such as bond names, bond codes, mark positions, scalar quantities, subject/bond rating and the like.
4. The deep learning based bond position automatic detection technology according to claim 3, characterized in that: the specific technical scheme of the text analysis and identification module adopts a combined model scheme, namely a deep neural network algorithm realized in a model by 'intention identification' and 'element extraction'.
5. The deep learning based bond position automatic detection technology according to claim 1, characterized in that: the reforming module: the data is arranged into a unified and executable module which is a set of logic library, completion information is arranged into a standard form according to the intention of a user and provided element information, when the intention of the user is ' bid/newly increased/withdrawn ', the data is arranged into the forms of ' bond name, mark position and scalar ', when the intention of the user is ' withdrawn ', the data is arranged into the forms of ' bond name, mark position and scalar ', when the intention is withdrawn, the data is arranged into the forms of ' bond name, mark position, scalar ' and withdrawn '.
6. The deep learning based bond position automatic detection technology according to claim 5, characterized in that: the specific process of the reforming comprises the following steps: grouping the intention of the message, identifying the intention of the whole sentence message by using a rule, and setting a main key: bond name and bond code, and secondary key: the editing mode and the time limit are used as entity list splitting keys to reasonably split and combine the entity list; then iteratively supplementing necessary entities which are possibly lost to the grouped entity list, firstly, carrying out prefix tree matching by using bond keywords and a bond type library, and secondly, mapping and supplementing the key entities such as the lost bond names, bond types and bond keywords and the like by associating the front and back relations; finally, the 'label changing' logic is distinguished, and the 'before change' and 'after change' entity lists are split.
7. The deep learning based bond position automatic detection technology according to claim 1, characterized in that: the execution module: the method comprises the steps of executing specific operations such as bidding, bid changing, bid removing and the like, executing specific operations such as bidding, bid changing and bid removing, directly linking a database when the intention is 'bidding', writing data into the database, dividing the database into a plurality of modes when the intention is 'bid changing', wherein the modes comprise four modification modes of 'more than one modification mode, one more than one modification mode and more than one modification mode', deleting data in the database, writing the modified data into the database, and deleting the data in the database and writing a new result into the database when the intention is 'increased investment'.
8. The deep learning based bond position automatic detection technology according to claim 1, characterized in that: the data storage module is used for storing order data of users, and includes but is not limited to SQL, Redis and other databases.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110414721.7A CN113239679A (en) | 2021-04-17 | 2021-04-17 | Bond position automatic detection technology based on deep learning |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110414721.7A CN113239679A (en) | 2021-04-17 | 2021-04-17 | Bond position automatic detection technology based on deep learning |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113239679A true CN113239679A (en) | 2021-08-10 |
Family
ID=77128537
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110414721.7A Pending CN113239679A (en) | 2021-04-17 | 2021-04-17 | Bond position automatic detection technology based on deep learning |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113239679A (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6876309B1 (en) * | 1994-11-21 | 2005-04-05 | Espeed, Inc. | Bond trading system |
| CN110390108A (en) * | 2019-07-29 | 2019-10-29 | 中国工商银行股份有限公司 | Task exchange method and system based on deeply study |
| CN111241262A (en) * | 2020-01-20 | 2020-06-05 | 深圳壹账通智能科技有限公司 | Loan qualification auditing method based on artificial intelligence and related equipment |
| CN111353013A (en) * | 2018-12-05 | 2020-06-30 | 中兴通讯股份有限公司 | Method and system for realizing intelligent delivery and reception |
-
2021
- 2021-04-17 CN CN202110414721.7A patent/CN113239679A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6876309B1 (en) * | 1994-11-21 | 2005-04-05 | Espeed, Inc. | Bond trading system |
| CN111353013A (en) * | 2018-12-05 | 2020-06-30 | 中兴通讯股份有限公司 | Method and system for realizing intelligent delivery and reception |
| CN110390108A (en) * | 2019-07-29 | 2019-10-29 | 中国工商银行股份有限公司 | Task exchange method and system based on deeply study |
| CN111241262A (en) * | 2020-01-20 | 2020-06-05 | 深圳壹账通智能科技有限公司 | Loan qualification auditing method based on artificial intelligence and related equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111428053B (en) | Construction method of tax field-oriented knowledge graph | |
| CN110799981B (en) | Systems and methods for domain-independent aspect level emotion detection | |
| CN110727779A (en) | Question-answering method and system based on multi-model fusion | |
| CN108829682B (en) | Computer readable storage medium, intelligent question answering method and intelligent question answering device | |
| CN110580308B (en) | Information auditing method and device, electronic equipment and storage medium | |
| CN112434535B (en) | Element extraction method, device, equipment and storage medium based on multiple models | |
| CN105378732A (en) | Subject-matter analysis of tabular data | |
| CN112417891B (en) | Text relation automatic labeling method based on open type information extraction | |
| CN108153729A (en) | A kind of Knowledge Extraction Method towards financial field | |
| CN113360582B (en) | Relation classification method and system based on BERT model fusion multi-entity information | |
| CN111782793A (en) | Intelligent customer service processing method, system and equipment | |
| CN112784585A (en) | Abstract extraction method and terminal for financial bulletin | |
| CN110765276A (en) | Entity alignment method and device in knowledge graph | |
| CN112883183B (en) | Method for constructing multi-classification model, intelligent customer service method, and related device and system | |
| CN113239679A (en) | Bond position automatic detection technology based on deep learning | |
| CN115640378A (en) | Work order retrieval method, server, medium and product | |
| CN112541357B (en) | Entity identification method and device and intelligent equipment | |
| CN113761900A (en) | Unstructured transaction information identification method and system based on natural language processing | |
| CN114239576A (en) | Issue label classification method based on topic model and convolutional neural network | |
| Yang | RETRACTED ARTICLE: Financial Information Extraction Using the Improved Hidden Markov Model and Deep Learning | |
| CN114996407B (en) | Remote supervision relation extraction method and system based on packet reconstruction | |
| CN113569974B (en) | Programming statement error correction method, device, electronic equipment and storage medium | |
| CN117010349B (en) | Form filling method, system and storage medium based on neural network model | |
| CN112905789B (en) | Unstructured data processing method and system based on natural language processing | |
| CN113032540B (en) | Man-machine interaction method, device, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |