CN113536257B - Multi-party conference admission method and system based on block chain - Google Patents

Multi-party conference admission method and system based on block chain Download PDF

Info

Publication number
CN113536257B
CN113536257B CN202110851564.6A CN202110851564A CN113536257B CN 113536257 B CN113536257 B CN 113536257B CN 202110851564 A CN202110851564 A CN 202110851564A CN 113536257 B CN113536257 B CN 113536257B
Authority
CN
China
Prior art keywords
sub
conference
information
preset
attendees
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202110851564.6A
Other languages
Chinese (zh)
Other versions
CN113536257A (en
Inventor
李庆勇
周亚
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nupt Institute Of Big Data Research At Yancheng
Original Assignee
Nupt Institute Of Big Data Research At Yancheng
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nupt Institute Of Big Data Research At Yancheng filed Critical Nupt Institute Of Big Data Research At Yancheng
Priority to CN202110851564.6A priority Critical patent/CN113536257B/en
Publication of CN113536257A publication Critical patent/CN113536257A/en
Application granted granted Critical
Publication of CN113536257B publication Critical patent/CN113536257B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/30Authentication, i.e. establishing the identity or authorisation of security principals
    • G06F21/31User authentication
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/60Protecting data
    • G06F21/602Providing cryptographic facilities or services
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/60Protecting data
    • G06F21/64Protecting data integrity, e.g. using checksums, certificates or signatures

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Security & Cryptography (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Bioethics (AREA)
  • General Health & Medical Sciences (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The invention provides a block chain-based multi-party conference admission method and a block chain-based multi-party conference admission system, wherein the method comprises the following steps: the method comprises the steps of carrying out identity identification on pre-attendees who pre-attend a multi-party conference to obtain identity information of the pre-attendees, generating digital signatures of the pre-attendees based on the identity information of the pre-attendees, transmitting the digital signatures to a block chain, verifying the access authority of the digital signatures, generating a new block after the digital signatures are verified, storing conference records corresponding to the pre-attendees, enabling the conference records to be transparent and incapable of being changed through the block chain technology, and improving safety.

Description

Multi-party conference admission method and system based on block chain
Technical Field
The invention relates to a method and a system for establishing multi-party conference admission for an enterprise holding a conference on line by using a block chain technology, which are mainly applied to the field of internet and the field of mobile internet, in particular to a method and a system for multi-party conference admission based on a block chain.
Background
The conference is the most common working form of modern business, and people who are high in charge of the conference are more often used for dinner at home. However, most of the people who participate in the conference consider that the efficiency of the vast majority of conferences is low, and the people often spend time and effort to arrive at the conference place, and the result is obtained, the online conference provides great convenience and is beneficial to reducing the cost, the people do not need to take a boat and a vehicle, the people can remotely work in the own office place, the negotiation is easily realized, the expensive international travel cost is not needed to be consumed, and the productivity of the online conference system can be greatly improved, and the real-time customer support is provided. The system can shorten the reaction time and help the client to answer the problem in time through network communication, and can also give new sales strategies or perform network education and training to sales personnel in various places in time through the system, share files in real time and show the new performance of products, so that the system is developed quickly, and the confidentiality of online conferences is more and more emphasized.
Disclosure of Invention
The invention provides a block chain-based multi-party conference admission method and a block chain-based multi-party conference admission system, which are used for carrying out authority authentication on pre-participators through a block chain technology and storing conference contents into a block chain, so that conference records cannot be falsified, the safety of a conference is improved, and multi-party participators can inquire the conference records, so that an online conference is more convenient.
The invention provides a block chain-based multi-party conference admission method, which comprises the following steps:
step 1, identity recognition is carried out on pre-attendees who pre-attend a multi-party conference, so that identity information of the pre-attendees is obtained;
step 2, generating a digital signature of the pre-attendee based on the identity information of the pre-attendee, transmitting the digital signature to a block chain, and verifying the access authority of the digital signature;
and 3, generating a new block after the digital signature passes the verification, and storing the meeting record corresponding to the pre-attendee.
In a possible implementation manner, the identifying the pre-attendees who pre-attend the multi-party conference in step 1, so as to obtain the identity information of the pre-attendees includes:
carrying out audio acquisition on pre-attendees to obtain first voice signals of the pre-attendees, carrying out feature extraction on the first voice signals to obtain first voice features, and processing the first voice features to obtain first phoneme information;
inputting the first phoneme information into a pre-trained acoustic model to obtain a first speech recognition result, and determining audio content corresponding to the first speech signal;
acquiring a preset audio quasi-database, determining the association degree of audio content corresponding to the first voice and preset content in the audio quasi-database, and if the association degree is greater than the preset degree, acquiring facial images of pre-attendees to obtain facial video data of the pre-attendees;
performing brightness detection on each sub-image in the face video data to obtain the brightness value of each pixel point in the sub-image, calculating to obtain the average brightness value of the sub-image based on the brightness value of each pixel point in the sub-image, and determining the brightness adjustment proportion value of the sub-image based on the difference between the average brightness value and a preset target brightness value;
setting a brightness adjustment weighted value of each pixel point based on the brightness value of each pixel point in the subimage, obtaining a brightness adjustment proportional value of each pixel based on the brightness adjustment proportional value of the subimage and the brightness adjustment weighted value of each pixel point, and adjusting the brightness of each pixel point in the subimage based on the specific brightness adjustment proportional value to obtain a standard brightness image;
performing face detection on the standard brightness image to obtain key points of the face, positioning the key points to obtain positioning information, based on the positioning information, extracting the feature of the key points to obtain the feature vector of the corresponding key points, establishing the corresponding relation between the feature vector and the positioning information of the corresponding key points, thereby obtaining the facial features of the human face in the standard brightness image, retrieving the facial features of the human face in the standard brightness image in a preset database to obtain the identity information of the pre-attendees, prompting the pre-attendee to blink to obtain blink video data of the pre-attendee, marking preset point positions of each sub-picture of the blink video data of the pre-attendee to obtain sub-marked frame images, projecting the sub-mark frame images to a preset coordinate system to obtain coordinates of a sub-preset point in each sub-mark frame image;
determining the variation of a preset point location in the blinking video data based on the coordinates of the preset point location in each sub-marker frame image, and authenticating the identity information according to the relationship between the variation of the preset point location and the preset value:
if the variation of the preset point location is smaller than the preset value, the pre-attendee corresponding to the identity information is indicated to have no identity authentication authority,
and if the variation of the preset point position is not less than the preset value, the participant corresponding to the identity information has the identity authentication authority.
In a possible implementation manner, the step 2 of generating a digital signature of the pre-participant based on the identity information of the pre-participant, transmitting the digital signature to the blockchain, and verifying the admission authority of the digital signature includes:
mapping a number corresponding to the identity information of the pre-attendee to be a binary value, carrying out Hash operation on the binary value to obtain abstract information of the identity information of the pre-attendee to obtain encrypted abstract information, encrypting the abstract information based on a preset private key to obtain encrypted abstract information, adding a timestamp to the encrypted abstract information based on the verification time of the pre-attendee to obtain a digital signature of the pre-attendee, and transmitting the digital signature to all child nodes in a block chain;
and decrypting the digital signature based on the public key to obtain decryption information of the digital signature, wherein the digital signature has the access authority if the decryption information is consistent with the summary information, and the digital signature does not have the access authority if the decryption information is inconsistent with the summary information.
In a possible implementation manner, in step 3, after the digital signature is verified, a new block is generated, and the meeting record corresponding to the pre-attendee is stored, including:
taking the version number of the block chain as a first byte of a block head of the new block, performing hash operation on the parent block to obtain a hash value of the parent block, taking the hash value of the parent block as a second byte of the block head of the new block, determining a timestamp of the new block based on the digital signature, and taking the timestamp as a third byte of the block head of the new block, thereby obtaining an initial block head;
recording access information of pre-attendees to obtain meeting information of the pre-attendees, performing binary value conversion on the meeting information to obtain meeting records, using the meeting records as block bodies, and combining the head of an initial block with the block bodies to obtain an initial new block;
reversely pushing the hash value of the father block to obtain a plurality of sub-history conference records, sequencing the conference records of the pre-participants and the sub-history conference records based on the conference records of the pre-participants and timestamps corresponding to the sub-history conference records to obtain a first conference record sequence, and performing odd-even detection on the record number of the first conference record sequence;
and respectively taking the head-end conference record and the tail-end conference record in the second conference record sequence as a head-end merging item and a tail-end merging item, merging the conference records in the second conference record sequence from the head end and the tail end respectively to obtain a root record, and adding the root record to the block head of the initial new block to obtain a complete new block.
In a possible implementation manner, in step 3, after the digital signature is verified, a new block is generated, and after the meeting record corresponding to the pre-attendee is stored, the method further includes: based on the information calling request, calling the meeting record from the new block, including:
acquiring request data corresponding to the information calling request, and performing data analysis on the request data to acquire target data;
extracting characteristic points of the target data, and grouping the target data according to the characteristic points to obtain sub-target data;
respectively carrying out normalization processing on the sub-target data, and carrying out data packing on the processed sub-target data to obtain sub-target data packets;
determining sub-request tasks of the information calling request according to the feature points and the sub-target data packets, merging the sub-request tasks, and acquiring a request task;
and simultaneously, acquiring the conference record in the corresponding new block according to the request task.
In one possible implementation, the meeting record includes: the meeting time, the meeting duration, the number of participants and the meeting level of the participants.
In a possible implementation manner, step 3, configured to generate a new block after the digital signature is verified, and store the meeting record of the pre-attendee, further includes:
recording conference audio information of the participants, classifying the conference audio information based on sources to obtain sub-conference audio information of the participants of each party, and analyzing the sub-conference audio information file to obtain sub-speech content of the participants of each party;
and segmenting the sub-speech content according to the speech interval, dividing the sub-speech content into a plurality of sub-speech segments, summarizing the content of the sub-speech segments, determining a keyword for each sub-speech segment, labeling the sub-speech segments based on the keywords so as to obtain labeled conference audio information, and storing the labeled conference audio information in a corresponding new block.
In a possible implementation manner, step 3, configured to generate a new block after the digital signature is verified, and store the meeting record corresponding to the pre-attendee, further includes:
determining sub-audio and video states of participants of all parties based on the conference audio information;
judging whether the conference state of each party participant is abnormal or not according to the sub-audio and video state;
when the abnormal meeting state of each party of the participants is determined, marking the participants and determining abnormal time nodes;
starting an information backup task from a first abnormal time node, processing a conference audio information piece, taking conference audio information behind the abnormal time node as a target audio, and backing up the target audio to obtain backup data;
and when the participant state of the participant is determined to be recovered to be normal, pushing the backup data to the participant.
The invention provides a block chain-based multi-party conference admission system, which comprises:
the identification module is used for identifying the identities of pre-attendees who pre-attend the multi-party conference so as to obtain the identity information of the pre-attendees;
the detection module generates a digital signature of the pre-attendee based on the identity information of the pre-attendee, transmits the digital signature to the block chain and verifies the access authority of the digital signature;
and the storage module is used for generating a new block after the digital signature passes the verification and storing the conference record corresponding to the pre-attendee.
Additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by the practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.
The technical solution of the present invention is further described in detail by the accompanying drawings and embodiments.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the principles of the invention and not to limit the invention. In the drawings:
fig. 1 is a flowchart of a block chain-based multi-party conference admission method according to an embodiment of the present invention;
fig. 2 is a block chain-based structure diagram of a multi-party conference admission system in an embodiment of the present invention;
Detailed Description
The preferred embodiments of the present invention will be described in conjunction with the accompanying drawings, and it should be understood that they are presented herein only to illustrate and explain the present invention and not to limit the present invention.
Example 1:
the embodiment provides a block chain-based multi-party conference admission method, which is characterized by comprising the following steps:
step 1, carrying out identity recognition on pre-attendees who pre-attend a multi-party conference, thereby obtaining identity information of the pre-attendees;
step 2, generating a digital signature of the pre-attendee based on the identity information of the pre-attendee, transmitting the digital signature to a block chain, and verifying the access authority of the digital signature;
and 3, generating a new block after the digital signature passes the verification, and storing the meeting record corresponding to the pre-attendee.
In the embodiment, the digital signature of the pre-attendee is a section of digital string formed by encrypting and adding a timestamp after the binary form of the serial number corresponding to the pre-attendee is converted by a hash function;
in this embodiment, the admission right is a right of whether the pre-conferee corresponding to the digital signature has a conference.
In this embodiment, the new block is a block for storing the conference record generated based on the parent block in the block chain;
the beneficial effects of the above technical scheme are: by identifying the pre-attendees and verifying whether the pre-attendees have the attendance qualification through the blockchain technology, the safety of the online conference is improved, the conference record is stored in the blockchain, the conference record cannot be changed, and the mutual confidence degree of the attendees is improved.
Example 2:
on the basis of embodiment 1, this embodiment provides a block chain-based multiparty conference admission method, which is characterized in that, in step 1, identity recognition is performed on pre-attendees who pre-attend a multiparty conference, so that obtaining identity information of the pre-attendees includes:
carrying out audio acquisition on pre-attendees to obtain first voice signals of the pre-attendees, carrying out feature extraction on the first voice signals to obtain first voice features, and processing the first voice features to obtain first phoneme information;
inputting the first phoneme information into a pre-trained acoustic model to obtain a first speech recognition result, and determining audio content corresponding to the first speech signal;
acquiring a preset audio quasi-database, determining the association degree of audio content corresponding to the first voice and preset content in the audio quasi-database, and if the association degree is greater than the preset degree, acquiring facial images of pre-attendees to obtain facial video data of the pre-attendees;
performing brightness detection on each sub-image in the face video data to obtain the brightness value of each pixel point in the sub-image, calculating to obtain the average brightness value of the sub-image based on the brightness value of each pixel point in the sub-image, and determining the brightness adjustment proportion value of the sub-image based on the difference between the average brightness value and a preset target brightness value;
setting a brightness adjustment weighted value of each pixel point based on the brightness value of each pixel point in the subimage, obtaining a brightness adjustment proportional value of each pixel based on the brightness adjustment proportional value of the subimage and the brightness adjustment weighted value of each pixel point, and adjusting the brightness of each pixel point in the subimage based on the specific brightness adjustment proportional value to obtain a standard brightness image;
performing face detection on the standard brightness image to obtain key points of the face, positioning the key points to obtain positioning information, based on the positioning information, extracting the feature of the key points to obtain the feature vector of the corresponding key point, establishing the corresponding relationship between the feature vector and the positioning information of the corresponding key point, thereby obtaining the facial features of the human face in the standard brightness image, retrieving the facial features of the human face in the standard brightness image in a preset database to obtain the identity information of the pre-attendees, prompting the pre-attendee to blink to obtain blink video data of the pre-attendee, marking preset point positions of each sub-picture of the blink video data of the pre-attendee to obtain sub-marked frame images, projecting the sub-mark frame images to a preset coordinate system to obtain coordinates of a sub-preset point in each sub-mark frame image;
determining the variation of a preset point location in the blinking video data based on the coordinates of the preset point location in each sub-marker frame image, and authenticating the identity information according to the relationship between the variation of the preset point location and the preset value:
if the variation of the preset point location is smaller than the preset value, the pre-attendee corresponding to the identity information is indicated to have no identity authentication authority,
and if the variation of the preset point position is not less than the preset value, the participant corresponding to the identity information has the identity authentication authority.
In this embodiment, the feature extraction of the first speech signal is to collect information of tone, frequency and phoneme after filtering the first speech signal;
in this embodiment, the association degree is a similarity between the audio content and the preset content;
in this embodiment, the acoustic model trained in advance is a GMM-HMM speech recognition model;
in this embodiment, the preset content is a voice vocabulary input in advance by a user with a participation qualification;
in this embodiment, the key points are edge points of the face and edge points of the eyes, mouth, and nose;
in this embodiment, the positioning information is coordinates of each sub-key point in a coordinate system with the central point of the second key image as the origin;
in this embodiment, the correspondence relationship is an inseparable relationship between the position of the same feature point and the feature vector;
in this embodiment, the sub preset point is a preset point in the sub mark frame image;
the beneficial effects of the above technical scheme are: the conference pre-attending personnel are verified for the first time through voice recognition, the conference pre-attending personnel are authenticated for the second time through face recognition, the conference pre-attending personnel are verified for the third time through eye recognition, persons without permission are prevented from participating in the conference, and the safety of the conference is improved.
Example 3:
on the basis of embodiment 1, this embodiment provides a block chain-based multiparty conference admission method, which is characterized in that, in step 2, a digital signature of a pre-participant is generated based on identity information of the pre-participant, the digital signature is transmitted to a block chain, and the admission authority of the digital signature is verified, including:
mapping a number corresponding to the identity information of the pre-attendee to be a binary value, carrying out Hash operation on the binary value to obtain abstract information of the identity information of the pre-attendee to obtain encrypted abstract information, encrypting the abstract information based on a preset private key to obtain encrypted abstract information, adding a timestamp to the encrypted abstract information based on the verification time of the pre-attendee to obtain a digital signature of the pre-attendee, and transmitting the digital signature to all child nodes in a block chain;
and decrypting the digital signature based on the public key to obtain decryption information of the digital signature, wherein the digital signature has the access authority if the decryption information is consistent with the summary information, and the digital signature does not have the access authority if the decryption information is inconsistent with the summary information.
In this embodiment, the hash operation is based on a hash function, and a group of key data is mapped onto a limited address interval, that is, a binary value is summarized to obtain summary information;
in this embodiment, the private key and the public key are a set of paired codes, and are used for an algorithm for encrypting and decrypting the digest information;
in this embodiment, the timestamp is a character sequence of the verification time of the pre-attendee;
in the embodiment, the transmission digital signature is to transmit the digital signature in a block chain, so that all blocks have verification records of pre-attendees;
the beneficial effects of the above technical scheme are: and generating a digital signature based on the identity information of the pre-attendees, transmitting the digital signature to the block chain, and improving the security level of the conference by encrypting, decrypting and verifying the authority of the digital signature.
Example 4:
on the basis of embodiment 1, this embodiment provides a block chain-based multi-party conference admission method, which is characterized in that, in step 3, after the digital signature passes verification, a new block is generated, and a conference record corresponding to a pre-attendee is stored, including:
taking the version number of the block chain as a first byte of a block head of the new block, carrying out hash operation on the parent block to obtain a hash value of the parent block, taking the hash value of the parent block as a second byte of the block head of the new block, determining a timestamp of the new block based on a digital signature, and taking the timestamp as a third byte of the block head of the new block, thereby obtaining an initial block head;
recording access information of pre-participants to obtain participant information of the pre-participants, performing binary value conversion on the participant information to obtain conference records, using the conference records as block bodies, and combining the initial block heads and the block bodies to obtain initial new blocks;
reversely pushing the hash value of the father block to obtain a plurality of sub-history conference records, sequencing the conference records of the pre-participants and the sub-history conference records based on the conference records of the pre-participants and timestamps corresponding to the sub-history conference records to obtain a first conference record sequence, and performing odd-even detection on the record number of the first conference record sequence;
and respectively taking the head-end conference record and the tail-end conference record in the second conference record sequence as a head-end merging item and a tail-end merging item, merging the conference records in the second conference record sequence from the head end and the tail end respectively to obtain a root record, and adding the root record to the block head of the initial new block to obtain a complete new block.
In the embodiment, the reverse operation is to convert the hash value of the parent block into binary code by performing the reverse operation on the hash value through a hash function;
in the embodiment, the odd-even detection is to judge the number of the first conference records, if the number is even, the processing is not needed, if the number is odd, the binary code of the last conference record is copied, the first conference record sequence with the even number of the conference records and the first conference record sequence with the odd number of the processed conference records are used as the second conference record sequence, and then the conference records in the second conference record sequence are merged into the root record by a tree derivation method;
in this embodiment, the version number of the block chain is a release version number of the block chain, and is used as a name to distinguish different block chains;
in this embodiment, the initial block header is a processed block that is a part of the block and is formed together with the block body;
in this embodiment, the first participant record sequence is a sequence obtained by sorting participant records of pre-participants and sub-history participant records;
in this embodiment, the second participant record sequence is a sequence obtained by performing parity detection on the first participant record sequence and processing the first participant record sequence;
in this embodiment, the root record is a fusion of the second participant record sequence obtained by simultaneously fusing the first participant record and the last participant record of the second participant record sequence towards the middle;
the beneficial effects of the above technical scheme are: the participant records are reversely pushed, detected and fused to obtain a complete new block, so that the participant records are stored in the block chain, the participant records cannot be tampered, the participant records cannot be lost, participants of all parties can inquire the participant records in the block chain, and the transparency of the conference is improved.
Example 5:
on the basis of embodiment 1, this embodiment provides a block chain-based multi-party conference admission method, which is characterized in that, in step 3, after the digital signature passes verification, a new block is generated, and after the meeting records corresponding to pre-attendees are stored, the method further includes: based on the information calling request, calling the meeting record from the new block, including:
acquiring request data corresponding to the information calling request, and performing data analysis on the request data to acquire target data;
extracting characteristic points of the target data, and grouping the target data according to the characteristic points to obtain sub-target data;
respectively carrying out normalization processing on the sub-target data, and carrying out data packing on the processed sub-target data to obtain sub-target data packets;
determining a sub-request task of the information calling request according to the feature points and the sub-target data packets, and merging the sub-request task to obtain a request task;
and simultaneously, acquiring the conference record in the corresponding new block according to the request task.
In this embodiment, the request data is a directional keyword in the information retrieval request.
In this embodiment, the feature points of the target data are participants corresponding to the target data.
The beneficial effects of the above technical scheme are: the related information of the conference can be called through the information calling request, and the information calling request is recorded in the block chain, so that the transparency of the conference system is guaranteed.
Example 6:
on the basis of embodiment 1, this embodiment provides a block chain-based multiparty conference admission method, which is characterized in that the conference participation record includes: the conference time, the conference duration, the number of participants and the conference grade of the participants.
Example 7:
on the basis of embodiment 1, this embodiment provides a block chain-based multiparty conference admission method, which is characterized in that step 3 is used to generate a new block and store conference records of pre-attendees after a digital signature passes verification, and further includes:
recording conference audio information of the participants, classifying the conference audio information based on sources to obtain sub-conference audio information of the participants of each party, and analyzing the sub-conference audio information file to obtain sub-speech content of the participants of each party;
and segmenting the sub-speech content according to the speech interval, dividing the sub-speech content into a plurality of sub-speech segments, summarizing the content of the sub-speech segments, determining a keyword for each sub-speech segment, labeling the sub-speech segments based on the keywords so as to obtain labeled conference audio information, and storing the labeled conference audio information in a corresponding new block.
In this embodiment, the conference audio information is a recording of the speech of the participant.
In this embodiment, the speaking interval is a pause time when the participants speak, and the speaking of the participants is segmented based on the speaking interval.
The beneficial effects of the above technical scheme are: the conference audio information is classified, the content of the conference audio information is summarized, the sub-conference speech sections are labeled by the summary keywords, and therefore the speech of each participant is summarized into a plurality of sections, the conference content can be inquired conveniently, the conference content can be mastered, the professional of conference records can be improved, and the conference content can be screened conveniently in the follow-up process.
Example 8:
on the basis of embodiment 1, this embodiment provides a block chain-based multiparty conference admission method, and step 3 is configured to generate a new block after the digital signature passes verification, and store a conference record corresponding to a pre-attendee, and further includes:
determining sub-audio and video states of participants of all parties based on the conference audio information;
judging whether the conference state of each party participant is abnormal or not according to the sub-audio and video state;
when the abnormal meeting state of each party of the participants is determined, marking the participants and determining abnormal time nodes;
starting an information backup task from a first abnormal time node, processing a conference audio information piece, taking conference audio information behind the abnormal time node as a target audio, and backing up the target audio to obtain backup data;
and when the participant state of the participant is determined to be recovered to be normal, pushing the backup data to the participant.
The beneficial effects of the above technical scheme are: whether the participant state of each participant is abnormal or not is judged according to the sub-audio and video states of the participants of each party, and when the participant state is determined to be recovered to be normal, backup in the abnormal time period of the participant state is pushed to the participants, so that the timeliness of the conference is improved.
Example 9:
the embodiment provides a block chain-based multi-party conference admission system, which is characterized by comprising:
the identification module is used for identifying the identities of pre-attendees who pre-attend the multi-party conference so as to obtain the identity information of the pre-attendees;
the detection module generates a digital signature of the pre-attendee based on the identity information of the pre-attendee, transmits the digital signature to the block chain and verifies the access authority of the digital signature;
and the storage module is used for generating a new block after the digital signature passes the verification and storing the conference record corresponding to the pre-attendee.
The beneficial effects of the above scheme are already mentioned in embodiment 1 and are not described herein.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.

Claims (8)

1. A block chain-based multi-party conference admission method is characterized by comprising the following steps:
step 1, carrying out identity recognition on pre-attendees who pre-attend a multi-party conference, thereby obtaining identity information of the pre-attendees;
step 2, generating a digital signature of the pre-attendee based on the identity information of the pre-attendee, transmitting the digital signature to a block chain, and verifying the access authority of the digital signature;
step 3, generating a new block after the digital signature passes the verification, and storing the meeting record corresponding to the pre-attendee;
in step 1, the identity recognition of the pre-attendees who pre-attend the multi-party conference is performed, so that the identity information of the pre-attendees is obtained, and the identity recognition comprises the following steps:
carrying out audio acquisition on pre-attendees to obtain first voice signals of the pre-attendees, carrying out feature extraction on the first voice signals to obtain first voice features, and processing the first voice features to obtain first phoneme information;
inputting the first phoneme information into a pre-trained acoustic model to obtain a first speech recognition result, and determining audio content corresponding to the first speech signal;
acquiring a preset audio quasi-database, determining the association degree of audio content corresponding to the first voice signal and preset content in the audio quasi-database, and if the association degree is greater than the preset degree, acquiring facial images of pre-attendees to obtain facial video data of the pre-attendees;
performing brightness detection on each sub-image in the face video data to obtain the brightness value of each pixel point in the sub-image, calculating to obtain the average brightness value of the sub-image based on the brightness value of each pixel point in the sub-image, and determining the brightness adjustment proportion value of the sub-image based on the difference between the average brightness value and a preset target brightness value;
setting a brightness adjustment weighted value of each pixel point based on the brightness value of each pixel point in the subimage, obtaining a specific brightness adjustment proportional value of each pixel point based on the brightness adjustment proportional value of the subimage and the brightness adjustment weighted value of each pixel point, and adjusting the brightness of each pixel point in the subimage based on the specific brightness adjustment proportional value to obtain a standard brightness image;
performing face detection on the standard brightness image to obtain key points of the face, positioning the key points to obtain positioning information, performing face detection on the standard brightness image to obtain the key points of the face, extracting the feature of the key points to obtain the feature vector of the corresponding key points, establishing the corresponding relation between the feature vector and the positioning information of the corresponding key points, thereby obtaining the facial features of the human face in the standard brightness image, retrieving the facial features of the human face in the standard brightness image in a preset database to obtain the identity information of the pre-attendees, prompting the pre-attendee to blink to obtain blink video data of the pre-attendee, marking preset point positions of each sub-picture of the blink video data of the pre-attendee to obtain sub-marked frame images, projecting the sub-mark frame images to a preset coordinate system to obtain coordinates of a sub-preset point in each sub-mark frame image;
determining the variation of a preset point location in the blinking video data based on the coordinates of the preset point location in each sub-marker frame image, and authenticating the identity information according to the relationship between the variation of the preset point location and the preset value:
if the variation of the preset point position is smaller than the preset value, the fact that the pre-attendee corresponding to the identity information does not have identity authentication authority is shown;
and if the variation of the preset point position is not less than the preset value, the participant corresponding to the identity information has the identity authentication authority.
2. The method as claimed in claim 1, wherein the step 2 of generating a digital signature of the pre-attendee based on the identity information of the pre-attendee, transmitting the digital signature to the blockchain, and verifying the admission authority of the digital signature includes:
mapping numbers corresponding to the identity information of the pre-attendees into binary values, carrying out Hash operation on the binary values to obtain abstract information of the identity information of the pre-attendees, encrypting the abstract information based on a preset private key to obtain encrypted abstract information, adding timestamps to the encrypted abstract information based on the verification time of the pre-attendees to obtain digital signatures of the pre-attendees, and transmitting the digital signatures to all child nodes in the block chain;
and decrypting the digital signature based on the public key to obtain decryption information of the digital signature, wherein the digital signature has the access authority if the decryption information is consistent with the summary information, and the digital signature does not have the access authority if the decryption information is inconsistent with the summary information.
3. The method as claimed in claim 1, wherein the step 3 of generating a new block after the digital signature is verified, and storing the conference record corresponding to the pre-attendee comprises:
taking the version number of the block chain as a first byte of a block head of the new block, carrying out hash operation on the parent block to obtain a hash value of the parent block, taking the hash value of the parent block as a second byte of the block head of the new block, determining a timestamp of the new block based on a digital signature, and taking the timestamp as a third byte of the block head of the new block, thereby obtaining an initial block head;
recording access information of pre-participants to obtain participant information of the pre-participants, performing binary value conversion on the participant information to obtain conference records, using the conference records as block bodies, and combining the initial block heads and the block bodies to obtain initial new blocks;
reversely pushing the hash value of the parent block to obtain a plurality of sub-history conference records, sequencing the conference records of the pre-participants and the sub-history conference records based on the conference records of the pre-participants and timestamps corresponding to the sub-history conference records to obtain a first conference record sequence, performing odd-even detection on the record number of the first conference record sequence, copying the conference records of the pre-participants and adding the conference records to the first conference record sequence if the first conference record number is an odd number, and keeping the first conference record sequence unchanged if the record number is an even number to obtain a second conference record sequence;
and respectively taking the head-end conference record and the tail-end conference record in the second conference record sequence as a head-end merging item and a tail-end merging item, merging the conference records in the second conference record sequence from the head end and the tail end respectively to obtain a root record, and adding the root record to the block head of the initial new block to obtain a complete new block.
4. The method as claimed in claim 1, wherein in step 3, after the digital signature is verified, a new block is generated, and after the meeting record of the corresponding pre-attendee is stored, the method further comprises: based on the information calling request, calling the meeting record from the new block, including:
acquiring request data corresponding to the information calling request, and performing data analysis on the request data to acquire target data;
extracting characteristic points of the target data, and grouping the target data according to the characteristic points to obtain sub-target data;
respectively carrying out normalization processing on the sub-target data, and carrying out data packing on the processed sub-target data to obtain sub-target data packets;
determining a sub-request task of the information calling request according to the feature points and the sub-target data packets, and merging the sub-request task to obtain a request task;
and simultaneously, acquiring the conference record in the corresponding new block according to the request task.
5. The block chain based multi-party conference admission method according to claim 1, wherein the conference record comprises: the meeting time, the meeting duration, the number of participants and the meeting level of the participants.
6. The method as claimed in claim 1, wherein step 3, after the digital signature is verified, a new block is generated, and the meeting record corresponding to the pre-attendee is stored, further comprising:
recording conference audio information of the participants, classifying the conference audio information based on sources to obtain sub-conference audio information of the participants of each party, and analyzing the sub-conference audio information to obtain sub-speech content of the participants of each party;
and segmenting the sub-speech content according to the speech interval, dividing the sub-speech content into a plurality of sub-speech segments, summarizing the content of the sub-speech segments, determining a keyword for each sub-speech segment, labeling the sub-speech segments based on the keywords so as to obtain labeled conference audio information, and storing the labeled conference audio information in a corresponding new block.
7. The method for multi-party conference admission based on block chain as claimed in claim 1, wherein step 3 is configured to generate a new block after the digital signature is verified, and store the conference record corresponding to the pre-attendee, further comprising:
determining sub-audio and video states of participants of all parties based on conference audio information;
judging whether the conference state of each party participant is abnormal or not according to the sub-audio and video state;
when the abnormal meeting state of each party of the participants is determined, marking the participants and determining abnormal time nodes;
starting an information backup task from a first abnormal time node, processing conference audio information, taking the conference audio information behind the abnormal time node as a target audio, and backing up the target audio to obtain backup data;
and when the participant state of the participant is determined to be recovered to be normal, pushing the backup data to the participant.
8. A block chain based multi-party conference admission system, comprising:
the identification module is used for identifying the identities of pre-attendees who pre-attend the multi-party conference so as to obtain the identity information of the pre-attendees;
the detection module is used for generating a digital signature of the pre-attendee based on the identity information of the pre-attendee, transmitting the digital signature to the block chain and verifying the access permission of the digital signature;
the storage module is used for generating a new block after the digital signature passes the verification and storing the conference record corresponding to the pre-attendee;
the recognition module is used for carrying out audio acquisition on the pre-attendees to obtain first voice signals of the pre-attendees, carrying out feature extraction on the first voice signals to obtain first voice features, and processing the first voice features to obtain first phoneme information;
inputting the first phoneme information into a pre-trained acoustic model to obtain a first speech recognition result, and determining audio content corresponding to the first speech signal;
acquiring a preset audio quasi-database, determining the association degree of audio content corresponding to the first voice signal and preset content in the audio quasi-database, and if the association degree is greater than the preset degree, acquiring facial images of pre-attendees to obtain facial video data of the pre-attendees;
performing brightness detection on each sub-image in the face video data to obtain the brightness value of each pixel point in the sub-image, calculating to obtain the average brightness value of the sub-image based on the brightness value of each pixel point in the sub-image, and determining the brightness adjustment proportion value of the sub-image based on the difference between the average brightness value and a preset target brightness value;
setting a brightness adjustment weighted value of each pixel point based on the brightness value of each pixel point in the subimage, obtaining a specific brightness adjustment proportional value of each pixel point based on the brightness adjustment proportional value of the subimage and the brightness adjustment weighted value of each pixel point, and adjusting the brightness of each pixel point in the subimage based on the specific brightness adjustment proportional value to obtain a standard brightness image;
performing face detection on the standard brightness image to obtain key points of the face, positioning the key points to obtain positioning information, based on the positioning information, extracting the feature of the key points to obtain the feature vector of the corresponding key points, establishing the corresponding relation between the feature vector and the positioning information of the corresponding key points, thereby obtaining the facial features of the human face in the standard brightness image, retrieving the facial features of the human face in the standard brightness image in a preset database to obtain the identity information of the pre-attendees, prompting the pre-attendee to blink to obtain blink video data of the pre-attendee, marking preset point positions of each sub-picture of the blink video data of the pre-attendee to obtain sub-marked frame images, projecting the sub-mark frame images to a preset coordinate system to obtain coordinates of a sub-preset point in each sub-mark frame image;
determining the variation of a preset point location in the blinking video data based on the coordinates of the preset point location in each sub-marker frame image, and authenticating the identity information according to the relationship between the variation of the preset point location and the preset value:
if the variation of the preset point position is smaller than the preset value, the pre-attendee corresponding to the identity information does not have the identity authentication authority;
and if the variation of the preset point position is not less than the preset value, the participant corresponding to the identity information has the identity authentication authority.
CN202110851564.6A 2021-07-27 2021-07-27 Multi-party conference admission method and system based on block chain Active CN113536257B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110851564.6A CN113536257B (en) 2021-07-27 2021-07-27 Multi-party conference admission method and system based on block chain

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110851564.6A CN113536257B (en) 2021-07-27 2021-07-27 Multi-party conference admission method and system based on block chain

Publications (2)

Publication Number Publication Date
CN113536257A CN113536257A (en) 2021-10-22
CN113536257B true CN113536257B (en) 2022-06-03

Family

ID=78121018

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110851564.6A Active CN113536257B (en) 2021-07-27 2021-07-27 Multi-party conference admission method and system based on block chain

Country Status (1)

Country Link
CN (1) CN113536257B (en)

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108986826A (en) * 2018-08-14 2018-12-11 中国平安人寿保险股份有限公司 Automatically generate method, electronic device and the readable storage medium storing program for executing of minutes

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107689225B (en) * 2017-09-29 2019-11-19 福建实达电脑设备有限公司 A method of automatically generating minutes
US9990504B1 (en) * 2017-12-18 2018-06-05 Northern Trust Corporation Systems and methods for generating and maintaining immutable digital meeting records within distributed network nodes
CN110232925A (en) * 2019-06-28 2019-09-13 百度在线网络技术(北京)有限公司 Generate the method, apparatus and conference terminal of minutes
US11394538B2 (en) * 2019-11-05 2022-07-19 David Lee Anthony Ramirez System and method for verifying the no-later-than date-of-existence, data integrity, identity of the recorder, and timestamp of the recording for digital content

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108986826A (en) * 2018-08-14 2018-12-11 中国平安人寿保险股份有限公司 Automatically generate method, electronic device and the readable storage medium storing program for executing of minutes

Also Published As

Publication number Publication date
CN113536257A (en) 2021-10-22

Similar Documents

Publication Publication Date Title
US20210328801A1 (en) Systems and Methods to Verify Identity of an Authenticated User using a Digital Health Passport
US10135818B2 (en) User biological feature authentication method and system
Chan et al. Combating deepfakes: Multi-LSTM and blockchain as proof of authenticity for digital media
CN1860724A (en) Method for identification
US11768957B2 (en) Privacy-preserving image distribution
CN112614586B (en) Remote disease intelligent diagnosis system based on medical images and block chains
CN109993502A (en) Cross-platform intelligent terminal resume delivery system and method
US20200145241A1 (en) Systems and methods for identifying participants in multimedia data streams
US20240048572A1 (en) Digital media authentication
CN116015945A (en) Electronic file secure transmission method, system and medium based on electronic signature
CN113873088B (en) Interactive method and device for voice call, computer equipment and storage medium
CN113536257B (en) Multi-party conference admission method and system based on block chain
CA2759682C (en) System, method and computer program for conducting transactions remotely
CN106503522A (en) A kind of interactive mode reality people's identity verification scheme based on multimedia messages
CN114666133B (en) Remote inquiry evidence obtaining system and method based on original handwriting signature
CN115866290A (en) Video dotting method, device, equipment and storage medium
CN114764690A (en) Method, device and system for intelligently conducting conference summary
CN109344590A (en) User identity online verification method and user identity online verification system
CN116684092B (en) Network-based password storage and recovery method and password recovery device
CN113179358B (en) Anti-cheating method and device for problem answering and electronic equipment
US11308198B1 (en) Blockchain-based credential vault system (CVS)
Tambay Testing fuzzy extractors for face biometrics: generating deep datasets
CN112800832A (en) Face image information routing management system
CN113948092A (en) Target person identification method, system and device based on voiceprint and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
EE01 Entry into force of recordation of patent licensing contract
EE01 Entry into force of recordation of patent licensing contract

Application publication date: 20211022

Assignee: Yancheng Nongfu Technology Co.,Ltd.

Assignor: NUPT INSTITUTE OF BIG DATA RESEARCH AT YANCHENG

Contract record no.: X2023980048144

Denomination of invention: A blockchain based multi-party conference access method and system

Granted publication date: 20220603

License type: Common License

Record date: 20231127

EE01 Entry into force of recordation of patent licensing contract
EE01 Entry into force of recordation of patent licensing contract

Application publication date: 20211022

Assignee: Jiangsu Yanan Information Technology Co.,Ltd.

Assignor: NUPT INSTITUTE OF BIG DATA RESEARCH AT YANCHENG

Contract record no.: X2023980049133

Denomination of invention: A blockchain based multi-party conference access method and system

Granted publication date: 20220603

License type: Common License

Record date: 20231203

Application publication date: 20211022

Assignee: Yanmi Technology (Yancheng) Co.,Ltd.

Assignor: NUPT INSTITUTE OF BIG DATA RESEARCH AT YANCHENG

Contract record no.: X2023980049119

Denomination of invention: A blockchain based multi-party conference access method and system

Granted publication date: 20220603

License type: Common License

Record date: 20231203