Disclosure of Invention
The invention provides a block chain-based multi-party conference admission method and a block chain-based multi-party conference admission system, which are used for carrying out authority authentication on pre-participators through a block chain technology and storing conference contents into a block chain, so that conference records cannot be falsified, the safety of a conference is improved, and multi-party participators can inquire the conference records, so that an online conference is more convenient.
The invention provides a block chain-based multi-party conference admission method, which comprises the following steps:
step 1, identity recognition is carried out on pre-attendees who pre-attend a multi-party conference, so that identity information of the pre-attendees is obtained;
step 2, generating a digital signature of the pre-attendee based on the identity information of the pre-attendee, transmitting the digital signature to a block chain, and verifying the access authority of the digital signature;
and 3, generating a new block after the digital signature passes the verification, and storing the meeting record corresponding to the pre-attendee.
In a possible implementation manner, the identifying the pre-attendees who pre-attend the multi-party conference in step 1, so as to obtain the identity information of the pre-attendees includes:
carrying out audio acquisition on pre-attendees to obtain first voice signals of the pre-attendees, carrying out feature extraction on the first voice signals to obtain first voice features, and processing the first voice features to obtain first phoneme information;
inputting the first phoneme information into a pre-trained acoustic model to obtain a first speech recognition result, and determining audio content corresponding to the first speech signal;
acquiring a preset audio quasi-database, determining the association degree of audio content corresponding to the first voice and preset content in the audio quasi-database, and if the association degree is greater than the preset degree, acquiring facial images of pre-attendees to obtain facial video data of the pre-attendees;
performing brightness detection on each sub-image in the face video data to obtain the brightness value of each pixel point in the sub-image, calculating to obtain the average brightness value of the sub-image based on the brightness value of each pixel point in the sub-image, and determining the brightness adjustment proportion value of the sub-image based on the difference between the average brightness value and a preset target brightness value;
setting a brightness adjustment weighted value of each pixel point based on the brightness value of each pixel point in the subimage, obtaining a brightness adjustment proportional value of each pixel based on the brightness adjustment proportional value of the subimage and the brightness adjustment weighted value of each pixel point, and adjusting the brightness of each pixel point in the subimage based on the specific brightness adjustment proportional value to obtain a standard brightness image;
performing face detection on the standard brightness image to obtain key points of the face, positioning the key points to obtain positioning information, based on the positioning information, extracting the feature of the key points to obtain the feature vector of the corresponding key points, establishing the corresponding relation between the feature vector and the positioning information of the corresponding key points, thereby obtaining the facial features of the human face in the standard brightness image, retrieving the facial features of the human face in the standard brightness image in a preset database to obtain the identity information of the pre-attendees, prompting the pre-attendee to blink to obtain blink video data of the pre-attendee, marking preset point positions of each sub-picture of the blink video data of the pre-attendee to obtain sub-marked frame images, projecting the sub-mark frame images to a preset coordinate system to obtain coordinates of a sub-preset point in each sub-mark frame image;
determining the variation of a preset point location in the blinking video data based on the coordinates of the preset point location in each sub-marker frame image, and authenticating the identity information according to the relationship between the variation of the preset point location and the preset value:
if the variation of the preset point location is smaller than the preset value, the pre-attendee corresponding to the identity information is indicated to have no identity authentication authority,
and if the variation of the preset point position is not less than the preset value, the participant corresponding to the identity information has the identity authentication authority.
In a possible implementation manner, the step 2 of generating a digital signature of the pre-participant based on the identity information of the pre-participant, transmitting the digital signature to the blockchain, and verifying the admission authority of the digital signature includes:
mapping a number corresponding to the identity information of the pre-attendee to be a binary value, carrying out Hash operation on the binary value to obtain abstract information of the identity information of the pre-attendee to obtain encrypted abstract information, encrypting the abstract information based on a preset private key to obtain encrypted abstract information, adding a timestamp to the encrypted abstract information based on the verification time of the pre-attendee to obtain a digital signature of the pre-attendee, and transmitting the digital signature to all child nodes in a block chain;
and decrypting the digital signature based on the public key to obtain decryption information of the digital signature, wherein the digital signature has the access authority if the decryption information is consistent with the summary information, and the digital signature does not have the access authority if the decryption information is inconsistent with the summary information.
In a possible implementation manner, in step 3, after the digital signature is verified, a new block is generated, and the meeting record corresponding to the pre-attendee is stored, including:
taking the version number of the block chain as a first byte of a block head of the new block, performing hash operation on the parent block to obtain a hash value of the parent block, taking the hash value of the parent block as a second byte of the block head of the new block, determining a timestamp of the new block based on the digital signature, and taking the timestamp as a third byte of the block head of the new block, thereby obtaining an initial block head;
recording access information of pre-attendees to obtain meeting information of the pre-attendees, performing binary value conversion on the meeting information to obtain meeting records, using the meeting records as block bodies, and combining the head of an initial block with the block bodies to obtain an initial new block;
reversely pushing the hash value of the father block to obtain a plurality of sub-history conference records, sequencing the conference records of the pre-participants and the sub-history conference records based on the conference records of the pre-participants and timestamps corresponding to the sub-history conference records to obtain a first conference record sequence, and performing odd-even detection on the record number of the first conference record sequence;
and respectively taking the head-end conference record and the tail-end conference record in the second conference record sequence as a head-end merging item and a tail-end merging item, merging the conference records in the second conference record sequence from the head end and the tail end respectively to obtain a root record, and adding the root record to the block head of the initial new block to obtain a complete new block.
In a possible implementation manner, in step 3, after the digital signature is verified, a new block is generated, and after the meeting record corresponding to the pre-attendee is stored, the method further includes: based on the information calling request, calling the meeting record from the new block, including:
acquiring request data corresponding to the information calling request, and performing data analysis on the request data to acquire target data;
extracting characteristic points of the target data, and grouping the target data according to the characteristic points to obtain sub-target data;
respectively carrying out normalization processing on the sub-target data, and carrying out data packing on the processed sub-target data to obtain sub-target data packets;
determining sub-request tasks of the information calling request according to the feature points and the sub-target data packets, merging the sub-request tasks, and acquiring a request task;
and simultaneously, acquiring the conference record in the corresponding new block according to the request task.
In one possible implementation, the meeting record includes: the meeting time, the meeting duration, the number of participants and the meeting level of the participants.
In a possible implementation manner, step 3, configured to generate a new block after the digital signature is verified, and store the meeting record of the pre-attendee, further includes:
recording conference audio information of the participants, classifying the conference audio information based on sources to obtain sub-conference audio information of the participants of each party, and analyzing the sub-conference audio information file to obtain sub-speech content of the participants of each party;
and segmenting the sub-speech content according to the speech interval, dividing the sub-speech content into a plurality of sub-speech segments, summarizing the content of the sub-speech segments, determining a keyword for each sub-speech segment, labeling the sub-speech segments based on the keywords so as to obtain labeled conference audio information, and storing the labeled conference audio information in a corresponding new block.
In a possible implementation manner, step 3, configured to generate a new block after the digital signature is verified, and store the meeting record corresponding to the pre-attendee, further includes:
determining sub-audio and video states of participants of all parties based on the conference audio information;
judging whether the conference state of each party participant is abnormal or not according to the sub-audio and video state;
when the abnormal meeting state of each party of the participants is determined, marking the participants and determining abnormal time nodes;
starting an information backup task from a first abnormal time node, processing a conference audio information piece, taking conference audio information behind the abnormal time node as a target audio, and backing up the target audio to obtain backup data;
and when the participant state of the participant is determined to be recovered to be normal, pushing the backup data to the participant.
The invention provides a block chain-based multi-party conference admission system, which comprises:
the identification module is used for identifying the identities of pre-attendees who pre-attend the multi-party conference so as to obtain the identity information of the pre-attendees;
the detection module generates a digital signature of the pre-attendee based on the identity information of the pre-attendee, transmits the digital signature to the block chain and verifies the access authority of the digital signature;
and the storage module is used for generating a new block after the digital signature passes the verification and storing the conference record corresponding to the pre-attendee.
Additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by the practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.
The technical solution of the present invention is further described in detail by the accompanying drawings and embodiments.
Detailed Description
The preferred embodiments of the present invention will be described in conjunction with the accompanying drawings, and it should be understood that they are presented herein only to illustrate and explain the present invention and not to limit the present invention.
Example 1:
the embodiment provides a block chain-based multi-party conference admission method, which is characterized by comprising the following steps:
step 1, carrying out identity recognition on pre-attendees who pre-attend a multi-party conference, thereby obtaining identity information of the pre-attendees;
step 2, generating a digital signature of the pre-attendee based on the identity information of the pre-attendee, transmitting the digital signature to a block chain, and verifying the access authority of the digital signature;
and 3, generating a new block after the digital signature passes the verification, and storing the meeting record corresponding to the pre-attendee.
In the embodiment, the digital signature of the pre-attendee is a section of digital string formed by encrypting and adding a timestamp after the binary form of the serial number corresponding to the pre-attendee is converted by a hash function;
in this embodiment, the admission right is a right of whether the pre-conferee corresponding to the digital signature has a conference.
In this embodiment, the new block is a block for storing the conference record generated based on the parent block in the block chain;
the beneficial effects of the above technical scheme are: by identifying the pre-attendees and verifying whether the pre-attendees have the attendance qualification through the blockchain technology, the safety of the online conference is improved, the conference record is stored in the blockchain, the conference record cannot be changed, and the mutual confidence degree of the attendees is improved.
Example 2:
on the basis of embodiment 1, this embodiment provides a block chain-based multiparty conference admission method, which is characterized in that, in step 1, identity recognition is performed on pre-attendees who pre-attend a multiparty conference, so that obtaining identity information of the pre-attendees includes:
carrying out audio acquisition on pre-attendees to obtain first voice signals of the pre-attendees, carrying out feature extraction on the first voice signals to obtain first voice features, and processing the first voice features to obtain first phoneme information;
inputting the first phoneme information into a pre-trained acoustic model to obtain a first speech recognition result, and determining audio content corresponding to the first speech signal;
acquiring a preset audio quasi-database, determining the association degree of audio content corresponding to the first voice and preset content in the audio quasi-database, and if the association degree is greater than the preset degree, acquiring facial images of pre-attendees to obtain facial video data of the pre-attendees;
performing brightness detection on each sub-image in the face video data to obtain the brightness value of each pixel point in the sub-image, calculating to obtain the average brightness value of the sub-image based on the brightness value of each pixel point in the sub-image, and determining the brightness adjustment proportion value of the sub-image based on the difference between the average brightness value and a preset target brightness value;
setting a brightness adjustment weighted value of each pixel point based on the brightness value of each pixel point in the subimage, obtaining a brightness adjustment proportional value of each pixel based on the brightness adjustment proportional value of the subimage and the brightness adjustment weighted value of each pixel point, and adjusting the brightness of each pixel point in the subimage based on the specific brightness adjustment proportional value to obtain a standard brightness image;
performing face detection on the standard brightness image to obtain key points of the face, positioning the key points to obtain positioning information, based on the positioning information, extracting the feature of the key points to obtain the feature vector of the corresponding key point, establishing the corresponding relationship between the feature vector and the positioning information of the corresponding key point, thereby obtaining the facial features of the human face in the standard brightness image, retrieving the facial features of the human face in the standard brightness image in a preset database to obtain the identity information of the pre-attendees, prompting the pre-attendee to blink to obtain blink video data of the pre-attendee, marking preset point positions of each sub-picture of the blink video data of the pre-attendee to obtain sub-marked frame images, projecting the sub-mark frame images to a preset coordinate system to obtain coordinates of a sub-preset point in each sub-mark frame image;
determining the variation of a preset point location in the blinking video data based on the coordinates of the preset point location in each sub-marker frame image, and authenticating the identity information according to the relationship between the variation of the preset point location and the preset value:
if the variation of the preset point location is smaller than the preset value, the pre-attendee corresponding to the identity information is indicated to have no identity authentication authority,
and if the variation of the preset point position is not less than the preset value, the participant corresponding to the identity information has the identity authentication authority.
In this embodiment, the feature extraction of the first speech signal is to collect information of tone, frequency and phoneme after filtering the first speech signal;
in this embodiment, the association degree is a similarity between the audio content and the preset content;
in this embodiment, the acoustic model trained in advance is a GMM-HMM speech recognition model;
in this embodiment, the preset content is a voice vocabulary input in advance by a user with a participation qualification;
in this embodiment, the key points are edge points of the face and edge points of the eyes, mouth, and nose;
in this embodiment, the positioning information is coordinates of each sub-key point in a coordinate system with the central point of the second key image as the origin;
in this embodiment, the correspondence relationship is an inseparable relationship between the position of the same feature point and the feature vector;
in this embodiment, the sub preset point is a preset point in the sub mark frame image;
the beneficial effects of the above technical scheme are: the conference pre-attending personnel are verified for the first time through voice recognition, the conference pre-attending personnel are authenticated for the second time through face recognition, the conference pre-attending personnel are verified for the third time through eye recognition, persons without permission are prevented from participating in the conference, and the safety of the conference is improved.
Example 3:
on the basis of embodiment 1, this embodiment provides a block chain-based multiparty conference admission method, which is characterized in that, in step 2, a digital signature of a pre-participant is generated based on identity information of the pre-participant, the digital signature is transmitted to a block chain, and the admission authority of the digital signature is verified, including:
mapping a number corresponding to the identity information of the pre-attendee to be a binary value, carrying out Hash operation on the binary value to obtain abstract information of the identity information of the pre-attendee to obtain encrypted abstract information, encrypting the abstract information based on a preset private key to obtain encrypted abstract information, adding a timestamp to the encrypted abstract information based on the verification time of the pre-attendee to obtain a digital signature of the pre-attendee, and transmitting the digital signature to all child nodes in a block chain;
and decrypting the digital signature based on the public key to obtain decryption information of the digital signature, wherein the digital signature has the access authority if the decryption information is consistent with the summary information, and the digital signature does not have the access authority if the decryption information is inconsistent with the summary information.
In this embodiment, the hash operation is based on a hash function, and a group of key data is mapped onto a limited address interval, that is, a binary value is summarized to obtain summary information;
in this embodiment, the private key and the public key are a set of paired codes, and are used for an algorithm for encrypting and decrypting the digest information;
in this embodiment, the timestamp is a character sequence of the verification time of the pre-attendee;
in the embodiment, the transmission digital signature is to transmit the digital signature in a block chain, so that all blocks have verification records of pre-attendees;
the beneficial effects of the above technical scheme are: and generating a digital signature based on the identity information of the pre-attendees, transmitting the digital signature to the block chain, and improving the security level of the conference by encrypting, decrypting and verifying the authority of the digital signature.
Example 4:
on the basis of embodiment 1, this embodiment provides a block chain-based multi-party conference admission method, which is characterized in that, in step 3, after the digital signature passes verification, a new block is generated, and a conference record corresponding to a pre-attendee is stored, including:
taking the version number of the block chain as a first byte of a block head of the new block, carrying out hash operation on the parent block to obtain a hash value of the parent block, taking the hash value of the parent block as a second byte of the block head of the new block, determining a timestamp of the new block based on a digital signature, and taking the timestamp as a third byte of the block head of the new block, thereby obtaining an initial block head;
recording access information of pre-participants to obtain participant information of the pre-participants, performing binary value conversion on the participant information to obtain conference records, using the conference records as block bodies, and combining the initial block heads and the block bodies to obtain initial new blocks;
reversely pushing the hash value of the father block to obtain a plurality of sub-history conference records, sequencing the conference records of the pre-participants and the sub-history conference records based on the conference records of the pre-participants and timestamps corresponding to the sub-history conference records to obtain a first conference record sequence, and performing odd-even detection on the record number of the first conference record sequence;
and respectively taking the head-end conference record and the tail-end conference record in the second conference record sequence as a head-end merging item and a tail-end merging item, merging the conference records in the second conference record sequence from the head end and the tail end respectively to obtain a root record, and adding the root record to the block head of the initial new block to obtain a complete new block.
In the embodiment, the reverse operation is to convert the hash value of the parent block into binary code by performing the reverse operation on the hash value through a hash function;
in the embodiment, the odd-even detection is to judge the number of the first conference records, if the number is even, the processing is not needed, if the number is odd, the binary code of the last conference record is copied, the first conference record sequence with the even number of the conference records and the first conference record sequence with the odd number of the processed conference records are used as the second conference record sequence, and then the conference records in the second conference record sequence are merged into the root record by a tree derivation method;
in this embodiment, the version number of the block chain is a release version number of the block chain, and is used as a name to distinguish different block chains;
in this embodiment, the initial block header is a processed block that is a part of the block and is formed together with the block body;
in this embodiment, the first participant record sequence is a sequence obtained by sorting participant records of pre-participants and sub-history participant records;
in this embodiment, the second participant record sequence is a sequence obtained by performing parity detection on the first participant record sequence and processing the first participant record sequence;
in this embodiment, the root record is a fusion of the second participant record sequence obtained by simultaneously fusing the first participant record and the last participant record of the second participant record sequence towards the middle;
the beneficial effects of the above technical scheme are: the participant records are reversely pushed, detected and fused to obtain a complete new block, so that the participant records are stored in the block chain, the participant records cannot be tampered, the participant records cannot be lost, participants of all parties can inquire the participant records in the block chain, and the transparency of the conference is improved.
Example 5:
on the basis of embodiment 1, this embodiment provides a block chain-based multi-party conference admission method, which is characterized in that, in step 3, after the digital signature passes verification, a new block is generated, and after the meeting records corresponding to pre-attendees are stored, the method further includes: based on the information calling request, calling the meeting record from the new block, including:
acquiring request data corresponding to the information calling request, and performing data analysis on the request data to acquire target data;
extracting characteristic points of the target data, and grouping the target data according to the characteristic points to obtain sub-target data;
respectively carrying out normalization processing on the sub-target data, and carrying out data packing on the processed sub-target data to obtain sub-target data packets;
determining a sub-request task of the information calling request according to the feature points and the sub-target data packets, and merging the sub-request task to obtain a request task;
and simultaneously, acquiring the conference record in the corresponding new block according to the request task.
In this embodiment, the request data is a directional keyword in the information retrieval request.
In this embodiment, the feature points of the target data are participants corresponding to the target data.
The beneficial effects of the above technical scheme are: the related information of the conference can be called through the information calling request, and the information calling request is recorded in the block chain, so that the transparency of the conference system is guaranteed.
Example 6:
on the basis of embodiment 1, this embodiment provides a block chain-based multiparty conference admission method, which is characterized in that the conference participation record includes: the conference time, the conference duration, the number of participants and the conference grade of the participants.
Example 7:
on the basis of embodiment 1, this embodiment provides a block chain-based multiparty conference admission method, which is characterized in that step 3 is used to generate a new block and store conference records of pre-attendees after a digital signature passes verification, and further includes:
recording conference audio information of the participants, classifying the conference audio information based on sources to obtain sub-conference audio information of the participants of each party, and analyzing the sub-conference audio information file to obtain sub-speech content of the participants of each party;
and segmenting the sub-speech content according to the speech interval, dividing the sub-speech content into a plurality of sub-speech segments, summarizing the content of the sub-speech segments, determining a keyword for each sub-speech segment, labeling the sub-speech segments based on the keywords so as to obtain labeled conference audio information, and storing the labeled conference audio information in a corresponding new block.
In this embodiment, the conference audio information is a recording of the speech of the participant.
In this embodiment, the speaking interval is a pause time when the participants speak, and the speaking of the participants is segmented based on the speaking interval.
The beneficial effects of the above technical scheme are: the conference audio information is classified, the content of the conference audio information is summarized, the sub-conference speech sections are labeled by the summary keywords, and therefore the speech of each participant is summarized into a plurality of sections, the conference content can be inquired conveniently, the conference content can be mastered, the professional of conference records can be improved, and the conference content can be screened conveniently in the follow-up process.
Example 8:
on the basis of embodiment 1, this embodiment provides a block chain-based multiparty conference admission method, and step 3 is configured to generate a new block after the digital signature passes verification, and store a conference record corresponding to a pre-attendee, and further includes:
determining sub-audio and video states of participants of all parties based on the conference audio information;
judging whether the conference state of each party participant is abnormal or not according to the sub-audio and video state;
when the abnormal meeting state of each party of the participants is determined, marking the participants and determining abnormal time nodes;
starting an information backup task from a first abnormal time node, processing a conference audio information piece, taking conference audio information behind the abnormal time node as a target audio, and backing up the target audio to obtain backup data;
and when the participant state of the participant is determined to be recovered to be normal, pushing the backup data to the participant.
The beneficial effects of the above technical scheme are: whether the participant state of each participant is abnormal or not is judged according to the sub-audio and video states of the participants of each party, and when the participant state is determined to be recovered to be normal, backup in the abnormal time period of the participant state is pushed to the participants, so that the timeliness of the conference is improved.
Example 9:
the embodiment provides a block chain-based multi-party conference admission system, which is characterized by comprising:
the identification module is used for identifying the identities of pre-attendees who pre-attend the multi-party conference so as to obtain the identity information of the pre-attendees;
the detection module generates a digital signature of the pre-attendee based on the identity information of the pre-attendee, transmits the digital signature to the block chain and verifies the access authority of the digital signature;
and the storage module is used for generating a new block after the digital signature passes the verification and storing the conference record corresponding to the pre-attendee.
The beneficial effects of the above scheme are already mentioned in embodiment 1 and are not described herein.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.