CN111311227A - Method and device suitable for in-screen type biological feature and two-dimensional code recognition - Google Patents
Method and device suitable for in-screen type biological feature and two-dimensional code recognition Download PDFInfo
- Publication number
- CN111311227A CN111311227A CN201811511604.7A CN201811511604A CN111311227A CN 111311227 A CN111311227 A CN 111311227A CN 201811511604 A CN201811511604 A CN 201811511604A CN 111311227 A CN111311227 A CN 111311227A
- Authority
- CN
- China
- Prior art keywords
- payment
- image
- reading
- mobile payment
- dimensional code
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q20/00—Payment architectures, schemes or protocols
- G06Q20/30—Payment architectures, schemes or protocols characterised by the use of specific devices or networks
- G06Q20/32—Payment architectures, schemes or protocols characterised by the use of specific devices or networks using wireless devices
- G06Q20/327—Short range or proximity payments by means of M-devices
- G06Q20/3274—Short range or proximity payments by means of M-devices using a pictured code, e.g. barcode or QR-code, being displayed on the M-device
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06K—GRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
- G06K7/00—Methods or arrangements for sensing record carriers, e.g. for reading patterns
- G06K7/10—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation
- G06K7/14—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation using light without selection of wavelength, e.g. sensing reflected white light
- G06K7/1404—Methods for optical code recognition
- G06K7/1408—Methods for optical code recognition the method being specifically adapted for the type of code
- G06K7/1417—2D bar codes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06K—GRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
- G06K7/00—Methods or arrangements for sensing record carriers, e.g. for reading patterns
- G06K7/10—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation
- G06K7/14—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation using light without selection of wavelength, e.g. sensing reflected white light
- G06K7/1404—Methods for optical code recognition
- G06K7/146—Methods for optical code recognition the method including quality enhancement steps
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q20/00—Payment architectures, schemes or protocols
- G06Q20/30—Payment architectures, schemes or protocols characterised by the use of specific devices or networks
- G06Q20/34—Payment architectures, schemes or protocols characterised by the use of specific devices or networks using cards, e.g. integrated circuit [IC] cards or magnetic cards
- G06Q20/349—Rechargeable cards
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q20/00—Payment architectures, schemes or protocols
- G06Q20/30—Payment architectures, schemes or protocols characterised by the use of specific devices or networks
- G06Q20/34—Payment architectures, schemes or protocols characterised by the use of specific devices or networks using cards, e.g. integrated circuit [IC] cards or magnetic cards
- G06Q20/351—Virtual cards
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q20/00—Payment architectures, schemes or protocols
- G06Q20/38—Payment protocols; Details thereof
- G06Q20/40—Authorisation, e.g. identification of payer or payee, verification of customer or shop credentials; Review and approval of payers, e.g. check credit lines or negative lists
- G06Q20/401—Transaction verification
- G06Q20/4014—Identity check for transactions
- G06Q20/40145—Biometric identity checks
Landscapes
- Engineering & Computer Science (AREA)
- Business, Economics & Management (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Accounting & Taxation (AREA)
- Strategic Management (AREA)
- General Business, Economics & Management (AREA)
- Computer Networks & Wireless Communication (AREA)
- Artificial Intelligence (AREA)
- Health & Medical Sciences (AREA)
- Electromagnetism (AREA)
- General Health & Medical Sciences (AREA)
- Toxicology (AREA)
- Microelectronics & Electronic Packaging (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Quality & Reliability (AREA)
- Computer Security & Cryptography (AREA)
- Finance (AREA)
- Cash Registers Or Receiving Machines (AREA)
Abstract
The invention provides a method suitable for recognizing and reading screen-down biological characteristics and two-dimensional codes, which comprises the steps of networking a mobile payment device which is provided with a camera and a control system based on a central processing unit supporting a biological recognition technology, and connecting the mobile payment device with an electronic terminal and a server cluster; acquiring parameter data to generate a two-dimensional code image; and when the payment event is triggered, the code scanning and non-contact card swiping payment are supported, and the first distance measurement sampling point is monitored, the recognition and the reading are completed through the buckling scanning. The method adopts a preset algorithm for decoding the two-dimensional code image, and when a bar code in front is sensed, display contents are removed, and a display screen is changed into transparent glass so as to be convenient to read; through algorithm processing, the barcode content is read while the content is displayed on a screen, so that the flexibility and the usability of code scanning are improved; the security of the subsequent code scanning payment is improved through the identification of the biological characteristics of the user. The present disclosure also provides a device suitable for recognizing and reading the screen-below type biological characteristics and the two-dimensional code.
Description
Technical Field
The disclosure relates to the technical field of mobile payment and the technical field of image recognition, in particular to a method and a device suitable for recognizing and reading screen-type biological features and two-dimensional codes.
Background
In the prior art, the cash register modes applied to a plurality of scenes are pos machine card swiping modes, cash modes and the like. The electronic terminal is opened for the payer in a few scenes, static two-dimensional codes provided by a plurality of scenes are scanned (in the process of manufacturing and image acquisition of static payment images, impurities, interference and the like are inevitably mixed in the images, so that the problems of noise, blurring and uneven gray scale exist in the images), information of the two-dimensional codes is read, and payment operation is completed. The cash register mode enables the cash register mode to be single, the two-dimensional code reading operation cannot be realized under a screen based on display content, and the method also has no reading operation for biological feature recognition of a user, namely has no application accuracy, safety, flexibility and usability.
Disclosure of Invention
In order to solve the technical problem in the prior art, the disclosed embodiment provides a method and a device suitable for in-screen biometric feature and two-dimensional code recognition, wherein cameras which are arranged in a plurality of scenes and are configured to be suitable for bar code recognition and mobile payment equipment of a control system based on a central processing unit supporting a biometric recognition technology are networked, and the mobile payment equipment, an electronic terminal controlling the mobile payment equipment and a server cluster which are arranged in the plurality of scenes and support the cooperative application of input equipment and a printing device are connected; the method comprises the steps of acquiring data of a plurality of parameters which are sent by a server cluster and are suitable for being recognized and read by the mobile payment equipment in real time, and generating a two-dimensional code image suitable for the mobile payment equipment according to the data of the plurality of parameters; grouping continuous ranging data extracted by at least one ranging sensor aiming at a generated two-dimensional code image into a plurality of data groups according to the adjacent relation of corresponding sequences, and classifying ranging data points in each data group to be divided into a first ranging sampling point and a second ranging sampling point, wherein each data group comprises the same number of ranging data points; when a payment event is monitored to be triggered, whether an initial system of the mobile payment device supports a multi-form payment system or not is judged, wherein the multi-form payment system supports code scanning payment and non-contact card swiping payment, the multi-form payment system comprises a closed payment system and an open payment system, the closed payment system is used for presetting a single scene and a single payment position and combining a payment system formed by a virtual value storage card or a real value storage card, and the open payment system is used for presetting at least two scenes and at least two payment positions and combining a payment system formed by the virtual value storage card or the real value storage card; and if the multi-form payment system is supported and the first distance measurement sampling point is monitored, starting and receiving the reading operation finished by the user in a buckling and scanning mode.
In a first aspect, an embodiment of the present disclosure provides a method for recognizing and reading a biometric feature and a two-dimensional code under a screen, including the following steps: the method comprises the steps that cameras which are arranged in a plurality of scenes and are configured to be suitable for bar code reading and mobile payment equipment of a control system of a central processing unit based on a biological recognition technology are networked, and the mobile payment equipment which is arranged in the plurality of scenes and supports the cooperative application of an input device and a printing device, an electronic terminal for controlling the mobile payment equipment and a server cluster are connected, wherein the mobile payment equipment which supports the cooperative application of the input device and the printing device comprises at least one camera suitable for bar code reading, and the at least one camera suitable for bar code reading is used for sensing light change of 360 degrees in a full angle in real time so as to trigger a liquid crystal display to complete change operation of display content through the central processing unit; acquiring data of a plurality of parameters which are sent by the server cluster and are suitable for being recognized and read by the mobile payment equipment in real time, and generating a two-dimensional code image suitable for the mobile payment equipment according to the data of the plurality of parameters; grouping continuous ranging data extracted by at least one ranging sensor for the generated two-dimensional code image into a plurality of data groups according to the adjacent relation of corresponding sequences, and classifying ranging data points in each data group to be divided into a first ranging sampling point and a second ranging sampling point, wherein each data group comprises the same number of ranging data points; when a payment event is monitored to be triggered, judging whether an initial system of the mobile payment device supports a multi-form payment system or not, wherein the multi-form payment system supports code scanning payment and non-contact card swiping payment, the multi-form payment system comprises a closed payment system and an open payment system, the closed payment system is combined with a payment system formed by a virtual value storage card or a real value storage card in a preset single scene and a preset single payment position, and the open payment system is combined with the payment system formed by the virtual value storage card or the real value storage card in a preset at least two scenes and at least two payment positions; and receiving the recognition operation finished by the user in a buckling and scanning mode if the multi-form payment system is supported and the first distance measurement sampling point is monitored.
In a second aspect, the disclosed embodiments provide a computer-readable storage medium, on which a computer program is stored, which when executed by a processor, implements the steps of the method described above.
In a third aspect, the disclosed embodiments provide a computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the steps of the method described above when executing the program.
In a fourth aspect, an embodiment of the present disclosure provides an apparatus suitable for recognizing and reading a biometric feature and a two-dimensional code under a screen, where the apparatus includes: the networking and connecting module is used for networking cameras which are arranged in a plurality of scenes and are configured to be suitable for bar code reading and mobile payment equipment of a control system of a central processing unit based on a support biological identification technology, and connecting the mobile payment equipment which is arranged in a plurality of scenes and supports the cooperative application of an input device and a printing device, an electronic terminal for controlling the mobile payment equipment and a server cluster, wherein the mobile payment equipment which supports the cooperative application of the input device and the printing device comprises at least one camera suitable for bar code reading, and the at least one camera suitable for bar code reading is used for sensing light change of 360 degrees at a full angle in real time so as to trigger a liquid crystal display to complete change operation of display content through the central processing unit; the acquisition and image generation module is used for acquiring data of a plurality of parameters which are sent by the server cluster and are suitable for being recognized and read by the mobile payment equipment in real time and generating a two-dimensional code image suitable for the mobile payment equipment according to the data of the plurality of parameters; the classification module is used for grouping continuous ranging data extracted by at least one ranging sensor aiming at the generated two-dimensional code image into a plurality of data groups according to the adjacent relation of corresponding sequences, and classifying ranging data points in each data group to be divided into a first ranging sampling point and a second ranging sampling point, wherein each data group comprises the same number of ranging data points; the system comprises a judging module, a payment processing module and a payment processing module, wherein the judging module is used for judging whether an initial system of the mobile payment device supports a multi-form payment system when a payment event is triggered, the multi-form payment system supports code scanning payment and non-contact card swiping payment, the multi-form payment system comprises a closed payment system and an open payment system, the closed payment system is combined with a payment system formed by a virtual value card or a real value card in a mode of presetting a single scene and a single payment position, and the open payment system is combined with a payment system formed by a virtual value card or a real value card in a mode of presetting at least two scenes and at least two payment positions; and the deducting and scanning reading module is used for receiving the reading operation finished by the user in a deducting and scanning mode if the multi-form payment system is supported and the first distance measurement sampling point is monitored.
The invention provides a method and a device suitable for in-screen biological feature and two-dimensional code reading.A camera which is arranged in a plurality of scenes and is configured to be suitable for bar code reading is networked with a mobile payment device of a control system based on a central processing unit supporting a biological recognition technology, and the mobile payment device, an electronic terminal controlling the mobile payment device and a server cluster which are arranged in the plurality of scenes and support the cooperative application of an input device and a printing device are connected; the method comprises the steps of acquiring data of a plurality of parameters which are sent by a server cluster and are suitable for being recognized and read by the mobile payment equipment in real time, and generating a two-dimensional code image suitable for the mobile payment equipment according to the data of the plurality of parameters; grouping continuous ranging data extracted by at least one ranging sensor aiming at a generated two-dimensional code image into a plurality of data groups according to the adjacent relation of corresponding sequences, and classifying ranging data points in each data group to be divided into a first ranging sampling point and a second ranging sampling point, wherein each data group comprises the same number of ranging data points; when a payment event is monitored to be triggered, whether an initial system of the mobile payment device supports a multi-form payment system or not is judged, wherein the multi-form payment system supports code scanning payment and non-contact card swiping payment, the multi-form payment system comprises a closed payment system and an open payment system, the closed payment system is used for presetting a single scene and a single payment position and combining a payment system formed by a virtual value storage card or a real value storage card, and the open payment system is used for presetting at least two scenes and at least two payment positions and combining a payment system formed by the virtual value storage card or the real value storage card; and if the multi-form payment system is supported and the first distance measurement sampling point is monitored, starting and receiving the reading operation finished by the user in a buckling and scanning mode. The method comprises the steps of firstly, networking is carried out, a rough segmentation and a secondary segmentation are carried out on a two-dimensional code image by adopting an Otsu algorithm, the segmentation operation suitable for the two-dimensional code image is completed by shape testing on the result obtained after the secondary segmentation operation, rapid characteristic extraction can be carried out on the two-dimensional code image through deep learning, the two-dimensional code image is intercepted as a payment image after payment information sent by a server is received, when a payment event is monitored to be triggered, whether an initial system of the mobile payment device supports a multi-form payment system or not is judged, and if the multi-form payment system is supported and a first ranging sampling point is monitored, the reading operation completed by a user in a buckling and scanning mode is started and received. In addition, still accomplish the payment demonstration through the sharing window of liquid crystal window and light guide plate window, can also detect the light change through the 360 full angles of camera that are applicable to the bar code recognition even to trigger the change operation that the LCD screen accomplished the display content through central processing unit. Specifically, when the bar code is sensed in front, the display content of the transparent screen is removed, and the display screen is changed into transparent glass so that the bar code can be conveniently read. In addition, the barcode content can be read while the content is displayed on the screen through algorithm optimization processing. Furthermore, the operation of recognizing and reading the image can be efficiently, accurately and quickly realized aiming at the two-dimensional code image under the networking environment supporting the multi-form payment system based on a plurality of scene conditions, and then the subsequent payment operation can be quickly, efficiently and flexibly completed through the identification of the biological characteristics of the user, and the system has safety and applicability.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure, the drawings needed to be used in the description of the embodiments are briefly introduced as follows:
fig. 1 is a schematic flow chart illustrating steps of a method for reading an on-screen biometric feature and a two-dimensional code according to an embodiment of the present invention;
fig. 2 is a schematic flow chart illustrating steps of a method for reading an on-screen biometric feature and a two-dimensional code according to another embodiment of the present invention; and
fig. 3 is a schematic structural diagram of an apparatus for reading an on-screen biometric feature and a two-dimensional code according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more clearly understood, specific embodiments of a method and an apparatus for identifying and reading an on-screen biometric feature and a two-dimensional code according to the present invention are described in detail below by way of examples and with reference to the accompanying drawings. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
As shown in fig. 1, a schematic flow chart of a method for reading a biometric feature and a two-dimensional code under a screen in one embodiment specifically includes the following steps:
102, networking the cameras which are arranged in a plurality of scenes and are configured to be suitable for bar code reading and mobile payment equipment of a control system of a central processing unit based on a biological recognition technology, and connecting the mobile payment equipment which is arranged in a plurality of scenes and supports the cooperative application of input equipment and a printing device, an electronic terminal for controlling the mobile payment equipment and a server cluster. The mobile payment equipment supporting the cooperative application with the input equipment and the printing device comprises at least one camera suitable for bar code reading, wherein the at least one camera suitable for bar code reading is used for sensing the light change of 360 degrees of full angles in real time, so that the change operation of the display content is completed by triggering the liquid crystal screen through the central processing unit. It can be understood that, for example, when a camera suitable for bar code reading can sense that a bar code exists in front, display content is removed, and a display screen is changed into transparent glass so as to be convenient for reading the bar code. Therefore, the intelligence and the usability of the mobile payment device are enhanced. In addition, the bar code content can be read while the content is displayed on the screen through the processing based on the preset algorithm in the central processing unit. Therefore, the diversity and the flexibility of the mobile payment equipment are improved.
As can be understood by those skilled in the art, the control system based on the central processing unit mainly comprises a code scanning sensing module, a backlight module, a light supplementing module, a biological characteristic acquisition module, an image acquisition module, a decoding module and a main control module. Specifically, sweep a yard response module and be located mobile payment equipment, sweep a yard box top promptly, but perception user's the yard action of sweeping sends this perception information to host system, and host system chip handles promptly. And after the main control chip receives the code scanning signal of the user, the transparent display window is controlled to close all display contents, the transparent display window becomes transparent glass, and the two-dimensional code image information can be allowed to pass through the transparent display window for imaging. The sensing module includes but is not limited to one or more of the following forms: an infrared distance sensing module; an ultrasonic distance sensing module; a light sensing module; and an electromagnetic field induction module. In addition, it should be noted that the code scanning sensing module can also be operated and realized by multiplexing the image acquisition module, and the movement change or the light ray change is monitored by the image acquisition module to sense the code scanning action.
Furthermore, the transparent display window can display corresponding prompt guide information according to the instruction sent by the main control module, and can also close all displays according to the instruction sent by the main control module to become a transparent glass window, so that the light of the two-dimensional code image is allowed to normally pass through, and imaging is carried out in the image acquisition module. The transparent display window can be selected from transparent liquid crystal display screens, such as transparent TN-LCD, transparent TFT-LCD, transparent OLED display screens, transparent PDP display screens and plasma display screens.
Furthermore, it should be noted that the backlight module uses a white LED lamp as a light source, and forms uniform white light through a light guide plate, a light bowl, and the like, and the uniform white light is used as a backlight source of the transparent display screen, and is also used as a code scanning light supplement to obtain clear two-dimensional code image information. And the light supplementing module is positioned above the transparent display screen, namely positioned on two sides of the transparent display light window together with the image acquisition module. When the paper bar code is read, clear bar code image information can be obtained as auxiliary illumination. The image acquisition module can acquire image information in front of the equipment and sends the acquired two-dimensional code image information to the decoding module. The biological characteristic acquisition module is used for acquiring biological characteristic information of a user, transmitting the acquired biological characteristic information to a communication module arranged in the mobile payment equipment, and transmitting the information to an upper computer or a server cluster based on the mobile payment equipment by the communication module. It should be noted that the biometric information includes, but is not limited to, fingerprint information acquisition, iris information acquisition, vein information acquisition, and voice information acquisition. The arrangement of the biological characteristic acquisition module can effectively improve the safety and the usability of payment after recognition. The decoding module carries out image processing on the acquired two-dimensional code image information, carries out two-dimensional code decoding according to a decoding algorithm and transmits a decoding result to the main control module. And the main control module is used for realizing the operation and control of each functional module of the equipment.
Further, before scanning the code, the device displays scanning guide information, money prompting information or other advertisement contents on the transparent display window. When the code scanning sensing module senses the code scanning payment action, the window display information is closed to form a completely transparent code scanning reading optical window, the image acquisition module acquires the two-dimensional code information in front through the transparent optical window, the decoding module acquires the two-dimensional code image information for decoding, and after the decoding is completed, the transparent display window displays the result information, the advertisement information and other contents. The device then enters the next code scanning loop logic. Therefore, the diversity and flexibility of the application of the mobile payment device are increased.
In addition, it should be noted that the body of the mobile payment device related to the method for identifying and reading the in-screen biometric feature and the two-dimensional code according to the present disclosure may be further configured with at least one sensor. The at least one sensor is used for collecting and detecting a plurality of environment parameters of the mobile payment device which is arranged in a plurality of scenes and supports the cooperative application of the input device and the printing device. When the collected and monitored plurality of environmental parameters of the mobile payment device are larger than the preset plurality of environmental parameters, the mobile payment device can complete reminding operation through the internal master controller. The reminding operation includes but is not limited to an acousto-optic reminding or an acoustic buzzer reminding. Therefore, the interactivity and the experience of the mobile payment device are improved. Further, it should be noted that the sensor suitable for the method for identifying and reading the in-screen biometric feature and the two-dimensional code proposed by the present disclosure includes, but is not limited to, an optical sensor, a linear displacement sensor, an angular displacement sensor, and a temperature and humidity sensor. Therefore, the usability of the electronic terminal under the real-time operating system under the condition of recognizing, reading and paying of the mobile payment device with the multiple sensors is improved.
In addition, it should be noted that the mobile payment device may be a spine type mobile payment device configured with a common window of the liquid crystal window and the light guide plate window, and includes a code scanning lamp bowl. Specifically, the common window of the liquid crystal window and the light guide plate window specifically comprises a common window main body; a fixed window is arranged on the main body; the fixed window comprises a first characteristic window and a second characteristic window which are arranged in a crossed manner; at least one fixing device is arranged on each of the first characteristic window and the second characteristic window. The fixing device comprises a clamping hook and a clamping groove; the clamping hooks and the clamping grooves are respectively arranged on two opposite sides of the first characteristic window or the second characteristic window, and the liquid crystal window or the light guide plate window can be fixed through the clamping hooks after being clamped through the clamping grooves. In addition, the fixing device comprises hooks arranged in pairs, and each pair of hooks is respectively arranged on two opposite sides of the first characteristic window or the second characteristic window. The clamping hook comprises a fixed connecting part and a clamping part; the fixed connecting part is fixedly connected with the common window main body; the clamping portion is fixedly arranged on one side of the fixed connecting portion. One side that main part was kept away from to joint portion is provided with the slip-in inclined plane, can make things convenient for the entering of light guide plate window or liquid crystal window. The side face of the clamping part close to the common window, namely one side of the light panel window or the liquid crystal window main body is vertical to the fixed connecting part. The fixed connecting part is made of elastic material. On different hooks, the distances between the clamping parts and the common window main body are different. The first characteristic window and the second characteristic window are coaxially arranged. A third characteristic window is also included; the third characteristic window is respectively communicated with the first characteristic window and the second characteristic window in a cross way; at least one fixing device is arranged on the third characteristic window.
In addition, the input device is an input keyboard which is cooperated with a desktop computer, or an input keyboard of a PC all-in-one machine, or a digital function keyboard with a calculation function and an auxiliary payment operation function. Printing device is the printer, specifically includes: the paper feeding machine comprises a machine body, wherein a paper feeding inlet and a printing outlet are arranged, a thermal printing module is arranged in the machine body, at least one low-temperature cooling cavity is arranged between the paper feeding inlet and the thermal printing module, and a laminating module, a cold pressing module and a cutting module are sequentially connected between the thermal printing module and the printing outlet through a transmission mechanism. Specifically, the at least one low-temperature cooling cavity is used for reducing the surface temperature of the paper by using cold air; the thermal printing module is used for printing paper and transmitting the printed paper to the film covering module; the film laminating module is used for receiving the paper transmitted by the thermal printing module, laminating the paper and transmitting the paper subjected to film laminating to the cold pressing module; the cold pressing module is used for receiving the paper transmitted by the film covering module, carrying out cold pressing on the paper on the surface of the film covering module and transmitting the cold-pressed paper to the cutting module; the cutting module is used for receiving the paper conveyed by the cold pressing module, cutting the paper according to the specification, and conveying the cut paper to the printing outlet. In addition, a low-temperature cooling cavity is arranged between the thermal printing module and the film covering module. In addition, still be provided with interconnect's display module, controller on the organism, thermal-sensitive printing module, tectorial membrane module, the module of colding pressing, tailor the module and all be connected with the controller and give the controller with operating condition, and the controller gives display module with operating condition transmission.
In one embodiment, the connecting the mobile payment device supporting the cooperative application with the input device and the printing device, the electronic terminal controlling the mobile payment device, and the server cluster, which are arranged in a plurality of scenes, comprises: connecting at least one mobile payment device arranged in a plurality of scenes with a cloud server cluster through WIFI; and connecting at least one mobile payment device arranged in a plurality of scenes with an electronic terminal for controlling the mobile payment device through Bluetooth connection. In addition, at least one mobile payment device arranged in a plurality of scenes can be connected with the electronic terminal for controlling the mobile payment device through wired connection. Therefore, the diversity and the multi-selectivity of the networking layout are improved.
And 104, acquiring data of a plurality of parameters which are sent by the server cluster and are suitable for payment of the mobile payment equipment in real time, and generating a two-dimensional code image suitable for the mobile payment equipment according to the data of the plurality of parameters.
In addition, it should be noted that the two-dimensional code image may be generated by combining the data of a plurality of parameters with the product code. Further, acquiring setting information required in the two-dimensional code; converting the acquired setting information into a binary file; carrying out information segmentation processing required by a structural link mode on the converted binary file to generate a plurality of different binary information with structural link characteristic characters, wherein the number of segments in the information segmentation processing required by the structural link mode on the converted binary file can be set by two-dimensional code numerical values in a range of 2-32 according to the size and application of set information; the binary file is disassembled into a plurality of corresponding parts within the range of 2-32, and corresponding start characters and end characters are respectively added before and after the binary file of each part which is disassembled; providing original binary coding information which is coded one by one for a coding part corresponding to each split part; a plurality of binary information which are different and have structural link characteristic characters are coded by two-dimensional codes which are encrypted or not one by one and are correspondingly sequenced, then information in commodity codes is obtained by combination, information conversion, encryption and sequencing are carried out according to the principle, and finally a plurality of two-dimensional code images which are sequenced according to a certain sequence are formed.
In one embodiment, the present disclosure proposesThe method suitable for reading the on-screen biological characteristics and the two-dimensional code further comprises the following steps: selecting a plurality of two-dimensional code images as training sample sets, and judging the number of the training sample sets; if the number of the training sample sets is insufficient, amplifying the sample sets to a preset number range; creating a CNN network, and initializing each parameter value of the CNN and each parameter value of the SVM; creating a Gabor filter and applying to the sample image IiExtracting the dimensions of theta-0, pi/8, pi/4, 3 pi/8, pi/2, 5 pi/8, 3 pi/4 and 7 pi/8, f-0, f-1, f-2, f-3 and f-4 to generate 40 characteristic maps; using 9-9 grid to reduce the dimension of feature map with 70-70 size to 8-8, connecting the first positions of feature map to form a feature vector Xi1=[x11,x12,…x1,m](ii) a For the same sample image I according to the size of batch valueiSequencing and inputting the created CNN network, and calculating the output of each convolution layer and each pooling layer in the hidden layer; wherein, the output of the pooling layer is used as a CNN network extraction characteristic part Xi2=[x21,x22,…x2,n]。
Suppose that the strong features of all samples are X1=[x11,x12,…x1,M]The characteristic automatically extracted by the CNN network is X2=[x21,x22,…x2,N]And for the feature vector X1、X2Carrying out standardization processing and serial fusion to obtain a fusion characteristic W ═ W1,w2,…,wM+N)=(αX1,βX2). Using PCA method to reduce dimension of W and obtaining final fusion characteristic vector W*And will fuse the feature vectors W*Inputting the training data into the SVM to train to reach the preset range error or train to reach the preset maximum iterative training generation times. Therefore, good algorithm technical support is provided for automatically extracting the characteristics of the two-dimension code image to quickly recognize and read the two-dimension code subsequently.
Further, the method for recognizing and reading the screen-type biological features and the two-dimensional codes comprises the following steps: intercepting the generated two-dimensional code image suitable for the mobile payment equipment, and dividing the payment image after the two-dimensional code image is intercepted as the payment image; according to the Otsu algorithm, performing rough segmentation operation on the region of interest in the divided payment image, wherein the Otsu algorithm is to divide the original image into two images, namely a foreground image and a background image, by using a threshold value. Specifically, the prospect is: points, mass moments and average gray levels of the foreground under the current threshold are represented by n1, csum and m 1; background: the number of points, the mass moment and the average gray level of the background under the current threshold are represented by n2, sum-csum and m 2. When the optimal threshold is taken, the difference between the background and the foreground is the largest, and the key is how to select a standard for measuring the difference, namely an Otsu algorithm, namely the maximum between-class variance, which is represented by sb, and the maximum between-class variance which is represented by fmax. Further, regarding the sensitivity of Otsu's algorithm to noise and target size, it only produces better segmentation effect on images with a single peak between classes variance. When the size ratio of the target to the background is very different, the inter-class variance criterion function may present double peaks or multiple peaks, which is not good, but the greater amount of algorithm is the least time-consuming. Further, the formula for the Otsu algorithm is derived as: recording t as a segmentation threshold of the foreground and the background, wherein the number of foreground points accounts for w0 of the image proportion, and the average gray level is u 0; the number of background points is w1 in the image scale, and the average gray scale is u 1. The total average gray scale of the image is: u-w 0 u0+ w1 u 1. The variance of the foreground and background images can be expressed by the following formula:
g (w 0 (u0-u) (u0-u) + w1 (u1-u) (u1-u) (w 0) w1 (u0-u1) (u0-u 1). It should be noted that the above formula is a variance formula. The formula for g can be referred to in probability theory, i.e. the expression for sb as described below. When the variance g is maximum, the difference between the foreground and the background at this time can be considered as maximum, and the gray level t at this time is the optimal threshold sb — w0 — w1 (u1-u0) (u0-u 1).
Further, performing secondary segmentation on the roughly segmented payment image by using an active contour model of the gradient vector flow; and completing the segmentation operation suitable for the payment image by shape testing on the result obtained after the secondary segmentation operation.
Further, it should be noted that dividing the payment image includes: selecting a segmentation channel based on a statistical rule of payment image data of a training sample; selecting a segmentation threshold value in a segmentation channel, and performing foreground and background segmentation on the payment image; and analyzing a communication region according to the segmented foreground pixels and background pixels to obtain a coding region meeting the conditions, wherein the coding region meeting the conditions is divided into payment image subblocks in a preset row and preset column dividing mode, and the preset row and the preset column are equivalent numerical values. Thereby providing the necessary data basis for subsequent rapid recognition of the payment image.
Further, selecting the split channel based on statistical rules of the payment image data of the training samples comprises: based on the statistical rules of the payment image data of the training samples, the distribution conditions of the image values in different color channels are obtained, and the color channel with the largest image value variance is obtained from the distribution conditions to form a segmentation channel. In addition, it should be further noted that selecting a segmentation threshold in a segmentation channel, and performing foreground and background segmentation on the payment image includes: obtaining a segmentation threshold value through a minimization algorithm in the Dajin algorithm; acquiring an image pixel value of a payment image; and performing dichotomy segmentation according to the image pixel value and the segmentation threshold value to obtain the foreground and the background. Further, it should be noted that, performing bisection segmentation according to the image pixel value and the segmentation threshold, and acquiring the foreground and the background includes: acquiring a region of which the image pixel value is higher than a segmentation threshold value as a foreground; and acquiring a region of which the image pixel value is lower than or equal to the segmentation threshold as a background.
Further, performing connected region analysis according to the segmented foreground pixels and background pixels, and acquiring a coding region meeting the conditions includes: clustering the segmented foreground pixels and background pixels to form a communication area; and selecting the area with the largest size and meeting the prior position information in the communication area to form a coding area meeting the conditions, and outputting the coding area meeting the conditions. Further, it should be noted that the performing of the segmentation operation suitable for the payment image by the shape test on the result obtained after the secondary segmentation operation includes: completing the graph segmentation operation suitable for the payment image by area test on the result obtained after the secondary segmentation operation, wherein the surfaceThe product test is to judge whether the number of the pixel points in the region of interest meets the pixel point threshold interval of the preset normal coding area. Furthermore, it should be noted that the performing of the segmentation operation applicable to the payment image by the shape test on the result obtained after the secondary segmentation operation includes: completing the graph segmentation operation suitable for the payment image by a simple malformation degree calculation formula gamma l/N on the result obtained after the rough segmentation operation through a malformation degree testpCalculating the degree of deformity of the region of interest, wherein l is the perimeter of the region of interest, and N ispThe number of pixel points in the region of interest is counted; presetting a high threshold gamma of degree of deformityT(ii) a When gamma is less than or equal to gammaTJudging that the result obtained after the rough segmentation operation passes the deformity degree test; when gamma > gammaTAnd then, carrying out secondary rough segmentation operation on the region of interest by the segmentation method of the active contour model based on the gradient vector flow, and completing the segmentation operation suitable for the payment image by shape testing on the result obtained after the secondary rough segmentation operation.
And 106, grouping continuous ranging data extracted by at least one ranging sensor aiming at the generated two-dimensional code image into a plurality of data groups according to the adjacent relation of corresponding sequences, and classifying ranging data points in each data group to be divided into a first ranging sampling point and a second ranging sampling point, wherein each data group comprises the same number of ranging data points.
In addition, it should be noted that the method for recognizing and reading the screen-type biometric feature and the two-dimensional code provided by the present disclosure can also recognize and read a combined image of the two-dimensional code image and the identification card image. Specifically, the specific steps of combining the two-dimensional code image with the acquired identification card image are as follows: acquiring a two-dimensional code image and an identity card image to be fused; determining an alpha image of the two-dimensional code image; adjusting the transparency of the two-dimensional code image through the alpha image to obtain a foreground image; adjusting the transparency of the identity card image through the alpha image to obtain a background image; and fusing the foreground image and the background image. Further, before acquiring the two-dimensional code image and the identity card image to be fused, the method further comprises the following steps: and adjusting the size of the two-dimensional code image or the identity card image so that the two-dimensional code image is superposed at the preset position of the identity card image.
Further, determining an alpha image of the two-dimensional code image includes: determining an alpha image of the two-dimensional code image by an image coding processing method; determining an alpha image of the two-dimensional code image by the image coding processing method comprises the following steps: reading the two-dimensional code image through a first OpenCV function to convert the two-dimensional code image into a first matrix; separating the first matrix through a second OpenCV function to obtain an alpha image channel matrix; and determining an alpha image according to the alpha image channel matrix. Further, adjusting the transparency of the two-dimensional code image through the alpha image to obtain a foreground image, comprising: separating the first matrix through a second OpenCV function to obtain a first RGB image channel matrix; point-multiplying the first RGB image channel matrix and the alpha image channel matrix through a third OpenCV function to obtain a foreground matrix; and determining a foreground image according to the foreground matrix. In addition, it should be further noted that, adjusting the transparency of the identity card image through the alpha image to obtain the background image includes: calculating an alpha pixel inverse matrix; reading the identity card image through a first OpenCV function to convert the identity card image into a second matrix; separating the second matrix through a second OpenCV function to obtain a second RGB image channel matrix; point-multiplying the second RGB image channel matrix and the alpha pixel inverse matrix through a third OpenCV function to obtain a background matrix; and determining a background image according to the background matrix. Further, fusing the foreground image and the background image, comprising: adding the foreground matrix and the background matrix to obtain a fusion image matrix; and merging the fused image matrix through a fourth OpenCV function to obtain a fused image. And combining the generated two-dimensional code image with the fused image of the acquired identification card image by at least one ranging sensor to extract continuous ranging data, grouping the continuous ranging data into a plurality of data groups according to the adjacent relation of the corresponding sequences, and classifying the ranging data points in each data group to be divided into a first ranging sampling point and a second ranging sampling point, wherein each data group comprises the same number of ranging data points. Therefore, the applicability of the mobile payment equipment for reading the bar code is improved.
In addition, it should be further noted that classifying the ranging data points in each data group to be divided into a first ranging sample point and a second ranging sample point includes: one or more distance measurement data points are selected from each data group according to a selection rule to serve as first distance measurement sampling points, the rest distance measurement data points serve as second distance measurement sampling points, and meanwhile, the same number of key distance measurement sampling points are contained in each data group. It should be noted that the selection rule includes at least any one of the following: selecting a range data point of an effective range measurement from each data set as a first range sampling point, wherein the effective range measurement satisfies the following condition: reading data exceeding a preset distance, measuring a target distance or measuring a signal within a preset range; and determining the distance between each data group and other ranging data points as ranging data points exceeding a preset distance threshold value to serve as first ranging sampling points.
And 108, when the payment event is monitored to be triggered, judging whether the initial system of the mobile payment device supports a multi-form payment system. The multi-form payment system supports code scanning payment and non-contact card swiping payment, and comprises a closed payment system and an open payment system. The closed payment system is a payment system which is formed by presetting a single scene, a single payment position and combining a virtual value storage card or a real value storage card; the open payment system is a payment system which is formed by presetting at least two scenes and at least two payment positions and combining a virtual stored value card or a real stored value card.
Further, it is understood that a closed payment system, such as a savings system in a retail store, may be used by a consumer to save money for later use, based on a stored value card (virtual or physical) that can only be held back at one store, and a mobile application may be deployed to allow the consumer to hold back the stored value. When the system is used, the QR code or the bar code is displayed at a point of sale, a user can store the value of the card infinitely, only money which is wanted to be spent in a specific merchant is stored, the financial information and the bank account exposure of the user are avoided, and the system is also an effective mode for arranging budget for specific types of consumption for the user. Such as groceries or restaurants, merchants typically combine customer loyalty with a closed payment system, such as a closed payment card, to keep customers back streaming. In addition, open payment systems, such as a savings system in a retail store, a savings system in a restaurant or grocery store, where the consumer may have a deposit for later use, may be based on a stored value card (virtual or real) that can be held back at multiple stores, and a mobile application may be deployed to allow the consumer to hold back the stored value. When the method is used, the QR code or the bar code is displayed at a point of sale, a user can store the value of the card infinitely and only stores money which the user wants to spend in a specific merchant, so that the compatibility and the data sharing of the financial information and the bank account of the user in a plurality of payment scenes and payment positions are facilitated, and the method is an effective way for the user to arrange budget for specific types of consumption. Such as groceries or restaurants, merchants typically combine customer consumption replacement with an open payment system, such as an open payment card, to allow customers to consume back-streams.
And step 110, receiving the recognition operation finished by the user in a buckling and scanning mode if the multi-form payment system is supported and the first distance measurement sampling point is monitored. In addition, it should be noted that the method for recognizing and reading the below-screen biometric feature and the two-dimensional code provided by the present disclosure further includes: and payment display is completed through a common window of the liquid crystal window and the light guide plate window. From this, the convenience and the ease of use of payment after through accurate and swift recognition two-dimensional code have been improved. Note that, the common window of the liquid crystal window and the light guide plate window is used to display a specific payment amount and a payment status (the payment status includes payment in progress, payment success or payment failure). In addition, it should be noted that, when the common window of the liquid crystal window and the light guide plate window is not used for payment display, the common window is used for playing the advertisement information pushed by the cloud server and the propaganda content of the scene where the common window is located. Therefore, the beneficial effects that the shared window of the liquid crystal window and the light guide plate window is multifunctional, flexible and efficient to operate and display payment are achieved.
Specifically, if support the multi-form payment system and when monitoring first range finding sampling point, the recognition operation that the user was accomplished through the mode of deducting and sweeping includes: establishing a mapping relation between the characteristics of the cash register commodity and the price of the cash register commodity; according to the mapping relation, the commodity price in each commodity and the price of the commodity corresponding to the current payment image are obtained; and finishing the cash register operation according to the price of the commodity corresponding to the current payment image. And obtaining the commodity price of each commodity according to the mapping relation, accumulating the commodity prices, and obtaining the price of the commodity corresponding to the current payment image. It can be understood that the prices of the accumulated commodities are pre-stored, and the prices of the commodities can be quickly analyzed and obtained through deep learning according to historical data of user shopping. It should be noted that, in order to increase the user experience, the data of the cash register operation and the completion status are displayed. In addition, it should be noted that the snap-scanning mode is that the user holds the electronic terminal by hand, and faces the display screen of the electronic terminal and the two-dimensional code scanning window of the mobile payment device. The technical field personnel can understand that the built-in binocular camera or at least one sensor of the mobile payment equipment can be effectively sensed in a buckling and sweeping mode, and technical support is provided for efficient payment.
In an embodiment, it should be noted that the method for recognizing and reading the below-screen biometric feature and the two-dimensional code according to the present disclosure further includes: after the payment event is monitored to be triggered, when the electronic terminal is charged, deleting the payment image from the picture library, and setting a default picture in a built-in system of the electronic terminal as a prompt image; and when the current electric quantity of the electronic terminal is lower than a preset electric quantity threshold value, setting a default picture in a built-in system of the electronic terminal as a prompt image. The prompt image is a power-off low-power prompt image of the mobile payment device. In addition, the method further comprises the following steps: the method comprises the steps of obtaining the illumination intensity of a screen of the electronic terminal and the illumination intensity reflected by the screen of the electronic terminal in a preset time period, and constructing a screen illumination intensity database aiming at the electronic terminal and a screen reflection illumination intensity database aiming at the electronic terminal. Therefore, payment operation can be completed quickly and accurately by adapting corresponding illumination intensity of different mobile payment equipment models according to different scenes.
In order to more clearly and accurately understand and apply the method for recognizing and reading the in-screen biometric feature and the two-dimensional code according to the present disclosure, the following example is performed in conjunction with fig. 2, and it should be noted that the scope of the present disclosure is not limited to the following example.
Specifically, the steps 201 to 208 are sequentially: receiving a plurality of images; dividing the image into N × N sub-blocks, performing rough segmentation operation through an Otsu algorithm, judging whether the region of interest conforms to the basic coding form, and if the region of interest conforms to the basic coding form, sending the image of the region of interest to a preset feature model to complete feature extraction of the payment image; if the region of interest does not accord with the basic coding form, performing secondary segmentation operation on the active contour model based on the gradient vector flow, and then judging whether the region of interest accords with the basic coding form, if so, sending the image of the region of interest to a preset feature model to finish feature extraction of the payment image; and if the interested region does not conform to the basic form of the code, removing impurities in the payment image.
It is understood that the received payment image is divided; according to the Dajin algorithm, performing rough segmentation operation and secondary segmentation operation on the region of interest in the divided payment image; and completing the segmentation operation suitable for the payment image according to the result obtained after the secondary segmentation operation through shape testing. Specifically, for a payment image, the payment image is roughly segmented by adopting an Otsu algorithm and secondarily segmented by an active contour model of a gradient vector flow to obtain the payment image which is free of noise and convenient to read; the results of the above segmentation were then subjected to shape testing.
It should be noted that the test conditions are: and (6) area testing. Number N Of pixels in ROI (Region Of Interest)pI.e. whether the ROI area corresponds to the range of the normal coding area [ N ]min,Nmax]Within; and (5) testing the degree of deformity. Calculating the formula gamma as l/N by simple malformation degreepCalculating the malformation degree of the ROI region, wherein l is the perimeter of the ROI and is provided with a high malformation degree threshold value gammaTWhen gamma is less than or equal to gammaTThe test passed. Further, if the test condition passes, the ROI is a payment image and enters a feature extraction module; if the ROI region that does not pass the test condition, i.e., the pay image with noise or foreign matter, is possible, the segmentation method based on the active contour model of the gradient vector flow performs a secondary segmentation on the ROI region, and then performs a shape test on the secondary segmentation result, with the test condition being as described above. Wherein, as can be understood by those skilled in the art, the ROI is an impurity when the test is not passed, and is directly discarded; and the ROI passing the test is a payment image, and a preset feature extraction module is used for carrying out feature extraction on the payment image.
As will be understood by those skilled in the art, the classical active contour model often has certain disadvantages when selecting an initial contour curve, such as being far away from a target curve and unable to converge on the target curve, and also has a poor convergence effect on a concave edge. Aiming at the problems, the traditional active contour model is improved, and an active contour model based on gradient vector flow is provided. The active contour model based on gradient vector flow replaces a Gaussian potential energy field in a traditional model, and the mathematical theoretical basis of the active contour model is Helmholtz theorem in an electromagnetic field. Compared with a Gaussian potential energy field, the gradient vector diagram of the whole image is obtained based on the field of the gradient vector flow, so that the action range of the external force field is larger. This also means that even if the selected initial contour is far from the target contour, it will eventually converge to the target contour through successive approximation. Meanwhile, after the external force action range is enlarged, the external force action of the concave part at the target contour is enlarged, so that the boundary can be converged to the concave part.
The invention provides a method suitable for recognizing and reading biological characteristics and two-dimensional codes under a screen, which comprises the steps of networking, roughly dividing and secondarily dividing a two-dimensional code image by adopting an extra algorithm, completing the division operation suitable for the two-dimensional code image by shape testing on the result obtained after the secondary division operation, rapidly extracting the characteristics of the two-dimensional code image through deep learning, intercepting the two-dimensional code image as a payment image after receiving payment information sent by a server, judging whether an initial system of a mobile payment device supports a multi-form payment system or not when monitoring that a payment event is triggered, and starting and receiving the recognizing and reading operation completed by a buckling scanning mode by a user if the initial system supports the multi-form payment system and monitors a first distance measurement sampling point. In addition, still accomplish the payment demonstration through the sharing window of liquid crystal window and light guide plate window, can also detect the light change through the 360 full angles of camera that are applicable to the bar code recognition even to trigger the change operation that the LCD screen accomplished the display content through central processing unit. Specifically, when the bar code is sensed in front, the display content of the transparent screen is removed, and the display screen is changed into transparent glass so that the bar code can be conveniently read. In addition, the barcode content can be read while the content is displayed on the screen through algorithm optimization processing. Furthermore, the operation of recognizing and reading the image can be efficiently, accurately and quickly realized aiming at the two-dimensional code image under the networking environment supporting the multi-form payment system based on a plurality of scene conditions, and then the subsequent payment operation can be quickly, efficiently and flexibly completed through the identification of the biological characteristics of the user, and the system has safety and applicability.
Based on the same invention concept, the invention also provides a device suitable for recognizing and reading the under-screen biological characteristics and the two-dimensional code. Because the principle of solving the problems of the device is similar to the method suitable for recognizing and reading the screen-type biological characteristics and the two-dimensional codes, the implementation of the device can be realized according to the specific steps of the method, and repeated parts are not repeated.
Fig. 3 is a schematic structural diagram of an apparatus suitable for reading an on-screen biometric feature and a two-dimensional code in an embodiment. This device 10 suitable for screen following formula biological characteristics and two-dimensional code recognition includes: networking and connecting module 100, acquiring and image generating module 200, classifying module 300, judging module 400 and deduction scanning and reading module 500.
The networking and connecting module 100 is used for networking cameras arranged in a plurality of scenes and configured to be suitable for bar code reading and mobile payment equipment of a control system of a central processing unit based on a support biological identification technology, and connecting the mobile payment equipment which is arranged in the plurality of scenes and supports cooperative application of input equipment and a printing device, an electronic terminal for controlling the mobile payment equipment and a server cluster, wherein the mobile payment equipment which supports cooperative application of the input equipment and the printing device comprises at least one camera suitable for bar code reading, and the at least one camera suitable for bar code reading is used for sensing light change of 360 degrees at a full angle in real time so as to trigger a liquid crystal display to complete change operation of display content through the central processing unit; the acquisition and image generation module 200 is configured to acquire data of multiple parameters, which are sent by the server cluster and are suitable for being recognized and read by the mobile payment device, in real time, and generate a two-dimensional code image suitable for the mobile payment device according to the data of the multiple parameters; the classification module 300 is configured to group continuous ranging data extracted by at least one ranging sensor for a generated two-dimensional code image into a plurality of data groups according to an adjacent relationship of corresponding sequences, and classify ranging data points in each data group to be divided into a first ranging sampling point and a second ranging sampling point, where each data group includes the same number of ranging data points; the judging module 400 is configured to judge whether an initial system of the mobile payment device supports a multi-form payment system when it is monitored that a payment event is triggered, where the multi-form payment system supports code scanning payment and contactless card swiping payment, the multi-form payment system includes a closed payment system and an open payment system, the closed payment system presets a single scene and a single payment position and combines a payment system composed of a virtual value storage card or a real value storage card, and the open payment system presets at least two scenes and at least two payment positions and combines a payment system composed of a virtual value storage card or a real value storage card; the deduction and scanning recognition module 500 is used for receiving the recognition operation finished by the user in the deduction and scanning mode if the multi-form payment system is supported and the first distance measurement sampling point is monitored.
The invention provides a device suitable for recognizing and reading biological characteristics and two-dimensional codes under a screen, which is characterized in that networking is firstly carried out, a large amount of algorithm is adopted to carry out rough segmentation and secondary segmentation on a two-dimensional code image, the segmentation operation suitable for the two-dimensional code image is completed through shape testing on the result obtained after the secondary segmentation operation, rapid characteristic extraction can be carried out on the two-dimensional code image through deep learning, the two-dimensional code image is intercepted as a payment image after payment information sent by a server is received, when a payment event is monitored to be triggered, whether an initial system of a mobile payment device supports a multi-form payment system or not is judged, and if the multi-form payment system is supported and a first distance measurement sampling point is monitored, the recognizing and reading operation completed by a buckling and scanning mode by a user is started and received. In addition, still accomplish the payment demonstration through the sharing window of liquid crystal window and light guide plate window, can also detect the light change through the 360 full angles of camera that are applicable to the bar code recognition even to trigger the change operation that the LCD screen accomplished the display content through central processing unit. Specifically, when the bar code is sensed in front, the display content of the transparent screen is removed, and the display screen is changed into transparent glass so that the bar code can be conveniently read. In addition, the barcode content can be read while the content is displayed on the screen through algorithm optimization processing. Furthermore, the operation of recognizing and reading the image can be efficiently, accurately and quickly realized aiming at the two-dimensional code image under the networking environment supporting the multi-form payment system based on a plurality of scene conditions, and then the subsequent payment operation can be quickly, efficiently and flexibly completed through the identification of the biological characteristics of the user, and the system has safety and applicability.
An embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and the computer program is executed by the processor in fig. 1 or fig. 2. The embodiment of the invention also provides a computer program product containing the instruction. When the computer program product is run on a computer, it causes the computer to perform the method of fig. 1 or fig. 2 described above.
Those skilled in the art will appreciate that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. The storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), or the like. The above-mentioned embodiments only express several embodiments of the present invention, and the description thereof is more specific and detailed, but not construed as limiting the scope of the present invention. It will be apparent to those skilled in the art that various changes and modifications can be made without departing from the spirit and scope of the invention. Therefore, the protection scope of the present patent shall be subject to the appended claims. The foregoing description has been presented for purposes of illustration and description. This description is not intended to limit embodiments of the disclosure to the form disclosed herein. While a number of example aspects and embodiments have been discussed above, those of skill in the art will recognize certain variations, modifications, alterations, additions and sub-combinations thereof.
Claims (10)
1. A method suitable for recognizing and reading biological characteristics and two-dimensional codes in a screen-following mode is characterized by comprising the following steps:
the method comprises the steps that cameras which are arranged in a plurality of scenes and are configured to be suitable for bar code reading and mobile payment equipment of a control system of a central processing unit based on a biological recognition technology are networked, and the mobile payment equipment which is arranged in the plurality of scenes and supports the cooperative application of an input device and a printing device, an electronic terminal for controlling the mobile payment equipment and a server cluster are connected, wherein the mobile payment equipment which supports the cooperative application of the input device and the printing device comprises at least one camera suitable for bar code reading, and the at least one camera suitable for bar code reading is used for sensing light change of 360 degrees in a full angle in real time so as to trigger a liquid crystal display to complete change operation of display content through the central processing unit;
acquiring data of a plurality of parameters which are sent by the server cluster and are suitable for being recognized and read by the mobile payment equipment in real time, and generating a two-dimensional code image suitable for the mobile payment equipment according to the data of the plurality of parameters;
grouping continuous ranging data extracted by at least one ranging sensor for the generated two-dimensional code image into a plurality of data groups according to the adjacent relation of corresponding sequences, and classifying ranging data points in each data group to be divided into a first ranging sampling point and a second ranging sampling point, wherein each data group comprises the same number of ranging data points;
when a payment event is monitored to be triggered, judging whether an initial system of the mobile payment device supports a multi-form payment system or not, wherein the multi-form payment system supports code scanning payment and non-contact card swiping payment, the multi-form payment system comprises a closed payment system and an open payment system, the closed payment system is combined with a payment system formed by a virtual value storage card or a real value storage card in a preset single scene and a preset single payment position, and the open payment system is combined with the payment system formed by the virtual value storage card or the real value storage card in a preset at least two scenes and at least two payment positions;
and receiving the recognition operation finished by the user in a buckling and scanning mode if the multi-form payment system is supported and the first distance measurement sampling point is monitored.
2. The method for recognizing and reading the in-screen biometric features and the two-dimensional codes according to claim 1, wherein the connecting the mobile payment device supporting the cooperative application of the input device and the printing device, the electronic terminal controlling the mobile payment device, and the server cluster, which are arranged in a plurality of scenes, comprises: connecting at least one mobile payment device arranged in a plurality of scenes with a cloud server cluster through WIFI;
and connecting the at least one mobile payment device arranged in a plurality of scenes with the electronic terminal for controlling the mobile payment device through Bluetooth connection.
3. The method for recognizing and reading the in-screen biometric features and the two-dimensional codes according to claim 1, further comprising: acquiring capability values corresponding to a plurality of protocol stacks in the mobile payment equipment and a channel identifier currently bound with the protocol stack with the maximum value of the capability values;
selecting a corresponding channel according to the acquired channel identifier;
and completing the payment operation applicable to the mobile payment device through the selected channel.
4. The method for recognizing and reading the in-screen biometric features and the two-dimensional codes according to claim 1, further comprising: selecting a plurality of two-dimensional code images as a training sample set, and judging the number of the training sample set;
if the number of the training sample sets is insufficient, amplifying the sample sets to a preset number range;
creating a CNN network, and initializing each parameter value of the CNN and each parameter value of the SVM;
creating a Gabor filter and applying to the sample image IiExtracting the dimensions of theta-0, pi/8, pi/4, 3 pi/8, pi/2, 5 pi/8, 3 pi/4 and 7 pi/8, f-0, f-1, f-2, f-3 and f-4 to generate 40 characteristic maps;
using 9-9 grid to reduce the dimension of feature map with 70-70 size to 8-8, connecting the first positions of feature map to form a feature vector Xi1=[x11,x12,…x1,m];
For the same sample image I according to the size of batch valueiSequencing and inputting the created CNN network, and calculating the output of each convolution layer and each pooling layer in the hidden layer; wherein the output of the pooling layer is used as the CNN network extraction feature part Xi2=[x21,x22,…x2,n];
Suppose that the strong features of all samples are X1=[x11,x12,…x1,M]The characteristic automatically extracted by the CNN network is X2=[x21,x22,…x2,N]And for the feature vector X1、X2Carrying out standardization processing and serial fusion to obtain a fusion characteristic W ═ W1,w2,…,wM+N)=(αX1,βX2);
Using PCA method to reduce W dimension and obtain final fusionResultant eigenvector W*And fusing the feature vectors W*Inputting the training data into the SVM to train to reach the preset range error or train to reach the preset maximum iterative training generation times.
5. The method for recognizing and reading the in-screen biometric features and the two-dimensional codes according to claim 1, further comprising: the method comprises the steps of obtaining the illumination intensity of a screen of the electronic terminal and the illumination intensity reflected by the screen of the electronic terminal in a preset time period, and constructing a screen illumination intensity database aiming at the electronic terminal and a screen reflection illumination intensity database aiming at the electronic terminal.
6. The method for recognizing and reading the in-screen biometric features and the two-dimensional codes according to claim 1, further comprising: intercepting the generated two-dimensional code image suitable for the mobile payment equipment, and dividing the payment image after the two-dimensional code image is intercepted as the payment image;
according to the Dajin algorithm, performing rough segmentation operation on the region of interest in the divided payment image;
performing secondary segmentation on the roughly segmented payment image by using an active contour model of a gradient vector flow;
and completing the segmentation operation suitable for the payment image by shape testing on the result obtained after the secondary segmentation operation.
7. The method for on-screen biometric and two-dimensional code recognition according to claim 6, wherein the dividing the payment image comprises: selecting a segmentation channel based on statistical rules of the payment image data of training samples;
selecting a segmentation threshold value in the segmentation channel, and performing foreground and background segmentation on the payment image;
and analyzing a communication region according to the segmented foreground pixels and background pixels to obtain a coding region meeting the conditions, wherein the coding region meeting the conditions is divided into the payment image subblocks in a preset row and preset column dividing mode, and the preset row and the preset column are equal numerical values.
8. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the method according to any one of claims 1 to 7.
9. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the steps of the method of any of claims 1-7 are implemented when the program is executed by the processor.
10. The utility model provides a device suitable for screen following formula biological feature and two-dimensional code recognition, its characterized in that, the device includes:
the networking and connecting module is used for networking cameras which are arranged in a plurality of scenes and are configured to be suitable for bar code reading and mobile payment equipment of a control system of a central processing unit based on a support biological identification technology, and connecting the mobile payment equipment which is arranged in a plurality of scenes and supports the cooperative application of an input device and a printing device, an electronic terminal for controlling the mobile payment equipment and a server cluster, wherein the mobile payment equipment which supports the cooperative application of the input device and the printing device comprises at least one camera suitable for bar code reading, and the at least one camera suitable for bar code reading is used for sensing light change of 360 degrees at a full angle in real time so as to trigger a liquid crystal display to complete change operation of display content through the central processing unit;
the acquisition and image generation module is used for acquiring data of a plurality of parameters which are sent by the server cluster and are suitable for being recognized and read by the mobile payment equipment in real time and generating a two-dimensional code image suitable for the mobile payment equipment according to the data of the plurality of parameters;
the classification module is used for grouping continuous ranging data extracted by at least one ranging sensor aiming at the generated two-dimensional code image into a plurality of data groups according to the adjacent relation of corresponding sequences, and classifying ranging data points in each data group to be divided into a first ranging sampling point and a second ranging sampling point, wherein each data group comprises the same number of ranging data points;
the system comprises a judging module, a payment processing module and a payment processing module, wherein the judging module is used for judging whether an initial system of the mobile payment device supports a multi-form payment system when a payment event is triggered, the multi-form payment system supports code scanning payment and non-contact card swiping payment, the multi-form payment system comprises a closed payment system and an open payment system, the closed payment system is combined with a payment system formed by a virtual value card or a real value card in a mode of presetting a single scene and a single payment position, and the open payment system is combined with a payment system formed by a virtual value card or a real value card in a mode of presetting at least two scenes and at least two payment positions;
and the deducting and scanning reading module is used for receiving the reading operation finished by the user in a deducting and scanning mode if the multi-form payment system is supported and the first distance measurement sampling point is monitored.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201811511604.7A CN111311227A (en) | 2018-12-11 | 2018-12-11 | Method and device suitable for in-screen type biological feature and two-dimensional code recognition |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201811511604.7A CN111311227A (en) | 2018-12-11 | 2018-12-11 | Method and device suitable for in-screen type biological feature and two-dimensional code recognition |
Publications (1)
Publication Number | Publication Date |
---|---|
CN111311227A true CN111311227A (en) | 2020-06-19 |
Family
ID=71146535
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201811511604.7A Withdrawn CN111311227A (en) | 2018-12-11 | 2018-12-11 | Method and device suitable for in-screen type biological feature and two-dimensional code recognition |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN111311227A (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11475424B2 (en) * | 2020-08-03 | 2022-10-18 | Alipay (Hangzhou) Information Technology Co., Ltd. | Method and system for implementing interworking of different payment operations |
-
2018
- 2018-12-11 CN CN201811511604.7A patent/CN111311227A/en not_active Withdrawn
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11475424B2 (en) * | 2020-08-03 | 2022-10-18 | Alipay (Hangzhou) Information Technology Co., Ltd. | Method and system for implementing interworking of different payment operations |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN111311226A (en) | Machine vision-based two-dimensional code reading method and device under complex background | |
CN111311244A (en) | Passive code scanning method and device based on QR (quick response) code | |
CN111311227A (en) | Method and device suitable for in-screen type biological feature and two-dimensional code recognition | |
CN111311233A (en) | Passive code scanning method and device based on multi-trigger mode | |
TWI769387B (en) | Payment processing method, apparatus, and self-checkout device | |
CN111310492A (en) | In-screen two-dimensional code reading method and device suitable for adjustable light source | |
CN111311248A (en) | Method and device for recognizing and reading two-dimensional code under low-power-consumption screen | |
CN111311225A (en) | Optical module encryption-based in-screen payment method and device | |
CN111311241A (en) | Two-dimensional code reading method and device based on scene perception | |
CN109816393B (en) | Method and device for identifying and verifying biological characteristics under screen | |
CN111311229A (en) | Chinese-sensible code based passive code scanning method and device | |
CN111310499A (en) | Method and device for identifying and reading two-dimensional code under screen based on photoelectric sensor | |
CN111310494A (en) | Method and device for recognizing and reading two-dimensional code under screen based on double-screen display | |
CN111310493A (en) | Method and device for identifying and reading two-dimensional code under screen based on multiple sensors | |
CN111311242A (en) | Method and device suitable for in-screen quick reading of two-dimensional code | |
CN111310501A (en) | Two-dimensional code reading method and device suitable for comprehensive screen | |
CN111311223A (en) | Multi-user barrier-free code scanning payment method and device applied to android system | |
CN111311239A (en) | Perspective two-dimensional code reading method and device suitable for double-screen double-camera | |
CN111311240A (en) | Multi-user barrier-free code scanning payment method and device applied to IOS (input/output system) | |
CN111310496A (en) | Under-screen two-dimensional code reading method and device with adaptive light supplement function | |
CN111311237A (en) | Face and bar code double-recognition method and device | |
CN111311224A (en) | Waving code scanning method and device for identifying multi-trigger mode of bill | |
CN111311235A (en) | Buckling scanning code scanning method and device for identifying multi-trigger mode of bill | |
CN111311222A (en) | Waving code scanning method and device suitable for multiple communication modes | |
CN111311243A (en) | Code buckling, scanning and scanning method and device suitable for multiple video communication modes |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
WW01 | Invention patent application withdrawn after publication | ||
WW01 | Invention patent application withdrawn after publication |
Application publication date: 20200619 |