CN111126341A - Service system for blind people - Google Patents
Service system for blind people Download PDFInfo
- Publication number
- CN111126341A CN111126341A CN201911415416.9A CN201911415416A CN111126341A CN 111126341 A CN111126341 A CN 111126341A CN 201911415416 A CN201911415416 A CN 201911415416A CN 111126341 A CN111126341 A CN 111126341A
- Authority
- CN
- China
- Prior art keywords
- path
- black
- white
- client
- electrically connected
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000015572 biosynthetic process Effects 0.000 claims description 17
- 238000003786 synthesis reaction Methods 0.000 claims description 16
- 238000000034 method Methods 0.000 claims description 8
- 239000000284 extract Substances 0.000 claims description 6
- 238000000605 extraction Methods 0.000 claims description 3
- 238000007670 refining Methods 0.000 claims 1
- 230000002194 synthesizing effect Effects 0.000 claims 1
- 208000010415 Low Vision Diseases 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000001914 filtration Methods 0.000 description 2
- 230000004303 low vision Effects 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000003416 augmentation Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000004438 eyesight Effects 0.000 description 1
- 238000005286 illumination Methods 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/10—Terrestrial scenes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/90—Determination of colour characteristics
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L13/00—Speech synthesis; Text to speech systems
- G10L13/02—Methods for producing synthetic speech; Speech synthesisers
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Computational Linguistics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Acoustics & Sound (AREA)
- Image Processing (AREA)
Abstract
The invention relates to a blind person service system, which comprises a camera, a client, a server and a broadcaster, wherein the camera is connected with the client; wherein: the output end of the camera is electrically connected with the input end of the client, the output end of the client is electrically connected with the input end of the server, the output end of the server is electrically connected with the input end of the client, and the output end of the client is electrically connected with the input end of the broadcaster. The invention provides a blind person service system, wherein a camera acquires image information, the image information is converted into voice information through a service terminal, and the voice information is broadcasted to a user through a broadcaster.
Description
Technical Field
The invention relates to the field of data processing, in particular to a blind person service system.
Background
In recent years, the number of blind people has attracted attention. According to statistics, about 45 tens of thousands of blind people and 135 thousands of low-vision patients occur in China every year, namely 1 blind person and 3 low-vision patients occur every minute, and the high operation cost cannot be borne by a plurality of families.
Various blind devices exist that convert vision into information that can be perceived by other senses by the combination of image recognition and various sensory devices. The system specifically covers AR reality augmentation technology, voice synthesis technology, position navigation and the like, and can basically help the blind to realize the function of autonomous life. But the disadvantages are that the popularization is greatly reduced due to high price, the equipment is single, and the background management is lacked.
Disclosure of Invention
The invention provides a blind person service system for solving the problems that various existing blind person devices are single and lack of background management, and the blind person service system is applied to various blind person devices and can be managed in a centralized manner through a client.
In order to realize the purpose, the technical scheme is as follows:
a blind service system comprises a camera, a client, a server and a broadcaster; wherein: the output end of the camera is electrically connected with the input end of the client, the output end of the client is electrically connected with the input end of the server, the output end of the server is electrically connected with the input end of the client, and the output end of the client is electrically connected with the input end of the broadcaster.
According to the technical scheme, the camera acquires image information, converts the image information into voice information through the server side, and broadcasts the voice information to the user through the broadcaster.
The server comprises an image recognition module, a path analysis module and a voice synthesis module; wherein: the output end of the client is electrically connected with the input end of the image recognition module, the output end of the image recognition module is electrically connected with the input end of the path analysis module, and the output end of the path analysis module is electrically connected with the input end of the voice synthesis module.
The image identification module converts image information into binary image information through Matlab, extracts associated features and removes redundant information, and sends the binary image information to the path analysis module.
The path analysis module receives the binarization image information, identifies a black-and-white path by using a filtering binarization black-and-white path identification algorithm, extracts the black-and-white path by using a centerline method, and sends path information to the voice synthesis module after extraction.
The filtered binarization black-white path identification algorithm is to judge all pixel point values of an image, if the value of the point is less than or equal to a threshold value, the value is assigned to 255, namely white, otherwise, the value is assigned to 0, namely black, and finally the path is displayed in black or white.
The centerline method for extracting the black and white path is to refine the black and white path area into lines as the essential characteristics of the black and white path.
And the voice synthesis module carries out voice synthesis on the information of the black and white path by calling the message flying API voice interface and sends the synthesized voice information to the client.
Compared with the prior art, the invention has the beneficial effects that:
the invention provides a blind person service system, wherein a camera acquires image information, the image information is converted into voice information through a service terminal, and the voice information is broadcasted to a user through a broadcaster.
Drawings
FIG. 1 is a block flow diagram of the present invention;
FIG. 2 is a graph of R, G, B color component gray scale saturation values according to the present invention;
description of reference numerals: 1. a camera; 2. a client; 3. a server side; 4. a broadcaster; 31. an image recognition module; 32. a path analysis module; 33. and a voice synthesis module.
Detailed Description
The drawings are for illustrative purposes only and are not to be construed as limiting the patent;
the invention is further illustrated below with reference to the figures and examples.
Example 1
As shown in fig. 1, a blind person service system includes a camera 1, a client 2, a server 3 and a broadcaster 4; wherein: the output of the camera 1 is electrically connected with the input of the client 2, the output of the client 2 is electrically connected with the input of the server 3, the output of the server 3 is electrically connected with the input of the client 2, and the output of the client 2 is electrically connected with the input of the broadcaster 4.
In the scheme, the camera 1 acquires image information, converts the image information into voice information through the server 3, and broadcasts the voice information to the user through the broadcaster 4.
The server 3 comprises an image recognition module 31, a path analysis module 32 and a voice synthesis module 33; wherein: the output end of the client 2 is electrically connected to the input end of the image recognition module 31, the output end of the image recognition module 31 is electrically connected to the input end of the path analysis module 32, and the output end of the path analysis module 32 is electrically connected to the input end of the voice synthesis module 33.
The image recognition module 31 converts the image information into binarized image information through Matlab, extracts the associated features and removes redundant information, and sends the binarized image information to the path analysis module.
The path analysis module 32 receives the binarized image information, identifies the black-and-white path by using an algorithm for identifying the black-and-white path by filtering binarization, extracts the black-and-white path by using a centerline method, and sends the path information to the speech synthesis module after extraction.
The filtered binarization black-white path identification algorithm is to judge all pixel point values of an image, if the value of the point is less than or equal to a threshold value, the value is assigned to 255, namely white, otherwise, the value is assigned to 0, namely black, and finally the path is displayed in black or white.
The centerline method for extracting the black and white path is to refine the black and white path area into lines as the essential characteristics of the black and white path.
The voice synthesis module 33 performs voice synthesis on the information of the black and white path by calling the message API voice interface, and sends the synthesized voice information to the client.
Example 2
As shown in fig. 2, an algorithm for identifying color paths using an RGB color space can rapidly detect a path of a given color. The image received by the digital camera is of YCbCr, and here it needs to be converted into RPG first, and then the path is identified by using the principle of RPG color space formation. The relationship between the YCbCr of 8 bits and the RPG of 8 bits is:
R＝Y+1.371*(Cr-128)
G＝Y-0.689*(Cr-128)-0.336(Cb-128)
B＝Y+1.732*(Cb-128)
the red component and the green component in the yellow signal are 255, the blue component is 0, and based on this, the gray scale of the color component corresponding to the yellow path can be obtained by performing RGB analysis on the obtained yellow path, wherein the gray scale value of the red component is greater than 185 and less than 256, the gray scale value of the green component is greater than 150 and less than 256, and the gray scale value of the blue component is greater than 0 and less than 170, and the path can be identified by using the RBG color space. The method has the advantages that the color seen by human eyes is RGB, so that the color is visually clear when the specified color is set, but the specified color is easily influenced by illumination when the specified color is identified through an RGB color space, and mismatching is easily caused when the brightness and the saturation are different although the colors are similar.
It should be understood that the above-described embodiments of the present invention are merely examples for clearly illustrating the present invention, and are not intended to limit the embodiments of the present invention. Other variations and modifications will be apparent to persons skilled in the art in light of the above description. And are neither required nor exhaustive of all embodiments. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present invention should be included in the protection scope of the claims of the present invention.
Claims (7)
1. A blind service system is characterized by comprising a camera (1), a client (2), a server (3) and a broadcaster (4); wherein: the output end of the camera (1) is electrically connected with the input end of the client (2), the output end of the client (2) is electrically connected with the input end of the server (3), the output end of the server (3) is electrically connected with the input end of the client (2), and the output end of the client (2) is electrically connected with the input end of the broadcaster (6).
2. Blind person service system according to claim 1, characterized in that the service end (3) comprises an image recognition module (31), a path analysis module (32) and a speech synthesis module (33); wherein: the output end of the client (2) is electrically connected with the input end of the image recognition module (31), the output end of the image recognition module (31) is electrically connected with the input end of the path analysis module (32), and the output end of the path analysis module (32) is electrically connected with the input end of the voice synthesis module (33).
3. The blind person service system according to claim 2, wherein the image recognition module (31) converts the image information into binarized image information by Matlab, extracts associated features and removes redundant information, and sends the binarized image information to the path analysis module (32).
4. The blind person service system according to claim 3, wherein the path analyzing module (32) receives the binarized image information, identifies the black-and-white path using the filtered binarized black-and-white path identifying algorithm, extracts the black-and-white path using the centerline method, and transmits the path information to the voice synthesizing module (33) after the extraction.
5. The blind person service system as claimed in claim 4, wherein the filtered binary algorithm for recognizing black and white paths is to judge all pixel point values of the image, if the value of the point is less than or equal to a threshold value, the value is 255, that is, white, otherwise, the value is 0, that is, black, and finally the path is displayed in black or white.
6. The blind person service system as claimed in claim 4, wherein the center line method for extracting black and white paths is the center line method for refining black and white path regions into lines as essential features of black and white paths.
7. The blind person service system according to claim 3, wherein the speech synthesis module (33) performs speech synthesis on the information of the black and white path by calling a fly API speech interface, and sends the synthesized speech information to the client (2).
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911415416.9A CN111126341A (en) | 2019-12-31 | 2019-12-31 | Service system for blind people |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911415416.9A CN111126341A (en) | 2019-12-31 | 2019-12-31 | Service system for blind people |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111126341A true CN111126341A (en) | 2020-05-08 |
Family
ID=70506927
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911415416.9A Pending CN111126341A (en) | 2019-12-31 | 2019-12-31 | Service system for blind people |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111126341A (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102164344A (en) * | 2011-02-21 | 2011-08-24 | 中国华录集团有限公司 | Navigation mobile phone for the blind |
| JP2014137752A (en) * | 2013-01-17 | 2014-07-28 | Jb Craft:Kk | Walking guidance system for people with visual impairment, walking guidance method for people with visual impairment, server and computer program executable on the same |
| CN107346629A (en) * | 2017-08-22 | 2017-11-14 | 贵州大学 | A kind of intelligent blind reading method and intelligent blind reader system |
| CN109419609A (en) * | 2017-08-27 | 2019-03-05 | 南京乐朋电子科技有限公司 | A kind of intelligent glasses of blind man navigation |
-
2019
- 2019-12-31 CN CN201911415416.9A patent/CN111126341A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102164344A (en) * | 2011-02-21 | 2011-08-24 | 中国华录集团有限公司 | Navigation mobile phone for the blind |
| JP2014137752A (en) * | 2013-01-17 | 2014-07-28 | Jb Craft:Kk | Walking guidance system for people with visual impairment, walking guidance method for people with visual impairment, server and computer program executable on the same |
| CN107346629A (en) * | 2017-08-22 | 2017-11-14 | 贵州大学 | A kind of intelligent blind reading method and intelligent blind reader system |
| CN109419609A (en) * | 2017-08-27 | 2019-03-05 | 南京乐朋电子科技有限公司 | A kind of intelligent glasses of blind man navigation |
Non-Patent Citations (1)
| Title |
|---|
| 吴吟箫;张虹;王新生;: "基于黑白摄像头的智能小车路径识别***设计" * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106780438B (en) | Insulator defect detection method and system based on image processing | |
| EP2538584A1 (en) | Information Transmission System, Information Sending Device, Information Receiving Device, Information Transmission Method, Information Sending Method and Information Receiving Method | |
| KR101169140B1 (en) | Apparatus and method for generating image for text region extraction | |
| US11790493B2 (en) | Image processing device, control method, and control program | |
| CN103488987A (en) | Video-based method and device for detecting traffic lights | |
| CN102663345B (en) | Method and apparatus for automatic identification of traffic lights | |
| CN106682665B (en) | Seven-segment type digital display instrument number identification method based on computer vision | |
| CN107659799B (en) | Image pickup apparatus, image processing method, and storage medium | |
| CA3153067C (en) | Picture-detecting method and apparatus | |
| CN105430361A (en) | Imaging method, image sensor, imaging device and electronic device | |
| CN105279487A (en) | Beauty tool screening method and system | |
| CN105451094B (en) | Subtitle color adjustment method and device | |
| KR101428923B1 (en) | System and Method for Automatic Extraction of Component Packaging Regions in PCB | |
| CN104992680A (en) | Electronic ink screen graying method | |
| CN110766636B (en) | Intelligent image processing method for AI chip | |
| US20030235334A1 (en) | Method for recognizing image | |
| CN108288026A (en) | Video monitoring system and method with image color identification and alarm functions | |
| CN111126341A (en) | Service system for blind people | |
| CN203104635U (en) | Character superimposing device | |
| CN109584317B (en) | Vehicle body color identification method based on HSV color space histogram | |
| CN111414960A (en) | Artificial intelligence image feature extraction system and feature identification method thereof | |
| CN106060636A (en) | Display method and display system | |
| KR101359549B1 (en) | Method for Automatically Determining Weather Conditions from Image Data and Image Treatment Method for Improving Image by Using the Same | |
| CN210627230U (en) | Face recognition equipment | |
| JP2010521757A (en) | Method, apparatus and program for classifying moving objects into common colors in video (Classification of moving objects into common colors in video) |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200508 |
|
| RJ01 | Rejection of invention patent application after publication |