CN103327081A - System and method for monitoring family affection communication of blind people - Google Patents
System and method for monitoring family affection communication of blind people Download PDFInfo
- Publication number
- CN103327081A CN103327081A CN2013102216580A CN201310221658A CN103327081A CN 103327081 A CN103327081 A CN 103327081A CN 2013102216580 A CN2013102216580 A CN 2013102216580A CN 201310221658 A CN201310221658 A CN 201310221658A CN 103327081 A CN103327081 A CN 103327081A
- Authority
- CN
- China
- Prior art keywords
- blind person
- handheld terminal
- kith
- kin
- session
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Telephonic Communication Services (AREA)
Abstract
The invention discloses a system and method for monitoring family affection communication of blind people. The system comprises a blind people hand-held terminal, a relative hand-held terminal and a service platform, wherein the blind people hand-held terminal is used for sending the surrounding environment information of the blind people, information needing to be known and the situational information of the blind people to the relative hand-held terminal, and receiving corresponding voice prompting information from the relative hand-held terminal; the relative hand-held terminal is used for knowing the information of the blind people by selecting to send different messages and used for sending out the voice prompting information to assist the blind people to improve cognitive competence on surrounding scenes after receiving the information of the blind people hand-held terminal; the service platform is used for achieving data communication between the relative hand-held terminal and the blind people hand-held people. The system and method can transmit the surrounding environment information of the blind people to relatives and friends or the emergency service platform according to the needs of the blind people, the relatives and friends send out prompts through voices, the activity range of the blind people is accelerated, and the monitoring capacity of the relatives and friends on the daily activities of the blind people is improved.
Description
Technical field
The present invention relates to stream media technology and context aware technology, particularly relate to a kind of blind person's emotional affection and link up monitor system and method thereof.
Background technology
China has a large amount of blind person disadvantaged group, always has the pain that ordinary person can't know from experience in their daily life.Things at the moment can't be seen and distinguish clearly, an a series of difficult problem can be run into: as be beyond recognition the state of indicator light when going across the road; Being beyond recognition the place ahead barrier and road during walking is uneven; Be beyond recognition needed medicine bottle when taking medicine; The floor that can't know when taking elevator etc.And before novel auxiliary equipment and auxiliary system were popularized, friend blind person generally only can pass through braille, and blind guiding stick and seeing-eye dog etc. solves the problem that runs in the daily life.But such problem that solves is very limited, and the price of the conventional auxiliary equipment such as seeing-eye dog also is very expensive, and common people can't bear.Existing blind person's auxiliary equipment and system mainly contain based on GPS, the navigation system for blinds of 3G network and various sensing equipments; Based on the blind mobile phone of international braille, blind person's notepad and blind person's computer; Based on blind person's auxiliary system of video identification and equipment etc.
Present satellite positioning navigation technology has leveled off to maturation, and accurately the locating terminal area of using and error range bring great convenience to people's trip less than 1 meter now civilian GPS.And the coverage of 3G network is increasing, wireless network from we more and more close to.But GPS is positioned at significantly decline of positioning accuracy in built-up street environment or the indoor environment, even can not locate.And when emergency is arranged, can't contact timely and effectively household or guardian.
Blind mobile phone, blind person's auxiliary equipment such as blind person's notepad can allow friend's blind person use equipment the same as the normal person.By the design of braille keys, friend blind person can call by touch key-press, the record memorandum, and operating computers etc. greatly facilitate using and operating of friend blind person like this.
Glasses for blind person, blind-people voice prompting devices etc. generally have a main body based on system and the equipment of video identification technology, are provided with camera in main body, and camera is by the processing module frames connecting with headphone, and processing module is arranged in the main body; By camera environment is on every side taken monitoring, with captured picture signal transmission to the processing module analyzing and processing and identify, change into the instruction of voice, phonetic order is transferred to friend blind person by earphone, help friend blind person to understand the information of self surrounding environment, judge to make accurately.But only limit to realize at unit on this system and the functions of the equipments, and the accuracy rate of present video identification technology is not high, when wrong communication, friend blind person is difficult to make accurately judgement.
Above blind person's auxiliary system and equipment can solve the problem of friend blind person in life to a certain extent, but friend blind person still has a lot of difficulties in present Protean complicated living environment.Long-distance video by relatives and friends assists to help friend blind person to solve quickly in real time bursting problem, allows friend blind person can both hear household's sound, sensation with family at any foreign environment.
Summary of the invention
Technical problem to be solved by this invention is to provide a kind of blind person's emotional affection to link up monitor system and method, be used for solving prior art recognition accuracy auxiliary the blind person and navigation procedure not enough, can't in time make safely the problem of accurate judgement to the situation around the blind person.
To achieve these goals, the invention provides a kind of blind person's emotional affection and link up monitor system, it is characterized in that, comprising: blind person's handheld terminal, kith and kin's handheld terminal, service platform;
Described blind person's handheld terminal is used for the information of blind person's ambient condition information, required understanding and blind person's contextual information are sent to described kith and kin's handheld terminal, and receives corresponding information of voice prompt from described kith and kin's handheld terminal;
Described kith and kin's handheld terminal is used for by selecting to send the information that different message is understood the blind person, and sends information of voice prompt after the information that receives described blind person's handheld terminal, assists the blind person to improve the cognitive ability of scene on every side;
Described service platform is for the data communication that realizes between described kith and kin's handheld terminal and the described blind person's handheld terminal.
Described blind person's emotional affection is linked up monitor system, and wherein, described blind person's handheld terminal also comprises: the first task manager, the first session manager, first are looked audio interface hair device, the first context management device;
The first task manager is used for blind person's session start and stop, the man-machine interaction event capturing when looking voice-frequency telephony, and triggers corresponding task;
The first session manager is used for creating session, start and stop session in man-machine interaction, and keeps the tracking with communication process of helping each other of maintenance customer's session activation;
First looks the audio interface hair device, is transferred to described kith and kin's handheld terminal for the form of the information exchange of blind person's ambient condition information, required understanding being crossed video, and receives the information of voice prompt of described kith and kin's handheld terminal feedback;
The first context management device is used for according to the request of described kith and kin's handheld terminal blind person's contextual information being sent to described kith and kin's handheld terminal.
Described blind person's emotional affection is linked up monitor system, and wherein, described blind person's handheld terminal also comprises:
The flash appeal message sender is used for initiating the flash appeal request to described service platform when the blind person is in emergency.
Described blind person's emotional affection is linked up monitor system, and wherein, described kith and kin's handheld terminal also comprises: second event manager, the second session manager, second are looked audio interface hair device, the second context management device;
Described second event manager is used for kith and kin's session start and stop, the man-machine interaction event capturing when looking voice-frequency telephony, and triggers corresponding task;
Described the second session manager is used for creating session, start and stop session in man-machine interaction, and keeps the tracking with communication process of helping each other of maintenance customer's session activation;
Described second looks the audio interface hair device, be used for receive the required understanding of blind person around the video of scene information and kith and kin understand the blind person required around its information is fed back to described blind person's handheld terminal behind the scene information;
Described the second context management device is used for sending request to described blind person's handheld terminal, and receives the blind person's of described blind person's handheld terminal transmission contextual information.
Described blind person's emotional affection is linked up monitor system, and wherein, described service platform comprises: session management server, data transmitting server;
Described session management server is used for collecting the first session manager of described blind person's handheld terminal and the second session manager of described kith and kin's handheld terminal is caught and feedack, and the path of session start and stop, transfer of data is set according to the content of information;
Described data transmitting server is used for data that described blind person's handheld terminal, described kith and kin's handheld terminal are sent and sends to distant terminal with the form of correspondence.
Described blind person's emotional affection is linked up monitor system, and wherein, described service platform comprises:
Described flash appeal server is used for after receiving the flash appeal request that described flash appeal message sender sends, and sends to third party social service agency and seeks help, and overcomes a difficulty to assist the blind person.
To achieve these goals, the invention provides a kind of blind person's emotional affection and link up monitoring method, it is characterized in that, comprising:
Step 1, blind person's handheld terminal initiates a session request to kith and kin's handheld terminal;
Step 2, service platform receives described session request, and send session invitation to described kith and kin's handheld terminal, and the response message of described kith and kin's handheld terminal is fed back to described blind person's handheld terminal, set up the session path between described blind person's handheld terminal and the described kith and kin's handheld terminal;
Step 3, described blind person's handheld terminal is forwarded to described kith and kin's handheld terminal with the information of blind person's ambient condition information, required understanding and blind person's contextual information by described service platform;
Step 4, described kith and kin's handheld terminal is transmitted to described blind person's handheld terminal with information of voice prompt by described service platform.
Described blind person's emotional affection is linked up monitoring method, wherein, in the described step 2, comprising:
When described kith and kin's handheld terminal is not in time processed session invitation or refusal session invitation, and the blind person is when being in emergency, and described blind person's handheld terminal is initiated the flash appeal request to described service platform;
Described service platform sends to third party social service agency and to seek help after receiving described flash appeal request, overcomes a difficulty to assist the blind person.
To achieve these goals, the invention provides a kind of blind person's emotional affection and link up monitoring method, it is characterized in that, comprising:
Step 1, kith and kin's handheld terminal initiates a session request to blind person's handheld terminal;
Step 2, service platform receives described session request, and send session invitation to described blind person's handheld terminal, and the response message of described blind person's handheld terminal is fed back to described kith and kin's handheld terminal, set up the session path between described kith and kin's handheld terminal and the described blind person's handheld terminal;
Step 3, described kith and kin's handheld terminal is crossed described service platform with the blind person's of required understanding information exchange and is transmitted to described blind person's handheld terminal;
Step 4, described service platform are received the data that described blind person's handheld terminal sends and are transmitted to described kith and kin's handheld terminal.
Described blind person's emotional affection is linked up monitoring method, wherein, in the described step 3, comprising:
If kith and kin only need obtain blind person's contextual information, after then described kith and kin's handheld terminal is received the response message of described service platform, the data of acquisition request blind person's contextual information are sent to described service platform; Or
If kith and kin only need to carry out the audio frequency and video conversation with the blind person, after then described kith and kin's handheld terminal is received the response message of described service platform, speech data is sent to described service platform; Or
If kith and kin need to look voice-frequency telephony with the blind person and obtain blind person's contextual information, after then described kith and kin's handheld terminal is received the response message of described service platform, the data of speech data and acquisition request blind person's context information are sent to described service platform.
The present invention is take video transmission technologies and context aware technology as the basis, provide that a kind of blind person's emotional affection of the multi-user concurrent based on terminal is linked up monitor system and method, the emotional affection that gets involved towards kith and kin is linked up auxiliary environment whenever and wherever possible, can its ambient condition information be passed to kith and kin or emergency services platform according to blind person's needs, kith and kin send prompting or explanation by voice, the emergency services platform is transmitted to the third party with help information, assist the blind person to improve the cognitive ability of scene on every side, and according to circumstances rationally movable.The present invention can promote blind person's scope of activities, has improved the monitoring ability of kith and kin to blind person's daily routines.What is more important, because identification and the supplementary means of manpower intervention are provided, but the Effective Raise blind person is to the cognitive accuracy of surrounding environment.
The science and technology that the present invention the can be applicable to China cause of helping the disabled, specifically, the emotional affection that is applicable to serve the blind person is linked up auxiliary system construction and research and development of products.
Describe the present invention below in conjunction with the drawings and specific embodiments, but not as a limitation of the invention.
Description of drawings
Fig. 1 is the structure chart that blind person's emotional affection of the present invention is linked up monitor system;
Fig. 2 is the flow chart that blind person's emotional affection of the present invention is linked up monitoring method;
Fig. 3 is that blind person's emotional affection of the present invention is linked up the transmission of messages figure in the monitoring method;
Fig. 4 is that blind person's emotional affection of the present invention is linked up the data transmission scheme in the monitoring method.
Embodiment
Below in conjunction with the drawings and specific embodiments technical scheme of the present invention is made further more detailed description.
As shown in Figure 1, be the structure chart that blind person's emotional affection of the present invention is linked up monitor system.Monitor system 100 comprises at least two Terminal Types and a service platform.
Terminal comprises: 20 two types of blind person's handheld terminal 10 and kith and kin's handheld terminals.
Blind person's handheld terminal 10, be used for blind person's ambient condition information of living in, the information of required understanding and blind person's contextual information send to kith and kin's handheld terminal 20 with the form of looking audio frequency or extended formatting, receive corresponding voice suggestion supplementary from kith and kin's handheld terminal 20 simultaneously.
Kith and kin's handheld terminal 20 is used for by initiatively selecting to send the information that different message is understood blind person's each side.Simultaneously can also receive blind person's handheld terminal 10 look audio frequency after send prompting or explanation by voice, assist the blind person to improve the cognitive ability of scene on every side.
Service platform 30, the data transfer path that is used for planning two Terminal Types (such as blind person's handheld terminal 10, kith and kin's handheld terminal 20), transmit the data between two Terminal Types, accept simultaneously emergency services message request that blind person's handheld terminal 10 sends and seek help to other mechanisms.
Further, blind person's handheld terminal 10 comprises again: task manager 11, session manager 12, look audio interface hair device 13, context management device 14,15 5 modules of flash appeal message sender.But its form is not limit, and only need possess above five modules and get final product.Wherein:
Task manager 11 finishes manager by dialog events startup manager and dialog events and forms, and is used for blind person's session start and stop, the man-machine interaction event capturing when looking voice-frequency telephony, and triggers corresponding task.The event of task manager 11 responses comprises: session initiation event, conversation end event.
Further, the session initiation task manager is used for the blind person to kith and kin's initiation session, and the event when catching man-machine interaction occurs, and triggers and look the unlatching of audio frequency and context aware.After session establishment, session initiation task manager and finish its work.
Further, dialog events finishes manager, is used for the blind person to kith and kin's end session, triggers and looks closing of audio frequency and context aware, only just starts dialog events and finish manager when the needs initiation session finishes.
Session manager 12 is used in man-machine interaction, creates session, and the start and stop session keeps the tracing process with whole communication system of helping each other of maintenance customer's whole session activation simultaneously.
Further, session manager 12 is responsible for sending of session started message, the reception of session invitation message, sending of session feedback message, the unlatching of audio-video capture, the unlatching of context aware, the unlatching that audio frequency receives, the tasks such as the end of session communication are the normal hinges of linking up of whole session activation.
Depending on audio interface hair device 13, be used for form that the blind person crosses video with scene information exchange around the required understanding and be transferred to kith and kin and receive kith and kin and see prompting or the explanation voice messaging that feeds back behind the video.
Further, partly formed by video encoding module, audio coding module, audio decoder module, cache module, camera, microphone etc. depending on audio interface hair device 13.
Context management device 14 after being used for receiving the message request of kith and kin's handheld terminal 20, sends to kith and kin with the contextual information (such as geographical location information) around the blind person automatically.Contextual information around the blind person can comprise the residing geographical location information of blind person, the residing state of blind person etc.
Flash appeal message sender 15 is used for the blind person when emergency, initiates the request of seeking help to flash appeal server 33.When the blind person meets with emergency, can directly send request by flash appeal message sender 15 to flash appeal server 33, need not the forwarding through server.
Further, kith and kin's handheld terminal 20 comprises again: task manager 21, session manager 22, look audio interface hair device 23,24 4 modules of context management device.But its form is not limit, and only need possess above four modules and get final product.Wherein:
Task manager 21 finishes manager by dialog events startup manager and dialog events and forms, and is used for kith and kin's session start and stop, the feedback of the man-machine interaction event when looking voice-frequency telephony, and triggers corresponding task.The corresponding event of task manager comprises: event, conversation end event are connected in session.
Further, the session initiation task manager is used for kith and kin to blind person's initiation session, and the event when catching man-machine interaction occurs, and triggers and look the unlatching of audio frequency and context aware.After session establishment, session initiation task manager and finish its work.
Further, dialog events finishes manager, is used for kith and kin to blind person's end session, triggers and looks closing of audio frequency and context aware, only sends out at needs just to start dialog events when opening conversation end and finish manager.
Session manager 22 is used in man-machine interaction, creates session, and the start and stop session keeps the tracing process with whole communication system of helping each other of maintenance customer's whole session activation simultaneously.
Further, session manager 22, be responsible for sending of session started message, the reception of session invitation message, the session feedback message send the unlatching of video reception, the unlatching that context aware receives, the unlatching that audio frequency sends, the tasks such as the end of session communication are the normal hinges of linking up of whole session activation.
Depending on audio interface hair device 23, be used for kith and kin receive the required understanding of blind person around the video of scene information and kith and kin understand the blind person required around behind the scene information mode by voice its prompting or explanation are fed back to the blind person.Partly formed by video decode module, audio coding module, audio decoder module, cache module, microphone etc. depending on audio interface hair device 23.
Further, service platform 30 comprises again: session management server 31, data transmitting server 32, flash appeal server 33.Wherein:
Session management server 31, the session manager 12 that is used for collection blind person handheld terminal 10 is caught and feedack with the session manager 22 of kith and kin's handheld terminal 20, and to the source of information, the type of information, the feedback of information is processed, thereby the planning session start and stop, the path of transfer of data.
Data transmitting server 32 is used for the data that blind person's handheld terminal 10 and kith and kin's handheld terminal 20 send are sent to distant terminal with its corresponding form, plays the effect of data relay.The audio mix of looking that data transmitting server 32 can send blind person's handheld terminal 10 flows, context aware information, and the audio stream of kith and kin's handheld terminal 20 is transmitted mutually, plays the effect of data relay.
Flash appeal server 33 is used for after the flash appeal message that the flash appeal message sender 15 of receiving blind person's handheld terminal 10 sends, and sends to third party social service agency and seeks help, and overcomes a difficulty to assist the blind person.
Further, session management server 31 also is used for the information notification blind person handheld terminal 10 with kith and kin's handheld terminal 20 and data transmitting server 32.
Further, data transmitting server 32 is also for the data of looking audio mix flow data and blind person's contextual information of transmitting blind person's handheld terminal 10 and kith and kin's handheld terminal 20.
Take sip server as example, session management server 31 can be comprised of Proxy Server, registrar, Redirect Server.
Proxy Server refers to sip proxy server, and sip proxy server is accepted the session request of SIP UA and inquired about SIP registrar server, obtains the address information of recipient UA.Then, it is arranged in same territory if it directly is transmitted to recipient UA(with the session message request) or acting server (if UA is arranged in another territory).
SIP registrar server is the database of all user agents' position in the IncFlds.In SIP communication, these servers can be retrieved IP address and other relevant informations of ginseng the other side, and send it to sip proxy server.
The SIP Redirect Server for the call path of planning SIP, allows sip proxy server that SIP session invitation information is directed to external domain.The SIP Redirect Server can coexist on the hardware with SIP registrar server and sip proxy server.
Data transmitting server 32 is used for the data that blind person's handheld terminal 10 and kith and kin's handheld terminal 20 send are sent to distant terminal with its corresponding form, plays the effect of data relay.The audio mix of looking that data transmitting server 32 can send blind person's handheld terminal 10 flows, context aware information, and the audio stream of kith and kin's handheld terminal 20 is transmitted mutually, plays the effect of data relay.
Flash appeal server 33 is used for after the flash appeal message that the flash appeal message sender 15 of receiving blind person's handheld terminal 10 sends, and sends to third party social service agency and seeks help, and overcomes a difficulty to assist the blind person.
As shown in Figure 2, be the flow chart that blind person's emotional affection of the present invention is linked up monitoring method.In conjunction with Fig. 1, take sip server as session management server as an example, this flow process comprises the steps:
Steps A, session sends request.As shown in Figure 3, the session setup square tube is crossed the task manager of handheld terminal to session management server 31 transmission requests.
Described steps A comprises following possibility:
A1, blind person's handheld terminal 10 sends the session request to kith and kin's handheld terminal 20.
When the blind person need to understand ambient environmental conditions, put through kith and kin's number by blind person's handheld terminal 10, blind person and kith and kin's mobile phone namely can be used as the terminal (UA) of SIP.After the blind person has dialled phone to kith and kin, asked to server Proxy Server transmission session INVITE by blind person's mobile phone terminal.
A2, kith and kin's handheld terminal 20 sends the session request to blind person's handheld terminal 10.
When kith and kin need to understand blind person's state, the mobile phone of putting through blind person's number blind person and kith and kin by kith and kin's handheld terminal 20 namely can be used as the terminal (UA) of SIP.After kith and kin have dialled phone to the blind person, asked to server Proxy Server transmission session INVITE by kith and kin's mobile phone terminal.
The terminal of SIP (UA) mainly is end user device, as being used for mobile phone, multimedia handheld device, PC, the PDA etc. of establishment and managing SIP session.User agent client initiates a message.Subscriber proxy server responds message.Sip user agent comprises user agent client (UAC) and subscriber proxy server (UAS).User agent client is mainly used in sending the INVITE request; And subscriber proxy server is mainly used in respective request.
INVITE is used for inviting client or service to participate in a dialogue.In the message body of INVITE request, can be described callee's session.Such as the medium response type of calling party's reception, medium type and the parameter of transmission.Server can be replied invitation with corresponding response.
Step B, the replying and path planning of session request.After session management server 31 is determined the request of receiving, task manager to session recipient's handheld terminal sends session invitation, after determining the response state of session manager of session recipient handheld terminal, session manager to session setup side feeds back response message again, last planning session path.
Described step B may further comprise the steps:
B1, the session recipient invitation that accepts session, session management server 31 feeds back its invitation to the initiator and is accepted.
B2, session recipient in time do not process and invite, and session management server 31 feeds back invitation to the initiator and can't reply.
B3, the session recipient refuses session invitation, and session management server 31 feeds back its invitation to the initiator and is rejected.
Following steps all are that to be based upon B1 be the received state of session invitation.
Information corresponding to number of server Proxy Server by searching the recipient sends the message of session request to the recipient.After the recipient receives the message of request, if handheld terminal can be used, just send to server Proxy Server and reply, and make recipient's handheld terminal ringring prompting.
Server Proxy Server sends response message to the calling party after receiving and replying.Described here replying comprises: two provisional responses (100Trying and 180Ringing) and a successful respond (200OK).
Described 100Trying and 180Ringing represent that request is received the interim message of processing.
Described 200OK represents that the recipient receives request, and processed success (conditional code is 200), receives this request.
Described ACK for200 sends the ACK request to the recipient after representing that the calling party receives the processing success response.After the recipient received the ACK request, access success was set up (conditional code is 200).
Step C, the catching and transmit of data.After feedback information is received by session setup side, the data of required transmission are sent to data transmitting server 32.At this moment, session setup side is defined as data receiver, i.e. calling party, and the session recipient is defined as the data receiver, i.e. the callee.
Described step C may further comprise the steps:
C1, session setup side is blind person's handheld terminal 10, after blind person's handheld terminal 10 is received the response message of session management server 31, open camera, the ambient condition information that needs are understood is taken into video, then dynamic video is compressed, encodes, then send to data transmitting server 32, can pass through the RTP/RTCP protocol transmission depending on audio mix stream.
The RTP/RTCP agreement is being used in conjunction with of Real-time Transport Protocol and rtcp protocol.RTP is RTP, is a host-host protocol for the upper multimedia data stream of INTERNET, and its objective is provides temporal information and realize that stream synchronously.RTCP is RTCP Real-time Transport Control Protocol, is in charge of the exchange message of transmission quality between the current application process.RTP and RTCP are used in conjunction with, and can make the efficiency of transmission optimization with effective feedback and minimum expense, therefore be particularly suitable for the real time data on the transmission network.
As shown in Figure 4, this moment, the blind person was the calling party, and kith and kin are callees:
1) blind person takes into video with the ambient condition information of required understanding, sends data transmitting server to.
2) data transmitting server is by registration and the residing network segment of location-server inquiry kith and kin.
3) registration and location-server are informed data transmitting server with institute's Query Information.
4) the data transmitting server video that the blind person is captured is transmitted to kith and kin.
5) kith and kin are that prompting or the explanation that kith and kin give the blind person sends to data transmitting server with feedback information.
6) data transmitting server sends to the blind person with its prompting or explanation.
C2, session setup side are kith and kin's handheld terminals 20, and after the session manager 22 of kith and kin's handheld terminal 20 was received the response message of session management server 31, the blind person's that needs are understood information sent on the data transmitting server 32 with the selection of its correspondence.
Described step C2 may further comprise the steps:
If kith and kin only need understand blind person's contextual information (take positional information as example), kith and kin's handheld terminal 20 is opened context management after receiving the response message of session management server 31, will ask the data of blind person position information to be sent to data transmitting server 32.
If kith and kin only need to look voice-frequency telephony with the blind person, after kith and kin's handheld terminal 20 is received the response message of session management server 31, open and look the audio interface hair device, with the speech data compression, coding is sent to data transmitting server 32.
If kith and kin not only need to look voice-frequency telephony with the blind person, also need understand its positional information, after kith and kin's handheld terminal 20 is received the response message of session management server 31, speech data is compressed, and coding is rear and will ask the data of blind person position information to be sent to together data transmitting server 32.
As shown in Figure 4, this moment, kith and kin were calling partys, and the blind person is the callee:
1) kith and kin send blind person's information of required understanding to data transmitting server.
2) data transmitting server is by registration and the residing network segment of location-server inquiry blind person.
3) registration and location-server are informed data transmitting server with institute's Query Information.
4) data transmitting server sends to the blind person with the information of the required understanding of kith and kin.
5) blind person's feedback information that it is corresponding is that blind person's information of the required understanding of kith and kin sends to data transmitting server.
6) data transmitting server sends to kith and kin with feedback information.
Step D, the forwarding of data transmitting server 32 data.As shown in Figure 3, data transmitting server 32 is transmitted to the data receiver after receiving the data of data receiver; Data with data receiver's feedback send to the data initiator again, thereby reach user both sides' exchanges data.
Described step D may further comprise the steps:
D1, data receiver is blind person's handheld terminal 10, data transmitting server 32 receive blind person's handheld terminal 10 look audio interface hair device 13 sends look audio mix stream after, look audio interface hair device 23 with what it was transmitted to kith and kin's handheld terminal 20.Kith and kin's handheld terminal 20 receives video/audio, deposits it in buffer area, then by looking 23 pairs of decoding datas of audio interface hair device, be reduced into the blind person captured look audio frequency.Then carry out voice suggestion and explanation according to video content to the blind person.Again speech explanation is encoded by looking audio interface hair device 23, send to data transmitting server 32, data transmitting server 32 is transmitted to blind person's handheld terminal 10 with its speech data, is reducible kith and kin's voice suggestion after 10 decodings of blind person's handheld terminal, thereby reaches the purpose that kith and kin assist the blind person.
D2, data receiver is kith and kin's handheld terminal 20, data transmitting server 32 is transmitted to blind person's handheld terminal 10 with it after receiving the data of blind person's handheld terminal 10 transmissions.
Described D2 may further comprise the steps:
What kith and kin sent is request blind person position information data, blind person's handheld terminal 10 is opened context management device 14 after receiving data automatically, its positional information is sent to data transmitting server 32, and then be forwarded to the context management device 24 of kith and kin's handheld terminal 20, thereby reach the purpose that kith and kin understand blind person position information.
What kith and kin sent is speech data, blind person's handheld terminal 10 is received to open after the data and is looked audio interface hair device 13 and decode, then according to voice, the environmental information around it and s own situation are encoded by looking audio conversion hair device 13, be sent to data transmitting server 21 after the compression.The audio interface hair device 23 of looking that is forwarded to again kith and kin's mobile phone terminal 20 is decoded, thereby reaches the purpose that kith and kin understand blind person's present situation.
What kith and kin sent is voice and request blind person position information data, and blind person's handheld terminal 10 is opened context management device 14 after receiving data automatically, and its positional information is sent to kith and kin.Open again and look audio interface hair device 13, then according to voice, the environmental information around it and s own situation are encoded by looking audio interface hair device 13, be sent to data transmitting server 32 after the compression.The audio interface hair device 23 of looking that is forwarded to again kith and kin's mobile phone terminal 20 is decoded, thereby reaches the purpose that kith and kin understand kith and kin in all directions.
Step e, if the user is the blind person, when step B1 can't carry out, or the blind person is when having emergency to process, can send the message of seeking help to flash appeal server 33 by flash appeal message sender 15, then send help information by flash appeal server 33 to third party and kith and kin.
Step F, the termination request of session.As shown in Figure 3, the termination of session realizes by the BYE request message.When the either party who participates in session wants end call, it just constructs a BYE request message, after server Proxy Server determines to receive the BYE request message, task manager to the handheld terminal of request receiving side sends the BYE request message, after the BYE request message is received by request receiving side, discharge and call out therewith relevant resource, a success response 200for of loopback BYE, expression is called out and is stopped.
The present invention proposes a kind of blind person's emotional affection take transmission of video and context aware technology as the multi-user concurrent on basis and link up monitor system and method; the recognition accuracy in the auxiliary and navigation procedure is not enough the blind person to have overcome prior art; can't in time make safely the problem of accurate judgement to the situation around the blind person; by setting up kith and kin's emotional affection intercourse platform and sending flash appeal message, instruct accurately and easily blind person's daily routines.
Certainly; the present invention also can have other various embodiments; in the situation that do not deviate from spirit of the present invention and essence thereof; those of ordinary skill in the art work as can make according to the present invention various corresponding changes and distortion, but these corresponding changes and distortion all should belong to the protection range of the appended claim of the present invention.
Claims (10)
1. blind person's emotional affection is linked up monitor system, it is characterized in that, comprising: blind person's handheld terminal, kith and kin's handheld terminal, service platform;
Described blind person's handheld terminal is used for the information of blind person's ambient condition information, required understanding and blind person's contextual information are sent to described kith and kin's handheld terminal, and receives corresponding information of voice prompt from described kith and kin's handheld terminal;
Described kith and kin's handheld terminal is used for by selecting to send the information that different message is understood the blind person, and sends information of voice prompt after the information that receives described blind person's handheld terminal, assists the blind person to improve the cognitive ability of scene on every side;
Described service platform is for the data communication that realizes between described kith and kin's handheld terminal and the described blind person's handheld terminal.
2. blind person's emotional affection according to claim 1 is linked up monitor system, it is characterized in that, described blind person's handheld terminal also comprises: the first task manager, the first session manager, first are looked audio interface hair device, the first context management device;
The first task manager is used for blind person's session start and stop, the man-machine interaction event capturing when looking voice-frequency telephony, and triggers corresponding task;
The first session manager is used for creating session, start and stop session in man-machine interaction, and keeps the tracking with communication process of helping each other of maintenance customer's session activation;
First looks the audio interface hair device, is transferred to described kith and kin's handheld terminal for the form of the information exchange of blind person's ambient condition information, required understanding being crossed video, and receives the information of voice prompt of described kith and kin's handheld terminal feedback;
The first context management device is used for according to the request of described kith and kin's handheld terminal blind person's contextual information being sent to described kith and kin's handheld terminal.
3. blind person's emotional affection according to claim 1 is linked up monitor system, it is characterized in that, described blind person's handheld terminal also comprises:
The flash appeal message sender is used for initiating the flash appeal request to described service platform when the blind person is in emergency.
4. according to claim 1,2 or 3 described blind person's emotional affections link up monitor systems, it is characterized in that, described kith and kin's handheld terminal also comprises: second event manager, the second session manager, second are looked audio interface hair device, the second context management device;
Described second event manager is used for kith and kin's session start and stop, the man-machine interaction event capturing when looking voice-frequency telephony, and triggers corresponding task;
Described the second session manager is used for creating session, start and stop session in man-machine interaction, and keeps the tracking with communication process of helping each other of maintenance customer's session activation;
Described second looks the audio interface hair device, be used for receive the required understanding of blind person around the video of scene information and kith and kin understand the blind person required around its information is fed back to described blind person's handheld terminal behind the scene information;
Described the second context management device is used for sending request to described blind person's handheld terminal, and receives the blind person's of described blind person's handheld terminal transmission contextual information.
5. according to claim 1,2 or 3 described blind person's emotional affections link up monitor systems, it is characterized in that, described service platform comprises: session management server, data transmitting server;
Described session management server is used for collecting the first session manager of described blind person's handheld terminal and the second session manager of described kith and kin's handheld terminal is caught and feedack, and the path of session start and stop, transfer of data is set according to the content of information;
Described data transmitting server is used for data that described blind person's handheld terminal, described kith and kin's handheld terminal are sent and sends to distant terminal with the form of correspondence.
6. blind person's emotional affection according to claim 3 is linked up monitor system, it is characterized in that, described service platform comprises:
Described flash appeal server is used for after receiving the flash appeal request that described flash appeal message sender sends, and sends to third party social service agency and seeks help, and overcomes a difficulty to assist the blind person.
7. blind person's emotional affection is linked up monitoring method, it is characterized in that, comprising:
Step 1, blind person's handheld terminal initiates a session request to kith and kin's handheld terminal;
Step 2, service platform receives described session request, and send session invitation to described kith and kin's handheld terminal, and the response message of described kith and kin's handheld terminal is fed back to described blind person's handheld terminal, set up the session path between described blind person's handheld terminal and the described kith and kin's handheld terminal;
Step 3, described blind person's handheld terminal is forwarded to described kith and kin's handheld terminal with the information of blind person's ambient condition information, required understanding and blind person's contextual information by described service platform;
Step 4, described kith and kin's handheld terminal is transmitted to described blind person's handheld terminal with information of voice prompt by described service platform.
8. blind person's emotional affection according to claim 7 is linked up monitoring method, it is characterized in that, in the described step 2, comprising:
When described kith and kin's handheld terminal is not in time processed session invitation or refusal session invitation, and the blind person is when being in emergency, and described blind person's handheld terminal is initiated the flash appeal request to described service platform;
Described service platform sends to third party social service agency and to seek help after receiving described flash appeal request, overcomes a difficulty to assist the blind person.
9. blind person's emotional affection is linked up monitoring method, it is characterized in that, comprising:
Step 1, kith and kin's handheld terminal initiates a session request to blind person's handheld terminal;
Step 2, service platform receives described session request, and send session invitation to described blind person's handheld terminal, and the response message of described blind person's handheld terminal is fed back to described kith and kin's handheld terminal, set up the session path between described kith and kin's handheld terminal and the described blind person's handheld terminal;
Step 3, described kith and kin's handheld terminal is crossed described service platform with the blind person's of required understanding information exchange and is transmitted to described blind person's handheld terminal;
Step 4, described service platform are received the data that described blind person's handheld terminal sends and are transmitted to described kith and kin's handheld terminal.
10. want 9 described blind person's emotional affections to link up monitoring method according to right, it is characterized in that, in the described step 3, comprising:
If kith and kin only need obtain blind person's contextual information, after then described kith and kin's handheld terminal is received the response message of described service platform, the data of acquisition request blind person's contextual information are sent to described service platform; Or
If kith and kin only need to carry out the audio frequency and video conversation with the blind person, after then described kith and kin's handheld terminal is received the response message of described service platform, speech data is sent to described service platform; Or
If kith and kin need to look voice-frequency telephony with the blind person and obtain blind person's contextual information, after then described kith and kin's handheld terminal is received the response message of described service platform, the data of speech data and acquisition request blind person's context information are sent to described service platform.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2013102216580A CN103327081A (en) | 2013-06-05 | 2013-06-05 | System and method for monitoring family affection communication of blind people |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2013102216580A CN103327081A (en) | 2013-06-05 | 2013-06-05 | System and method for monitoring family affection communication of blind people |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN103327081A true CN103327081A (en) | 2013-09-25 |
Family
ID=49195603
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2013102216580A Pending CN103327081A (en) | 2013-06-05 | 2013-06-05 | System and method for monitoring family affection communication of blind people |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103327081A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106162073A (en) * | 2015-04-30 | 2016-11-23 | 小蚁科技（香港）有限公司 | Communication equipment |
| CN111263001A (en) * | 2020-01-17 | 2020-06-09 | 深圳市春盛海科技有限公司 | Image-based blind remote assistance method and system |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101986673A (en) * | 2010-09-03 | 2011-03-16 | 浙江大学 | Intelligent mobile phone blind-guiding device and blind-guiding method |
| CN201878195U (en) * | 2010-12-20 | 2011-06-22 | 长春大学 | Third-generation (3G) and Internet-based double-network remote help system |
| CN102164344A (en) * | 2011-02-21 | 2011-08-24 | 中国华录集团有限公司 | Navigation mobile phone for the blind |
| CN102186141A (en) * | 2011-05-06 | 2011-09-14 | 中国华录集团有限公司 | Blind user navigation service system based on global positioning system (GPS) and 3rd-generation (3G) network |
| CN202179671U (en) * | 2011-07-22 | 2012-04-04 | 张殿礼 | Smart guide glasses |
| CN102885685A (en) * | 2011-07-22 | 2013-01-23 | 张殿礼 | Monitoring and blind-guide method implemented through communication equipment |
-
2013
- 2013-06-05 CN CN2013102216580A patent/CN103327081A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101986673A (en) * | 2010-09-03 | 2011-03-16 | 浙江大学 | Intelligent mobile phone blind-guiding device and blind-guiding method |
| CN201878195U (en) * | 2010-12-20 | 2011-06-22 | 长春大学 | Third-generation (3G) and Internet-based double-network remote help system |
| CN102164344A (en) * | 2011-02-21 | 2011-08-24 | 中国华录集团有限公司 | Navigation mobile phone for the blind |
| CN102186141A (en) * | 2011-05-06 | 2011-09-14 | 中国华录集团有限公司 | Blind user navigation service system based on global positioning system (GPS) and 3rd-generation (3G) network |
| CN202179671U (en) * | 2011-07-22 | 2012-04-04 | 张殿礼 | Smart guide glasses |
| CN102885685A (en) * | 2011-07-22 | 2013-01-23 | 张殿礼 | Monitoring and blind-guide method implemented through communication equipment |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106162073A (en) * | 2015-04-30 | 2016-11-23 | 小蚁科技（香港）有限公司 | Communication equipment |
| CN111263001A (en) * | 2020-01-17 | 2020-06-09 | 深圳市春盛海科技有限公司 | Image-based blind remote assistance method and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110891124B (en) | System for artificial intelligence pick-up call | |
| US8984143B2 (en) | Emergency information services | |
| US7925246B2 (en) | Radio/telephony interoperability system | |
| CN102065187B (en) | Method and system for providing a call answering service between a source telephone and a target telephone | |
| US8929851B2 (en) | System and method for establishing an incident communications network | |
| US7890638B2 (en) | Communication between a real world environment and a virtual world environment | |
| CN1791093B (en) | Communications system and method for providing customized messages based on presence and preference information | |
| CN101466090B (en) | Low-threat response service for mobile device users | |
| US9020106B2 (en) | Emergency video calls | |
| CN109413286A (en) | A kind of intelligent customer service voice response system and method | |
| CN102158614A (en) | Context sensitive, cloud-based telephony | |
| US10057426B2 (en) | Speaker priority for conference calls | |
| US20120259924A1 (en) | Method and apparatus for providing summary information in a live media session | |
| CN103931164B (en) | Apparatus and method for performing lawful interception in groupcall | |
| US20110026687A1 (en) | Emergency 911 services with just-in-time provisioning for voip customers | |
| CN103152334A (en) | Method for remotely opening door by building intercom system using speech recognition of management platform | |
| CN103634448A (en) | Method for intelligently responding to incoming calls by voice | |
| US11509695B1 (en) | Management of controlled-environment facility resident image and/or background during video visitation | |
| CN105100678B (en) | Video conference access method and system | |
| CN103327081A (en) | System and method for monitoring family affection communication of blind people | |
| KR101360950B1 (en) | Method and apparatus for verifying a visitor using SIP sever | |
| KR20100020726A (en) | System and method for providing video chatting service | |
| CN107566340B (en) | Conference auxiliary communication method and storage medium and device thereof | |
| CN102255738A (en) | Method and system for realizing broadcasting and group calling in click-to-dial (CTD) service | |
| CN102143153A (en) | Broadband service nesting method and device, and service application server |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20130925 |
|
| RJ01 | Rejection of invention patent application after publication |