CN106686208B - Method and device for displaying multimedia message on wearable devices - Google Patents
Method and device for displaying multimedia message on wearable devices Download PDFInfo
- Publication number
- CN106686208B CN106686208B CN201611020804.3A CN201611020804A CN106686208B CN 106686208 B CN106686208 B CN 106686208B CN 201611020804 A CN201611020804 A CN 201611020804A CN 106686208 B CN106686208 B CN 106686208B
- Authority
- CN
- China
- Prior art keywords
- message
- multimedia message
- wearable device
- key information
- displayed
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 48
- 230000009471 action Effects 0.000 claims description 84
- 238000012545 processing Methods 0.000 claims description 30
- 230000007613 environmental effect Effects 0.000 claims description 26
- 238000004891 communication Methods 0.000 claims description 17
- 230000006835 compression Effects 0.000 claims description 16
- 238000007906 compression Methods 0.000 claims description 16
- 238000000605 extraction Methods 0.000 claims description 10
- 238000006243 chemical reaction Methods 0.000 claims description 8
- 239000000284 extract Substances 0.000 claims description 7
- 238000012544 monitoring process Methods 0.000 claims description 7
- 238000010801 machine learning Methods 0.000 claims description 4
- 230000005540 biological transmission Effects 0.000 claims description 3
- 238000004148 unit process Methods 0.000 claims 4
- 230000000875 corresponding effect Effects 0.000 description 28
- 238000010295 mobile communication Methods 0.000 description 8
- 238000007781 pre-processing Methods 0.000 description 5
- 230000008569 process Effects 0.000 description 5
- 238000013145 classification model Methods 0.000 description 2
- 230000007547 defect Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 230000010365 information processing Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000001143 conditioned effect Effects 0.000 description 1
- 230000008921 facial expression Effects 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 238000005286 illumination Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 230000011218 segmentation Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
- H04M1/72409—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories
- H04M1/72412—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories using two-way short-range wireless interfaces
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
- H04M1/7243—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages
- H04M1/72436—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages for text messaging, e.g. short messaging services [SMS] or e-mails
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
- H04M1/7243—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages
- H04M1/72439—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages for image or video messaging
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72469—User interfaces specially adapted for cordless or mobile telephones for operating the device by selecting functions from two or more displayed items, e.g. menus or icons
- H04M1/72472—User interfaces specially adapted for cordless or mobile telephones for operating the device by selecting functions from two or more displayed items, e.g. menus or icons wherein the items are sorted according to specific criteria, e.g. frequency of use
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Human Computer Interaction (AREA)
- Signal Processing (AREA)
- Business, Economics & Management (AREA)
- General Business, Economics & Management (AREA)
- Multimedia (AREA)
- Information Transfer Between Computers (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses a method for displaying multimedia messages on kinds of wearable equipment, which comprises the steps of extracting key information in the multimedia messages, determining the category of the multimedia messages according to the extracted key information and preset message classification rules, determining at least corresponding display rules according to the category of the multimedia messages, determining the most matched display rule in the corresponding display rules according to the extracted key information, storing the extracted key information into the most matched display rule template, and generating the multimedia messages to be displayed on the wearable equipment.
Description
Technical Field
The invention relates to the technical field of display, in particular to a method and a device for displaying multimedia messages on wearable devices.
Background
Because along with intelligent communication equipment such as wearable equipment constantly develops, wearable equipment's rate of use in the crowd is also higher and higher, combines wearable equipment and mobile communication equipment's technique and application also constantly to emerge. In the interaction between the wearable device and the mobile communication device, the requirements for intelligent notification, display and interoperation of messages between devices are high, and the existing solution for displaying messages on the wearable device aims at text messages but does not have a solution for multimedia information such as pictures, audios and videos. And the text message received from the communication device is directly displayed on the wearable device and is not displayed after any processing.
Disclosure of Invention
The invention aims to provide a method and a device for displaying multimedia messages on wearable devices, which can reduce the workload of people for reading messages.
In order to achieve the above object, the present invention provides methods for displaying multimedia messages on a wearable device, the method including extracting key information in a multimedia message, determining a category to which the multimedia message belongs according to the extracted key information and preset message classification rules, determining at least corresponding display rules according to the category to which the multimedia message belongs, determining a most matched display rule in the corresponding display rules according to the extracted key information, and storing the extracted key information in the most matched display rule template to generate a multimedia message to be displayed on the wearable device.
In order to achieve the above object, the present invention further provides an apparatus for displaying multimedia messages on a wearable device, the apparatus includes an extracting unit configured to extract key information in a multimedia message, a classifying unit configured to determine a category to which the multimedia message belongs according to the extracted key information and a preset message classification rule, a display matching unit configured to determine at least corresponding display rules according to the category to which the multimedia message belongs, determine a most matched display rule in the corresponding display rules according to the extracted key information, and a message generating unit configured to store the extracted key information in the most matched display rule template to generate a multimedia message to be displayed on the wearable device.
In summary, the invention provides methods and apparatuses for displaying multimedia messages on wearable devices, so that when a user communication device is not nearby, the wearable device can receive and display preprocessed multimedia messages, thereby preventing important messages from being missed, filtering unimportant messages, greatly reducing the workload of people for reading messages, reducing the operations of users, and effectively improving the efficiency of users.
Drawings
Fig. 1 is a flowchart illustrating a method for displaying multimedia messages on wearable devices according to the present invention.
Fig. 2 is a schematic structural diagram of an apparatus for displaying multimedia messages on wearable devices according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the solution of the present invention is described in further detail with reference to the accompanying drawings and examples.
In the prior art, only communication of messages between devices and how to display them on a wearable device is provided, but no pre-processing of the messages is done to better show the user. Therefore, the invention overcomes the defects in the prior art, and can display and suggest the action of the message on the wearable device by preprocessing the multimedia message, thereby greatly reducing the workload of people for reading the message, reducing the operation of the user and effectively improving the efficiency of the user.
Fig. 1 is a flowchart illustrating a method for displaying multimedia messages on wearable devices according to the present invention.
Step 11, extracting key information in the multimedia message;
the message sources comprise but are not limited to (1) app messages such as update prompt messages, notification messages of push (2) chat messages sent by chat apps, short message messages containing text messages, audio messages, pictures, video messages and the like (3) short message messages sent by service numbers (4) private messages sent by individuals (5) operating system messages and the like.
Step 12, determining the category of the multimedia message according to the extracted key information and a preset message classification rule;
the message classification rules are formed based on machine learning, or formed based on rules, or formed based on a method combining machine learning and rules, and can classify the multimedia messages according to the extracted key information, the categories to which the multimedia messages belong include, but are not limited to announcements, notifications, chats, pictures, and the like.
Step 13, determining at least corresponding display rules according to the category of the multimedia message, and determining the most matched display rule in the corresponding display rules according to the extracted key information;
the display rules can be flexibly set and modified according to the user's own conditions, for example, the display rules include message source, message receiving time, and the display rules two include message source, message receiving time, and message keyword.
, categories correspond to multiple display rules, and then the most matched display rule is determined according to the extracted key information.
And step 14, saving the extracted key information into the most matched display rule template, and generating the multimedia message to be displayed on the wearable device.
The wearable device comprises a display function, and is not limited to a smart watch, a smart bracelet, *** glasses and other wearable devices with the display function.
Preferably, when extracting the key information in the multimedia message, the method further comprises: and correspondingly processing the multimedia message according to the extracted multimedia message type.
Types of multimedia messages include, but are not limited to, text messages, picture messages, audio messages, video messages, and the like.
Specifically, when the multimedia message type is a text message, processing the multimedia message comprises performing standardized conversion on the text message, further extracting key information in the text message after the standardized conversion for determining the category to which the multimedia message belongs, determining the best matching display rule template, and generating the multimedia message to be displayed on the wearable device.
Specifically, when the multimedia message type is a picture message, processing the multimedia message includes: and judging whether the picture in the picture message needs to be compressed, cut, fuzzified or identified by the image content according to the extracted key information, if so, processing the picture, and storing the extracted key information and the processed picture into the most matched display rule template to generate the multimedia message to be displayed on the wearable device.
Specifically, when the multimedia message type is an audio message, the processing of the multimedia message includes judging whether audio in the audio message needs to be played on the wearable device according to the extracted key information, and if so, further judging whether compression is needed or not or whether conversion into a text message is needed;
if the compression is needed, forming compressed audio, storing the extracted key information and the compressed audio into the most matched display rule template, and generating a multimedia message to be displayed on the wearable device;
if the multimedia message needs to be converted into the text message, after the audio is converted into the text message, the key information in the text message is further extracted for determining the category to which the multimedia message belongs, determining the most matched display rule template, and generating the multimedia message to be displayed on the wearable device;
if no play is required on the wearable device, a text message is displayed on the wearable device that audio messages were received.
Specifically, when the multimedia message type is a video message, the processing of the multimedia message includes judging whether a video in the video message needs to be played on the wearable device according to the extracted key information, and if so, further judging whether compression is needed or not or whether a caption message needs to be extracted;
if the compression is needed, forming a compressed video, storing the extracted key information and the compressed video into the most matched display rule template, and generating a multimedia message to be displayed on the wearable device;
if the caption message needs to be extracted, after the caption message in the video is extracted, further extracting key information in the caption message for determining the category to which the multimedia message belongs and determining the most matched display rule template to generate the multimedia message to be displayed on the wearable device;
if no play is required on the wearable device, a text message is displayed on the wearable device that video messages were received.
To this end, a method of preprocessing a multimedia message and then displaying the filtered multimedia message on a wearable device is completed.
Further , after determining the category to which the multimedia message belongs in step 12, the method further includes determining a suggested action to be displayed on the wearable device according to the preset correspondence between the category to which the multimedia message belongs and the suggested action.
The corresponding relation between the multimedia message belonged category and the suggested action is a preset suggested action classification model, and the suggested action classification model is used for recording the belonged category of each multimedia message and the user habit action corresponding to the category to form the corresponding relation between the preset multimedia message belonged category and the suggested action.
The suggested actions for the multimedia message include, but are not limited to, the following: (1) the short message reply (2) message is set to be read (3) and has no default operation, the message is kept in an unread state of the mobile communication terminal, and is not sent to the wearable device (4), the reply voice message (5) is deleted, the message (6) is saved to a specific position (7) to display original pictures, and the high-definition picture (8) runs the app of the mobile communication terminal.
For example, the corresponding relationship between the category to which the multimedia message belongs and the suggested action is shown in table 1.
| Categories to which multimedia messages belong | Suggesting actions |
| type of advertisement | Deleting the message |
| Type of notification | Setting read |
| Chat type | Default actions |
| Picture type | Saving pictures |
TABLE 1
The default action may be flexibly set, e.g., may be no operation, leaving the message in an unread state at the communication terminal, and no longer sent to the wearable device.
Further , preferably each display rule template further corresponds to an environmental condition for displaying the multimedia message on the wearable device, the method further includes determining a best matching display rule based on the extracted key information and the current environmental condition.
Further , preferably each suggested action further corresponds to an environmental condition for performing the suggested action, the method further includes determining suggested actions to be displayed on the wearable device according to the category to which the preset multimedia message belongs and the current environmental condition.
In conclusion, through the method of the invention, the preprocessed multimedia information and the corresponding suggested action are displayed on the wearable device. Thus, when the user is in motion or the mobile device is not beside the user or the user is inconvenient to view, the preprocessed multimedia messages can be timely accepted through the wearable device on the user, important messages are prevented from being missed, and unimportant messages can be filtered. The invention overcomes the defects in the prior art, can display the multimedia message of the communication terminal on the wearable device and generate the suggested action of the message by preprocessing the multimedia message, greatly reduces the workload of people for reading the message, reduces the operation of users and effectively improves the efficiency of the users.
Based on the same inventive concept, the invention provides kinds of devices for displaying multimedia messages on wearable equipment, the structural schematic diagram is shown in fig. 2, the device comprises:
an extracting unit 201, which extracts key information in the multimedia message;
a classification unit 202, configured to determine a category to which the multimedia message belongs according to the extracted key information and a preset message classification rule;
the display matching unit 203 determines at least corresponding display rules according to the category of the multimedia message, determines the most matched display rule in the corresponding display rules according to the extracted key information;
and a message generating unit 204 for saving the extracted key information into the most matched display rule template to generate a multimedia message to be displayed on the wearable device.
The device further comprises a processing unit 205, when the extraction unit 201 extracts the key information in the multimedia message, the multimedia message is processed correspondingly according to the extracted multimedia message type.
When the multimedia message type is a text message, the processing unit 205 processes the multimedia message including standardizing the text message, further extracting key information in the text message after the standardized conversion for determining a category to which the multimedia message belongs, and determining a best matching display rule template to generate the multimedia message to be displayed on the wearable device.
When the multimedia message type is a picture message, the processing unit 205 processes the multimedia message, including: and judging whether the picture in the picture message needs to be compressed, cut, fuzzified or identified by the image content according to the extracted key information, if so, processing the picture, and storing the extracted key information and the processed picture into the most matched display rule template to generate the multimedia message to be displayed on the wearable device.
When the multimedia message type is an audio message, the processing unit 205 processes the multimedia message by determining whether audio in the audio message needs to be played on the wearable device according to the extracted key information, and if so, further determining whether compression is needed or whether conversion into a text message is needed;
if the compression is needed, forming compressed audio, storing the extracted key information and the compressed audio into the most matched display rule template, and generating a multimedia message to be displayed on the wearable device;
if the multimedia message needs to be converted into the text message, after the audio is converted into the text message, the key information in the text message is further extracted for determining the category to which the multimedia message belongs, determining the most matched display rule template, and generating the multimedia message to be displayed on the wearable device;
if no play is required on the wearable device, a text message is displayed on the wearable device that audio messages were received.
When the multimedia message type is a video message, the processing unit 205 processes the multimedia message by determining whether a video in the video message needs to be played on the wearable device according to the extracted key information, and if so, further determining whether compression is needed or a caption message needs to be extracted;
if the compression is needed, forming a compressed video, storing the extracted key information and the compressed video into the most matched display rule template, and generating a multimedia message to be displayed on the wearable device;
if the caption message needs to be extracted, after the caption message in the video is extracted, further extracting key information in the caption message for determining the category to which the multimedia message belongs and determining the most matched display rule template to generate the multimedia message to be displayed on the wearable device;
if no play is required on the wearable device, a text message is displayed on the wearable device that video messages were received.
The apparatus further includes a suggested action generating unit 206, which determines, after the classifying unit 202 determines the category to which the multimedia message belongs, a suggested action to be displayed on the wearable device according to a preset correspondence between the category to which the multimedia message belongs and the suggested action.
The apparatus further includes an action transmission unit 207, which transmits the suggested action input by the user on the wearable device to the communication terminal after the suggested action is displayed on the wearable device, for the communication terminal to perform an operation according to the suggested action.
Each display rule template also corresponds to an environmental condition for displaying the multimedia message on the wearable device;
the apparatus further comprises an environment monitoring unit 208 for monitoring the current environmental condition, and the display matching unit 203 is further configured to determine the most matched display rule according to the extracted key information and the current environmental condition.
Each suggested action also corresponds to an environmental condition for executing the suggested action;
the suggested action generating unit 206 is further configured to determine a suggested action to be displayed on the wearable device according to the category to which the preset multimedia message belongs and the current environmental condition.
In summary, the apparatus for displaying multimedia messages on a wearable device of the present invention may be located on the wearable device, the communication device first sends the received multimedia messages to the wearable device, and then the wearable device performs preprocessing operations such as extraction, processing, classification, display matching, message generation, suggested action generation, action transmission, and the like on the multimedia messages, and finally displays the preprocessed multimedia messages and the corresponding suggested actions on the wearable device.
For clarity of explanation, specific scenarios are set forth below.
Example
The embodiments described herein are merely for explaining and explaining the manner of multimedia information processing, but a specific multimedia information processing method is not limited to the manner mentioned below. The processing of multimedia messages can be divided into the following processes according to specific types:
1. the text message is subjected to standardized conversion, for example, the system adopts simplified text representation, missing parts are supplemented for sentences, punctuation-lacking word breaks, sentence segmentation, sentence principal component extraction, message theme extraction and the like are carried out, and the final purpose of the operations is to extract the main content of the text message so as to display the main content of the text message, namely, the text message can be clear.
An embodiment is that pieces of short messages (Jingdong) honored customers are received on a user mobile communication device, your order (1000100010) is delivered out of a warehouse, and is being delivered, you are peacefully waiting, the Jingdong does not refund the order with the invalidation as the operation of actively requiring your bank card information, the Jingdong is just in charge of preventing fraud, if the order needs to be refunded, please reply to CKTD, "the sender extracting the short message is Jingdong", and the message subject extracting the message is "order delivered". A message display content of "Jingdong: your order delivered" can be generated and sent to a wearable device for display.
2. Audio message for an audio message, the user may be conditioned on the size of the audio extracted from the audio message, the length of time, whether the user is wearing headphones, etc. to decide whether the audio needs to be compressed, played on a wearable device, converted to word message processing, or simply to tell the user that voice messages were received.
Embodiments the user is exercising in a gym wearing a wearable device, the user receives voice messages on the mobile communication device, the voice content is a brief voice message of "when to eat", and the means for displaying a multimedia message on the wearable device sends the voice message to the wearable device and plays it along with sender , depending on the current situation that the user is exercising and wearing headphones.
3. Picture message: for the picture message, whether to compress or not can be decided according to the size and type of the picture extracted from the picture message and the display condition of the wearable device.
The embodiment is that when a user runs outdoors in a non-network place, certain IM software on a mobile communication device of the user receives high-quality and large-size pictures sent by friends, and the pictures need to be compressed and displayed on a screen of a wearable device because the display screen of the wearable device is small, small-size gif-format facial expressions and animations sent by the friends are received by the user through the certain IM software, and the pictures can be well displayed on the wearable device, so that the pictures do not need to be compressed.
4. Video message, the video message can be determined whether the video needs to be compressed or not, whether the video needs to be played on the wearable device or not, or only the user is told to receive video messages according to the conditions of the size, the time length, the video picture quality, whether the user wears earphones or not, the display condition of the wearable device and the like of the video message extracted from the video message.
According to the embodiment, when a user is at rest, the mobile communication device of the user receives a video short message sent by some IM software, the video short message is short in duration and can be displayed on the screen of the wearable device as the picture quality is , and therefore the video short message is sent to the wearable device of the user to be displayed and played.
Example two
The method for displaying multimedia messages on wearable devices of the present invention is further described in by specific application examples:
1) assuming that the multimedia message belongs to four categories, the corresponding display rules are as follows, wherein [ represents that corresponding information needs to be extracted from the message and filled into the display rule template as the content that needs to be displayed on the wearable device finally.
The classification of messages is determined from the chat type, if the rules of the chat type are not met, whether the rules of the notification type are met is determined, and if the rules of the chat type are not met, whether the rules of the notification type belong to the rules of the notification type is determined finally.
The corresponding relationship between the category to which the multimedia message belongs, the corresponding message classification rule, and the most matched display rule template is shown in table 2. Here, it is equivalent to the display matching unit having found the best matching display rule corresponding to the category to which the multimedia message belongs.
TABLE 2
2) When a new version notification sent by the microblog is received, the microblog new version is on line! ", the source of the message extracted by the extraction unit is ' microblog app ', and the message content is ' microblog new edition online! ", the key" new version "of the message. The classification unit classifies the message into a notification category according to the information and the classification rule, and the message generation unit generates the content of 'you receive the microblog app notification'.
When self-timer photos sent by WeChat friend Wang are received, the extraction unit extracts that the source of the message is 'WeChat-Wang', the processing unit compresses the photos to form picture thumbnails, the classification unit classifies the message into picture types according to the message and the classification rules, and the message generation unit generates the content of 'WeChat-Wang [ picture thumbnails'.
3) And transmitting the content generated in the step 2 to the wearable device.
4) The wearable device receives the content generated in the step 2) and displays the content on a screen.
EXAMPLE III
The embodiment provides methods for automatically suggesting actions for multimedia messages, and the following steps will describe the method for automatically suggesting actions for multimedia messages by specific application examples:
1) the category to which the multimedia message belongs and the corresponding suggested action are preset, as still shown in table 1,
| categories to which multimedia messages belong | Suggesting actions |
| type of advertisement | Deleting the message |
| Type of notification | Setting read |
| Chat type | Default actions |
| Picture type | Saving pictures |
TABLE 1
2) When a new version notification sent by the microblog app is received, the microblog new version is online! ", the classification unit classifies the message into the notification category according to the above message and the above classification rule, and the suggested action generation unit generates the corresponding suggested action of the notification category according to table 1.
When self-timer photos sent by WeChat friend Wang are received, the classification unit classifies the messages into the picture types according to the messages and the classification rules, and the suggested action generation unit generates the corresponding suggested actions of the picture types according to the table 1.
3) And the user operates the wearable device according to the suggested action in the step 2.
4) The wearable device receives a suggested action input operation by the user and transmits the suggested action input operation to the communication terminal.
5) And the communication terminal takes corresponding action according to the data transmitted by the wearable equipment.
Example four
The invention displays the preprocessed multimedia information and the corresponding suggested action on the wearable device. Taking table 3 as an example, table 3 is data content displayed on the wearable device.
TABLE 3
After the suggested action is displayed on the wearable device, the suggested action input by the user on the wearable device is sent to the communication terminal, wherein the data received by the communication terminal at least comprises the following data, as shown in table 4.
TABLE 4
And the environment monitoring unit is used for collecting information of the surrounding environment, such as GPS position information, network connection state, illumination, temperature and the like. Relevant data can be collected from wearable devices, connected sensors and devices, and other apps, and this environmental information can affect the way messages are displayed and suggested actions. The following description will be made by taking examples five and six. Example five illustrates the effect of environmental information on the way a message is displayed. Embodiment six illustrates the effect of environmental information on the way messages are displayed and suggested actions.
EXAMPLE five
Each display rule template also corresponds to an environmental condition for displaying the multimedia message on the wearable device, and the method further includes determining a best matching display rule based on the extracted key information and the current environmental condition.
Table 5 shows the correspondence between the category to which the multimedia message belongs, the corresponding message classification rule, the environmental condition, and the best matching display rule template in this embodiment.
TABLE 5
1) When self-timer photos sent by WeChat friend Wang are received, the extraction unit extracts that the source of the message is WeChat-Wang, the processing unit compresses the photos to form picture thumbnails, the classification unit classifies the message into picture types according to the message and the classification rules, and the environment monitoring unit collects the content of the message-Wang (picture thumbnails) when the current environment condition is wireless network access.
If the environment monitoring unit collects the current environment condition that no wireless network access exists, the message generating unit generates the contents of 'WeChat-Wang: pictures are received'.
2) And transmitting the content generated in the step 1 to the wearable device.
3) The wearable device receives the content generated in the step 1) and displays the content on a screen.
EXAMPLE six
Each suggested action also corresponds to an environmental condition for performing the suggested action, and the method further includes determining a suggested action to display on the wearable device based on the category to which the preset multimedia message belongs and the current environmental condition.
Table 6 shows the correspondence between the category to which the multimedia message belongs, the corresponding message classification rule, the environmental condition, and the best matching display rule template in this embodiment.
Table 7 shows the correspondence relationship between the category to which the multimedia message belongs, the environmental condition, and the suggested action.
TABLE 6
TABLE 7
Example
1) When the system notification is received, the user is informed that the mobile system is connected with the vehicle-mounted system.
2) The extraction unit extracts the source of the message, the system message, and other required information. The classification unit classifies the information into "navigation" categories according to the corresponding classification rules, and the above information. And generating display contents as' system: connect to the onboard system ".
3) The suggested action generating unit determines the suggested action given to the user according to the current environment information and the category information as 'turning on the vehicle navigation'.
4) The generated display content and the suggested action are sent to the wearable device.
5) And displaying the display content and the suggested action to the user.
6) And waiting for the user operation, and if the user selects the suggested operation, converting the operation into a command and sending the command to the mobile terminal for execution.
Example two
1) When mr. plum messages, "where do you are" were received.
2) The extraction unit extracts the source of the message, mr. pruni, and other required information. The classification unit classifies the information into a question location category according to the corresponding classification rule and the above information. And generating a display content of Mr. Lifei according to the current environment and the extracted information: where you are ".
3) The suggested action generating unit automatically replies the current position information according to the current environment information, namely the connection state of the mobile terminal and the vehicle-mounted system and the suggested action determined by the category information to the user.
4) The generated display content and the suggested action are sent to the wearable device.
5) And displaying the display content and the suggested action to the user.
6) And waiting for the user operation, and if the user selects the suggested operation, converting the operation into a command and sending the command to the mobile terminal for execution.
The beneficial effect of the invention is that,
the invention provides methods for displaying multimedia messages and automatically suggesting actions on wearable equipment, wherein the multimedia messages displayed on the wearable equipment are preprocessed by series, so that important messages can be better prevented from being missed, unimportant messages are filtered, suggested actions are generated according to message contents, manual operations of users are reduced, and the efficiency of the users is effectively improved.
The above description is only a preferred embodiment of the present invention, and is not intended to limit the scope of the present invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (22)
- A method of displaying a multimedia message on a wearable device of the type , the method comprising:extracting key information in the multimedia message;determining the category of the multimedia message according to the extracted key information and a preset message classification rule;determining at least corresponding display rules according to the category of the multimedia message, and determining the most matched display rule in the corresponding display rules according to the extracted key information;storing the extracted key information into the most matched display rule template, and generating a multimedia message to be displayed on the wearable device;wherein each display rule template further corresponds to an environmental condition for displaying the multimedia message on the wearable device, the method further includes determining a best matching display rule based on the extracted key information and the current environmental condition.
- 2. The method of claim 1, wherein in extracting the key information in the multimedia message, the method further comprises: and correspondingly processing the multimedia message according to the extracted multimedia message type.
- 3. The method of claim 2, wherein when the multimedia message type is a text message, processing the multimedia message comprises normalizing the text message, further extracting key information in the text message after the normalizing for determining the category to which the multimedia message belongs, and determining a best matching display rule template to generate the multimedia message to be displayed on the wearable device.
- 4. The method of claim 2, wherein when the multimedia message type is a picture message, processing the multimedia message comprises: and judging whether the picture in the picture message needs to be compressed, cut, fuzzified or identified by the image content according to the extracted key information, if so, processing the picture, and storing the extracted key information and the processed picture into the most matched display rule template to generate the multimedia message to be displayed on the wearable device.
- 5. The method of claim 2, wherein when the multimedia message type is an audio message, processing the multimedia message comprises determining whether audio in the audio message needs to be played on the wearable device based on the extracted key information, and if so, determining whether compression is needed or conversion into a text message is needed;if the compression is needed, forming compressed audio, storing the extracted key information and the compressed audio into the most matched display rule template, and generating a multimedia message to be displayed on the wearable device;if the multimedia message needs to be converted into the text message, after the audio is converted into the text message, the key information in the text message is further extracted for determining the category to which the multimedia message belongs, determining the most matched display rule template, and generating the multimedia message to be displayed on the wearable device;if no play is required on the wearable device, a text message is displayed on the wearable device that audio messages were received.
- 6. The method of claim 2, wherein when the multimedia message type is a video message, processing the multimedia message comprises determining whether a video in the video message needs to be played on the wearable device according to the extracted key information, and if so, determining whether compression is needed or a caption message needs to be extracted;if the compression is needed, forming a compressed video, storing the extracted key information and the compressed video into the most matched display rule template, and generating a multimedia message to be displayed on the wearable device;if the caption message needs to be extracted, after the caption message in the video is extracted, further extracting key information in the caption message for determining the category to which the multimedia message belongs and determining the most matched display rule template to generate the multimedia message to be displayed on the wearable device;if no play is required on the wearable device, a text message is displayed on the wearable device that video messages were received.
- 7. The method of claim 1, wherein after determining the category to which the multimedia message belongs, the method further comprises:and determining the suggested action to be displayed on the wearable equipment according to the corresponding relation between the preset multimedia message belonging category and the suggested action.
- 8. The method of claim 7, wherein after the suggested action is displayed on the wearable device, the method further comprises:and sending the suggested action input by the user on the wearable device to the communication terminal, and enabling the communication terminal to execute operation according to the suggested action.
- 9. The method of claim 7, further comprising:recording the belonged category of each multimedia message and the user habit action corresponding to the category, and forming the corresponding relation between the belonged category of the preset multimedia message and the suggested action.
- 10. The method of any of claims 1-9 and , wherein the categories to which the multimedia message belongs include announcements, notifications, chats, and pictures.
- 11. The method according to any of , wherein the extracting key information in the multimedia message comprises message ID, message source, message receiving time, message keyword, message specific content.
- 12. The method of any of , wherein the message classification rules are formed based on machine learning, or formed based on rules, or formed based on a combination of machine learning and rules.
- 13. The method of claim 8, wherein each suggested action further corresponds to an environmental condition for performing the suggested action, and wherein the method further comprises determining the suggested action to be displayed on the wearable device based on the category to which the predetermined multimedia message belongs and the current environmental condition.
- An apparatus for displaying a multimedia message on a wearable device of the type , the apparatus comprising:the extraction unit is used for extracting key information in the multimedia message;the classification unit is used for determining the category of the multimedia message according to the extracted key information and a preset message classification rule;the display matching unit determines at least corresponding display rules according to the category of the multimedia message, and determines the most matched display rule in the corresponding display rules according to the extracted key information;the message generating unit stores the extracted key information into the most matched display rule template to generate a multimedia message to be displayed on the wearable device;wherein each display rule template further corresponds to an environmental condition for displaying the multimedia message on the wearable device; the device also comprises an environment monitoring unit used for monitoring the current environment condition, and the display matching unit is also used for determining the most matched display rule according to the extracted key information and the current environment condition.
- 15. The apparatus as claimed in claim 14, further comprising a processing unit, wherein when the extracting unit extracts the key information in the multimedia message, the multimedia message is processed according to the extracted multimedia message type.
- 16. The apparatus of claim 15, wherein when the multimedia message type is a text message, the processing unit processes the multimedia message including normalizing the text message, extracting key information from the normalized text message for determining the category to which the multimedia message belongs in step , and determining a best matching display rule template to generate the multimedia message for display on the wearable device.
- 17. The apparatus as claimed in claim 15, wherein when the multimedia message type is a picture message, the processing unit processes the multimedia message comprising: and judging whether the picture in the picture message needs to be compressed, cut, fuzzified or identified by the image content according to the extracted key information, if so, processing the picture, and storing the extracted key information and the processed picture into the most matched display rule template to generate the multimedia message to be displayed on the wearable device.
- 18. The apparatus of claim 15, wherein when the multimedia message type is an audio message, the processing unit processes the multimedia message by determining whether audio in the audio message needs to be played on the wearable device according to the extracted key information, and if so, determining whether compression is needed or conversion into a text message is needed;if the compression is needed, forming compressed audio, storing the extracted key information and the compressed audio into the most matched display rule template, and generating a multimedia message to be displayed on the wearable device;if the multimedia message needs to be converted into the text message, after the audio is converted into the text message, the key information in the text message is further extracted for determining the category to which the multimedia message belongs, determining the most matched display rule template, and generating the multimedia message to be displayed on the wearable device;if no play is required on the wearable device, a text message is displayed on the wearable device that audio messages were received.
- 19. The apparatus of claim 15, wherein when the multimedia message type is a video message, the processing unit processes the multimedia message by determining whether video in the video message needs to be played on the wearable device according to the extracted key information, and if so, determining whether compression is needed or whether caption message needs to be extracted;if the compression is needed, forming a compressed video, storing the extracted key information and the compressed video into the most matched display rule template, and generating a multimedia message to be displayed on the wearable device;if the caption message needs to be extracted, after the caption message in the video is extracted, further extracting key information in the caption message for determining the category to which the multimedia message belongs and determining the most matched display rule template to generate the multimedia message to be displayed on the wearable device;if no play is required on the wearable device, a text message is displayed on the wearable device that video messages were received.
- 20. The apparatus of claim 14, further comprising a suggested action generating unit, wherein after the classifying unit determines the category to which the multimedia message belongs, the suggested action to be displayed on the wearable device is determined according to a preset corresponding relationship between the category to which the multimedia message belongs and the suggested action.
- 21. The apparatus of claim 20, further comprising an action transmission unit configured to transmit the suggested action input by the user on the wearable device to the communication terminal after the suggested action is displayed on the wearable device, for the communication terminal to perform an operation according to the suggested action.
- 22. The apparatus of claim 21, wherein each suggested action further corresponds to an environmental condition for performing the suggested action;the suggested action generating unit is further used for determining suggested actions to be displayed on the wearable device according to the preset multimedia message belonging category and the current environmental condition.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611020804.3A CN106686208B (en) | 2016-11-21 | 2016-11-21 | Method and device for displaying multimedia message on wearable devices |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611020804.3A CN106686208B (en) | 2016-11-21 | 2016-11-21 | Method and device for displaying multimedia message on wearable devices |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106686208A CN106686208A (en) | 2017-05-17 |
| CN106686208B true CN106686208B (en) | 2020-01-31 |
Family
ID=58865843
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611020804.3A Active CN106686208B (en) | 2016-11-21 | 2016-11-21 | Method and device for displaying multimedia message on wearable devices |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106686208B (en) |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107548043A (en) * | 2017-07-12 | 2018-01-05 | 广东小天才科技有限公司 | A kind of method and system for controlling wearable device to receive pictorial information |
| CN109164994A (en) * | 2018-06-28 | 2019-01-08 | 努比亚技术有限公司 | Display methods, intelligent wearable device and storage medium based on intelligent wearable device |
| CN109597919B (en) * | 2018-10-18 | 2021-11-09 | 中国科学院计算机网络信息中心 | Data management method and system fusing graph database and artificial intelligence algorithm |
| CN110471638A (en) * | 2019-07-09 | 2019-11-19 | 努比亚技术有限公司 | A kind of information display method, wearable device and computer readable storage medium |
| CN112434328B (en) * | 2019-08-26 | 2024-04-05 | 钉钉控股（开曼）有限公司 | Message forwarding (transferring) mail forwarding method and electronic equipment |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104205785A (en) * | 2012-03-28 | 2014-12-10 | 高通股份有限公司 | Multifunction wristband for displaying social information |
| CN105094824A (en) * | 2015-07-20 | 2015-11-25 | 北京京东尚科信息技术有限公司 | Display method for notification messages on intelligent watch and intelligent watch |
| CN105230114A (en) * | 2014-05-23 | 2016-01-06 | 三星电子株式会社 | Wearable device and the method for reception of notification message is set in wearable device |
| CN105824645A (en) * | 2016-03-30 | 2016-08-03 | 联想(北京)有限公司 | Information processing method and terminal |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8983551B2 (en) * | 2005-10-18 | 2015-03-17 | Lovina Worick | Wearable notification device for processing alert signals generated from a user's wireless device |
| KR20160059069A (en) * | 2014-11-17 | 2016-05-26 | 삼성전자주식회사 | Apparatus and method for managing message |
-
2016
- 2016-11-21 CN CN201611020804.3A patent/CN106686208B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104205785A (en) * | 2012-03-28 | 2014-12-10 | 高通股份有限公司 | Multifunction wristband for displaying social information |
| CN105230114A (en) * | 2014-05-23 | 2016-01-06 | 三星电子株式会社 | Wearable device and the method for reception of notification message is set in wearable device |
| CN105094824A (en) * | 2015-07-20 | 2015-11-25 | 北京京东尚科信息技术有限公司 | Display method for notification messages on intelligent watch and intelligent watch |
| CN105824645A (en) * | 2016-03-30 | 2016-08-03 | 联想(北京)有限公司 | Information processing method and terminal |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106686208A (en) | 2017-05-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106686208B (en) | Method and device for displaying multimedia message on wearable devices | |
| CN107197384B (en) | The multi-modal exchange method of virtual robot and system applied to net cast platform | |
| US11386394B2 (en) | Method and system for shared document approval | |
| US20170061248A1 (en) | System and Method of Detecting Offensive Content Sent or Received on a Portable Electronic Device | |
| US9098385B2 (en) | Content managing apparatus, content managing method, content managing program, and integrated circuit | |
| CN109710370B (en) | Session list display method and device and electronic equipment | |
| US10291767B2 (en) | Information presentation method and device | |
| CN106959852B (en) | Application icon corner mark display method and device and terminal | |
| WO2020253388A1 (en) | Machine learning-based e-mail message processing method, apparatus, medium, and electronic device | |
| CN108243086B (en) | Message processing method and system | |
| CN110458130B (en) | Person identification method, person identification device, electronic equipment and storage medium | |
| CN104021398A (en) | Wearable intelligent device and method for assisting identity recognition | |
| CN103309998A (en) | Message query method, message query device and terminal equipment | |
| CN104969254A (en) | Personalized summaries for content | |
| CN111158924B (en) | Content sharing method and device, electronic equipment and readable storage medium | |
| EP3367249A1 (en) | Information processing system and information processing method | |
| CN105814587A (en) | Local real-time facial recognition | |
| CN103458300A (en) | Television false advertisement prompting method and system | |
| US20180248830A1 (en) | Methods for generating message notifications | |
| CN113542801B (en) | Method, device, equipment, storage medium and program product for generating anchor identification | |
| CN112929253A (en) | Virtual image interaction method and device | |
| CN110909241B (en) | Information recommendation method, user identification recommendation method, device and equipment | |
| CN102780652A (en) | Method and system for classified collection of information in instant messaging | |
| US9906485B1 (en) | Apparatus and method for coordinating live computer network events | |
| CN113626624B (en) | Resource identification method and related device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |