WO2023185967A1 - 富媒体信息处理方法、***及相关装置 - Google Patents
富媒体信息处理方法、***及相关装置 Download PDFInfo
- Publication number
- WO2023185967A1 WO2023185967A1 PCT/CN2023/084886 CN2023084886W WO2023185967A1 WO 2023185967 A1 WO2023185967 A1 WO 2023185967A1 CN 2023084886 W CN2023084886 W CN 2023084886W WO 2023185967 A1 WO2023185967 A1 WO 2023185967A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- rich media
- capability
- component
- card
- media capability
- Prior art date
Links
- 230000010365 information processing Effects 0.000 title claims abstract description 28
- 238000003672 processing method Methods 0.000 title claims description 14
- 238000009877 rendering Methods 0.000 claims description 154
- 230000003068 static effect Effects 0.000 claims description 66
- 230000002452 interceptive effect Effects 0.000 claims description 58
- 238000000034 method Methods 0.000 claims description 43
- 230000004044 response Effects 0.000 claims description 42
- 230000015654 memory Effects 0.000 claims description 31
- 230000003993 interaction Effects 0.000 claims description 24
- 230000015556 catabolic process Effects 0.000 claims description 19
- 238000006731 degradation reaction Methods 0.000 claims description 19
- 230000009191 jumping Effects 0.000 claims description 2
- 238000004891 communication Methods 0.000 description 31
- 230000006870 function Effects 0.000 description 19
- 238000007726 management method Methods 0.000 description 15
- 238000010295 mobile communication Methods 0.000 description 14
- 101100264195 Caenorhabditis elegans app-1 gene Proteins 0.000 description 13
- 238000012545 processing Methods 0.000 description 12
- 230000008569 process Effects 0.000 description 9
- 238000004590 computer program Methods 0.000 description 8
- 230000000694 effects Effects 0.000 description 7
- 230000005236 sound signal Effects 0.000 description 7
- 101150053844 APP1 gene Proteins 0.000 description 6
- 101100189105 Homo sapiens PABPC4 gene Proteins 0.000 description 6
- 102100039424 Polyadenylate-binding protein 4 Human genes 0.000 description 6
- 238000010586 diagram Methods 0.000 description 6
- 238000005516 engineering process Methods 0.000 description 6
- 230000001360 synchronised effect Effects 0.000 description 6
- 230000003044 adaptive effect Effects 0.000 description 5
- 230000003287 optical effect Effects 0.000 description 5
- 229920001621 AMOLED Polymers 0.000 description 4
- 238000013528 artificial neural network Methods 0.000 description 4
- 210000000988 bone and bone Anatomy 0.000 description 4
- 210000004027 cell Anatomy 0.000 description 4
- 238000012546 transfer Methods 0.000 description 4
- 230000000007 visual effect Effects 0.000 description 4
- 230000001133 acceleration Effects 0.000 description 3
- 230000009189 diving Effects 0.000 description 3
- PCHJSUWPFVWCPO-UHFFFAOYSA-N gold Chemical compound [Au] PCHJSUWPFVWCPO-UHFFFAOYSA-N 0.000 description 3
- 239000010931 gold Substances 0.000 description 3
- 229910052737 gold Inorganic materials 0.000 description 3
- 230000007774 longterm Effects 0.000 description 3
- 101100421745 Caenorhabditis elegans sms-1 gene Proteins 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 2
- 238000006243 chemical reaction Methods 0.000 description 2
- 238000013500 data storage Methods 0.000 description 2
- 230000000593 degrading effect Effects 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 230000005855 radiation Effects 0.000 description 2
- 239000004065 semiconductor Substances 0.000 description 2
- 210000000352 storage cell Anatomy 0.000 description 2
- 239000002699 waste material Substances 0.000 description 2
- 230000003321 amplification Effects 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 230000003416 augmentation Effects 0.000 description 1
- 230000003190 augmentative effect Effects 0.000 description 1
- 238000013529 biological neural network Methods 0.000 description 1
- 210000004556 brain Anatomy 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000005266 casting Methods 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000001149 cognitive effect Effects 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 230000005484 gravity Effects 0.000 description 1
- 230000003862 health status Effects 0.000 description 1
- 230000001939 inductive effect Effects 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 210000002569 neuron Anatomy 0.000 description 1
- 238000003199 nucleic acid amplification method Methods 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 239000002096 quantum dot Substances 0.000 description 1
- 230000011664 signaling Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 241000894007 species Species 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000001755 vocal effect Effects 0.000 description 1
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1415—Digital output to display device ; Cooperation and interconnection of the display device with other functional units with means for detecting differences between the image stored in the host and the images displayed on the displays
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
Definitions
- This application relates to the field of electronic technology, and in particular to rich media information processing methods, systems and related devices.
- Rich media refers to information dissemination methods with animation, sound, video and/or interactivity.
- Rich media can include one or more forms of streaming media, sound, Flash, and programming languages such as Java, Javascript, and DHTML. combination of species.
- ordinary text messages i.e. text messages or multimedia messages
- rich media messages presented in the form of rich media cards have a higher information carrying capacity and can provide a variety of information types such as text, images, videos, data, etc., and have rich interactive functions. Provide users with more business services.
- the display and interactive functions of rich media cards in an application (APP) on the terminal device are limited by the APP's own rendering capabilities and interactive capabilities.
- the terminal device cannot display the above rich media card. In this way, the user's experience of using rich media messages is greatly reduced.
- This application provides a rich media information processing method, system and related devices, which can obtain rich media messages within the rich media capability range of the first application of the terminal device, and display the above rich media messages in the first application in the form of rich media cards, Effectively improves user experience.
- this application provides a rich media information processing system, including a first terminal device, a business device and a card server,
- the first terminal device is configured to send first information to the card server.
- the first information is used to indicate a first set of rich media capabilities supported by the first application of the first terminal device.
- the first set of rich media capabilities includes at least one rich media capability.
- the business device is used to send the card parameters of the original rich media card and the device identification of the first terminal device to the card server; the card server is also used to generate the first card information based on the card parameters and the first rich media capability set, and the first card information including the card data of the first rich media card and the corresponding first label, and sending the first label to the business device;
- the business device is also used to send a rich media message to the first application of the first terminal device, where the rich media message includes the first a tag;
- the first application of the first terminal device is also used to send an acquisition request to the card server, and the acquisition request includes the first tag;
- the card server is also used to send card data to the first application of the first terminal device; the first terminal
- the first application of the device is also
- the card server can convert the original rich media capabilities based on the rich media capability set of the first application of the first terminal device.
- the media card is adaptively downgraded to a rich media card within the rich media capability range of the first application; in this way, the first terminal device can display the above-mentioned rich media card and support all interactive capabilities of the above-mentioned rich media card in the first application, Effectively improves user experience.
- rich media capabilities include component rendering capabilities and interaction capabilities; component rendering capabilities refer to rendering rich The ability to specify components in the media card.
- the specified components include one or more of the following: static images, dynamic images, videos, horizontal images, carousel images, voting forms, buttons, etc.;
- the interactive capabilities include one or more of the following: Jump to the browser, jump to the default application (APP), jump to the phone APP to make a call, jump to the map APP for positioning and navigation, jump to other APPs to share rich media cards, jump to quick apps, etc.;
- the default APP refers to an APP with a web version.
- the card data includes the card layout information of the original rich media card and the component parameters of each component in the original rich media card.
- the component parameters include the component name, information indicating the display content of the component, and the specified interaction capability of the implementation component. Some or all of the URL links, component types, etc.
- the first information includes an identification of each rich media capability in the first rich media set; or the first information includes a version number of the first rich media set, and the card server stores multiple rich media capabilities.
- the ability to upload rich media through version numbers can save storage space and signaling overhead.
- the above-mentioned generation of the first card information based on card parameters and the first rich media capability set specifically includes: based on the card parameters, determining at least one rich media capability required by each component in the original rich media card , the rich media capability required by the first component includes the first rich media capability, and the first component is any component in the original rich media card; when the first rich media capability set does not include the first rich media capability, based on the default The capability downgrade relationship is used to downgrade the capability of the first component; after the capability is downgraded, the first card information of the first rich media card within the rich media capability range of the first application is generated.
- the card parameters include the component type of the first component; the rich media capabilities required by the first component include the component rendering capabilities corresponding to the component type of the first component; the card parameters include the implementation-specified interaction capabilities of the first component When connecting to a URL, the rich media capabilities required by the first component include specifying interactive capabilities.
- the capability downgrade relationship includes one or more of the following: the first rich media capability is downgraded to the second rich media capability, or the first rich media capability is downgraded to null; the second rich media capability is downgraded to the third rich media capability.
- the third rich media capability, or the second rich media capability is downgraded to null; downgrading to null means that it cannot be downgraded to other rich media capabilities.
- some rich media capabilities can perform multi-layer degradation.
- the capability downgrade relationship includes the capability downgrade relationship of component rendering capability and the capability downgrade relationship of interaction capability.
- the capability downgrade relationship of component rendering capability includes one or more of the following: the rendering capability of dynamic pictures is downgraded to static pictures. The rendering capability of horizontal swipe pictures is downgraded to that of static pictures. The rendering capability of videos is downgraded to that of static pictures. The rendering capability of carousel pictures is downgraded to that of horizontal swipe pictures. The rendering capability of static pictures is downgraded.
- the rendering ability of the voting form is downgraded to empty;
- the ability downgrading relationship of the interactive ability includes one or more of the following: the ability to jump to the default APP is downgraded to the ability to jump to the browser; jump to the browser The ability to jump to the phone APP to make calls is downgraded to empty; the ability to jump to the map APP for positioning and navigation is downgraded to empty; the ability to jump to other pages of the first application to reply to information is downgraded to empty; jump The ability to switch to other apps to share rich media cards has been downgraded to empty.
- the first rich media capability set does not include the first rich media capability but includes the second rich media capability.
- the second rich media capability is the downgraded capability of the first rich media capability.
- the first rich media capability and The second rich media capability is the component rendering capability;
- the card parameters include information indicating the first display content of the first component, and the first display content is displayed through the first rich media capability;
- the first rich media card includes the second component,
- the display content of the two components is the second display content, the second display content is determined based on the first display content, and the second display content is displayed through the second rich media capability.
- the first rich media capability is the rendering capability of videos
- the second rich media capability is the rendering capability of static images
- the first display content is a video
- the second display content is a frame of static images in the video.
- the first rich media capability set includes the third rich media capability and does not include the first rich media capability.
- the second rich media capability, the third rich media capability is the downgraded capability of the second rich media capability, the first rich media capability, the second rich media capability, and the third rich media capability are component rendering capabilities;
- the card parameters include indicating the third rich media capability.
- Information about the first display content of a component the first display content is displayed through the first rich media capability;
- the first rich media card includes a third component, the display content of the third component is the third display content, and the third display content It is determined based on the first display content, and the third display content is displayed through the third rich media capability.
- the first rich media capability set does not include the first rich media capability, the first rich media capability cannot be downgraded to other rich media capabilities, and the first rich media capability is component rendering capability; the card parameter includes an indication of the first rich media capability. Information about the first display content of the component, the first display content is displayed through the first rich media capability; the first rich media card does not display the first display content.
- the first rich media card includes a fourth component
- the display content of the fourth component is the first URL link or the replacement content of the first component
- the card parameters include the first URL of the first component that implements the interactive capability. Links and replacement content for the first component.
- the card parameters include a first URL link of the first component that implements the fourth rich media capability, and a second URL link of the first component that implements the fifth rich media capability;
- the fifth rich media capability is the After downgrading the four rich media capabilities, the fourth rich media capability and the fifth rich media capability are interactive capabilities;
- the first rich media capability set includes the fourth rich media capability, the first rich media card includes the first component,
- a terminal device is further configured to, in response to the first input operation for the first component, jump to the user interface indicated by the first URL link based on the fourth rich media capability;
- the first rich media capability set does not include the fourth rich media capability , when the fifth rich media capability is included, the first rich media card includes a fifth component, and the first terminal device is further configured to jump to the second URL based on the fifth rich media capability in response to the first input operation for the fifth component.
- the link indicates the user interface.
- the first URL link is the URL link of the default APP
- the second URL link is the URL link of the web version of the default APP
- the fourth rich media capability is the ability to jump to the default APP.
- the five rich media capabilities are the ability to jump to the browser.
- the first rich media capability set does not include the fourth rich media capability but includes the fifth rich media capability.
- the fifth rich media capability is the downgraded capability of the fourth rich media capability.
- the fourth rich media capability and The fifth rich media capability is the interactive capability; the card parameters include the first URL link of the first component that implements the fourth rich media capability, and the card parameters do not include the URL link of the first component that implements the fifth rich media capability; the first rich media The card does not include components with fourth rich media capabilities.
- the first rich media capability set does not include the fourth rich media capability, the fourth rich media capability cannot be downgraded to other rich media capabilities, and the fourth rich media capability is the interactive capability; the card parameters include the first component The first URL link that implements the fourth rich media capability; the first rich media card does not include components with the fourth rich media capability.
- the first rich media card includes a sixth component
- the sixth component is generated based on component parameters of the first component, and the component parameters of the sixth component do not include the first URL link.
- sending an acquisition request to the card server specifically includes: receiving a second input operation for viewing the rich media card corresponding to the rich media message; and in response to the second input operation, sending an acquisition request to the card server.
- the above system further includes a second terminal device; the second terminal device is used to send second information to the card server, and the second information is used to indicate the second rich media supported by the first application of the second terminal device.
- a capability set, the second rich media capability set includes at least one rich media capability;
- the card server is also used to generate third information based on the card parameters and the second rich media capability set, and send the third information to the business device, where the third information is used to indicate that the rich media card of the second terminal device cannot be generated based on the card parameters;
- the business device is also used to send a text message corresponding to the original rich media card to the first application of the second terminal device;
- the first application of the second terminal device is also used to display text messages. Rich media messages cost more than Regarding the cost of text messages, implementing the embodiments of this application can avoid wasting the cost of rich media messages.
- the second information is generated when the second card parameter and the second rich media capability set meet preset conditions; the preset conditions include: based on the preset capability degradation relationship and the first rich media capability set , determine that all rich media capabilities required by the original rich media card are downgraded to empty, or at least one rich media capability required by the original rich media card is downgraded to empty; downgrading to empty means that it cannot be downgraded to other rich media capabilities.
- the present application provides a method for processing rich media information, including: a first terminal device sending first information to a card server, where the first information is used to indicate a first rich media capability set supported by the first application, and the first rich media capability set is supported by the first application.
- the media capability set includes at least one rich media capability; the first application of the first terminal device receives a rich media message sent by the service device, the rich media message includes a first label, and the first label is the first rich media card generated by the card server.
- the card data of the first rich media card is generated by the card server based on the card parameters of the original rich media card sent by the business device and the first rich media capability set; the first application of the first terminal device sends an acquisition request to the card server, The acquisition request includes the first tag; the first application of the first terminal device receives the card data sent by the card server; and the first application of the first terminal device displays the first rich media card based on the card data.
- the card server can convert the original rich media capabilities based on the rich media capability set of the first application of the first terminal device.
- the media card is adaptively downgraded to a rich media card within the rich media capability range of the first application; in this way, the first terminal device can display the above-mentioned rich media card and support all interactive capabilities of the above-mentioned rich media card in the first application, Effectively improves user experience.
- rich media capabilities include component rendering capabilities and interaction capabilities;
- component rendering capabilities refer to the ability to render specified components in rich media cards, and the specified components include one or more of the following: static pictures, dynamic pictures, videos, Horizontal swipe pictures, carousel pictures, voting forms, buttons, etc.;
- interactive capabilities include one or more of the following: jump to the browser, jump to the default application (APP), jump to the phone APP to make a call, jump to Go to the map APP for positioning and navigation, jump to other APPs to share rich media cards, jump to quick apps, etc.; the default APP refers to an APP with a web version.
- the card data includes card layout information of the first rich media card and component parameters of each component in the first rich media card.
- the component parameters include component name, information indicating the display content of the component, and designation of the implementation component. Some or all of the URL links, component types, etc. of the interactive capabilities.
- the first information includes the identification of each rich media capability in the first rich media set; or the first information includes the version number of the first rich media set, and the version numbers corresponding to different rich media capability sets. different.
- At least one rich media capability required by each component in the original rich media card is determined based on card parameters.
- the rich media capability required by the first component includes the first rich media capability.
- the first component is Any component in the original rich media card; when the first rich media capability set does not include the first rich media capability, the first card information is generated after degrading the capabilities of the first component based on the preset capability degradation relationship.
- the card parameters include the component type of the first component; the rich media capabilities required by the first component include the component rendering capabilities corresponding to the component type of the first component; the card parameters include the implementation-specified interaction capabilities of the first component When connecting to a URL, the rich media capabilities required by the first component include specifying interactive capabilities.
- the capability downgrade relationship includes one or more of the following: the first rich media capability is downgraded to the second rich media capability, or the first rich media capability is downgraded to null; the second rich media capability is downgraded to the third rich media capability.
- the third rich media capability, or the second rich media capability, is downgraded to null; downgrading to null means that it cannot be downgraded to other rich media capabilities.
- the capability downgrade relationship includes the capability downgrade relationship of component rendering capability and the capability downgrade relationship of interaction capability.
- the capability downgrade relationship of component rendering capability includes one or more of the following: the rendering capability of dynamic pictures is downgraded to The rendering capabilities of static pictures and horizontal swipe pictures are downgraded to the rendering capabilities of static pictures.
- the rendering capabilities of videos are downgraded to the rendering capabilities of static pictures.
- the rendering capabilities of carousel pictures are downgraded to the rendering capabilities of horizontal swipe pictures.
- the rendering capabilities of static pictures are downgraded.
- the rendering capability is downgraded to null, and the rendering capability of the voting form is downgraded to null;
- the capability downgrade relationship of the interactive capability includes one or more of the following: the ability to jump to the default APP is downgraded to the ability to jump to the browser; jump to The browser's ability is downgraded to empty; the ability to jump to the phone APP to make calls is downgraded to empty; the ability to jump to the map APP for positioning and navigation is downgraded to empty; the ability to jump to other pages of the first application to reply to messages is downgraded to empty. ; The ability to jump to other apps to share rich media cards has been downgraded to empty.
- the first rich media capability set does not include the first rich media capability but includes the second rich media capability.
- the second rich media capability is the downgraded capability of the first rich media capability.
- the first rich media capability and The second rich media capability is the component rendering capability;
- the card parameters include information indicating the first display content of the first component, and the first display content is displayed through the first rich media capability;
- the first rich media card includes the second component,
- the display content of the two components is the second display content, the second display content is determined based on the first display content, and the second display content is displayed through the second rich media capability.
- the first rich media capability is the rendering capability of videos
- the second rich media capability is the rendering capability of static images
- the first display content is a video
- the second display content is a frame of static images in the video.
- the first rich media capability set includes the third rich media capability, excluding the first rich media capability and the second rich media capability, and the third rich media capability is the downgraded capability of the second rich media capability,
- the first rich media capability, the second rich media capability, and the third rich media capability are component rendering capabilities;
- the card parameters include information indicating the first display content of the first component, and the first display content is displayed through the first rich media capability ;
- the first rich media card includes a third component, the display content of the third component is the third display content, the third display content is determined based on the first display content, and the third display content is displayed through the third rich media capability.
- the first rich media capability set does not include the first rich media capability, the first rich media capability cannot be downgraded to other rich media capabilities, and the first rich media capability is component rendering capability; the card parameter includes an indication of the first rich media capability. Information about the first display content of the component, the first display content is displayed through the first rich media capability; the first rich media card does not display the first display content.
- the first rich media card includes a fourth component
- the display content of the fourth component is the first URL link or the replacement content of the first component
- the card parameters include the first URL of the first component that implements the interactive capability. Links and replacement content for the first component.
- the card parameters include a first URL link of the first component that implements the fourth rich media capability, and a second URL link of the first component that implements the fifth rich media capability;
- the fifth rich media capability is the After downgrading the four rich media capabilities, the fourth rich media capability and the fifth rich media capability are interactive capabilities; when the first rich media capability set includes the fourth rich media capability, the first rich media card includes the first component, and the above
- the method also includes: in response to the first input operation for the first component, the first terminal device jumps to the user interface indicated by the first URL link based on the fourth rich media capability; when the first rich media capability set does not include the fourth rich media capability
- the media capabilities include the fifth rich media capability
- the first rich media card includes a fifth component
- the above method further includes: in response to the first input operation for the fifth component, the first terminal device jumps based on the fifth rich media capability Link to the user interface indicated by the second URL.
- the first URL link is the URL link of the default APP
- the second URL link is the URL link of the web version of the default APP
- the fourth rich media capability is the ability to jump to the default APP.
- the five rich media capabilities are the ability to jump to the browser.
- the first rich media capability set does not include the fourth rich media capability but includes the fifth rich media capability.
- the fifth rich media capability is the downgraded capability of the fourth rich media capability.
- the fourth rich media capability and The fifth rich media capability is interaction Capabilities; the card parameters include the first URL link of the first component that implements the fourth rich media capability, and the card parameters do not include the URL link of the first component that implements the fifth rich media capability; the first rich media card does not include the first URL link that has the fourth rich media capability. Components of media capabilities.
- the first rich media capability set does not include the fourth rich media capability, the fourth rich media capability cannot be downgraded to other rich media capabilities, and the fourth rich media capability is the interactive capability; the card parameters include the first component The first URL link that implements the fourth rich media capability; the first rich media card does not include components with the fourth rich media capability.
- the first rich media card includes a sixth component
- the sixth component is generated based on component parameters of the first component, and the component parameters of the sixth component do not include the first URL link.
- this application provides a terminal device including one or more processors and one or more memories.
- the one or more memories are coupled to one or more processors.
- the one or more memories are used to store computer program codes.
- the computer program codes include computer instructions.
- embodiments of the present application provide a computer storage medium that includes computer instructions.
- the terminal device When the computer instructions are run on a terminal device, the terminal device causes the terminal device to execute the rich media information in any of the possible implementations of the second aspect. Approach.
- embodiments of the present application provide a computer program product.
- the computer program product When the computer program product is run on a computer, it causes the computer to execute the rich media information processing method in any of the possible implementations of the second aspect.
- Figures 1A to 1F are user interfaces related to rich media text messages provided by embodiments of the present application.
- Figure 2A is a system architecture diagram of a rich media information processing system provided by an embodiment of the present application.
- Figure 2B is a related user interface of the rich media card provided by the embodiment of the present application.
- Figure 3 is a schematic structural diagram of a terminal device provided by an embodiment of the present application.
- Figure 4A is a schematic flowchart of a rich media information processing method provided by an embodiment of the present application.
- FIGS. 4B and 4C are schematic diagrams of rich media cards provided by embodiments of the present application.
- Figures 5A to 5E are relevant user interfaces for selecting and editing rich media card templates provided by embodiments of the present application.
- Figures 6A to 6E are user interfaces related to rich media text messages provided by embodiments of the present application.
- Figures 7A to 7F are user interfaces related to rich media text messages provided by embodiments of the present application.
- Figures 8A to 8J are user interfaces related to rich media text messages provided by embodiments of the present application.
- first and second are used for descriptive purposes only and shall not be understood as implying or implying relative importance or implicitly specifying the quantity of indicated technical features. Therefore, the features defined as “first” and “second” may explicitly or implicitly include one or more of the features. In the description of the embodiments of this application, unless otherwise specified, “plurality” The meaning is two or more.
- GUI graphical user interface
- SMS Short message service
- MMS multimedia messaging service
- MMS can transmit information in various multimedia formats such as text, images, sounds, and data.
- MMS editing is limited, the amount of information it can carry is still small (usually within 300kb), the charges are high, and the interactivity is low.
- Rich communication services is a communication method proposed by the Global Mobile Communications System Association in 2008.
- RCS integrates instant messaging, file transfer, content sharing, presentation, location services and other communication services to enrich Customer experience of mobile phone system native applications such as calls, text messages, contacts, etc.
- RCS supports enterprises to provide users with efficient, convenient, and rich services through rich media, strong interaction, and intelligence.
- cards may be used to carry rich media information, and cards carrying rich media information may be referred to as rich media cards for short.
- Card is a new service form that provides a more fine-grained atomic service capability than an application (APP). It directly displays the services or content that users care about most to users in the form of interactive cards. Cards It can be embedded in various APPs or interactive scenarios to better meet user needs.
- APP application
- Rich media messages refer to messages containing specific tags (such as short links) in the first APP; the terminal device can obtain the rich media card corresponding to the above-mentioned specific tag and display it in the first APP, and then realize real-time through the above-mentioned rich media card Communication services such as messaging, file transfer, content sharing, and positioning.
- the above short link is a unique short URL shortened from any longer URL.
- Rich media SMS is a rich media service based on the operator's basic communication service to meet users' needs for rich media messages.
- rich media text messages can also be called rich media card text messages, which refer to text messages containing specific tags (such as short links) sent through regular text message channels; through the above-mentioned specific tags, the terminal device can obtain the above-mentioned rich media Rich media cards associated with text messages are displayed in the SMS APP, and communication services such as instant messaging, file transfer, content sharing, and positioning are realized through the rich media cards. It is not limited to short links.
- the above-mentioned specific tag can also be the card's identity (identity, ID), uniform resource locator (Uniform Resource Locator, URL) and other information, which is not specifically limited here.
- Quick application is a new application form based on mobile phone hardware platform.
- the quick application framework is deeply integrated into the mobile operating systems of major mobile phone manufacturers, which can form a seamless connection between user needs and application services at the operating system level, making native applications ( Functions in application, APP) (such as shopping APP, payment APP, map APP, etc.) can be implemented in quick applications (such as shopping quick application, payment quick application, map quick application).
- Quick Apps can have partial or complete application experience of native APPs, but unlike native APPs, quick apps do not require installation and can be used immediately.
- FIG. 1A to FIG. 1B are user interfaces related to rich media text messages provided by embodiments of the present application.
- FIG. 1A shows a main interface 11 on the terminal device 100 for displaying applications installed on the terminal device 100 .
- the main interface 11 may include: a status bar 101, a calendar indicator 102, a weather indicator 103, a tray 104 with commonly used application icons, and other application icons 105. in:
- the tray 104 with commonly used application icons can display: phone APP icon, contact APP icon, text message APP icon 104A, camera APP icon.
- the main interface 11 may also include a page indicator 106 .
- Other application icons may be distributed on multiple pages, and the page indicator 106 may be used to indicate which application in which page the user is currently viewing. Users can slide the area of other application icons left and right to view application icons in other pages.
- the icon 104A of the SMS APP can receive the user's input operation (such as a touch operation), and in response to the above input operation, the terminal device 100 can display the SMS homepage 12 shown in FIG. 1B .
- the SMS home page 12 may include SMS entries corresponding to each sender who receives the SMS, for example, SMS entries 201 for XX Car Network, SMS entries 202 for XX News, and SMS entries 203 for XX Shopping.
- the text message entry 202 may include the name of the sender 202A (i.e. XX news), the preview information 202B of the latest text message of XX news, the receiving time or sending time 202C of the above-mentioned latest text message, and the above-mentioned sending time.
- the person's avatar 202D may receive the user's input operation (such as a click operation on the preview information 202B).
- the terminal device 100 may display the SMS display interface 13 of XX news shown in FIG. 1C or FIG. 1D.
- the text message display interface 13 includes the original text information of the received rich media text message 1 of XX news, and the control 301 for displaying the rich media card.
- the above text information includes short link 1 (ie etp8.cn/VGBfmC). Short link 1 is used to obtain the rich media card 1 associated with the rich media text message 1.
- Control 301 can receive the user's input operation (such as touch operation); as shown in FIG. Rich media card 1 switches back to the text information shown in Figure 1C.
- the rich media card 1 may include pictures, videos, and texts, and may also be interactive.
- the rich media card 1 includes the playback control 303 of the video component and the text "Special moments of synchronized gymnastics" 304.
- the text "Special moments of synchronized gymnastics" can be a news title.
- the link obtains and displays the news webpage of "Special Moments of Synchronized Gymnastics" in the browser APP.
- embodiments of the present application can also call up the short message display interface 13 including the rich media card 1 shown in FIG. 1D through other methods, which are not specifically limited here.
- the terminal device 100 receives the rich media text message 1
- the preview information of the rich media text message 1 is displayed in the notification bar
- the terminal device 100 displays the rich media card shown in Figure 1D. 1 SMS display interface 13.
- the SMS APP displays the rich media cards associated with the rich media SMS and supports the interactive functions of the rich media cards. It relies on the rich media capabilities of the SMS APP of the terminal device.
- the rich media capabilities of the above SMS APP include rendering rich media cards. The ability to specify components (such as static pictures, dynamic pictures, videos, horizontal pictures, carousel pictures, voting forms, etc.) in the rich media card, as well as the ability to implement specified interactive functions in the rich media card (such as jump to the browser, jump to the preset The ability to set up APP, jump to quick application (quick APP), reply to text messages, make calls, locate navigation, etc.).
- the terminal device After the terminal device obtains the card data of rich media card 1 corresponding to short link 1, only when the SMS APP of the terminal device has all the rich media capabilities required by rich media card 1 can it display rich media card 1 based on the above card data; and when In the case of "the SMS APP of the terminal device only has part of the rich media capabilities required by the rich media card, or does not have the rich media capabilities required by the rich media card", the SMS APP of the terminal device cannot display the rich media card 1.
- the SMS APP of the terminal device can only display the original text information of the rich media SMS.
- the SMS APP of the terminal device 100 only has the parts required by the rich media card 1.
- Rich media capability the SMS display interface 13 of XX News in the SMS APP of the terminal device 100 can only display the original text information 1 of the rich media SMS 1, and cannot display the rich media card 1 associated with the rich media SMS 1.
- the enterprise sends a rich media text message to the terminal device 100, but due to the rich media capabilities of the SMS APP, the terminal device 100 cannot display the rich media card associated with the rich media text message, and the user can only see the original content of the rich media text message.
- Text messages which leads to poor user experience; in addition, rich media text messages are more expensive than text messages, which also wastes rich media text message fees, especially when the same rich media text message is sent to a large number of different terminal devices.
- Embodiments of the present application also provide a rich media information processing method.
- the terminal device can obtain the rich media message corresponding to the rich media card within the rich media capability range of the first APP (such as SMS APP) of the terminal device, and process it in the third APP.
- the above-mentioned rich media card and all interactive functions supporting the above-mentioned rich media card are displayed in one APP, which effectively improves the user experience.
- the rich media information processing system to which the above rich media information processing method is applied is introduced below.
- FIG. 2A exemplarily shows a system architecture diagram of a rich media information processing system 10 provided by an embodiment of the present application.
- the rich media information processing system 10 includes end-side terminal equipment (such as terminal equipment 100, terminal equipment 200, etc.), enterprise-side business equipment (such as business terminal 300 or business server 400) and card server 500; Third-party messaging platforms can also be included.
- Each terminal device on the terminal side is used to report the rich media capability set of the first APP (for example, SMS APP) to the card server 500 .
- the rich media capability library in the card server 500 is used to store the rich media capability set reported by each terminal device.
- the following description takes the terminal device 100 as an example.
- the rich media capability set 1 reported by the terminal device 100 includes one or more rich media capabilities.
- the staff can submit the card parameters of the original rich media card corresponding to the rich media message (such as rich media text message) intended to be sent to the card server 500 through the business device (i.e., the business terminal 300 or the business server 400), as well as the terminal device on the receiving side.
- Device identification 1 of 100 for example, the current phone number of the terminal device 100.
- the adaptive conversion module in the card server 500 is used to adaptively downgrade the capabilities of the components in the original rich media card based on the rich media capability set 1 reported by the terminal device 100 indicated by the device identifier 1 (for example, downgrade the video component to static Picture component, the ability to jump to the default APP is downgraded to the ability to jump to the browser), generate the first rich media card within the rich media capability set 1 and store it; the card server 500 generates and feeds back the first rich media card to the business device The label of the rich media card (for example, short link 1).
- the service device is also configured to deliver a rich media message containing the label of the first rich media card to the terminal device 100 .
- the terminal device 100 can obtain the first rich media card corresponding to the above tag from the card server 500; the terminal device 100 can display the first rich media card within the range of rich media capabilities through the first APP.
- Rich media messages contain text information and may also contain information in other formats, which are not specifically limited here.
- the original rich media card submitted by the service terminal 300 includes a video component
- the display content of the video component is video 1.
- the rich media capability set 1 of the terminal device 100 includes the video rendering capability
- the rich media card generated by the card server 500 based on the rich media capability set 1 includes the above video component; the terminal device 100 finally obtains and displays the video component shown in (a) of Figure 2B Rich media cards.
- the card server 500 downgrades the above video component to a static picture component based on the rich media capability set 1, and the display content of the static picture component It may be a frame of image in video 1 (ie, still picture 1); the terminal device 100 finally obtains and displays the downgraded rich media card shown in (b) of FIG. 2B.
- the first APP is a short message APP
- the rich media message is a rich media short message containing the above tag
- the service terminal 300 sends the rich media short message to the terminal device 100 through a third-party short message platform.
- the device identification of the terminal device may include a user identity (ID) and/or device ID.
- the user ID can be a phone number or the account used to log in to the first APP.
- the device ID may include one or more of the following: International Mobile Equipment Identity (IMEI), Mobile Equipment Identifier (MEID), Unique Device Identifier (UDID), Universal Unique Identifier (Universally Unique Identifier, UUID), Advertising Identifier (Identifier For Advertising, IDFA), Open Anonymous Device Identifier (Open Anonymous Device Identifier, OAID).
- IMEI International Mobile Equipment Identity
- MEID Mobile Equipment Identifier
- UDID Unique Device Identifier
- UUID Universal Unique Identifier
- Advertising Identifier Identifier For Advertising
- IDFA Open Anonymous Device Identifier
- OAID Open Anonymous Device Identifier
- the first APP is an SMS APP
- the rich media message is a rich media SMS
- the device identifier of the terminal device is a phone number
- devices in the rich media information processing system 10 can communicate through one or more communication networks 500 .
- the communication network 500 may include local area networks (LAN), wide area networks (WAN), such as the Internet.
- the communication network 500 can be implemented using any known network communication protocol.
- the network communication protocol can be various wired or wireless communication protocols, such as Ethernet, universal serial bus (USB), and FireWire.
- GSM global system for mobile communications
- GPRS general packet radio service
- CDMA code division multiple access
- WCDMA wideband code division multiple access
- TD-SCDMA time-division code division multiple access
- LTE long term evolution
- Bluetooth wireless fidelity (Wi-Fi)
- NFC NFC
- VoIP voice over Internet protocol
- communication protocol that supports network slicing architecture, or any other suitable communication protocol, there is no specific limitation here.
- the equipment in the rich media information processing system 10 can be deployed on land, including indoors, outdoors, handheld or vehicle-mounted, on water, or on aircraft and artificial satellites in the air.
- the embodiments of this application are all No restrictions.
- FIG. 2A is only a schematic system structure diagram of the rich media information processing system 10 provided by the embodiment of the present application, and does not constitute a specific limitation on the rich media information processing system 10.
- the rich media information processing system 10 may include more than what is shown in the figure. More or less devices, for example, may also include wireless relay devices and wireless backhaul devices (not shown in Figure 2A), which are not limited here.
- the following takes the terminal device 100 as an example to introduce the structure of the terminal device provided by the embodiment of the present application.
- FIG. 3 shows a schematic structural diagram of the terminal device 100.
- the terminal device 100 may be a mobile phone, a tablet computer, a desktop computer, a laptop computer, a handheld computer, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, a cellular phone, a personal digital assistant (personal digital assistant) digital assistant (PDA), augmented reality (AR) device, virtual reality (VR) device, artificial intelligence (AI) device, wearable device, vehicle-mounted device, smart home device and/or Smart city equipment, the embodiment of this application does not place special restrictions on the specific type of terminal equipment.
- the terminal device can be equipped with iOS, Android, Microsoft or other operating systems, and there are no specific limitations here.
- the terminal device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, and an antenna 2. , mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone interface 170D, sensor module 180, button 190, motor 191, indicator 192, camera 193, display screen 194, and Subscriber identification module (subscriber identification module, SIM) card interface 195, etc.
- SIM Subscriber identification module
- the sensor module 180 may include a pressure sensor 180A, a gyro sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, and a fingerprint.
- the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the terminal device 100.
- the terminal device 100 may include more or less components than shown in the figures, or combine some components, or split some components, or arrange different components.
- the components illustrated may be implemented in hardware, software, or a combination of software and hardware.
- the processor 110 may include one or more processing units.
- the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processing unit (GPU), and an image signal processor. (image signal processor, ISP), controller, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural network processor (neural-network processing unit, NPU), etc.
- application processor application processor, AP
- modem processor graphics processing unit
- GPU graphics processing unit
- image signal processor image signal processor
- ISP image signal processor
- controller video codec
- digital signal processor digital signal processor
- DSP digital signal processor
- baseband processor baseband processor
- neural network processor neural-network processing unit
- the controller can generate operation control signals based on the instruction operation code and timing signals to complete the control of fetching and executing instructions.
- the processor 110 may also be provided with a memory for storing instructions and data.
- the memory in processor 110 is cache memory. This memory may hold instructions or data that have been recently used or recycled by processor 110 . If the processor 110 needs to use the instructions or data again, it can be called directly from the memory. Repeated access is avoided and the waiting time of the processor 110 is reduced, thus improving the efficiency of the system.
- processor 110 may include one or more interfaces.
- Interfaces may include integrated circuit (inter-integrated circuit, I2C) interface, integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, pulse code modulation (pulse code modulation, PCM) interface, universal asynchronous receiver and transmitter (universal asynchronous receiver/transmitter (UART) interface, mobile industry processor interface (MIPI), general-purpose input/output (GPIO) interface, subscriber identity module (SIM) interface, and /or universal serial bus (USB) interface, etc.
- I2C integrated circuit
- I2S integrated circuit built-in audio
- PCM pulse code modulation
- UART universal asynchronous receiver and transmitter
- MIPI mobile industry processor interface
- GPIO general-purpose input/output
- SIM subscriber identity module
- USB universal serial bus
- the charging management module 140 is used to receive charging input from the charger.
- the charger can be a wireless charger or a wired charger.
- the charging management module 140 may receive charging input from the wired charger through the USB interface 130 .
- the charging management module 140 may receive wireless charging input through the wireless charging coil of the terminal device 100 . While charging the battery 142, the charging management module 140 can also provide power to the terminal device through the power management module 141.
- the power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110.
- the power management module 141 receives input from the battery 142 and/or the charging management module 140, and supplies power to the processor 110, the internal memory 121, the display screen 194, the camera 193, the wireless communication module 160, and the like.
- the power management module 141 can also be used to monitor battery capacity, battery cycle times, battery health status (leakage, impedance) and other parameters.
- the power management module 141 may also be provided in the processor 110 .
- the power management module 141 and the charging management module 140 may also be provided in the same device.
- the wireless communication function of the terminal device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.
- Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals.
- Each antenna in terminal device 100 may be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example: Antenna 1 can be reused as a diversity antenna for a wireless LAN. In other embodiments, antennas may be used in conjunction with tuning switches.
- the mobile communication module 150 can provide solutions for wireless communications including 2G/3G/4G/5G etc. applied on the terminal device 100. solution.
- the mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc.
- LNA low noise amplifier
- the mobile communication module 150 can receive electromagnetic waves through the antenna 1, perform filtering, amplification and other processing on the received electromagnetic waves, and transmit them to the modem processor for demodulation.
- the mobile communication module 150 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves through the antenna 1 for radiation.
- at least part of the functional modules of the mobile communication module 150 may be disposed in the processor 110 .
- at least part of the functional modules of the mobile communication module 150 and at least part of the modules of the processor 110 may be provided in the same device.
- a modem processor may include a modulator and a demodulator.
- the modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal.
- the demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal.
- the demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing.
- the application processor outputs sound signals through audio devices (not limited to speaker 170A, receiver 170B, etc.), or displays images or videos through display screen 194.
- the modem processor may be a stand-alone device.
- the modem processor may be independent of the processor 110 and may be provided in the same device as the mobile communication module 150 or other functional modules.
- the wireless communication module 160 can provide applications on the terminal device 100 including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) network), Bluetooth (bluetooth, BT), and global navigation satellites.
- WLAN wireless local area networks
- System global navigation satellite system, GNSS
- frequency modulation frequency modulation, FM
- near field communication technology near field communication, NFC
- infrared technology infrared, IR
- the wireless communication module 160 may be one or more devices integrating at least one communication processing module.
- the wireless communication module 160 receives electromagnetic waves via the antenna 2 , demodulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110 .
- the wireless communication module 160 can also receive the signal to be sent from the processor 110, frequency modulate it, amplify it, and convert it into electromagnetic waves through the antenna 2 for radiation.
- the antenna 1 of the terminal device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the terminal device 100 can communicate with the network and other devices through wireless communication technology.
- the wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), broadband Code division multiple access (wideband code division multiple access, WCDMA), time division code division multiple access (time-division code division multiple access, TD-SCDMA), long term evolution (long term evolution, LTE), BT, GNSS, WLAN, NFC , FM, and/or IR technology, etc.
- the GNSS may include global positioning system (GPS), global navigation satellite system (GLONASS), Beidou navigation satellite system (BDS), quasi-zenith satellite system (quasi) -zenith satellite system (QZSS) and/or satellite based augmentation systems (SBAS).
- GPS global positioning system
- GLONASS global navigation satellite system
- BDS Beidou navigation satellite system
- QZSS quasi-zenith satellite system
- SBAS satellite based augmentation systems
- the terminal device 100 implements display functions through a GPU, a display screen 194, an application processor, and the like.
- the main interface, the user interface of the SMS APP, the user interfaces of other third-party APPs, etc. are displayed on the display screen 194, and the rich media card associated with the rich media SMS related to the embodiment of the present application is displayed on the user interface of the SMS application.
- the GPU is an image processing microprocessor and is connected to the display screen 194 and the application processor. GPUs are used to perform mathematical and geometric calculations for graphics rendering.
- Processor 110 may include one or more GPUs that execute program instructions to generate or alter display information.
- the mobile communication module of the terminal device 100 receives the card data of the rich media card from the card server 400 and passes it to the GPU in the processor 110.
- the GPU performs graphics rendering based on the card data and generates a rich media card to be displayed.
- the display screen 194 is used to display images, videos, etc.
- Display 194 includes a display panel.
- the display panel can use liquid crystal Display screen (liquid crystal display, LCD), organic light-emitting diode (OLED), active matrix organic light emitting diode or active matrix organic light emitting diode (active-matrix organic light emitting diode, AMOLED) ), flexible light-emitting diodes (FLED), Miniled, MicroLed, Micro-oLed, quantum dot light emitting diodes (QLED), etc.
- the terminal device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1.
- the terminal device 100 can implement the shooting function through the ISP, camera 193, video codec, GPU, display screen 194, application processor, etc.
- the ISP is used to process the data fed back by the camera 193. For example, when taking a photo, the shutter is opened, the light is transmitted to the camera sensor through the lens, the optical signal is converted into an electrical signal, and the camera sensor passes the electrical signal to the ISP for processing, and converts it into an image visible to the naked eye. ISP can also perform algorithm optimization on image noise and brightness. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, the ISP may be provided in the camera 193.
- Camera 193 is used to capture still images or video.
- the object passes through the lens to produce an optical image that is projected onto the photosensitive element.
- the photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor.
- CMOS complementary metal-oxide-semiconductor
- the photosensitive element converts the optical signal into an electrical signal, and then passes the electrical signal to the ISP to convert it into a digital image signal.
- ISP outputs digital image signals to DSP for processing.
- DSP converts digital image signals into standard RGB, YUV and other format image signals.
- the terminal device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.
- Digital signal processors are used to process digital signals. In addition to digital image signals, they can also process other digital signals. For example, when the terminal device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.
- Video codecs are used to compress or decompress digital video.
- the terminal device 100 may support one or more video codecs. In this way, the terminal device 100 can play or record videos in multiple encoding formats, such as moving picture experts group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.
- MPEG moving picture experts group
- MPEG2 MPEG2, MPEG3, MPEG4, etc.
- NPU is a neural network (NN) computing processor.
- NN neural network
- the NPU can realize intelligent cognitive applications of the terminal device 100, such as image recognition, face recognition, speech recognition, text understanding, etc.
- the internal memory 121 may include one or more random access memories (RAM) and one or more non-volatile memories (NVM).
- RAM random access memories
- NVM non-volatile memories
- Random access memory can include static random-access memory (SRAM), dynamic random-access memory (DRAM), synchronous dynamic random-access memory (SDRAM), double data rate synchronous Dynamic random access memory (double data rate synchronous dynamic random access memory, DDR SDRAM, for example, the fifth generation DDR SDRAM is generally called DDR5SDRAM), etc.; non-volatile memory can include disk storage devices and flash memory (flash memory).
- SRAM static random-access memory
- DRAM dynamic random-access memory
- SDRAM synchronous dynamic random-access memory
- DDR SDRAM double data rate synchronous Dynamic random access memory
- non-volatile memory can include disk storage devices and flash memory (flash memory).
- Flash memory can be divided according to the operating principle to include NOR FLASH, NAND FLASH, 3D NAND FLASH, etc.
- the storage unit potential level it can include single-level storage cells (single-level cell, SLC), multi-level storage cells (multi-level cell, MLC), third-level storage unit (triple-level cell, TLC), fourth-level storage unit (quad-level cell, QLC), etc., which can include universal flash storage (English: universal flash storage, UFS) according to storage specifications. , embedded multi media card (embedded multi media Card, eMMC), etc.
- the random access memory can be directly read and written by the processor 110 and can be used to store the operating system or other running
- the executable program (such as machine instructions) of the program in the line can also be used to store user and application data, etc.
- the non-volatile memory can also store executable programs and user and application program data, etc., and can be loaded into the random access memory in advance for direct reading and writing by the processor 110.
- the external memory interface 120 can be used to connect an external non-volatile memory to expand the storage capacity of the terminal device 100 .
- the external non-volatile memory communicates with the processor 110 through the external memory interface 120 to implement the data storage function. For example, save music, video and other files in external non-volatile memory.
- the terminal device 100 can implement audio functions through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone interface 170D, and the application processor. Such as music playback, recording, etc.
- the audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. Audio module 170 may also be used to encode and decode audio signals. In some embodiments, the audio module 170 may be provided in the processor 110 , or some functional modules of the audio module 170 may be provided in the processor 110 .
- Speaker 170A also called “speaker” is used to convert audio electrical signals into sound signals.
- Receiver 170B also called “earpiece” is used to convert audio electrical signals into sound signals.
- Microphone 170C also called “microphone” or “microphone”, is used to convert sound signals into electrical signals.
- the headphone interface 170D is used to connect wired headphones.
- the pressure sensor 180A is used to sense pressure signals and can convert the pressure signals into electrical signals.
- pressure sensor 180A may be disposed on display screen 194 .
- the gyro sensor 180B may be used to determine the motion posture of the terminal device 100 .
- the angular velocity of the terminal device 100 about three axes ie, x, y, and z axes
- the gyro sensor 180B may be determined by the gyro sensor 180B.
- Air pressure sensor 180C is used to measure air pressure.
- Magnetic sensor 180D includes a Hall sensor.
- the acceleration sensor 180E can detect the acceleration of the terminal device 100 in various directions (generally three axes). When the terminal device 100 is stationary, the magnitude and direction of gravity can be detected. It can also be used to identify the gesture of the terminal device.
- the terminal device 100 can measure distance through infrared or laser.
- Proximity light sensor 180G may include, for example, a light emitting diode (LED) and a light detector, such as a photodiode.
- LED light emitting diode
- a light detector such as a photodiode
- the ambient light sensor 180L is used to sense ambient light brightness.
- the terminal device 100 can adaptively adjust the brightness of the display screen 194 according to the perceived ambient light brightness.
- Fingerprint sensor 180H is used to collect fingerprints.
- Temperature sensor 180J is used to detect temperature. In some embodiments, the terminal device 100 uses the temperature detected by the temperature sensor 180J to execute the temperature processing policy.
- Touch sensor 180K also known as "touch device”.
- the touch sensor 180K can be disposed on the display screen 194.
- the touch sensor 180K and the display screen 194 form a touch screen, which is also called a "touch screen”.
- the touch sensor 180K is used to detect a touch operation on or near the touch sensor 180K.
- the touch sensor can pass the detected touch operation to the application processor to determine the touch event type.
- Visual output related to the touch operation may be provided through display screen 194 .
- the touch sensor 180K may also be disposed on the surface of the terminal device 100 in a position different from that of the display screen 194 .
- Bone conduction sensor 180M can acquire vibration signals.
- the bone conduction sensor 180M can acquire the vibration signal of the vibrating bone mass of the human body's vocal part.
- the buttons 190 include a power button, a volume button, etc.
- Key 190 may be a mechanical key. It can also be a touch button.
- the terminal device 100 can receive key input and generate key signal input related to user settings and function control of the terminal device 100 .
- the terminal device 100 reports the rich media capability set 1 of the SMS APP to the card server 500; the card server 500 receives the original rich media card associated with the rich media SMS submitted by the business device. parameters and the device identification of the terminal device 100, based on the rich media capability set 1 reported by the terminal device 100 and the above card parameters, the first rich media card within the rich media capability range of the SMS APP is generated, and the first rich media card is sent to the business device.
- the card server 500 can adaptively convert the original rich media card to the original rich media card based on the rich media capability set 1 of the terminal device 100. Downgrade to a rich media card within the range of rich media capability set 1; in this way, the terminal device 100 can display the above rich media card and support all interactive functions of the above rich media card in the SMS APP, effectively improving the user experience.
- FIG. 4A shows a schematic flowchart of a rich media information processing method, which includes but is not limited to steps S101 to S108.
- the terminal device 100 reports the rich media capability set 1 of the SMS APP to the card server 500.
- the card server 500 receives the rich media capability set 1 reported by the terminal device 100 and stores it in the rich media capability library.
- the rich media capabilities of the SMS APP may include the ability to render specified components in the rich media card (which may be referred to as component rendering capabilities), and the ability to implement specified interactive functions in the rich media cards (which may be referred to as interactive capabilities). ).
- the above designated components include but are not limited to static pictures, dynamic pictures, videos, horizontal swipe pictures, carousel pictures, voting forms, buttons, etc.
- dynamic pictures include a group of specific static images that are switched at a specified frequency to produce a certain dynamic effect.
- the visual effect is similar to a video, such as a Gif animation.
- Horizontal pictures include multiple sequentially arranged static pictures for display in a designated area. Only one picture can be displayed in the above designated area at the same time; the user can view the above multiple sequentially arranged pictures by sliding the pictures displayed in the above designated area left or right. Other pictures in .
- Carousel images include multiple images that are automatically displayed in sequence at a specified frequency in a specified area.
- the voting form may include a voting title and at least two voting options, and the user may select at least one of the above at least two voting options to vote.
- Figure 4B shows a rich media card.
- Component 1 in the rich media card is a horizontally drawn picture.
- the display content of component 1 includes multiple pictures; the display area of component 1 includes a picture indicator 305.
- the picture indicator 305 can be used to indicate which picture among the above-mentioned pictures is currently displayed by component 1; as shown in Figure 4B, component 1 can receive the user's horizontal sliding operation, and in response to the above horizontal sliding operation, the terminal device 100 can display component 1 of other pictures.
- Figure 4C shows another rich media card.
- Component 1 in the rich media card is a voting form.
- the display content of component 1 includes a voting title and three voting options (for example, voting option 1); voting option 1 can After receiving the user's input operation (such as a touch operation), in response to the above input operation, the terminal device 100 may display the number of votes corresponding to each voting option.
- voting option 1 can After receiving the user's input operation (such as a touch operation), in response to the above input operation, the terminal device 100 may display the number of votes corresponding to each voting option.
- each APP is equipped with a rendering module (such as the rendering module 1 of the SMS APP), and the rendering module is configured with the component rendering capability of the APP; when the rendering module is configured with the component rendering capability of a specified component, the rendering module Only the APP can call the CPU and/or GPU to draw and render the above-mentioned specified components (such as videos), and the APP can implement the related services of the above-mentioned specified components (such as displaying and playing videos).
- a rendering module such as the rendering module 1 of the SMS APP
- the rendering module is configured with the component rendering capability of the APP
- the rendering module Only the APP can call the CPU and/or GPU to draw and render the above-mentioned specified components (such as videos), and the APP can implement the related services of the above-mentioned specified components (such as displaying and playing videos).
- the SMS APP has the rendering capability of the specified component depends on whether the rendering module of the SMS APP Sets the rendering capabilities of the specified component above.
- Different APPs of the same terminal device may have different component rendering capabilities; for example, if the photo album APP of the terminal device 100 has the ability to render videos, but the SMS APP does not have the ability to draw and render videos, the photo album APP can display and play videos, and the SMS APP can display and play videos. The APP cannot display and play videos.
- Different versions of the same APP may also have different component rendering capabilities; for example, if the current version of the SMS APP of the terminal device 100 does not have the video rendering capability, and the new version has the video rendering capability, the SMS APP cannot currently display and play videos. , and the SMS APP can display and play videos after being updated.
- the interactive capabilities implemented may include: the ability to jump from the SMS APP to the designated APP (such as the ability to jump to the browser, jump The ability to jump to the default APP, jump to the phone APP to make calls, jump to the map APP to locate and navigate, jump to the native APP to share rich media cards), jump from the SMS APP to quick apps (such as jump Jump ability 2 to map quick application positioning and navigation), and jump ability 3 from the current page of the SMS APP (i.e. activity 1 of the SMS APP) to other pages of the SMS APP to reply to text messages (i.e. activity 2 of the SMS APP) .
- the above-mentioned default APP refers to a native APP with a web version outside the browser. It is understandable that users can view the web version of the default APP online through the browser.
- SMS APP is set with an underlying business module for jumping to other APPs (referred to as jump module 1)
- APP 1 is set with an underlying business module for other APPs to call this APP (referred to as Jump module 2)
- Jump module 2 an underlying business module for other APPs to call this APP
- jump module 1 and jump module 2 can be the same module or different modules; an APP can have jump module 1 and/or jump module 2.
- SMS APP only when the SMS APP is included in the jump whitelist of APP 1, the SMS APP has the ability to jump to APP 1.
- APP 1 can register a URL scheme (protocol) with the operating system. This scheme is used to launch this application in other APPs. This scheme is set with a jump whitelist. The whitelist is used to indicate which apps can launch this application.
- the interactive ability to jump to a designated APP to implement specific interactive functions is implemented.
- specific interactive functions such as the ability to jump to a phone APP to make a call, the ability to jump to a map APP for positioning and navigation, or the ability to jump to a map APP
- the SMS APP can only have the above interaction capabilities when the SMS APP is set with business logic corresponding to the above specific interactive functions.
- the SMS APP has the ability to jump to the browser and the ability to jump to a preset APP (such as a shopping APP).
- the SMS APP does not have the ability to jump to a default APP (such as a shopping APP), but it has the ability to jump to a browser.
- the SMS APP can jump to the web version of the shopping APP through the browser.
- the terminal device 100 can start APP1 through the SMS APP and jump to the main page of APP1.
- the terminal device 100 can also start APP1 through the SMS APP and jump to the designated page (ie, designated activity) of APP1.
- APP 1 is a shopping APP, and the above specified pages can be product details page, order details page, message notification page, order payment page, etc.
- the terminal device 100 is provided with a quick application center, and the quick application center may include multiple quick applications; when the quick application center includes quick application 1, and the SMS APP is equipped with an underlying business module that calls the quick application, the SMS APP Only then can you jump to Quick App 1.
- the SMS APP when the SMS APP is equipped with the underlying business module for the above-mentioned jump capability 3, the APP can have the ability to jump from the current page of the SMS APP to other pages of the SMS APP to reply to text messages.
- the terminal device 100 can report the latest rich media capabilities to the card server 500; or, the terminal device 100 can report the latest rich media capabilities to the card server 500 regularly. Report the latest rich media capabilities; in this way, it is convenient for the card server 500 to timely update the rich media capability set 1 of the SMS APP of the terminal device 100 in the rich media capability library.
- the rich media capability library stores a corresponding relationship between the device identifier 1 of the terminal device 100 and the rich media capability set reported by the terminal device 100 .
- the SMS APP of the terminal device 100 can register the rich media card service with the card server 500 and report the rich media capability set 1 through the registration interface or the capability reporting interface. It can be understood that only after the rich media card service is registered, the card server 500 will store the rich media capability set of the terminal device 100 and generate a rich media card within the rich media capability range based on the rich media capability set of the terminal device 100 .
- the SMS APP of the terminal device 100 sends a registration request to the card server 500.
- the registration request is used to request to register the rich media card service and report the rich media capabilities.
- the registration request may include the user ID (for example, phone number 1). , may also include first information, which is used to indicate the rich media capability set 1 possessed by the SMS APP of the terminal device 100; the card server 500 may store the correspondence between the phone number 1 and the rich media capability set 1 in the rich media capability library. relation.
- the above-mentioned registration request also includes the device ID (such as UDID), and the card server 50 stores the corresponding relationship between the phone number 1 of the terminal device 100 and the device ID; subsequently, the terminal device 100 reports the updated rich information to the card server 500.
- the SMS APP of the terminal device 100 sends a registration request to the card server 500.
- the above-mentioned registration request is only used to request to register the rich media card service.
- the above-mentioned registration request can carry the user ID (for example, phone number 1) and the device ID ( For example, UDID); then, the SMS APP of the terminal device 100 sends the first information and device ID to the card server 500 through the registration interface or capability reporting interface; the card server 500 determines the phone number 1 corresponding to the device ID, and can use the rich media capability
- the library stores the corresponding relationship between phone number 1 and rich media capability set 1.
- the registration request and the reported information may both carry the phone number and not the device ID. There are no specific limitations here.
- the first information sent by the terminal device 100 specifically includes the identification (such as name, number, etc.) of each rich media capability possessed by the SMS APP.
- the card server 500 can determine that the SMS APP of the terminal device 100 has the rich media capability corresponding to the identifier 1.
- Table 1 shows two rich media capability sets (ie, capability set 1 and capability set 2).
- the first information reported by the terminal device 100 specifically includes the identification of each rich media capability in the capability set 2, that is, the identification of the static picture and the identification of the jump browser.
- multiple capability version numbers are preset, and each capability version number corresponds to a capability set.
- the first information reported by the terminal device 100 specifically includes a capability version number.
- the card server 500 pre-stores the corresponding relationship between each capability version number and the capability set. Based on the capability version number reported by the terminal device 100, the card server 500 determines that the capability set corresponding to the capability version number is the rich media possessed by the SMS APP of the terminal device 100.
- a collection of capabilities For example, Table 2 shows the corresponding relationship between two capability version numbers and capability sets.
- the card server 500 can store the corresponding relationship between the device identification 1 of the terminal device 100 and the rich media capability set 1 in the rich media capability library; it can also store only the device identification 1 and the capability version number in order to save storage space.
- the corresponding relationship is not specifically limited here.
- the business device sends the card parameters of the original rich media card and the device identifier 1 of the terminal device 100 to the card server 500.
- the card server 500 receives the card parameters and device identifier 1 sent by the business device.
- the service device (such as the aforementioned service terminal 300 or service server 400) can select a preset rich media card template and send card parameters corresponding to the rich media card template to the card server 500.
- the rich media card template can be used to indicate the card layout of the rich media card.
- the card layout can include some or all of: card shape, card size, and card color, and can also include all of the rich media card templates.
- the card parameters corresponding to the rich media card template may include: the module ID of the rich media card module, and the component parameters corresponding to each component included in the rich media card module.
- the card server 500 can obtain the corresponding rich media card module based on the module ID.
- the card server 500 can obtain the rich media module library, and obtain the rich media card module corresponding to the specified module ID in the rich media module library.
- the component parameters of component 1 may include: the component name (such as ID, name, etc.) of component 1 in the rich media card module, the display content, and may also include at least one URL connection associated with component 1.
- the display content of component 1 (such as a static picture) sent by the business device can be the display data of the component (such as the picture data of the static picture), or can be the download address of the display data of the component (such as a URL). connect).
- component 1 when component 1 (i.e. text 402 shown in Figure 1D) in the rich media card is associated with a URL link, component 1 can receive the user's input operation and jump to component 1 in response to the above input operation.
- the page indicated by the associated URL link i.e., the page in the browser APP shown in 1E).
- component 1 can be associated with multiple URL links.
- the multiple URL links can include one or more of the following: a URL link that jumps to the default APP 1, a URL link that jumps to the quick app 1, URL link to the browser, etc.
- the component parameters of component 1 may also include indication information 2.
- the indication information 2 is used to indicate URL link 1 to be used preferentially among the above multiple URL links.
- the card server 500 may determine, based on the rich media capabilities reported by the terminal device 100, which URL link among the multiple URL links mentioned above is associated with component 1 in the finally generated first rich media card, which will not be described again here.
- the service server 400 is equipped with a service input module (such as a display screen, keyboard and/or mouse),
- the staff can submit to the card server 500 through the business server 400 the card parameters of the original rich media card corresponding to the rich media text message intended to be sent and the device identification of the target receiving end (for example, the device identification 1 of the terminal device 100).
- the staff can submit the above-mentioned card parameters and the device identification of the target receiving end to the card server 500 through the business terminal 300.
- the staff can log in to the rich media text message editing system provided by the card server 500 at the business terminal 300.
- the rich media text message editing system can provide a variety of rich media card templates; the staff can select the required ones. Rich media card module, and edit the component parameters of each component in the rich media card module; finally, submit the card parameters (such as the template ID of rich media card module 1 and the rich media card module 1 to the card server 500 through the rich media SMS editing system component parameters of each component within) and the device identification of the target receiving end (for example, the device identification 1 of the terminal device 100).
- FIGS. 5A to 5E show related user interfaces for selecting and editing rich media card templates in the business terminal 300 .
- the staff calls the rich media card template library provided by the rich media text message editing system, and the business terminal 300 displays the user interface 21 shown in Figure 5A.
- the user interface 21 includes a plurality of rich media card templates (such as the rich media card template 201), and the template ID of each rich media card template (such as the template ID 202 of the rich media card template 201).
- the rich media card template 201 includes 1 video component, 2 text components and 2 static picture components.
- the user interface 21 may also include one or more of a search box 403 , a component classification option 404 and a sorting option 405 .
- the search box 403 is used to receive a template ID or keyword input by the user.
- the service terminal 300 can obtain the rich media card template corresponding to the template ID or keyword in the search box 403 and display it in the user interface 21 .
- the component classification options 404 include a variety of component options, such as static picture options 404A, dynamic picture options, video options 404B, etc.; the user can select one or more component options in the component classification options 404 (such as options 404A and options 404B), The service terminal 300 only displays the rich media card template including one or more of the above component options in the user interface 21 .
- the sorting options 405 include options for multiple sorting methods, for example, comprehensive sorting options 405A, most used sorting options, and latest uploaded sorting options. For example, as shown in FIG. 5A , when the comprehensive sorting option 405A in the sorting option 405 is selected, the sorting mode of the rich media card templates in the user interface 21 is comprehensive sorting.
- the rich media card template 201 can receive a user's input operation (such as a click operation). In response to the above input operation, the terminal device 100 displays the user interface 22 shown in Figure 5B .
- the user interface 22 Used to edit component parameters of the rich media card template 201.
- the user interface 22 may include an editing area of each component of the rich media card template 201, a submission control 406, and a preview card 407.
- the submission control 406 is used to submit the component parameters of the rich media card template 201 edited by the user to the rich media short message editing system.
- the preview card 407 is used to display the display effect of the rich media card according to the component parameters of the rich media card template 201 edited by the user.
- the editing area of the video component 1 in the user interface 22 includes an address box 408 for displaying content and/or an add control 409, and may also include a jump link box 410 and a video size 411. , video size 412.
- the address box 408 is used to input the URL link 1 of the display content of the video component 1, and the URL link 1 indicates the download address of the video file.
- the card server 500 and/or the terminal device 100 can obtain the above video file based on the URL link 1.
- Add control 409 is used to add local video files.
- the video size 411 is used to indicate the display size of the video uploaded by the user
- the video size 412 is used to indicate the amount of information in the video uploaded by the user. See Figure 5B.
- the video size is 412. Indicates the maximum amount of video information that can be uploaded (for example, 100 megabytes (M)).
- the jump link box 410 is used to input the URL link 2 associated with the video component 1 for page jump; for example, the URL link 2 indicates the address of the user interface 1 of the APP 1 .
- the adding control 409 can receive the user's input operation (such as a touch operation).
- the service terminal 300 can display the local file selection box 413 shown in FIG. 5C , and the user can search and search through the selection box 413. Select the desired video file.
- the service terminal 300 displays the name 414 and/or icon 415 of the video file, and displays the video size of the video file in the video size 409.
- the amount of information of the video file is displayed in the size 412, and the video cover and playback controls of the video file are displayed in the display area of the video component 1 of the preview card 407.
- the preview card 407 displays the display effect of the original rich media card required by the user.
- the rich media text message editing system also provides a customization function for rich media card templates.
- Staff can use the above customization functions to design exclusive rich media card templates, such as customizing the color of the card and the layout of each component in the card. Location, etc., are not specifically limited here.
- the card server 500 determines the rich media capability set 1 reported by the terminal device 100, and generates the first rich media card within the range of the rich media capability set 1 based on the rich media capability set 1 and the above card parameters, and The first label of the first rich media card.
- the card server 500 After receiving the device identification 1 and card parameters, the card server 500 queries the rich media capability set 1 corresponding to the device identification 1 in the rich media capability library; based on the above card parameters, determines each of the original rich media cards required by the business device. Rich media capabilities required by the component.
- the rich media capability set 1 does not include the rich media capability 1 required by the component 1 of the original rich media card
- the component can be adaptively degraded based on the preset capability degradation relationship; each component of the original rich media card can be adaptively degraded.
- the card server 500 After adaptive downgrade, the card server 500 generates the first rich media card within the range of rich media capability set 1 and the first label of the first rich media card, and stores the corresponding relationship between the first label and the first rich media card.
- the tag can be a card ID, card name or short link, and is not specifically limited here.
- the card server 500 may determine the required component rendering capabilities based on the component type of each component in the card parameters. For example, it is determined based on the card parameters that the original rich media card includes video component 1, which requires video rendering capabilities. Based on the jump links associated with each component in the card parameters, the card server 500 can determine the interaction capabilities required by the component. For example, based on the card parameters, it is determined that the jump link of component 1 in the original rich media card is URL link 1. The card server 500 parses URL link 1, determines that URL link 1 is used to jump to the default APP 1, and then determines that component 1 needs The ability to jump to the default APP 1.
- the card server 500 determines that URL link 1 is used for the jump. Go to default APP 1, and then determine that component 1 needs the ability to jump to default APP 1.
- Table 3 shows some capability downgrade relationships provided by embodiments of the present application. As shown in Table 3, rich media capability A can be downgraded to rich media capability B. As shown in Table 3, rich media capability A is empty, which means that rich media capability A cannot be downgraded to other rich media capabilities.
- rich media capability 1 can be downgraded to rich media capability 2.
- the rich media capability set 1 does not include rich media capability 1 but includes rich media capability 2
- the rich media capability 1 of component 1 is downgraded to rich media capability 2.
- the rendering capabilities of dynamic pictures, horizontal stroke pictures and videos can be downgraded to the rendering capabilities of static pictures.
- the rich media capability 1 of component 1 is component rendering capability
- the rich media capability 1 (such as video rendering capability) is downgraded to the rendering capability of static pictures
- the component type of the component is downgraded from a video component to a picture component.
- the degraded display content of this component is a static image frame in the display content of component 1 (ie, video).
- the rich media capability 1 of component 1 is the rendering capability of carousel images
- the rendering capability of carousel images is downgraded to the rendering capability of horizontal swipe images
- the component type of the component is downgraded from the carousel image component to the lateral swipe image component.
- the display content of the downgraded component remains unchanged, and the display mode of multiple images corresponding to the component changes from carousel display to horizontal swipe display.
- the rich media capability 1 of component 1 is the transfer capability to jump to a preset APP (such as a shopping APP), based on the preset capability downgrade relationship, it is determined that the rich media capability 1 can be downgraded to the rich media capability 2 (such as the ability to jump to a browser). Only when the rich media capability set 1 does not include rich media capability 1, but includes rich media capability 2, and the jump link associated with component 1 includes the URL link of rich media capability 2 (for example, the URL link that jumps to the browser) Downgrade rich media capability 1 of component 1 to rich media capability 2, and delete the URL link of rich media capability 1 (for example, jump to the URL link of the default APP).
- a preset APP such as a shopping APP
- rich media capability 1 can be downgraded to rich media capability 2, and rich media capability 2 can be downgraded to rich media capability 3.
- rich media capability set 1 does not include rich media capability 1 and rich media capability 2, but includes rich media capability 3
- the rich media capability 1 of component 1 is downgraded to rich media capability 3.
- rich media capability 1 can be downgraded multiple times in sequence. For example, referring to Table 3, the rendering capability of carousel images can be downgraded to the rendering capability of horizontal swipe images, and the rendering capability of horizontal swipe images can be downgraded to the rendering capability of static images.
- rich media capability 1 can eventually be downgraded to rich media capability 2, and rich media capability set 1 does not include rich media capability 2, rich media capability 1 will continue to be downgraded to null.
- Table 3 the rendering capability of carousel pictures can be downgraded to the rendering capability of horizontal swipe pictures, and the rendering capability of horizontal swipe pictures can be downgraded to the rendering capability of static pictures; when rich media capability set 1 does not include horizontal swipe pictures
- the rendering capability of component 1 and the rendering capability of static images are reduced, the rendering capability of the carousel image of component 1 is eventually degraded to null.
- the rich media capability 1 of component 1 is the component rendering capability (such as the rendering capability of static images), and the final degradation of rich media capability 1 is determined based on the preset capability degradation relationship and the rich media capability set 1 Is empty.
- the display content of the component is downgraded to blank (for example, the display content in the component parameters of the component is deleted).
- the component parameter indicates that component 1 is associated with URL link 1
- the displayed content of component 1 is replaced with the above URL link 1 or the replacement text indicated by the component parameter.
- component 1 when it is determined that rich media capability 1 is eventually downgraded to empty, component 1 is deleted, that is, all component parameters of component 1 (including the display content and jump links of the component) are deleted.
- the rich media capability 1 of component 1 is the rendering capability of static pictures. After the rich media capability 1 is downgraded, the display area of the component can be a blank area. For example, referring to Table 3, the rich media capability 1 of component 1 is the rendering capability of the voting form. Based on the preset capability downgrade relationship, the rendering capability of the voting form can be downgraded to empty; when the component parameter of component 1 indicates that component 1 When there is a jump link associated with it (for example, URL link 1 of the voting webpage in the browser), the rendering ability of the voting form is downgraded to empty. Specifically, it includes: replacing the display content of component 1 with the voting title in the voting form. After downgrading Component 1 is associated with URL link 1; when the component parameter of component 1 indicates that component 1 has no associated jump link, downgrade the rendering capability of the voting form to empty, specifically including: deleting component 1.
- the rich media capability 1 of component 1 is an interactive capability (such as the ability to jump to a browser).
- the final rich media capability 1 is determined based on the preset capability degradation relationship and the rich media capability set 1. Demoted to empty.
- the rich media capability 1 of component 1 is canceled (for example, the URL link of component 1 that jumps to the browser is deleted).
- component 1 is deleted, that is, all component parameters of component 1 are deleted.
- component 1 in implementation mode 4, in the downgraded rich media card, component 1 can continue to display the display content indicated by the component parameters of component 1; in implementation mode 5, in the downgraded rich media card, component 1 is not included, and naturally it cannot Displays the display content indicated by the component parameter of component 1.
- the components are adaptively downgraded based on the rich media capability set 1 and the capabilities required by each component (for example, component 1) in the original rich media card.
- the first rich media capability card within the range of the rich media capability set 1 is generated.
- a rich media card template 2 suitable for each downgraded component is re-selected; based on the component parameters of each downgraded component and the rich media card template 2, a rich media card template 2 is generated.
- the first rich media capability card in the Media Capability Set 1 range. For example, after adaptive downgrade, some components in the original rich media card are deleted. For better visual effects and user experience, a new rich media card template is needed to rearrange the downgraded components.
- the card server 500 sends the first tag of the first rich media card to the business device, and the business device receives the first tag sent by the card server 500.
- the service device sends a rich media message containing the first tag to the terminal device 100, and the terminal device 100 receives the rich media message sent by the service device.
- the service device sends the rich media text message containing the first tag to the terminal device 100 through a conventional text message platform.
- the terminal device 100 sends an acquisition request to the card server 500, where the acquisition request includes the first tag; the card server 500 receives the acquisition request sent by the terminal device 100.
- the terminal device 100 when the terminal device 100 receives the rich media text message containing the first tag, the terminal device 100 sends the above acquisition request to the card server 500; or, the terminal device 100 receives an input to view the first rich media card corresponding to the rich media text message. During operation, the above acquisition request is sent to the card server 500.
- the terminal device 100 There are no specific limitations here.
- the input operation to view the rich media card corresponding to the rich media text message can be an input operation (such as a touch operation) acting on the text message entry 202.
- an input operation such as a touch operation
- the input operation to view the rich media card corresponding to the rich media message can be an input operation (such as a touch operation) acting on the control 301 that displays the card.
- the display The rich media card shown in (a) or (b) of Figure 2B.
- the card server 500 sends the first rich media card corresponding to the first tag to the terminal device 100, and the terminal device 100 receives the first rich media card sent by the card server 500.
- the terminal device 100 displays the first rich media card in the SMS APP.
- the card server 500 sends the card data of the first rich media card to the terminal device 100.
- the card data may include the card ID of the first rich media card, card layout information, card theme and theme color, and the content of the first rich media card.
- Component parameters of each component; the card layout information can be the specific card layout data of the first rich media card; the card layout information can also be the download address (such as a URL connection) of the card layout data of the first rich media card, the terminal device 100
- the card layout data of the first rich media card can be downloaded through this download address.
- the SMS APP of the terminal device 100 calls the CPU and/or GPU through the rendering module 1 to draw and render the first rich media card based on the above card layout and the component parameters of the above components; the SMS APP displays the rendered first rich media card.
- the first rich media card is the rich media card shown in (b) of Figure 2B.
- the card data of the rich media card includes the component parameters of component A, such as ""text1": ⁇ "textValue”:"[The diving dream team wins another gold]” ⁇ ".
- "text1" is the component name of component A
- the value of "textValue” "Diving Dream Team Wins Another Gold” is the display content of component A.
- the card data of the rich media card includes the component parameters of component B, such as ""text2": ⁇ "visibility”:"visible”,"textValue”:”. “ ⁇ ”.
- “text2" is the component name of component B
- "visibility” with a value of “visible” means that component B is visible
- “visibility” with a value of “invisible” means that component B is hidden (that is, invisible)
- the value ".” of "textValue” is the display content of component B; it should be noted that when the value of "visibility” is “visible”, the rich media card shown in (b) of Figure 2B will display “Diving Dream” The team won another gold medal.”
- the card data of the rich media card includes the component parameters of component C, such as ""imgBottom”: ⁇ "src”:"https: ⁇ / ⁇ /a2p-functionxxxx.png”,"visibility”:"visible”,”actionParams” :"eyJkYXRhIjp7Im1lcxxxxxxxxxxxxxxxxxxxxxxxxxxxxx0sInR5cGUiOjJ9" ⁇ ".
- "imgBottom” is the component name of component C
- the value of "src” is "https: ⁇ / ⁇ /a2p-functionxxxx.png” is the download address of the display content (i.e.
- actionParams "eyJkYXRhIjp7Im1lcxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx0sInR5cGUiOjJ9" is the encoding of the response event corresponding to component C.
- the terminal device 100 decodes the value of "actionParams” to obtain the response event corresponding to component C. .
- the decoded value of "actionParams" may include a URL link that implements the specified interactive capability.
- the terminal device 100 receives an input operation to view the first rich media card corresponding to the rich media message; in response to the above input operation, the terminal device 100 displays the first rich media card in the SMS APP.
- steps S103 to S108 are optional.
- the card server 500 determines that the rich media capabilities required by each component in the original rich media card do not meet the preset conditions, it executes S103 to step S108; when it determines that the above preset conditions are met, it executes S109 to step S111.
- the above preset conditions include: based on the rich media capability set 1, it is determined that the rich media capabilities required by each component in the original rich media card are adaptively downgraded to empty; or, after adaptive downgrade, only the text component; alternatively, all rich media capabilities required to determine the presence of at least one component in the original rich media card are adaptively downgraded to null.
- the card server 500 sends indication information 3 to the business device.
- the indication information 3 is used to indicate that the rich media card cannot be generated; the business device receives the indication information 3 sent by the card server 500.
- the service device sends a text message to the terminal device 100; the terminal device 100 receives the Receive text messages sent by business equipment.
- the terminal device 100 displays the text message on the SMS APP.
- the service device when the service device determines that the rich media capability set of the terminal device 100 is insufficient to generate the required rich media card, it may not send a rich media text message to the terminal device 100 but only a normal text message. In this way, poor user experience caused by the user being unable to view the rich media card corresponding to the rich media text message can be avoided, and waste of rich media text message fees can also be avoided.
- the rich media capability 1 of component 1 in the original rich media card of the service device is the rendering capability of video.
- Figure 2B shows the relevant user interface in which the rendering capability of video is downgraded to the rendering capability of static pictures.
- the rich media capability 1 of component 1 in the original rich media card of the business device is the rendering capability of horizontal swipe pictures.
- Figures 6A and 6B show that the rendering capability of horizontal swipe pictures is downgraded to the rendering capability of static pictures.
- Related user interfaces The user clicks the SMS item 202 of XX news shown in Figure 1B.
- the terminal device 100 can display the rich media card shown in Figure 6A or 6B in the SMS APP.
- the card server 500 can generate and deliver the rich media card shown in Figure 6A; the display content of component 1 shown in Figure 6A includes multiple pictures.
- the display area also includes a picture indicator 501, which may be used to indicate which of the plurality of pictures the user is currently viewing.
- the SMS APP of the terminal device 100 does not have the ability to render horizontal pictures, but has the ability to render static pictures.
- the card server 500 can generate and deliver the rich media card shown in Figure 6B. As shown in Figure 6B, component 1 is composed of Horizontal images are downgraded to static images.
- the rich media capability 1 of component 1 in the original rich media card of the business device is the rendering capability of the voting form.
- Figures 6C to 6E show the relevant user interfaces for degrading the rendering capability of the voting form.
- the terminal device 100 can display the rich media card shown in Figure 6C, Figure 6D or Figure 6E in the SMS APP.
- the card server 500 can generate and deliver the rich media card shown in Figure 6C; the display content of component 1 shown in Figure 6C includes the voting title and multiple voting options. Users can select at least one of the above multiple voting options to vote.
- component 1 is associated with a jump link (for example, URL connection 1 of the voting webpage), and the SMS APP has the ability to jump to the browser
- the card server 500 can generate and Issue the rich media card shown in Figure 6D; the display content of component 1 shown in Figure 6D includes the voting title; the voting title can receive the user's input operation, and in response to the user's input operation, jumps to the browser based on URL connection 1 Voting webpage, users can vote through the voting webpage.
- the card server 500 can generate the rich media card shown in Figure 6C.
- the card server 500 can generate and deliver the rich media card shown in Figure 6E; as shown in Figure 6E, the card server 500 deletes component 1.
- the rich media capability 1 of component 1 in the original rich media card of the business device is the capability to jump to the shopping APP.
- the jump link of component 1 includes the URL link 1 to jump to the shopping APP and jump to browsing.
- URL link 2 of the shopping web page of the browser, the jump link that component 1 preferentially uses is URL link 1;
- Figure 7A to Figure 7F show the relevant user interface in which the ability to jump to the shopping APP is downgraded to the ability to jump to the browser. .
- the rich media card Includes component 1 (eg buy button 502).
- the jump link associated with the button 502 is URL link 1; in response to the input operation of the purchase button 502 (for example, touch operation), the terminal device 100 may display the OK button 503 and the Cancel button 504 shown in FIG. 7C .
- the OK button 503 is used to confirm opening the shopping APP
- the cancel button 504 is used to cancel opening the shopping APP.
- the OK button 503 may receive a user's input operation (for example, a touch operation).
- the terminal device 100 obtains and displays the shopping interface 15 of the shopping APP shown in FIG. 7D based on the URL link 1 .
- the terminal device 100 may also directly display the shopping interface 15 shown in FIG. 7D.
- the SMS APP of the terminal device 100 does not have the ability to jump to the shopping APP, but has the ability to jump to the browser.
- the jump link associated with the button 502 is a URL link. 2;
- the terminal device 100 may display the OK button 505 and the Cancel button 506 shown in FIG. 7E.
- the OK button 505 is used to confirm opening the browser, and the Cancel button 506 is used to cancel opening the browser.
- the OK button 505 may receive a user's input operation (for example, a touch operation).
- the terminal device 100 obtains and displays the shopping web page 16 of the browser shown in FIG.
- the terminal device 100 may also directly display the shopping web page 16 shown in FIG. 7F. It can be understood that the ability of the purchase button 502 to jump to the shopping APP is downgraded to the ability to jump to the browser.
- the rich media capability 1 of component 1 in the original rich media card of the business device is the ability to jump to the map APP for positioning and navigation, the ability to jump to other pages of the SMS APP to reply to text messages, or the ability to jump to the phone APP.
- Figures 8A to 8F illustrate the associated user interface of component 1 with rich media capability 1 downgraded to empty.
- the terminal device 100 can display the message shown in Figure 8B or 8C. SMS display interface 17.
- the short message display interface 17 shown in FIG. 8B includes text information and controls 510 of the rich media short message.
- the text information includes the short link corresponding to the rich media card.
- the control 510 can receive the user's input operation.
- the terminal device 100 can display the short message display interface 17 shown in Figure 8C; as shown in Figure 8C, the short message display interface 17 includes the above short message sent by the card server 500.
- the rich media card corresponding to the chain also includes a control 511.
- the control 511 is used to switch the rich media card shown in Figure 8C to the text information shown in Figure 8B.
- the terminal device 100 has the ability to jump to the map APP for positioning and navigation, the ability to jump to other text message pages to reply to text messages, and the ability to jump to the phone APP to call back; the rich information generated and distributed by the card server 500
- the media card includes a navigation button 512, a button 513 for replying to text messages, and a button 514 for making a call.
- the navigation button 512 can receive the user's input operation (such as a click operation). In response to the above click operation, the terminal device 100 can display the map APP navigation interface 18 shown in FIG. 8D.
- the component parameters of the navigation button 512 also include the target location, the navigation interface 18 may include a navigation route starting from the user's current location and ending at the target location indicated by the component parameters.
- the button 513 of replying to the text message can receive the user's input operation (such as a click operation), and in response to the above click operation,
- the terminal device 100 can display the SMS display interface 19 of the number 515 shown in Figure 8E; the component parameters of the button 513 can include the number 515 and information for unsubscribing (such as TD), and the SMS display interface 19 includes an information input box 516 and a send button.
- Button 517 and the information input box 516 have been automatically filled with the information for unsubscribing. The user only needs to click the send button 517 to complete the SMS unsubscription.
- the button 514 for making a call can receive the user's input operation (such as a click operation).
- the terminal device 100 can display the dialing interface 20 shown in FIG. 8F in the phone APP; the component parameters of the button 514 can include the number 518 , the SMS display interface 18 includes a dial input box 518 and a dial button 519.
- the information input box 518 has automatically filled in the number 518. The user only needs to click the dial button 519 to dial the number 518.
- the SMS APP of the terminal device 100 does not have the ability to jump to the map APP for positioning and navigation required by the navigation button 512.
- the ability to jump to the map APP for positioning and navigation is determined based on the capability downgrade relationship. is demoted to empty, the card server 500 deletes the navigation button 512, generates and delivers the rich media card shown in Figure 8G. That is, in response to the user's click operation on the SMS entry 201 of the XX car network shown in FIG. 8A , the terminal device 100 can display the rich media card shown in FIG. 8G .
- the SMS APP of the terminal device 100 does not have the ability required by the navigation button 512 to jump to the map APP for positioning and navigation, the ability required by the button 513 to jump to other pages of the SMS to reply to the SMS, and the button 514 required by the jump to the phone.
- the APP has the ability to make calls and other capabilities required by the original rich media card, it is determined that these three capabilities are downgraded to empty based on the capability downgrade relationship.
- the card server 500 deletes the navigation button 512, the button 513 and the button 514, generates and downloads Send the rich media card shown in Figure 8H. That is, in response to the user's click operation on the short message entry 201 of the XX car network shown in Figure 8A, the terminal device 100 can display the rich media card shown in Figure 8H.
- the card server 500 when the card server 500 deletes some components in the original rich media card, it adaptively adjusts the layout of the remaining components. For example, the card server 500 deletes the navigation button 512, the button 513 and the button 514, and generates and delivers the rich media card shown in Figure 8I; compared with the original rich media card shown in Figure 8C, the rich media card shown in Figure 8I is Reduced size.
- the service device may not send the rich media message to the terminal device 100, but instead send the text message shown in FIG. 8J.
- This application provides a rich media information processing system, including a first terminal device, a business device and a card server 500,
- the first terminal device is configured to send first information to the card server 500.
- the first information is used to indicate a first set of rich media capabilities supported by the first application of the first terminal device.
- the first set of rich media capabilities includes at least one rich media. ability;
- the business device is used to send the card parameters of the original rich media card and the device identification of the first terminal device to the card server 500;
- the card server 500 is also configured to generate first card information based on the card parameters and the first rich media capability set.
- the first card information includes card data of the first rich media card and the corresponding first label, and sends the first label to the business device. ;
- the service device is also configured to send a rich media message to the first application of the first terminal device, where the rich media message includes the first tag;
- the first application of the first terminal device is also configured to send an acquisition request to the card server 500, where the acquisition request includes the first tag;
- the card server 500 is also used to send card data to the first application of the first terminal device;
- the first application of the first terminal device is also used to display the first rich media card based on the card data.
- the first terminal device may be the aforementioned terminal device 100
- the first application may be the aforementioned SMS APP
- the first information may be the aforementioned indication information 1
- the first rich media capability set may be the aforementioned rich media capability set 1.
- the device identification of a terminal device may be the device identification 1 of the terminal device 100
- the rich media message may be the aforementioned rich media text message.
- rich media capabilities include component rendering capabilities and interaction capabilities;
- component rendering capabilities refer to the ability to render specified components in rich media cards, and the specified components include one or more of the following: static pictures, dynamic pictures, videos, horizontal Draw pictures, carousel pictures, voting forms, buttons, etc.;
- interactive capabilities include one or more of the following: jump to the browser, jump to the default application (APP), jump to the phone APP to make a call, jump Navigate to the map APP, jump to other APPs to share rich media cards, jump to quick apps, etc.; the default APP refers to an APP with a web version.
- APP application
- the card data includes card layout information of the original rich media card and component parameters of each component in the original rich media card.
- the component parameters include component names, information indicating the display content of the component, and information that implements the specified interactive capabilities of the component. Some or all of URL links, component types, etc.
- the first information includes an identification of each rich media capability in the first rich media set; or, the first information includes a version number of the first rich media set, and the card server 500 stores multiple rich media capabilities.
- generating the first card information based on the card parameters and the first rich media capability set includes: determining at least one rich media capability required by each component in the original rich media card based on the card parameters, The rich media capabilities required by the first component include the first rich media capability, and the first component is any component in the original rich media card; when the first rich media capability set does not include the first rich media capability, based on the default The capability downgrade relationship degrades the capability of the first component; after the capability is downgraded, the first card information of the first rich media card within the rich media capability range of the first application is generated.
- the first component may be the aforementioned component 1.
- the card parameters include the component type of the first component
- the rich media capabilities required by the first component include the component rendering capabilities corresponding to the component type of the first component
- the card parameters include the implementation of the specified interaction capabilities of the first component.
- the rich media capabilities required by the first component include specifying interactive capabilities.
- the capability downgrade relationship includes one or more of the following: the first rich media capability is downgraded to the second rich media capability, or the first rich media capability is downgraded to null; the second rich media capability is downgraded to the third The rich media capability, or the second rich media capability, is downgraded to null; downgrading to null means that it cannot be downgraded to other rich media capabilities.
- the capability downgrade relationship includes the capability downgrade relationship of the component rendering capability and the capability downgrade relationship of the interactive capability.
- the capability downgrade relationship of the component rendering capability includes one or more of the following: the rendering capability of dynamic pictures is downgraded to the rendering capability of static pictures, horizontal swipe pictures The rendering capability is downgraded to that of static pictures, the rendering capability of videos is downgraded to that of static pictures, the rendering capability of carousel pictures is downgraded to that of horizontal swipe pictures, the rendering capability of static pictures is downgraded to empty, and the rendering capability of voting forms is downgraded to that of static pictures.
- the rendering capability is downgraded to null;
- the capability downgrade relationship of the interactive capability includes one or more of the following: the ability to jump to the default APP is downgraded to the ability to jump to the browser; the ability to jump to the browser is downgraded to null; The ability to jump to the phone APP to make calls is downgraded to empty; the ability to jump to the map APP for positioning and navigation is downgraded to empty; the ability to jump to other pages of the first application to reply to messages is downgraded to empty; jump to other APPs to share rich media.
- the card's ability is downgraded to null.
- the first rich media capability set does not include the first rich media capability but includes the second rich media capability.
- the second rich media capability is a downgraded capability of the first rich media capability.
- the first rich media capability and the third rich media capability are The second rich media capability is the component rendering capability; the card parameters include information indicating the first display content of the first component, and the first display content is obtained through the first rich media capability.
- Media capabilities are displayed; the first rich media card includes a second component, the display content of the second component is the second display content, the second display content is determined based on the first display content, and the second display content is determined through the second rich media Demonstrated ability.
- the first rich media capability is the rendering capability of videos
- the second rich media capability is the rendering capability of static images
- the first display content is a video
- the second display content is a frame of static images in the video.
- the first display content is video 1 in the rich media card shown in (a) of Figure 2B, and the first component is the video component corresponding to video 1
- the first rich media card is the video component shown in (b) of Figure 2B.
- the second display content is the static picture 1 in the rich media card
- the second component is the static picture component corresponding to the static picture 1.
- the first rich media capability set includes a third rich media capability, excluding the first rich media capability and the second rich media capability.
- the third rich media capability is the downgraded capability of the second rich media capability.
- the first rich media capability, the second rich media capability, and the third rich media capability are component rendering capabilities;
- the card parameters include information indicating the first display content of the first component, and the first display content is displayed through the first rich media capability;
- the first rich media card includes a third component, the display content of the third component is the third display content, the third display content is determined based on the first display content, and the third display content is displayed through the third rich media capability.
- the first component is a carousel image component
- the first rich media capability is the rendering capability of carousel images
- the second rich media capability is the rendering capability of horizontally swiped images
- the third rich media capability is the rendering capability of static images.
- the first rich media capability set does not include the first rich media capability, the first rich media capability cannot be downgraded to other rich media capabilities, and the first rich media capability is a component rendering capability;
- the card parameters include indicating the first component The information of the first display content is displayed through the first rich media capability; the first rich media card does not display the first display content.
- the first component is a voting form component
- the first rich media capability is the rendering capability of the voting form.
- the original rich media card can be the rich media card shown in Figure 6C, which displays a voting form
- the first rich media card can be the rich media card shown in Figure 6D or Figure 6E, as shown in Figure 6D
- the SMS APP does not have the rendering capability of the voting form
- the rich media card does not display the voting form.
- the first rich media card includes a fourth component
- the display content of the fourth component is the first URL link or the replacement content of the first component
- the card parameters include the first URL link of the first component that implements the interactive capability. and the replacement content of the first component.
- the fourth component is component 1 shown in Figure 6D.
- the card parameters include the URL link of the voting form component that jumps to the voting web page.
- the voting form in the original rich media card is replaced with text (such as the above URL link) .
- the card parameters include a first URL link of the first component that implements the fourth rich media capability, and a second URL link of the first component that implements the fifth rich media capability;
- the fifth rich media capability is the fourth After downgraded rich media capabilities, the fourth rich media capability and the fifth rich media capability are interactive capabilities;
- the first rich media capability set includes the fourth rich media capability, the first rich media card includes the first component, the first The terminal device is also configured to, in response to the first input operation for the first component, jump to the user interface indicated by the first URL link based on the fourth rich media capability; when the first rich media capability set does not include the fourth rich media capability,
- the fifth rich media capability is included, the first rich media card includes a fifth component, and the first terminal device is further configured to jump to the second URL link based on the fifth rich media capability in response to the first input operation for the fifth component. Indicates the user interface.
- the first URL link is the URL link of the default APP
- the second URL link is the URL link of the web version of the default APP
- the fourth rich media capability is the ability to jump to the default APP
- the fifth Rich media capability is the ability to jump to the browser.
- the default APP is a shopping APP
- the first rich media card can be the rich media card shown in Figure 7B, Figure 7C or Figure 7E
- the first component is the button 502.
- Figure 7B to Figure 7D when the SMS APP has the ability to jump The ability to jump to the shopping APP.
- the first rich media card includes a button 502.
- the first rich media card includes a button 502 (i.e., the fifth component).
- the third button 502 One input operation can jump to the web version of the shopping APP indicated by the second URL link.
- the first rich media capability set does not include the fourth rich media capability but includes the fifth rich media capability.
- the fifth rich media capability is the downgraded capability of the fourth rich media capability.
- the fourth rich media capability and the third rich media capability are The fifth rich media capability is the interactive capability;
- the card parameters include the first URL link of the first component that implements the fourth rich media capability, and the card parameters do not include the URL link of the first component that implements the fifth rich media capability;
- the first rich media card Excludes components with fourth rich media capabilities.
- the first rich media card includes a sixth component, the sixth component is generated based on component parameters of the first component, and the component parameters of the sixth component do not include the first URL link.
- the first rich media card does not include components generated based on component parameters of the first component, and the first component is deleted.
- the first rich media capability set does not include the fourth rich media capability, the fourth rich media capability cannot be downgraded to other rich media capabilities, and the fourth rich media capability is an interactive capability;
- the card parameters include the implementation of the first component The first URL link of the fourth rich media capability;
- the first rich media card does not include the component with the fourth rich media capability.
- the first rich media card includes a sixth component, the sixth component is generated based on component parameters of the first component, and the component parameters of the sixth component do not include the first URL link.
- the first rich media card does not include components generated based on component parameters of the first component, that is, the first component is deleted.
- the original rich media card is the rich media card shown in Figure 8C
- the first component is the button 512
- the fourth rich media capability is the ability to jump to the map APP positioning and navigation, and this capability cannot be downgraded to other capabilities
- One rich media card is the rich media card shown in Figure 8G.
- the SMS APP does not have the ability to jump to the map APP for positioning and navigation, and the rich media card does not display button 512.
- sending an acquisition request to the card server 500 specifically includes: receiving a second input operation for viewing the rich media card corresponding to the rich media message; and sending an acquisition request to the card server 500 in response to the second input operation.
- the above system further includes a second terminal device; the second terminal device is used to send second information to the card server 500, and the second information is used to indicate the second rich media supported by the first application of the second terminal device.
- the second rich media capability set includes at least one rich media capability; the card server 500 is also configured to generate third information based on the card parameters and the second rich media capability set, and send the third information to the business device. Used to indicate that the rich media card of the second terminal device cannot be generated based on the card parameters; the business device is also used to send a text message corresponding to the original rich media card to the first application of the second terminal device; the first application of the second terminal device also Used to display text messages.
- the third information may be the aforementioned instruction information 3
- the text message may be the aforementioned text message.
- the second information is generated when the second card parameter and the second rich media capability set meet preset conditions; the preset conditions include: based on the preset capability degradation relationship and the first rich media capability set, It is determined that all rich media capabilities required by the original rich media card are downgraded to null, or at least one rich media capability required by the original rich media card is downgraded to null; downgrading to null means that it cannot be downgraded to other rich media capabilities.
- the computer program product includes one or more computer instructions.
- the computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device.
- the computer instructions may be stored in or transmitted from one computer-readable storage medium to another, e.g., the computer instructions may be transferred from a website, computer, server, or data center Transmission to another website, computer, server or data center through wired (such as coaxial cable, optical fiber, digital subscriber line) or wireless (such as infrared, wireless, microwave, etc.) means.
- the computer-readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. that contains one or more available media integrated.
- the available media may be magnetic media (eg, floppy disk, hard disk, magnetic tape), optical media (eg, DVD), or semiconductor media (eg, solid state disk (SSD)), etc.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Transfer Between Computers (AREA)
Abstract
本申请公开了富媒体信息处理***,该***中,终端设备向卡片服务器发送第一信息,第一信息用于指示终端设备的第一应用支持的第一富媒体能力集合;业务设备向卡片服务器发送卡片参数和终端设备的设备标识;卡片服务器基于卡片参数和第一富媒体能力集合生成第一富媒体卡片的卡片数据以及对应的第一标签,并向业务设备发送第一标签;业务设备向第一应用发送包括第一标签的富媒体消息;第一应用向卡片服务器发送包括第一标签的获取请求;卡片服务器向第一应用发送卡片数据;第一终端设备的第一应用基于卡片数据显示第一富媒体卡片。这样,能获取第一应用的富媒体能力范围内的富媒体消息,并在第一应用中显示上述富媒体消息对应的富媒体卡片。
Description
本申请要求于2022年3月31日提交中国专利局、申请号为202210336417.X、申请名称为“富媒体信息处理方法、***及相关装置”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
本申请涉及电子技术领域,尤其涉及富媒体信息处理方法、***及相关装置。
富媒体(rich media)指具有动画、声音、视频和/或交互性的信息传播方法,富媒体可包含流媒体、声音、Flash、以及Java、Javascript、DHTML等程序设计语言的形式之一或者几种的组合。相比于普通短信(即文本短信或彩信),以富媒体卡片形式展现的富媒体消息的信息承载量高,可以提供文字、图像、视频、数据等多种信息类型,且交互功能丰富,可以给用户提供更多业务服务。
然而,在终端设备的一个应用程序(application,APP)中富媒体卡片的显示和交互功能,受限于该APP自身的渲染能力和交互能力,当该APP不具备上述富媒体卡片所需的能力时,端侧设备无法显示上述富媒体卡片。这样,极大降低了用户对富媒体消息的使用体验。
发明内容
本申请提供了富媒体信息处理方法、***及相关装置,能获取终端设备的第一应用的富媒体能力范围内的富媒体消息,并以富媒体卡片形式在第一应用显示上述富媒体消息,有效提高了用户体验。
第一方面,本申请提供了一种富媒体信息处理***,包括第一终端设备、业务设备和卡片服务器,
第一终端设备用于向卡片服务器发送第一信息,第一信息用于指示第一终端设备的第一应用支持的第一富媒体能力集合,第一富媒体能力集合包括至少一种富媒体能力;业务设备用于向卡片服务器发送原始富媒体卡片的卡片参数和第一终端设备的设备标识;卡片服务器还用于基于卡片参数和第一富媒体能力集合生成第一卡片信息,第一卡片信息包括第一富媒体卡片的卡片数据以及对应的第一标签,并向业务设备发送第一标签;业务设备还用于向第一端终端设备的第一应用发送富媒体消息,富媒体消息包括第一标签;第一终端设备的第一应用的还用于向卡片服务器发送获取请求,获取请求包括第一标签;卡片服务器还用于向第一终端设备的第一应用发送卡片数据;第一终端设备的第一应用还用于基于卡片数据显示第一富媒体卡片。
实施本申请实施例,第一终端设备的第一应用仅支持原始富媒体卡片所需的部分富媒体能力时,卡片服务器可以依据第一终端设备的第一应用的富媒体能力集合,将原始富媒体卡片自适应地降级为第一应用的富媒体能力范围内的富媒体卡片;这样,第一终端设备就能在第一应用中显示上述富媒体卡片以及支持上述富媒体卡片的所有交互能力,有效提高了用户体验。
在一种实现方式中,富媒体能力包括组件渲染能力和交互能力;组件渲染能力指渲染富
媒体卡片中指定组件的能力,指定组件包括以下一项或多项:静态图片、动态图片、视频、横划图片、轮播图片、投票表单、按钮等;交互能力包括以下一项或多项:跳转至浏览器、跳转至预设应用程序(APP)、跳转至电话APP拨打电话、跳转至地图APP定位导航、跳转至其他APP分享富媒体卡片、跳转至快应用等;预设APP指具备网页版的APP。
在一种实现方式中,卡片数据包括原始富媒体卡片的卡片布局信息以及原始富媒体卡片中各组件的组件参数,组件参数包括组件名称、指示组件的显示内容的信息、实现组件的指定交互能力的URL链接、组件类型等中的部分或全部。
在一种实现方式中,第一信息包括第一富媒体集合中的每种富媒体能力的标识;或者,第一信息包括第一富媒体集合的版本号,卡片服务器存储有多种富媒体能力集合的版本号,多种富媒体能力集合包括第一富媒体集合。通过版本号上传富媒体能力,可以节省存储空间以及信令开销。
在一种实现方式中,上述基于卡片参数和第一富媒体能力集合范围内生成第一卡片信息,具体包括:基于卡片参数,确定原始富媒体卡片中各组件所需的至少一种富媒体能力,第一组件所需的富媒体能力包括第一富媒体能力,第一组件为原始富媒体卡片中的任一组件;当第一富媒体能力集合不包括第一富媒体能力时,基于预设的能力降级关系对第一组件进行能力降级;能力降级后,生成第一应用的富媒体能力范围内的第一富媒体卡片的第一卡片信息。
在一种实现方式中,卡片参数包括第一组件的组件类型,第一组件所需的富媒体能力包括第一组件的组件类型对应的组件渲染能力;卡片参数包括第一组件的实现指定交互能力的URL连接时,第一组件所需的富媒体能力包括指定交互能力。
在一种实现方式中,能力降级关系包括以下一种或多种:第一富媒体能力降级为第二富媒体能力,或者,第一富媒体能力降级为空;第二富媒体能力降级为第三富媒体能力,或者,第二富媒体能力降级为空;降级为空指不能降级为其他富媒体能力。本申请实施例中,部分富媒体能力能够进行多层降级。
在一种实现方式中,能力降级关系包括组件渲染能力的能力降级关系和交互能力的能力降级关系,组件渲染能力的能力降级关系包括以下一种或多种:动态图片的渲染能力降级为静态图片的渲染能力,横划图片的渲染能力降级为静态图片的渲染能力,视频的渲染能力降级为静态图片的渲染能力,轮播图片的渲染能力降级为横划图片的渲染能力,静态图片的渲染能力降级为空,投票表单的渲染能力降级为空;交互能力的能力降级关系包括以下一种或多种:跳转至预设APP的能力降级为跳转至浏览器的能力;跳转至浏览器的能力降级为空;跳转至电话APP拨打电话的能力降级为空;跳转至地图APP定位导航的能力降级为空;跳转至第一应用的其他页面回复信息的能力降级为空;跳转至其他APP分享富媒体卡片的能力降级为空。
在一种实现方式中,第一富媒体能力集合不包括第一富媒体能力,包括第二富媒体能力,第二富媒体能力是第一富媒体能力降级后的能力,第一富媒体能力和第二富媒体能力为组件渲染能力;卡片参数包括指示第一组件的第一显示内容的信息,第一显示内容是通过第一富媒体能力展示的;第一富媒体卡片包括第二组件,第二组件的显示内容为第二显示内容,第二显示内容是基于第一显示内容确定的,第二显示内容是通过第二富媒体能力展示的。
在一种实现方式中,第一富媒体能力为视频的渲染能力,第二富媒体能力为静态图片的渲染能力;第一显示内容为视频,第二显示内容是视频中的一帧静态图像。
在一种实现方式中,第一富媒体能力集合包括第三富媒体能力,不包括第一富媒体能力
和第二富媒体能力,第三富媒体能力是第二富媒体能力降级后的能力,第一富媒体能力、第二富媒体能力、第三富媒体能力为组件渲染能力;卡片参数包括指示第一组件的第一显示内容的信息,第一显示内容是通过第一富媒体能力展示的;第一富媒体卡片包括第三组件,第三组件的显示内容为第三显示内容,第三显示内容是基于第一显示内容确定的,第三显示内容是通过第三富媒体能力展示的。
在一种实现方式中,第一富媒体能力集合不包括第一富媒体能力,第一富媒体能力不能降级为其他富媒体能力,第一富媒体能力为组件渲染能力;卡片参数包括指示第一组件的第一显示内容的信息,第一显示内容是通过第一富媒体能力展示的;第一富媒体卡片不显示第一显示内容。
在一种实现方式中,第一富媒体卡片包括第四组件,第四组件的显示内容为第一URL链接或者第一组件的替换内容,卡片参数包括第一组件的实现交互能力的第一URL链接和第一组件的替换内容。
在一种实现方式中,卡片参数包括第一组件的实现第四富媒体能力的第一URL链接,以及第一组件的实现第五富媒体能力的第二URL链接;第五富媒体能力是第四富媒体能力降级后的能力,第四富媒体能力和第五富媒体能力为交互能力;当第一富媒体能力集合包括第四富媒体能力时,第一富媒体卡片包括第一组件,第一终端设备还用于响应于针对第一组件的第一输入操作,基于第四富媒体能力跳转至第一URL链接指示的用户界面;当第一富媒体能力集合不包括第四富媒体能力,包括第五富媒体能力时,第一富媒体卡片包括第五组件,第一终端设备还用于响应于针对第五组件的第一输入操作,基于第五富媒体能力跳转至第二URL链接指示的用户界面。
在一种实现方式中,第一URL链接为预设APP的URL链接,第二URL链接为预设APP的网页版的URL链接;第四富媒体能力为跳转至预设APP的能力,第五富媒体能力为跳转至浏览器的能力。
在一种实现方式中,第一富媒体能力集合不包括第四富媒体能力,包括第五富媒体能力,第五富媒体能力是第四富媒体能力降级后的能力,第四富媒体能力和第五富媒体能力为交互能力;卡片参数包括第一组件的实现第四富媒体能力的第一URL链接,卡片参数未包括第一组件的实现第五富媒体能力的URL链接;第一富媒体卡片不包括具备第四富媒体能力的组件。
在一种实现方式中,第一富媒体能力集合不包括第四富媒体能力,第四富媒体能力不能降级为其他富媒体能力,第四富媒体能力为交互能力;卡片参数包括第一组件的实现第四富媒体能力的第一URL链接;第一富媒体卡片不包括具备第四富媒体能力的组件。
在一种实现方式中,第一富媒体卡片包括第六组件,第六组件是基于第一组件的组件参数生成的,第六组件的组件参数不包括第一URL链接。
在一种实现方式中,向卡片服务器发送获取请求,具体包括:接收用于查看富媒体消息对应的富媒体卡片的第二输入操作;响应于第二输入操作,向卡片服务器发送获取请求。
在一种实现方式中,上述***还包括第二终端设备;第二终端设备用于向卡片服务器发送第二信息,第二信息用于指示第二终端设备的第一应用支持的第二富媒体能力集合,第二富媒体能力集合包括至少一种富媒体能力;卡片服务器还用于基于卡片参数和第二富媒体能力集合生成第三信息,并向业务设备发送第三信息,第三信息用于指示不能基于卡片参数生成第二终端设备的富媒体卡片;业务设备还用于向第二终端设备的第一应用发送原始富媒体卡片对应的文本消息;第二终端设备的第一应用还用于显示文本消息。富媒体消息成本高于
文本消息的成本,实施本申请实施例,可以避免富媒体消息成本的浪费。
在一种实现方式中,第二信息是在第二卡片参数和第二富媒体能力集合满足预设条件时生成的;预设条件包括:基于预设的能力降级关系和第一富媒体能力集合,确定原始富媒体卡片所需的所有富媒体能力均降级为空,或者,原始富媒体卡片所需的至少一种富媒体能力降级为空;降级为空指不能降级为其他富媒体能力。
第二方面,本申请提供一种富媒体信息处理方法,包括:第一终端设备向卡片服务器发送第一信息,第一信息用于指示第一应用支持的第一富媒体能力集合,第一富媒体能力集合包括至少一种富媒体能力;第一终端设备的第一应用接收业务设备发送的富媒体消息,富媒体消息包括第一标签,第一标签是卡片服务器生成的第一富媒体卡片的标签,第一富媒体卡片的卡片数据是卡片服务器基于业务设备发送的原始富媒体卡片的卡片参数和第一富媒体能力集合生成的;第一终端设备的第一应用向卡片服务器发送获取请求,获取请求包括第一标签;第一终端设备的第一应用接收卡片服务器发送的卡片数据;第一终端设备的第一应用基于卡片数据显示第一富媒体卡片。
实施本申请实施例,第一终端设备的第一应用仅支持原始富媒体卡片所需的部分富媒体能力时,卡片服务器可以依据第一终端设备的第一应用的富媒体能力集合,将原始富媒体卡片自适应地降级为第一应用的富媒体能力范围内的富媒体卡片;这样,第一终端设备就能在第一应用中显示上述富媒体卡片以及支持上述富媒体卡片的所有交互能力,有效提高了用户体验。
在一种实现方式中,富媒体能力包括组件渲染能力和交互能力;组件渲染能力指渲染富媒体卡片中指定组件的能力,指定组件包括以下一项或多项:静态图片、动态图片、视频、横划图片、轮播图片、投票表单、按钮等;交互能力包括以下一项或多项:跳转至浏览器、跳转至预设应用程序(APP)、跳转至电话APP拨打电话、跳转至地图APP定位导航、跳转至其他APP分享富媒体卡片、跳转至快应用等;预设APP指具备网页版的APP。
在一种实现方式中,卡片数据包括第一富媒体卡片的卡片布局信息以及第一富媒体卡片中各组件的组件参数,组件参数包括组件名称、指示组件的显示内容的信息、实现组件的指定交互能力的URL链接、组件类型等中的部分或全部。
在一种实现方式中,第一信息包括第一富媒体集合中的每种富媒体能力的标识;或者,第一信息包括第一富媒体集合的版本号,不同富媒体能力集合对应的版本号不同。
在一种实现方式中,原始富媒体卡片中各组件所需的至少一种富媒体能力是基于卡片参数确定的,第一组件所需的富媒体能力包括第一富媒体能力,第一组件为原始富媒体卡片中的任一组件;当第一富媒体能力集合不包括第一富媒体能力时,第一卡片信息是基于预设的能力降级关系,对第一组件进行能力降级后生成的。
在一种实现方式中,卡片参数包括第一组件的组件类型,第一组件所需的富媒体能力包括第一组件的组件类型对应的组件渲染能力;卡片参数包括第一组件的实现指定交互能力的URL连接时,第一组件所需的富媒体能力包括指定交互能力。
在一种实现方式中,能力降级关系包括以下一种或多种:第一富媒体能力降级为第二富媒体能力,或者,第一富媒体能力降级为空;第二富媒体能力降级为第三富媒体能力,或者,第二富媒体能力降级为空;降级为空指不能降级为其他富媒体能力。
在一种实现方式中,能力降级关系包括组件渲染能力的能力降级关系和交互能力的能力降级关系,组件渲染能力的能力降级关系包括以下一种或多种:动态图片的渲染能力降级为
静态图片的渲染能力,横划图片的渲染能力降级为静态图片的渲染能力,视频的渲染能力降级为静态图片的渲染能力,轮播图片的渲染能力降级为横划图片的渲染能力,静态图片的渲染能力降级为空,投票表单的渲染能力降级为空;交互能力的能力降级关系包括以下一种或多种:跳转至预设APP的能力降级为跳转至浏览器的能力;跳转至浏览器的能力降级为空;跳转至电话APP拨打电话的能力降级为空;跳转至地图APP定位导航的能力降级为空;跳转至第一应用的其他页面回复信息的能力降级为空;跳转至其他APP分享富媒体卡片的能力降级为空。
在一种实现方式中,第一富媒体能力集合不包括第一富媒体能力,包括第二富媒体能力,第二富媒体能力是第一富媒体能力降级后的能力,第一富媒体能力和第二富媒体能力为组件渲染能力;卡片参数包括指示第一组件的第一显示内容的信息,第一显示内容是通过第一富媒体能力展示的;第一富媒体卡片包括第二组件,第二组件的显示内容为第二显示内容,第二显示内容是基于第一显示内容确定的,第二显示内容是通过第二富媒体能力展示的。
在一种实现方式中,第一富媒体能力为视频的渲染能力,第二富媒体能力为静态图片的渲染能力;第一显示内容为视频,第二显示内容是视频中的一帧静态图像。
在一种实现方式中,第一富媒体能力集合包括第三富媒体能力,不包括第一富媒体能力和第二富媒体能力,第三富媒体能力是第二富媒体能力降级后的能力,第一富媒体能力、第二富媒体能力、第三富媒体能力为组件渲染能力;卡片参数包括指示第一组件的第一显示内容的信息,第一显示内容是通过第一富媒体能力展示的;第一富媒体卡片包括第三组件,第三组件的显示内容为第三显示内容,第三显示内容是基于第一显示内容确定的,第三显示内容是通过第三富媒体能力展示的。
在一种实现方式中,第一富媒体能力集合不包括第一富媒体能力,第一富媒体能力不能降级为其他富媒体能力,第一富媒体能力为组件渲染能力;卡片参数包括指示第一组件的第一显示内容的信息,第一显示内容是通过第一富媒体能力展示的;第一富媒体卡片不显示第一显示内容。
在一种实现方式中,第一富媒体卡片包括第四组件,第四组件的显示内容为第一URL链接或者第一组件的替换内容,卡片参数包括第一组件的实现交互能力的第一URL链接和第一组件的替换内容。
在一种实现方式中,卡片参数包括第一组件的实现第四富媒体能力的第一URL链接,以及第一组件的实现第五富媒体能力的第二URL链接;第五富媒体能力是第四富媒体能力降级后的能力,第四富媒体能力和第五富媒体能力为交互能力;当第一富媒体能力集合包括第四富媒体能力时,第一富媒体卡片包括第一组件,上述方法还包括:第一终端设备响应于针对第一组件的第一输入操作,基于第四富媒体能力跳转至第一URL链接指示的用户界面;当第一富媒体能力集合不包括第四富媒体能力,包括第五富媒体能力时,第一富媒体卡片包括第五组件,上述方法还包括:第一终端设备响应于针对第五组件的第一输入操作,基于第五富媒体能力跳转至第二URL链接指示的用户界面。
在一种实现方式中,第一URL链接为预设APP的URL链接,第二URL链接为预设APP的网页版的URL链接;第四富媒体能力为跳转至预设APP的能力,第五富媒体能力为跳转至浏览器的能力。
在一种实现方式中,第一富媒体能力集合不包括第四富媒体能力,包括第五富媒体能力,第五富媒体能力是第四富媒体能力降级后的能力,第四富媒体能力和第五富媒体能力为交互
能力;卡片参数包括第一组件的实现第四富媒体能力的第一URL链接,卡片参数未包括第一组件的实现第五富媒体能力的URL链接;第一富媒体卡片不包括具备第四富媒体能力的组件。
在一种实现方式中,第一富媒体能力集合不包括第四富媒体能力,第四富媒体能力不能降级为其他富媒体能力,第四富媒体能力为交互能力;卡片参数包括第一组件的实现第四富媒体能力的第一URL链接;第一富媒体卡片不包括具备第四富媒体能力的组件。
在一种实现方式中,第一富媒体卡片包括第六组件,第六组件是基于第一组件的组件参数生成的,第六组件的组件参数不包括第一URL链接。
第三方面,本申请提供了一种终端设备,包括一个或多个处理器和一个或多个存储器。该一个或多个存储器与一个或多个处理器耦合,一个或多个存储器用于存储计算机程序代码,计算机程序代码包括计算机指令,当一个或多个处理器执行计算机指令时,使得终端设备执行上述第二方面任一项可能的实现方式中的富媒体信息处理方法。
第四方面,本申请实施例提供了一种计算机存储介质,包括计算机指令,当计算机指令在终端设备上运行时,使得终端设备执行上述第二方面任一项可能的实现方式中的富媒体信息处理方法。
第五方面,本申请实施例提供了一种计算机程序产品,当计算机程序产品在计算机上运行时,使得计算机执行上述第二方面任一项可能的实现方式中的富媒体信息处理方法。
图1A至图1F为本申请实施例提供的富媒体短信的相关用户界面;
图2A为本申请实施例提供的一种富媒体信息处理***的***架构图;
图2B为本申请实施例提供的富媒体卡片的相关用户界面;
图3为本申请实施例提供的终端设备的结构示意图;
图4A为本申请实施例提供的富媒体信息处理方法的流程示意图;
图4B和图4C为本申请实施例提供的富媒体卡片的示意图;
图5A至图5E为本申请实施例提供的选择和编辑富媒体卡片模板的相关用户界面;
图6A至图6E为本申请实施例提供的富媒体短信的相关用户界面;
图7A至图7F为本申请实施例提供的富媒体短信的相关用户界面;
图8A至图8J为本申请实施例提供的富媒体短信的相关用户界面。
下面将结合附图对本申请实施例中的技术方案进行清楚、详尽地描述。其中,在本申请实施例的描述中,除非另有说明,“/”表示或的意思,例如,A/B可以表示A或B;文本中的“和/或”仅仅是一种描述关联对象的关联关系,表示可以存在三种关系,例如,A和/或B,可以表示:单独存在A,同时存在A和B,单独存在B这三种情况,另外,在本申请实施例的描述中,“多个”是指两个或多于两个。
以下,术语“第一”、“第二”仅用于描述目的,而不能理解为暗示或暗示相对重要性或者隐含指明所指示的技术特征的数量。由此,限定有“第一”、“第二”的特征可以明示或者隐含地包括一个或者更多个该特征,在本申请实施例的描述中,除非另有说明,“多个”的含义是两个或两个以上。
本申请以下实施例中的术语“用户界面(user interface,UI)”,是应用程序或操作***与用户之间进行交互和信息交换的介质接口,它实现信息的内部形式与用户可以接受形式之间
的转换。用户界面是通过java、可扩展标记语言(extensible markup language,XML)等特定计算机语言编写的源代码,界面源代码在电子设备上经过解析,渲染,最终呈现为用户可以识别的内容。用户界面常用的表现形式是图形用户界面(graphic user interface,GUI),是指采用图形方式显示的与计算机操作相关的用户界面。它可以是在电子设备的显示屏中显示的文本、图标、按钮、菜单、选项卡、文本框、对话框、状态栏、导航栏、Widget等可视的界面元素。
下面对本申请实施例涉及的技术概念进行解释说明。
短信(short message service,SMS),是用户通过电信终端发送或接收的文本信息,短信所能承载的信息量较小(通常在70或140个字符以内)。
彩信(multimedia messaging service,MMS),能够传递文字、图像、声音、数据等各种多媒体格式的信息。彩信编辑受限,能承载的信息量依旧较小(通常在300kb以内),收费高,交互性低。
富媒体通信(rich communication services,RCS),是全球移动通信***协会在2008年提出的一种通讯方式,RCS融合了即时消息、文件传输、内容共享、呈现、位置服务等通信服务,用以丰富通话、短信、联系人等手机***原生应用的客户体验。RCS支持企业通过富媒体、强交互、智能化的方式,向用户提供高效、便捷、丰富的服务。
本申请实施例中可通过卡片承载富媒体信息,承载富媒体信息的卡片可以简称为富媒体卡片。卡片,是一种新的服务形态,提供一种比应用程序(application,APP)更细粒度的原子化服务能力,以可交互的卡片形式直接将用户最关心的服务或内容展示给用户,卡片可以嵌入各种APP或交互场景中,更好的满足用户需求。
富媒体消息,指第一APP的包含特定标签(例如短链)的消息;终端设备可以获取上述特定标签对应的富媒体卡片,并在第一APP中进行展示,进而通过上述富媒体卡片实现即时消息、文件传输、内容共享、定位等通信服务。上述短链为由任意较长的网址缩短而成的具有唯一性的短网址。
富媒体短信,是基于运营商的基础通信业务,提供的一种富媒体业务,以满足用户对富媒体消息的需求。本申请实施例中,富媒体短信又可称为富媒体卡片短信,指通过常规短信通道下发的包含特定标签(例如短链)的文本信息;通过上述特定标签,终端设备可以获取上述富媒体短信关联的富媒体卡片,并在短信APP进行展示,进而通过上述富媒体卡片实现即时消息、文件传输、内容共享、定位等通信服务。不限于短链,本申请实施例中,上述特定标签还可以是卡片的身份标识(identity,ID)、统一资源定位符(Uniform Resource Locator,URL)等信息,此处不作具体限定。
快应用,是基于手机硬件平台的新型应用形态,快应用框架深度集成进各大手机厂商的手机操作***中,可以在操作***层面形成用户需求与应用服务的无缝连接,使得原生应用程序(application,APP)(例如购物APP、支付APP、地图APP等)中的功能可以在快应用(例如购物快应用、支付快应用、地图快应用)中实现。快应用可以具备原生APP的部分或完整的应用体验,但与原生APP不同的是,快应用无需安装、即点即用。
示例性的,图1A至图1B为本申请实施例提供的一种富媒体短信的相关用户界面。
图1A示出了终端设备100上的用于展示终端设备100安装的应用程序的主界面11。
主界面11可以包括:状态栏101,日历指示符102,天气指示符103,具有常用应用程序图标的托盘104,以及其他应用程序图标105。其中:
具有常用应用程序图标的托盘104可展示:电话APP图标、联系人APP图标、短信APP图标104A、相机APP图标。主界面11还可包括页面指示符106。其他应用程序图标可分布在多个页面,页面指示符106可用于指示用户当前查看的是哪一个页面中的应用程序。用户可以左右滑动其他应用程序图标的区域,来查看其他页面中的应用程序图标。
短信APP的图标104A可以接收用户的输入操作(例如触摸操作),响应于上述输入操作,终端设备100可以显示图1B所示的短信主页12。
如图1B所示,短信主页12可以包括接收到短信的每个发件人对应的短信条目,例如,XX车网的短信条目201、XX新闻的短信条目202、XX购物的短信条目203。以短信条目202为例,短信条目202可以包括发件人的名称202A(即XX新闻),XX新闻的最近一条短信的预览信息202B,上述最近一条短信的接收时间或发送时间202C,以及上述发件人的头像202D。短信条目202可以接收用户的输入操作(例如作用于预览信息202B的点击操作),响应于上述输入操作,终端设备100可以显示图1C或图1D所示的XX新闻的短信展示界面13。
如图1C所示,短信展示界面13包括已接收到的XX新闻的富媒体短信1的原始文本信息,以及用于显示富媒体卡片的控件301。上述文本信息包括短链1(即etp8.cn/VGBfmC),短链1用于获取富媒体短信1关联的富媒体卡片1。控件301可以接收用户的输入操作(例如触摸操作);如图1D所示,响应于上述输入操作,终端设备100可以显示富媒体卡片1和控件302,控件302用于将短信展示界面13中的富媒体卡片1切换回图1C所示的文本信息。
本申请实施例中,富媒体卡片1可以包括图片、视频、文本,还可以具备交互性。示例性的,如图1D所示,富媒体卡片1包括视频组件的播放控件303和文本“花样体操精彩瞬间”304,文本“花样体操精彩瞬间”可以为新闻标题。用户点击播放控件303,终端设备100响应于用户的点击操作,可以通过富媒体卡片1的视频组件播放视频;用户点击文本402,终端设备100响应于用户的点击操作,可以基于文本402关联的URL链接获取并显示浏览器APP中的“花样体操精彩瞬间”的新闻网页。
不限于图1A至图1D所示的调出方式,本申请实施例还可以通过其他方式调出图1D所示的包括富媒体卡片1的短信展示界面13,此处不作具体限定。例如,终端设备100接收富媒体短信1后,在通知栏显示富媒体短信1的预览信息;用户点击通知栏中富媒体短信1的预览信息后,终端设备100显示图1D所示的包括富媒体卡片1的短信展示界面13。
然而,短信APP显示富媒体短信关联的富媒体卡片并支持富媒体卡片的交互功能,依赖于终端设备的短信APP所具备的富媒体能力,上述短信APP所具备的富媒体能力包括渲染富媒体卡片内指定组件(例如静态图片,动态图片,视频,横划图片,轮播图片、投票表单等)的能力,以及实现富媒体卡片内的指定交互功能(例如跳转至浏览器、跳转至预设APP、跳转至快应用(quick application,quick APP)、回复短信、拨打电话、定位导航等)的能力。终端设备获取短链1对应的富媒体卡片1的卡片数据后,在终端设备的短信APP具备富媒体卡片1所需的所有富媒体能力时,才能基于上述卡片数据显示富媒体卡片1;而在“终端设备的短信APP仅具备富媒体卡片所需的部分富媒体能力,或不具备富媒体卡片所需的富媒体能力”的情况下,该终端设备的短信APP无法显示富媒体卡片1。
在一种实现方式中,上述情况下,终端设备的短信APP仅能显示富媒体短信的原始文本信息。示例性的,如图1F所示,终端设备100的短信APP仅具备富媒体卡片1所需的部分
富媒体能力,终端设备100的短信APP中XX新闻的短信展示界面13仅能显示富媒体短信1的原始文本信息1,不能显示富媒体短信1关联的富媒体卡片1。
可以理解,企业向终端设备100下发了富媒体短信,但受限于短信APP的富媒体能力,终端设备100不能显示富媒体短信关联的富媒体卡片,用户只能看到富媒体短信的原始文本信息,这导致了用户体验差;此外,富媒体短信比文本短信成本高,这还浪费了富媒体短信费用,尤其在向大量不同终端设备下发同一富媒体短信的情况下。
本申请实施例还提供了一种富媒体信息处理方法,终端设备能获取该终端设备的第一APP(例如短信APP)的富媒体能力范围内的富媒体卡片对应的富媒体短信,并在第一APP中显示上述富媒体卡片以及支持上述富媒体卡片的所有交互功能,有效提高了用户体验。
下面介绍上述富媒体信息处理方法应用的富媒体信息处理***。
图2A示例性地示出了本申请实施例提供的一种富媒体信息处理***10的***架构图。如图2A所示,该富媒体信息处理***10包括端侧的终端设备(例如终端设备100、终端设备200等),企业侧业务设备(例如业务终端300或业务服务器400)以及卡片服务器500;还可以包括第三方***。
其中,端侧的各终端设备用于向卡片服务器500上报第一APP(例如短信APP)的富媒体能力集合。卡片服务器500中的富媒体能力库,用于存储各终端设备上报的富媒体能力集合。下面以终端设备100为例进行说明,终端设备100上报的富媒体能力集合1包括一或多种富媒体能力。
工作人员可以通过业务设备(即业务终端300或业务服务器400)向卡片服务器500提交意图下发的富媒体消息(例如富媒体短信)对应的原始富媒体卡片的卡片参数,以及接收侧的终端设备100的设备标识1(例如终端设备100当前的电话号码)。
卡片服务器500中的自适应转换模块,用于基于设备标识1指示的终端设备100上报的富媒体能力集合1,对原始富媒体卡片中的组件进行自适应地能力降级(例如视频组件降级为静态图片组件、跳转至预设APP的能力降级为跳转至浏览器的能力),生成富媒体能力集合1范围内的第一富媒体卡片并存储;卡片服务器500生成并向业务设备反馈第一富媒体卡片的标签(例如短链1)。
业务设备还用于向终端设备100下发包含第一富媒体卡片的标签的富媒体消息。
终端设备100接收到富媒体消息后,可以向卡片服务器500获取上述标签对应的第一富媒体卡片;终端设备100可以通过第一APP显示富媒体能力范围内的第一富媒体卡片。富媒体消息包含文本信息,还可以包含其他格式的信息,此处不作具体限定。
示例性的,业务终端300提交的原始富媒体卡片包括视频组件,该视频组件的显示内容为视频1。终端设备100的富媒体能力集合1包括视频渲染能力时,卡片服务器500基于富媒体能力集合1生成的富媒体卡片包括上述视频组件;终端设备100最终获取并显示图2B的(a)所示的富媒体卡片。终端设备100的富媒体能力集合1不包括视频渲染能力,但包括静态图片的渲染能力时,卡片服务器500基于富媒体能力集合1将上述视频组件降级为静态图片组件,该静态图片组件的显示内容可以为视频1中的一帧图像(即静态图片1);终端设备100最终获取并显示图2B的(b)所示的降级后的富媒体卡片。
在一些实施例中,上述第一APP为短信APP,上述富媒体消息为包含上述标签的富媒体短信,业务终端300通过第三方***向终端设备100下发富媒体短信。
本申请实施例中,终端设备的设备标识可以包括用户身份标识(identity,ID)和/或设备ID。用户ID可以为电话号码或第一APP登录的账号。设备ID可以包括以下一或多项:移动设备国际识别码(International Mobile Equipment Identity,IMEI)、移动设备识别码(Mobile Equipment Identifier,MEID)、唯一设备标识码(Unique Device Identifier,UDID)、通用唯一识别码(Universally Unique Identifier,UUID)、广告标识符(Identifier For Advertising,IDFA)、开放匿名设备标识符(Open Anonymous Device Identifier,OAID)。
后续实施例以“第一APP为短信APP,富媒体消息为富媒体短信,终端设备的设备标识为电话号码”为例,对本申请实施例提供的富媒体信息处理方法进行介绍。
本申请实施例中,富媒体信息处理***10中的设备可以通过一个或多个通信网络500进行通信。通信网络500可以包括局域网(local area networks,LAN),广域网(wide area networks,WAN),例如互联网。该通信网络500可使用任何已知的网络通信协议来实现,上述网络通信协议可以是各种有线或无线通信协议,诸如以太网、通用串行总线(universal serial bus,USB)、火线(FIREWIRE)、全球移动通讯***(global system for mobile communications,GSM)、通用分组无线服务(general packet radio service,GPRS)、码分多址接入(code division multiple access,CDMA)、宽带码分多址(wideband code division multiple access,WCDMA),时分码分多址(time-division code division multiple access,TD-SCDMA),长期演进(long term evolution,LTE)、蓝牙、无线保真(wireless fidelity,Wi-Fi)、NFC、基于互联网协议的语音通话(voice over Internet protocol,VoIP)、支持网络切片架构的通信协议或任何其他合适的通信协议,此处不作具体限定。
富媒体信息处理***10中的设备可以部署在陆地上,包括室内、室外、手持或车载,也可以部署在水面上,还可以部署在空中的飞机和人造卫星上,本申请实施例对此均不做限定。
应当理解,图2A仅仅为本申请实施例提供的富媒体信息处理***10的***结构示意图,并不构成对富媒体信息处理***10的具体限定,富媒体信息处理***10可以包括比图示更多或更少的设备,例如,还可以包括无线中继设备和无线回传设备(图2A中未示出),在此不做限定。
下面以终端设备100为例,介绍本申请实施例提供的终端设备的结构。
图3示出了终端设备100的结构示意图。终端设备100可以是手机、平板电脑、桌面型计算机、膝上型计算机、手持计算机、笔记本电脑、超级移动个人计算机(ultra-mobile personal computer,UMPC)、上网本,以及蜂窝电话、个人数字助理(personal digital assistant,PDA)、增强现实(augmented reality,AR)设备、虚拟现实(virtual reality,VR)设备、人工智能(artificial intelligence,AI)设备、可穿戴式设备、车载设备、智能家居设备和/或智慧城市设备,本申请实施例对该终端设备的具体类型不作特殊限制。终端设备可以搭载iOS、Android、Microsoft或者其它操作***,此处不作具体限定。
终端设备100可以包括处理器110,外部存储器接口120,内部存储器121,通用串行总线(universal serial bus,USB)接口130,充电管理模块140,电源管理模块141,电池142,天线1,天线2,移动通信模块150,无线通信模块160,音频模块170,扬声器170A,受话器170B,麦克风170C,耳机接口170D,传感器模块180,按键190,马达191,指示器192,摄像头193,显示屏194,以及用户标识模块(subscriber identification module,SIM)卡接口195等。其中传感器模块180可以包括压力传感器180A,陀螺仪传感器180B,气压传感器180C,磁传感器180D,加速度传感器180E,距离传感器180F,接近光传感器180G,指纹
传感器180H,温度传感器180J,触摸传感器180K,环境光传感器180L,骨传导传感器180M等。
可以理解的是,本发明实施例示意的结构并不构成对终端设备100的具体限定。在本申请另一些实施例中,终端设备100可以包括比图示更多或更少的部件,或者组合某些部件,或者拆分某些部件,或者不同的部件布置。图示的部件可以以硬件,软件或软件和硬件的组合实现。
处理器110可以包括一个或多个处理单元,例如:处理器110可以包括应用处理器(application processor,AP),调制解调处理器,图形处理器(graphics processing unit,GPU),图像信号处理器(image signal processor,ISP),控制器,视频编解码器,数字信号处理器(digital signal processor,DSP),基带处理器,和/或神经网络处理器(neural-network processing unit,NPU)等。其中,不同的处理单元可以是独立的器件,也可以集成在一个或多个处理器中。
控制器可以根据指令操作码和时序信号,产生操作控制信号,完成取指令和执行指令的控制。
处理器110中还可以设置存储器,用于存储指令和数据。在一些实施例中,处理器110中的存储器为高速缓冲存储器。该存储器可以保存处理器110刚用过或循环使用的指令或数据。如果处理器110需要再次使用该指令或数据,可从所述存储器中直接调用。避免了重复存取,减少了处理器110的等待时间,因而提高了***的效率。
在一些实施例中,处理器110可以包括一个或多个接口。接口可以包括集成电路(inter-integrated circuit,I2C)接口,集成电路内置音频(inter-integrated circuit sound,I2S)接口,脉冲编码调制(pulse code modulation,PCM)接口,通用异步收发传输器(universal asynchronous receiver/transmitter,UART)接口,移动产业处理器接口(mobile industry processor interface,MIPI),通用输入输出(general-purpose input/output,GPIO)接口,用户标识模块(subscriber identity module,SIM)接口,和/或通用串行总线(universal serial bus,USB)接口等。
充电管理模块140用于从充电器接收充电输入。其中,充电器可以是无线充电器,也可以是有线充电器。在一些有线充电的实施例中,充电管理模块140可以通过USB接口130接收有线充电器的充电输入。在一些无线充电的实施例中,充电管理模块140可以通过终端设备100的无线充电线圈接收无线充电输入。充电管理模块140为电池142充电的同时,还可以通过电源管理模块141为终端设备供电。
电源管理模块141用于连接电池142,充电管理模块140与处理器110。电源管理模块141接收电池142和/或充电管理模块140的输入,为处理器110,内部存储器121,显示屏194,摄像头193,和无线通信模块160等供电。电源管理模块141还可以用于监测电池容量,电池循环次数,电池健康状态(漏电,阻抗)等参数。在其他一些实施例中,电源管理模块141也可以设置于处理器110中。在另一些实施例中,电源管理模块141和充电管理模块140也可以设置于同一个器件中。
终端设备100的无线通信功能可以通过天线1,天线2,移动通信模块150,无线通信模块160,调制解调处理器以及基带处理器等实现。
天线1和天线2用于发射和接收电磁波信号。终端设备100中的每个天线可用于覆盖单个或多个通信频带。不同的天线还可以复用,以提高天线的利用率。例如:可以将天线1复用为无线局域网的分集天线。在另外一些实施例中,天线可以和调谐开关结合使用。
移动通信模块150可以提供应用在终端设备100上的包括2G/3G/4G/5G等无线通信的解
决方案。移动通信模块150可以包括至少一个滤波器,开关,功率放大器,低噪声放大器(low noise amplifier,LNA)等。移动通信模块150可以由天线1接收电磁波,并对接收的电磁波进行滤波,放大等处理,传送至调制解调处理器进行解调。移动通信模块150还可以对经调制解调处理器调制后的信号放大,经天线1转为电磁波辐射出去。在一些实施例中,移动通信模块150的至少部分功能模块可以被设置于处理器110中。在一些实施例中,移动通信模块150的至少部分功能模块可以与处理器110的至少部分模块被设置在同一个器件中。
调制解调处理器可以包括调制器和解调器。其中,调制器用于将待发送的低频基带信号调制成中高频信号。解调器用于将接收的电磁波信号解调为低频基带信号。随后解调器将解调得到的低频基带信号传送至基带处理器处理。低频基带信号经基带处理器处理后,被传递给应用处理器。应用处理器通过音频设备(不限于扬声器170A,受话器170B等)输出声音信号,或通过显示屏194显示图像或视频。在一些实施例中,调制解调处理器可以是独立的器件。在另一些实施例中,调制解调处理器可以独立于处理器110,与移动通信模块150或其他功能模块设置在同一个器件中。
无线通信模块160可以提供应用在终端设备100上的包括无线局域网(wireless local area networks,WLAN)(如无线保真(wireless fidelity,Wi-Fi)网络),蓝牙(bluetooth,BT),全球导航卫星***(global navigation satellite system,GNSS),调频(frequency modulation,FM),近距离无线通信技术(near field communication,NFC),红外技术(infrared,IR)等无线通信的解决方案。无线通信模块160可以是集成至少一个通信处理模块的一个或多个器件。无线通信模块160经由天线2接收电磁波,将电磁波信号解调以及滤波处理,将处理后的信号发送到处理器110。无线通信模块160还可以从处理器110接收待发送的信号,对其进行调频,放大,经天线2转为电磁波辐射出去。
在一些实施例中,终端设备100的天线1和移动通信模块150耦合,天线2和无线通信模块160耦合,使得终端设备100可以通过无线通信技术与网络以及其他设备通信。所述无线通信技术可以包括全球移动通讯***(global system for mobile communications,GSM),通用分组无线服务(general packet radio service,GPRS),码分多址接入(code division multiple access,CDMA),宽带码分多址(wideband code division multiple access,WCDMA),时分码分多址(time-division code division multiple access,TD-SCDMA),长期演进(long term evolution,LTE),BT,GNSS,WLAN,NFC,FM,和/或IR技术等。所述GNSS可以包括全球卫星定位***(global positioning system,GPS),全球导航卫星***(global navigation satellite system,GLONASS),北斗卫星导航***(beidou navigation satellite system,BDS),准天顶卫星***(quasi-zenith satellite system,QZSS)和/或星基增强***(satellite based augmentation systems,SBAS)。
终端设备100通过GPU,显示屏194,以及应用处理器等实现显示功能。例如,在显示屏194上显示主界面、短信APP的用户界面、其他第三方APP的用户界面等,以及在短信应用的用户界面上显示本申请实施例涉及的富媒体短信关联的富媒体卡片。GPU为图像处理的微处理器,连接显示屏194和应用处理器。GPU用于执行数学和几何计算,用于图形渲染。处理器110可包括一个或多个GPU,其执行程序指令以生成或改变显示信息。例如,终端设备100的移动通信模块从卡片服务器400接收富媒体卡片的卡片数据,传递给处理器110中的GPU,GPU基于卡片数据等进行图形渲染,生成待显示的富媒体卡片。
显示屏194用于显示图像,视频等。显示屏194包括显示面板。显示面板可以采用液晶
显示屏(liquid crystal display,LCD),有机发光二极管(organic light-emitting diode,OLED),有源矩阵有机发光二极体或主动矩阵有机发光二极体(active-matrix organic light emitting diode的,AMOLED),柔性发光二极管(flex light-emitting diode,FLED),Miniled,MicroLed,Micro-oLed,量子点发光二极管(quantum dot light emitting diodes,QLED)等。在一些实施例中,终端设备100可以包括1个或N个显示屏194,N为大于1的正整数。
终端设备100可以通过ISP,摄像头193,视频编解码器,GPU,显示屏194以及应用处理器等实现拍摄功能。
ISP用于处理摄像头193反馈的数据。例如,拍照时,打开快门,光线通过镜头被传递到摄像头感光元件上,光信号转换为电信号,摄像头感光元件将所述电信号传递给ISP处理,转化为肉眼可见的图像。ISP还可以对图像的噪点,亮度进行算法优化。ISP还可以对拍摄场景的曝光,色温等参数优化。在一些实施例中,ISP可以设置在摄像头193中。
摄像头193用于捕获静态图像或视频。物体通过镜头生成光学图像投射到感光元件。感光元件可以是电荷耦合器件(charge coupled device,CCD)或互补金属氧化物半导体(complementary metal-oxide-semiconductor,CMOS)光电晶体管。感光元件把光信号转换成电信号,之后将电信号传递给ISP转换成数字图像信号。ISP将数字图像信号输出到DSP加工处理。DSP将数字图像信号转换成标准的RGB,YUV等格式的图像信号。在一些实施例中,终端设备100可以包括1个或N个摄像头193,N为大于1的正整数。
数字信号处理器用于处理数字信号,除了可以处理数字图像信号,还可以处理其他数字信号。例如,当终端设备100在频点选择时,数字信号处理器用于对频点能量进行傅里叶变换等。
视频编解码器用于对数字视频压缩或解压缩。终端设备100可以支持一种或多种视频编解码器。这样,终端设备100可以播放或录制多种编码格式的视频,例如:动态图像专家组(moving picture experts group,MPEG)1,MPEG2,MPEG3,MPEG4等。
NPU为神经网络(neural-network,NN)计算处理器,通过借鉴生物神经网络结构,例如借鉴人脑神经元之间传递模式,对输入信息快速处理,还可以不断的自学习。通过NPU可以实现终端设备100的智能认知等应用,例如:图像识别,人脸识别,语音识别,文本理解等。
内部存储器121可以包括一个或多个随机存取存储器(random access memory,RAM)和一个或多个非易失性存储器(non-volatile memory,NVM)。
随机存取存储器可以包括静态随机存储器(static random-access memory,SRAM)、动态随机存储器(dynamic random access memory,DRAM)、同步动态随机存储器(synchronous dynamic random access memory,SDRAM)、双倍资料率同步动态随机存取存储器(double data rate synchronous dynamic random access memory,DDR SDRAM,例如第五代DDR SDRAM一般称为DDR5SDRAM)等;非易失性存储器可以包括磁盘存储器件、快闪存储器(flash memory)。
快闪存储器按照运作原理划分可以包括NOR FLASH、NAND FLASH、3D NAND FLASH等,按照存储单元电位阶数划分可以包括单阶存储单元(single-level cell,SLC)、多阶存储单元(multi-level cell,MLC)、三阶储存单元(triple-level cell,TLC)、四阶储存单元(quad-level cell,QLC)等,按照存储规范划分可以包括通用闪存存储(英文:universal flash storage,UFS)、嵌入式多媒体存储卡(embedded multi media Card,eMMC)等。
随机存取存储器可以由处理器110直接进行读写,可以用于存储操作***或其他正在运
行中的程序的可执行程序(例如机器指令),还可以用于存储用户及应用程序的数据等。
非易失性存储器也可以存储可执行程序和存储用户及应用程序的数据等,可以提前加载到随机存取存储器中,用于处理器110直接进行读写。
外部存储器接口120可以用于连接外部的非易失性存储器,实现扩展终端设备100的存储能力。外部的非易失性存储器通过外部存储器接口120与处理器110通信,实现数据存储功能。例如将音乐,视频等文件保存在外部的非易失性存储器中。
终端设备100可以通过音频模块170,扬声器170A,受话器170B,麦克风170C,耳机接口170D,以及应用处理器等实现音频功能。例如音乐播放,录音等。
音频模块170用于将数字音频信息转换成模拟音频信号输出,也用于将模拟音频输入转换为数字音频信号。音频模块170还可以用于对音频信号编码和解码。在一些实施例中,音频模块170可以设置于处理器110中,或将音频模块170的部分功能模块设置于处理器110中。
扬声器170A,也称“喇叭”,用于将音频电信号转换为声音信号。
受话器170B,也称“听筒”,用于将音频电信号转换成声音信号。
麦克风170C,也称“话筒”,“传声器”,用于将声音信号转换为电信号。
耳机接口170D用于连接有线耳机。
压力传感器180A用于感受压力信号,可以将压力信号转换成电信号。在一些实施例中,压力传感器180A可以设置于显示屏194。压力传感器180A的种类很多,如电阻式压力传感器,电感式压力传感器,电容式压力传感器等。
陀螺仪传感器180B可以用于确定终端设备100的运动姿态。在一些实施例中,可以通过陀螺仪传感器180B确定终端设备100围绕三个轴(即,x,y和z轴)的角速度。
气压传感器180C用于测量气压。
磁传感器180D包括霍尔传感器。
加速度传感器180E可检测终端设备100在各个方向上(一般为三轴)加速度的大小。当终端设备100静止时可检测出重力的大小及方向。还可以用于识别终端设备的姿态。
距离传感器180F,用于测量距离。终端设备100可以通过红外或激光测量距离。
接近光传感器180G可以包括例如发光二极管(LED)和光检测器,例如光电二极管。
环境光传感器180L用于感知环境光亮度。终端设备100可以根据感知的环境光亮度自适应调节显示屏194亮度。
指纹传感器180H用于采集指纹。
温度传感器180J用于检测温度。在一些实施例中,终端设备100利用温度传感器180J检测的温度,执行温度处理策略。
触摸传感器180K,也称“触控器件”。触摸传感器180K可以设置于显示屏194,由触摸传感器180K与显示屏194组成触摸屏,也称“触控屏”。触摸传感器180K用于检测作用于其上或附近的触摸操作。触摸传感器可以将检测到的触摸操作传递给应用处理器,以确定触摸事件类型。可以通过显示屏194提供与触摸操作相关的视觉输出。在另一些实施例中,触摸传感器180K也可以设置于终端设备100的表面,与显示屏194所处的位置不同。
骨传导传感器180M可以获取振动信号。在一些实施例中,骨传导传感器180M可以获取人体声部振动骨块的振动信号。
按键190包括开机键,音量键等。按键190可以是机械按键。也可以是触摸式按键。终
端设备100可以接收按键输入,产生与终端设备100的用户设置以及功能控制有关的键信号输入。
基于前述富媒体信息处理***和终端设备的结构,下面对本申请实施例提供的富媒体信息处理方法进行详细介绍。
本申请实施例提供的富媒体信息处理方法中,终端设备100向卡片服务器500上报短信APP的富媒体能力集合1;卡片服务器500收到业务设备提交的富媒体短信关联的原始富媒体卡片的卡片参数和终端设备100的设备标识后,依据终端设备100上报的富媒体能力集合1和上述卡片参数,生成短信APP的富媒体能力范围内的第一富媒体卡片,并向业务设备发送第一富媒体卡片的标签;业务设备向终端设备100下发包含上述标签的富媒体短信;终端设备100基于上述标签向卡片服务器500获取第一富媒体卡片,并在短信APP显示第一富媒体卡片。实施本申请实施例,终端设备100的短信APP仅支持原始富媒体卡片所需的部分富媒体能力时,卡片服务器500可以依据终端设备100的富媒体能力集合1,将原始富媒体卡片自适应地降级为富媒体能力集合1范围内的富媒体卡片;这样,终端设备100就能在短信APP中显示上述富媒体卡片以及支持上述富媒体卡片的所有交互功能,有效提高了用户体验。
示例性的,图4A示出了一种富媒体信息处理方法的流程示意图,该富媒体信息处理方法包括但不限于步骤S101至步骤S108。
S101、终端设备100向卡片服务器500上报短信APP的富媒体能力集合1,卡片服务器500接收终端设备100上报的富媒体能力集合1,并存储在富媒体能力库中。
本申请实施例中,短信APP的富媒体能力可以包括渲染富媒体卡片内指定组件的能力(可简称为组件渲染能力),以及实现富媒体卡片内的指定交互功能的能力(可简称为交互能力)。
本申请实施例中,上述指定组件包括但不限于静态图片、动态图片、视频、横划图片、轮播图片、投票表单、按钮等。其中,动态图片包括一组特定的静态图像以指定频率切换而产生某种动态效果的图片,视觉效果上类似于视频,例如Gif动图。横划图片包括用于在指定区域显示的多张依序排列的静态图片,在同一时刻上述指定区域只能显示一张图片;用户通过左右滑动上述指定区域显示的图片,可以查看上述多张依序排列的图片中的其他图片。轮播图片包括在指定区域自动以指定频率依序显示的多张图片。投票表单可以包括投票标题和至少两个投票选项,用户可以选择上述至少两个投票选项中的至少一个选项,进行投票。
示例性的,图4B示出了一种富媒体卡片,富媒体卡片中组件1为横划图片,组件1的显示内容包括多张图片;组件1的显示区域包括图片指示符305,图片指示符305可用于指示组件1当前显示的是上述多张图片中的哪一张图片;如图4B所示,组件1可以接收用户横向滑动操作,响应于上述横向滑动操作,终端设备100可以显示组件1的其他图片。示例性的,图4C示出了另一种富媒体卡片,富媒体卡片中组件1为投票表单,组件1的显示内容包括投票标题和三个投票选项(例如投票选项1);投票选项1可以接收用户的输入操作(例如触摸操作),响应于上述输入操作,终端设备100可以显示各投票选项对应的投票数量。
在一些实施例中,每个APP都设置有渲染模块(例如短信APP的渲染模块1),且渲染模块设置有该APP的组件渲染能力;当渲染模块设置有指定组件的组件渲染能力时,该APP才能调用CPU和/或GPU绘制渲染上述指定组件(例如视频),该APP才能实现上述指定组件的相关业务(例如显示和播放视频)。
可以理解,短信APP是否具备指定组件的渲染能力,取决于短信APP的渲染模块是否
设置有上述指定组件的渲染能力。同一终端设备的不同APP设置的组件渲染能力可能不同;例如,若终端设备100的相册APP具备视频的渲染能力,短信APP不具备视频的绘制渲染能力,则相册APP可以显示和播放视频,而短信APP不能显示和播放视频。同一APP的不同版本具备的组件渲染能力也可能不同;例如,若终端设备100的短信APP的当前版本不具备视频的渲染能力,新版本具备视频的渲染能力,则短信APP当前不能显示和播放视频,而短信APP更新后可以显示和播放视频。
本申请实施例中,响应于针对富媒体卡片的指定组件的输入操作,实现的交互能力可以包括:从短信APP跳转至指定APP的跳转能力(例如跳转至浏览器的能力、跳转至预设APP的能力、跳转至电话APP拨打电话的能力、跳转至地图APP定位导航的能力、跳转至原生APP分享富媒体卡片),从短信APP跳转至快应用(例如跳转至地图快应用定位导航)的跳转能力2,以及从短信APP的当前页面(即短信APP的activity 1)跳转至短信APP的其他页面回复短信(即短信APP的activity2)的跳转能力3。上述预设APP指浏览器之外的具备网页版的原生APP,可以理解,用户可以通过浏览器在线查看预设APP的网页版。
需要说明的是,通常满足如下条件“短信APP设置有用于跳转至其他APP的底层业务模块(简称为跳转模块1),APP 1设置用于其他APP调用本APP的底层业务模块(简称为跳转模块2),且终端设备安装有APP1”时,短信APP才具备跳转至APP1的能力。其中,跳转模块1和跳转模块2可以是同一个模块,也可以是不同模块;一个APP可以具备跳转模块1和/或跳转模块2。
在一种实现方式中,在上述条件基础上,APP 1的跳转白名单中包括短信APP时,短信APP才具备跳转至APP 1的跳转能力。需要说明的是,为实现APP间的跳转,APP 1可以向操作***注册一个URL scheme(协议),该scheme用于在其他APP中启动本应用,该scheme设置有跳转白名单,跳转白名单用于指示哪些APP可以启动本应用。
在一种实现方式中,在上述条件基础上,针对跳转至指定APP实现特定交互功能的交互能力(例如跳转至电话APP拨打电话的能力、跳转至地图APP定位导航的能力或者跳转至其他APP分享富媒体卡片),短信APP设置有上述特定交互功能对应的业务逻辑时,短信APP才能具备上述交互能力。
需要说明的是,在一些示例中,短信APP具备跳转至浏览器的能力和跳转至预设APP(例如购物APP)的能力。在一些示例中,短信APP不具备跳转至预设APP(例如购物APP)的能力,但具备跳转至浏览器的能力,短信APP可以通过浏览器跳转至购物APP的网页版。
可以理解,终端设备100可以通过短信APP启动APP1,跳转至APP1的主页面。终端设备100也可以通过短信APP启动APP1,并跳转至APP1的指定页面(即指定activity)。例如,APP 1为购物APP,上述指定页面可以为商品详情页、订单详情页、消息通知页、订单支付页面等。
在一些实施例中,终端设备100设置有快应用中心,快应用中心可以包括多个快应用;当快应用中心包括快应用1,且短信APP设置有调用快应用的底层业务模块时,短信APP才具备跳转至快应用1的跳转能力。
在一些实施例中,当短信APP设置有用于上述跳转能力3的底层业务模块时,该APP才能具备从短信APP的当前页面跳转至短信APP的其他页面回复短信的能力。
本申请实施例中,当终端设备100的短信APP的富媒体能力有变化时,终端设备100可以向卡片服务器500上报最新的富媒体能力;或者,终端设备100可以定期向卡片服务器500
上报最新的富媒体能力;这样,便于卡片服务器500及时更新富媒体能力库中终端设备100的短信APP的富媒体能力集合1。可以理解,富媒体能力库中存储有终端设备100的设备标识1和终端设备100上报的富媒体能力集合的对应关系。
本申请实施例中,终端设备100的短信APP可以向卡片服务器500注册富媒体卡片服务,并通过注册接口或能力上报接口上报富媒体能力集合1。可以理解,注册富媒体卡片服务后,卡片服务器500才会存储终端设备100的富媒体能力集合,以及基于终端设备100的富媒体能力集合生成富媒体能力范围内的富媒体卡片。
在一些实施例中,终端设备100的短信APP向卡片服务器500发送注册请求,上述注册请求用于请求注册富媒体卡片服务和上报富媒体能力,上述注册请求可以包括用户ID(例如电话号码1),还可以包括第一信息,第一信息用于指示终端设备100的短信APP所具备的富媒体能力集合1;卡片服务器500可以在富媒体能力库存储电话号码1和富媒体能力集合1的对应关系。在一种实现方式中,上述注册请求还包括设备ID(例如UDID),卡片服务器50存储终端设备100的电话号码1和设备ID的对应关系;后续终端设备100向卡片服务器500上报更新后的富媒体能力集合,可以仅携带设备ID。
在一些实施例中,终端设备100的短信APP向卡片服务器500发送注册请求,上述注册请求仅用于请求注册富媒体卡片服务,上述注册请求可以携带用户ID(例如电话号码1)和设备ID(例如UDID);然后,终端设备100的短信APP再通过注册接口或能力上报接口向卡片服务器500发送第一信息和设备ID;卡片服务器500确定设备ID对应的电话号码1,并可以在富媒体能力库存储电话号码1和富媒体能力集合1的对应关系。在一种实现方式中,注册请求和上报信息也可以均携带电话号码,不携带设备ID。此处不作具体限定。
在一种实现方式中,终端设备100发送的第一信息具体包括短信APP所具备的每种富媒体能力的标识(例如名称、编号等)。卡片服务器500根据终端设备100发送的第一信息中的标识1,可以确定终端设备100的短信APP具备标识1对应的富媒体能力。示例性的,表1示出了两种富媒体能力集合(即能力集合1,能力集合2)。例如,终端设备100上报的第一信息具体包括能力集合2中各富媒体能力的标识,即静态图片的标识和跳转浏览器的标识。
表1
在一种实现方式中,预设多个能力版本号,每个能力版本号对应一种能力集合。终端设备100上报的第一信息具体包括能力版本号。卡片服务器500预存有各能力版本号和能力集合的对应关系,卡片服务器500基于终端设备100上报的能力版本号,确定该能力版本号对应的能力集合即为终端设备100的短信APP具备的富媒体能力集合。示例性的,表2示出了两种能力版本号和能力集合的对应关系。
表2
本申请实施例中,卡片服务器500可以在富媒体能力库中存储终端设备100的设备标识1和富媒体能力集合1的对应关系;也可以为了节省存储空间,仅存储设备标识1和能力版本号的对应关系,此处不作具体限定。
S102、业务设备向卡片服务器500发送原始富媒体卡片的卡片参数和终端设备100的设备标识1,卡片服务器500接收业务设备发送的卡片参数和设备标识1。
在一些实施例中,业务设备(例如前述业务终端300或业务服务器400)可以选择一种预设的富媒体卡片模板,并向卡片服务器500发送该富媒体卡片模板对应的卡片参数。本申请实施例中,富媒体卡片模板可以用于指示富媒体卡片的卡片布局,卡片布局可以包括:卡片形状、卡片尺寸和卡片颜色中的部分或全部,还可以包括富媒体卡片模板包括的所有组件(例如组件1)的组件标识、组件名称、组件尺寸、组件类型、组件形状和组件位置中的部分或全部。
上述富媒体卡片模板对应的卡片参数可以包括:富媒体卡片模块的模块ID,富媒体卡片模块包含的各组件对应的组件参数。本申请实施例中,卡片服务器500基于模块ID可以获取相应的富媒体卡片模块。在一种实现方式中,卡片服务器500可以获取富媒体模块库,以及在富媒体模块库获取指定模块ID对应的富媒体卡片模块。
以组件1为例,组件1的组件参数可以包括:组件1在富媒体卡片模块中的组件名称(例如ID、名称等)、显示内容,还可以包括组件1关联的至少一个URL连接。
在一些实施例中,业务设备发送的组件1(例如静态图片)的显示内容可以为该组件的显示数据(例如静态图片的图片数据)、也可以是该组件的显示数据的下载地址(例如URL连接)。
参考图1D和图1E,富媒体卡片中的组件1(即图1D所示的文本402)关联一个URL链接时,组件1可以接收用户的输入操作,响应于上述输入操作,跳转至组件1关联的URL链接指示的页面(即1E所示的浏览器APP中的页面)。
在一些实施例中,组件1可以关联多个URL链接,上述多个URL链接可以包括以下一或多个:跳转至预设APP 1的URL链接、跳转至快应用1的URL链接、跳转至浏览器的URL链接等。组件1的组件参数还可以包括指示信息2,指示信息2用于指示上述多个URL链接中优先使用的URL链接1。后续实施例中,卡片服务器500可以基于终端设备100上报的富媒体能力,确定最终生成的第一富媒体卡片中组件1关联上述多个URL链接中的哪个URL链接,此处不再赘述。
在一些实施例中,业务服务器400具备业务输入模块(例如显示屏、键盘和/或鼠标),
工作人员可以通过业务服务器400向卡片服务器500提交意图下发的富媒体短信对应的原始富媒体卡片的卡片参数和目标接收端的设备标识(例如终端设备100的设备标识1)。
在一些实施例中,工作人员可以通过业务终端300向卡片服务器500提交上述卡片参数和目标接收端的设备标识。
具体的,在一种实现方式中,工作人员可以在业务终端300登录卡片服务器500提供的富媒体短信编辑***,富媒体短信编辑***可以提供多种富媒体卡片模板;工作人员可以选择所需的富媒体卡片模块,并编辑该富媒体卡片模块内各组件的组件参数;最后,通过富媒体短信编辑***向卡片服务器500提交卡片参数(例如富媒体卡片模块1的模板ID和富媒体卡片模块1内各组件的组件参数)和目标接收端的设备标识(例如终端设备100的设备标识1)。
示例性的,图5A至图5E示出了在业务终端300中选择和编辑富媒体卡片模板的相关用户界面。
示例性的,工作人员在业务终端300登录富媒体短信编辑***后,调用富媒体短信编辑***提供的富媒体卡片模板库,业务终端300显示图5A所示的用户界面21。如图5A所示,用户界面21包括多个富媒体卡片模板(例如富媒体卡片模板201),以及各富媒体卡片模板的模板ID(例如富媒体卡片模板201的模板ID 202)。富媒体卡片模板201包括1个视频组件、2个文本组件和2个静态图片组件。
如图5A所示,在一种实现方式中,用户界面21还可以包括搜索框403、组件分类选项404和排序选项405中的一个或多个。
其中,搜索框403用于接收用户输入的模板ID或关键词,业务终端300可以获取搜索框403中的模板ID或关键词对应的富媒体卡片模板,并显示在用户界面21中。组件分类选项404包括多种组件选项,例如,静态图片选项404A、动态图片选项、视频选项404B等;用户可以选择组件分类选项404中的一或多个组件选项(例如选项404A和选项404B),业务终端300在用户界面21中仅显示包括上述一或多个组件选项的富媒体卡片模板。排序选项405包括多种排序方式的选项,例如,综合排序选项405A、最多使用的排序选项、最新上传的排序选项。示例性的,如图5A所示,排序选项405中综合排序选项405A被选中时,用户界面21中富媒体卡片模板的排序方式为综合排序。
如图5A所示和图5B所示,富媒体卡片模板201可以接收用户的输入操作(例如点击操作),响应于上述输入操作,终端设备100显示图5B所示的用户界面22,用户界面22用于编辑富媒体卡片模板201的组件参数。用户界面22可以包括富媒体卡片模板201的各组件的编辑区域、提交控件406、预览卡片407。提交控件406用于向富媒体短信编辑***提交用户编辑的富媒体卡片模板201的组件参数。预览卡片407用于根据用户编辑的富媒体卡片模板201的组件参数展示富媒体卡片的显示效果。
以富媒体卡片模板201中的视频组件1为例,用户界面22中视频组件1的编辑区域包括显示内容的地址框408和/或添加控件409,还可以包括跳转链接框410、视频尺寸411、视频大小412。其中,地址框408用于输入视频组件1的显示内容的URL链接1,URL链接1指示了视频文件的下载地址。本申请实施例中,卡片服务器500和/或终端设备100可以基于URL链接1获取上述视频文件。添加控件409用于添加本地的视频文件。用户通过地址框408或添加控件409上传视频后,视频尺寸411用于指示用户上传的视频的显示尺寸,视频大小412用于指示用户上传的视频的信息量。参见图5B,用户上传视频前,视频大小412还可以
指示可上传的视频的最大信息量(例如100兆(M))。跳转链接框410用于输入视频组件1关联的用于页面跳转的URL链接2;例如URL链接2指示了APP 1的用户界面1的地址。
示例性的,添加控件409可以接收用户的输入操作(例如触摸操作),响应于上述输入操作,业务终端300可以显示图5C所示的本地文件的选择框413,用户可以通过选择框413查找和选择所需的视频文件。如图5D所示,用户通过选择框413选择所需的视频文件后,业务终端300显示该视频文件的名称414和/或图标415,在视频尺寸409中显示该视频文件的视频尺寸,在视频大小412中显示该视频文件的信息量,在预览卡片407的视频组件1的显示区域显示上述视频文件的视频封面和播放控件。如图5E所示,用户编辑完各组件的组件参数后,预览卡片407展示用户所需的原始富媒体卡片的显示效果。
在一些实施例中,富媒体短信编辑***还提供富媒体卡片模板的自定义功能,工作人员可以通过上述自定义功能,设计专属的富媒体卡片模板,例如自定义卡片颜色、卡片中各组件的位置等等,此处不作具体限定。
S103、基于设备标识1,卡片服务器500确定终端设备100上报的富媒体能力集合1,并基于富媒体能力集合1和上述卡片参数,生成富媒体能力集合1范围内的第一富媒体卡片,以及第一富媒体卡片的第一标签。
卡片服务器500收到设备标识1和卡片参数后,在富媒体能力库中,查询到设备标识1对应的富媒体能力集合1;基于上述卡片参数,确定业务设备所需的原始富媒体卡片的各组件所需的富媒体能力。当富媒体能力集合1不包括原始富媒体卡片的组件1所需的富媒体能力1时,可以基于预设的能力降级关系对该组件进行自适应地能力降级;对原始富媒体卡片的各组件进行自适应降级后,卡片服务器500生成富媒体能力集合1范围内的第一富媒体卡片,以及第一富媒体卡片的第一标签,并存储第一标签和第一富媒体卡片的对应关系。该标签可以是卡片ID、卡片名称或短链,此处不作具体限定。
在一种实现方式中,卡片服务器500基于卡片参数中各组件的组件类型,可以确定所需的组件渲染能力。例如,基于卡片参数确定原始富媒体卡片包括视频组件1,该视频组件需要视频渲染能力。卡片服务器500基于卡片参数中各组件关联的跳转链接,可以确定该组件所需的交互能力。例如,基于卡片参数确定原始富媒体卡片中的组件1的跳转链接为URL链接1,卡片服务器500解析URL链接1,确定URL链接1用于跳转至预设APP 1,进而确定组件1需要跳转至预设APP 1的能力。例如,基于卡片参数确定原始富媒体卡片中的组件1的跳转链接包括多个URL链接,且多个URL链接中优先使用的URL链接为URL链接1;卡片服务器500确定URL链接1用于跳转至预设APP 1,进而确定组件1需要跳转至预设APP 1的能力。
示例性的,表3示出了本申请实施例提供的一些能力降级关系,如表3所示,富媒体能力A可以降级至富媒体能力B。如表3所示,富媒体能力A为空,指富媒体能力A不能降级为其他富媒体能力。
表3
在一些实施例中,参考表3,基于预设的能力降级关系,确定富媒体能力1可以降级为富媒体能力2。当富媒体能力集合1不包括富媒体能力1,但包括富媒体能力2时,将组件1的富媒体能力1降级为富媒体能力2。示例性的,参见表3,动态图片、横划图片和视频的渲染能力均可以降级为静态图片的渲染能力。
需要说明的是,若组件1的富媒体能力1为组件渲染能力,富媒体能力1(例如视频渲染能力)降级为静态图片的渲染能力时,该组件的组件类型由视频组件降级为图片组件,该组件降级后的显示内容为组件1的显示内容(即视频)中的一帧静态图像。若组件1的富媒体能力1为轮播图片的渲染能力,轮播图片的渲染能力降级为横划图片的渲染能力时,该组件的组件类型由轮播图片组件降级为横划图片组件,该组件降级后的显示内容不变,该组件对应的多张图片的显示方式由轮播显示变成横划显示。
需要说明的是,若组件1的富媒体能力1为跳转至预设APP(例如购物APP)的转能力,基于预设的能力降级关系,确定富媒体能力1可以降级为富媒体能力2(例如跳转至浏览器的能力)。当富媒体能力集合1不包括富媒体能力1,但包括富媒体能力2,且组件1关联的跳转链接包括富媒体能力2的URL链接(例如跳转至浏览器的URL链接)时,才能将组件1的富媒体能力1降级为富媒体能力2,并可以删除富媒体能力1的URL链接(例如跳转至预设APP的URL链接)。
在一些实施例中,参考表3,基于预设的能力降级关系,确定富媒体能力1可以降级为富媒体能力2,富媒体能力2可以降级为富媒体能力3。当富媒体能力集合1不包括富媒体能力1和富媒体能力2,但包括富媒体能力3时,将组件1的富媒体能力1降级为富媒体能力3。以此类推,基于预设的能力降级关系,可以将富媒体能力1依序进行多次降级。示例性的,参见表3,轮播图片的渲染能力可以降级为横划图片的渲染能力,横划图片的渲染能力可以降级为静态图片的渲染能力。
需要说明的是,当基于预设的能力降级关系,确定富媒体能力1最终可以降级为富媒体能力2,且富媒体能力集合1不包括富媒体能力2时,将富媒体能力1继续降级为空。示例性的,参见表3,轮播图片的渲染能力可以降级为横划图片的渲染能力,横划图片的渲染能力可以降级为静态图片的渲染能力;当富媒体能力集合1不包括横划图片的渲染能力和静态图片的渲染能力时,组件1的轮播图片的渲染能力最终降级为空。
在一些实施例中,参考表3,组件1的富媒体能力1为组件渲染能力(例如静态图片的渲染能力),基于预设的能力降级关系和富媒体能力集合1确定富媒体能力1最终降级为空。在实现方式1中,确定富媒体能力1最终降级为空时,将上述该组件的显示内容降级为空白(例如删除该组件的组件参数中的显示内容)。在实现方式2中,确定富媒体能力1最终降级为空时,若组件参数指示组件1关联有URL链接1,将组件1的显示内容替换为上述URL链接1或者组件参数指示的替换文本)。在实现方式3中,确定富媒体能力1最终降级为空时,删除组件1,即删除组件1的所有组件参数(包括该组件的显示内容和跳转链接)。
可以理解,实现方式1和实现方式2中,若富媒体能力集合1包括组件1的组件参数指示的交互能力(例如跳转至浏览器的能力),降级后的富媒体卡片中组件1依旧具备上述交互能力;而实现方式3中,降级后的富媒体卡片不包括组件1,自然也不具备上述交互能力。
示例性的,参见表3,组件1的富媒体能力1为静态图片的渲染能力,富媒体能力1降级后,该组件的显示区域可以为空白区域。示例性的,参考表3,组件1的富媒体能力1为投票表单的渲染能力,基于预设的能力降级关系,可以将投票表单的渲染能力降级为空;当组件1的组件参数指示组件1关联有跳转链接(例如浏览器中的投票网页的URL链接1)时,将投票表单的渲染能力降级为空,具体包括:将组件1的显示内容替换为投票表单中的投票标题,降级后的组件1关联有URL链接1;当组件1的组件参数指示组件1没有关联跳转链接时,将投票表单的渲染能力降级为空,具体包括:删除组件1。
在一些实施例中,参考表3,组件1的富媒体能力1为交互能力(例如跳转至浏览器的能力),基于预设的能力降级关系和富媒体能力集合1确定富媒体能力1最终降级为空。在实现方式4中,确定富媒体能力1最终降级为空时,取消组件1的富媒体能力1(例如删除组件1的跳转至浏览器的URL链接)。在实现方式5中,确定富媒体能力1最终降级为空时,删除组件1,即删除组件1的所有组件参数。
可以理解,实现方式4,降级后的富媒体卡片中,组件1可以继续显示组件1的组件参数指示的显示内容;而实现方式5中,降级后的富媒体卡片不包括组件1,自然也不能显示组件1的组件参数指示的显示内容。
本申请实施例,基于富媒体能力集合1和原始富媒体卡片中的各组件(例如组件1)所需的能力,对组件进行自适应降级。在一种实现方式中,基于降级后的各组件的组件参数,和业务设备选择的富媒体卡片模板1,生成富媒体能力集合1范围内的第一富媒体能力卡片。在一种实现方式中,基于降级后的各组件的组件参数,重新选择适合降级后的各组件的富媒体卡片模板2;基于降级后的各组件的组件参数和富媒体卡片模板2,生成富媒体能力集合1范围内的第一富媒体能力卡片。例如,自适应降级后,删除了原始富媒体卡片中的部分组件,为了更好的视觉效果和用户体验,需要新的富媒体卡片模板对降级后的各组件进行重新布局。
S104、卡片服务器500向业务设备发送第一富媒体卡片的第一标签,业务设备接收卡片服务器500发送的第一标签。
S105、业务设备向终端设备100发送包含第一标签的富媒体短信,终端设备100接收业务设备发送的富媒体短信。
在一些实施例中,业务设备通过常规***向终端设备100下发包含第一标签的富媒体短信。
S106、终端设备100向卡片服务器500发送获取请求,获取请求包括第一标签;卡片服务器500接收终端设备100发送的获取请求。
本申请实施例中,终端设备100收到包含第一标签的富媒体短信时,向卡片服务器500发送上述获取请求;或者,终端设备100接收到查看富媒体短信对应的第一富媒体卡片的输入操作时,向卡片服务器500发送上述获取请求。此处不作具体限定。
示例性的,参考图1B和图2B,查看富媒体短信对应的富媒体卡片的输入操作可以为作用于短信条目202的输入操作(例如触摸操作),响应于上述输入操作,显示图2B的(a)或(b)所示的富媒体卡片。参考图1C和图2B,查看富媒体短信对应的富媒体卡片的输入操作可以为作用于显示卡片的控件301的输入操作(例如触摸操作),响应于上述输入操作,显示
图2B的(a)或(b)所示的富媒体卡片。
S107、卡片服务器500向终端设备100发送第一标签对应的第一富媒体卡片,终端设备100接收卡片服务器500发送的第一富媒体卡片。
S108、终端设备100在短信APP显示第一富媒体卡片。
具体的,卡片服务器500向终端设备100发送第一富媒体卡片的卡片数据,卡片数据可以包括第一富媒体卡片的卡片ID、卡片布局信息、卡片主题和主题颜色,以及第一富媒体卡片内各组件的组件参数;卡片布局信息可以是第一富媒体卡片的具体的卡片布局数据;卡片布局信息也可以是第一富媒体卡片的卡片布局数据的下载地址(例如URL连接),终端设备100可以通过该下载地址下载第一富媒体卡片的卡片布局数据。终端设备100的短信APP通过渲染模块1调用CPU和/或GPU基于上述卡片布局和上述各组件的组件参数绘制和渲染第一富媒体卡片;短信APP显示渲染后的第一富媒体卡片。
示例性的,第一富媒体卡片为图2B的(b)所示的富媒体卡片。
该富媒体卡片的卡片数据包括组件A的组件参数,例如“"text1":{"textValue":"【跳水梦之队再夺一金】"}”。其中,"text1"为组件A的组件名称,"textValue"的取值“跳水梦之队再夺一金”为组件A的显示内容。
该富媒体卡片的卡片数据包括组件B的组件参数,例如“"text2":{"visibility":"visible","textValue":"。"}}”。其中,"text2"为组件B的组件名称,"visibility"取值为"visible"指组件B是可视的,"visibility"取值为"invisible"指组件B是隐藏的(即不可视的),"textValue"的取值“。”为组件B的显示内容;需要说明的是,"visibility"取值为"visible"时,图2B的(b)所示的富媒体卡片会显示“跳水梦之队再夺一金。”
该富媒体卡片的卡片数据包括组件C的组件参数,例如“"imgBottom":{"src":"https:\/\/a2p-functionxxxx.png","visibility":"visible","actionParams":"eyJkYXRhIjp7Im1lcxxxxxxxxxxxxxxxxxxxxxxxxx0sInR5cGUiOjJ9"}}”。其中,"imgBottom"为组件C的组件名称,"src"的取值"https:\/\/a2p-functionxxxx.png"为组件C的显示内容(即图片)的下载地址,"visibility"的取值用于指示组件C是否可视,"actionParams"的取值"eyJkYXRhIjp7Im1lcxxxxxxxxxxxxxxxxxxxxxxxxx0sInR5cGUiOjJ9"是组件C对应的响应事件的编码,终端设备100对"actionParams"的取值进行解码,可以获取组件C对应的响应事件。在一种示例中,"actionParams"的取值解码后可以包括实现指定交互能力的URL链接。
在一些实施例中,终端设备100接收到查看富媒体短信对应的第一富媒体卡片的输入操作;响应于上述输入操作,终端设备100在短信APP显示第一富媒体卡片。
此外,在一些实施例中,步骤S103至步骤S108是可选的。步骤S102之后,卡片服务器500确定原始富媒体卡片中各组件所需的富媒体能力不满足预设条件时,执行S103至步骤S108;确定满足上述预设条件时,执行S109至步骤S111。
在一种实现方式中,上述预设条件包括:基于富媒体能力集合1,确定原始富媒体卡片中各组件所需的富媒体能力均自适应降级为空;或者,自适应降级后仅剩下文本组件;或者,确定原始富媒体卡片中存在至少一个组件所需的富媒体能力均自适应降级为空。
S109、卡片服务器500向业务设备发送指示信息3,指示信息3用于指示无法生成富媒体卡片;业务设备接收卡片服务器500发送的指示信息3。
S110、业务设备基于上述指示信息3,向终端设备100发送文本短信;终端设备100接
收业务设备发送的文本短信。
S111、终端设备100在短信APP显示文本短信。
实施本申请过实施例,业务设备确定终端设备100的富媒体能力集合不足以生成所需的富媒体卡片时,可以不向终端设备100下发富媒体短信,仅下发普通的文本短信。这样,可以避免用户无法查看富媒体短信对应的富媒体卡片导致的用户体验差,还避免了富媒体短信费用的浪费。
下面结合附图,对本申请实施例提供的富媒体信息处理方法的应用进行示例性说明。
示例性的,业务设备的原始富媒体卡片中的组件1的富媒体能力1为视频的渲染能力,图2B示出了视频的渲染能力降级为静态图片的渲染能力的相关用户界面。具体的,参考前述实施例,此处不再赘述。
示例性的,业务设备的原始富媒体卡片中的组件1的富媒体能力1为横划图片的渲染能力,图6A和图6B示出了横划图片的渲染能力降级为静态图片的渲染能力的相关用户界面。用户点击图1B所示的XX新闻的短信条目202,响应于用户的点击操作,终端设备100可以在短信APP中显示图6A或图6B所示的富媒体卡片。
终端设备100的短信APP具备横划图片的渲染能力时,卡片服务器500可以生成和下发图6A所示的富媒体卡片;图6A所示的组件1的显示内容包括多张图片,组件1的显示区域还包括图片指示符501,图片指示符501可用于指示用户当前查看的是上述多张图片中的哪一张图片。
终端设备100的短信APP不具备横划图片的渲染能力,但具备静态图片的渲染能力时,卡片服务器500可以生成和下发图6B所示的富媒体卡片,如图6B所示,组件1由横划图片降级为静态图片。
示例性的,业务设备的原始富媒体卡片中的组件1的富媒体能力1为投票表单的渲染能力,图6C至图6E示出了对投票表单的渲染能力进行降级的相关用户界面。用户点击图1B所示的XX新闻的短信条目202,响应于用户的点击操作,终端设备100可以在短信APP中显示图6C、图6D或图6E所示的富媒体卡片。
终端设备100的短信APP具备投票表单的渲染能力时,卡片服务器500可以生成和下发图6C所示的富媒体卡片;图6C所示的组件1的显示内容包括投票标题和多个投票选项,用户可以选择上述多个投票选项中的至少一个选项,进行投票。
终端设备100的短信APP不具备投票表单的渲染能力,组件1关联有跳转链接(例如投票网页的URL连接1)、且短信APP具备跳转至浏览器的能力时,卡片服务器500可以生成和下发图6D所示的富媒体卡片;图6D所示的组件1的显示内容包括投票标题;投票标题可以接收用户的输入操作,响应于用户的输入操作,基于URL连接1跳转至浏览器的投票网页,用户可以通过投票网页进行投票。可选的,若业务设备提交的原始富媒体卡片的卡片参数指示组件1关联URL连接1,终端设备100的短信APP具备投票表单的渲染能力时,卡片服务器500可以在生成图6C所示的富媒体卡片时,删除组件1的URL连接1。可以理解,短信APP具备投票表单的渲染能力时,无需跳转至投票网页进行投屏。
终端设备100的短信APP不具备投票表单的渲染能力,组件1未关联有跳转链接(或者组件1关联有跳转链接时,但短信APP不具备跳转至浏览器的能力)时,卡片服务器500可以生成和下发图6E所示的富媒体卡片;如图6E所示,卡片服务器500删除了组件1。
示例性的,业务设备的原始富媒体卡片中的组件1的富媒体能力1为跳转至购物APP的能力,组件1的跳转链接包括跳转至购物APP的URL链接1和跳转至浏览器的购物网页的URL链接2,组件1优先使用的跳转链接为URL链接1;图7A至图7F示出了跳转至购物APP的能力降级为跳转至浏览器的能力的相关用户界面。
用户点击图7A所示的XX购物的短信条目203;响应于用户的点击操作,终端设备100可以在短信展示界面14中显示图7B所示的卡片服务器500下发的富媒体卡片,富媒体卡片包括组件1(例如购买按钮502)。
终端设备100的短信APP具备跳转至购物APP的能力时,卡片服务器500生成和下发的富媒体卡片中,按钮502关联的跳转链接为URL链接1;响应于针对购买按钮502的输入操作(例如触摸操作),终端设备100可以显示图7C所示的确定按钮503和取消按钮504。确定按钮503用于确定打开购物APP,取消按钮504用于取消打开购物APP。确定按钮503可以接收用户的输入操作(例如触摸操作),响应于上述输入操作,终端设备100基于URL链接1获取并显示图7D所示的购物APP的购物界面15。可选的,响应于针对购买按钮502的输入操作,终端设备100也可以直接显示图7D所示的购物界面15。
终端设备100的短信APP不具备跳转至购物APP的能力,但具备跳转至浏览器的能力时,卡片服务器500生成和下发的富媒体卡片中,按钮502关联的跳转链接为URL链接2;,响应于针对购买按钮502的输入操作(例如触摸操作),终端设备100可以显示图7E所示的确定按钮505和取消按钮506。确定按钮505用于确定打开浏览器,取消按钮506用于取消打开浏览器。确定按钮505可以接收用户的输入操作(例如触摸操作),响应于上述输入操作,终端设备100基于URL链接2获取并显示图7F所示的浏览器的购物网页16。可选的,响应于针对购买按钮502的输入操作,终端设备100也可以直接显示图7F所示的购物网页16。可以理解,购买按钮502的跳转至购物APP的能力被降级为跳转至浏览器的能力。
示例性的,业务设备的原始富媒体卡片中的组件1的富媒体能力1为跳转至地图APP定位导航的能力、跳转至短信APP的其他页面回复短信的能力或者跳转至电话APP的回拨电话的能力,图8A至图8F示出了组件1的富媒体能力1降级为空的相关用户界面。
终端设备100具备原始富媒体卡片所需的所有富媒体能力时,响应于用户对图8A所示的XX车网的短信条目201的点击操作,终端设备100可以显示图8B或图8C所示的短信展示界面17。图8B所示的短信展示界面17包括富媒体短信的文本信息和控件510,文本信息包括富媒体卡片对应的短链。其中,控件510可以接收用户的输入操作,响应于上述输入操作,终端设备100可以显示图8C所示的短信展示界面17;图8C所示,短信展示界面17包括卡片服务器500下发的上述短链对应的富媒体卡片,还包括控件511,控件511用于切换图8C所示富媒体卡片为图8B所示的文本信息。
图8C所示,终端设备100具备跳转至地图APP定位导航的能力、跳转至短信其他页面回复短信的能力和跳转至电话APP回拨电话的能力;卡片服务器500生成和下发的富媒体卡片包括导航按钮512、回复短信的按钮513、拨打电话的按钮514。
导航按钮512可以接收用户的输入操作(例如点击操作),响应于上述点击操作,终端设备100可以显示图8D所示的地图APP导航界面18,导航按钮512的组件参数还包括目标位置,导航界面18可以包括以用户的当前位置为起点,以组件参数指示的目标位置为终点的导航路线。
回复短信的按钮513可以接收用户的输入操作(例如点击操作),响应于上述点击操作,
终端设备100可以显示图8E所示的号码515的短信展示界面19;按钮513的组件参数可以包括号码515和用于退订的信息(例如TD),短信展示界面19包括信息输入框516和发送按钮517,信息输入框516已自动填入用于退订的信息,用户只需点击发送按钮517,就可以完成短信退订。
拨打电话的按钮514可以接收用户的输入操作(例如点击操作),响应于上述点击操作,终端设备100可以在电话APP中显示图8F所示的拨号界面20;按钮514的组件参数可以包括号码518,短信展示界面18包拨号输入框518和拨打按钮519,信息输入框518已自动填入号码518,用户只需点击拨打按钮519,就可以拨打号码518。
终端设备100的短信APP不具备导航按钮512所需的跳转至地图APP定位导航的能力,具备原始富媒体卡片所需的其他能力时,基于能力降级关系确定跳转至地图APP定位导航的能力被降级为空,卡片服务器500删除导航按钮512,生成并下发图8G所示的富媒体卡片。即响应于用户针对图8A所示的XX车网的短信条目201的点击操作,终端设备100可以显示图8G所示的富媒体卡片。
终端设备100的短信APP不具备导航按钮512所需的跳转至地图APP定位导航的能力,按钮513所需的跳转至短信其他页面回复短信的能力,和按钮514所需的跳转至电话APP拨打电话的能力,具备原始富媒体卡片所需的其他能力时,基于能力降级关系确定这三种能力均被降级为空,卡片服务器500删除导航按钮512、按钮513和按钮514,生成并下发图8H所示的富媒体卡片。即响应于用户针对图8A所示的XX车网的短信条目201的点击操作,终端设备100可以显示图8H所示的富媒体卡片。
在一种实现方式中,卡片服务器500删除原始富媒体卡片中的部分组件时,对剩余组件的布局进行自适应调整。例如,卡片服务器500删除导航按钮512、按钮513和按钮514,生成并下发图8I所示的富媒体卡片;相比图8C所示原始富媒体卡片,图8I所示的富媒体卡片的卡片尺寸减小。
示例性的,基于终端设备100的富媒体能力集合1和原始富媒体卡片的卡片参数,确定原始富媒体卡片中各组件所需的富媒体能力均自适应降级为空,或者自适应降级后仅剩下文本组件的组件渲染能力时;卡片服务器500向业务设备反馈指示信息3,指示信息3指示无法生成富媒体能力集合1范围内的富媒体卡片。基于上述指示信息3,业务设备可以不向终端设备100下发富媒体短信,转而下发图8J所示的文本短信。
本申请提供了一种富媒体信息处理***,包括第一终端设备、业务设备和卡片服务器500,
第一终端设备用于向卡片服务器500发送第一信息,第一信息用于指示第一终端设备的第一应用支持的第一富媒体能力集合,第一富媒体能力集合包括至少一种富媒体能力;
业务设备用于向卡片服务器500发送原始富媒体卡片的卡片参数和第一终端设备的设备标识;
卡片服务器500还用于基于卡片参数和第一富媒体能力集合生成第一卡片信息,第一卡片信息包括第一富媒体卡片的卡片数据以及对应的第一标签,并向业务设备发送第一标签;
业务设备还用于向第一端终端设备的第一应用发送富媒体消息,富媒体消息包括第一标签;
第一终端设备的第一应用的还用于向卡片服务器500发送获取请求,获取请求包括第一标签;
卡片服务器500还用于向第一终端设备的第一应用发送卡片数据;
第一终端设备的第一应用还用于基于卡片数据显示第一富媒体卡片。
示例性的,第一终端设备可以是前述终端设备100,第一应用可以为前述短信APP,第一信息可以为前述指示信息1,第一富媒体能力集合可以为前述富媒体能力集合1,第一终端设备的设备标识可以为前述终端设备100的设备标识1,富媒体消息可以为前述富媒体短信。
在一些实施例中,富媒体能力包括组件渲染能力和交互能力;组件渲染能力指渲染富媒体卡片中指定组件的能力,指定组件包括以下一项或多项:静态图片、动态图片、视频、横划图片、轮播图片、投票表单、按钮等;交互能力包括以下一项或多项:跳转至浏览器、跳转至预设应用程序(APP)、跳转至电话APP拨打电话、跳转至地图APP定位导航、跳转至其他APP分享富媒体卡片、跳转至快应用等;预设APP指具备网页版的APP。
在一些实施例中,卡片数据包括原始富媒体卡片的卡片布局信息以及原始富媒体卡片中各组件的组件参数,组件参数包括组件名称、指示组件的显示内容的信息、实现组件的指定交互能力的URL链接、组件类型等中的部分或全部。
在一些实施例中,第一信息包括第一富媒体集合中的每种富媒体能力的标识;或者,第一信息包括第一富媒体集合的版本号,卡片服务器500存储有多种富媒体能力集合的版本号,多种富媒体能力集合包括第一富媒体集合。
在一些实施例中,上述基于卡片参数和第一富媒体能力集合范围内生成第一卡片信息,具体包括:基于卡片参数,确定原始富媒体卡片中各组件所需的至少一种富媒体能力,第一组件所需的富媒体能力包括第一富媒体能力,第一组件为原始富媒体卡片中的任一组件;当第一富媒体能力集合不包括第一富媒体能力时,基于预设的能力降级关系对第一组件进行能力降级;能力降级后,生成第一应用的富媒体能力范围内的第一富媒体卡片的第一卡片信息。
示例性的,第一组件可以为前述组件1。
在一些实施例中,卡片参数包括第一组件的组件类型,第一组件所需的富媒体能力包括第一组件的组件类型对应的组件渲染能力;卡片参数包括第一组件的实现指定交互能力的URL连接时,第一组件所需的富媒体能力包括指定交互能力。
在一些实施例中,能力降级关系包括以下一种或多种:第一富媒体能力降级为第二富媒体能力,或者,第一富媒体能力降级为空;第二富媒体能力降级为第三富媒体能力,或者,第二富媒体能力降级为空;降级为空指不能降级为其他富媒体能力。
示例性的,表3示出了本申请实施例提供的一些能力降级关系。能力降级关系包括组件渲染能力的能力降级关系和交互能力的能力降级关系,组件渲染能力的能力降级关系包括以下一种或多种:动态图片的渲染能力降级为静态图片的渲染能力,横划图片的渲染能力降级为静态图片的渲染能力,视频的渲染能力降级为静态图片的渲染能力,轮播图片的渲染能力降级为横划图片的渲染能力,静态图片的渲染能力降级为空,投票表单的渲染能力降级为空;交互能力的能力降级关系包括以下一种或多种:跳转至预设APP的能力降级为跳转至浏览器的能力;跳转至浏览器的能力降级为空;跳转至电话APP拨打电话的能力降级为空;跳转至地图APP定位导航的能力降级为空;跳转至第一应用的其他页面回复信息的能力降级为空;跳转至其他APP分享富媒体卡片的能力降级为空。
在一些实施例中,第一富媒体能力集合不包括第一富媒体能力,包括第二富媒体能力,第二富媒体能力是第一富媒体能力降级后的能力,第一富媒体能力和第二富媒体能力为组件渲染能力;卡片参数包括指示第一组件的第一显示内容的信息,第一显示内容是通过第一富
媒体能力展示的;第一富媒体卡片包括第二组件,第二组件的显示内容为第二显示内容,第二显示内容是基于第一显示内容确定的,第二显示内容是通过第二富媒体能力展示的。
在一些实施例中,第一富媒体能力为视频的渲染能力,第二富媒体能力为静态图片的渲染能力;第一显示内容为视频,第二显示内容是视频中的一帧静态图像。示例性的,第一显示内容为图2B的(a)所示的富媒体卡片中的视频1,第一组件为视频1对应的视频组件;第一富媒体卡片为图2B的(b)所示的富媒体卡片,第二显示内容为该富媒体卡片中的静态图片1,第二组件为静态图片1对应的静态图片组件。
在一些实施例中,第一富媒体能力集合包括第三富媒体能力,不包括第一富媒体能力和第二富媒体能力,第三富媒体能力是第二富媒体能力降级后的能力,第一富媒体能力、第二富媒体能力、第三富媒体能力为组件渲染能力;卡片参数包括指示第一组件的第一显示内容的信息,第一显示内容是通过第一富媒体能力展示的;第一富媒体卡片包括第三组件,第三组件的显示内容为第三显示内容,第三显示内容是基于第一显示内容确定的,第三显示内容是通过第三富媒体能力展示的。
示例性的,第一组件为轮播图片组件,第一富媒体能力为轮播图片的渲染能力,第二富媒体能力为横划图片的渲染能力,第三富媒体能力为静态图片的渲染能力。
在一些实施例中,第一富媒体能力集合不包括第一富媒体能力,第一富媒体能力不能降级为其他富媒体能力,第一富媒体能力为组件渲染能力;卡片参数包括指示第一组件的第一显示内容的信息,第一显示内容是通过第一富媒体能力展示的;第一富媒体卡片不显示第一显示内容。
示例性的,第一组件为投票表单组件,第一富媒体能力为投票表单的渲染能力。参考图6C,原始富媒体卡片可以为图6C所示的富媒体卡片,该富媒体卡片显示有投票表单;第一富媒体卡片可以为图6D或图6E所示的富媒体卡片,如图6D和图6E所示,短信APP不具备投票表单的渲染能力时,富媒体卡片不显示投票表单。
在一些实施例中,第一富媒体卡片包括第四组件,第四组件的显示内容为第一URL链接或者第一组件的替换内容,卡片参数包括第一组件的实现交互能力的第一URL链接和第一组件的替换内容。
示例性的,第四组件为图6D所示的组件1,卡片参数包括投票表单组件的跳转至投票网页的URL链接,原始富媒体卡片中的投票表单被替换为文本(例如上述URL链接)。
在一些实施例中,卡片参数包括第一组件的实现第四富媒体能力的第一URL链接,以及第一组件的实现第五富媒体能力的第二URL链接;第五富媒体能力是第四富媒体能力降级后的能力,第四富媒体能力和第五富媒体能力为交互能力;当第一富媒体能力集合包括第四富媒体能力时,第一富媒体卡片包括第一组件,第一终端设备还用于响应于针对第一组件的第一输入操作,基于第四富媒体能力跳转至第一URL链接指示的用户界面;当第一富媒体能力集合不包括第四富媒体能力,包括第五富媒体能力时,第一富媒体卡片包括第五组件,第一终端设备还用于响应于针对第五组件的第一输入操作,基于第五富媒体能力跳转至第二URL链接指示的用户界面。
在一些实施例中,第一URL链接为预设APP的URL链接,第二URL链接为预设APP的网页版的URL链接;第四富媒体能力为跳转至预设APP的能力,第五富媒体能力为跳转至浏览器的能力。示例性的,预设APP为购物APP,第一富媒体卡片可以为图7B、图7C或图7E所示的富媒体卡片,第一组件为按钮502。如图7B至图7D所示,当短信APP具备跳
转至购物APP的能力,第一富媒体卡片包括按钮502,响应于针对按钮502的第一输入操作,可以跳转至第一URL链接指示的购物APP的用户界面;如图7B、图7E和图7F所示,当短信APP不具备跳转至购物APP的能力,具备跳转至浏览器的能力时,第一富媒体卡片包括按钮502(即第五组件),响应于针对按钮502的第一输入操作,可以跳转至第二URL链接指示的购物APP的网页版。
在一些实施例中,第一富媒体能力集合不包括第四富媒体能力,包括第五富媒体能力,第五富媒体能力是第四富媒体能力降级后的能力,第四富媒体能力和第五富媒体能力为交互能力;卡片参数包括第一组件的实现第四富媒体能力的第一URL链接,卡片参数未包括第一组件的实现第五富媒体能力的URL链接;第一富媒体卡片不包括具备第四富媒体能力的组件。在一种实现方式中,第一富媒体卡片包括第六组件,第六组件是基于第一组件的组件参数生成的,第六组件的组件参数不包括第一URL链接。在另一种实现方式中,第一富媒体卡片不包括基于第一组件的组件参数生成的组件,第一组件被删除。
在一些实施例中,第一富媒体能力集合不包括第四富媒体能力,第四富媒体能力不能降级为其他富媒体能力,第四富媒体能力为交互能力;卡片参数包括第一组件的实现第四富媒体能力的第一URL链接;第一富媒体卡片不包括具备第四富媒体能力的组件。在一种实现方式中,第一富媒体卡片包括第六组件,第六组件是基于第一组件的组件参数生成的,第六组件的组件参数不包括第一URL链接。在另一种实现方式中,第一富媒体卡片不包括基于第一组件的组件参数生成的组件,即第一组件被删除。
示例性的,原始富媒体卡片为图8C所示的富媒体卡片,第一组件为按钮512,第四富媒体能力为跳转至地图APP定位导航的能力,该能力不能降级为其他能力;第一富媒体卡片为图8G所示富媒体卡片,短信APP不具备跳转至地图APP定位导航的能力,该富媒体卡片未显示按钮512。
在一些实施例中,向卡片服务器500发送获取请求,具体包括:接收用于查看富媒体消息对应的富媒体卡片的第二输入操作;响应于第二输入操作,向卡片服务器500发送获取请求。
在一些实施例中,上述***还包括第二终端设备;第二终端设备用于向卡片服务器500发送第二信息,第二信息用于指示第二终端设备的第一应用支持的第二富媒体能力集合,第二富媒体能力集合包括至少一种富媒体能力;卡片服务器500还用于基于卡片参数和第二富媒体能力集合生成第三信息,并向业务设备发送第三信息,第三信息用于指示不能基于卡片参数生成第二终端设备的富媒体卡片;业务设备还用于向第二终端设备的第一应用发送原始富媒体卡片对应的文本消息;第二终端设备的第一应用还用于显示文本消息。
示例性的,第三信息可以为前述指示信息3,文本消息可以为前述文本短信。
在一些实施例中,第二信息是在第二卡片参数和第二富媒体能力集合满足预设条件时生成的;预设条件包括:基于预设的能力降级关系和第一富媒体能力集合,确定原始富媒体卡片所需的所有富媒体能力均降级为空,或者,原始富媒体卡片所需的至少一种富媒体能力降级为空;降级为空指不能降级为其他富媒体能力。
本申请的各实施方式可以任意进行组合,以实现不同的技术效果。
在上述实施例中,可以全部或部分地通过软件、硬件、固件或者其任意组合来实现。当使用软件实现时,可以全部或部分地以计算机程序产品的形式实现。所述计算机程序产品包括一个或多个计算机指令。在计算机上加载和执行所述计算机程序指令时,全部或部分地产生按照本申请所述的流程或功能。所述计算机可以是通用计算机、专用计算机、计算机网络、
或者其他可编程装置。所述计算机指令可以存储在计算机可读存储介质中,或者从一个计算机可读存储介质向另一个计算机可读存储介质传输,例如,所述计算机指令可以从一个网站站点、计算机、服务器或数据中心通过有线(例如同轴电缆、光纤、数字用户线)或无线(例如红外、无线、微波等)方式向另一个网站站点、计算机、服务器或数据中心进行传输。所述计算机可读存储介质可以是计算机能够存取的任何可用介质或者是包含一个或多个可用介质集成的服务器、数据中心等数据存储设备。所述可用介质可以是磁性介质,(例如,软盘、硬盘、磁带)、光介质(例如,DVD)、或者半导体介质(例如固态硬盘(solid state disk,SSD))等。
本领域普通技术人员可以理解实现上述实施例方法中的全部或部分流程,该流程可以由计算机程序来指令相关的硬件完成,该程序可存储于计算机可读取存储介质中,该程序在执行时,可包括如上述各方法实施例的流程。而前述的存储介质包括:ROM或随机存储记忆体RAM、磁碟或者光盘等各种可存储程序代码的介质。
总之,以上所述仅为本发明技术方案的实施例而已,并非用于限定本发明的保护范围。凡根据本发明的揭露,所作的任何修改、等同替换、改进等,均应包含在本发明的保护范围之内。
Claims (38)
- 一种富媒体信息处理***,其特征在于,所述***包括第一终端设备、业务设备和卡片服务器,所述第一终端设备用于向卡片服务器发送第一信息,所述第一信息用于指示所述第一终端设备的第一应用支持的第一富媒体能力集合,所述第一富媒体能力集合包括至少一种富媒体能力;业务设备用于向所述卡片服务器发送原始富媒体卡片的卡片参数和所述第一终端设备的设备标识;所述卡片服务器还用于基于所述卡片参数和所述第一富媒体能力集合生成第一卡片信息,第一卡片信息包括第一富媒体卡片的卡片数据以及对应的第一标签,并向所述业务设备发送所述第一标签;所述业务设备还用于向所述第一端终端设备的所述第一应用发送富媒体消息,所述富媒体消息包括所述第一标签;所述第一终端设备的所述第一应用的还用于向所述卡片服务器发送获取请求,所述获取请求包括所述第一标签;所述卡片服务器还用于向所述第一终端设备的所述第一应用发送所述卡片数据;所述第一终端设备的第一应用还用于基于所述卡片数据显示所述第一富媒体卡片。
- 根据权利要求1所述的***,其特征在于,所述富媒体能力包括组件渲染能力和交互能力;所述组件渲染能力指渲染富媒体卡片中指定组件的能力,所述指定组件包括以下一项或多项:静态图片、动态图片、视频、横划图片、轮播图片、投票表单、按钮等;所述交互能力包括以下一项或多项:跳转至浏览器、跳转至预设应用程序(APP)、跳转至电话APP拨打电话、跳转至地图APP定位导航、跳转至其他APP分享富媒体卡片、跳转至快应用等;所述预设APP指具备网页版的APP。
- 根据权利要求1所述的***,其特征在于,所述卡片数据包括所述原始富媒体卡片的卡片布局信息以及所述原始富媒体卡片中各组件的组件参数,所述组件参数包括组件名称、指示组件的显示内容的信息、实现组件的指定交互能力的URL链接、组件类型等中的部分或全部。
- 根据权利要求1所述的***,其特征在于,所述第一信息包括所述第一富媒体集合中的每种富媒体能力的标识;或者,所述第一信息包括所述第一富媒体集合的版本号,所述卡片服务器存储有多种富媒体能力集合的版本号,所述多种富媒体能力集合包括所述第一富媒体集合。
- 根据权利要求1所述的***,其特征在于,所述基于所述卡片参数和所述第一富媒体能力集合范围内生成第一卡片信息,具体包括:基于所述卡片参数,确定所述原始富媒体卡片中各组件所需的至少一种富媒体能力,所 述第一组件所需的富媒体能力包括第一富媒体能力,所述第一组件为所述原始富媒体卡片中的任一组件;当所述第一富媒体能力集合不包括所述第一富媒体能力时,基于预设的能力降级关系对所述第一组件进行能力降级;能力降级后,生成所述第一应用的富媒体能力范围内的第一富媒体卡片的第一卡片信息。
- 根据权利要求5所述的***,其特征在于,所述卡片参数包括所述第一组件的组件类型,所述第一组件所需的富媒体能力包括所述第一组件的组件类型对应的组件渲染能力;所述卡片参数包括所述第一组件的实现指定交互能力的URL连接时,所述第一组件所需的富媒体能力包括所述指定交互能力。
- 根据权利要求5所述的***,其特征在于,所述能力降级关系包括以下一种或多种:所述第一富媒体能力降级为第二富媒体能力,或者,所述第一富媒体能力降级为空;所述第二富媒体能力降级为第三富媒体能力,或者,所述第二富媒体能力降级为空;所述降级为空指不能降级为其他富媒体能力。
- 根据权利要求7所述的***,其特征在于,所述能力降级关系包括组件渲染能力的能力降级关系和交互能力的能力降级关系,所述组件渲染能力的能力降级关系包括以下一种或多种:动态图片的渲染能力降级为静态图片的渲染能力,横划图片的渲染能力降级为静态图片的渲染能力,视频的渲染能力降级为静态图片的渲染能力,轮播图片的渲染能力降级为横划图片的渲染能力,静态图片的渲染能力降级为空,投票表单的渲染能力降级为空;所述交互能力的能力降级关系包括以下一种或多种:跳转至预设APP的能力降级为跳转至浏览器的能力;跳转至浏览器的能力降级为空;跳转至电话APP拨打电话的能力降级为空;跳转至地图APP定位导航的能力降级为空;跳转至第一应用的其他页面回复信息的能力降级为空;跳转至其他APP分享富媒体卡片的能力降级为空。
- 根据权利要求1至8任一项所述的***,其特征在于,所述第一富媒体能力集合不包括第一富媒体能力,包括第二富媒体能力,所述第二富媒体能力是所述第一富媒体能力降级后的能力,所述第一富媒体能力和所述第二富媒体能力为组件渲染能力;所述卡片参数包括指示第一组件的第一显示内容的信息,所述第一显示内容是通过所述第一富媒体能力展示的;所述第一富媒体卡片包括第二组件,所述第二组件的显示内容为第二显示内容,所述第二显示内容是基于所述第一显示内容确定的,所述第二显示内容是通过所述第二富媒体能力展示的。
- 根据权利要求9所述的***,其特征在于,所述第一富媒体能力为视频的渲染能力,所述第二富媒体能力为静态图片的渲染能力;所述第一显示内容为视频,所述第二显示内容是所述视频中的一帧静态图像。
- 根据权利要求1至8任一项所述的***,其特征在于,所述第一富媒体能力集合包括第三富媒体能力,不包括第一富媒体能力和第二富媒体能力,所述第三富媒体能力是所述第二富媒体能力降级后的能力,所述第一富媒体能力、所述第二富媒体能力、所述第三富媒体能力为组件渲染能力;所述卡片参数包括指示第一组件的第一显示内容的信息,所述第一显示内容是通过所述第一富媒体能力展示的;所述第一富媒体卡片包括第三组件,所述第三组件的显示内容为第三显示内容,所述第三显示内容是基于所述第一显示内容确定的,所述第三显示内容是通过所述第三富媒体能力展示的。
- 根据权利要求1至8任一项所述的***,其特征在于,所述第一富媒体能力集合不包括第一富媒体能力,所述第一富媒体能力不能降级为其他富媒体能力,所述第一富媒体能力为组件渲染能力;所述卡片参数包括指示所述第一组件的第一显示内容的信息,所述第一显示内容是通过所述第一富媒体能力展示的;所述第一富媒体卡片不显示所述第一显示内容。
- 根据权利要求12所述的***,其特征在于,所述第一富媒体卡片包括第四组件,所述第四组件的显示内容为第一URL链接或者所述第一组件的替换内容,所述卡片参数包括所述第一组件的实现交互能力的所述第一URL链接和所述第一组件的替换内容。
- 根据权利要求1至13任一项所述的***,其特征在于,所述卡片参数包括第一组件的实现第四富媒体能力的第一URL链接,以及所述第一组件的实现第五富媒体能力的第二URL链接;所述第五富媒体能力是所述第四富媒体能力降级后的能力,所述第四富媒体能力和所述第五富媒体能力为交互能力;当所述第一富媒体能力集合包括所述第四富媒体能力时,所述第一富媒体卡片包括所述第一组件,所述第一终端设备还用于响应于针对所述第一组件的第一输入操作,基于所述第四富媒体能力跳转至所述第一URL链接指示的用户界面;当所述第一富媒体能力集合不包括所述第四富媒体能力,包括所述第五富媒体能力时,所述第一富媒体卡片包括第五组件,所述第一终端设备还用于响应于针对所述第五组件的第一输入操作,基于所述第五富媒体能力跳转至所述第二URL链接指示的用户界面。
- 根据权利要求14所述的***,其特征在于,所述第一URL链接为预设APP的URL链接,所述第二URL链接为所述预设APP的网页版的URL链接;所述第四富媒体能力为跳转至所述预设APP的能力,所述第五富媒体能力为跳转至浏览器的能力。
- 根据权利要求1至13任一项所述的***,其特征在于,所述第一富媒体能力集合不包括第四富媒体能力,包括第五富媒体能力,所述第五富媒体能力是所述第四富媒体能力降级后的能力,所述第四富媒体能力和所述第五富媒体能力为交互能力;所述卡片参数包括所述第一组件的实现所述第四富媒体能力的第一URL链接,所述卡片参数未包括所述第一组件的实现所述第五富媒体能力的URL链接;所述第一富媒体卡片不包括具备所述第四富媒体能力的组件。
- 根据权利要求1至13任一项所述的***,其特征在于,所述第一富媒体能力集合不包括第四富媒体能力,所述第四富媒体能力不能降级为其他富媒体能力,所述第四富媒体能力为交互能力;所述卡片参数包括所述第一组件的实现所述第四富媒体能力的第一URL链接;所述第一富媒体卡片不包括具备所述第四富媒体能力的组件。
- 根据权利要求16或17所述的***,所述第一富媒体卡片包括第六组件,所述第六组件是基于所述第一组件的组件参数生成的,所述第六组件的组件参数不包括所述第一URL链接。
- 一种富媒体信息处理方法,其特征在于,所述方法包括:第一终端设备向卡片服务器发送第一信息,所述第一信息用于指示第一应用支持的第一富媒体能力集合,所述第一富媒体能力集合包括至少一种富媒体能力;所述第一终端设备的第一应用接收业务设备发送的富媒体消息,所述富媒体消息包括第一标签,所述第一标签是所述卡片服务器生成的第一富媒体卡片的标签,所述第一富媒体卡片的卡片数据是所述卡片服务器基于所述业务设备发送的原始富媒体卡片的卡片参数和所述第一富媒体能力集合生成的;所述第一终端设备的所述第一应用向所述卡片服务器发送获取请求,所述获取请求包括所述第一标签;所述第一终端设备的所述第一应用接收所述卡片服务器发送的所述卡片数据;所述第一终端设备的所述第一应用基于所述卡片数据显示所述第一富媒体卡片。
- 根据权利要求19所述的方法,其特征在于,所述富媒体能力包括组件渲染能力和交互能力;所述组件渲染能力指渲染富媒体卡片中指定组件的能力,所述指定组件包括以下一项或多项:静态图片、动态图片、视频、横划图片、轮播图片、投票表单、按钮等;所述交互能力包括以下一项或多项:跳转至浏览器、跳转至预设应用程序(APP)、跳转至电话APP拨打电话、跳转至地图APP定位导航、跳转至其他APP分享富媒体卡片、跳转至快应用等;所述预设APP指具备网页版的APP。
- 根据权利要求19所述的方法,其特征在于,所述卡片数据包括所述第一富媒体卡片的卡片布局信息以及所述第一富媒体卡片中各组件的组件参数,所述组件参数包括组件名称、指示组件的显示内容的信息、实现组件的指定交互能力的URL链接、组件类型等中的部分或全部。
- 根据权利要求19所述的方法,其特征在于,所述第一信息包括所述第一富媒体集合中的每种富媒体能力的标识;或者,所述第一信息包括所述第一富媒体集合的版本号,不同富媒体能力集合对应的版本号不同。
- 根据权利要求19所述的方法,其特征在于,所述原始富媒体卡片中各组件所需的至少一种富媒体能力是基于所述卡片参数确定的,所述第一组件所需的富媒体能力包括第一富媒体能力,所述第一组件为所述原始富媒体卡片中的任一组件;当所述第一富媒体能力集合不包括所述第一富媒体能力时,所述第一卡片信息是基于预设的能力降级关系,对所述第一组件进行能力降级后生成的。
- 根据权利要求23所述的方法,其特征在于,所述卡片参数包括所述第一组件的组件类型,所述第一组件所需的富媒体能力包括所述第一组件的组件类型对应的组件渲染能力;所述卡片参数包括所述第一组件的实现指定交互能力的URL连接时,所述第一组件所需的富媒体能力包括所述指定交互能力。
- 根据权利要求23所述的方法,其特征在于,所述能力降级关系包括以下一种或多种:所述第一富媒体能力降级为第二富媒体能力,或者,所述第一富媒体能力降级为空;所述第二富媒体能力降级为第三富媒体能力,或者,所述第二富媒体能力降级为空;所述降级为空指不能降级为其他富媒体能力。
- 根据权利要求25所述的方法,其特征在于,所述能力降级关系包括组件渲染能力的能力降级关系和交互能力的能力降级关系,所述组件渲染能力的能力降级关系包括以下一种或多种:动态图片的渲染能力降级为静态图片的渲染能力,横划图片的渲染能力降级为静态图片的渲染能力,视频的渲染能力降级为静态图片的渲染能力,轮播图片的渲染能力降级为横划图片的渲染能力,静态图片的渲染能力降级为空,投票表单的渲染能力降级为空;所述交互能力的能力降级关系包括以下一种或多种:跳转至预设APP的能力降级为跳转至浏览器的能力;跳转至浏览器的能力降级为空;跳转至电话APP拨打电话的能力降级为空;跳转至地图APP定位导航的能力降级为空;跳转至第一应用的其他页面回复信息的能力降级为空;跳转至其他APP分享富媒体卡片的能力降级为空。
- 根据权利要求19至26任一项所述的方法,其特征在于,所述第一富媒体能力集合不包括第一富媒体能力,包括第二富媒体能力,所述第二富媒体能力是所述第一富媒体能力降级后的能力,所述第一富媒体能力和所述第二富媒体能力为组件渲染能力;所述卡片参数包括指示第一组件的第一显示内容的信息,所述第一显示内容是通过所述第一富媒体能力展示的;所述第一富媒体卡片包括第二组件,所述第二组件的显示内容为第二显示内容,所述第二显示内容是基于所述第一显示内容确定的,所述第二显示内容是通过所述第二富媒体能力展示的。
- 根据权利要求27所述的方法,其特征在于,所述第一富媒体能力为视频的渲染能力,所述第二富媒体能力为静态图片的渲染能力;所述第一显示内容为视频,所述第二显示内容是所述视频中的一帧静态图像。
- 根据权利要求19至26任一项所述的方法,其特征在于,所述第一富媒体能力集合包括第三富媒体能力,不包括第一富媒体能力和第二富媒体能力,所述第三富媒体能力是所述第二富媒体能力降级后的能力,所述第一富媒体能力、所述第二富媒体能力、所述第三富媒体能力为组件渲染能力;所述卡片参数包括指示第一组件的第一显示内容的信息,所述第一显示内容是通过所述第一富媒体能力展示的;所述第一富媒体卡片包括第三组件,所述第三组件的显示内容为第三显示内容,所述第三显示内容是基于所述第一显示内容确定的,所述第三显示内容是通过所述第三富媒体能力展示的。
- 根据权利要求19至26任一项所述的方法,其特征在于,所述第一富媒体能力集合不包括第一富媒体能力,所述第一富媒体能力不能降级为其他富媒体能力,所述第一富媒体能力为组件渲染能力;所述卡片参数包括指示所述第一组件的第一显示内容的信息,所述第一显示内容是通过所述第一富媒体能力展示的;所述第一富媒体卡片不显示所述第一显示内容。
- 根据权利要求30所述的方法,其特征在于,所述第一富媒体卡片包括第四组件,所述第四组件的显示内容为第一URL链接或者所述第一组件的替换内容,所述卡片参数包括所述第一组件的实现交互能力的所述第一URL链接和所述第一组件的替换内容。
- 根据权利要求19至31任一项所述的方法,其特征在于,所述卡片参数包括第一组件的实现第四富媒体能力的第一URL链接,以及所述第一组件的实现第五富媒体能力的第二URL链接;所述第五富媒体能力是所述第四富媒体能力降级后的能力,所述第四富媒体能力和所述第五富媒体能力为交互能力;当所述第一富媒体能力集合包括所述第四富媒体能力时,所述第一富媒体卡片包括所述第一组件,所述方法还包括:所述第一终端设备响应于针对所述第一组件的第一输入操作,基于所述第四富媒体能力跳转至所述第一URL链接指示的用户界面;当所述第一富媒体能力集合不包括所述第四富媒体能力,包括所述第五富媒体能力时,所述第一富媒体卡片包括第五组件,所述方法还包括:所述第一终端设备响应于针对所述第五组件的第一输入操作,基于所述第五富媒体能力跳转至所述第二URL链接指示的用户界面。
- 根据权利要求32所述的方法,其特征在于,所述第一URL链接为预设APP的URL链接,所述第二URL链接为所述预设APP的网页版的URL链接;所述第四富媒体能力为跳转至所述预设APP的能力,所述第五富媒体能力为跳转至浏览器的能力。
- 根据权利要求19至31任一项所述的方法,其特征在于,所述第一富媒体能力集合不包括第四富媒体能力,包括第五富媒体能力,所述第五富媒体能力是所述第四富媒体能力降级后的能力,所述第四富媒体能力和所述第五富媒体能力为交互能力;所述卡片参数包括所述第一组件的实现所述第四富媒体能力的第一URL链接,所述卡片参数未包括所述第一组件的实现所述第五富媒体能力的URL链接;所述第一富媒体卡片不包括具备所述第四富媒体能力的组件。
- 根据权利要求19至13任一项所述的方法,其特征在于,所述第一富媒体能力集合不包括第四富媒体能力,所述第四富媒体能力不能降级为其他富媒体能力,所述第四富媒体能力为交互能力;所述卡片参数包括所述第一组件的实现所述第四富媒体能力的第一URL链接;所述第一富媒体卡片不包括具备所述第四富媒体能力的组件。
- 根据权利要求34或35所述的方法,其特征在于,所述第一富媒体卡片包括第六组件,所述第六组件是基于所述第一组件的组件参数生成的,所述第六组件的组件参数不包括所述第一URL链接。
- 一种终端设备,其特征在于,包括存储器和处理器,所述存储器和所述处理器电偶合,所述存储器用于存储程序指令,所述处理器被配置用于调用所述存储器存储的全部或部分程序指令,执行如权利要求19-36任一项所述的方法。
- 一种计算机存储介质,其特征在于,包括计算机指令,当所述计算机指令在终端设备上运行时,使得所述终端设备执行如权利要求19-36任一项所述的方法。
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202210336417.XA CN116931855A (zh) | 2022-03-31 | 2022-03-31 | 富媒体信息处理方法、***及相关装置 |
CN202210336417.X | 2022-03-31 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2023185967A1 true WO2023185967A1 (zh) | 2023-10-05 |
Family
ID=88199361
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2023/084886 WO2023185967A1 (zh) | 2022-03-31 | 2023-03-29 | 富媒体信息处理方法、***及相关装置 |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN116931855A (zh) |
WO (1) | WO2023185967A1 (zh) |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109862399A (zh) * | 2018-12-14 | 2019-06-07 | 珠海市小源科技有限公司 | 显示富媒体信息的方法、处理富媒体信息的方法、计算机装置及计算机可读存储介质 |
CN110049456A (zh) * | 2019-03-26 | 2019-07-23 | 深圳市物联天下技术有限公司 | 一种在移动终端显示富媒体的方法、装置及移动终端 |
CN110113247A (zh) * | 2019-04-18 | 2019-08-09 | 深圳市梦网科技发展有限公司 | 富媒体信息收发***、发送、展示方法及终端设备 |
CN110234080A (zh) * | 2019-06-11 | 2019-09-13 | 珠海市小源科技有限公司 | 一种信息显示方法、装置和*** |
CN111314202A (zh) * | 2018-12-11 | 2020-06-19 | 中兴通讯股份有限公司 | 消息发送方法和装置 |
CN113438200A (zh) * | 2021-05-13 | 2021-09-24 | 荣耀终端有限公司 | 在通话过程中传输富媒体信息的***、方法及设备 |
CN114189502A (zh) * | 2021-11-30 | 2022-03-15 | 中国电信股份有限公司 | 信息发送方法、装置、存储介质及设备 |
-
2022
- 2022-03-31 CN CN202210336417.XA patent/CN116931855A/zh active Pending
-
2023
- 2023-03-29 WO PCT/CN2023/084886 patent/WO2023185967A1/zh unknown
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111314202A (zh) * | 2018-12-11 | 2020-06-19 | 中兴通讯股份有限公司 | 消息发送方法和装置 |
CN109862399A (zh) * | 2018-12-14 | 2019-06-07 | 珠海市小源科技有限公司 | 显示富媒体信息的方法、处理富媒体信息的方法、计算机装置及计算机可读存储介质 |
CN110049456A (zh) * | 2019-03-26 | 2019-07-23 | 深圳市物联天下技术有限公司 | 一种在移动终端显示富媒体的方法、装置及移动终端 |
CN110113247A (zh) * | 2019-04-18 | 2019-08-09 | 深圳市梦网科技发展有限公司 | 富媒体信息收发***、发送、展示方法及终端设备 |
CN110234080A (zh) * | 2019-06-11 | 2019-09-13 | 珠海市小源科技有限公司 | 一种信息显示方法、装置和*** |
CN113438200A (zh) * | 2021-05-13 | 2021-09-24 | 荣耀终端有限公司 | 在通话过程中传输富媒体信息的***、方法及设备 |
CN114189502A (zh) * | 2021-11-30 | 2022-03-15 | 中国电信股份有限公司 | 信息发送方法、装置、存储介质及设备 |
Also Published As
Publication number | Publication date |
---|---|
CN116931855A (zh) | 2023-10-24 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2020244495A1 (zh) | 一种投屏显示方法及电子设备 | |
WO2020238774A1 (zh) | 一种通知消息的预览方法及电子设备 | |
WO2020155014A1 (zh) | 智能家居设备分享***、方法及电子设备 | |
CN114356258A (zh) | 电子设备及其投屏方法和介质 | |
WO2021249318A1 (zh) | 一种投屏方法和终端 | |
WO2020233556A1 (zh) | 一种通话内容处理方法和电子设备 | |
WO2022078295A1 (zh) | 一种设备推荐方法及电子设备 | |
CN113961157B (zh) | 显示交互***、显示方法及设备 | |
CN114201097B (zh) | 一种多应用程序之间的交互方法 | |
CN114860136A (zh) | 一种微件的显示方法与电子设备 | |
WO2023016014A1 (zh) | 视频编辑方法和电子设备 | |
WO2023273543A1 (zh) | 一种文件夹管理方法及装置 | |
WO2022111653A1 (zh) | 一种反馈方法、装置及*** | |
WO2022135157A1 (zh) | 页面显示的方法、装置、电子设备以及可读存储介质 | |
CN114173189B (zh) | 视频编辑方法、电子设备和存储介质 | |
EP4336357A1 (en) | Message processing method and related apparatus | |
WO2023005711A1 (zh) | 一种服务的推荐方法及电子设备 | |
WO2023185967A1 (zh) | 富媒体信息处理方法、***及相关装置 | |
WO2022052706A1 (zh) | 一种服务的分享方法、***及电子设备 | |
WO2020216144A1 (zh) | 一种添加邮件联系人的方法和电子设备 | |
CN116016418B (zh) | 一种信息交互方法及电子设备 | |
WO2024140002A1 (zh) | 一种存储空间的管理方法、装置、电子设备及存储介质 | |
WO2023125832A1 (zh) | 图片分享方法和电子设备 | |
WO2023207890A1 (zh) | 一种界面显示方法及电子设备 | |
EP4387210A1 (en) | Screen identification method for distributed display, medium and electronic device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 23778332 Country of ref document: EP Kind code of ref document: A1 |