US20160292564A1 - Cross-Channel Content Translation Engine - Google Patents
Cross-Channel Content Translation Engine Download PDFInfo
- Publication number
- US20160292564A1 US20160292564A1 US15/185,222 US201615185222A US2016292564A1 US 20160292564 A1 US20160292564 A1 US 20160292564A1 US 201615185222 A US201615185222 A US 201615185222A US 2016292564 A1 US2016292564 A1 US 2016292564A1
- Authority
- US
- United States
- Prior art keywords
- content
- user
- translation
- communications channel
- channel
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/004—Artificial life, i.e. computing arrangements simulating life
- G06N3/006—Artificial life, i.e. computing arrangements simulating life based on simulated virtual individual or collective life forms, e.g. social simulations or particle swarm optimisation [PSO]
-
- G06F17/28—
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/0483—Interaction with page-structured environments, e.g. book metaphor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/40—Processing or translation of natural language
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N20/00—Machine learning
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N5/00—Computing arrangements using knowledge-based models
- G06N5/02—Knowledge representation; Symbolic representation
-
- G06N99/005—
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M3/00—Automatic or semi-automatic exchanges
- H04M3/42—Systems providing special services or facilities to subscribers
- H04M3/487—Arrangements for providing information services, e.g. recorded voice services or time announcements
- H04M3/493—Interactive information services, e.g. directory enquiries ; Arrangements therefor, e.g. interactive voice response [IVR] systems or voice portals
- H04M3/4938—Interactive information services, e.g. directory enquiries ; Arrangements therefor, e.g. interactive voice response [IVR] systems or voice portals comprising a voice browser which renders and interprets, e.g. VoiceXML
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M7/00—Arrangements for interconnection between switching centres
- H04M7/0024—Services and arrangements where telephone services are combined with data services
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/12—Messaging; Mailboxes; Announcements
Definitions
- Some multi-channel virtual assistants offer the same user interaction and content across Web, SMS, IVR, Mobile and other channels. Such content needs to be adapted according to the channel. Conventionally, the content is not easily expanded to cover new elements.
- An embodiment according to the present invention addresses reusability and alignment of content across channels in a multi-channel virtual assistant by allowing users to define content on one channel and then have the content fully or partially translated for the other channels using a mix of pre-defined static rules, dynamic rules or machine learning.
- Content translation is provided based on communications channels and is performed from one to many formats, optionally in real time. Performing content translation using machine learning provides an advantage that as users work, content translation becomes more precise and covers more elements.
- a system for content translation comprising a translation module configured to receive, from a user interface, user entered content to provide a first end user experience suitable to be presented over a first type of communications channel; and a knowledge base comprising at least one translation configuration to translate the user entered content into analogous content to provide at least one other end user experience suitable to be presented over at least one respective different type of communications channel.
- the translation module is configured to consult the knowledge base to translate the user entered content into the analogous content, and to provide the analogous content to the user interface to be associated with the user entered content over the user interface.
- each of the first type of communications channel and the at least one different type of communications channel may comprise at least one of: a web channel; a mobile channel; a text message channel; an e-mail channel; and an interactive voice response channel.
- the translation module may be still further configured to provide the analogous content, to the user interface to be associated with the user entered content over the user interface, automatically in real time as the user entered content is entered by the user; and/or automatically in response to a single user gesture over the user interface.
- the at least one translation configuration of the knowledge base may comprise at least one static translation configuration and/or at least one dynamically learned translation configuration.
- the system may further comprise a learning module configured to provide the at least one dynamically learned translation configuration to the knowledge base based on at least one user interaction received from the user interface.
- the system may further comprise the user interface, wherein the user interface is configured to provide the user entered content to the translation module and to receive the analogous content from the translation module.
- the user interface may comprise a plurality of display interfaces including a base display interface and at least one non-base display interface.
- the translation module may be configured to consult the knowledge base to translate at least a user changed portion of content into at least a portion of corresponding analogous content whenever a content change is made over the base display interface, and may be configured not to make a display change over the base display interface when a change is made over the at least one other non-base display interfaces.
- the user interface may comprise a plurality of display interfaces, and the translation module may be configured to consult the knowledge base to translate at least a user changed portion of content into at least a portion of corresponding analogous content whenever a content change is made over any of the plurality of display interfaces.
- At least one of the first type of communications channel and the at least one different type of communications channel may comprise a visual type of communications channel; and at least one of the first type of communications channel and the at least one different type of communications channel may comprise an audio type of communications channel.
- FIG. 1A is a diagram of a multi-channel user interface for content translation in accordance with an embodiment of the invention.
- FIG. 1B is a schematic diagram of components of a system for content translation in accordance with an embodiment of the invention.
- FIG. 1C is a block diagram of a method implemented by a system in accordance with an embodiment of the invention.
- FIG. 2 illustrates a computer network or similar digital processing environment in which the present invention may be implemented.
- FIG. 3 is a diagram of an example internal structure of a computer in the computer system of FIG. 2 , in accordance with an embodiment of the invention.
- a useful aspect for users to benefit when investing in a multi-channel virtual assistant is to be able to streamline content creation across the channels and maintain alignment when changes are needed.
- An embodiment according to the present invention addresses reusability and alignment of content across channels by allowing users to define content on one channel and then, have the content fully or partially translated for the other channels using a mix of pre-defined static rules, dynamic rules or machine learning.
- Content translation is provided based on communications channels, and is performed from one to many formats in real time. Performing content translation using machine learning provides an advantage that as users work, content translation becomes more precise and covers more elements.
- a multi-channel virtual assistant in accordance with an embodiment of the invention provides human/machine dialogs across channels.
- a cross channel virtual assistant offers a consistent and rich user experience through Interactive Voice Response (IVR), Web, Text Messaging (such as Short Message Service or “SMS” messaging), Mobile and other communications channels.
- IVR Interactive Voice Response
- Web Web
- Text Messaging such as Short Message Service or “SMS” messaging
- Mobile Mobile and other communications channels.
- “content” comprises information to send to the end user in different formats.
- content may include prompts to invite the user to articulate a question or a desired action.
- Prompts can be text and/or audio with or without visual artifacts.
- Text in prompts can be formatted (for example, in a Hyper Text Markup Language or HTML format), such as when presented on a web channel, or can be plain text, such as for text messaging (e.g., SMS).
- Content may also, for example, include additional questions to the end user to better understand the request (such as a disambiguation or a step by step dialog).
- the additional questions can be text and/or audio with or without visual artifacts.
- the text of the additional questions can be formatted (for example, HTML), such as when presented on a web channel.
- the additional questions can include clickable answers, Uniform Resource Locators (URLs) or choices in the form of text or audio.
- Content may also include transaction dialogs to complete a given task, for example, to pay a bill.
- the transaction dialogs may include a combination of prompts and additional questions, for example of the types described above.
- Content may also include answers or transaction results, which may include any of the foregoing forms of content.
- SMS can only contain text limited in length; pure audio IVR cannot provide visual artifacts, clickable choices or text; and mobile has limited space to display information.
- An embodiment according to the present invention addresses reusability of content by allowing users to define content on one channel and then, have the content fully or partially translated for the other channels using a mix of pre-defined static rules, dynamic rules and machine learning. Users can define and maintain content for one channel and streamline the creation/reuse of content for other channels, while also ensuring that the content is viable for each channel.
- FIG. 1A is a diagram of a multi-channel user interface for content translation in accordance with an embodiment of the invention.
- An embodiment according to the invention comprises a graphical user interface (GUI) 100 for editing and reading channel specific content, and a backend translation engine 120 (see FIG. 1B ) for translating content.
- GUI graphical user interface
- FIG. 1B a backend translation engine 120 for translating content.
- a user writes content on one tab 101 , for a given channel (here, for example, the web channel 101 ).
- Automatic translation takes place either in real time as content is written or after the user presses a button (or provides another user gesture) to launch the translation process.
- the user is shown the automatic content translation that was performed and can accept it, reject it and/or make changes.
- the GUI comprises several tabs or pages 101 - 104 .
- Each represents the same content, but adapted to the channel.
- the GUI tabs 101 - 104 are all linked together by a translation and learning engine, so that when content is edited for any of the channels, it is translated and adapted for all other channels simultaneously.
- a translation and learning engine so that when content is edited for any of the channels, it is translated and adapted for all other channels simultaneously.
- the GUI 100 may also be configured to allow one or more “tabs” to act as masters or base display interfaces, meaning that their content is not impacted by changes to other tabs (no automatic translation/adaptation), and that only changes on the master tabs trigger an automated translation process on non-master tabs.
- a user could set the web tab 101 as a master tab, so that changes made on that tab 101 would trigger translation/adaption on all other tabs, but changes on any other tab 102 - 104 would not trigger changes on the web tab 101 .
- an automated translation may be triggered for any given tab based on any other tab.
- a user can select the mobile tab 102 and request an automated translation with data originating from the IVR tab 104 . Any such combination can be supported.
- the content can be represented for display and editing using one or more GUI components, such as, without limitation: a rich text and/or plain text area 105 , a text input field 106 , a date field 107 or a fixed selection 108 .
- FIG. 1B is a schematic diagram of components of a system for content translation in accordance with an embodiment of the invention.
- a translation engine 120 comprises a translation module 121 , a learning module 122 , and a knowledge base 123 .
- the translation module 121 is responsible for getting the content, translating it using the knowledge base 123 and sending it back to the GUI 100 . This is done for all other channels (e.g., 102 - 104 of FIG. 1A ) when one of the channels is modified (e.g., 101 of FIG. 1A ).
- the learning module 122 is responsible for capturing user interactions 124 (such as accept, reject and modify), analyzing the data in order to learn from it and pushing the result into the knowledge base 123 in a format consumable by the translation engine.
- the translation engine 120 registers user actions 124 in order to learn from them and better predict translation for future content.
- Translation configuration and learning can be segmented by one or more attributes, such as by project.
- Translation configuration and learning can also use third party system access to complete translations. For example, contact information may be fetched from a third party system to translate a URL to a phone number.
- the knowledge base 123 can include two main sources for performing translations: a static configuration and a dynamic configuration. Static configurations do not change based on user interactions, whereas dynamic configurations do.
- a static configuration rule for converting content to SMS may comprise stripping all other content except text; and a static configuration rule for converting content to IVR may comprise converting all text to audio prompt content.
- user interactions such as when accepting, rejecting or adjusting proposals, are kept and used to predict proper translations for future content.
- Data may be used in a statistical manner or in a direct correlation.
- grammars may be used to permit user-defined dynamic rules to be created.
- URL patterns can be analyzed and used to predict the outcome of a translation into another channel, using any element from the URL.
- Some examples of translations based on URL domains follow. In these, any part of a mixed part of the domain may be used. Examples:
- a) Domain 1 can be translated into a specific phone number
- b) Domain 2 can be translated into a phone number, but not a known phone number; for example, the user can be guided by proposing a generic phone number upon the translation, such as a generic phone number of format x-xxx-xxx-xxxx, instead of keeping the URL in the translation.
- c) Domain 3 can be translated into a specific prompt in the IVR channel.
- “presentation” content may be translated from one to multiple channels mixing audio and visual, such as SMS, IVR, mobile and web. Additionally, a combination of a static pre-set configuration and dynamic/machine learning may be used for the cross channel translation. The content may be translatable from any channel to all other channels.
- a “communications channel” comprises a distinct type of communication technique having a corresponding distinct user experience.
- text messaging, IVR, mobile and web channels are examples of distinct communications channels.
- two distinct communications channels may be simply different facets of a common type of communication, such as a web presentation for different devices.
- a web channel for display on a tablet device may be considered a separate communications channel from a web channel for display on a phone.
- multiple mobile channels may be considered distinct communications channels where they are directed to displays on different types of mobile devices, for example mobile devices having different operating systems.
- content that is translated may include not only primary content, but also metadata and the data “wrapper.” For example, plain text on one channel may be changed into bold face text on another channel, or vice versa.
- metadata may be removed or modified when translated from channel to channel.
- FIG. 1C is a block diagram of a method implemented by a system in accordance with an embodiment of the invention.
- the method comprises receiving 10 , from a user interface, user entered content to provide a first end user experience suitable to be presented over a first type of communications channel.
- the user entered content is translated 20 into analogous content to provide at least one other end user experience suitable to be presented over at least one respective different type of communications channel.
- the translating uses at least one translation configuration.
- the analogous content is provided 30 to the user interface to be associated with the user entered content over the user interface. It will be appreciated that related methods may be implemented in accordance with teachings herein.
- FIG. 2 illustrates a computer network or similar digital processing environment in which the present invention may be implemented.
- Client computer(s)/devices 281 and server computer(s) 282 provide processing, storage, and input/output devices executing application programs and the like.
- Client computers 281 can include, for example, the computers used to implement a graphical user interface 100 , in accordance with an embodiment of the invention; and server computers 282 can be used to implement a translation engine 120 , in accordance with an embodiment of the invention.
- Client computer(s)/devices 281 can also be linked through a communications network 283 to other computing devices, including other client devices/processes 281 and server computer(s) 282 .
- the communications network 283 can be part of a remote access network, global network (e.g., the Internet), worldwide collection of computers, Local area or Wide area networks, and gateways that currently use respective protocols (TCP/IP, Bluetooth, etc.) to communicate with one another.
- global network e.g., the Internet
- IP Local area or Wide area networks
- gateways that currently use respective protocols (TCP/IP, Bluetooth, etc.) to communicate with one another.
- Other electronic device/computer network architectures are suitable.
- FIG. 3 is a diagram of an example internal structure of a computer (e.g., client processor/device 281 or server computers 282 ) in the computer system of FIG. 2 , in accordance with an embodiment of the invention.
- Each computer 281 , 282 contains a system bus 384 , where a bus is a set of hardware lines used for data transfer among the components of a computer or processing system.
- the system bus 384 is essentially a shared conduit that connects different elements of a computer system (e.g., processor, disk storage, memory, input/output ports, network ports, etc.) that enables the transfer of information between the elements.
- Attached to the system bus 384 is an I/O device interface 385 for connecting various input and output devices (e.g., keyboard, mouse, displays, printers, speakers, etc.) to the computer 281 , 282 .
- a network interface 386 allows the computer to connect to various other devices attached to a network (e.g., the network 283 of FIG. 2 ).
- Memory 387 provides volatile storage for computer software instructions 388 and data 389 used to implement an embodiment of the present invention (e.g., routines for content translation).
- a disk storage 390 provides non-volatile storage for computer software instructions 391 and data 392 used to implement an embodiment of the present invention.
- a central processor unit 393 is also attached to the system bus 384 and provides for the execution of computer instructions.
- a system in accordance with the invention has been described in which there is provided content translation.
- Components of such a system for example components of a translation module, learning module, knowledge base, user interface and other systems described herein may, for example, be a portion of program code, operating on a computer processor.
- Portions of the above-described embodiments of the present invention can be implemented using one or more computer systems, for example to perform content translation.
- the embodiments may be implemented using hardware, software or a combination thereof.
- the software code can be stored on any form of non-transient computer-readable medium and loaded and executed on any suitable processor or collection of processors, whether provided in a single computer or distributed among multiple computers.
- a computer may be embodied in any of a number of forms, such as a rack-mounted computer, a desktop computer, a laptop computer, or a tablet computer. Additionally, a computer may be embedded in a device not generally regarded as a computer but with suitable processing capabilities, including a Personal Digital Assistant (PDA), a smart phone or any other suitable portable or fixed electronic device.
- PDA Personal Digital Assistant
- a computer may have one or more input and output devices. These devices can be used, among other things, to present a user interface. Examples of output devices that can be used to provide a user interface include printers or display screens for visual presentation of output and speakers or other sound generating devices for audible presentation of output. Examples of input devices that can be used for a user interface include keyboards, and pointing devices, such as mice, touch pads, and digitizing tablets. As another example, a computer may receive input information through speech recognition or in other audible formats.
- Such computers may be interconnected by one or more networks in any suitable form, including as a local area network or a wide area network, such as an enterprise network or the Internet.
- networks may be based on any suitable technology and may operate according to any suitable protocol and may include wireless networks, wired networks or fiber optic networks.
- the various methods or processes outlined herein may be coded as software that is executable on one or more processors that employ any one of a variety of operating systems or platforms. Additionally, such software may be written using any of a number of suitable programming languages and/or programming or scripting tools, and also may be compiled as executable machine language code or intermediate code that is executed on a framework or virtual machine.
- At least a portion of the invention may be embodied as a computer readable medium (or multiple computer readable media) (e.g., a computer memory, one or more floppy discs, compact discs, optical discs, magnetic tapes, flash memories, circuit configurations in Field Programmable Gate Arrays or other semiconductor devices, or other tangible computer storage medium) encoded with one or more programs that, when executed on one or more computers or other processors, perform methods that implement the various embodiments of the invention described above.
- the computer readable medium or media can be transportable, such that the program or programs stored thereon can be loaded onto one or more different computers or other processors to implement various aspects of the present invention as discussed above.
- one implementation of the above-described embodiments comprises at least one computer-readable medium encoded with a computer program (e.g., a plurality of instructions), which, when executed on a processor, performs some or all of the above-discussed functions of these embodiments.
- a computer program e.g., a plurality of instructions
- the term “computer-readable medium” encompasses only a non-transient computer-readable medium that can be considered to be a machine or a manufacture (i.e., article of manufacture).
- a computer-readable medium may be, for example, a tangible medium on which computer-readable information may be encoded or stored, a storage medium on which computer-readable information may be encoded or stored, and/or a non-transitory medium on which computer-readable information may be encoded or stored.
- Other non-exhaustive examples of computer-readable media include a computer memory (e.g., a ROM, a RAM, a flash memory, or other type of computer memory), a magnetic disc or tape, an optical disc, and/or other types of computer-readable media that can be considered to be a machine or a manufacture.
- program or “software” are used herein in a generic sense to refer to any type of computer code or set of computer-executable instructions that can be employed to program a computer or other processor to implement various aspects of the present invention as discussed above. Additionally, it should be appreciated that according to one aspect of this embodiment, one or more computer programs that when executed perform methods of the present invention need not reside on a single computer or processor, but may be distributed in a modular fashion amongst a number of different computers or processors to implement various aspects of the present invention.
- Computer-executable instructions may be in many forms, such as program modules, executed by one or more computers or other devices.
- program modules include routines, programs, objects, components, data structures, etc. that perform particular tasks or implement particular abstract data types.
- functionality of the program modules may be combined or distributed as desired in various embodiments.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Software Systems (AREA)
- Signal Processing (AREA)
- Artificial Intelligence (AREA)
- Mathematical Physics (AREA)
- Data Mining & Analysis (AREA)
- Evolutionary Computation (AREA)
- Computing Systems (AREA)
- Human Computer Interaction (AREA)
- General Health & Medical Sciences (AREA)
- Health & Medical Sciences (AREA)
- Computational Linguistics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Medical Informatics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Molecular Biology (AREA)
- Biomedical Technology (AREA)
- Life Sciences & Earth Sciences (AREA)
- Biophysics (AREA)
- Information Transfer Between Computers (AREA)
- User Interface Of Digital Computer (AREA)
- Automation & Control Theory (AREA)
- Fuzzy Systems (AREA)
- Algebra (AREA)
- Computational Mathematics (AREA)
- Mathematical Analysis (AREA)
- Mathematical Optimization (AREA)
- Pure & Applied Mathematics (AREA)
Abstract
Description
- This application is a continuation of U.S. application Ser. No. 14/057,463, filed Oct. 18, 2013. The entire teachings of the above application are incorporated herein by reference.
- Some multi-channel virtual assistants offer the same user interaction and content across Web, SMS, IVR, Mobile and other channels. Such content needs to be adapted according to the channel. Conventionally, the content is not easily expanded to cover new elements.
- An embodiment according to the present invention addresses reusability and alignment of content across channels in a multi-channel virtual assistant by allowing users to define content on one channel and then have the content fully or partially translated for the other channels using a mix of pre-defined static rules, dynamic rules or machine learning. Content translation is provided based on communications channels and is performed from one to many formats, optionally in real time. Performing content translation using machine learning provides an advantage that as users work, content translation becomes more precise and covers more elements.
- In accordance with an embodiment of the invention, there is provided a system for content translation. The system comprises a translation module configured to receive, from a user interface, user entered content to provide a first end user experience suitable to be presented over a first type of communications channel; and a knowledge base comprising at least one translation configuration to translate the user entered content into analogous content to provide at least one other end user experience suitable to be presented over at least one respective different type of communications channel. The translation module is configured to consult the knowledge base to translate the user entered content into the analogous content, and to provide the analogous content to the user interface to be associated with the user entered content over the user interface.
- In further, related embodiments, each of the first type of communications channel and the at least one different type of communications channel may comprise at least one of: a web channel; a mobile channel; a text message channel; an e-mail channel; and an interactive voice response channel. The translation module may be still further configured to provide the analogous content, to the user interface to be associated with the user entered content over the user interface, automatically in real time as the user entered content is entered by the user; and/or automatically in response to a single user gesture over the user interface. The at least one translation configuration of the knowledge base may comprise at least one static translation configuration and/or at least one dynamically learned translation configuration. The system may further comprise a learning module configured to provide the at least one dynamically learned translation configuration to the knowledge base based on at least one user interaction received from the user interface. The system may further comprise the user interface, wherein the user interface is configured to provide the user entered content to the translation module and to receive the analogous content from the translation module.
- In other, related embodiments, the user interface may comprise a plurality of display interfaces including a base display interface and at least one non-base display interface. The translation module may be configured to consult the knowledge base to translate at least a user changed portion of content into at least a portion of corresponding analogous content whenever a content change is made over the base display interface, and may be configured not to make a display change over the base display interface when a change is made over the at least one other non-base display interfaces. In another embodiment, the user interface may comprise a plurality of display interfaces, and the translation module may be configured to consult the knowledge base to translate at least a user changed portion of content into at least a portion of corresponding analogous content whenever a content change is made over any of the plurality of display interfaces. At least one of the first type of communications channel and the at least one different type of communications channel may comprise a visual type of communications channel; and at least one of the first type of communications channel and the at least one different type of communications channel may comprise an audio type of communications channel.
- The foregoing will be apparent from the following more particular description of example embodiments of the invention, as illustrated in the accompanying drawings in which like reference characters refer to the same parts throughout the different views. The drawings are not necessarily to scale, emphasis instead being placed upon illustrating embodiments of the present invention.
-
FIG. 1A is a diagram of a multi-channel user interface for content translation in accordance with an embodiment of the invention. -
FIG. 1B is a schematic diagram of components of a system for content translation in accordance with an embodiment of the invention. -
FIG. 1C is a block diagram of a method implemented by a system in accordance with an embodiment of the invention. -
FIG. 2 illustrates a computer network or similar digital processing environment in which the present invention may be implemented. -
FIG. 3 is a diagram of an example internal structure of a computer in the computer system ofFIG. 2 , in accordance with an embodiment of the invention. - A description of example embodiments of the invention follows.
- A useful aspect for users to benefit when investing in a multi-channel virtual assistant is to be able to streamline content creation across the channels and maintain alignment when changes are needed.
- An embodiment according to the present invention addresses reusability and alignment of content across channels by allowing users to define content on one channel and then, have the content fully or partially translated for the other channels using a mix of pre-defined static rules, dynamic rules or machine learning. Content translation is provided based on communications channels, and is performed from one to many formats in real time. Performing content translation using machine learning provides an advantage that as users work, content translation becomes more precise and covers more elements.
- A multi-channel virtual assistant in accordance with an embodiment of the invention provides human/machine dialogs across channels. A cross channel virtual assistant offers a consistent and rich user experience through Interactive Voice Response (IVR), Web, Text Messaging (such as Short Message Service or “SMS” messaging), Mobile and other communications channels. To make this solution attractive and worthwhile for users, it is useful to maximize reusability at application and content levels.
- For a typical virtual assistant, “content” comprises information to send to the end user in different formats.
- For example, content may include prompts to invite the user to articulate a question or a desired action. Prompts can be text and/or audio with or without visual artifacts. Text in prompts can be formatted (for example, in a Hyper Text Markup Language or HTML format), such as when presented on a web channel, or can be plain text, such as for text messaging (e.g., SMS).
- Content may also, for example, include additional questions to the end user to better understand the request (such as a disambiguation or a step by step dialog). The additional questions can be text and/or audio with or without visual artifacts. The text of the additional questions can be formatted (for example, HTML), such as when presented on a web channel. The additional questions can include clickable answers, Uniform Resource Locators (URLs) or choices in the form of text or audio.
- Content may also include transaction dialogs to complete a given task, for example, to pay a bill. The transaction dialogs may include a combination of prompts and additional questions, for example of the types described above.
- Content may also include answers or transaction results, which may include any of the foregoing forms of content.
- Typically, content is not readily usable across different channels. For example, SMS can only contain text limited in length; pure audio IVR cannot provide visual artifacts, clickable choices or text; and mobile has limited space to display information.
- An embodiment according to the present invention addresses reusability of content by allowing users to define content on one channel and then, have the content fully or partially translated for the other channels using a mix of pre-defined static rules, dynamic rules and machine learning. Users can define and maintain content for one channel and streamline the creation/reuse of content for other channels, while also ensuring that the content is viable for each channel.
-
FIG. 1A is a diagram of a multi-channel user interface for content translation in accordance with an embodiment of the invention. An embodiment according to the invention comprises a graphical user interface (GUI) 100 for editing and reading channel specific content, and a backend translation engine 120 (seeFIG. 1B ) for translating content. In thegraphical user interface 100 ofFIG. 1A , a user writes content on onetab 101, for a given channel (here, for example, the web channel 101). Automatic translation takes place either in real time as content is written or after the user presses a button (or provides another user gesture) to launch the translation process. On each of theother tabs 102, 103 and 104, the user is shown the automatic content translation that was performed and can accept it, reject it and/or make changes. - In the embodiment of
FIG. 1A , the GUI comprises several tabs or pages 101-104. Each represents the same content, but adapted to the channel. The GUI tabs 101-104 are all linked together by a translation and learning engine, so that when content is edited for any of the channels, it is translated and adapted for all other channels simultaneously. When a user enters a tab for which automatic translation was done, all modifications are highlighted and can be accepted or rejected over the GUI one by one or all together by the user. TheGUI 100 may also be configured to allow one or more “tabs” to act as masters or base display interfaces, meaning that their content is not impacted by changes to other tabs (no automatic translation/adaptation), and that only changes on the master tabs trigger an automated translation process on non-master tabs. For example, a user could set theweb tab 101 as a master tab, so that changes made on thattab 101 would trigger translation/adaption on all other tabs, but changes on any other tab 102-104 would not trigger changes on theweb tab 101. - In the embodiment of
FIG. 1A , an automated translation may be triggered for any given tab based on any other tab. For example, a user can select themobile tab 102 and request an automated translation with data originating from the IVR tab 104. Any such combination can be supported. In addition, the content can be represented for display and editing using one or more GUI components, such as, without limitation: a rich text and/orplain text area 105, atext input field 106, adate field 107 or a fixedselection 108. -
FIG. 1B is a schematic diagram of components of a system for content translation in accordance with an embodiment of the invention. Atranslation engine 120 comprises atranslation module 121, alearning module 122, and aknowledge base 123. Thetranslation module 121 is responsible for getting the content, translating it using theknowledge base 123 and sending it back to theGUI 100. This is done for all other channels (e.g., 102-104 ofFIG. 1A ) when one of the channels is modified (e.g., 101 ofFIG. 1A ). Thelearning module 122 is responsible for capturing user interactions 124 (such as accept, reject and modify), analyzing the data in order to learn from it and pushing the result into theknowledge base 123 in a format consumable by the translation engine. Thetranslation engine 120 registers user actions 124 in order to learn from them and better predict translation for future content. Translation configuration and learning can be segmented by one or more attributes, such as by project. Translation configuration and learning can also use third party system access to complete translations. For example, contact information may be fetched from a third party system to translate a URL to a phone number. - In the embodiment of
FIG. 1B , theknowledge base 123 can include two main sources for performing translations: a static configuration and a dynamic configuration. Static configurations do not change based on user interactions, whereas dynamic configurations do. - As an example of a static configuration, a static configuration rule for converting content to SMS may comprise stripping all other content except text; and a static configuration rule for converting content to IVR may comprise converting all text to audio prompt content.
- In a learning or dynamic configuration in the embodiment of
FIG. 1B , user interactions, such as when accepting, rejecting or adjusting proposals, are kept and used to predict proper translations for future content. Data may be used in a statistical manner or in a direct correlation. Further, grammars may be used to permit user-defined dynamic rules to be created. - Example 1 of Learning Configuration:
-
- a) User interaction translates
url 1 from web channel into some specific text for the SMS channel. - b) User interaction translates
url 1 from web channel into call transfer to a specific number on the IVR channel. - c) Learning configuration uses changes (a) and (b) for future translations. Additionally, the fact that a URL becomes (i) text in SMS and (ii) a phone number in IVR, is used in general for translating URLs, using the learning configuration. At some point, a different URL can be translated into something else than a phone number under IVR. As such operations occur, the translation engine keeps data and learns from it, in the learning configuration.
- a) User interaction translates
- Example 2 of Learning Configuration:
-
- A list of URLs from the web channel is translated into a list in other channels; for example, into prompts asking the user for options, or into SMS options to send back.
- In another example in the learning or dynamic configuration in the embodiment of
FIG. 1B , URL patterns can be analyzed and used to predict the outcome of a translation into another channel, using any element from the URL. Some examples of translations based on URL domains follow. In these, any part of a mixed part of the domain may be used. Examples: - a)
Domain 1 can be translated into a specific phone number - b)
Domain 2 can be translated into a phone number, but not a known phone number; for example, the user can be guided by proposing a generic phone number upon the translation, such as a generic phone number of format x-xxx-xxx-xxxx, instead of keeping the URL in the translation. - c)
Domain 3 can be translated into a specific prompt in the IVR channel. - In accordance with an embodiment of the invention, “presentation” content may be translated from one to multiple channels mixing audio and visual, such as SMS, IVR, mobile and web. Additionally, a combination of a static pre-set configuration and dynamic/machine learning may be used for the cross channel translation. The content may be translatable from any channel to all other channels.
- As used herein, a “communications channel” comprises a distinct type of communication technique having a corresponding distinct user experience. For example, text messaging, IVR, mobile and web channels are examples of distinct communications channels. In addition, however, two distinct communications channels may be simply different facets of a common type of communication, such as a web presentation for different devices. For example a web channel for display on a tablet device may be considered a separate communications channel from a web channel for display on a phone. Further, multiple mobile channels may be considered distinct communications channels where they are directed to displays on different types of mobile devices, for example mobile devices having different operating systems.
- In addition, as used herein, “content” that is translated may include not only primary content, but also metadata and the data “wrapper.” For example, plain text on one channel may be changed into bold face text on another channel, or vice versa. In another example, metadata may be removed or modified when translated from channel to channel.
-
FIG. 1C is a block diagram of a method implemented by a system in accordance with an embodiment of the invention. The method comprises receiving 10, from a user interface, user entered content to provide a first end user experience suitable to be presented over a first type of communications channel. The user entered content is translated 20 into analogous content to provide at least one other end user experience suitable to be presented over at least one respective different type of communications channel. The translating uses at least one translation configuration. The analogous content is provided 30 to the user interface to be associated with the user entered content over the user interface. It will be appreciated that related methods may be implemented in accordance with teachings herein. -
FIG. 2 illustrates a computer network or similar digital processing environment in which the present invention may be implemented. Client computer(s)/devices 281 and server computer(s) 282 provide processing, storage, and input/output devices executing application programs and the like.Client computers 281 can include, for example, the computers used to implement agraphical user interface 100, in accordance with an embodiment of the invention; andserver computers 282 can be used to implement atranslation engine 120, in accordance with an embodiment of the invention. Client computer(s)/devices 281 can also be linked through acommunications network 283 to other computing devices, including other client devices/processes 281 and server computer(s) 282. Thecommunications network 283 can be part of a remote access network, global network (e.g., the Internet), worldwide collection of computers, Local area or Wide area networks, and gateways that currently use respective protocols (TCP/IP, Bluetooth, etc.) to communicate with one another. Other electronic device/computer network architectures are suitable. -
FIG. 3 is a diagram of an example internal structure of a computer (e.g., client processor/device 281 or server computers 282) in the computer system ofFIG. 2 , in accordance with an embodiment of the invention. Eachcomputer O device interface 385 for connecting various input and output devices (e.g., keyboard, mouse, displays, printers, speakers, etc.) to thecomputer network interface 386 allows the computer to connect to various other devices attached to a network (e.g., thenetwork 283 ofFIG. 2 ).Memory 387 provides volatile storage forcomputer software instructions 388 anddata 389 used to implement an embodiment of the present invention (e.g., routines for content translation). Adisk storage 390 provides non-volatile storage forcomputer software instructions 391 anddata 392 used to implement an embodiment of the present invention. Acentral processor unit 393 is also attached to the system bus 384 and provides for the execution of computer instructions. - A system in accordance with the invention has been described in which there is provided content translation. Components of such a system, for example components of a translation module, learning module, knowledge base, user interface and other systems described herein may, for example, be a portion of program code, operating on a computer processor.
- Portions of the above-described embodiments of the present invention can be implemented using one or more computer systems, for example to perform content translation. For example, the embodiments may be implemented using hardware, software or a combination thereof. When implemented in software, the software code can be stored on any form of non-transient computer-readable medium and loaded and executed on any suitable processor or collection of processors, whether provided in a single computer or distributed among multiple computers.
- Further, it should be appreciated that a computer may be embodied in any of a number of forms, such as a rack-mounted computer, a desktop computer, a laptop computer, or a tablet computer. Additionally, a computer may be embedded in a device not generally regarded as a computer but with suitable processing capabilities, including a Personal Digital Assistant (PDA), a smart phone or any other suitable portable or fixed electronic device.
- Also, a computer may have one or more input and output devices. These devices can be used, among other things, to present a user interface. Examples of output devices that can be used to provide a user interface include printers or display screens for visual presentation of output and speakers or other sound generating devices for audible presentation of output. Examples of input devices that can be used for a user interface include keyboards, and pointing devices, such as mice, touch pads, and digitizing tablets. As another example, a computer may receive input information through speech recognition or in other audible formats.
- Such computers may be interconnected by one or more networks in any suitable form, including as a local area network or a wide area network, such as an enterprise network or the Internet. Such networks may be based on any suitable technology and may operate according to any suitable protocol and may include wireless networks, wired networks or fiber optic networks.
- Also, the various methods or processes outlined herein may be coded as software that is executable on one or more processors that employ any one of a variety of operating systems or platforms. Additionally, such software may be written using any of a number of suitable programming languages and/or programming or scripting tools, and also may be compiled as executable machine language code or intermediate code that is executed on a framework or virtual machine.
- In this respect, at least a portion of the invention may be embodied as a computer readable medium (or multiple computer readable media) (e.g., a computer memory, one or more floppy discs, compact discs, optical discs, magnetic tapes, flash memories, circuit configurations in Field Programmable Gate Arrays or other semiconductor devices, or other tangible computer storage medium) encoded with one or more programs that, when executed on one or more computers or other processors, perform methods that implement the various embodiments of the invention described above. The computer readable medium or media can be transportable, such that the program or programs stored thereon can be loaded onto one or more different computers or other processors to implement various aspects of the present invention as discussed above.
- In this respect, it should be appreciated that one implementation of the above-described embodiments comprises at least one computer-readable medium encoded with a computer program (e.g., a plurality of instructions), which, when executed on a processor, performs some or all of the above-discussed functions of these embodiments. As used herein, the term “computer-readable medium” encompasses only a non-transient computer-readable medium that can be considered to be a machine or a manufacture (i.e., article of manufacture). A computer-readable medium may be, for example, a tangible medium on which computer-readable information may be encoded or stored, a storage medium on which computer-readable information may be encoded or stored, and/or a non-transitory medium on which computer-readable information may be encoded or stored. Other non-exhaustive examples of computer-readable media include a computer memory (e.g., a ROM, a RAM, a flash memory, or other type of computer memory), a magnetic disc or tape, an optical disc, and/or other types of computer-readable media that can be considered to be a machine or a manufacture.
- The terms “program” or “software” are used herein in a generic sense to refer to any type of computer code or set of computer-executable instructions that can be employed to program a computer or other processor to implement various aspects of the present invention as discussed above. Additionally, it should be appreciated that according to one aspect of this embodiment, one or more computer programs that when executed perform methods of the present invention need not reside on a single computer or processor, but may be distributed in a modular fashion amongst a number of different computers or processors to implement various aspects of the present invention.
- Computer-executable instructions may be in many forms, such as program modules, executed by one or more computers or other devices. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform particular tasks or implement particular abstract data types. Typically the functionality of the program modules may be combined or distributed as desired in various embodiments.
- While this invention has been particularly shown and described with references to example embodiments thereof, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the scope of the invention encompassed by the appended claims.
Claims (20)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US15/185,222 US20160292564A1 (en) | 2013-10-18 | 2016-06-17 | Cross-Channel Content Translation Engine |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US14/057,463 US9396442B2 (en) | 2013-10-18 | 2013-10-18 | Cross-channel content translation engine |
US15/185,222 US20160292564A1 (en) | 2013-10-18 | 2016-06-17 | Cross-Channel Content Translation Engine |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/057,463 Continuation US9396442B2 (en) | 2013-10-18 | 2013-10-18 | Cross-channel content translation engine |
Publications (1)
Publication Number | Publication Date |
---|---|
US20160292564A1 true US20160292564A1 (en) | 2016-10-06 |
Family
ID=51751945
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/057,463 Active 2034-07-19 US9396442B2 (en) | 2013-10-18 | 2013-10-18 | Cross-channel content translation engine |
US15/185,222 Abandoned US20160292564A1 (en) | 2013-10-18 | 2016-06-17 | Cross-Channel Content Translation Engine |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/057,463 Active 2034-07-19 US9396442B2 (en) | 2013-10-18 | 2013-10-18 | Cross-channel content translation engine |
Country Status (2)
Country | Link |
---|---|
US (2) | US9396442B2 (en) |
EP (1) | EP2863341A1 (en) |
Families Citing this family (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20170243107A1 (en) * | 2016-02-19 | 2017-08-24 | Jack Mobile Inc. | Interactive search engine |
CN108874460B (en) * | 2017-05-11 | 2022-12-02 | 达发科技股份有限公司 | Voice transmission device and method for executing voice assistant program |
CN110032276A (en) * | 2019-03-07 | 2019-07-19 | 永德利硅橡胶科技(深圳)有限公司 | Quick start voice translation method and Related product |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20020122060A1 (en) * | 2000-12-18 | 2002-09-05 | Markel Steven O. | Wizard generating HTML web pages using XML and XSL |
US20030220973A1 (en) * | 2002-03-28 | 2003-11-27 | Min Zhu | Conference recording system |
US20070069973A1 (en) * | 2005-05-10 | 2007-03-29 | Gerbacia William E | Controlled and Monitored Remote Advertising and Information Display System |
US20100088438A1 (en) * | 2008-10-08 | 2010-04-08 | Udell John C | Apparatus and methods for translation of data formats between multiple interface types |
US20140337790A1 (en) * | 2013-05-10 | 2014-11-13 | Moonjung Kim | Mobile terminal and method for controlling the same |
US20150120278A1 (en) * | 2013-06-11 | 2015-04-30 | Facebook, Inc. | Translation and integration of presentation materials with cross-lingual multi-media support |
US20190037050A1 (en) * | 2013-03-15 | 2019-01-31 | Gadget Software, Inc. | User Interface and Content Translation System |
Family Cites Families (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7333507B2 (en) | 2001-08-31 | 2008-02-19 | Philip Bravin | Multi modal communications system |
US8886537B2 (en) | 2007-03-20 | 2014-11-11 | Nuance Communications, Inc. | Method and system for text-to-speech synthesis with personalized voice |
US8725513B2 (en) | 2007-04-12 | 2014-05-13 | Nuance Communications, Inc. | Providing expressive user interaction with a multimodal application |
-
2013
- 2013-10-18 US US14/057,463 patent/US9396442B2/en active Active
-
2014
- 2014-10-15 EP EP20140189076 patent/EP2863341A1/en not_active Withdrawn
-
2016
- 2016-06-17 US US15/185,222 patent/US20160292564A1/en not_active Abandoned
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20020122060A1 (en) * | 2000-12-18 | 2002-09-05 | Markel Steven O. | Wizard generating HTML web pages using XML and XSL |
US20030220973A1 (en) * | 2002-03-28 | 2003-11-27 | Min Zhu | Conference recording system |
US20070069973A1 (en) * | 2005-05-10 | 2007-03-29 | Gerbacia William E | Controlled and Monitored Remote Advertising and Information Display System |
US20100088438A1 (en) * | 2008-10-08 | 2010-04-08 | Udell John C | Apparatus and methods for translation of data formats between multiple interface types |
US20190037050A1 (en) * | 2013-03-15 | 2019-01-31 | Gadget Software, Inc. | User Interface and Content Translation System |
US20140337790A1 (en) * | 2013-05-10 | 2014-11-13 | Moonjung Kim | Mobile terminal and method for controlling the same |
US20150120278A1 (en) * | 2013-06-11 | 2015-04-30 | Facebook, Inc. | Translation and integration of presentation materials with cross-lingual multi-media support |
Also Published As
Publication number | Publication date |
---|---|
US9396442B2 (en) | 2016-07-19 |
US20150112896A1 (en) | 2015-04-23 |
EP2863341A1 (en) | 2015-04-22 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10255265B2 (en) | Process flow diagramming based on natural language processing | |
KR102351587B1 (en) | Initiating conversations with automated agents via selectable graphical elements | |
JP5794779B2 (en) | Client input method | |
CN101495965B (en) | Dynamic user experience with semantic rich objects | |
US10936288B2 (en) | Voice-enabled user interface framework | |
US20160306784A1 (en) | Audio Onboarding Of Digital Content With Enhanced Audio Communications | |
CN109992338B (en) | Method and system for exposing virtual assistant services across multiple platforms | |
Ramanarayanan et al. | Assembling the jigsaw: How multiple open standards are synergistically combined in the HALEF multimodal dialog system | |
JP2022105273A (en) | Computer-implemented method, computer-implemented system and computer program product for generating summaries and next actions in real time for multiple users from interaction records in natural language | |
KR102188564B1 (en) | Method and system for machine translation capable of style transfer | |
US20160292564A1 (en) | Cross-Channel Content Translation Engine | |
US11114092B2 (en) | Real-time voice processing systems and methods | |
Sateli et al. | Smarter mobile apps through integrated natural language processing services | |
Lee | Voice user interface projects: build voice-enabled applications using dialogflow for *** home and Alexa skills kit for Amazon Echo | |
Inupakutika et al. | Integration of NLP and Speech-to-text Applications with Chatbots | |
US20190347067A1 (en) | User interface interaction channel | |
CN117540805A (en) | Data processing method, device, electronic equipment and storage medium | |
US10142400B2 (en) | Context-sensitive information retrieval | |
Bisser et al. | Introduction to the microsoft conversational ai platform | |
Fume et al. | Implementation of Automatic Captioning System to Enhance the Accessibility of Meetings | |
Pereira et al. | Review of platforms and frameworks for building Virtual Assistants | |
US10559298B2 (en) | Discussion model generation system and method | |
Pathak et al. | Designing a multilingual virtual agent capable of interacting with uneducated people for automated data collection | |
Deshpande et al. | A survey of designing tools for chatbot application | |
Ofulue | Localisation of mobile Phone Technological terms: A case study of Yorùbá Language |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: NUANCE COMMUNICATIONS, INC., MASSACHUSETTS Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:FALARDEAU, SIMON;NANTEL, GERARD;SIGNING DATES FROM 20131016 TO 20131017;REEL/FRAME:038984/0478 |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO PAY ISSUE FEE |