WO2014155742A1 - 情報処理システム、情報処理システムの制御方法、情報処理装置、情報処理装置の制御方法、情報記憶媒体、及びプログラム - Google Patents
情報処理システム、情報処理システムの制御方法、情報処理装置、情報処理装置の制御方法、情報記憶媒体、及びプログラム Download PDFInfo
- Publication number
- WO2014155742A1 WO2014155742A1 PCT/JP2013/059765 JP2013059765W WO2014155742A1 WO 2014155742 A1 WO2014155742 A1 WO 2014155742A1 JP 2013059765 W JP2013059765 W JP 2013059765W WO 2014155742 A1 WO2014155742 A1 WO 2014155742A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- image
- character string
- translation
- converted
- original
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/40—Processing or translation of natural language
- G06F40/58—Use of machine translation, e.g. for multi-lingual retrieval, for server-side translation for client devices or for real-time translation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/40—Processing or translation of natural language
- G06F40/53—Processing of non-Latin text
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/94—Hardware or software architectures specially adapted for image or video understanding
- G06V10/95—Hardware or software architectures specially adapted for image or video understanding structured as a network, e.g. client-server architectures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/60—Type of objects
- G06V20/62—Text, e.g. of license plates, overlay texts or captions on TV images
- G06V20/635—Overlay text, e.g. embedded captions in a TV program
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
- G11B27/02—Editing, e.g. varying the order of information signals recorded on, or reproduced from, record carriers
- G11B27/031—Electronic editing of digitised analogue information signals, e.g. audio or video signals
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
- G06V30/10—Character recognition
- G06V30/28—Character recognition specially adapted to the type of the alphabet, e.g. Latin alphabet
- G06V30/287—Character recognition specially adapted to the type of the alphabet, e.g. Latin alphabet of Kanji, Hiragana or Katakana characters
Definitions
- the present invention relates to a browsing system, a browsing system control method, a terminal, a terminal control method, a server, a server control method, an information storage medium, and a program.
- an image including a character string such as “last day” used in bargains and the like and a background image such as a graphic for calling attention may be used. It would be convenient to have a function of reading a character string from such an image and translating it into another language and generating an image including the translated character string and a background image.
- Patent Document 1 discloses a server that receives an image request from a terminal and transmits an image with a character or character string specified by additional information specified by an image parameter specified in the received image request as an image response. Is disclosed.
- Patent Document 1 when there are a plurality of character strings added to an image, or when there are a plurality of images to which a character string is added, the processing load on the server tends to increase.
- the present invention has been made in view of the above problems, and an object thereof is an information processing system capable of avoiding concentration of processing, a control method for the information processing system, an information processing device, and a control method for the information processing device.
- An information storage medium and a program are provided.
- an information processing system partially converts a plurality of converted character strings obtained by converting a plurality of original character strings respectively added to at least one of one or a plurality of original images.
- An acquisition unit for acquiring the converted character string, and an area corresponding to the display region of the original character string in the original image to which the original character string corresponding to the acquired converted character string is added each time the converted character string is acquired A generating unit configured to generate a converted image in which the converted character string is arranged; and a display device that displays on a screen at least a part of an object including one or more images based on display information.
- Changing means for changing the foreground content of the arrangement area of the original image corresponding to the converted image generated by the generating means to the converted image.
- the control method of the information processing system acquires part of a plurality of converted character strings obtained by converting a plurality of original character strings respectively added to at least one of one or a plurality of original images.
- the converted character string is displayed in an area corresponding to the display area of the original character string in the original image to which the original character string corresponding to the acquired converted character string is added.
- a converted image generated by the generating means in the object is generated on a display device that generates a converted image in which the image is arranged and displays on the screen at least a part of the object including one or more images based on the display information.
- the content in the foreground of the arrangement area of the original image corresponding to the image is changed to the converted image.
- the information processing apparatus obtains a part of a plurality of converted character strings obtained by converting a plurality of original character strings respectively added to at least one of one or a plurality of original images.
- the converted character string is displayed in an area corresponding to the display area of the original character string in the original image to which the original character string corresponding to the acquired converted character string is added.
- the information processing apparatus control method also acquires a plurality of converted character strings obtained by converting a plurality of original character strings respectively added to at least one of one or a plurality of original images.
- the converted character string is displayed in an area corresponding to the display area of the original character string in the original image to which the original character string corresponding to the acquired converted character string is added.
- a converted image generated by the generating means in the object is generated on a display device that generates a converted image in which the image is arranged and displays on the screen at least a part of the object including one or more images based on the display information.
- the content in the foreground of the arrangement area of the original image corresponding to the image is changed to the converted image.
- the program of the present invention is an acquisition unit that acquires a plurality of converted character strings obtained by converting a plurality of original character strings respectively added to at least one of one or a plurality of original images, Each time the converted character string is acquired, the converted character string is arranged in an area corresponding to the display area of the original character string in the original image to which the original character string corresponding to the acquired converted character string is added.
- the generation unit that generates the converted image and the display unit that displays on the screen at least a part of the object including one or more images based on the display information.
- This is a program that causes a computer to function as changing means for changing the foremost contents of the arrangement area of the original image corresponding to the completed image to the converted image.
- the information storage medium of the present invention obtains a part of a plurality of converted character strings obtained by converting a plurality of original character strings respectively added to at least one of one or a plurality of original images.
- the converted character string is displayed in an area corresponding to the display area of the original character string in the original image to which the original character string corresponding to the acquired converted character string is added.
- Computer is a readable information storage medium.
- the acquisition unit may partially convert the plurality of converted character strings respectively corresponding to the plurality of original character strings according to an order based on the priority order for the plurality of original character strings. get.
- the priority may be set based on at least one of a display mode of the original character string and an arrangement position of the image to which the original character string is added in the object. Is set by
- the priority is set by setting means based on the size of the visual feature amount of the original character string in the object displayed based on the display information.
- the apparatus further includes the setting unit.
- receiving means for receiving an acquisition request for any of the images arranged in the forefront in the object from the display device that transmits the acquisition request at a predetermined timing for each image.
- the content of the foreground area of the image related to the acquisition request in the object is displayed on the forefront of the area generated by the generation means.
- the image is changed to a converted image having more converted character strings to be arranged than the arranged images.
- the information processing apparatus further includes range information acquisition means for acquiring range information indicating a range of the object displayed on the screen from the display device at a predetermined timing, and the setting means includes the range Decrease the priority of the original character string not included in the range indicated by the information by at least one step.
- the display device that transmits an acquisition request for an image corresponding to the original character string at a predetermined timing according to an order based on the priority order set by the setting unit may be the most recent in the object.
- the image processing apparatus further includes receiving means for receiving an acquisition request for any of the images arranged on the front surface, and the changing means receives an acquisition request for an image related to the acquisition request in the object each time the acquisition request is received.
- the foreground content is changed to a converted image that is generated by the generating means and has more converted character strings arranged than the image arranged in the foreground of the area.
- the changing unit may cause the display device to gradually convert the foreground content of the arrangement area of the original image corresponding to the generated converted image in the object to the converted image. Make changes.
- FIG. 1 It is a figure which shows an example of a structure of the browsing system which concerns on embodiment of this invention. It is a figure which shows an example of the hardware constitutions of an image server. It is a figure which shows an example of the page before translation. It is a figure which shows an example of the page after translation. It is a sequence diagram which shows the outline
- FIG. 1 is a diagram illustrating an example of a configuration of a browsing system 1 according to an embodiment of the present invention.
- the browsing system 1 includes a web server 2, an image server 3, a translation server 4, and a user terminal 10.
- the web server 2, the image server 3, the translation server 4, and the user terminal 10 are connected to the communication network 5 and can communicate with each other.
- the web server 2, the image server 3, and the translation server 4 communicate with the user terminal 10 in accordance with, for example, HTTP (Hypertext Transfer Protocol).
- the web server 2 is a server that provides a virtual shopping mall site, for example.
- the image server 3 includes, for example, a database that stores image data used in a virtual shopping mall site.
- the translation server 4 executes, for example, processing for translating the designated character string into another language.
- another application server may be provided with a function of executing processing for generating an image.
- the web server 2 and the image server 3 may be integrated.
- the HTTP daemon is activated in the web server 2 and the web browser is activated in the user terminal 10.
- a processing request (HTTP request) is transmitted from the user terminal 10 to the web server 2
- a corresponding processing result (HTTP response) is transmitted from the web server 2 to the user terminal 10.
- the web server 2 transmits page data described in a web page description language to the user terminal 10, and the user terminal 10 displays a page on the screen based on the received page data.
- FIG. 2 is a diagram illustrating an example of a hardware configuration of the image server 3.
- the image server 3 is realized by, for example, a desktop computer or a laptop computer.
- the image server 3 includes a control unit 11, a storage unit 12, an optical disc drive unit 13, a communication interface unit 14, an operation unit 15, a display unit 16, and an audio output unit 17.
- the control unit 11 includes, for example, one or a plurality of microprocessors, and executes information processing according to an operating system or a program stored in the storage unit 12.
- the storage unit 12 includes, for example, a RAM, a hard disk, or a solid state drive.
- the optical disk drive unit 13 reads programs and data stored on an optical disk (information storage medium).
- the program and data are supplied to the storage unit 12 via the optical disc. That is, the program and data are read from the optical disk by the optical disk drive unit 13 and stored in the storage unit 12.
- the image server 3 may include a component for reading a program or data stored in an information storage medium (for example, a memory card) other than the optical disk. And a program and data may be supplied to the memory
- the communication interface unit 14 is an interface for connecting the image server 3 to a communication network.
- the image server 3 can exchange data with other devices via a communication network.
- the program and data may be supplied to the storage unit 12 via a communication network.
- the operation unit 15 is for a user to perform an operation.
- a keyboard, a mouse, a touch pad, a touch panel, a stick (lever), or the like corresponds to the operation unit 15.
- the display unit 16 is, for example, a liquid crystal display or an organic EL display.
- the audio output unit 17 is, for example, a speaker or a headphone terminal.
- the user terminal 10, the web server 2, and the translation server 4 also have the same configuration as the image server 3 described above.
- FIG. 3A is a diagram illustrating an example of an original page before translation (hereinafter referred to as pre-translation page 6). That is, the pre-translation page 6 is a page that is displayed when the page data held by the web server 2 is processed by the user terminal 10 without undergoing translation processing by the translation server 4 or the like.
- the pre-translation page 6 is a page displayed based on page data as display information, and includes a character string (hereinafter referred to as a pre-translation character string 61).
- the pre-translation character string 61 is a character string described in the page data and displayed in the pre-translation page 6.
- the pre-translation character string 61 is a character string described in a “body” tag.
- the pre-translation character string 61 is a Japanese character string “currently in super sale. Please enjoy shopping.”
- the pre-translation page 6 includes an original image (hereinafter referred to as a pre-translation image 7) in which a character string is represented.
- the pre-translational image 7 is an image whose location is described in the page data and is displayed in the pre-translation page 6. For example, in the case of page data described in HTML, a URL (Uniform Resource Locator) indicating the location of the pre-translation image 7 is described in the “img” tag.
- URL Uniform Resource Locator
- the pre-translational image 7 includes, for example, a background image 71 in which a plurality of character strings (hereinafter referred to as pre-translation character strings 72 and 74) are written on the background image 71, and a plurality of pre-translation character strings 72 and 74.
- This is a converted image.
- the first pre-translation character string 72 is arranged relatively large in the center portion of the background image 71.
- the first pre-translation character string 72 is a Japanese character string “last date” representing the last date such as a bargain.
- the second pre-translation character string 74 is arranged relatively small at a position away from the center of the background image 71 and is less conspicuous than the first pre-translation character string 72.
- the second pre-translation character string 74 is a Japanese character string “until 12:00” representing a more specific end time on the last day, for example.
- the pre-translation character strings 72 and 74 are often written in a conspicuous color different from the background image 71.
- the pre-translation character strings 72 and 74 are often written in a single color, and are often aligned in the horizontal direction, vertical direction, or diagonal direction.
- FIG. 3B is a diagram illustrating an example of the translated page 8.
- the post-translation page 8 includes the pre-translation character string 61 described in the pre-translation page 6 in FIG. 3A and the pre-translation character strings 72 and 74 represented in the pre-translation image 7 included in the pre-translation page 6.
- the translated page 8 includes a translated character string (hereinafter referred to as a translated character string 81).
- the translated character string 81 is an English character string “Now ⁇ on Super Sale. Please enjoy your shopping. ”.
- the post-translation page 8 converts an image (hereinafter referred to as a post-translation image 9) representing a character string (hereinafter referred to as post-translation character strings 92 and 94) obtained by translating the pre-translation character strings 72 and 74. It is included as a finished image.
- the post-translational image 9 is an image in which the post-translation character strings 92 and 94 are written on the same background image 71 as the pre-translational image 71 and the background image 71 and post-translation character strings 92 and 94 are integrated.
- the first post-translation character string 92 is arranged relatively large in the center portion of the background image 71, like the first pre-translation character string 72.
- the first post-translation character string 92 is an English character string “FINAL DAY” corresponding to Japanese, for example, the last day.
- the second post-translation character string 94 is disposed relatively small at a position away from the center of the background image 71.
- the second post-translation character string 94 is an English character string “until 12mp.m.” corresponding to Japanese, for example, until 12:00 pm.
- a Japanese character string is translated into an English character string, but the combination of the pre-translation language and the post-translation language is not limited to this mode.
- the character string may be converted into different types of characters in the same language. For example, a kanji character string may be converted into a hiragana character string or a katakana character string. Further, the number of characters included in the character string is not limited to a plurality and may be one.
- FIG. 4 is a sequence diagram showing an outline of an example of processing of the browsing system 1.
- the user terminal 10 transmits a translation request to the translation server 4.
- the translation request includes location information indicating the location of the original page data to be translated.
- the location information represents the location of the original page data held by the web server 2.
- the translation request includes language designation information indicating the pre-translation language and the post-translation language designated by the user.
- the translation server 4 transmits a page request for requesting the original page data to be translated to the web server 2 based on the location information included in the received translation request.
- the web server 2 transmits the original page data to be translated to the translation server 4 based on the received page request.
- the translation server 4 translates the received original page data to be translated.
- the translation server 4 converts the original page data described in the pre-translation language into page data described in the post-translation language (hereinafter referred to as post-translation page data) based on the language designation information included in the received translation request. Convert.
- the target to be converted into the post-translation language is a pre-translation character string 61 displayed in the pre-translation page 6.
- a character string described in a “body” tag is targeted.
- the translation server 4 adds language designation information to the post-translation page data.
- the translation server 4 transmits the generated post-translation page data to the user terminal 10.
- the user terminal 10 draws a translated page that does not include an image on the screen of the display unit, and transmits an image request for requesting image data to the image server 3.
- the image request includes location information indicating the location of the image data specified by the post-translation page data.
- the location information represents the location of the pre-translational image data held by the image server 3.
- the location of the pre-translation image 7 displayed in the pre-translation page 6 is represented in the location information.
- language designation information is added to the image request. The addition of language designation information is realized, for example, when the user terminal 10 executes a script process designated by page data.
- the image server 3 executes a series of processes from S107 onward when language designation information indicating that the original page data is translated is added to the received image request.
- language designation information indicating that the original page data is translated is added to the received image request.
- the image server 3 specifies the region of the pre-translation character string represented in the pre-translation image data specified by the image request.
- the image server 3 determines the translation priority for the pre-translation character string in which the area is specified (an example of a function as a setting unit). In other words, the image server 3 determines the order in which a plurality of post-translation character strings are acquired part by part.
- the image server 3 performs a partial translation process (SP1) on a part of pre-translation character strings to which the first priority is assigned. Specifically, the image server 3 acquires the character data of the pre-translation character string having the first priority (S109), and transmits a translation request including the character data and language designation information to the translation server 4 (S110). ). The translation server 4 translates the pre-translation character string having the first priority (S111), and transmits the character data of the post-translation character string to the image server 3 (S112). Next, the image server 3 generates post-translational image data representing the acquired post-translation character string (S113). As described above, the image server 3 acquires a part of the translated character string and generates post-translational image data in which the character string is represented (an example of an acquisition unit and a function as a generation unit).
- SP1 partial translation process
- the image server 3 transmits the post-translational image data acquired by the partial translation process (SP1) to the user terminal 10.
- the image server 3 performs a partial translation process (SP2) on a part of the pre-translation character string to which the second priority is assigned.
- the contents of the partial translation process (SP2) are the same as the partial translation process (SP1) described above.
- the image server 3 obtains another part of the post-translation character string and generates post-translational image data in which it is represented. Such partial translation processing is repeated until partial translation processing is executed for all pre-translation character strings.
- the image server 3 adds order information indicating the order of generation to the post-translational image data that is sequentially generated. Further, the image server 3 adds an end notification to the post-translational image data generated last.
- the post-translational image data sequentially generated by the image server 3 is accumulated in a database (not shown), and is read out in order from the oldest in response to an image request from the user terminal 10 and transmitted to the user terminal 10. Is done.
- the user terminal 10 draws the acquired post-translation image data in the post-translation page displayed on the screen of the display unit (an example of a function as a changing unit).
- the user terminal 10 further transmits an image request to the image server 3.
- the user terminal 10 transmits an image request to the image server 3 at every predetermined timing. For example, an image request is transmitted after a predetermined time has elapsed since the previous image acquisition or at regular intervals.
- the image server 3 transmits the post-translation data generated next to the post-translational image data transmitted in S114 to the user terminal 10.
- the user terminal 10 draws the acquired post-translational image data in the post-translation page displayed on the screen of the display unit (an example of a function as a changing unit).
- the transmission of the image request by the user terminal 10 is repeated until it is detected that an end notification is added to the received post-translational image data.
- the image server 3 transmits the image data before translation to the user terminal 10, and the user terminal 10 translates in the page after translation. After drawing the previous image data, the user terminal 10 may repeatedly transmit an image request for acquiring the translated image data.
- the process of generating post-translational image data is performed by the image server 3, but is not limited thereto, and may be performed by the web server 2 or another application server.
- FIG. 5 is a diagram illustrating an example of a processing flow of the image server 3.
- the processing flow shown in this figure is realized, for example, when the control unit of the image server 3 executes a program stored in the storage unit.
- FIG. 6 is a diagram illustrating an example of a processing flow of the user terminal 10. The processing flow shown in this figure is realized, for example, when the control unit of the user terminal 10 executes script processing specified by page data.
- FIG. 7A is a diagram showing an example of the pre-translational image 7 processed in this example.
- This pre-translational image 7 is the same as that shown in FIG. 3A. That is, the pre-translational image 7 is, for example, an image in which the background image 71 and the plurality of pre-translation character strings 72 and 74 are integrated.
- the first pre-translation character string 72 is a Japanese character string “last day”, for example, and is relatively large in the center of the background image 71.
- the second pre-translation character string 74 is a Japanese character string “until 12 pm”, for example, and is arranged relatively small at a position away from the center of the background image 71, and the first pre-translation character Less noticeable than row 72.
- FIG. 7B is a diagram showing an example of a post-translational image 9A after partial translation
- FIG. 7C is a diagram showing an example of a post-translational image 9B after full translation.
- the image server 3 receives an image request from the user terminal 10. Location information indicating the location of the pre-translation image 7 and language designation information are added to the image request.
- the image server 3 acquires the pre-translation image 7 specified by the received image request from an image database (not shown).
- the image server 3 identifies areas including the pre-translation character strings 72 and 74 (hereinafter referred to as character string areas 77 and 79) in the pre-translation image 7, respectively.
- the broken line surrounding the first pre-translation character string 72 represents the character string region 77 of the first pre-translation character string 72
- the broken line surrounding the second pre-translation character string 74 is the second Represents a character string region 79 of the pre-translation character string 74.
- Such a character string area is specified as part of a known character recognition process called OCR (Optical Character Recognition), for example.
- OCR Optical Character Recognition
- each character included in the character string is recognized by specifying a character string region in the image and collating the character pattern in the region with a pre-registered character pattern.
- the image server 3 determines the translation priority for the pre-translation character strings 72 and 74 in which the character string regions 77 and 79 are specified. For example, the image server 3 determines the priority of translation based on the display mode of the pre-translation character strings 72 and 74.
- the display mode includes, for example, the position where the character string is arranged, the size of the character string, the color of the character string itself, and the color difference between the character string and the background.
- the priority is determined, for example, a higher priority is assigned to a character string having a more conspicuous display mode.
- a technique for identifying a conspicuous location in an image for example, there is a saliency map.
- the first pre-translation character string 72 is larger than the second pre-translation character string 74 and closer to the center, so it is determined that the first pre-translation character string 72 is more noticeable.
- a higher priority than the second pre-translation character string 74 is assigned to the character string 72.
- the image server 3 acquires character data representing the first pre-translation character string 72 having a high priority among the pre-translation character strings 72 and 74 in the pre-translation image 7.
- the character data includes, for example, a character code for each character.
- a known character recognition process is applied to the acquisition of character data.
- a plurality of pre-translation character strings 72 and 74 shown in the pre-translation image 7 are targeted for translation, and their character data are extracted by character recognition processing.
- the present invention is not limited to this mode. 6 or the character string added to the pre-translational image 7 so as to be readable can be used as a translation target, and the character data can be read therefrom.
- a character string with an alt attribute that does not appear in the page may be described in the “img” tag. Character data may be acquired from the data.
- the image server 3 transmits to the translation server 4 a translation request including the acquired character data representing the first pre-translation character string 72 and language designation information.
- the image server 3 receives the character data of the first post-translation character string 92 corresponding to the first pre-translation character string 72 translated by the translation server 4.
- the first translated character string 92 is, for example, an English character string “FINAL DAY”.
- the image server 3 generates a post-translational image 9A so as to represent the first post-translation character string 92. Specifically, the image server 3 acquires a character image representing the first post-translation character string 92 from a font database (not shown) and synthesizes it with the pre-translational image 7. Thereby, a post-translational image 9A after partial translation as shown in FIG. 7B is generated. That is, in the post-translational image 9A after partial translation, only the first pre-translation character string 72 is replaced with the first post-translation character string 92, and the second pre-translation character string 74 remains untranslated. .
- the character string region 97 of the first post-translation character string 92 is replaced with the character string region 77 of the first pre-translation character string 72 (see FIG. 7A).
- the position, size, etc. of the character image are adjusted so as to cover all the reference.
- background pixels other than the pixels constituting the character image are, for example, the character string region 77 (see FIG. 7A) of the first pre-translation character string 72.
- the color is the same as that of the background pixel.
- the image server 3 temporarily stores the generated partially translated image 9A after partial translation in a database (not shown). Order information representing the first generation is added to the post-translational image 9A after partial translation stored here.
- the image server 3 executes the processing of S35 to S39 for the second pre-translation character string 74 having a low priority among the pre-translation character strings 72 and 74 in the pre-translation image 7 (S40: NO). ).
- the image server 3 acquires character data representing the second pre-translation character string 74 having a low priority among the pre-translation character strings 72 and 74 in the pre-translation image 7.
- the image server 3 transmits a translation request including the character data representing the acquired second pre-translation character string 74 and language designation information to the translation server 4.
- the image server 3 receives the character data of the second post-translation character string 94 corresponding to the second pre-translation character string 74 translated by the translation server 4.
- the second translated character string 94 is, for example, an English character string “until ⁇ 12 p.m. ”.
- the image server 3 generates the post-translational image 9B so as to represent the first post-translation character string 92 and the second post-translation character string 94. Specifically, the image server 3 acquires a character image representing the second post-translation character string 94 from a font database (not shown), and synthesizes it with a partially translated image 9A. As a result, a post-translational image 9B after full translation as shown in FIG. 7C is generated. That is, in the post-translational image 9B after full translation, both the first pre-translation character string 72 and the second pre-translation character string 72 are converted into the first post-translation character string 92 and the second post-translation character string 94. Has been replaced.
- the character string region 99 of the second post-translation character string 94 is replaced with the character string region 79 (see FIG. 7A) of the second pre-translation character string 74.
- the position, size, etc. of the character image are adjusted so as to cover all the reference.
- background pixels other than the pixels constituting the character image are, for example, the character string area 79 (see FIG. 7A) of the second pre-translation character string 74.
- the color is the same as that of the background pixel.
- the image server 3 temporarily stores the generated post-translational image 9B after translation in a database (not shown).
- the post-translational image 9B after all translations stored here is appended with order information indicating the second generation and an end notification indicating the end.
- the user terminal 10 receives a partially translated image 9A from the image server 3 after translation.
- the user terminal 10 draws a partially translated image 9 ⁇ / b> A in the translated page 8.
- the user terminal 10 determines whether or not the update timing has arrived. When the update timing comes (S14: YES), the user terminal 10 transmits an image request to the image server 3 in S15.
- the user terminal 10 receives the translated image 9B after translation from the image server 3.
- the user terminal 10 renders the post-translational image 9 ⁇ / b> B after translation in the post-translation page 8.
- FIG. 8 is a diagram showing an example of a drawing process when the partially translated image 9A after partial translation is replaced with the completely translated image 9B after translation.
- the user terminal 10 increases the rate at which the pixels of the post-translational image 9B after the entire translation replace the pixels of the post-translational image 9A after the partial translation with time. Thereby, the post-translational image 9A after partial translation is gradually replaced with the post-translational image 9B after translation.
- the user terminal 10 divides the post-translational image 9B after all translation into block units including one or a plurality of pixels, and gradually increases the number of blocks to be displayed over time.
- the mode of increasing the blocks may be a mode in which the blocks gradually increase while being dispersed, or a mode in which the blocks increase from one side toward the other side, and are not particularly limited.
- images that gradually become clear as the download progresses such as progressive JPEG or interlaced GIF, may be used.
- FIG. 9 is a diagram illustrating an example of a processing flow of the image server 3. Regarding steps similar to those in the first processing example, a part of the detailed description is omitted by sharing step numbers.
- FIG. 10A is a diagram illustrating an example of the pre-translation page 6 including a plurality of pre-translation images 170 and 270 processed in this example.
- the first pre-translational image 170 is, for example, an image in which the background image 171 and the pre-translation character string 172 are integrated.
- the pre-translation character string 172 is a Japanese character string “super sale”, for example.
- the first pre-translational image 170 is arranged relatively large over the entire upper part of the pre-translation page 6.
- the second pre-translational image 270 is, for example, an image in which the background image 271 and the pre-translation character string 272 are integrated.
- the pre-translation character string 272 is, for example, a Japanese character string “Would you like to open a shop?”.
- the second pre-translational image 270 is arranged relatively small in the lower right of the pre-translation page 6 and is less noticeable than the first pre-translational image 170.
- FIG. 10B is a diagram illustrating an example of a post-translation page 8A after partial translation
- FIG. 10C is a diagram illustrating an example of a post-translation page 8B after full translation.
- the user terminal 10 transmits an image request according to a predetermined order for the pre-translation images 170 and 270, and repeats this until all the translations are completed.
- the image server 3 executes the processing shown in FIG. In the example described below, it is assumed that the image server 3 first receives an image request for the first pre-translational image 170 and then receives an image request for the second pre-translational image 270.
- the image server 3 receives an image request for the first pre-translational image 170 from the user terminal 10. Location information indicating the location of the first pre-translation image 170 and language designation information are added to the image request.
- the image server 3 acquires the first pre-translation image 170 specified by the received image request from an image database (not shown).
- the image server 3 acquires image position information indicating the position of the first pre-translation image 170 in the pre-translation page 6.
- image position information may be acquired by acquiring page data from the user terminal 10, the web server 2, or the translation server 4 and analyzing it, or an image request transmitted from the user terminal 10 in S31. Image position information may be added to the.
- the image server 3 specifies the character string area of the first pre-translation character string 172 in the first pre-translation image 170.
- the image server 3 determines the translation priority for the first pre-translation character string 172. For example, the image server 3 determines the translation priority based on the position of the first pre-translation image 170 in the pre-translation page 6.
- a higher priority is assigned to the pre-translation character string of the pre-translation image that occupies a more conspicuous position in the page.
- a technique for identifying a conspicuous portion in a page for example, there is a saliency map.
- the first pre-translation image 170 occupies many conspicuous portions in the pre-translation page 6, the first pre-translation image 170 added to the first pre-translation image 170 A first priority is assigned to the character string 172.
- the image server 3 determines whether or not to translate the first pre-translation character string 172 based on the priority. In this example, since the first priority is assigned to the first pre-translation character string 172, it is determined to be translated (S344: YES).
- the image server 3 acquires character data representing the first pre-translation character string 172 from the first pre-translation image 170.
- the image server 3 transmits to the translation server 4 a translation request including the acquired character data representing the first pre-translation character string 172 and language designation information.
- the image server 3 receives the character data of the first post-translation character string 192 corresponding to the first pre-translation character string 172 translated by the translation server 4.
- the first translated character string 192 is, for example, an English character string “Super ⁇ Sale”.
- the image server 3 generates the first post-translation image 190 so as to represent the first post-translation character string 192. Specifically, the image server 3 synthesizes a character image representing the first post-translation character string 192 with the first pre-translation image 170. Thereby, a first post-translational image 190 as shown in FIG. 10B is generated.
- the image server 3 temporarily stores the generated first translated image 190 in a database (not shown).
- the first post-translation image 190 stored here is added with an end notification indicating that the translation has been completed.
- the image server 3 receives an image request for the second pre-translational image 270 from the user terminal 10. Location information indicating the location of the second pre-translational image 270 and language designation information are added to the image request.
- the image server 3 acquires the second pre-translational image 270 specified by the received image request from an image database (not shown).
- the image server 3 acquires image position information indicating the position of the second pre-translation image 270 in the pre-translation page 6.
- the image server 3 specifies the character string area of the second pre-translation character string 272 in the second pre-translation image 270.
- the image server 3 determines the translation priority for the second pre-translation character string 272. For example, the image server 3 determines the translation priority based on the position of the second pre-translation image 270 in the pre-translation page 6.
- the second pre-translation image 270 since the second pre-translation image 270 does not occupy many conspicuous portions in the pre-translation page 6, the second pre-translation image 270 added to the second pre-translation image 270.
- a second priority is assigned to the character string 272.
- the image server 3 determines whether or not to translate the second pre-translation character string 272 based on the priority. In this example, since the second priority is assigned to the second pre-translation character string 272, it is determined not to translate (S344: NO).
- the user terminal 10 acquires the first post-translation image 190 that has been translated in response to the image request for the first pre-translation image 170, and the second pre-translation image 190 In response to the image request for the image 270, the second pre-translational image 270 that is not translated can be acquired.
- a post-translation page 8A after partial translation as shown in FIG. 10B is displayed. In other words, in the post-translation page 8A after partial translation, only the first pre-translation image 170 is replaced with the first post-translation image 190, and the second pre-translation image 270 remains untranslated.
- the image server 3 receives the second round image request from the user terminal 10.
- the user terminal 10 can omit the transmission of an image request for the first pre-translational image 170 that has already been translated.
- the image server 3 receives the image request for the second pre-translational image 270.
- the image server 3 acquires the second pre-translation image 270 and the image position information, specifies the character string area of the second pre-translation character string 272, and prioritizes the translation. To decide.
- S32 to S34 can be omitted.
- the image server 3 determines whether or not to translate the second pre-translation character string 272 based on the priority.
- the second pre-translation character string 272 to which the second priority is assigned is the target of translation (S344: YES).
- the image server 3 acquires character data representing the second pre-translation character string 272 from the second pre-translation image 270.
- the image server 3 transmits a translation request including character data representing the acquired second pre-translation character string 272 and language designation information to the translation server 4.
- the image server 3 receives the character data of the second post-translation character string 292 corresponding to the second pre-translation character string 272 translated by the translation server 4.
- the second translated character string 292 is, for example, an English character string “Would ⁇ you like to open your shop? ”.
- the image server 3 generates the second translated image 290 so as to represent the second translated character string 292. Specifically, the image server 3 synthesizes a character image representing the second post-translation character string 292 with the second pre-translation image 270. As a result, a second post-translational image 290 as shown in FIG. 10C is generated.
- the image server 3 temporarily stores the generated second translated image 290 in a database (not shown).
- the second post-translational image 290 stored here is appended with an end notification indicating that the translation has been completed.
- the user terminal 10 can acquire the second translated image 290 that has been translated in response to the image request for the second untranslated image 270. is there.
- a post-translation page 8B after all translation as shown in FIG. 10C is displayed. That is, in the post-translation page 8B after all translation, both the pre-translation images 170 and 270 are replaced with the post-translation images 190 and 290.
- the user terminal 10 detects the end notification of both the translated images 190 and 290, the user terminal 10 ends the transmission of the image request.
- the user terminal 10 transmits an image request for the pre-translation images 170 and 270 in a predetermined order.
- the present invention is not limited to this mode, and the image server 3 transmits an image request for the pre-translation images 170 and 270.
- the order may be determined based on the priority and specified for the user terminal 10.
- FIG. 11 is a diagram illustrating an example of a processing flow of the image server 3. Regarding steps similar to those in the first processing example and the second processing example, a part of the detailed description is omitted by sharing the step numbers.
- FIG. 12A is a diagram illustrating an example of the pre-translation page 6 including a plurality of pre-translation images 170, 270, and 370 processed in this example.
- the first pre-translational image 170 and the second pre-translational image 270 are the same as in the second processing example.
- the third pre-translational image 370 is, for example, an image in which the background image 371 and the pre-translation character string 372 are integrated.
- the pre-translation character string 372 is, for example, a Japanese character string “shopping basket”.
- the third pre-translational image 370 is arranged at the top of the pre-translation page 6.
- FIG. 12B is a diagram illustrating an example of a post-translation page 8A after partial translation
- FIG. 12C is a diagram illustrating an example of a post-translation page 8B after full translation.
- the pre-translation page 6 is vertically long and cannot be fully displayed on the display screen of the user terminal 10, so the user needs to scroll the display range.
- a broken line shown in FIG. 12A represents the current display range 100 of the user terminal 10. That is, in the state of FIG. 12A, the pre-translation character string 61 and the pre-translation images 170 and 370 that are within the display range 100 are displayed on the user terminal 10, and the pre-translation image 270 that is outside the display range 100 is displayed. Is not displayed.
- the user terminal 10 transmits image requests according to a predetermined order for the pre-translation images 170, 270, and 370, and repeats this until all the translations are completed.
- the image server 3 executes the processing shown in FIG. In the example described below, the image server 3 first receives an image request for the first pre-translational image 170, then receives an image request for the second pre-translational image 270, and then receives a third pre-translational image. Assume that an image request for image 370 is received.
- the image server 3 receives an image request for the first pre-translational image 170 from the user terminal 10. Location information indicating the location of the first pre-translation image 170 and language designation information are added to the image request.
- the image server 3 acquires the first pre-translation image 170 specified by the received image request from an image database (not shown).
- the image server 3 acquires image position information indicating the position of the first pre-translation image 170 in the pre-translation page 6.
- image position information may be acquired by acquiring page data from the user terminal 10, the web server 2, or the translation server 4 and analyzing it, or an image request transmitted from the user terminal 10 in S31. Image position information may be added to the.
- the image server 3 acquires current position information indicating the position of the current display range 100 of the user terminal 10 from the user terminal 10.
- the image server 3 specifies the character string area of the first pre-translation character string 172 in the first pre-translation image 170.
- the image server 3 determines the translation priority for the first pre-translation character string 172. For example, the image server 3 determines the priority of translation based on the position of the current display range 100 of the user terminal 10.
- a higher priority is assigned to the pre-translation character string of the pre-translation image included in the display range 100 or the pre-translation character string of the pre-translation image close to the display range 100.
- the first pre-translation character string 172 added to the first pre-translation image 170 is A priority of 1 is assigned.
- the image server 3 determines whether or not to translate the first pre-translation character string 172 based on the priority. In this example, since the first priority is assigned to the first pre-translation character string 172, it is determined to be translated (S344: YES).
- the image server 3 acquires character data representing the first pre-translation character string 172 from the first pre-translation image 170.
- the image server 3 transmits to the translation server 4 a translation request including the acquired character data representing the first pre-translation character string 172 and language designation information.
- the image server 3 receives the character data of the first post-translation character string 192 corresponding to the first pre-translation character string 172 translated by the translation server 4.
- the first translated character string 192 is, for example, an English character string “Super ⁇ Sale”.
- the image server 3 generates the first post-translation image 190 so as to represent the first post-translation character string 192. Specifically, the image server 3 synthesizes a character image representing the first post-translation character string 192 with the first pre-translation image 170. As a result, a first post-translational image 190 as shown in FIG. 12B is generated.
- the image server 3 temporarily stores the generated first translated image 190 in a database (not shown).
- the first post-translation image 190 stored here is added with an end notification indicating that the translation has been completed.
- the image server 3 receives an image request for the second pre-translational image 270 from the user terminal 10. Location information indicating the location of the second pre-translational image 270 and language designation information are added to the image request.
- the image server 3 acquires the second pre-translational image 270 specified by the received image request from an image database (not shown).
- the image server 3 acquires image position information indicating the position of the second pre-translation image 270 in the pre-translation page 6.
- the image server 3 acquires current position information indicating the position of the current display range 100 of the user terminal 10 from the user terminal 10.
- the image server 3 specifies the character string area of the second pre-translation character string 272 in the second pre-translation image 270.
- the image server 3 determines the translation priority for the second pre-translation character string 272. For example, the image server 3 determines the priority of translation based on the position of the current display range 100 of the user terminal 10.
- the second pre-translation character string 272 added to the second pre-translation image 270 A priority of 2 is assigned.
- the image server 3 determines whether or not to translate the second pre-translation character string 272 based on the priority. In this example, since the second priority is assigned to the second pre-translation character string 272, it is determined not to translate (S344: NO).
- the image server 3 receives an image request for the third pre-translational image 370 from the user terminal 10. Location information indicating the location of the third pre-translational image 370 and language designation information are added to the image request.
- the image server 3 acquires the first pre-translation image 170 specified by the received image request from an image database (not shown).
- the image server 3 acquires image position information indicating the position of the first pre-translation image 170 in the pre-translation page 6.
- the image server 3 acquires current position information indicating the position of the current display range 100 of the user terminal 10 from the user terminal 10.
- the image server 3 identifies the character string area of the third pre-translation character string 372 in the third pre-translation image 370.
- the image server 3 determines the translation priority for the third pre-translation character string 372. For example, the image server 3 determines the priority of translation based on the position of the current display range 100 of the user terminal 10.
- the third pre-translation character string 372 added to the third pre-translation image 370 is also displayed.
- a first priority is assigned.
- the image server 3 determines whether or not to translate the third pre-translation character string 372 based on the priority. In this example, since the first priority is also assigned to the third pre-translation character string 372, it is determined to be translated (S344: YES).
- the image server 3 acquires character data representing the third pre-translation character string 372 from the third pre-translation image 370.
- the image server 3 transmits a translation request including the character data representing the acquired third pre-translation character string 372 and language designation information to the translation server 4.
- the image server 3 receives the character data of the third post-translation character string 392 corresponding to the third pre-translation character string 372 translated by the translation server 4.
- the third post-translation character string 392 is, for example, an English character string “Shopping Cart”.
- the image server 3 generates the third post-translational image 190 so as to represent the third post-translation character string 392. Specifically, the image server 3 synthesizes a character image representing the third post-translation character string 392 with the third pre-translation image 370. As a result, a third post-translational image 390 as shown in FIG. 12B is generated.
- the image server 3 temporarily stores the generated third translated image 190 in a database (not shown).
- the third post-translational image 190 stored here is added with an end notification indicating that the translation has been completed.
- the user terminal 10 acquires the first post-translation image 190 that has been translated in response to the image request for the first pre-translation image 170, and the second pre-translation image 190 A second untranslated image 270 that is not translated is acquired for the image request of the image 270, and a third translated image 390 that is translated for the image request of the third untranslated image 370 is obtained. It is in a situation that can be acquired. In this case, a post-translation page 8A after partial translation as shown in FIG. 12B is displayed.
- the post-translation page 8A after partial translation only the first pre-translation image 170 and the third pre-translation image 370 are replaced with the first post-translation image 190 and the third post-translation image 390.
- the second pre-translational image 270 remains untranslated.
- the image server 3 receives the second round image request from the user terminal 10.
- the user terminal 10 can omit the transmission of image requests for the first pre-translation image 170 and the third pre-translation image 370 that have already been translated.
- the image server 3 receives the image request for the second pre-translational image 270.
- the image server 3 acquires the second pre-translational image 270, the image position information, and the current position information, and specifies the character string area of the second pre-translation character string 272. , Determine translation priority.
- S32 to S34 can be omitted.
- the image server 3 determines whether or not to translate the second pre-translation character string 272 based on the priority.
- the second pre-translation character string 272 to which the second priority is assigned is the target of translation (S344: YES).
- the image server 3 acquires character data representing the second pre-translation character string 272 from the second pre-translation image 270.
- the image server 3 transmits a translation request including the character data representing the acquired second pre-translation character string 272 and language designation information to the translation server 4.
- the image server 3 receives the character data of the second post-translation character string 292 corresponding to the second pre-translation character string 272 translated by the translation server 4.
- the second translated character string 292 is, for example, an English character string “Would ⁇ you like to open your shop? ”.
- the image server 3 generates the second translated image 290 so as to represent the second translated character string 292. Specifically, the image server 3 synthesizes a character image representing the second post-translation character string 292 with the second pre-translation image 270. As a result, a second post-translational image 290 as shown in FIG. 12C is generated.
- the image server 3 temporarily stores the generated second translated image 290 in a database (not shown).
- the second post-translational image 290 stored here is appended with an end notification indicating that the translation has been completed.
- the user terminal 10 can acquire the second translated image 290 that has been translated in response to the image request for the second untranslated image 270. is there.
- a post-translation page 8B after all translations as shown in FIG. 12C is displayed. That is, in the post-translation page 8B after all translation, all the pre-translation images 170, 270, and 370 are replaced with post-translation images 190, 290, and 390.
- the user terminal 10 detects all the end notifications of the translated images 190, 290, and 390, the user terminal 10 ends the transmission of the image request.
- the user terminal 10 transmits the image request for the pre-translation images 170, 270, and 370 according to a predetermined order.
- the present invention is not limited to this mode.
- the order in which the requests are transmitted may be determined based on the priority and specified to the user terminal 10.
- the second processing example, and the third processing example may be appropriately combined. .
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Artificial Intelligence (AREA)
- General Engineering & Computer Science (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Computational Linguistics (AREA)
- General Health & Medical Sciences (AREA)
- Health & Medical Sciences (AREA)
- Data Mining & Analysis (AREA)
- Software Systems (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Bioinformatics & Computational Biology (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Evolutionary Biology (AREA)
- Evolutionary Computation (AREA)
- Life Sciences & Earth Sciences (AREA)
- Information Transfer Between Computers (AREA)
Abstract
Description
図5は、画像サーバ3の処理フローの一例を示す図である。この図に示される処理フローは、例えば、画像サーバ3の制御部が記憶部に記憶されているプログラムを実行することによって実現される。図6は、ユーザ端末10の処理フローの一例を示す図である。この図に示される処理フローは、例えば、ユーザ端末10の制御部がページデータで指定されるスクリプト処理を実行することによって実現される。これら図5及び図6に示される処理例は、上記図4に示されるS107以降の一連の処理に対応する。
図9は、画像サーバ3の処理フローの一例を示す図である。上記第1の処理例と類似するステップについては、ステップ番号を共通にすることで詳細な説明を一部省略する。
図11は、画像サーバ3の処理フローの一例を示す図である。上記第1の処理例及び第2の処理例と類似するステップについては、ステップ番号を共通にすることで詳細な説明を一部省略する。
Claims (14)
- 1又は複数の元画像の少なくとも何れかにそれぞれ付加された複数の元文字列をそれぞれ変換してなる複数の変換済み文字列を一部ずつ取得する取得手段と、
前記変換済み文字列を取得する毎に、該取得した変換済み文字列に対応する元文字列が付加された元画像における該元文字列の表示領域に相当する領域に該変換済み文字列が配置された変換済み画像を生成する生成手段と、
表示情報に基づいて1又は複数の画像を含むオブジェクトの少なくとも一部を画面に表示する表示装置に、該オブジェクト内における前記生成手段により生成された変換済み画像に対応する元画像の配置領域の最前面の内容を該変換済み画像に変更させる変更手段と、
を備える情報処理システム。 - 前記取得手段は、前記複数の元文字列に対する優先順位に基づく順序にしたがって、該複数の元文字列にそれぞれ対応する前記複数の変換済み文字列を一部ずつ取得する、
請求項1に記載の情報処理システム。 - 前記優先順位は、前記元文字列の表示態様と、前記オブジェクト内における前記元文字列が付加された画像の配置位置と、の少なくともいずれかに基づいて設定手段により設定される、
請求項2に記載の情報処理システム。 - 前記優先順位は、前記表示情報に基づいて表示されるオブジェクト内における前記元文字列の視覚的特徴量の大きさに基づいて設定手段により設定される、
請求項2に記載の情報処理システム。 - 前記設定手段をさらに備える、
請求項3または4に記載の情報処理システム。 - 画像ごとに所定のタイミングで取得要求を送信する前記表示装置から前記オブジェクト内の最前面に配置されているいずれかの画像の取得要求を受信する受信手段をさらに備え、
前記変更手段は、前記取得要求を受信する度に、前記オブジェクト内における該取得要求にかかる画像の配置領域の最前面の内容を、前記生成手段により生成された、該領域の最前面に配置されている画像よりも配置される変換済み文字列が多い変換済み画像に変更させる、
請求項5に記載の情報処理システム。 - 前記オブジェクトの前記画面に表示されている範囲を示す範囲情報を所定のタイミングで前記表示装置から取得する範囲情報取得手段をさらに備え、
前記設定手段は、前記範囲情報が示す範囲に含まれない元文字列に対する優先順位を少なくとも1段階下げる、
請求項6に記載の情報処理システム。 - 前記設定手段により設定される優先順位に基づく順序にしたがって所定のタイミングで前記元文字列に対応する画像の取得要求を送信する前記表示装置から前記オブジェクト内の最前面に配置されているいずれかの画像の取得要求を受信する受信手段をさらに備え、
前記変更手段は、前記取得要求を受信する度に、前記オブジェクト内における該取得要求にかかる画像の配置領域の最前面の内容を、前記生成手段により生成された、該領域の最前面に配置されている画像よりも配置される変換済み文字列が多い変換済み画像に変更させる、
請求項3に記載の情報処理システム。 - 前記変更手段は、前記表示装置に、前記オブジェクト内における該生成された変換済み画像に対応する元画像の配置領域の最前面の内容を該変換済み画像に漸進的に変更させる、
請求項1ないし8の何れかに記載の情報処理システム。 - 1又は複数の元画像の少なくとも何れかにそれぞれ付加された複数の元文字列をそれぞれ変換してなる複数の変換済み文字列を一部ずつ取得し、
前記変換済み文字列を取得する毎に、該取得した変換済み文字列に対応する元文字列が付加された元画像における該元文字列の表示領域に相当する領域に該変換済み文字列が配置された変換済み画像を生成し、
表示情報に基づいて1又は複数の画像を含むオブジェクトの少なくとも一部を画面に表示する表示装置に、該オブジェクト内における前記生成手段により生成された変換済み画像に対応する元画像の配置領域の最前面の内容を該変換済み画像に変更させる、
情報処理システムの制御方法。 - 1又は複数の元画像の少なくとも何れかにそれぞれ付加された複数の元文字列をそれぞれ変換してなる複数の変換済み文字列を一部ずつ取得する取得手段と、
前記変換済み文字列を取得する毎に、該取得した変換済み文字列に対応する元文字列が付加された元画像における該元文字列の表示領域に相当する領域に該変換済み文字列が配置された変換済み画像を生成する生成手段と、
表示情報に基づいて1又は複数の画像を含むオブジェクトの少なくとも一部を画面に表示する表示装置に、該オブジェクト内における前記生成手段により生成された変換済み画像に対応する元画像の配置領域の最前面の内容を該変換済み画像に変更させる変更手段と、
を備える情報処理装置。 - 1又は複数の元画像の少なくとも何れかにそれぞれ付加された複数の元文字列をそれぞれ変換してなる複数の変換済み文字列を一部ずつ取得し、
前記変換済み文字列を取得する毎に、該取得した変換済み文字列に対応する元文字列が付加された元画像における該元文字列の表示領域に相当する領域に該変換済み文字列が配置された変換済み画像を生成し、
表示情報に基づいて1又は複数の画像を含むオブジェクトの少なくとも一部を画面に表示する表示装置に、該オブジェクト内における前記生成手段により生成された変換済み画像に対応する元画像の配置領域の最前面の内容を該変換済み画像に変更させる、
情報処理装置の制御方法。 - 1又は複数の元画像の少なくとも何れかにそれぞれ付加された複数の元文字列をそれぞれ変換してなる複数の変換済み文字列を一部ずつ取得する取得手段、
前記変換済み文字列を取得する毎に、該取得した変換済み文字列に対応する元文字列が付加された元画像における該元文字列の表示領域に相当する領域に該変換済み文字列が配置された変換済み画像を生成する生成手段、及び、
表示情報に基づいて1又は複数の画像を含むオブジェクトの少なくとも一部を画面に表示する表示装置に、該オブジェクト内における前記生成手段により生成された変換済み画像に対応する元画像の配置領域の最前面の内容を該変換済み画像に変更させる変更手段、
としてコンピュータを機能させるプログラム。 - 1又は複数の元画像の少なくとも何れかにそれぞれ付加された複数の元文字列をそれぞれ変換してなる複数の変換済み文字列を一部ずつ取得する取得手段、
前記変換済み文字列を取得する毎に、該取得した変換済み文字列に対応する元文字列が付加された元画像における該元文字列の表示領域に相当する領域に該変換済み文字列が配置された変換済み画像を生成する生成手段、及び、
表示情報に基づいて1又は複数の画像を含むオブジェクトの少なくとも一部を画面に表示する表示装置に、該オブジェクト内における前記生成手段により生成された変換済み画像に対応する元画像の配置領域の最前面の内容を該変換済み画像に変更させる変更手段、
としてコンピュータを機能させるプログラムを記録したコンピュータ読み取り可能な情報記憶媒体。
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2015505745A JP5829354B2 (ja) | 2013-03-29 | 2013-03-29 | 情報処理システム、情報処理システムの制御方法、情報処理装置、情報処理装置の制御方法、情報記憶媒体、及びプログラム |
US14/781,032 US9690778B2 (en) | 2013-03-29 | 2013-03-29 | Information processing system, control method for information processing system, information processing device, control method for information processing device, information storage medium, and program |
PCT/JP2013/059765 WO2014155742A1 (ja) | 2013-03-29 | 2013-03-29 | 情報処理システム、情報処理システムの制御方法、情報処理装置、情報処理装置の制御方法、情報記憶媒体、及びプログラム |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/JP2013/059765 WO2014155742A1 (ja) | 2013-03-29 | 2013-03-29 | 情報処理システム、情報処理システムの制御方法、情報処理装置、情報処理装置の制御方法、情報記憶媒体、及びプログラム |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2014155742A1 true WO2014155742A1 (ja) | 2014-10-02 |
Family
ID=51622786
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2013/059765 WO2014155742A1 (ja) | 2013-03-29 | 2013-03-29 | 情報処理システム、情報処理システムの制御方法、情報処理装置、情報処理装置の制御方法、情報記憶媒体、及びプログラム |
Country Status (3)
Country | Link |
---|---|
US (1) | US9690778B2 (ja) |
JP (1) | JP5829354B2 (ja) |
WO (1) | WO2014155742A1 (ja) |
Families Citing this family (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP7016612B2 (ja) * | 2017-02-10 | 2022-02-07 | 株式会社東芝 | 画像処理装置及びプログラム |
JP6866788B2 (ja) * | 2017-07-06 | 2021-04-28 | 株式会社リコー | 情報処理装置及びプログラム |
US11347381B2 (en) * | 2019-06-13 | 2022-05-31 | International Business Machines Corporation | Dynamic synchronized image text localization |
US11631234B2 (en) | 2019-07-22 | 2023-04-18 | Adobe, Inc. | Automatically detecting user-requested objects in images |
US11468550B2 (en) | 2019-07-22 | 2022-10-11 | Adobe Inc. | Utilizing object attribute detection models to automatically select instances of detected objects in images |
US11107219B2 (en) | 2019-07-22 | 2021-08-31 | Adobe Inc. | Utilizing object attribute detection models to automatically select instances of detected objects in images |
US11468110B2 (en) | 2020-02-25 | 2022-10-11 | Adobe Inc. | Utilizing natural language processing and multiple object detection models to automatically select objects in images |
US11055566B1 (en) * | 2020-03-12 | 2021-07-06 | Adobe Inc. | Utilizing a large-scale object detector to automatically select objects in digital images |
US11587234B2 (en) | 2021-01-15 | 2023-02-21 | Adobe Inc. | Generating class-agnostic object masks in digital images |
US11972569B2 (en) | 2021-01-26 | 2024-04-30 | Adobe Inc. | Segmenting objects in digital images utilizing a multi-object segmentation model framework |
JP2022147337A (ja) * | 2021-03-23 | 2022-10-06 | 株式会社リコー | 表示装置、表示方法、プログラム |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPS61228571A (ja) * | 1985-04-01 | 1986-10-11 | Ricoh Co Ltd | 文書作成編集装置 |
JP2001216303A (ja) * | 2000-02-04 | 2001-08-10 | Fujitsu Ltd | 翻訳結果表示装置及び方法並びに翻訳結果表示プログラムを格納したコンピュータ可読の記録媒体 |
JP2002108855A (ja) * | 2000-09-29 | 2002-04-12 | Brother Ind Ltd | 文書処理装置 |
US20080300859A1 (en) * | 2003-06-05 | 2008-12-04 | Yen-Fu Chen | System and Method for Automatic Natural Language Translation of Embedded Text Regions in Images During Information Transfer |
WO2012147936A1 (ja) * | 2011-04-28 | 2012-11-01 | 楽天株式会社 | 閲覧システム、端末、画像サーバ、プログラム、プログラムを記録したコンピュータ読み取り可能な記録媒体、及び方法 |
Family Cites Families (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2758952B2 (ja) * | 1989-12-28 | 1998-05-28 | 富士通株式会社 | 日本語文書読取翻訳システムの修正時における表示方式 |
US7865358B2 (en) * | 2000-06-26 | 2011-01-04 | Oracle International Corporation | Multi-user functionality for converting data from a first form to a second form |
JP2006252049A (ja) * | 2005-03-09 | 2006-09-21 | Fuji Xerox Co Ltd | 翻訳システム、翻訳方法およびプログラム |
JP2006260080A (ja) * | 2005-03-16 | 2006-09-28 | Toshiba Corp | 光学的文字認識システムおよび光学的文字認識方法 |
US7778632B2 (en) * | 2005-10-28 | 2010-08-17 | Microsoft Corporation | Multi-modal device capable of automated actions |
US8144990B2 (en) * | 2007-03-22 | 2012-03-27 | Sony Ericsson Mobile Communications Ab | Translation and display of text in picture |
JP5235135B2 (ja) * | 2008-12-26 | 2013-07-10 | 楽天株式会社 | 機械翻訳システム及び機械翻訳方法 |
JP5299011B2 (ja) * | 2009-03-25 | 2013-09-25 | セイコーエプソン株式会社 | テープ印刷装置、テープ印刷装置の制御方法及びプログラム |
JP5211193B2 (ja) * | 2010-11-10 | 2013-06-12 | シャープ株式会社 | 翻訳表示装置 |
JP5606385B2 (ja) | 2011-04-28 | 2014-10-15 | 楽天株式会社 | サーバ装置、サーバ装置の制御方法、及び、プログラム |
US8855413B2 (en) * | 2011-05-13 | 2014-10-07 | Abbyy Development Llc | Image reflow at word boundaries |
-
2013
- 2013-03-29 US US14/781,032 patent/US9690778B2/en active Active
- 2013-03-29 JP JP2015505745A patent/JP5829354B2/ja active Active
- 2013-03-29 WO PCT/JP2013/059765 patent/WO2014155742A1/ja active Application Filing
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPS61228571A (ja) * | 1985-04-01 | 1986-10-11 | Ricoh Co Ltd | 文書作成編集装置 |
JP2001216303A (ja) * | 2000-02-04 | 2001-08-10 | Fujitsu Ltd | 翻訳結果表示装置及び方法並びに翻訳結果表示プログラムを格納したコンピュータ可読の記録媒体 |
JP2002108855A (ja) * | 2000-09-29 | 2002-04-12 | Brother Ind Ltd | 文書処理装置 |
US20080300859A1 (en) * | 2003-06-05 | 2008-12-04 | Yen-Fu Chen | System and Method for Automatic Natural Language Translation of Embedded Text Regions in Images During Information Transfer |
WO2012147936A1 (ja) * | 2011-04-28 | 2012-11-01 | 楽天株式会社 | 閲覧システム、端末、画像サーバ、プログラム、プログラムを記録したコンピュータ読み取り可能な記録媒体、及び方法 |
Also Published As
Publication number | Publication date |
---|---|
JP5829354B2 (ja) | 2015-12-09 |
US9690778B2 (en) | 2017-06-27 |
US20160299890A1 (en) | 2016-10-13 |
JPWO2014155742A1 (ja) | 2017-02-16 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP5829354B2 (ja) | 情報処理システム、情報処理システムの制御方法、情報処理装置、情報処理装置の制御方法、情報記憶媒体、及びプログラム | |
US10956531B2 (en) | Dynamic generation of mobile web experience | |
US8497883B2 (en) | Information display device | |
TWI448953B (zh) | 網路文件之可適的伺服式佈局 | |
JP5575511B2 (ja) | ウェブサイト閲覧システム、サーバ及びクライアント端末 | |
US20140380229A1 (en) | System, method and user interface for designing customizable products from a mobile device | |
JP2013501997A (ja) | ウェブページを表示する方法、装置およびシステム | |
US20090085921A1 (en) | Populate Web-Based Content Based on Space Availability | |
US9117314B2 (en) | Information output apparatus, method, and recording medium for displaying information on a video display | |
US9619440B2 (en) | Document conversion apparatus | |
WO2022048141A1 (zh) | 一种图像处理方法及装置、计算机可读存储介质 | |
JP2007233659A (ja) | ネットワークサービスにおける情報配信システム | |
CN101114300A (zh) | 图像形成***和图像形成方法 | |
US20160259771A1 (en) | Information processing system, information processing apparatus, control method, and storage medium | |
TWI435226B (zh) | A method of reading a system, a terminal, an image server, a computer program product, a terminal, and an image server | |
US9706006B2 (en) | System and method of context aware adaption of content for a mobile device | |
JP5525623B2 (ja) | 遠隔印刷 | |
EP2317424A1 (en) | Information display device | |
JP2008234147A (ja) | 文書画像表示装置、文書画像表示方法及び文書画像表示プログラム | |
JP4815501B2 (ja) | 端末装置及びプログラム | |
RU2634221C2 (ru) | Способ и устройство для отрисовки представления электронного документа на экране | |
US20150186758A1 (en) | Image processing device | |
JP2011113460A (ja) | 情報提供システム | |
US8533588B2 (en) | Overriding images in user interfaces | |
US9690783B2 (en) | Image conversion and method for converting text in an image into a targeted language |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 13880692 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 2015505745 Country of ref document: JP Kind code of ref document: A |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
WWE | Wipo information: entry into national phase |
Ref document number: 14781032 Country of ref document: US |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 13880692 Country of ref document: EP Kind code of ref document: A1 |