CN109543193B

CN109543193B - Translation method, translation device and terminal equipment

Info

Publication number: CN109543193B
Application number: CN201811338644.6A
Authority: CN
Inventors: 李凯华
Original assignee: Vivo Mobile Communication Co Ltd
Current assignee: Vivo Mobile Communication Co Ltd
Priority date: 2018-11-12
Filing date: 2018-11-12
Publication date: 2023-08-29
Anticipated expiration: 2038-11-12
Also published as: CN109543193A

Abstract

The application discloses a translation method, a translation device and terminal equipment. The translation method is applied to the terminal equipment with the first display screen and the second display screen, and comprises the following steps: acquiring first information input by a first user through the first display screen; translating the first information to obtain second information; and displaying the second information to a second user through the second display screen. In the scheme of the application, the terminal equipment is provided with at least two display screens, the first user inputs the first information to be translated into the terminal equipment through one of the display screens, the terminal equipment translates the first information into the second information, and the second information is displayed to the second user through the second display screen, so that the instant translation between the first user and the second user can be realized based on the two display screens, the terminal equipment is not required to be exchanged repeatedly in the hands of both sides, and better communication experience is brought.

Description

Translation method, translation device and terminal equipment

Technical Field

The present application relates to the field of terminal applications, and in particular, to a translation method, a translation device, and a terminal device.

Background

With the global information, networking development and understanding among people in countries around the world, along with the daily and monthly variation of traffic modes and communication modes, communication with friends in other countries is indispensable at present no matter going out of home for study, work and travel, and language variation becomes the biggest obstacle in communication. Thus, studies using machine translation instead of manual translation have been rapidly developed.

At present, when people communicate with other people and encounter language barriers, the machine translation function on the terminal equipment can be used for assistance. Generally, in the use process, a user inputs information to be expressed to a terminal device, and after the terminal device generates a translation result, the terminal device is handed to another party for viewing. Obviously, the mode needs the terminal equipment to be exchanged repeatedly in both hands, so that the operation is complicated, the instantaneity of translation is lost, and the use experience is poor for users.

In view of this, how to realize instant translation in a more convenient manner based on terminal equipment is a technical problem to be solved.

Disclosure of Invention

The embodiment of the application aims to provide a translation method, a translation device and terminal equipment, which can quickly and accurately perform instant translation.

In order to achieve the above object, the embodiment of the present application adopts the following technical scheme:

in a first aspect, a translation method is provided, applied to a terminal device having a first display screen and a second display screen, the translation method includes:

acquiring first information input by a first user through the first display screen;

translating the first information to obtain second information;

and displaying the second information to a second user through the second display screen.

In a second aspect, there is provided a translation apparatus applied to a terminal device having a first display screen and a second display screen, the translation apparatus comprising:

the first acquisition module is used for acquiring first information input by a first user through the first display screen;

the translation module is used for translating the first information to obtain second information;

and the display module is used for displaying the second information to a second user through the second display screen.

In a third aspect, there is provided a terminal device comprising: a memory, a processor and a computer program stored on the memory and executable on the processor, which when executed by the processor performs the steps in the translation method according to the first aspect.

In a fourth aspect, there is provided a computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements the steps of the translation method of the first aspect.

In the embodiment of the application, the terminal equipment is provided with at least two display screens, the first user inputs the first information to be translated into the terminal equipment through one of the display screens, the terminal equipment translates the first information into the second information, and the second information is displayed to the second user through the second display screen, so that the instant translation between the first user and the second user can be realized based on the two display screens, the terminal equipment is not required to be exchanged repeatedly in the hands of both sides, and better communication experience is brought.

Drawings

The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this specification, illustrate embodiments of the application and together with the description serve to explain the application and do not constitute a limitation on the application. In the drawings:

FIG. 1 is a schematic diagram of steps of a translation method according to an embodiment of the present application;

fig. 2 is a schematic diagram of steps of a translation method provided in an embodiment of the present application in an application scenario;

FIG. 3 is a schematic diagram of a logic structure of a translation device according to an embodiment of the present application;

fig. 4 is a schematic diagram of a hardware structure of an electronic device according to an embodiment of the present application.

Detailed Description

The following description of the embodiments of the present application will be made clearly and fully with reference to the accompanying drawings, in which it is evident that the embodiments described are some, but not all embodiments of the application. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.

As described above, when a user uses the machine translation function of the terminal device to communicate with a person, the terminal device needs to be exchanged repeatedly between the two hands, which not only is complicated in operation, but also loses the immediacy of translation. The present application proposes a solution to this problem.

In one aspect, an embodiment of the present application provides a translation method applied to a terminal device having a first display screen and a second display screen. It should be understood that the electronic device according to the embodiment of the present application is not limited to having only the first display screen and the second display screen, but may also have a plurality of display screens, for example: third display … … nth display.

As shown in fig. 1, the playing method in the embodiment of the present application includes:

step S102, first information input by a first user is acquired through a first display screen.

For step S102:

the embodiment of the application does not specifically limit the input mode of the first information.

As an exemplary introduction, the present step may obtain, via the first display screen, first information entered by the first user in at least one of voice input, text input, and optical character recognition (Optical Character Recognition, OCR) input.

In addition, the step can determine the first information to be translated based on the information selected by the first user in the touch control manner on the first display screen. For example, when a first user wants to ask a second user how to go to a certain scenic spot, the first user can touch-control and select the landmark of the scenic spot displayed on the first display screen, then the step is based on the existing image recognition technology, the landmark information selected by the first user through touch control is identified, and semantic interpretation is performed on the landmark information based on a semantic analysis algorithm, so that first information of how to go to the scenic spot is obtained.

Or, the step can also obtain the information selected by the first user touch and the information input by the voice through the first display screen, and correlate the information selected by the first user touch and the information input by the voice based on the existing semantic analysis algorithm to obtain the first information to be translated. For example, when the first user wants to ask the second user how to go to a certain scenic spot, the first user can touch and select the landmark of the scenic spot displayed on the first display screen, and input the information of how to go through voice. Then, the step can identify landmark information selected by the first user through touch based on an image identification technology, and associate what information is input by the first user through voice with landmark information of a scenic spot selected through touch based on a semantic analysis algorithm to obtain first information of what the scenic spot is.

Since the implementation is not unique, it is not described in detail herein by way of example.

Step S104, translating the first information to obtain second information.

For step S104:

the embodiment of the application does not specifically limit the translation mode of the first information.

As an exemplary introduction, this step may use translation software installed on the terminal device to translate the first information; or, the first information can be sent to the cloud server for translation, and the second information fed back by the cloud is received.

And step S106, displaying second information to a second user through a second display screen.

For step S106:

information display of the second display screen and information input of the first display screen are completed independently, and in the process that the second display screen displays second information to a second user, the first user can input information to be translated later through the first display screen without waiting for whether the second user looks over.

In addition, it should be understood that the second user may also actively send information to the first user, that is, the scheme of the embodiment of the present application may also obtain, through the second display screen, third information input by the second user, and reverse translate the third information to obtain fourth information, and display the fourth information to the first user through the first display screen.

On the basis of the above, the translation method of the embodiment of the application can also play the second information to the second user by voice, thereby displaying the second information to the second user in a sound-picture parallel mode.

Specifically, if the first user voice inputs the first information, the translation method of the embodiment of the application can acquire the first volume value of the first user voice input first information, and play the second information to the second user voice by using the second volume value higher than the first volume value, so as to ensure that the speaking voice of the first user does not interfere with the voice of the second user for listening to the second information.

In addition, the translation method of the embodiment of the application can also use the earphone audio channel of the terminal equipment to play the second information to the voice of the second user, so that the second user can listen to the voice of the second information based on the earphone, thereby avoiding interference of the speaking sound of the first user.

In addition, the embodiment of the application can translate the first information by using translation software installed on the terminal equipment.

Before executing step S102, the embodiment of the present application may obtain, through a first display screen, a configuration operation of the translation software by a first user; then, based on the configuration operation, determining the original language (namely the language of the first information) and the target language (namely the language of the second information) of the translation software;

correspondingly, when step S104 is performed, the first information is translated by the translation software.

In addition, in order to bring better translation experience to the user, the embodiment of the application can actively update the data packet of the translation software so as to ensure that the terminal equipment can translate the first information based on the latest version of the translation software.

That is, before executing step S102, the embodiment of the present application may further detect whether the terminal device accesses the Wi-Fi network;

if the terminal equipment is accessed to the Wi-Fi network, an automatic update flow is started for translation software on the terminal equipment.

If the terminal equipment is not connected to the Wi-Fi network, prompting whether to update prompting information of the translation software in a non-Wi-Fi network environment or not to the first user, and determining whether to start an updating flow of the translation software according to selection of the prompting information by the first user.

The following describes the translation method of the application embodiment in detail in connection with an application scenario.

In the application scene, the terminal equipment is a folding screen mobile phone and is provided with a first foldable display screen and a second foldable display screen, and translation software and voice playing software are installed on the terminal equipment. As shown in fig. 2, the main flow of the translation method of the application scenario includes:

step S201, a first user opens a folding screen mobile phone and starts translation software.

Step S202, detecting whether the folding screen mobile phone is connected to a Wi-Fi network, and automatically downloading or updating a translation data packet of the translation software and a voice playing data packet of the voice playing software when the folding screen mobile phone is connected to the Wi-Fi network.

It should be appreciated that the translation software and the voice playback software may be used offline after the update is completed.

In step S203, the folding screen mobile phone is unfolded, the first display screen faces the first user, the second display screen faces the second user, and the first user sets the translation software through the first display screen, for example, sets the original language and the target language of the translation software.

In step S204, the first user inputs the first information of the original language to the folding mobile phone through the first display screen based on one of the input modes of voice input, text input and OCR input.

In addition, after the first information is determined, the first information can be displayed to the first user through the first display screen in the step, so that the first user is assisted to confirm whether the first information is correctly identified.

In step S205, the translation software performs matching translation on the first information of the original language to obtain the second information of the target language.

If the first user inputs the first information through voice, the volume value of the first user is collected at the same time;

step S206, the second display screen displays the translated second information, and the voice of the second information is synchronously played through the voice playing software to assist the second user in reading.

If the first user inputs the first information through voice and the second information is played through the speaker of the terminal device, the playing volume of the second information can be automatically adjusted to be higher than the volume value of the first user, so that the first user can be prevented from speaking voice to cause that the second user cannot hear the translated content.

It should be understood that, by adopting the logic, the second user can also send the information needing to be translated reversely to the first user on the first display screen through the second display screen, so that the instant communication of both parties without language barriers is realized.

The foregoing is illustrative of the method of playing embodiments of the present application, and suitable modifications may be made without departing from the principles herein above and such modifications should also be considered as falling within the scope of the embodiments of the present application.

For example, the embodiment of the application can also run chat software on the over-terminal device. The first user inputs first information through a chat interface of the first display screen corresponding to the chat software. After that, the embodiment of the application translates the first information into the second information based on the translation control loaded by the chat software, and displays the second information on the chat interface of the chat software corresponding to the second display screen so as to display the second information to the second user.

Correspondingly, as shown in fig. 3, the embodiment of the application further provides a multimedia translation device 3000, which is applied to a terminal device having a first display screen and a second display screen. Wherein, play device 3000 includes:

the first obtaining module 3001 is configured to obtain first information input by a first user through the first display screen;

the translation module 3002 is configured to translate the first information to obtain second information;

and the display module 3003 is configured to display the second information to a second user through the second display screen.

Specifically, the first obtaining module 3001 in the embodiment of the present application obtains, through the first display screen, first information input by a first user in at least one of voice input, text input, and optical character recognition input.

In addition, on the basis of the above, the translation device according to the embodiment of the present application further includes:

and the voice playing module is used for playing the second information to the second user after the second information is obtained by the translation module.

Wherein if the first user inputs the first information by voice, the translating device further includes:

the volume detection module is used for acquiring a first volume value of the first information input by the first user through voice;

correspondingly, the playing module is specifically configured to play the second information to the second user by using the second volume value; wherein the second volume value is higher than the first volume value.

In addition, the terminal device of the embodiment of the application is provided with translation software, and the translation device further comprises:

the second acquisition module is used for acquiring configuration operation of the first user on the translation software through the first display screen before the first acquisition module acquires the first information input by the first user through the first display screen;

the configuration module is used for determining the original language and the target language of the translation software based on the configuration operation;

the translation module translates the first information through the translation software to obtain second information; the languages of the first information are original languages, and the languages of the second information are target languages.

In addition, the translation device of the embodiment of the application further comprises:

the network detection module is used for detecting whether the terminal equipment is accessed to a Wi-Fi network before the first acquisition module acquires first information input by a first user through the first display screen;

and the updating module is used for starting an automatic updating flow for the translation software on the terminal equipment if the terminal equipment is accessed to the Wi-Fi network.

Obviously, the translation device in the embodiment of the present application serves as an execution body of the translation method shown in fig. 1, so that the translation method can implement the functions in fig. 1 and 2, and the translation device in the embodiment of the present application can also be implemented, which is not described herein again.

In addition, as shown in fig. 4, the embodiment of the present application further provides a terminal device 400, where the terminal device 400 includes, but is not limited to: radio frequency unit 401, network module 402, audio output unit 403, input unit 404, sensor 405, display unit 406, user input unit 407, interface unit 408, memory 409, processor 410, and power source 411. It will be appreciated by those skilled in the art that the terminal structure shown in fig. 4 does not constitute a limitation of the terminal device 400, and the terminal device 400 may include more or less components than illustrated, or may combine certain components, or may have a different arrangement of components. In an embodiment of the present application, the terminal device 400 includes, but is not limited to, a mobile phone, a tablet computer, a notebook computer, a palm computer, a vehicle-mounted terminal, a wearable device, a pedometer, and the like.

Wherein the processor 410 is configured to:

translating the first information to obtain second information;

It should be understood that, in the embodiment of the present application, the radio frequency unit 401 may be used for receiving and transmitting signals during the process of receiving and transmitting information or communication, specifically, receiving downlink data from a base station and then processing the downlink data by the processor 140; and, the uplink data is transmitted to the base station. Typically, the radio frequency unit 401 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency unit 401 may also communicate with networks and other devices through a wireless communication system.

Terminal device 400 provides wireless broadband internet access to a user, such as helping the user to send and receive e-mail, browse web pages, access streaming media, etc., via network module 402.

The audio output unit 403 may convert audio data received by the radio frequency unit 401 or the network module 402 or stored in the memory 409 into an audio signal and output as sound. Also, the audio output unit 403 may also provide audio output (e.g., a call signal reception sound, a message reception sound, etc.) related to a specific function performed by the terminal 400. The audio output unit 403 includes a speaker, a buzzer, a receiver, and the like.

The input unit 404 is used to receive an audio or video signal. The input unit 404 may include a graphics processor (Graphics Processing Unit, GPU) 4041 and a microphone 4042, the graphics processor 4041 processing image data of still pictures or video obtained by an image capturing device (e.g., a camera) in a video capturing mode or an image capturing mode. The processed image frames may be displayed on the display unit 406. The image frames processed by the graphics processor 4041 may be stored in memory 409 (or other storage medium) or transmitted via the radio frequency unit 401 or the network module 402. The microphone 4042 may receive sound and may be capable of processing such sound into audio data. The processed audio data may be converted into a format output that can be transmitted to the mobile communication base station via the radio frequency unit 401 in the case of a telephone call mode.

The terminal device 400 further comprises at least one sensor 405, such as a light sensor, a motion sensor and other sensors. Specifically, the light sensor includes an ambient light sensor and a proximity sensor, wherein the ambient light sensor can adjust the brightness of the display panel 4061 according to the brightness of ambient light, and the proximity sensor can turn off the display panel 4061 and/or the backlight when the terminal device 400 moves to the ear. As one of the motion sensors, the accelerometer sensor can detect the acceleration in all directions (generally three axes), and can detect the gravity and direction when the accelerometer sensor is stationary, and can be used for recognizing the terminal gesture (such as horizontal and vertical screen switching, related games, magnetometer gesture calibration), vibration recognition related functions (such as pedometer and knocking), and the like; the sensor 405 may further include a fingerprint sensor, a pressure sensor, an iris sensor, a molecular sensor, a gyroscope, a barometer, a hygrometer, a thermometer, an infrared sensor, etc., which are not described herein.

The display unit 406 is used to display information input by a user or information provided to the user. The display unit 406 may include a display panel 4061, and the display panel 4061 may be configured in the form of a liquid crystal display (Liquid Crystal Display, LCD), an Organic Light-Emitting Diode (OLED), or the like.

The user input unit 407 is operable to receive input numeric or character information and to generate key signal inputs related to user settings and function control of the terminal device. Specifically, the user input unit 407 includes a touch panel 4071 and other input devices 4072. The touch panel 4071, also referred to as a touch screen, may collect touch operations thereon or thereabout by a user (e.g., operations of the user on the touch panel 4071 or thereabout using any suitable object or accessory such as a finger, stylus, etc.). The touch panel 4071 may include two parts, a touch detection device and a touch controller. The touch detection device detects the touch azimuth of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch detection device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 140, and receives and executes commands sent by the processor 140. In addition, the touch panel 4071 may be implemented in various types such as resistive, capacitive, infrared, and surface acoustic wave. The user input unit 407 may include other input devices 4072 in addition to the touch panel 4071. In particular, other input devices 4072 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described in detail herein.

Further, the touch panel 4071 may be overlaid on the display panel 4061, and when the touch panel 4071 detects a touch operation thereon or thereabout, the touch operation is transferred to the processor 140 to determine the type of touch event, and the processor 410 then provides a corresponding visual output on the display panel 4061 according to the type of touch event. Although in fig. 4, the touch panel 4071 and the display panel 4061 are two independent components to implement the input and output functions of the terminal, in some embodiments, the touch panel 4071 may be integrated with the display panel 4061 to implement the input and output functions of the terminal, which is not limited herein.

The interface unit 408 is an interface to which an external device is connected to the terminal apparatus 400. For example, the external devices may include a wired or wireless headset port, an external power (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The interface unit 408 may be used to receive input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more elements within the terminal apparatus 400 or may be used to transmit data between the terminal 400 and an external device.

Memory 409 may be used to store software programs as well as various data. The memory 409 may mainly include a storage program area that may store an operating system, application programs required for at least one function (such as a sound playing function, an image playing function, etc.), and a storage data area; the storage data area may store data (such as audio data, phonebook, etc.) created according to the use of the handset, etc. In addition, memory 409 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage device.

The processor 410 is a control center of the terminal, connects various parts of the entire terminal using various interfaces and lines, and performs various functions of the terminal and processes data by running or executing software programs and/or modules stored in the memory 409 and calling data stored in the memory 409, thereby performing overall monitoring of the terminal. Processor 140 may include one or more processing units; preferably, the processor 410 may integrate an application processor that primarily handles operating systems, user interfaces, applications, etc., with a modem processor that primarily handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 410.

The terminal device 400 may further include a power source 411 (e.g., a battery) for supplying power to the respective components, and preferably, the power source 411 may be logically connected to the processor 410 through a power management system, so as to perform functions of managing charging, discharging, power consumption management, etc. through the power management system.

In addition, the terminal device 400 may also execute the translation method shown in fig. 1 and implement the functions of the playing device in the embodiments shown in fig. 1 and fig. 2, which are not described herein again.

In addition, an embodiment of the present application further provides a computer readable storage medium, where a computer program is stored, where the computer program when executed by a processor implements each process of the method embodiment of fig. 1, and the same technical effects can be achieved, and for avoiding repetition, a description is omitted herein. Wherein the computer readable storage medium is selected from Read-Only Memory (ROM), random access Memory (Random Access Memory, RAM), magnetic disk or optical disk.

It should be understood that when the computer program in the computer readable storage medium of the embodiment of the present application is executed by the processor, the functions of the playing device in the embodiment shown in fig. 1 and fig. 2 can be implemented, and the embodiments of the present application are not described herein again.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.

From the above description of the embodiments, it will be clear to those skilled in the art that the above-described embodiment method may be implemented by means of software plus a necessary general hardware platform, but of course may also be implemented by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present application may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a storage medium (e.g. ROM/RAM, magnetic disk, optical disk) comprising instructions for causing a terminal (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to perform the method according to the embodiments of the present application.

The embodiments of the present application have been described above with reference to the accompanying drawings, but the present application is not limited to the above-described embodiments, which are merely illustrative and not restrictive, and many forms may be made by those having ordinary skill in the art without departing from the spirit of the present application and the scope of the claims, which are to be protected by the present application.

Claims

1. A translation method applied to a terminal device having a first display screen and a second display screen, the translation method comprising:

acquiring first information input by a first user through the first display screen, wherein the first display screen faces the first user;

translating the first information to obtain second information;

and displaying the second information to a second user through the second display screen, wherein the second display screen faces the second user.

2. The translation method according to claim 1, wherein,

acquiring first information input by a first user through the first display screen, wherein the first information comprises:

and acquiring first information input by a first user in at least one input mode of voice input, text input and optical character recognition input through the first display screen.

3. The translation method according to claim 2, wherein after translating the first information to obtain the second information, the translation method further comprises:

and playing the second information to the second user through voice.

4. The translation method of claim 3, wherein if said first user speech inputs said first information, said translation method further comprises:

acquiring a first volume value of the first user voice input first information;

playing the second information to the second user by voice, including:

playing the second information to the second user in a voice way with a second volume value; wherein the second volume value is higher than the first volume value.

5. The translation method of claim 3, wherein said terminal device has a headset audio channel for voice playing said second information to said second user, further comprising:

and playing the second information to the second user through the earphone audio channel.

6. The translation method according to any one of claims 1 to 5, wherein the terminal device is provided with translation software, and wherein before the first information input by the first user is acquired through the first display screen, the translation method further comprises:

acquiring configuration operation of a first user on the translation software through the first display screen;

determining an original language and a target language of the translation software based on the configuration operation;

translating the first information to obtain second information, including:

translating the first information through the translation software to obtain second information; the languages of the first information are original languages, and the languages of the second information are target languages.

7. A translation apparatus for use with a terminal device having a first display and a second display, the translation apparatus comprising:

the first acquisition module is used for acquiring first information input by a first user through the first display screen, and the first display screen faces the first user;

and the display module is used for displaying the second information to a second user through the second display screen, and the second display screen faces the second user.

8. The translation device as recited in claim 7, wherein,

the first acquisition module acquires first information input by a first user in at least one input mode of voice input, text input and optical character recognition input through the first display screen.

9. The translation device of claim 8, wherein the translation device further comprises:

10. The translation device of claim 9, wherein if said first user speech inputs said first information, said translation device further comprises:

the playing module is specifically configured to play the second information to the second user by using a second volume value; wherein the second volume value is higher than the first volume value.

11. Translation device according to any of the claims 7-10, wherein the terminal device is provided with translation software, the translation device further comprising:

12. A terminal device, comprising: memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the computer program realizes the steps in the translation method according to any of claims 1-6 when being executed by the processor.