CN106982273B

CN106982273B - Mobile terminal and control method thereof

Info

Publication number: CN106982273B
Application number: CN201710206609.8A
Authority: CN
Inventors: 陈盼; 张腾
Original assignee: Nubia Technology Co Ltd
Current assignee: Nubia Technology Co Ltd
Priority date: 2017-03-31
Filing date: 2017-03-31
Publication date: 2020-03-31
Anticipated expiration: 2037-03-31
Also published as: CN106982273A

Abstract

The invention discloses a mobile terminal and a control method thereof, wherein the mobile terminal comprises: the first front camera module is suitable for generating a first instruction when sensing that the light intensity change reaches a set threshold value and outputting the first instruction to the control module; the second front camera module is suitable for generating a second instruction when sensing that the light intensity change reaches a set threshold value and outputting the second instruction to the control module; the control module is suitable for determining matching parameters when two instructions are received and the time interval of the two instructions is less than or equal to a set time threshold, matching corresponding operation items according to the matching parameters, and performing operation control according to the matched operation items; the matching parameters include one or more of the following parameters: the generation of the two commands, the order of receipt of the two commands and the state of the mobile terminal. The invention realizes the function of the original function key of the mobile terminal by multiplexing the function of the front camera module, and provides powerful support for the enlargement of the screen of the mobile terminal.

Description

Mobile terminal and control method thereof

Technical Field

The present invention relates to the field of image processing, and in particular, to a mobile terminal and a control method thereof.

Background

With the rapid development of communication technology, mobile terminals such as mobile phones have more and more functions, and most of entertainment functions which can be realized on computers can be realized on the mobile terminals, so that people can watch movies, play games, browse webpages, chat videos and the like on the mobile terminals. In order to improve the visual effect of the mobile terminal, the mobile terminal tends to be developed into a large screen, but the size of the mobile terminal cannot be increased infinitely due to the portability characteristic of the mobile terminal, so that the utilization rate of the screen needs to be increased by fully utilizing the external size of the mobile terminal, and therefore, the mobile terminal with a narrow frame or even without a frame appears. The mobile terminal with the narrow-frame or frameless touch screen fully utilizes the appearance size of the mobile terminal, greatly expands the screen size of the mobile terminal, meets the requirement of a user on a large screen, and meanwhile, enables the appearance of the mobile terminal to be more attractive. However, the terminal usually sets function keys, such as a home key, a return key, and the like, on the screen side, and the presence of these function keys greatly affects further enlargement of the screen size. Therefore, how to simplify the function keys of the terminal without affecting the use of the terminal becomes a technical problem to be solved by the invention, so that the terminal screen is further expanded.

Disclosure of Invention

The present invention has been made in view of the above problems, and provides a mobile terminal and a control method thereof that solve the above problems.

To achieve the above object, the present invention provides a mobile terminal, comprising: the device comprises a first front camera module, a second front camera module and a control module;

the first front camera module is suitable for generating a first instruction when sensing that the light intensity change reaches a set threshold value, and outputting the first instruction to the control module;

the second front camera module is suitable for generating a second instruction when sensing that the light intensity change reaches a set threshold value, and outputting the second instruction to the control module;

the control module is suitable for determining matching parameters when two instructions are received and the time interval of the two instructions is less than or equal to a set time threshold, matching corresponding operation items according to the matching parameters, and performing operation control according to the matched operation items; the matching parameters include one or more of the following parameters: a generator of the two instructions, a receiving order of the two instructions, and a state of the mobile terminal.

Optionally, in the mobile terminal of the present invention, the operation item includes one of: unlocking, shooting, returning to a main interface, calling a multi-task interface and returning.

Optionally, in the mobile terminal of the present invention, the control module is specifically adapted to control the specified front-facing camera module to perform image acquisition when the matched operation item is unlocking, perform user identification by using the acquired image, and perform unlocking control according to an identification result.

Optionally, in the mobile terminal of the present invention, the control module is specifically adapted to, after determining the matching parameter, call a mapping relationship table between a preset matching parameter and an operation item, search the mapping relationship table, obtain an operation item matched with the determined matching parameter, and perform operation control according to the matched operation item.

Optionally, the mobile terminal of the present invention further includes: a grip detection module;

the holding detection module is suitable for detecting the holding mode of the mobile terminal and outputting the holding mode to the control module;

and the control module is also suitable for calling a preset mapping relation table of the matching parameters corresponding to the holding mode and the operation items after the matching parameters are determined, searching the mapping relation table to obtain the operation items matched with the determined matching parameters, and performing operation control according to the matched operation items.

To achieve the above object, the present invention also provides a control method of a mobile terminal including a first front camera module and a second front camera module, the method comprising:

sensing the light intensity change by utilizing the first front camera module and the second front camera module;

when the light intensity changes of two times reach a set threshold value and the time interval between the two times is less than or equal to the set time threshold value, determining a matching parameter, matching a corresponding operation item according to the matching parameter, and performing operation control according to the matched operation item; the matching parameters include one or more of the following parameters: and sensing the sensing party when the two light intensity changes reach the set threshold, the occurrence sequence when the two light intensity changes reach the set threshold and the state of the mobile terminal.

Optionally, in the method of the present invention, the operation item includes one of: unlocking, shooting, returning to a main interface, calling a multi-task interface and returning.

Optionally, in the method of the present invention, when the matched operation item is unlocked, after matching the corresponding operation item according to the matching parameter, the method specifically includes: and controlling the appointed front camera module to acquire images, identifying users by using the acquired images, and performing unlocking control according to an identification result.

Optionally, in the method of the present invention, after determining the matching parameter, the method specifically includes: calling a mapping relation table of preset matching parameters and operation items, searching the mapping relation table to obtain the operation items matched with the determined matching parameters, and performing operation control according to the matched operation items.

Optionally, the method of the present invention further comprises: detecting a holding mode of the mobile terminal;

after the matching parameters are determined, the method specifically includes: and calling a preset mapping relation table of the matching parameters corresponding to the holding mode and the operation items, searching the mapping relation table to obtain the operation items matched with the determined matching parameters, and performing operation control according to the matched operation items.

According to the mobile terminal and the control method thereof, whether the user shields the front camera module can be judged by utilizing the photosensitive function of the front camera module, so that the shielding mode of the user can be obtained, and the matching of the original function key operation items can be carried out according to the shielding mode, and the operation control is carried out. Therefore, the function of the original function key of the mobile terminal is realized by multiplexing the function of the front camera module. The mobile terminal adopting the technical scheme of the invention can remove the original function keys and provide powerful support for the enlargement of the screen of the mobile terminal.

Drawings

Fig. 1 is a schematic diagram of a hardware structure of a mobile terminal implementing various embodiments of the present invention;

FIG. 2 is a diagram of a wireless communication system for the mobile terminal shown in FIG. 1;

fig. 3 is a block diagram of a mobile terminal according to a first embodiment of the present invention;

fig. 4 is a schematic structural diagram of a mobile terminal according to the present invention;

fig. 5 is a schematic structural diagram of a mobile terminal according to the present invention;

fig. 6 is a block diagram of a mobile terminal according to a second embodiment of the present invention;

fig. 7 is a flowchart of a control method of a mobile terminal according to a fourth embodiment of the present invention.

The implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.

Detailed Description

It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

A mobile terminal implementing various embodiments of the present invention will now be described with reference to the accompanying drawings. In the following description, suffixes such as "module", "component", or "unit" used to denote elements are used only for facilitating the explanation of the present invention, and have no specific meaning in themselves. Thus, "module" and "component" may be used in a mixture.

The mobile terminal may be implemented in various forms. For example, the terminal described in the present invention may include a mobile terminal such as a mobile phone, a smart phone, a notebook computer, a digital broadcast receiver, a PDA (personal digital assistant), a PAD (tablet computer), a PMP (portable multimedia player), a navigation device, and the like, and a stationary terminal such as a digital TV, a desktop computer, and the like. In the following, it is assumed that the terminal is a mobile terminal. However, it will be understood by those skilled in the art that the configuration according to the embodiment of the present invention can be applied to a fixed type terminal in addition to elements particularly used for moving purposes.

Fig. 1 is a schematic diagram of a hardware structure of an alternative mobile terminal for implementing various embodiments of the present invention.

The mobile terminal 100 may include a wireless communication unit 110, an a/V (audio/video) input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, an interface unit 170, a controller 180, and a power supply unit 190, etc. Fig. 1 illustrates a mobile terminal having various components, but it is to be understood that not all illustrated components are required to be implemented. More or fewer components may alternatively be implemented. Elements of the mobile terminal will be described in detail below.

The wireless communication unit 110 typically includes one or more components that allow radio communication between the mobile terminal 100 and a wireless communication system or network. For example, the wireless communication unit may include at least one of a broadcast receiving module 111, a mobile communication module 112, a wireless internet module 113, a short-range communication module 114, and a location information module 115.

The broadcast receiving module 111 receives a broadcast signal and/or broadcast associated information from an external broadcast management server via a broadcast channel. The broadcast channel may include a satellite channel and/or a terrestrial channel. The broadcast management server may be a server that generates and transmits a broadcast signal and/or broadcast associated information or a server that receives a previously generated broadcast signal and/or broadcast associated information and transmits it to a terminal. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and the like. Also, the broadcast signal may further include a broadcast signal combined with a TV or radio broadcast signal. The broadcast associated information may also be provided via a mobile communication network, and in this case, the broadcast associated information may be received by the mobile communication module 112. The broadcast signal may exist in various forms, for example, it may exist in the form of an Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB), an Electronic Service Guide (ESG) of digital video broadcasting-handheld (DVB-H), and the like. The broadcast receiving module 111 may receive a signal broadcast by using various types of broadcasting systems. In particular, the broadcast receiving module 111 may receive a broadcast signal by using a signal such as multimedia broadcasting-terrestrial (DMB-T), digital multimedia broadcasting-satellite (DMB-S), digital video broadcasting-handheld (DVB-H), forward link media (MediaFLO)^@) A digital broadcasting system of a terrestrial digital broadcasting integrated service (ISDB-T), etc. receives digital broadcasting. The broadcast receiving module 111 may be constructed to be suitable for various broadcasting systems that provide broadcast signals as well as the above-mentioned digital broadcasting systems. The broadcast signal and/or broadcast associated information received via the broadcast receiving module 111 may be stored in the memory 160 (or other type of storage medium).

The mobile communication module 112 transmits and/or receives radio signals to and/or from at least one of a base station (e.g., access point, node B, etc.), an external terminal, and a server. Such radio signals may include voice call signals, video call signals, or various types of data transmitted and/or received according to text and/or multimedia messages.

The wireless internet module 113 supports wireless internet access of the mobile terminal. The module may be internally or externally coupled to the terminal. The wireless internet access technology to which the module relates may include WLAN (wireless LAN) (Wi-Fi), Wibro (wireless broadband), Wimax (worldwide interoperability for microwave access), HSDPA (high speed downlink packet access), and the like.

The short-range communication module 114 is a module for supporting short-range communication. Some examples of short-range communication technologies include bluetooth^TMRadio Frequency Identification (RFID), infrared data association (IrDA), Ultra Wideband (UWB), zigbee^TMAnd so on.

The location information module 115 is a module for checking or acquiring location information of the mobile terminal. A typical example of the location information module is a GPS (global positioning system). According to the current technology, the GPS module 115 calculates distance information and accurate time information from three or more satellites and applies triangulation to the calculated information, thereby accurately calculating three-dimensional current location information according to longitude, latitude, and altitude. Currently, a method for calculating position and time information uses three satellites and corrects an error of the calculated position and time information by using another satellite. In addition, the GPS module 115 can calculate speed information by continuously calculating current position information in real time.

The a/V input unit 120 is used to receive an audio or video signal. The a/V input unit 120 may include a camera 121 and a microphone 122, and the camera 121 processes image data of still pictures or video obtained by an image capturing apparatus in a video capturing mode or an image capturing mode. The processed image frames may be displayed on the display unit 151. The image frames processed by the cameras 121 may be stored in the memory 160 (or other storage medium) or transmitted via the wireless communication unit 110, and two or more cameras 121 may be provided according to the construction of the mobile terminal. The microphone 122 may receive sounds (audio data) via the microphone in a phone call mode, a recording mode, a voice recognition mode, or the like, and can process such sounds into audio data. The processed audio (voice) data may be converted into a format output transmittable to a mobile communication base station via the mobile communication module 112 in case of a phone call mode. The microphone 122 may implement various types of noise cancellation (or suppression) algorithms to cancel (or suppress) noise or interference generated in the course of receiving and transmitting audio signals.

The user input unit 130 may generate key input data according to a command input by a user to control various operations of the mobile terminal. The user input unit 130 allows a user to input various types of information, and may include a keyboard, dome sheet, touch pad (e.g., a touch-sensitive member that detects changes in resistance, pressure, capacitance, and the like due to being touched), scroll wheel, joystick, and the like. In particular, when the touch pad is superimposed on the display unit 151 in the form of a layer, a touch screen may be formed.

The sensing unit 140 detects a current state of the mobile terminal 100 (e.g., an open or closed state of the mobile terminal 100), a position of the mobile terminal 100, presence or absence of contact (i.e., touch input) by a user with the mobile terminal 100, an orientation of the mobile terminal 100, acceleration or deceleration movement and direction of the mobile terminal 100, and the like, and generates a command or signal for controlling an operation of the mobile terminal 100. For example, when the mobile terminal 100 is implemented as a slide-type mobile phone, the sensing unit 140 may sense whether the slide-type phone is opened or closed. In addition, the sensing unit 140 can detect whether the power supply unit 190 supplies power or whether the interface unit 170 is coupled with an external device.

The interface unit 170 serves as an interface through which at least one external device is connected to the mobile terminal 100. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The identification module may store various information for authenticating a user using the mobile terminal 100 and may include a User Identity Module (UIM), a Subscriber Identity Module (SIM), a Universal Subscriber Identity Module (USIM), and the like. In addition, a device having an identification module (hereinafter, referred to as an "identification device") may take the form of a smart card, and thus, the identification device may be connected with the mobile terminal 100 via a port or other connection means. The interface unit 170 may be used to receive input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more elements within the mobile terminal 100 or may be used to transmit data between the mobile terminal and the external device.

In addition, when the mobile terminal 100 is connected with an external cradle, the interface unit 170 may serve as a path through which power is supplied from the cradle to the mobile terminal 100 or may serve as a path through which various command signals input from the cradle are transmitted to the mobile terminal. Various command signals or power input from the cradle may be used as signals for recognizing whether the mobile terminal is accurately mounted on the cradle. The output unit 150 is configured to provide output signals (e.g., audio signals, video signals, alarm signals, vibration signals, etc.) in a visual, audio, and/or tactile manner. The output unit 150 may include a display unit 151, an audio output module 152, an alarm unit 153, and the like.

The display unit 151 may display information processed in the mobile terminal 100. For example, when the mobile terminal 100 is in a phone call mode, the display unit 151 may display a User Interface (UI) or a Graphical User Interface (GUI) related to a call or other communication (e.g., text messaging, multimedia file downloading, etc.). When the mobile terminal 100 is in a video call mode or an image capturing mode, the display unit 151 may display a captured image and/or a received image, a UI or GUI showing a video or an image and related functions, and the like.

Meanwhile, when the display unit 151 and the touch pad are overlapped with each other in the form of a layer to form a touch screen, the display unit 151 may serve as an input device and an output device. The display unit 151 may include at least one of a Liquid Crystal Display (LCD), a thin film transistor LCD (TFT-LCD), an Organic Light Emitting Diode (OLED) display, a flexible display, a three-dimensional (3D) display, and the like. Some of these displays may be configured to be transparent to allow a user to view from the outside, which may be referred to as transparent displays, and a typical transparent display may be, for example, a TOLED (transparent organic light emitting diode) display or the like. Depending on the particular desired implementation, the mobile terminal 100 may include two or more display units (or other display devices), for example, the mobile terminal may include an external display unit (not shown) and an internal display unit (not shown). The touch screen may be used to detect a touch input pressure as well as a touch input position and a touch input area.

The audio output module 152 may convert audio data received by the wireless communication unit 110 or stored in the memory 160 into an audio signal and output as sound when the mobile terminal is in a call signal reception mode, a call mode, a recording mode, a voice recognition mode, a broadcast reception mode, or the like. Also, the audio output module 152 may provide audio output related to a specific function performed by the mobile terminal 100 (e.g., a call signal reception sound, a message reception sound, etc.). The audio output module 152 may include a speaker, a buzzer, and the like.

The alarm unit 153 may provide an output to notify the mobile terminal 100 of the occurrence of an event. Typical events may include call reception, message reception, key signal input, touch input, and the like. In addition to audio or video output, the alarm unit 153 may provide output in different ways to notify the occurrence of an event. For example, the alarm unit 153 may provide an output in the form of vibration, and when a call, a message, or some other incoming communication (incomingmunication) is received, the alarm unit 153 may provide a tactile output (i.e., vibration) to inform the user thereof. By providing such a tactile output, the user can recognize the occurrence of various events even when the user's mobile phone is in the user's pocket. The alarm unit 153 may also provide an output notifying the occurrence of an event via the display unit 151 or the audio output module 152.

The memory 160 may store software programs and the like for processing and controlling operations performed by the controller 180, or may temporarily store data (e.g., a phonebook, messages, still images, videos, and the like) that has been or will be output. Also, the memory 160 may store data regarding various ways of vibration and audio signals output when a touch is applied to the touch screen.

The memory 160 may include at least one type of storage medium including a flash memory, a hard disk, a multimedia card, a card-type memory (e.g., SD or DX memory, etc.), a Random Access Memory (RAM), a Static Random Access Memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read-only memory (PROM), a magnetic memory, a magnetic disk, an optical disk, and the like. Also, the mobile terminal 100 may cooperate with a network storage device that performs a storage function of the memory 160 through a network connection.

The controller 180 generally controls the overall operation of the mobile terminal. For example, the controller 180 performs control and processing related to voice calls, data communications, video calls, and the like. In addition, the controller 180 may include a multimedia module 1810 for reproducing (or playing back) multimedia data, and the multimedia module 1810 may be constructed within the controller 180 or may be constructed separately from the controller 180. The controller 180 may perform a pattern recognition process to recognize a handwriting input or a picture drawing input performed on the touch screen as a character or an image.

The power supply unit 190 receives external power or internal power and provides appropriate power required to operate various elements and components under the control of the controller 180.

The various embodiments described herein may be implemented in a computer-readable medium using, for example, computer software, hardware, or any combination thereof. For a hardware implementation, the embodiments described herein may be implemented using at least one of an Application Specific Integrated Circuit (ASIC), a Digital Signal Processor (DSP), a Digital Signal Processing Device (DSPD), a Programmable Logic Device (PLD), a Field Programmable Gate Array (FPGA), a processor, a controller, a microcontroller, a microprocessor, an electronic unit designed to perform the functions described herein, and in some cases, such embodiments may be implemented in the controller 180. For a software implementation, the implementation such as a process or a function may be implemented with a separate software module that allows performing at least one function or operation. The software codes may be implemented by software applications (or programs) written in any suitable programming language, which may be stored in the memory 160 and executed by the controller 180.

Up to this point, mobile terminals have been described in terms of their functionality. Hereinafter, a slide-type mobile terminal among various types of mobile terminals, such as a folder-type, bar-type, swing-type, slide-type mobile terminal, and the like, will be described as an example for the sake of brevity. Accordingly, the present invention can be applied to any type of mobile terminal, and is not limited to a slide type mobile terminal.

The mobile terminal 100 as shown in fig. 1 may be configured to operate with communication systems such as wired and wireless communication systems and satellite-based communication systems that transmit data via frames or packets.

A communication system in which a mobile terminal according to the present invention is operable will now be described with reference to fig. 2.

Such communication systems may use different air interfaces and/or physical layers. For example, the air interface used by the communication system includes, for example, Frequency Division Multiple Access (FDMA), Time Division Multiple Access (TDMA), Code Division Multiple Access (CDMA), and Universal Mobile Telecommunications System (UMTS) (in particular, Long Term Evolution (LTE)), global system for mobile communications (GSM), and the like. By way of non-limiting example, the following description relates to a CDMA communication system, but such teachings are equally applicable to other types of systems.

Referring to fig. 2, the CDMA wireless communication system may include a plurality of mobile terminals 100, a plurality of Base Stations (BSs) 270, Base Station Controllers (BSCs) 275, and a Mobile Switching Center (MSC) 280. The MSC280 is configured to interface with a Public Switched Telephone Network (PSTN) 290. The MSC280 is also configured to interface with a BSC275, which may be coupled to the base station 270 via a backhaul. The backhaul may be constructed according to any of several known interfaces including, for example, E1/T1, ATM, IP, PPP, frame Relay, HDSL, ADSL, or xDSL. It will be understood that a system as shown in fig. 2 may include multiple BSCs 2750.

Each BS270 may serve one or more sectors (or regions), each sector covered by a multi-directional antenna or an antenna pointing in a particular direction being radially distant from the BS 270. Alternatively, each partition may be covered by two or more antennas for diversity reception. Each BS270 may be configured to support multiple frequency allocations, with each frequency allocation having a particular frequency spectrum (e.g., 1.25MHz,5MHz, etc.).

The intersection of partitions with frequency allocations may be referred to as a CDMA channel. The BS270 may also be referred to as a Base Transceiver Subsystem (BTS) or other equivalent terminology. In such a case, the term "base station" may be used to generically refer to a single BSC275 and at least one BS 270. The base stations may also be referred to as "cells". Alternatively, each sector of a particular BS270 may be referred to as a plurality of cell sites.

As shown in fig. 2, a Broadcast Transmitter (BT)295 transmits a broadcast signal to the mobile terminal 100 operating within the system. A broadcast receiving module 111 as shown in fig. 1 is provided at the mobile terminal 100 to receive a broadcast signal transmitted by the BT 295. In fig. 2, several Global Positioning System (GPS) satellites 300 are shown. The satellite 300 assists in locating at least one of the plurality of mobile terminals 100.

In fig. 2, a plurality of satellites 300 are depicted, but it is understood that useful positioning information may be obtained with any number of satellites. The GPS module 115 as shown in fig. 1 is generally configured to cooperate with satellites 300 to obtain desired positioning information. Other techniques that can track the location of the mobile terminal may be used instead of or in addition to GPS tracking techniques. In addition, at least one GPS satellite 300 may selectively or additionally process satellite DMB transmission.

As a typical operation of the wireless communication system, the BS270 receives reverse link signals from various mobile terminals 100. The mobile terminal 100 is generally engaged in conversations, messaging, and other types of communications. Each reverse link signal received by a particular base station 270 is processed within the particular BS 270. The obtained data is forwarded to the associated BSC 275. The BSC provides call resource allocation and mobility management functions including coordination of soft handoff procedures between BSs 270. The BSCs 275 also route the received data to the MSC280, which provides additional routing services for interfacing with the PSTN 290. Similarly, the PSTN290 interfaces with the MSC280, the MSC interfaces with the BSCs 275, and the BSCs 275 accordingly control the BS270 to transmit forward link signals to the mobile terminal 100.

Based on the above mobile terminal hardware structure and communication system, various embodiments of the present invention are proposed.

A first embodiment of the present invention provides a mobile terminal, as shown in fig. 3, including: a first front camera module 310, a second front camera module 320, and a control module 330, wherein:

the first front camera module 310 is adapted to generate a first instruction when sensing that the light intensity variation reaches a set threshold value, and output the first instruction to the control module 330;

the second front camera module 320 is adapted to generate a second instruction when sensing that the light intensity variation reaches a set threshold value, and output the second instruction to the control module 330;

the control module 330 is adapted to determine a matching parameter when two instructions are received and a time interval between the two instructions is less than or equal to a set time threshold, match a corresponding operation item according to the matching parameter, and perform operation control according to the matched operation item; the matching parameters include one or more of the following parameters: a generator of the two instructions, a receiving order of the two instructions, and a state of the mobile terminal.

In the embodiment of the invention, the cameras have the photosensitive function, so that a user can shield different front cameras to influence the intensity of light sensed by the front cameras, thereby forming the corresponding relation between the shielding sequence and the operation items, and further realizing the function control of the original function key by shielding the front cameras.

The mobile terminal according to the embodiment of the present invention may be, but is not limited to, a three-sided structure, as shown in fig. 4, the mobile terminal 300 is provided with a display 301 and an upper frame 302 on the front surface thereof, and does not have a lower frame and left and right frames. In the embodiment of the present invention, the first front camera module 310 and the second front camera module 320 are disposed in the upper frame 302.

Alternatively, as shown in fig. 5, the front surface of the mobile terminal 300 includes: display screen 301 and lower border 303 without upper and left and right borders. In the embodiment of the present invention, the first front camera module 310 and the second front camera module 320 are disposed in the lower frame 303.

The technical personnel in the field can flexibly select the setting mode of the front camera according to the requirements. In an embodiment of the present invention, the mode shown in fig. 5 is adopted, that is, two front cameras are arranged in the lower frame 303, and the arrangement mode is the same as the arrangement mode of the existing function keys, so that the operation by a user is facilitated, and the operation efficiency of the user is ensured.

In an alternative embodiment of the present invention, the first front camera module 310 and the second front camera module 320 are sequentially arranged from left to right in a horizontal direction in a bottom original home key area of the mobile terminal.

In the embodiment of the present invention, the first front camera module 310 and the second front camera module 320 should be separated by a specific distance L.

The minimum value of L is required to satisfy feature 1, that is, when each finger of a general user is normally blocked by the finger abdomen, the first front camera module 310 and the second front camera module 320 cannot be completely covered at the same time.

The maximum value of L needs to satisfy feature 2, i.e. the time required for a typical user to slide from one front camera module to another at normal speed should not exceed the user's average endurance limit, e.g. 1 s. Wherein, the regular speed can be obtained by counting multiple users.

Further, in the embodiment of the present invention, the light intensity changes sensed by the two front camera modules may be light-to-dark intensity changes or dark-to-light intensity changes, which is not limited in the embodiment of the present invention.

Further, in an optional embodiment of the present invention, in order to avoid the mobile terminal being in an environment with alternating light and shade, which causes misoperation, the embodiment of the present invention further provides the following solutions, specifically:

in the embodiment of the present invention, in the scheme 1, when the time interval between two instructions is adjusted to be greater than zero and less than or equal to the set time threshold, the matching parameter is determined. That is to say, if the whole mobile terminal is in an environment with alternating light and shade, the light induction intensities of the two front cameras of the mobile terminal are necessarily changed at the same time, so that the situation that the time interval is zero is eliminated in the scheme, and the problem that misoperation may be caused is well solved.

In the embodiment of the present invention, a pressure-sensitive sensor is further disposed on the mobile terminal, that is, when the control module 330 receives the two instructions and the time interval between the two instructions is less than or equal to the set time threshold, it is further determined whether the pressing strength of the front camera is greater than the set threshold, and when the pressing strength is also greater than the set threshold, the matching parameter is determined. Therefore, by adopting the scheme, the problem that misoperation may be caused can be well solved.

Further, in the embodiment of the present invention, the state of the mobile terminal includes, but is not limited to: a screen locking state and a screen unlocking state.

Further, in the embodiment of the present invention, the operation items include, but are not limited to: unlocking, shooting, returning to a main interface, calling a multi-task interface and returning.

In the embodiment of the present invention, after determining the matching parameter, the control module 330 calls a mapping relationship table of the preset matching parameter and the operation item, searches the mapping relationship table to obtain the operation item matched with the determined matching parameter, and performs operation control according to the matched operation item.

In a specific embodiment of the present invention, the setting manner of the mapping relationship table of the matching parameters and the operation items is as follows:

assuming that the first front camera is P1 and the second front camera is P2, when the user presses the front cameras, the light sensation changes obviously, and when the intensity change reaches a set threshold, the light sensation change is recorded as a command T, then:

for the unlocking operation: when the terminal is in a screen locking state and slides from left to right, instructions T1 and T2 are generated by P1 and P2 respectively, and T1 and T2 respond to unlocking operation within a preset time interval;

for the shooting operation: when the terminal is in a screen locking state or a screen unlocking state, the terminal slides from right to left, instructions T2 and T1 are generated by P2 and P1 respectively, and T2 and T1 respond to quick shooting operation within a preset time interval;

for the return to home interface (also called home key function) operation: when the terminal is in a non-screen-locking state, two times of T1 instructions are continuously generated within a preset time interval, and then the terminal returns to the main interface;

aiming at the operation of calling a multitask interface: when the terminal is in a non-screen-locking state, two times of T2 instructions are continuously generated within a preset time interval, and then a multi-task interface is called;

for the return operation: and when the terminal is in a non-lock screen state, generating the commands T1 and T2 within a preset time interval respectively, and then performing a return operation (or defining that generating the commands T2 and T1 respectively, then performing a return operation).

The setting mode of the mapping relation table is only a specific implementation mode of the invention, the invention does not limit the mapping relation table uniquely, and a person skilled in the art can set the mapping relation table flexibly according to needs.

In summary, the mobile terminal according to the embodiment of the present invention can determine whether the user blocks the front-facing camera module by using the photosensitive function of the front-facing camera module, so as to obtain the blocking mode of the user, and can perform matching of the original function key operation item according to the blocking mode, and perform operation control. Therefore, the function of the original function key of the mobile terminal is realized by multiplexing the function of the front camera module. The mobile terminal adopting the technical scheme of the invention can remove the original function keys and provide powerful support for the enlargement of the screen of the mobile terminal.

In a second embodiment of the present invention, there is provided a mobile terminal, as shown in fig. 6, including: a first front camera module 610, a second front camera module 620, a grip detection module 630, and a control module 640, wherein:

the first front camera module 610 is adapted to generate a first instruction when sensing that the light intensity change reaches a set threshold value, and output the first instruction to the control module 640;

the second front camera module 620 is adapted to generate a second instruction when sensing that the light intensity change reaches a set threshold value, and output the second instruction to the control module 640;

a holding detection module 630 adapted to detect a holding mode of the mobile terminal and output the detected holding mode to the control module 640;

the control module 640 is adapted to determine a matching parameter when two instructions are received and a time interval between the two instructions is less than or equal to a set time threshold, call a preset mapping relation table between the matching parameter corresponding to the holding mode and an operation item, search the mapping relation table to obtain the operation item matched with the determined matching parameter, and perform operation control according to the matched operation item, where the matching parameter includes one or more of the following parameters: a generator of the two instructions, a receiving order of the two instructions, and a state of the mobile terminal.

In this embodiment, it is considered that different users may use different holding modes, for example, a left-hand mode, a right-hand mode, etc., however, when different holding modes are used, the manner in which the user operates the two front cameras may be different, for example, when the right-hand mode is used, the sliding sequence is from left to right when unlocking, and when the left-hand mode is used, the sliding sequence is from right to left when unlocking. Therefore, in this embodiment, the mapping relationship table corresponding to the holding mode is called to adapt to the operation habits of different users, so as to improve the user experience of the user.

In this embodiment, the right-hand mode may be defaulted, and when it is recognized that the holding hand is changed, all the schemes related to the sequence are switched to the left-hand mode.

In a specific embodiment of the present invention, since the mobile terminal has a side frameless structure, and the touch area of the frameless structure extends to the edge area, when a user holds the terminal, a touch operation is inevitably generated on the edge touch area, and the present invention can detect a holding mode by detecting the touch operation. Of course, the present invention is not limited to this detection method, and any method that can realize the detection of the holding mode and apply it to the solution of the present invention is within the scope of the protection idea of the present invention.

In the embodiment of the present invention, regarding the setting modes of the two front-facing camera modules, the mode of avoiding the misoperation, the setting mode of the mapping relationship table, and the like, reference may be made to the first embodiment, and details are not described in this embodiment.

In summary, in the embodiment of the present invention, it is considered that the cameras all have a light sensing function, so that a user can shield different front cameras to influence the intensity of light sensed by the front cameras, thereby forming a corresponding relationship between a shielding sequence and an operation item, and further realizing function control of an original function key by shielding the front cameras. Meanwhile, the embodiment also considers the holding mode of the user, and adapts to different operation habits of the user according to the holding mode, so that the use experience of the user is further improved.

A third embodiment of the present invention provides a mobile terminal, which will be described in this embodiment with a focus on unlocking security, and for other implementation details, reference may be made to the first and second embodiments, specifically, the mobile terminal in this embodiment includes: first leading camera module, the leading camera module of second and control module, wherein:

the second front camera module is suitable for generating a second instruction when sensing that the light intensity change reaches a set threshold value and outputting the second instruction to the control module;

In the embodiment of the present invention, the operation items include, but are not limited to: unlocking, shooting, returning to a main interface, calling a multi-task interface, returning and the like.

In an embodiment of the present invention, when the operation item is unlocked, in order to improve the unlocking security, the control module is specifically adapted to control the designated front camera module to perform image acquisition, perform user identification using an image acquired by the front camera module, and perform unlocking control according to an identification result when the matched operation item is unlocked.

Optionally, in this embodiment, the designated camera module is a generator of an instruction preferentially received in the two instructions. For example, when the terminal is in a screen locking state, if a user slides from left to right and respectively passes through the first front camera module and the second front camera module, the two modules respectively generate instructions T1 and T2, and T1 and T2 are within a preset time interval, the operation item is matched to be an unlocking operation. At this time, the control module preferentially receives the T1 instruction, and the generator corresponding to the T1 instruction is the first front camera module, so that the first front camera module can be started to perform image acquisition at this time. In this embodiment, it is mainly considered that the user slides on the front camera from left to right, and when the finger of the user slides to the second front camera module, the first front camera module is not in the shielding state, so that the first front camera module can be started to perform image acquisition, and perform information identification on the acquired user information, for example, perform face recognition, and perform unlocking response only when the recognition result is a legal user.

In the embodiment of the invention, the cameras have the photosensitive function, so that a user can shield different front cameras to influence the intensity of light sensed by the front cameras, thereby forming the corresponding relation between the shielding sequence and the operation items, and further realizing the function control of the original function key by shielding the front cameras. Meanwhile, when the unlocking operation is performed, image acquisition and user identification are also performed, and the operation safety is further enhanced.

In a fourth embodiment of the present invention, there is provided a control method of a mobile terminal including a first front camera module and a second front camera module, as shown in fig. 7, the method including the steps of:

step S701, sensing light intensity change by using the first front camera module and the second front camera module;

step S702, when the light intensity changes of two times reach a set threshold and the time interval between the two times is less than or equal to the set time threshold, determining a matching parameter, matching a corresponding operation item according to the matching parameter, and performing operation control according to the matched operation item; the matching parameters include one or more of the following parameters: and sensing the sensing party when the two light intensity changes reach the set threshold, the occurrence sequence when the two light intensity changes reach the set threshold and the state of the mobile terminal.

Wherein, the sensing direction refers to a front camera module for sensing the light intensity change.

The mobile terminal according to the embodiment of the present invention may be, but is not limited to, a three-sided structure, as shown in fig. 4, the mobile terminal 300 is provided with a display 301 and an upper frame 302 on the front surface thereof, and does not have a lower frame and left and right frames. In the embodiment of the present invention, the first front camera module and the second front camera module are disposed in the upper frame 302.

Alternatively, as shown in fig. 5, the front surface of the mobile terminal 300 includes: display screen 301 and lower border 303 without upper and left and right borders. In the embodiment of the present invention, the first front camera module and the second front camera module are disposed in the lower frame 303.

In an optional embodiment of the invention, the first front camera module and the second front camera module are arranged in the original home key area at the bottom of the mobile terminal from left to right along the horizontal direction.

In the embodiment of the present invention, the first front camera module and the second front camera module should be separated by a specific distance L.

The minimum value of L needs to satisfy feature 1, that is, when each finger of a general user is normally shielded by the finger abdomen, the first front camera module and the second front camera module cannot be completely covered at the same time.

in the embodiment of the present invention, in scheme 1, when the time interval between two times of light intensity changes reaching the set threshold is adjusted to be greater than zero and less than or equal to the set time threshold, the matching parameter is determined. That is to say, if the whole mobile terminal is in an environment with alternating light and shade, the light induction intensities of the two front cameras of the mobile terminal are necessarily changed at the same time, so that the situation that the time interval is zero is eliminated in the scheme, and the problem that misoperation may be caused is well solved.

In the embodiment of the present invention, a pressure-sensitive sensor is further disposed on the mobile terminal, that is, when the light intensity changes twice reach a set threshold and the time interval between two times is less than or equal to the set time threshold, it is further determined whether the pressing strength of the front camera is greater than the set threshold, and when the pressing strength is also greater than the set threshold, the matching parameter is determined. Therefore, by adopting the scheme, the problem that misoperation may be caused can be well solved.

Further, in the embodiment of the present invention, after the matching parameter is determined, a mapping relation table between a preset matching parameter and an operation item is retrieved, the mapping relation table is searched for, an operation item matched with the determined matching parameter is obtained, and operation control is performed according to the matched operation item.

In an optional embodiment of the present invention, when step S701 is executed, a holding mode of the mobile terminal is further detected, and at this time, in step S702, after the matching parameter is determined, a preset mapping relation table between the matching parameter corresponding to the holding mode and the operation item is called, the mapping relation table is searched, the operation item matched with the determined matching parameter is obtained, and operation control is performed according to the matched operation item.

In summary, the control method according to the embodiment of the present invention can determine whether the user blocks the front-facing camera module by using the photosensitive function of the front-facing camera module, so as to obtain the blocking mode of the user, and can perform matching of the original function key operation item according to the blocking mode, and perform operation control. Therefore, the function of the original function key of the mobile terminal is realized by multiplexing the function of the front camera module. The mobile terminal adopting the technical scheme of the invention can remove the original function keys and provide powerful support for the enlargement of the screen of the mobile terminal.

In a fifth embodiment of the present invention, a method for controlling a mobile terminal including a first front camera module and a second front camera module is provided, and this embodiment will be described with emphasis on unlocking security, and for other implementation details, reference may be made to a fourth embodiment, and specifically, as shown in fig. 7, the method includes the following steps:

In an optional embodiment of the present invention, when sensing that the light intensity changes and the degree of change reaches the set threshold, the first front camera module and the second front camera module generate an instruction (i.e. in this embodiment, determining whether the first front camera module and the second front camera module sense the change in light intensity reaching the set threshold by determining whether the first front camera module and the second front camera module generate an instruction) assuming that: when sensing that the light intensity changes and the degree of change reaches the set threshold value, the first front camera module generates an instruction T1, and when sensing that the light intensity changes and the degree of change reaches the set threshold value, the second front camera module generates an instruction T2, and there are:

for the unlocking operation: when the terminal is in a screen locking state and slides from left to right, the first front camera module and the second front camera module respectively generate instructions T1 and T2, and T1 and T2 respond to unlocking operation within a preset time interval;

for the shooting operation: when the terminal is in a screen locking state or a non-screen locking state, the terminal slides from right to left, the second front camera module and the first front camera module respectively generate instructions T2 and T1, and the T2 and the T1 respond to quick shooting operation within a preset time interval;

for the return to home interface (also called home key function) operation: when the terminal is in a non-screen-locking state and within a preset time interval, the first front-facing camera module continuously generates two times of T1 instructions, and then the instructions are returned to the main interface;

aiming at the operation of calling a multitask interface: when the terminal is in a non-screen-locking state and within a preset time interval, the second front-facing camera module continuously generates two times of T2 instructions, and then a multitask interface is called;

In one embodiment of the invention, when the operation item is unlocked, in order to improve the unlocking safety, when the matched operation item is unlocked, the appointed front camera module is controlled to perform image acquisition, user identification is performed by using the acquired image, and unlocking control is performed according to the identification result.

Optionally, in this embodiment, it is assumed that, for the unlocking operation: when the terminal is in a screen locking state and slides from left to right, the first front camera module and the second front camera module respectively generate instructions T1 and T2, and T1 and T2 respond to unlocking operation within a preset time interval;

in this embodiment, the T1 instruction is generated preferentially, and then the T2 instruction is generated, so that the first front camera module can be activated to capture images at this time. Specifically, in this embodiment, it is mainly considered that when the user slides on the front camera from left to right to unlock the mobile phone, and when the finger of the user slides to the second front camera module, the first front camera module is not in the shielding state, so that the first front camera module may be started to perform image acquisition, perform information recognition on the acquired user information, for example, perform face recognition, and perform an unlocking response only when the recognition result is a legal user.

In summary, in the embodiment of the present invention, it is considered that the cameras all have a light sensing function, so that a user can shield different front cameras to influence the intensity of light sensed by the front cameras, thereby forming a corresponding relationship between a shielding sequence and an operation item, and further realizing function control of an original function key by shielding the front cameras. Meanwhile, when the unlocking operation is performed, image acquisition and user identification are also performed, and the operation safety is further enhanced.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.

The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.

Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal device (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.

The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.

Claims

1. A mobile terminal, comprising: the device comprises a first front camera module, a second front camera module and a control module;

the control module is suitable for determining matching parameters when two instructions are received and the time interval of the two instructions is less than or equal to a set time threshold, matching corresponding operation items according to the matching parameters, and performing operation control according to the matched operation items; the matching parameters include one or more of the following parameters: the generation party of the two instructions, the receiving sequence of the two instructions and the state of the mobile terminal;

the control module is specifically suitable for calling a preset mapping relation table of the matching parameters and the operation items after the matching parameters are determined, searching the mapping relation table to obtain the operation items matched with the determined matching parameters, and performing operation control according to the matched operation items.

2. The mobile terminal of claim 1, wherein the operation item comprises one of: unlocking, shooting, returning to a main interface, calling a multi-task interface and returning.

3. The mobile terminal according to claim 2, wherein the control module is specifically adapted to control the designated front camera module to perform image capture, perform user identification using the captured image, and perform unlocking control according to the identification result when the matched operation item is unlocking.

4. The mobile terminal of claim 1, further comprising: a grip detection module;

5. A method of controlling a mobile terminal including a first front camera module and a second front camera module, the method comprising:

when the light intensity changes of two times reach a set threshold value and the time interval between the two times is less than or equal to the set time threshold value, determining a matching parameter, matching a corresponding operation item according to the matching parameter, and performing operation control according to the matched operation item; the matching parameters include one or more of the following parameters: sensing the sensing party when the two light intensity changes reach the set threshold, the occurrence sequence when the two light intensity changes reach the set threshold and the state of the mobile terminal;

after the matching parameters are determined, the method specifically includes: calling a mapping relation table of preset matching parameters and operation items, searching the mapping relation table to obtain the operation items matched with the determined matching parameters, and performing operation control according to the matched operation items.

6. The method of claim 5, wherein the operation item comprises one of: unlocking, shooting, returning to a main interface, calling a multi-task interface and returning.

7. The method according to claim 6, wherein when the matched operation item is unlocked, after matching the corresponding operation item according to the matching parameter, specifically comprising: and controlling the appointed front camera module to acquire images, identifying users by using the acquired images, and performing unlocking control according to an identification result.

8. The method of claim 5, wherein the method further comprises: detecting a holding mode of the mobile terminal;