CN106550108B - Device and method for realizing mouse function by using mobile phone and mobile phone with device - Google Patents

Device and method for realizing mouse function by using mobile phone and mobile phone with device Download PDF

Info

Publication number
CN106550108B
CN106550108B CN201610812112.6A CN201610812112A CN106550108B CN 106550108 B CN106550108 B CN 106550108B CN 201610812112 A CN201610812112 A CN 201610812112A CN 106550108 B CN106550108 B CN 106550108B
Authority
CN
China
Prior art keywords
mouse
mobile phone
signal
key
state
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201610812112.6A
Other languages
Chinese (zh)
Other versions
CN106550108A (en
Inventor
张祝宾
金胜昔
刘玉婷
邓永文
杜东逸
曾仁智
宁瀛锋
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Gree Electric Appliances Inc of Zhuhai
Original Assignee
Gree Electric Appliances Inc of Zhuhai
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Gree Electric Appliances Inc of Zhuhai filed Critical Gree Electric Appliances Inc of Zhuhai
Priority to CN201610812112.6A priority Critical patent/CN106550108B/en
Publication of CN106550108A publication Critical patent/CN106550108A/en
Application granted granted Critical
Publication of CN106550108B publication Critical patent/CN106550108B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0354Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
    • G06F3/03541Mouse/trackball convertible devices, in which the same ball is used to track the 2D relative movement
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/72406User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by software upgrading or downloading
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/72409User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories
    • H04M1/72415User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories for remote control of appliances
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72448User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions
    • H04M1/72454User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions according to context-related or environment-related conditions
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72448User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions
    • H04M1/72457User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions according to geographic location
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72466User interfaces specially adapted for cordless or mobile telephones with selection means, e.g. keys, having functions defined by the mode or the status of the device
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72469User interfaces specially adapted for cordless or mobile telephones for operating the device by selecting functions from two or more displayed items, e.g. menus or icons

Landscapes

  • Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Environmental & Geological Engineering (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Position Input By Displaying (AREA)
  • Telephone Function (AREA)

Abstract

The invention provides a device and a method for realizing a mouse function by a mobile phone and the mobile phone with the device, wherein the device for realizing the mouse function by the mobile phone comprises: the photoelectric component is integrated in the camera of the mobile phone and used for capturing displacement data of the mobile phone; the data conversion unit is used for converting the displacement data of the mobile phone captured by the photoelectric component into a mouse movement signal; and the sending unit is used for sending the mouse moving signal to a computer connected with the mobile phone and controlling the mouse position of a computer screen according to the mouse moving signal. According to the technical scheme, the photoelectric component is integrated in the camera, so that the function of the camera can be realized, the power consumption is low, the components are integrated, the use is convenient, and the excellent user experience is brought.

Description

Device and method for realizing mouse function by using mobile phone and mobile phone with device
Technical Field
The invention relates to the field of electronic equipment, in particular to a device and a method for realizing a mouse function by using a mobile phone and the mobile phone with the device.
Background
For a computer user, a mouse is an indispensable input device, and for a notebook computer, it is difficult to perform operations if the user forgets to carry the mouse. When a user watches movies or listens to music by using a computer, the user does not like to sit at a computer desk, but usually likes to move to a comfortable place for watching, and at the moment, the user is away from the computer for a certain distance, so that the mouse is inconvenient to place aside. Under the conditions, the mobile phone APP can be connected with the mobile phone through Bluetooth or WIFI, and the mouse operation is replaced on the mobile phone in a touch and voice mode.
Patent application with publication number CN104793767A discloses a mobile phone mouse, based on the butt joint of APP software and computer software, realizes the effect with the same function of computer mouse on the APP software, but the technical scheme of this patent is to use the cell-phone light, and light consumption and calorific capacity are big, are difficult to use for a long time. Patent application with publication number CN202218301U discloses a mobile phone with mouse function, but the technical solution of the patent is to install a mouse photoelectric transceiver module on the back of the mobile phone, and adding additional modules will make the mobile phone cumbersome and affect the appearance of the mobile phone.
Disclosure of Invention
In view of the above, an aspect of the present invention provides an apparatus for implementing a mouse function with a mobile phone, including: the photoelectric component is integrated in the camera of the mobile phone and used for capturing displacement data of the mobile phone; the data conversion unit is used for converting the displacement data of the mobile phone captured by the photoelectric component into a mouse movement signal; and the sending unit is used for sending the mouse moving signal converted by the data conversion unit to a computer connected with the mobile phone and controlling the mouse position of a computer screen according to the mouse moving signal.
Optionally, the optoelectronic component comprises an infrared mouse module and/or an optical engine; the infrared mouse module is used for capturing displacement data of the mobile phone when the mobile phone moves on a desktop; the optical engine is used for capturing displacement data of the mobile phone when the mobile phone moves in the air.
Optionally, the electronic device further includes a key assembly, where the key assembly includes a click action unit configured to: responding to a click of a key arranged on a screen of a mobile phone APP, and sending a click signal to the data conversion unit; the data conversion unit is further configured to: converting the received click signal into a mouse button signal; the transmitting unit is further configured to: sending the mouse key signals converted by the data conversion unit to a computer connected with the mobile phone, and controlling the mouse click action of a computer screen according to the mouse key signals; the keys arranged on the screen of the mobile phone APP comprise a left key, a middle key and a right key.
Optionally, the key assembly further comprises a roller action unit configured to: responding to the up-down sliding of the middle key arranged on the screen of the mobile phone APP, and sending a middle key sliding signal to the data conversion unit; the data conversion unit is further configured to: converting the received middle key sliding signal into a mouse roller rolling signal; the transmitting unit is further configured to: and sending the mouse roller rolling signal converted by the data conversion unit to a computer connected with the mobile phone, and controlling a computer screen to realize the function of up-and-down rolling of the mouse roller according to the mouse roller rolling signal.
Optionally, the mobile terminal further includes a touch component, where the touch component includes a sliding area unit configured to: setting a mouse sliding area on a mobile phone APP screen, and capturing displacement data of fingers in the mouse sliding area; the data conversion unit is further configured to: and converting the displacement data of the finger captured by the touch control assembly into a mouse movement signal, and transmitting the mouse movement signal to the sending unit.
Optionally, the touch control assembly further includes a slider area unit configured to: setting a mouse sliding bar area on a mobile phone APP screen, and capturing displacement data of fingers in the mouse sliding bar area; the data conversion unit is further configured to: converting the displacement data of the mouse sliding bar area into a mouse roller rolling signal; the transmitting unit is further configured to: and sending the mouse roller rolling signal to a computer connected with the mobile phone, and controlling a computer screen to realize the up-and-down rolling function of the mouse roller according to the mouse roller rolling signal.
Optionally, the apparatus further comprises a voice control module configured to: identifying the received voice information to obtain voice instruction information corresponding to the mouse operation instruction; the data conversion unit is further configured to: converting the voice instruction information into a mouse moving signal or an operation signal of associated software; the transmitting unit is further configured to: and sending the mouse moving signal or the operation signal of the associated software to a computer connected with the mobile phone, and controlling the mouse position of a computer screen according to the mouse action signal or operating the associated software according to the operation signal of the associated software.
Optionally, the speech module is configured to: and responding to the pressing of a side key of the mobile phone, starting the voice control module, and implementing voice control on the mobile phone.
Optionally, the system further comprises a switching module configured to: judging the position state of the mobile phone by measuring the distance between the mobile phone and an adjacent plane object, wherein the position state comprises an aerial state and a state close to the plane object; under the condition that the position state of the mobile phone is changed from an air state to a state close to a plane object, automatically switching the photoelectric component from the optical engine to the infrared mouse module; under the condition that the position state of the mobile phone is changed from a state close to a plane object to a state in the air, the photoelectric component is automatically switched from the infrared mouse module to the optical engine; and inquiring whether the user is switched from the photoelectric component to the touch component or not under the condition that the position state of the mobile phone is changed from the state of being close to a plane object to the state of being in the air and the detected ambient light intensity is greater than the preset light intensity threshold value.
Optionally, the mobile phone further comprises a function setting module configured to respond to clicking a function setting button arranged on the screen of the mobile phone to realize function setting, wherein the function setting comprises pairing connection, and the mobile phone is connected with the computer through pairing.
Optionally, the function setting further includes at least one of left-right hand mode switching, mouse button addition, and mouse proofreading.
The invention also provides a mobile phone with any one of the devices.
The invention also provides a method for realizing the mouse function by using the mobile phone, which comprises the following steps: the photoelectric component is integrated in a mobile phone camera and used for capturing displacement data of the mobile phone; converting the displacement data of the mobile phone captured by the photoelectric component into a mouse movement signal; and sending the mouse moving signal to a computer connected with the mobile phone, and controlling the mouse position of a computer screen according to the mouse moving signal.
Optionally, the optoelectronic component comprises an infrared mouse module and/or an optical engine; the infrared mouse module is used for capturing displacement data of the mobile phone when the mobile phone moves on a desktop; the optical engine is used for capturing displacement data of the mobile phone when the mobile phone moves in the air.
Optionally, the method further comprises: responding to a click of a key arranged on a mobile phone APP screen, and generating a click signal; converting the click signal into a mouse button signal; sending the mouse button signal to a computer connected with the mobile phone, and controlling a mouse clicking action of a computer screen according to the mouse button signal; the keys arranged on the screen of the mobile phone APP comprise a left key, a middle key and a right key.
Optionally, the method further comprises: responding to the up-and-down sliding of the middle key arranged on the screen of the mobile phone APP, and generating a middle key sliding signal; converting the middle key sliding signal into a mouse roller rolling signal; and sending the mouse roller rolling signal to a computer connected with the mobile phone, and controlling a computer screen to realize the up-and-down rolling function of the mouse roller according to the mouse roller rolling signal.
Optionally, the method further comprises: setting a mouse sliding area on a mobile phone APP screen through a touch component, and capturing displacement data of fingers in the mouse sliding area; converting the displacement data of the finger captured by the touch component into a mouse movement signal; and sending the mouse moving signal to a computer connected with the mobile phone, and controlling the mouse position of a computer screen according to the mouse action signal.
Optionally, the method further comprises: setting a mouse sliding strip area on a mobile phone APP screen through the touch control assembly, and capturing displacement data of fingers in the mouse sliding strip area; converting the displacement data of the mouse sliding bar area into a mouse roller rolling signal; and sending the mouse roller rolling signal to a computer connected with the mobile phone, and controlling a computer screen to realize the up-and-down rolling function of the mouse roller according to the mouse roller rolling signal.
Optionally, the method further comprises: identifying the received voice information to obtain voice instruction information corresponding to the mouse operation instruction; converting the voice instruction information into a mouse moving signal or an operation signal of associated software; and sending the mouse moving signal or the operation signal of the associated software to a computer connected with the mobile phone, and controlling the mouse position of a computer screen according to the mouse action signal or operating the associated software according to the operation signal of the associated software.
Optionally, the method further comprises: and responding to the pressing of a side key of the mobile phone, starting the voice control module, and implementing voice control on the mobile phone.
Optionally, the method further comprises: judging the position state of the mobile phone by measuring the distance between the mobile phone and an adjacent plane object, wherein the position state comprises an aerial state and a state close to the plane object; under the condition that the position state of the mobile phone is changed from an air state to a state close to a plane object, automatically switching the photoelectric component from the optical engine to the infrared mouse module; under the condition that the position state of the mobile phone is changed from a state close to a plane object to a state in the air, the photoelectric component is automatically switched from the infrared mouse module to the optical engine; and inquiring whether the user is switched from the photoelectric component to the touch component or not under the condition that the position state of the mobile phone is changed from the state of being close to a plane object to the state of being in the air and the detected ambient light intensity is greater than the preset light intensity threshold value.
Optionally, the method further comprises: and responding to a function setting button arranged on the screen of the mobile phone by clicking to realize function setting, wherein the function setting comprises pairing connection, and the mobile phone is connected with the computer by pairing.
Optionally, the function setting further includes at least one of left-right hand mode switching, mouse button addition, and mouse proofreading.
According to the technical scheme, the photoelectric component is integrated in the camera, so that the function of the camera can be the same as that of a mouse, the power consumption is low, the components are integrated, the use is convenient, and excellent user experience is brought; furthermore, the infrared mouse module and the optical engine are integrated in the camera, so that the infrared mouse module and the optical engine can realize the same functions as an infrared mouse and an air mouse; meanwhile, the software can be associated with a voice assistant of the system, and can directly call and send a voice instruction, so that the defect that the voice assistant is required to be called to the foreground to use in the prior art is overcome; and the flexible switching between various use modes brings great convenience.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the invention and not to limit the invention. In the drawings:
FIG. 1 is a schematic structural diagram of a device for implementing a mouse function with a mobile phone according to the present invention;
FIG. 2 is a schematic structural diagram of a preferred embodiment of the device for implementing a mouse function with a mobile phone according to the present invention;
FIG. 3 is a schematic structural diagram of a key assembly of the device for implementing a mouse function with a mobile phone according to the present invention;
FIG. 4 is a schematic interface diagram of keys arranged on an APP screen of a mobile phone according to the present invention;
FIG. 5 is a schematic structural diagram of a touch component of the device for implementing a mouse function with a mobile phone according to the present invention;
FIG. 6 is a schematic interface diagram of a mobile phone APP screen in a touch mode according to the present invention;
FIG. 7 is an overall framework diagram of the method for implementing a mouse function with a mobile phone according to the present invention;
FIG. 8 is a flowchart illustrating the steps of the sliding area control in touch mode according to the present invention;
FIG. 9 is a flowchart illustrating the steps of the touch mode slider control of the method of the present invention;
FIG. 10 is a flow chart of the steps of the voice control of the method of the present invention;
fig. 11 is a flow chart of the steps of the handover control of the method of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the technical solutions of the present invention will be clearly and completely described below with reference to the specific embodiments of the present invention and the accompanying drawings. It is to be understood that the described embodiments are merely exemplary of the invention, and not restrictive of the full scope of the invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It should be noted that the terms "first," "second," and the like in the description and claims of the present invention and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the invention described herein are capable of operation in sequences other than those illustrated or described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
In one aspect, the present invention provides a device for implementing a mouse function with a mobile phone fig. 1 is a schematic structural diagram of the device for implementing a mouse function with a mobile phone according to the present invention. As shown in fig. 1, the device for implementing mouse function by mobile phone of the present invention comprises: the photoelectric component 100 is integrated in a camera of the mobile phone and is used for capturing displacement data of the mobile phone; a data conversion unit 200, configured to convert the displacement data of the mobile phone captured by the optoelectronic component into a mouse movement signal; and the sending unit 300 is used for sending the mouse moving signal converted by the data conversion unit to a computer connected with the mobile phone, and controlling the mouse position of a computer screen according to the mouse moving signal. According to the technical scheme, the mobile phone is moved, and the mouse position of the computer screen is controlled as a mouse is moved. The photoelectric component is integrated in the mobile phone camera, so that the mobile phone camera has the advantages of low power consumption and integration of the components, and overcomes the defect that the appearance is affected due to the fact that the components are additionally added in the prior art; the defect of large power consumption of the illuminating lamp in the prior art is also overcome.
According to one embodiment of the device for implementing a mouse function with a mobile phone according to the present invention, the optoelectronic component comprises an infrared mouse module and/or an optical engine. Fig. 2 is a schematic structural diagram of a preferred embodiment of the device for implementing a mouse function by using a mobile phone according to the present invention. The infrared mouse module 110 is configured to capture displacement data of the mobile phone when the mobile phone moves on a desktop; the optical engine 120 is used to capture displacement data of the mobile phone when the mobile phone is moving in the air. On one hand, the infrared induction function of the mouse can be realized by using the infrared mouse module, so that the mouse pointer can be controlled to move when the mobile phone is placed on a desktop to move, and the using mode is called as a desktop mobile phone mode; at present, mobile phones are provided with outer sleeves, or a base or a shell is designed for the function independently, so that the mobile phone is not worried about abrasion. On the other hand, the added optical engine can realize optical induction, the mouse can be moved by judging light, so that the mouse can be operated in the air, a laser speech pen can be replaced when the mouse is used for briefing and speech, the mouse can be directly used for operating in the air, the user experience is greatly improved, and the using mode is called as an air mouse mode. The infrared mouse module and the optical engine can be switched between a desktop mobile phone mode and an air mouse mode in a manual or automatic mode, namely, the infrared mouse module is used when the mouse is on a desktop, and the optical engine is used when the mouse is in the air.
As shown in fig. 2, the device also includes a key assembly 140. Fig. 3 is a schematic structural diagram of a key assembly of the device for implementing a mouse function with a mobile phone according to the present invention. As shown in fig. 3, the key assembly 140 includes a click action unit 141 configured to: responding to a click of a key arranged on a screen of a mobile phone APP, and sending a click signal to the data conversion unit; the data conversion unit is further configured to: converting the received click signal into a mouse button signal; the transmitting unit is further configured to: sending the mouse key signals converted by the data conversion unit to a computer connected with the mobile phone, and controlling the mouse click action of a computer screen according to the mouse key signals; the keys arranged on the screen of the mobile phone APP comprise a left key, a middle key and a right key. FIG. 4 is a schematic interface diagram of keys arranged on the APP screen of the mobile phone according to the present invention. As shown in fig. 4, the software interface includes three strip-shaped keys, the left strip-shaped key functions as a left mouse key, the right strip-shaped key functions as a right mouse key, and the middle strip-shaped key functions as a middle mouse key when clicked. The three keys can be set with different colors, so that the three keys are more striking and beautiful. The button color can enter a custom interface function in the function menu by clicking an "options" button in the lower left corner of the screen, setting the user's favorite color and/or adjusting to the user's favorite location.
Referring again to fig. 3, the key assembly 140 further includes a roller action unit 142 configured to: responding to the up-down sliding of the middle key arranged on the screen of the mobile phone APP, and sending a middle key sliding signal to the data conversion unit; the data conversion unit is further configured to: converting the received middle key sliding signal into a mouse roller rolling signal; the transmitting unit is further configured to: and sending the mouse roller rolling signal converted by the data conversion unit to a computer connected with the mobile phone, and controlling a computer screen to realize the function of up-and-down rolling of the mouse roller according to the mouse roller rolling signal. Referring to fig. 4 again, the user may control the computer screen connected to the mobile phone by sliding the middle strip key disposed on the screen of the mobile phone APP to implement the function of scrolling the mouse wheel up and down.
When the mouse operates in a desktop mobile phone mode and an air mouse mode, the keys are operated on a mobile phone screen through the function of the key assembly, so that the clicking operation of the mouse keys on a computer and the up-and-down rolling function of a mouse roller are realized.
Referring to fig. 2 again, the apparatus according to an embodiment of the present invention further includes a touch component 130, fig. 5 is a schematic structural diagram of the touch component of the apparatus for implementing a mouse function with a mobile phone according to the present invention, as shown in fig. 5, the touch component 130 includes a sliding area unit 131 configured to set a mouse sliding area on the mobile phone APP screen and capture displacement data of a finger in the mouse sliding area, the data conversion unit is further configured to convert the displacement data of the finger captured by the touch component into a mouse movement signal and transmit the mouse movement signal to the transmission unit, fig. 6 is a schematic interface diagram of the mobile phone APP screen in the touch mode of the present invention, as shown in fig. 6, the use of the touch component is different from the use of an infrared mouse module and an optical engine, which is to control the mouse position of the computer screen by sliding the finger in the sliding area (i.e., the mouse sliding area indicated by ① in the drawing) set on the mobile phone screen (i.e., the infrared mouse module and the optical engine are switched between the mouse module and the mobile phone in the three modes, i.e., the mobile phone air-used touch mode.
Referring to fig. 5, the touch component 130 further includes a slider area unit 132 configured to set a mouse slider area on the APP screen of the mobile phone to capture displacement data of a finger in the mouse slider area, the data conversion unit 200 is further configured to convert the displacement data of the mouse slider area into a mouse roller scroll signal, the transmission unit 300 is further configured to transmit the mouse roller scroll signal to a computer connected to the mobile phone, and control the computer screen to implement the up-and-down scroll function of the mouse roller according to the mouse roller scroll signal, and referring to fig. 6, the finger slides in the slider area (i.e., ② mouse slider area marked in the drawing) set on the screen of the mobile phone to control the computer screen to implement the up-and-down scroll function of the mouse roller.
According to an embodiment of the touch mode of the present invention, referring to fig. 6 again, a button area, i.e. ③ button area marked in the drawing, may be further provided on the mobile phone screen, and the screen operation of the button area is controlled by the button assembly for realizing the click function of the left, middle and right mouse buttons.
Referring again to fig. 2, in accordance with one embodiment of the present invention, the apparatus for implementing a mouse function with a mobile phone further comprises a voice control module 150 configured to: identifying the received voice information to obtain voice instruction information corresponding to the mouse operation instruction; the data conversion unit 200 is further configured to: converting the voice instruction information into a mouse moving signal or an operation signal of associated software; the transmitting unit 300 is further configured to: and sending the mouse moving signal or the operation signal of the associated software to a computer connected with the mobile phone, and controlling the mouse position of a computer screen according to the mouse action signal or operating the associated software according to the operation signal of the associated software. For example, the voice control function may be associated with Office or application software such as Office, and a user may control the mouse to a designated area through voice, or implement the designated function, for example, when the user sends a "next page" instruction, the voice control function will replace the operation of moving the mouse and clicking, and directly implement the function of turning to the next page, which will greatly facilitate the report presentation or speech.
According to an embodiment of the voice control module of the present invention, the voice module 150 is further configured to: and responding to the pressing of a side key of the mobile phone, starting the voice control module, and implementing voice control on the mobile phone. According to one embodiment of the voice control module of the present invention, when the user starts the voice control function by pressing the side key of the mobile phone, the sliding area of the instant software interface is changed into a color or pattern set by the user to prompt the start of the voice control function. Meanwhile, the software can be associated with a voice assistant (such as Microsoft Xiaona) of the system, a user can directly call the windows voice assistant through a side key of a mobile phone to replace mouse click call or keyboard key call, and the voice assistant can be called through the mobile phone and send a voice instruction through a microphone when other software is operated, so that the function of the voice assistant is synchronously realized under the condition that the operation of other software is not influenced, and the defect that the function of the voice assistant can be used only by placing other software in a background and calling the voice assistant to the forefront end in the prior art is overcome.
Referring again to fig. 2, in accordance with one embodiment of the apparatus for implementing a mouse function with a mobile phone according to the present invention, the apparatus further includes a switching module 400 configured to: judging the position state of the mobile phone by measuring the distance between the mobile phone and an adjacent plane object, wherein the position state comprises an aerial state and a state close to the plane object; under the condition that the position state of the mobile phone is changed from an air state to a state close to a plane object, the optical engine 120 automatically switches the photoelectric component 100 into the infrared mouse module 110; under the condition that the position state of the mobile phone is changed from the state of being close to a plane object to the state of being in the air, the photoelectric component 100 is automatically switched from the infrared mouse module 110 to the optical engine 120; when the position state of the mobile phone is changed from a state close to a plane object to a state in the air and the intensity of the ambient light is detected to be greater than a preset light intensity threshold value, the user is asked whether to switch from the photoelectric component 100 to the touch component 130. The user can switch among the infrared mouse module, the optical engine and the touch control component in an automatic or manual mode, namely, the desktop mobile phone mode, the air mouse mode and the touch control mode.
Infrared (IR) image processing based is one of the best implementations of an air mouse. The principle is that an infrared Image is captured by an Image Sensor (CMOS Image Sensor), and the position information of a moving object is calculated by utilizing Image processing and pattern recognition technology, so that a screen cursor is controlled. Since the image sensor captures infrared light, interference like sunlight, candlelight or lamplight can have a severe impact on the final controlled screen cursor, for example, an air mouse cannot be used in strong sunlight. Therefore, when the position state of the mobile phone is changed from the state close to the plane object to the air state and the ambient light intensity is detected to be greater than the preset light intensity threshold value, the user is inquired whether the photoelectric component is switched to the touch component.
Referring to fig. 2 again, according to an embodiment of the apparatus for implementing a mouse function by a mobile phone of the present invention, the apparatus further includes a function setting module configured to implement a function setting in response to clicking a function setting button disposed on a screen of the mobile phone, where the function setting includes a pairing connection, and the mobile phone is connected to the computer by pairing. The mobile phone and the computer can be connected through Wifi or Bluetooth. Referring to fig. 4 and 6, function setting may be performed by entering a function menu by clicking an "options" button at the lower left corner of the screen.
According to an embodiment of the device function setting for realizing the mouse function by the mobile phone, the function setting further comprises at least one of left-hand mode switching, mouse button adding and mouse proofreading. The left-right hand mode switching is to exchange the functions of the left key and the right key so as to adapt to different handedness habits; the addition of mouse buttons comprises the addition of additional operation buttons such as a mouse 4, a mouse 5 and the like; the mouse proofreading means that a user can move the mobile phone according to the interface requirement, so that the optical engine finishes proofreading, and the mouse accuracy is improved. The function setting may further include:
mode switching: the method is characterized in that the mode of the desktop mobile phone, the air mouse and the touch mode are switched.
Adjusting the sensitivity of the mouse: the moving speed of the mouse is controlled by adjusting the sensitivity;
interface color (theme) settings: changing the colors of the keys and the operation area, changing the shapes of the keys, customizing a theme background, customizing button icons and the like;
button function and interface custom setting: self-defining button functions, such as single click, replacement of double click and the like;
setting a software language: the language of the software can be changed;
software updates, etc.
The invention also provides a mobile phone with any one of the devices.
The invention also provides a method for realizing the mouse function by the mobile phone. Fig. 7 is an overall framework diagram of the method for implementing the mouse function by the mobile phone according to the present invention. As shown in fig. 7, the method for implementing mouse function by mobile phone of the present invention includes: step 501, integrating a photoelectric component in a mobile phone camera for capturing displacement data of a mobile phone; 502, converting displacement data of the mobile phone captured by the photoelectric component into a mouse moving signal; step 503, sending the mouse moving signal to a computer connected with the mobile phone, and controlling the mouse position of the computer screen according to the mouse moving signal.
In one embodiment of the method for implementing a mouse function with a mobile phone according to the present invention, referring to fig. 2, the optoelectronic assembly 100 includes an infrared mouse module 110 and/or an optical engine 120; the infrared mouse module 110 is configured to capture displacement data of the mobile phone when the mobile phone moves on a desktop; the optical engine 120 is used to capture displacement data of the mobile phone when the mobile phone is moving in the air. The infrared mouse module is used for working in a desktop mobile phone mode, and the optical engine is used for working in an air mouse mode.
According to an embodiment of the method for implementing a mouse function by a mobile phone of the present invention, the method further comprises: responding to a click of a key arranged on a mobile phone APP screen, and generating a click signal; converting the click signal into a mouse button signal; sending the mouse button signal to a computer connected with the mobile phone, and controlling a mouse clicking action of a computer screen according to the mouse button signal; the keys arranged on the screen of the mobile phone APP comprise a left key, a middle key and a right key.
According to an embodiment of the method for implementing a mouse function by a mobile phone of the present invention, the method further comprises: responding to the up-and-down sliding of the middle key arranged on the screen of the mobile phone APP, and generating a middle key sliding signal; converting the middle key sliding signal into a mouse roller rolling signal; and sending the mouse roller rolling signal to a computer connected with the mobile phone, and controlling a computer screen to realize the up-and-down rolling function of the mouse roller according to the mouse roller rolling signal.
According to one embodiment of the method for implementing the mouse function by the mobile phone, the method further comprises a touch mode. FIG. 8 is a flowchart illustrating the steps of controlling the sliding area in touch mode according to the method of the present invention. As shown in fig. 8, the step of controlling the sliding area in the touch mode of the present invention includes: step 601, setting a mouse sliding area on a mobile phone APP screen through a touch component 130, and capturing displacement data of fingers in the mouse sliding area; step 602, converting the displacement data of the finger captured by the touch component into a mouse movement signal; step 603, sending the mouse moving signal to a computer connected with the mobile phone, and controlling the mouse position of a computer screen according to the mouse action signal.
FIG. 9 is a flowchart illustrating the steps of the touch mode slider control method according to the present invention. As shown in fig. 9, the step of controlling the touch mode slider area of the present invention includes: step 701, setting a mouse sliding bar area on a mobile phone APP screen through the touch control assembly, and capturing displacement data of fingers in the mouse sliding bar area; step 702, converting the displacement data of the mouse sliding bar area into a mouse roller rolling signal; and 703, sending the mouse roller rolling signal to a computer connected with the mobile phone, and controlling a computer screen to realize the function of up-and-down rolling of the mouse roller according to the mouse roller rolling signal.
FIG. 10 is a flow chart of the steps of the voice control of the method of the present invention. As shown in fig. 10, the steps of the touch voice control of the present invention include: step 801, identifying the received voice information to obtain voice instruction information corresponding to a mouse operation instruction; step 802, converting the voice command information into a mouse moving signal or an operation signal of associated software; and 803, sending the mouse moving signal or the operation signal of the associated software to a computer connected with the mobile phone, and controlling the mouse position of a computer screen according to the mouse action signal or operating the associated software according to the operation signal of the associated software.
According to an embodiment of the method for implementing a mouse function by a mobile phone of the present invention, the method further comprises: and responding to the pressing of a side key of the mobile phone, starting the voice control module, and implementing voice control on the mobile phone.
Fig. 11 is a flow chart of the steps of the handover control of the method of the present invention. As shown in fig. 11, the step of switching control of the method of the present invention includes: step 901, judging the position state of the mobile phone by measuring the distance between the mobile phone and an adjacent plane object, wherein the position state comprises an air state and a state close to the plane object; when the position state of the mobile phone is changed from the air state to the state close to the plane object, step 903 is executed, and the photoelectric component is automatically switched from the optical engine to the infrared mouse module; when the position state of the mobile phone is changed from the state close to a plane object to the state in the air, executing step 904, and automatically switching the photoelectric component from the infrared mouse module to the optical engine; also included is a step 902 of detecting an ambient light intensity; when the position state of the mobile phone is changed from the state of the object close to the plane to the state of the air and the intensity of the ambient light is detected to be greater than the preset light intensity threshold value, step 905 is executed to inquire whether the user switches the photoelectric component to the touch component.
According to an embodiment of the method for implementing a mouse function by a mobile phone of the present invention, the method further comprises: and responding to a function setting button arranged on the screen of the mobile phone by clicking to realize function setting, wherein the function setting comprises pairing connection, and the mobile phone is connected with the computer by pairing.
According to an embodiment of the method for implementing a mouse function by a mobile phone of the present invention, the function setting further includes at least one of left-right hand mode switching, mouse button adding, and mouse proofreading. The function setting may further include: mode switching, mouse sensitivity adjustment, interface color (theme) setting, button function and interface custom setting, software updating and the like.
According to the technical scheme, the photoelectric component is integrated in the camera, so that the function of the camera can be the same as that of a mouse, the power consumption is low, the components are integrated, the use is convenient, and excellent user experience is brought; furthermore, the infrared mouse module and the optical engine are integrated in the camera, so that the infrared mouse module and the optical engine can realize the same functions as an infrared mouse and an air mouse; meanwhile, the software can be associated with a voice assistant of the system, and can directly call and send a voice instruction, so that the defect that the voice assistant is required to be called to the foreground to use in the prior art is overcome; and the flexible switching between various use modes brings great convenience.
The functions described herein may be implemented in hardware, software executed by a processor, firmware, or any combination thereof. If implemented in software executed by a processor, the functions may be stored on or transmitted over as one or more instructions or code on a computer-readable medium. Other examples and implementations are within the scope and spirit of the invention and the following claims. For example, due to the nature of software, the functions described above may be implemented using software executed by a processor, hardware, firmware, hardwired, or a combination of any of these. In addition, each functional unit may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit.
In the embodiments provided in the present application, it should be understood that the disclosed technology can be implemented in other ways. The above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units may be a logical division, and in actual implementation, there may be another division, for example, multiple units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, units or modules, and may be in an electrical or other form.
The units described as separate parts may or may not be physically separate, and the parts serving as the control device may or may not be physical units, may be located in one place, or may be distributed on a plurality of units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic or optical disk, and other various media capable of storing program codes.
The above description is only an example of the present invention, and is not intended to limit the present invention, and it is obvious to those skilled in the art that various modifications and variations can be made in the present invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the scope of the claims of the present invention.

Claims (19)

1. An apparatus for implementing a mouse function with a mobile phone, comprising:
the photoelectric component is integrated in the camera of the mobile phone and used for capturing displacement data of the mobile phone;
the data conversion unit is used for converting the displacement data of the mobile phone captured by the photoelectric component into a mouse movement signal;
the sending unit is used for sending the mouse moving signal converted by the data conversion unit to a computer connected with the mobile phone and controlling the mouse position of a computer screen according to the mouse moving signal;
the photoelectric component comprises an infrared mouse module and an optical engine;
the infrared mouse module is used for capturing displacement data of the mobile phone when the mobile phone moves on a desktop;
the optical engine is used for capturing displacement data of the mobile phone when the mobile phone moves in the air;
further comprising a switching module configured to:
judging the position state of the mobile phone by measuring the distance between the mobile phone and an adjacent plane object, wherein the position state comprises an aerial state and a state close to the plane object;
under the condition that the position state of the mobile phone is changed from an air state to a state close to a plane object, automatically switching the photoelectric component from the optical engine to the infrared mouse module;
under the condition that the position state of the mobile phone is changed from a state close to a plane object to a state in the air, the photoelectric component is automatically switched from the infrared mouse module to the optical engine;
and inquiring whether the user is switched from the photoelectric component to the touch component or not under the condition that the position state of the mobile phone is changed from the state of being close to a plane object to the state of being in the air and the detected ambient light intensity is greater than the preset light intensity threshold value.
2. The apparatus of claim 1, further comprising a key assembly, the key assembly including a click action element configured to: responding to a click of a key arranged on a screen of a mobile phone APP, and sending a click signal to the data conversion unit;
the data conversion unit is further configured to: converting the received click signal into a mouse button signal;
the transmitting unit is further configured to: sending the mouse key signals converted by the data conversion unit to a computer connected with the mobile phone, and controlling the mouse click action of a computer screen according to the mouse key signals;
the keys arranged on the screen of the mobile phone APP comprise a left key, a middle key and a right key.
3. The apparatus of claim 2, wherein the key assembly further comprises a roller action unit configured to: responding to the up-down sliding of the middle key arranged on the screen of the mobile phone APP, and sending a middle key sliding signal to the data conversion unit;
the data conversion unit is further configured to: converting the received middle key sliding signal into a mouse roller rolling signal;
the transmitting unit is further configured to: and sending the mouse roller rolling signal converted by the data conversion unit to a computer connected with the mobile phone, and controlling a computer screen to realize the up-and-down rolling function of the mouse roller according to the mouse roller rolling signal.
4. The apparatus of any one of claims 1-3, further comprising a touch component, the touch component comprising a sliding region unit configured to: setting a mouse sliding area on a mobile phone APP screen, and capturing displacement data of fingers in the mouse sliding area;
the data conversion unit is further configured to: and converting the displacement data of the finger captured by the touch control assembly into a mouse movement signal, and transmitting the mouse movement signal to the sending unit.
5. The apparatus of claim 4, wherein the touch component further comprises a slider area unit configured to: setting a mouse sliding bar area on a mobile phone APP screen, and capturing displacement data of fingers in the mouse sliding bar area;
the data conversion unit is further configured to: converting the displacement data of the mouse sliding bar area into a mouse roller rolling signal;
the transmitting unit is further configured to: and sending the mouse roller rolling signal to a computer connected with the mobile phone, and controlling a computer screen to realize the up-and-down rolling function of the mouse roller according to the mouse roller rolling signal.
6. The apparatus of any one of claims 1-3, 5, further comprising a voice control module configured to: identifying the received voice information to obtain voice instruction information corresponding to the mouse operation instruction;
the data conversion unit is further configured to: converting the voice instruction information into a mouse moving signal or an operation signal of associated software;
the transmitting unit is further configured to: and sending the mouse moving signal or the operation signal of the associated software to a computer connected with the mobile phone, and controlling the mouse position of a computer screen according to the mouse action signal or operating the associated software according to the operation signal of the associated software.
7. The apparatus of claim 6, wherein the speech module is further configured to: and responding to the pressing of a side key of the mobile phone, starting the voice control module, and implementing voice control on the mobile phone.
8. The device of any one of claims 1-3, 5, and 7, further comprising a function setting module configured to implement a function setting in response to clicking a function setting button provided on a screen of the mobile phone, wherein the function setting includes a pairing connection for connecting the mobile phone with the computer by pairing.
9. The apparatus of claim 8, wherein the function settings further comprise at least one of left-right hand mode switching, mouse button addition, and mouse proofreading.
10. A handset having an apparatus as claimed in any one of claims 1 to 9.
11. A method for realizing mouse function by a mobile phone comprises the following steps:
the photoelectric component is integrated in a mobile phone camera and used for capturing displacement data of the mobile phone;
converting the displacement data of the mobile phone captured by the photoelectric component into a mouse movement signal;
sending the mouse moving signal to a computer connected with the mobile phone, and controlling the mouse position of a computer screen according to the mouse moving signal; the photoelectric component comprises an infrared mouse module and an optical engine;
the infrared mouse module is used for capturing displacement data of the mobile phone when the mobile phone moves on a desktop;
the optical engine is used for capturing displacement data of the mobile phone when the mobile phone moves in the air;
further comprising:
judging the position state of the mobile phone by measuring the distance between the mobile phone and an adjacent plane object, wherein the position state comprises an aerial state and a state close to the plane object;
under the condition that the position state of the mobile phone is changed from an air state to a state close to a plane object, automatically switching the photoelectric component from the optical engine to the infrared mouse module;
under the condition that the position state of the mobile phone is changed from a state close to a plane object to a state in the air, the photoelectric component is automatically switched from the infrared mouse module to the optical engine;
and inquiring whether the user is switched from the photoelectric component to the touch component or not under the condition that the position state of the mobile phone is changed from the state of being close to a plane object to the state of being in the air and the detected ambient light intensity is greater than the preset light intensity threshold value.
12. The method of claim 11, further comprising:
responding to a click of a key arranged on a mobile phone APP screen, and generating a click signal;
converting the click signal into a mouse button signal;
sending the mouse button signal to a computer connected with the mobile phone, and controlling a mouse clicking action of a computer screen according to the mouse button signal;
the keys arranged on the screen of the mobile phone APP comprise a left key, a middle key and a right key.
13. The method of claim 12, further comprising:
responding to the up-and-down sliding of the middle key arranged on the screen of the mobile phone APP, and generating a middle key sliding signal;
converting the middle key sliding signal into a mouse roller rolling signal;
and sending the mouse roller rolling signal to a computer connected with the mobile phone, and controlling a computer screen to realize the up-and-down rolling function of the mouse roller according to the mouse roller rolling signal.
14. The method according to any one of claims 11-13, further comprising:
setting a mouse sliding area on a mobile phone APP screen through a touch component, and capturing displacement data of fingers in the mouse sliding area;
converting the displacement data of the finger captured by the touch component into a mouse movement signal;
and sending the mouse moving signal to a computer connected with the mobile phone, and controlling the mouse position of a computer screen according to the mouse action signal.
15. The method of claim 14, further comprising:
setting a mouse sliding strip area on a mobile phone APP screen through the touch control assembly, and capturing displacement data of fingers in the mouse sliding strip area;
converting the displacement data of the mouse sliding bar area into a mouse roller rolling signal;
and sending the mouse roller rolling signal to a computer connected with the mobile phone, and controlling a computer screen to realize the up-and-down rolling function of the mouse roller according to the mouse roller rolling signal.
16. The method of any of claims 11-13, 15, further comprising:
identifying the received voice information to obtain voice instruction information corresponding to the mouse operation instruction;
converting the voice instruction information into a mouse moving signal or an operation signal of associated software;
and sending the mouse moving signal or the operation signal of the associated software to a computer connected with the mobile phone, and controlling the mouse position of a computer screen according to the mouse action signal or operating the associated software according to the operation signal of the associated software.
17. The method of claim 16, further comprising: and responding to the pressing of a side key of the mobile phone, starting the voice control module, and implementing voice control on the mobile phone.
18. The method of any of claims 11-13, 15, 17, further comprising: and responding to a function setting button arranged on the screen of the mobile phone by clicking to realize function setting, wherein the function setting comprises pairing connection, and the mobile phone is connected with the computer by pairing.
19. The method of claim 18, wherein the function settings further comprise at least one of left-right hand mode switching, mouse button addition, and mouse proofreading.
CN201610812112.6A 2016-09-08 2016-09-08 Device and method for realizing mouse function by using mobile phone and mobile phone with device Active CN106550108B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610812112.6A CN106550108B (en) 2016-09-08 2016-09-08 Device and method for realizing mouse function by using mobile phone and mobile phone with device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610812112.6A CN106550108B (en) 2016-09-08 2016-09-08 Device and method for realizing mouse function by using mobile phone and mobile phone with device

Publications (2)

Publication Number Publication Date
CN106550108A CN106550108A (en) 2017-03-29
CN106550108B true CN106550108B (en) 2020-01-10

Family

ID=58368071

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610812112.6A Active CN106550108B (en) 2016-09-08 2016-09-08 Device and method for realizing mouse function by using mobile phone and mobile phone with device

Country Status (1)

Country Link
CN (1) CN106550108B (en)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107037896A (en) * 2017-05-26 2017-08-11 徐孝海 Split mouse
CN107391013A (en) * 2017-07-19 2017-11-24 上海青橙实业有限公司 Mobile phone control terminal, cell phone system and mobile phone control terminal containment vessel
TWM562433U (en) * 2018-01-05 2018-06-21 Thermaltake Technology Co Ltd Voice controlled input system
CN108509068B (en) * 2018-03-21 2021-05-04 安徽咪鼠科技有限公司 Intelligent game mouse capable of realizing voice transcription based on voice recognition
CN111459303A (en) * 2020-04-02 2020-07-28 北京奇点跳跃科技有限公司 Method and device for controlling terminal screen by mouse, mouse and storage medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102629166A (en) * 2012-02-29 2012-08-08 中兴通讯股份有限公司 Device for controlling computer and method for controlling computer through device
CN102722318A (en) * 2012-05-21 2012-10-10 四川长虹电器股份有限公司 Remote control system based on image identification
CN103259914A (en) * 2012-02-20 2013-08-21 宇龙计算机通信科技(深圳)有限公司 Implement method of mobile terminal with wireless mouse function and mobile terminal
CN104793767A (en) * 2015-05-12 2015-07-22 庄景阳 Mobile phone mouse

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100724939B1 (en) * 2005-06-20 2007-06-04 삼성전자주식회사 Method for implementing user interface using camera module and mobile communication terminal therefor
CN102253737B (en) * 2011-05-31 2013-07-17 王石 Realizing method of screen-vision mouse system
KR20160094183A (en) * 2015-01-30 2016-08-09 삼성전자주식회사 Interface apparatus between an electrical device and an outside device using an ear jack of the electriacl device and method therefor

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103259914A (en) * 2012-02-20 2013-08-21 宇龙计算机通信科技(深圳)有限公司 Implement method of mobile terminal with wireless mouse function and mobile terminal
CN102629166A (en) * 2012-02-29 2012-08-08 中兴通讯股份有限公司 Device for controlling computer and method for controlling computer through device
CN102722318A (en) * 2012-05-21 2012-10-10 四川长虹电器股份有限公司 Remote control system based on image identification
CN104793767A (en) * 2015-05-12 2015-07-22 庄景阳 Mobile phone mouse

Also Published As

Publication number Publication date
CN106550108A (en) 2017-03-29

Similar Documents

Publication Publication Date Title
CN106550108B (en) Device and method for realizing mouse function by using mobile phone and mobile phone with device
JP6522124B2 (en) Gesture control method, device and system
CN110909524B (en) Editing method and electronic equipment
CN108170329B (en) Display control method and terminal equipment
CN109683802B (en) Icon moving method and terminal
CN108476339B (en) Remote control method and terminal
CN103106031A (en) Operation method and operation device of mobile terminal
WO2020238647A1 (en) Hand gesture interaction method and terminal
CN111327458A (en) Configuration information sharing method, terminal device and computer readable storage medium
CN112121415A (en) Method, device and equipment for controlling interface display and storage medium
CN108415642A (en) A kind of display methods and mobile terminal
CN102905013A (en) Communication device with automatic talk mode switching function and operating method of communication device
CN108023994B (en) Side key structure and mobile terminal with same
CN109725789A (en) A kind of application icon archiving method and terminal device
CN106020363A (en) Method and device for operating intelligent watch by means of orientation gesture touching
CN104718511B (en) Communication system, communication means and program
CN109542307B (en) Image processing method, device and computer readable storage medium
CN103136285A (en) Translation query and operation system used for handheld device and method thereof
CN102685581A (en) Multi-hand control system for intelligent television
CN110830747A (en) Video call method, wearable device and storage medium
CN108737731B (en) Focusing method and terminal equipment
CN108040492A (en) A kind of data copy method and user terminal
CN103941845A (en) Display operation system and operation method thereof
KR102198175B1 (en) Method and apparatus for processing key pad input received on touch screen of mobile terminal
KR101353415B1 (en) The mobile terminal of pen mouse type

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant