CN115277934B - Communication terminal control method based on man-machine interaction - Google Patents

Communication terminal control method based on man-machine interaction Download PDF

Info

Publication number
CN115277934B
CN115277934B CN202210880701.3A CN202210880701A CN115277934B CN 115277934 B CN115277934 B CN 115277934B CN 202210880701 A CN202210880701 A CN 202210880701A CN 115277934 B CN115277934 B CN 115277934B
Authority
CN
China
Prior art keywords
perfume
delivery
information
user
communication terminal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202210880701.3A
Other languages
Chinese (zh)
Other versions
CN115277934A (en
Inventor
许湘荣
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Xunyin Technology Co ltd
Original Assignee
Beijing Xunyin Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Xunyin Technology Co ltd filed Critical Beijing Xunyin Technology Co ltd
Priority to CN202210880701.3A priority Critical patent/CN115277934B/en
Publication of CN115277934A publication Critical patent/CN115277934A/en
Application granted granted Critical
Publication of CN115277934B publication Critical patent/CN115277934B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72448—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions
    • H04M1/72454—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions according to context-related or environment-related conditions
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/77—Processing image or video features in feature spaces; using data integration or data reduction, e.g. principal component analysis [PCA] or independent component analysis [ICA] or self-organising maps [SOM]; Blind source separation
    • G06V10/774—Generating sets of training patterns; Bootstrap methods, e.g. bagging or boosting
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/82—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168—Feature extraction; Face representation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/172—Classification, e.g. identification

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Evolutionary Computation (AREA)
  • Human Computer Interaction (AREA)
  • Artificial Intelligence (AREA)
  • Multimedia (AREA)
  • Software Systems (AREA)
  • Computing Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • Computational Linguistics (AREA)
  • Data Mining & Analysis (AREA)
  • Molecular Biology (AREA)
  • Mathematical Physics (AREA)
  • Databases & Information Systems (AREA)
  • Medical Informatics (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Environmental & Geological Engineering (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

The invention belongs to the technical field of communication, and particularly relates to a communication terminal control method based on man-machine interaction, which is applied to a communication terminal with a perfume delivery function. The method comprises the following steps: acquiring system basic information of a perfume delivery unit of a communication terminal, and scanning to acquire a user personal scene image; the personal scene image of the user is sent to a cloud recommendation server so as to judge whether the current user is a pre-stored user or not; generating an input control of user basic information; analyzing the system basic information to obtain optional information of the perfume delivery system; receiving a perfume type information recommendation list; generating a perfume delivery type selection interface according to the perfume type information recommendation list; the perfume kind is delivered in response to a user selection operation. The invention improves the experience brought by the mobile main body capable of carrying perfume, gives full play to the experience brought by different perfumes, and can improve the experience brought by the mobile communication terminal with the odor release function.

Description

Communication terminal control method based on man-machine interaction
Technical Field
The invention belongs to the technical field of communication, and particularly relates to a communication terminal control method based on man-machine interaction.
Background
Along with the light, thin and portable mobile communication terminals such as smart phones and iPad being combined with life, work and study of people more and more, the following intelligent demands become more and more, and in order to better develop portability and usability brought by the mobile communication terminals, the development of a communication terminal control method becomes an indispensable direction of the mobile communication terminals in new ages. Currently, mobile phones have primarily visual, auditory, tactile (e.g. vibration) sensing dimensions, however, current smart phones do not have an olfactory sensing system, so that their user experience is poor.
Disclosure of Invention
The invention aims to solve the technical problem of providing a mobile communication terminal system capable of emitting fragrance.
The utility model provides a communication terminal control method based on human-computer interaction, is applied to communication terminal, be provided with perfume delivery unit in the communication terminal, perfume delivery unit includes perfume box, hot plate and controller, is provided with a plurality of perfume grids in the perfume box, has acceptd different perfume types in a plurality of perfume grids, is provided with a plurality of heating blocks of mutual separation on the hot plate, a plurality of heating blocks support respectively and paste the bottom of locating a plurality of perfume grids, the controller with hot plate electric connection, the method includes:
Responding to man-machine interaction operation of a user, acquiring system basic information of a perfume delivery unit of the communication terminal, and scanning to acquire a personal scene image of the user;
The method comprises the steps that a user personal scene image is sent to a cloud recommendation server, so that the cloud recommendation server captures the facial features of a user in the user personal scene image according to the user personal scene image, and whether the current user is a prestored user or not is judged;
when the cloud recommendation server determines that the current user is a non-prestored user, executing the following steps:
Generating an input control of user basic information, receiving user personal information through the input control, and sending the user personal information to a cloud recommendation server, so that the user personal information of the current user is stored, and a corresponding pre-stored user is newly added; and
Analyzing the basic information of the system to obtain optional information of the perfume delivery system, and sending the optional information of the perfume delivery system to a cloud recommendation server;
When the cloud recommendation server determines that the current user is a pre-stored user, executing the following steps:
Analyzing the basic information of the system to obtain optional information of the perfume delivery system, and sending the optional information of the perfume delivery system to a cloud recommendation server;
receiving a perfume type information recommendation list which is pushed by a cloud recommendation server according to optional information of a perfume delivery unit and aiming at basic information of a user based on user selection history statistical analysis or a pre-stored perfume push type model, wherein the basic information of the user is composed of personal information of the user and facial features of the user;
Generating a perfume delivery type selection interface according to the perfume type information recommendation list;
Responding to the selection operation of the user to accept the selected perfume type information and delivering the perfume type corresponding to the perfume type information.
In an embodiment of the present disclosure, the communication terminal further provides a first group of perfume delivery outlets and a second group of perfume delivery outlets, the communication terminal includes four perfume delivery units, the four perfume delivery units are divided into two groups, the first group of perfume delivery outlets and the second group of perfume delivery outlets are respectively communicated with the two groups of perfume delivery units, the first group of perfume delivery outlets are located at upper and lower corners on the left side of the communication terminal, the second group of perfume delivery outlets are located at upper and lower corners on the right side of the communication terminal, and the step of delivering perfume types corresponding to perfume type information specifically includes:
Sensing the inclination angle of the communication terminal through a gravity sensor to acquire a user hand-held mode, and delivering perfume types corresponding to perfume type information in a preset mode at a first group of perfume delivery outlets or a second group of perfume delivery outlets according to the user hand-held mode, wherein basic system information comprises perfume types and perfume storage quantity, and personal information of the user comprises user names, sexes and ages;
The step of scanning and obtaining the personal scene image of the user is as follows: and starting the camera to capture the user scene information so as to scan and acquire the user personal scene image.
In an embodiment of the present disclosure, the communication terminal is further provided with four perfume delivery outlets and includes four perfume delivery units, the four perfume delivery outlets are respectively communicated with perfume boxes of the four perfume delivery units, and the four perfume delivery outlets are respectively located at four corners of the communication terminal, where the step of delivering perfume types corresponding to the perfume type information specifically includes:
the method comprises the steps of sensing the inclination angle of a communication terminal through a direction sensor, determining delivery information according to an angle range of the inclination angle, wherein the delivery information comprises perfume delivery outlets and delivery concentration, and delivering perfume types corresponding to perfume type information at the determined perfume delivery outlets in a determined delivery concentration.
In one embodiment of the present disclosure, the four perfume delivery outlets are a first delivery outlet, a second delivery outlet, a third delivery outlet, and a fourth delivery outlet, respectively, the angular ranges are a first angular range, a second angular range, a third angular range, and a fourth angular range, and the step of determining the delivery information according to the angular range to which the tilt angle belongs is:
When the inclination angle is in a first angle range, determining delivery information corresponding to the inclination angle as first delivery information, wherein the first delivery information comprises information of a first delivery outlet and first delivery concentration;
When the inclination angle is in the second angle range, determining delivery information corresponding to the inclination angle as second delivery information, wherein the second delivery information comprises information of a second delivery outlet and second delivery concentration;
When the inclination angle is within a third angle range, determining delivery information corresponding to the inclination angle as third delivery information, wherein the third delivery information comprises information of a third delivery outlet and third delivery concentration;
When the inclination angle is in a fourth angle range, determining delivery information corresponding to the inclination angle as fourth delivery information, wherein the fourth delivery information comprises information of a fourth delivery outlet and fourth delivery concentration;
the first delivery outlet, the second delivery outlet, the third delivery outlet and the fourth delivery outlet are respectively positioned at the left upper corner, the left lower corner, the right upper corner and the right lower corner of the communication terminal; the first delivery concentration, the second delivery concentration, the third delivery concentration and the fourth delivery concentration are sequentially increased in a step-type or a progressive manner, and the first angle range, the second angle range, the third angle range and the fourth angle range are set to be different angle ranges.
In one embodiment of the present specification, the communication terminal is further provided with a tail opening, the tail opening is communicated with the perfume box of the perfume delivery unit, and the method further comprises:
responding to a preset touch operation to generate a self-injection control, wherein the preset touch operation is to slide back and forth along a touch screen of the communication terminal three times;
And responding to the preset operation on the self-spraying control, spraying perfume at the tail opening of the communication terminal, wherein the preset operation is to touch and press the self-spraying control of the communication terminal and simultaneously swing the communication terminal up and down, and the up and down swing is to alternately lift the upper end and the lower end of the communication terminal by taking the middle point of the communication terminal as a fulcrum.
In one embodiment of the present description, the perfume cartridge has a non-volatile memory built into it, wherein the optional information of the perfume delivery system includes the type of perfume that can be delivered and its consumable time:
The step of analyzing the system basic information to obtain optional information of the perfume delivery system comprises the steps of: the perfume type information and the perfume storage amount information of the perfume box stored in the nonvolatile memory are acquired, and the perfume type and the consumable time of the perfume which can be delivered are obtained through analysis.
In one embodiment of the present specification, the perfume kind information recommendation list includes history recommendation information, user gender recommendation information, user character recommendation information, or quarter recommendation information;
the user selection history statistical analysis is specifically:
according to the basic information of the user, the past history selection of the user is called, and the latest history selection of the user is utilized to form history recommendation information; or alternatively
According to the user basic information and through historical selection of the existing user quantity through statistical analysis, establishing user characteristic identification recommendation through a decision tree, a neural network or a vector-based representation method, wherein the user characteristic identification recommendation comprises user gender recommendation information and user character recommendation information; or alternatively
And establishing quarter recommendation information by means of statistical arrangement according to the recent historical selection of the existing user quantity.
In one embodiment of the present specification, the pre-stored perfume push type model is a facial feature-perfume type preference matching model, which is built by the steps of:
Facial feature data and perfume type preference associated data are acquired based on the Internet, and a facial feature-perfume type preference matching model is established through machine learning.
In an embodiment of the present disclosure, the communication terminal further includes two cameras, each of the two cameras is telescopically disposed on an upper end wall of the communication terminal and is located at left and right sides, perfume delivery outlets of two corners of an upper end of the communication terminal are located at a back surface of the communication terminal, a shielding device is disposed at a center of each perfume delivery outlet, the two cameras are respectively in one-to-one correspondence with the two shielding devices, an annular perfume injection area is formed at a periphery of the shielding device at the perfume delivery outlet, and a plurality of perfume injection holes are formed in the perfume injection area, and the method further includes:
Responding to pressing operation on the shielding device, enabling the shielding device to expand the area to reduce the width of the perfume spraying area, spraying perfume out of the changed perfume spraying area, simultaneously starting a camera corresponding to the shielding device and enabling the camera to extend and focus, thereby capturing a user environment scene image and sending the user environment scene image to the cloud recommendation server, enabling the cloud recommendation server to identify a face image according to the user environment scene image, and determining an emotional state as an active state or a passive state according to the emotional state obtained by matching facial features-emotion models; the facial feature-emotion model is established in the following way: facial feature data and emotion state associated data are acquired based on the Internet, and a facial feature-emotion state matching model is established through machine learning:
If the emotion change numerical information is displayed as a positive emotion state, continuing perfume delivery work;
if the mood change numeric information indicates a negative mood state, the perfume delivery task is discontinued.
In one embodiment of the present disclosure, an injection cavity is formed on the back of the communication terminal, the injection cavity is communicated with the perfume box, the communication terminal is formed with an annular blocking piece, a shielding opening is formed in the middle of the annular blocking piece, a shielding device is arranged in the shielding opening, an annular cylinder is protruding from the bottom center of the injection cavity, the shielding device comprises a pressing circular plate and a conical cover, the pressing circular plate is located in the shielding opening and the periphery of the pressing circular plate is abutted to the side wall of the shielding opening, the conical cover is arranged on the top of the annular cylinder, the top of the conical cover is connected to the center of the pressing circular plate, the inner diameter of the conical cover is gradually increased along the direction facing the injection cavity, a perfume injection area is formed on the annular blocking piece, and when the pressing circular plate is pressed, the conical cover is enabled to descend and the shielding area of the conical cover is gradually increased under the abutment of the annular cylinder, so that the width of the perfume injection area is reduced.
In the embodiment of the application, the mobile communication terminal is provided with the perfume delivery system, so that the mobile communication terminal can increase the perception dimension of smell besides vision, hearing and touch, and meanwhile, the intelligent perfume delivery type selection can be provided by analyzing personal information of a user and personal scene images of the user, so that the practicability of the odor release function of the communication terminal is fully released.
After the embodiment of the application receives the user operation, different perfume releasing operations are carried out according to different user operations, the dimension of the perfume releasing operations relates to the perfume type and the perfume releasing speed, and the perfume releasing operations are organically combined through the preset design, so that the intelligent degree of the mobile communication terminal on the odor releasing function is increased, and the intelligent degree of the mobile phone odor releasing function is more effectively exerted.
Drawings
Other features, objects and advantages of the application will become more apparent upon reading of the detailed description of a non-limiting implementation, made with reference to the accompanying drawings in which:
Fig. 1 is a flowchart illustrating steps of a communication terminal control method based on man-machine interaction according to an embodiment of the present disclosure;
Fig. 2 is a schematic diagram showing an internal module of the communication terminal according to one embodiment of the present disclosure;
FIG. 3 shows a schematic structural view of a shutter according to one embodiment of the present disclosure;
fig. 4 shows a schematic structural view of a perfume delivery unit according to one embodiment of the present description.
Detailed Description
The following description of the embodiments of the present invention, taken in conjunction with the accompanying drawings, will be clearly and fully described in terms of the drawings, wherein the embodiments described are some, but not all, of the embodiments of the present invention. All other embodiments, which can be made by those skilled in the art based on the embodiments of the present invention without making any inventive effort, are intended to fall within the scope of the present invention.
The computer device includes a user device and a network device. Wherein the user equipment includes, but is not limited to, a computer, a smart phone, a PDA, etc.; the network device includes, but is not limited to, a single network server, a server group of multiple network servers, or a Cloud based Cloud Computing (Cloud Computing) consisting of a large number of computers or network servers, where Cloud Computing is one of distributed Computing, and is a super virtual computer consisting of a group of loosely coupled computer sets. The computer device can be used for realizing the application by running alone, and can also be accessed into a network and realized by interaction with other computer devices in the network. Wherein the network where the computer device is located includes, but is not limited to, the internet, a wide area network, a metropolitan area network, a local area network, a VPN network, and the like.
It should be noted that the user device, the network, etc. are only examples, and other computer devices or networks that may be present in the present application or in the future are applicable to the present application, and are also included in the scope of the present application and are incorporated herein by reference.
The methods discussed below (some of which are illustrated by flowcharts) may be implemented by hardware, software, firmware, middleware, microcode, hardware description languages, or any combination thereof. When implemented in software, firmware, middleware or microcode, the program code or code segments to perform the necessary tasks may be stored in a machine or computer readable medium such as a storage medium. The processor(s) may perform the necessary tasks.
It will be understood that, although the terms "first," "second," etc. may be used herein to describe various elements, these elements should not be limited by these terms. These terms are only used to distinguish one element from another element. For example, a first element could be termed a second element, and, similarly, a second element could be termed a first element, without departing from the scope of example embodiments. The term "and/or" as used herein includes any and all combinations of one or more of the associated listed items.
The present invention provides an embodiment, and a scheme provided in the present specification is described below with reference to the accompanying drawings. Referring to fig. 1 to 4, the perfume delivery unit 10 is disposed in the communication terminal, the perfume delivery unit 10 includes a perfume box 11, a heating plate 12 and a controller 13, a plurality of perfume grids 14 are disposed in the perfume box, different perfume types are accommodated in the perfume grids 14, a plurality of heating blocks 15 separated from each other are disposed on the heating plate 12, the plurality of heating blocks 15 are respectively abutted to the bottoms of the perfume grids 14, the connection mode is an electric welding mode or a plastic pasting mode, the controller 13 is electrically connected with the heating plate 12, and the plurality of heating blocks 15 are respectively used for heating the perfume grids 14 in different types so as to prompt the communication terminal to volatilize the perfume in different types to cater to the preference of different users.
Specifically, for example, in one embodiment, the smart communication terminal is, for example, a mobile phone. For example, the number of the perfume delivery units 10 is two, and the two perfume delivery units 10 are respectively positioned at the upper end and the lower end of the communication terminal. For example, the opposite side walls of the communication terminal are made of flexible materials, so that a user can hold the communication terminal. For example, the surrounding wall extends in a straight line, the cross section of the surrounding wall is in a sector shape, and a perfume channel is formed in the surrounding wall, and two opposite ends of the perfume channel are respectively communicated with the perfume cartridges 11 of the two perfume delivery units 10. A plurality of perfume overflow micropores are formed in the side wall of one side, away from the display screen of the communication terminal, of the perfume channel. By arranging the surrounding wall of the flexible material, the holding hand feeling of a user holding the communication terminal is improved, and a plurality of perfume overflows from the micropores, so that the perfume steam is convenient to overflow.
The communication terminal control method based on man-machine interaction comprises the following steps:
step S1, responding to man-machine interaction operation of a user, acquiring system basic information of a perfume delivery unit of a communication terminal, and scanning to acquire a personal scene image of the user;
Specifically, the communication terminal is provided with a first camera, and the first camera has a rotation function; the step of scanning and obtaining the personal scene image of the user comprises the following steps:
Starting a first light supplementing lamp at the side of the first camera to emit a first light beam, and acquiring first image information of a user by utilizing reflected light of the first light beam;
Judging the brightness value of the first image information, and when the brightness value is lower than a first threshold value, driving the first camera to rotate by a preset angle, for example, rotating by 15 degrees, and then utilizing the first light supplementing lamp to emit diffuse light beams so as to increase the brightness;
A second light supplementing lamp of the communication terminal, which is far away from the first camera, is used for emitting a light supplementing beam, a preset included angle is formed between the scattered beam and the light supplementing beam, and the scattered beam and the light supplementing beam are emitted to the face of a user from different angles;
and acquiring second image information by using the first camera, and determining the second image information as a personal scene image of the user.
The brightness value is detected through the first light beam, so that when a scene of the later in a cloudy day is darker, the first light supplementing lamp can be rotated to emit diffuse light to increase brightness, and the light supplementing light beam emitted by the second light supplementing lamp from another angle is utilized, so that the identification degree of the acquired personal scene image of the user is increased;
step S2, sending a user personal scene image to a cloud recommendation server so that the cloud recommendation server can capture the facial features of the user in the user personal scene image according to the user personal scene image, and judging whether the current user is a prestored user or not;
Step S3, when the cloud recommendation server determines that the current user is a non-prestored user, executing the following steps:
Step S31, generating an input control of user basic information, receiving user personal information through the input control, and sending the user personal information to a cloud recommendation server, so as to store the user personal information of the current user, and newly adding a corresponding pre-stored user; and
S32, analyzing the basic information of the system to obtain optional information of the perfume delivery system, and sending the optional information of the perfume delivery system to a cloud recommendation server;
Specifically, for example, the selectable information includes a perfume consumable time, and a calculation formula of the consumable time is: time t=heating efficiency R perfume present amount information V;
step S4, when the cloud recommendation server determines that the current user is a pre-stored user, executing the following steps:
s41, analyzing the basic information of the system to obtain optional information of the perfume delivery system, and sending the optional information of the perfume delivery system to a cloud recommendation server;
Step S5, receiving a perfume type information recommendation list which is pushed by a cloud recommendation server according to optional information of a perfume delivery unit and aiming at basic information of a user based on user selection history statistical analysis or a pre-stored perfume push type model, wherein the basic information of the user is composed of personal information of the user and facial features of the user;
analyzing through a cloud server to obtain perfume recommendation information, wherein the analysis process of the cloud server comprises the following steps:
the historical recommendation selection information analysis process is to call and match the latest selection information selected by the user in the information stored in the cloud server through the user basic information;
The user gender recommendation information analysis process is to accept user basic information, match the gender information in the user basic information with preset gender-perfume type recommendation model to generate user gender recommendation information and select information of perfume delivery system to generate user gender recommendation information, wherein the gender-perfume type recommendation model can be established through decision trees, neural networks or vector-based representation methods, and then match the user basic information to obtain user gender recommendation information;
The user character recommendation information analysis process is that after receiving user personal scene information, face images are extracted through face recognition technology, user character recommendation information is generated through preset facial feature-perfume type recommendation model matching and perfume delivery system selectable information, and the preset facial feature-perfume type recommendation model is established as follows:
The facial image information and the corresponding perfume preference information are acquired through the Internet or questionnaire and a mode of acquiring facial image-perfume preference information, and the steps of establishing a facial feature-perfume type recommendation model through a machine learning algorithm are as follows:
The face image information is identified by adopting a face identification method of geometric features, a face identification method based on feature face (PCA), a face identification method of neural network, a face identification method of elastic graph matching, a face identification method of line segment Hausdorff distance (LHD) or a face identification method of Support Vector Machine (SVM) to sample and generate face feature information; the neural network face recognition method comprises the following steps:
in the convolutional layer based on the neural network, there are individual square small lattices filled with numbers, called convolutional kernels. The original picture is changed into a gray scale or an RGB value filled matrix after passing through the input layer. The convolution kernel is aligned with the picture matrix, the numbers in the corresponding lattices are multiplied and added, and the obtained numbers are filled into the new matrix, namely the convolution. The convolution kernel moves on the image with a certain distance to calculate, called step length, and the obtained new matrix can reflect part of the characteristics of the image, called characteristic diagram. The feature map is both the output of this layer and the input of the next layer. Different convolution kernels are set to find a variety of features. Training is to automatically determine the numbers in the convolution kernel according to the existing data and labels. The pooling layer can select main features of the image, and parameters can be greatly reduced after the matrix is pooled. The fully connected layer at the end of the network can bring the extracted features together. The probability that the picture is something is given to judge whether the picture is a human face or not.
Developing a prediction model by adopting a Support Vector Machine (SVM), a boost (boosted) decision tree and a bagged (bagged) decision tree, k-nearest neighbors, naive Bayes ( Bayes), discriminant analysis, logistic regression or classification technology in the supervised learning of a neural network, and establishing a facial feature-perfume type recommendation matching model by taking facial feature data and perfume preference data as input data; the method for establishing the facial feature-perfume type recommendation matching model based on the vector machine comprises the following steps of:
The facial feature information and the corresponding perfume type preference information are used as test samples, the basic thought of the vector machine-based method is to find the optimal hyperplane which enables the classification error rate of the test samples to be the lowest, namely a segmentation plane is found, so that the distance between the training samples in the training set and the plane is as far as possible, and the blank areas on two sides of the segmentation plane are the largest. The hyperplane is: wx+b=0;
the support vectors on both sides are: wx 1+b＝1,wx2 +b= -1;
the support vector to plane set interval is: d = (wx+ b) is (are) of I W ||=1/|w|;
maximizing d and minimizing w, and constructing an objective function of min1/2 w 2;
provided that the distance from any one point to the hyperplane is not less than 1 (on linearly separable data): y i(wxi +b) -1> =0;
Conversion to Lagrange algorithm: l (w, b, alpha) =1? 2 w i 2-∑ɑi(yi(wxi +b) -1);
Let have: w= Σα iyixi,sumɑiyi =0;
So w can be linearly expressed as { x 1,x2,…,xn } and has a fraction of a i =0, then for a sample vector x i of a i +.0, it is the support vector: bringing the differentiation result into the objective function w= Σα iyixi, provided that α i>＝0,∑ɑiyi =0 is such that: max { Q (a) } = max { -1/2 Σ a iɑjyiyj(xi,xj)+∑ɑi };
Making linearity inseparable: the constraint conditions are as follows: wx 1+b>＝1-X1,wx2+b<＝Xi -1;
the optimization problem becomes: min1/2 i w i 2+C∑Xi,yi(wxi+b)>＝1-Xi,chii > =0;
The LARGRANGE algorithm is constructed: A
Let have w= Σα iyixi,/>
The dual problem ：max{-1/2∑ɑiɑjyiyj(xi,xj)+∑ɑi},s.t.∑ɑiyi＝0,0<＝ɑi<＝X, is used for obtaining a facial feature-perfume type recommendation matching model;
The season recommendation information is generated according to the selectable information of the perfume delivery system by scanning and counting the latest histories of all users stored in the cloud server, and establishing weighted ranking;
s6, generating a perfume delivery type selection interface according to the perfume type information recommendation list;
And step S7, responding to the selection operation of the user to accept the selected perfume type information and delivering the perfume type corresponding to the perfume type information.
In particular, the corresponding perfume species may be delivered, for example, through a plurality of perfume spillover micro-pores surrounding the wall.
Fig. 1 is a flowchart of a communication terminal control method based on man-machine interaction, in which whether a pre-stored user can effectively shorten response time is determined, and the effective degree of perfume delivery effect can be effectively increased according to user scene information and user personal information.
The communication terminal is provided with the perfume delivery system, so that the communication terminal can increase the perception dimension of smell besides vision, hearing and touch, and meanwhile, the intelligent perfume delivery type selection can be provided through analyzing personal information of a user and personal scene images of the user, so that the intelligence of the perfume delivery system is improved.
Specifically, for example, the communication terminal can be classified into a osmanthus fragrance type, a jasmine fragrance type, a cologne waiting type and other communication terminal types through perfume types, for example, different types of lady mobile phones can be distinguished through different perfumes, so that the product demands of users can be created, and the sales of the mobile phones can be increased.
As shown in fig. 2, the embodiment of the present disclosure provides a device where a communication terminal control method based on man-machine interaction is located. The apparatus embodiments are implemented by hardware or a combination of hardware and software. In terms of hardware, as shown in fig. 3 and fig. 4, a hardware structure diagram of a device where a communication terminal control method based on man-machine interaction is located according to an embodiment of the present disclosure is shown in fig. 2, where the device is located may generally include other hardware, such as a forwarding chip responsible for processing a message, in addition to the processor, the memory, the internal bus, the network interface, and the nonvolatile memory shown in fig. 2. Taking software implementation as an example, the device in a logic sense is formed by reading corresponding computer program instructions in a nonvolatile memory into a memory by a CPU of a device where the device is located.
The invention provides an embodiment, a mobile communication terminal is provided with four perfume delivery outlets which are respectively arranged at the upper and lower corner positions of the left side and the right side of the mobile communication terminal and are divided into two groups of perfume delivery units, wherein the first group of perfume delivery units are arranged at the upper and lower corner positions of the left side of the communication terminal, and the second group of perfume delivery units are arranged at the upper and lower corner positions of the right side of the communication terminal, and the steps for delivering perfume types selected by a user are as follows:
Calculating a user hand-held mode by acquiring an inclination angle obtained by a direction sensor arranged at an internal angle of the mobile communication terminal; defaulting of the hand-held mode of the user is that the position, facing the right side, of the mobile communication terminal is regarded as a left hand-held mode, and the position, facing the left side, of the mobile communication terminal is regarded as a right hand-held mode; and starting corresponding perfume delivery units according to the hand-held direction of the user, performing perfume delivery work, and holding a first group of perfume delivery units corresponding to the left hand and a second group of perfume delivery units corresponding to the right hand. The corresponding perfume delivery unit is started to deliver perfume through judging the hand-held direction of the user, so that the perfume is sprayed onto the hands of the user, and the practicability of the perfume is effectively exerted.
Specifically, for example, when the mobile communication terminal determines that the hand-holding mode of the user is the left hand holding mode, a first group of perfume delivery units are started, the first group of perfume delivery units are positioned at the upper corner and the lower corner of the left side of the communication terminal, perfume is directly sprayed onto the left hand, and perfume is directly delivered onto the hand of the user; when the mobile communication terminal judges that the hand-holding mode of the user is the right hand-holding mode, the second group of perfume delivery units are started, the second group of perfume delivery units are positioned at the upper corner and the lower corner of the right side of the communication terminal, perfume is directly sprayed onto the right hand, and perfume is directly delivered onto the hand of the user.
In one embodiment, the step of determining the delivery information according to the angle range to which the tilt angle belongs includes:
when the inclination angle is within a first angle range, determining delivery information corresponding to the inclination angle as first delivery information, wherein the first delivery information comprises information of a first delivery outlet and first delivery concentration;
When the inclination angle is within a second angle range, determining delivery information corresponding to the inclination angle as second delivery information, wherein the second delivery information comprises information of a second delivery outlet and second delivery concentration;
When the inclination angle is within a third angle range, determining delivery information corresponding to the inclination angle as third delivery information, wherein the third delivery information comprises information of a third delivery outlet and third delivery concentration;
When the inclination angle is within a fourth angle range, determining delivery information corresponding to the inclination angle as fourth delivery information, wherein the fourth delivery information comprises information of a fourth delivery outlet and fourth delivery concentration;
The first delivery outlet, the second delivery outlet, the third delivery outlet and the fourth delivery outlet are respectively positioned at the left upper corner, the left lower corner, the right upper corner and the right lower corner of the communication terminal; the first delivery concentration, the second delivery concentration, the third delivery concentration and the fourth delivery concentration are sequentially increased in a step-type or a progressive manner, and the first angle range, the second angle range, the third angle range and the fourth angle range are set to be different angle ranges. The perfume delivery concentration and the perfume delivery outlet are influenced by the inclination angle of the handheld mobile communication terminal, wherein the first delivery outlet is positioned at the upper corner of the left side of the communication terminal, can be sprayed to the upper half part of the body when being held by the left hand, can be sprayed to the lower half part of the body when being held by the right hand, and increases the odor of the corresponding part of the body; the second delivery outlet is positioned at the left lower corner of the communication terminal, can be sprayed to the left hand part when being held by the left hand, and can be sprayed to the body when being held by the right hand; wherein the third delivery outlet is positioned at the upper right corner of the communication terminal and is sprayed to the lower half of the body when held by the left hand; the fourth delivery outlet is positioned at the lower right corner of the communication terminal, and is sprayed to the body when the communication terminal is held by the left hand, and is sprayed to the right hand position when the communication terminal is held by the right hand.
In particular, for example, the perfume delivery concentration and perfume delivery outlet are limited by the angle of inclination during perfume delivery work in one embodiment; the limit range of the inclination angle is 0-90 degrees, and when the inclination angle exceeds the range of the numerical value, the calculation is carried out in a congruent mode:
When the inclination angle is limited to be within the range of 0 DEG to 90 DEG:
when the inclination angle is 0-15 degrees, opening a corresponding perfume delivery outlet according to first outlet information, and performing perfume delivery work according to first delivery concentration, wherein the first outlet information is the upper left corner of the mobile communication terminal;
When the inclination angle is 15-30 degrees, opening a corresponding perfume delivery outlet according to second outlet information, and performing perfume delivery work according to second delivery concentration, wherein the second outlet information is the lower left corner of the mobile communication terminal;
when the inclination angle is 30-60 degrees, opening a corresponding perfume delivery outlet according to third outlet information, and performing perfume delivery work according to third delivery concentration, wherein the third outlet information is the upper right corner of the mobile communication terminal;
When the inclination angle is 60-90 degrees, opening a corresponding perfume delivery outlet according to fourth outlet information, and performing perfume delivery work according to fourth delivery concentration, wherein the fourth outlet information is the lower right corner of the mobile communication terminal;
The first, second, third, and fourth delivery concentrations develop in steps with a numerical ratio of 1:2:3:4 or 1:2:4:8, adjusting, namely designing the first two inclination angles to be small angles, and tilting the communication terminal in a labor-saving mode at first when the mobile phone is held, wherein the perfume release concentration change is stepwise, so that the perfume delivery concentration change caused by the inclination angle change is highlighted; the step type is a step type rising, namely the first delivery concentration is constant in a first angle range, when the angle of the mobile phone is changed into a second angle range, the first delivery concentration is directly changed into a second delivery concentration, and the middle change mode is called the step type;
In particular, for example, the perfume delivery concentration and perfume delivery outlet are limited by the angle of inclination during perfume delivery work in one embodiment; the limit range of the inclination angle is 0-90 degrees, and when the inclination angle exceeds the range of the numerical value, the calculation is carried out in a congruent mode:
When the inclination angle is limited to be within the range of 0 DEG to 90 DEG:
when the inclination angle is 0-15 degrees, opening a corresponding perfume delivery outlet according to first outlet information, and performing perfume delivery work according to first delivery concentration, wherein the first outlet information is the upper left corner of the mobile communication terminal;
When the inclination angle is 15-30 degrees, opening a corresponding perfume delivery outlet according to second outlet information, and performing perfume delivery work according to second delivery concentration, wherein the second outlet information is the lower left corner of the mobile communication terminal;
when the inclination angle is 30-60 degrees, opening a corresponding perfume delivery outlet according to third outlet information, and performing perfume delivery work according to third delivery concentration, wherein the third outlet information is the upper right corner of the mobile communication terminal;
When the inclination angle is 60-90 degrees, opening a corresponding perfume delivery outlet according to fourth outlet information, and performing perfume delivery work according to fourth delivery concentration, wherein the fourth outlet information is the lower right corner of the mobile communication terminal;
the first, second, third, and fourth delivery concentrations were progressively developed with a numerical ratio of 1:2:3:4 or 1:2:4:8, adjusting, wherein the intelligence of perfume release is effectively improved in the mode, the first two-inclination angle is designed to be a small angle, the initial change of the perfume release is met when the perfume release is held by hands in a labor-saving mode, and the change of the perfume release concentration is in linear change and meets human perception; progressive development of a change in delivery concentration in direct proportion to the angular range, with the formula delivery concentration c=proportional value K x angle D;
In particular, for example, the perfume delivery concentration and perfume delivery outlet are limited by the angle of inclination during perfume delivery work in one embodiment; the limit range of the inclination angle is 0-90 degrees, and when the inclination angle exceeds the range of the numerical value, the calculation is carried out in a congruent mode:
When the inclination angle is limited to be within the range of 0 DEG to 90 DEG:
When the inclination angle is 0-22.5 degrees, opening a corresponding perfume delivery outlet according to first outlet information, and performing perfume delivery work according to first delivery concentration, wherein the first outlet information is the upper left corner of the mobile communication terminal;
when the inclination angle is 22.5-45 degrees, opening a corresponding perfume delivery outlet according to second outlet information, and performing perfume delivery work according to second delivery concentration, wherein the second outlet information is the lower left corner of the mobile communication terminal;
when the inclination angle is 45-77.5 degrees, opening a corresponding perfume delivery outlet according to third outlet information, and performing perfume delivery work according to third delivery concentration, wherein the third outlet information is the upper right corner of the mobile communication terminal;
when the inclination angle is 77.5-90 degrees, opening a corresponding perfume delivery outlet according to fourth outlet information, and performing perfume delivery work according to fourth delivery concentration, wherein the fourth outlet information is the corner of the right lower side of the mobile communication terminal;
The first, second, third, and fourth delivery concentrations develop in steps with a numerical ratio of 1:2:3:4 or 1:2:4:8, adjusting, wherein the inclination angle is uniformly changed, so that the user can conveniently use and distinguish, and the perfume delivery concentration change caused by the inclination angle change is highlighted; the step type is a step type rising, namely the first delivery concentration is constant in a first angle range, when the angle of the mobile phone is changed into a second angle range, the first delivery concentration is directly changed into a second delivery concentration, and the middle change mode is called the step type;
In particular, for example, the perfume delivery concentration and perfume delivery outlet are limited by the angle of inclination during perfume delivery work in one embodiment; the limit range of the inclination angle is 0-90 degrees, and when the inclination angle exceeds the range of the numerical value, the calculation is carried out in a congruent mode:
When the inclination angle is limited to be within the range of 0 DEG to 90 DEG:
When the inclination angle is 0-22.5 degrees, opening a corresponding perfume delivery outlet according to first outlet information, and performing perfume delivery work according to first delivery concentration, wherein the first outlet information is the upper left corner of the mobile communication terminal;
when the inclination angle is 22.5-45 degrees, opening a corresponding perfume delivery outlet according to second outlet information, and performing perfume delivery work according to second delivery concentration, wherein the second outlet information is the lower left corner of the mobile communication terminal;
when the inclination angle is 45-77.5 degrees, opening a corresponding perfume delivery outlet according to third outlet information, and performing perfume delivery work according to third delivery concentration, wherein the third outlet information is the upper right corner of the mobile communication terminal;
when the inclination angle is 77.5-90 degrees, opening a corresponding perfume delivery outlet according to fourth outlet information, and performing perfume delivery work according to fourth delivery concentration, wherein the fourth outlet information is the corner of the right lower side of the mobile communication terminal;
The first, second, third, and fourth delivery concentrations were progressively developed with a numerical ratio of 1:2:3:4 or 1:2:4:8, adjusting, wherein the inclination angle is uniformly changed, the use and the discrimination of a user are convenient, and the change of the perfume release concentration is linear and accords with human perception; progressive development of a change in delivery concentration in direct proportion to the angular range, with the formula delivery concentration c=proportional value K x angle D;
In particular, for example, perfume delivery concentration during perfume delivery work and perfume delivery outlet are limited by the angle of inclination; the limiting range of the inclination angle is 90-180 degrees, the perfume spraying direction faces downwards, and the perfume delivery concentration range can be in the range of 0-90 degrees or can be set to be self-adaptively adjusted;
In one embodiment, the mobile communication terminal is further provided with a tail opening, and the tail opening is communicated with the perfume box of the perfume delivery unit, so that the user can perform perfume spraying operation on the tail opening of the communication terminal after activating the self-spraying control, and the operation is as follows:
The user touches/approaches the man-machine interaction interface in a preset mode, wherein the touch operation in the preset mode is to slide back and forth along the touch screen of the communication terminal three times, and the perfume delivery system generates a self-injection control on the touch screen of the communication terminal; for example, the self-injection control is a virtual button.
The user touches and presses a self-spraying control button positioned on a touch screen of the communication terminal, and simultaneously swings the communication terminal up and down, wherein the up and down swing is realized by taking the middle point of the communication terminal as a fulcrum, so that the upper end and the lower end of the communication terminal are alternately lifted, whether the communication terminal swings up and down or not can be judged by acquiring corresponding values through a direction sensor, on one hand, a tail opening can be sent out for perfume spraying work, on the other hand, perfume delivery work can be driven by the tail opening which swings up and down to spray perfume to all parts of a body, and meanwhile, the design of a preset mode effectively prevents misoperation;
the invention provides an embodiment, the communication terminal further comprises two cameras, the two cameras are telescopically arranged on the end wall of the upper end of the communication terminal and are respectively positioned at the left side and the right side, perfume delivery outlets of two corners of the upper end of the communication terminal are positioned at the back of the communication terminal, a shielding device is arranged in the center of each perfume delivery outlet, the two cameras are respectively in one-to-one correspondence with the two shielding devices, an annular perfume injection area is formed at the periphery of each shielding device by the perfume delivery outlets, and a plurality of perfume injection holes are formed in each perfume injection area, and the method further comprises the following steps:
Responding to the pressing operation on the shielding device 103 of the communication terminal, promoting the shielding device 103 to enlarge the area so as to reduce the width of the perfume spraying area, spraying perfume out of the changed perfume spraying area, simultaneously starting a corresponding camera on the communication terminal of the shielding device 103 and enabling the camera to extend and focus, thereby capturing a user environment scene image and sending the user environment scene image to the cloud recommendation server, enabling the cloud recommendation server to identify a face image according to the user environment scene image, and determining an emotion state as an active state or a passive state according to the emotion state obtained by matching facial features-emotion models; the facial feature-emotion model is established by acquiring facial feature data and emotion state associated data based on the Internet, and establishing a facial feature-emotion state matching model through machine learning comprises the following steps:
The face image information is identified by adopting a face identification method of geometric features, a face identification method based on feature face (PCA), a face identification method of neural network, a face identification method of elastic graph matching, a face identification method of line segment Hausdorff distance (LHD) or a face identification method of Support Vector Machine (SVM) to sample and generate face feature information; the neural network face recognition method comprises the following steps:
in the convolutional layer based on the neural network, there are individual square small lattices filled with numbers, called convolutional kernels. The original picture is changed into a gray scale or an RGB value filled matrix after passing through the input layer. The convolution kernel is aligned with the picture matrix, the numbers in the corresponding lattices are multiplied and added, and the obtained numbers are filled into the new matrix, namely the convolution. The convolution kernel moves on the image with a certain distance to calculate, called step length, and the obtained new matrix can reflect part of the characteristics of the image, called characteristic diagram. The feature map is both the output of this layer and the input of the next layer. Different convolution kernels are set to find a variety of features. Training is to automatically determine the numbers in the convolution kernel according to the existing data and labels. The pooling layer can select main features of the image, and parameters can be greatly reduced after the matrix is pooled. The fully connected layer at the end of the network can bring the extracted features together. The probability that the picture is something is given to judge whether the picture is a human face or not.
Developing a prediction model by adopting a Support Vector Machine (SVM), a boost (boosted) decision tree and a bagged (bagged) decision tree, k-nearest neighbors, naive Bayes ( Bayes), discriminant analysis, logistic regression or classification technology in the supervised learning of a neural network, and establishing a facial feature-emotion state matching model by taking facial feature data and emotion state data as input data; the method for establishing the facial feature-emotion state matching model based on the vector machine comprises the following steps of:
The facial feature information and the corresponding emotion states are used as test samples, the basic thought of the vector machine-based method is to find the optimal hyperplane for enabling the classification error rate of the test samples to be the lowest, namely to find a segmentation plane, so that the distance between the training samples in the training set and the plane is as far as possible, and the blank areas on two sides of the segmentation plane are the largest. The hyperplane is: wx+b=0;
the support vectors on both sides are: wx 1+b＝1,wx2 +b= -1;
the support vector to plane set interval is: d = (wx+ b) is (are) of I W ||=1/|w|;
In order to maximize d, i.e., minimize w, an objective function is constructed of min1/2 w 2;
provided that the distance from any one point to the hyperplane is not less than 1 (on linearly separable data): y i(wxi +b) -1> =0;
Conversion to Lagrange algorithm: l (w, b, alpha) =1? 2 w i 2-∑ɑi(yi(wxi +b) -1);
let have: w= Σα iyixi,sumɑiyi =0;
So w can be linearly expressed as { x 1,x2,…,xn } and has a fraction of a i =0, then for a sample vector x i of a i +.0, it is the support vector: bringing the differentiation result into the objective function w= Σα iyixi, provided that α i>＝0,∑ɑiyi =0 is such that: max { Q (a) } = max { -1/2 Σ a iɑjyiyj(xi,xj)+∑ɑi };
if the linearity is made inseparable: the constraint conditions are as follows: wx 1+b>＝1-X1,wx2+b<＝Xi -1;
the optimization problem becomes: min1/2 i w i 2+C∑Xi,yi(wxi+b)>＝1-Xi,chii > =0;
the LARGRANGE algorithm is constructed: A
Let have w= Σα iyixi,/>
The dual problem ：max{-1/2∑ɑiɑjyiyj(xi,xj)+∑ɑi},s.t.∑ɑiyi＝0,0<＝ɑi<＝X, thereby creates a facial feature-emotional state matching model;
If the emotion change numerical information is displayed as a positive emotion state, continuing perfume delivery work;
if the mood change numeric information indicates a negative mood state, the perfume delivery task is discontinued.
Positive emotional states, i.e., positive emotions or emotions with positive titers, including happiness, satisfaction, interest, porcupy, feeling, and love; the negative emotion state, namely negative emotion or emotion with negative titer, is that in a specific action, you are not beneficial to continue to complete work or normal thinking emotion caused by external or internal factors, and the negative emotion state comprises sadness, anger, tension, anxiety, pain, fear and horror. When the user judges that the perfume is in the active emotion state, the user is informed to accept perfume delivery work, and then the perfume delivery work is continuously carried out; when the user decides the negative emotion state, the user refuses the perfume delivery work, and the perfume delivery work is stopped.
In one embodiment, as shown in fig. 3, an injection cavity 100 is formed on the back of the communication terminal, the injection cavity 100 is communicated with a perfume box, an annular baffle 101 is formed on the communication terminal, a shielding opening 102 is formed in the middle of the annular baffle 101, a shielding device 103 is arranged in the shielding opening 102, an annular cylinder 104 is convexly arranged at the center of the bottom of the injection cavity, the shielding device 103 comprises a pressing circular plate 105 and a conical cover 106, the pressing circular plate 105 is positioned in the shielding opening 102, the periphery of the pressing circular plate 105 is abutted against the side wall of the shielding opening 102, the conical cover 106 covers the top of the annular cylinder 104, the top of the conical cover 106 is connected with the center of the pressing circular plate 105, the inner diameter of the conical cover 106 is gradually increased along the direction towards the injection cavity 100, and a perfume injection area is formed on the annular baffle 101.
When the pressing disk 105 is pressed, the conical cover 106 can be lowered and the shielding area of the conical cover 106 can be gradually increased by the pressing force of the annular tube 104, thereby reducing the width of the perfume spraying area. By designing the shutter 103, it is possible to increase the mask area in response to a user operation, the increased area of which is adapted to the size of the finger, so that the ejection area is correlated with the finger size. Pressing the pressing circular plate 105 gradually increases the shielding area of the cone cover 106, thereby decreasing the width of the perfume spraying area, so that the perfume spraying rate increases, and at the same time, the angle of the perfume spraying expands outward.
In addition, it is apparent that the user operation of the spray area in relation to the size of the finger increases the mask area, the increased area of which gradually increases in correspondence with the size of the finger, thereby decreasing the width of the perfume spray area and increasing the perfume spray speed according to the pressing force. The terms first, second, etc. of a perfume spray area are used to denote names, not to denote a particular order.
Finally, it should be noted that the above embodiments are only for illustrating the technical solution of the present invention and not for limiting the same, and although the invention has been described in detail with reference to the preferred embodiments, it should be understood by those skilled in the art that modifications and equivalents may be made to the technical solution of the present invention without departing from the spirit and scope of the technical solution of the present invention.

Claims (7)

1. The utility model provides a communication terminal control method based on human-computer interaction, a serial communication port is applied to on the communication terminal, be provided with perfume delivery unit (10) in the communication terminal, perfume delivery unit (10) are including perfume box (11), hot plate (12) and controller (13), be provided with a plurality of perfume check (14) in perfume box (11), different perfume types have been acceptd in a plurality of perfume check (14), be provided with a plurality of mutually separated heating blocks (15) on hot plate (12), a plurality of heating blocks (15) support respectively and paste the bottom of locating a plurality of perfume check (14), controller (13) and hot plate (12) electric connection, the method includes:
Responding to man-machine interaction operation of a user, acquiring system basic information of a perfume delivery unit of the communication terminal, starting a camera to capture scene information of the user, and scanning to acquire a personal scene image of the user;
The method comprises the steps that a user personal scene image is sent to a cloud recommendation server, so that the cloud recommendation server captures the facial features of a user in the user personal scene image according to the user personal scene image, and whether the current user is a prestored user or not is judged;
when the cloud recommendation server determines that the current user is a non-prestored user, executing the following steps:
Generating an input control of user basic information, receiving user personal information through the input control, and sending the user personal information to a cloud recommendation server, so that the user personal information of the current user is stored, and a corresponding pre-stored user is newly added; and
Analyzing the basic information of the system to obtain optional information of the perfume delivery unit, and sending the optional information of the perfume delivery unit to a cloud recommendation server;
When the cloud recommendation server judges that the current user is a pre-stored user, executing the following steps:
analyzing the basic information of the system to obtain optional information of the perfume delivery unit, and sending the optional information of the perfume delivery unit to a cloud recommendation server;
Receiving a perfume type information recommendation list which is pushed by a cloud recommendation server according to the user basic information and the optional information of a perfume delivery unit based on a pre-stored perfume pushing type model, wherein the user basic information consists of user personal information and user facial features;
Generating a perfume delivery type selection interface according to the perfume type information recommendation list;
Responding to the selection operation of the user to receive the selected perfume type information and delivering the perfume type corresponding to the perfume type information; the communication terminal is further provided with four perfume delivery outlets and comprises four perfume delivery units, the four perfume delivery outlets are respectively communicated with the perfume boxes of the four perfume delivery units, the four perfume delivery outlets are respectively positioned at four corner positions of the communication terminal, and the steps of delivering perfume types corresponding to the perfume type information are specifically as follows:
Sensing the inclination angle of the communication terminal through a direction sensor, determining delivery information according to an angle range to which the inclination angle belongs, wherein the delivery information comprises perfume delivery outlets and delivery concentration, delivering perfume types corresponding to the perfume type information at the determined perfume delivery outlets in the determined delivery concentration, wherein the four perfume delivery outlets are a first delivery outlet, a second delivery outlet, a third delivery outlet and a fourth delivery outlet respectively, the angle ranges are a first angle range, a second angle range, a third angle range and a fourth angle range, and the step of determining the delivery information according to the angle range to which the inclination angle belongs is as follows:
When the inclination angle is in a first angle range, determining delivery information corresponding to the inclination angle as first delivery information, wherein the first delivery information comprises information of a first delivery outlet and first delivery concentration;
when the inclination angle is in a second angle range, determining delivery information corresponding to the inclination angle as second delivery information, wherein the second delivery information comprises information of a second delivery outlet and second delivery concentration;
When the inclination angle is in a third angle range, determining delivery information corresponding to the inclination angle as third delivery information, wherein the third delivery information comprises information of a third delivery outlet and third delivery concentration;
When the inclination angle is in a fourth angle range, determining delivery information corresponding to the inclination angle as fourth delivery information, wherein the fourth delivery information comprises information of a fourth delivery outlet and fourth delivery concentration;
the first delivery outlet, the second delivery outlet, the third delivery outlet and the fourth delivery outlet are respectively positioned at the left upper corner, the left lower corner, the right upper corner and the right lower corner of the communication terminal; the first delivery concentration, the second delivery concentration, the third delivery concentration and the fourth delivery concentration are sequentially increased in a step-type or a progressive manner, and the first angle range, the second angle range, the third angle range and the fourth angle range are set to be different angle ranges.
2. The method of claim 1, wherein the communication terminal is further provided with a tail opening, the tail opening being in communication with a perfume cartridge of the perfume delivery unit, the method further comprising:
responding to a preset touch operation to generate a self-injection control, wherein the preset touch operation is to slide back and forth along a touch screen of the communication terminal three times;
And responding to the preset operation on the self-spraying control, spraying perfume at the tail opening of the communication terminal, wherein the preset operation is to touch and press the self-spraying control of the communication terminal and simultaneously swing the communication terminal up and down, and the up and down swing is to alternately lift the upper end and the lower end of the communication terminal by taking the middle point of the communication terminal as a fulcrum.
3. The method of claim 2, wherein the perfume cartridge has a non-volatile memory built into it, wherein the selectable information of the perfume delivery unit includes the type of perfume that can be delivered and its consumable time:
The step of analyzing the system basic information to obtain optional information of the perfume delivery unit comprises the steps of: the perfume type information and the perfume storage amount information of the perfume box stored in the nonvolatile memory are acquired, and the perfume type and the consumable time of the perfume which can be delivered are obtained through analysis.
4. The method of claim 3, wherein the perfume kind information recommendation list includes history recommendation information, user gender recommendation information, user character recommendation information, or quarter recommendation information.
5. The method according to claim 4, wherein the pre-stored perfume push type model is a facial feature-perfume type preference matching model, which is established by:
Facial feature data and perfume type preference associated data are acquired based on the Internet, and a facial feature-perfume type preference matching model is established through machine learning.
6. The method according to claim 1, wherein the communication terminal further comprises two cameras, the two cameras are telescopically arranged on an upper end wall of the communication terminal and are respectively positioned at the left side and the right side, perfume delivery outlets of two corners of the upper end of the communication terminal are positioned at the back of the communication terminal, a shielding device (103) is arranged in the center of each perfume delivery outlet, the two cameras are respectively in one-to-one correspondence with the two shielding devices (103), an annular perfume injection area (107) is formed at the periphery of the shielding device (103) at each perfume delivery outlet, and a plurality of perfume injection holes are formed in each perfume injection area, and the method further comprises:
Responding to the pressing operation on the shielding device (103), enabling the shielding device (103) to enlarge the area so as to reduce the width of the perfume spraying area (107), spraying perfume out of the changed perfume spraying area (107), simultaneously starting a camera corresponding to the shielding device (103) and enabling the camera to extend and focus, thereby capturing a user environment scene image and sending the user environment scene image to the cloud recommendation server, enabling the cloud recommendation server to identify a face image according to the user environment scene image, and determining the emotion state to be a positive state or a negative state according to the emotion state obtained by matching facial features-emotion models; the facial feature-emotion model is established in the following way: facial feature data and emotion state associated data are acquired based on the Internet, and a facial feature-emotion state matching model is established through machine learning:
If the emotion change numerical information is displayed as a positive emotion state, continuing perfume delivery work;
if the mood change numeric information indicates a negative mood state, the perfume delivery task is discontinued.
7. The method according to claim 6, characterized in that the injection chamber (100) is formed on the back of the communication terminal, the injection chamber (100) is communicated with the perfume box, the communication terminal is formed with an annular baffle plate (101), a shielding opening (102) is formed in the middle of the annular baffle plate (101), a shielding device (103) is arranged in the shielding opening (102), an annular cylinder (104) is convexly arranged at the bottom center of the injection chamber (100), the shielding device (103) comprises a pressing circular plate (105) and a conical cover (106), the pressing circular plate (105) is positioned in the shielding opening (102) and the periphery of the pressing circular plate (105) is abutted on the side wall of the shielding opening (102), the conical cover (106) is covered on the top of the annular cylinder (104), the top of the conical cover (106) is connected to the center of the pressing circular plate (105), the inner diameter of the conical cover (106) is gradually increased along the direction towards the injection chamber (100), the perfume injection area (107) is formed on the annular baffle plate (105), and when the pressing circular plate (105) is pressed, the conical cover (106) is enabled to be lowered and the width of the conical cover (104) is gradually reduced when the pressing circular plate (105) is pressed.
CN202210880701.3A 2022-07-25 2022-07-25 Communication terminal control method based on man-machine interaction Active CN115277934B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210880701.3A CN115277934B (en) 2022-07-25 2022-07-25 Communication terminal control method based on man-machine interaction

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210880701.3A CN115277934B (en) 2022-07-25 2022-07-25 Communication terminal control method based on man-machine interaction

Publications (2)

Publication Number Publication Date
CN115277934A CN115277934A (en) 2022-11-01
CN115277934B true CN115277934B (en) 2024-04-16

Family

ID=83769945

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210880701.3A Active CN115277934B (en) 2022-07-25 2022-07-25 Communication terminal control method based on man-machine interaction

Country Status (1)

Country Link
CN (1) CN115277934B (en)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20060078211A (en) * 2004-12-30 2006-07-05 엘지전자 주식회사 Mobile communication terminal with perfume dispenser apparatus
KR20130082980A (en) * 2011-12-26 2013-07-22 주식회사 유비벨록스모바일 User personalized recommendation system based on face-recognition
CN103970449A (en) * 2014-05-26 2014-08-06 北京金山网络科技有限公司 Multi-window sliding control method and device
KR20160041707A (en) * 2014-10-08 2016-04-18 엘지전자 주식회사 Mobile terminal and method for controlling the same
CN108198043A (en) * 2018-01-29 2018-06-22 杭州美界科技有限公司 A kind of facial skin care product recommended based on user recommend method
CN207766302U (en) * 2017-12-29 2018-08-24 上海展扬通信技术有限公司 Perfume mobile telephone shell and Perfume mobile telephone
CN112972746A (en) * 2019-12-18 2021-06-18 深圳富泰宏精密工业有限公司 Wearable device and fragrance release control method thereof

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20060078211A (en) * 2004-12-30 2006-07-05 엘지전자 주식회사 Mobile communication terminal with perfume dispenser apparatus
KR20130082980A (en) * 2011-12-26 2013-07-22 주식회사 유비벨록스모바일 User personalized recommendation system based on face-recognition
CN103970449A (en) * 2014-05-26 2014-08-06 北京金山网络科技有限公司 Multi-window sliding control method and device
KR20160041707A (en) * 2014-10-08 2016-04-18 엘지전자 주식회사 Mobile terminal and method for controlling the same
CN207766302U (en) * 2017-12-29 2018-08-24 上海展扬通信技术有限公司 Perfume mobile telephone shell and Perfume mobile telephone
CN108198043A (en) * 2018-01-29 2018-06-22 杭州美界科技有限公司 A kind of facial skin care product recommended based on user recommend method
CN112972746A (en) * 2019-12-18 2021-06-18 深圳富泰宏精密工业有限公司 Wearable device and fragrance release control method thereof

Also Published As

Publication number Publication date
CN115277934A (en) 2022-11-01

Similar Documents

Publication Publication Date Title
US11151453B2 (en) Device and method for recommending product
CN108664651B (en) Pattern recommendation method, device and storage medium
CN109242765B (en) Face image processing method and device and storage medium
KR102460511B1 (en) Device control based on processing image data that captures the device and/or the installation environment of the device
US20140157209A1 (en) System and method for detecting gestures
CN111418198B (en) Electronic device for providing text-related image and method of operating the same
CN106779073A (en) Media information sorting technique and device based on deep neural network
KR102616850B1 (en) An external device capable of being combined with an electronic device, and a display method thereof.
CN106792003B (en) Intelligent advertisement insertion method and device and server
US11492741B2 (en) Electronic device
KR102628037B1 (en) Method and apparatus for providing sales information of goods
CN107003929A (en) The application of machine learning on isomery nuclear equipment is characterized
EP3933552A1 (en) Method and device for determining gaze position of user, storage medium, and electronic apparatus
JP5605725B2 (en) Information notification system, information notification method, information processing apparatus, control method thereof, and control program
CN109978606A (en) Processing method, device and the computer readable storage medium of ad click rate data
CN109963072B (en) Focusing method, focusing device, storage medium and electronic equipment
Wu et al. Anticipating daily intention using on-wrist motion triggered sensing
KR20180132493A (en) System and method for determinig input character based on swipe input
CN112949689A (en) Image recognition method and device, electronic equipment and storage medium
JP2023544475A (en) Smart home bubble formation
CN113569138A (en) Intelligent device control method and device, electronic device and storage medium
CN115277934B (en) Communication terminal control method based on man-machine interaction
KR102151006B1 (en) Method for providing shopping information on each product and electronic device for executing the method
CN112492397A (en) Video processing method, computer device, and storage medium
CN111385595A (en) Network live broadcast method, live broadcast replenishment processing method and device, live broadcast server and terminal equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right

Effective date of registration: 20240319

Address after: Room 218, 2nd Floor, Building 30, No. 5 Jiangtai Road, Chaoyang District, Beijing, 100000

Applicant after: Beijing Xunyin Technology Co.,Ltd.

Country or region after: China

Address before: No. 2, 6th Floor, Building 6, No. 106, West Section of Jinkai Avenue, Yubei District, Chongqing 400000

Applicant before: Xu Xiangrong

Country or region before: China

TA01 Transfer of patent application right
GR01 Patent grant
GR01 Patent grant