CN111093034B

CN111093034B - Article searching method and electronic equipment

Info

Publication number: CN111093034B
Application number: CN201911424086.XA
Authority: CN
Inventors: 韩桂敏
Original assignee: Vivo Mobile Communication Co Ltd
Current assignee: Vivo Mobile Communication Co Ltd
Priority date: 2019-12-31
Filing date: 2019-12-31
Publication date: 2021-08-31
Anticipated expiration: 2039-12-31
Also published as: CN111093034A

Abstract

The embodiment of the invention provides an article searching method and electronic equipment, which are applied to the technical field of communication and can solve the problem of complex operation when the conventional electronic equipment is used for searching articles. The method comprises the following steps: displaying a shooting preview interface; under the condition that the preview image displayed in the shooting preview interface comprises a target object, displaying N article identifications in the shooting preview interface; each article identification indicates one article, the target object contains N articles indicated by the N article identifications, and N is a positive integer. The method and the device are applied to the scene of finding the article by using the electronic equipment.

Description

Article searching method and electronic equipment

Technical Field

The embodiment of the invention relates to the technical field of communication, in particular to an article searching method and electronic equipment.

Background

Along with the improvement of standard of living, the article in family are more and more, and when the user accomodates cupboard or case in the article arrangement in family after, when wanting to use again, often can forget the position that the article were deposited.

Currently, a user may record the storage location of an article in a text manner by using a notepad in an electronic device, so as to find the article later. When a user wants to search for an article, the user usually needs to search for a text describing the storage location of the article from the notebook, and then use the description in the text to search for the article at the corresponding location.

However, when a large number of characters describing the storage positions of various articles are stored in the notebook of the electronic device, the whole searching process is complicated and inefficient.

Disclosure of Invention

The embodiment of the invention provides an article searching method and electronic equipment, which can solve the problem of complex operation when the conventional electronic equipment is used for searching articles.

In order to solve the technical problem, the present application is implemented as follows:

in a first aspect, an embodiment of the present invention provides an article searching method, which is applied to an electronic device, and the method includes:

displaying a shooting preview interface;

under the condition that the preview image displayed in the shooting preview interface comprises a target object, displaying N article identifications in the shooting preview interface;

each article identification indicates one article, the target object contains N articles indicated by the N article identifications, and N is a positive integer.

In a second aspect, an embodiment of the present invention further provides an electronic device, where the electronic device includes:

the display module is used for displaying a shooting preview interface; and displaying N article identifiers in the shooting preview interface under the condition that the preview image displayed in the shooting preview interface comprises the target object;

In a third aspect, an embodiment of the present invention provides an electronic device, which includes a processor, a memory, and a computer program stored on the memory and executable on the processor, and when executed by the processor, the computer program implements the steps of the item searching method according to the first aspect.

In a fourth aspect, the present invention provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the steps of the item searching method according to the first aspect.

In the embodiment of the present invention, if the electronic device displays the shooting preview interface, the electronic device may display N item identifiers on the shooting preview interface when the shooting preview interface of the electronic device includes a target object that accommodates N items. Because every article sign is used for instructing an article, consequently, the user can find the article that wants to look for through the N article signs that electronic equipment shows fast for the user need not to open the target object, and alright look over all article that this target object accomodates, and then make whole article look up the process step simple and convenient, efficient.

Drawings

Fig. 1 is a schematic diagram of an architecture of a possible android operating system according to an embodiment of the present invention;

fig. 2 is a schematic flow chart of an article searching method according to an embodiment of the present invention;

fig. 3 is a schematic view of an interface applied by an article search method according to an embodiment of the present invention;

fig. 4 is a second schematic diagram of an interface applied in the article search method according to the embodiment of the present invention;

fig. 5 is a third schematic view of an interface applied in an article searching method according to an embodiment of the present invention;

fig. 6 is a fourth schematic view of an interface applied in the article search method according to the embodiment of the present invention;

fig. 7 is a fifth schematic view of an interface applied in the item searching method according to the embodiment of the present invention;

fig. 8 is a sixth schematic view of an interface applied in the item searching method according to the embodiment of the present invention;

fig. 9 is a seventh schematic view of an interface applied in an article searching method according to an embodiment of the present invention;

fig. 10 is a schematic diagram of an item searching method according to an embodiment of the present invention;

fig. 11 is an eighth schematic diagram of an interface applied in an article search method according to an embodiment of the present invention;

fig. 12 is a ninth schematic diagram illustrating an interface applied in an article search method according to an embodiment of the present invention;

fig. 13 is a tenth schematic diagram of an interface applied to an article search method according to an embodiment of the present invention;

fig. 14 is a schematic structural diagram of an electronic device according to an embodiment of the present invention;

fig. 15 is a second schematic structural diagram of an electronic device according to an embodiment of the invention.

Detailed Description

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

It should be noted that "/" in this context means "or", for example, A/B may mean A or B; "and/or" herein is merely an association describing an associated object, and means that there may be three relationships, e.g., a and/or B, which may mean: a exists alone, A and B exist simultaneously, and B exists alone.

It should be noted that "a plurality" herein means two or more than two.

It should be noted that, in the embodiments of the present invention, words such as "exemplary" or "for example" are used to indicate examples, illustrations or explanations. Any embodiment or design described as "exemplary" or "e.g.," an embodiment of the present invention is not necessarily to be construed as preferred or advantageous over other embodiments or designs. Rather, use of the word "exemplary" or "such as" is intended to present concepts related in a concrete fashion.

It should be noted that, for the convenience of clearly describing the technical solutions of the embodiments of the present invention, in the embodiments of the present invention, words such as "first" and "second" are used to distinguish the same items or similar items with substantially the same functions or actions, and those skilled in the art can understand that the words such as "first" and "second" do not limit the quantity and execution order. For example, the first input and the second input are for distinguishing different inputs, rather than for describing a particular order of inputs.

The execution subject of the item searching method provided in the embodiment of the present invention may be the electronic device (including a mobile electronic device and a non-mobile electronic device), or may also be a functional module and/or a functional entity capable of implementing the item searching method in the electronic device, which may be determined specifically according to actual use requirements, and the embodiment of the present invention is not limited. The following takes an electronic device as an example to exemplarily explain the item searching method provided by the embodiment of the present invention.

The electronic device in the embodiment of the invention can be a mobile electronic device or a non-mobile electronic device. The mobile electronic device may be a mobile phone, a tablet computer, a notebook computer, a palm computer, a vehicle-mounted terminal device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook or a Personal Digital Assistant (PDA), etc.; the non-mobile electronic device may be a Personal Computer (PC), a Television (TV), a teller machine, a self-service machine, or the like; the embodiments of the present invention are not particularly limited.

The electronic device in the embodiment of the present invention may be an electronic device having an operating system. The operating system may be an Android (Android) operating system, an ios operating system, or other possible operating systems, and embodiments of the present invention are not limited in particular.

The following describes a software environment applied to the article search method provided by the embodiment of the present invention, by taking an android operating system as an example.

Fig. 1 is a schematic diagram of an architecture of a possible android operating system according to an embodiment of the present invention. In fig. 1, the architecture of the android operating system includes 4 layers, which are respectively: an application layer, an application framework layer, a system runtime layer, and a kernel layer (specifically, a Linux kernel layer).

The application program layer comprises various application programs (including system application programs and third-party application programs) in an android operating system.

The application framework layer is a framework of the application, and a developer can develop some applications based on the application framework layer under the condition of complying with the development principle of the framework of the application.

The system runtime layer includes libraries (also called system libraries) and android operating system runtime environments. The library mainly provides various resources required by the android operating system. The android operating system running environment is used for providing a software environment for the android operating system.

The kernel layer is an operating system layer of an android operating system and belongs to the bottommost layer of an android operating system software layer. The kernel layer provides kernel system services and hardware-related drivers for the android operating system based on the Linux kernel.

Taking an android operating system as an example, in the embodiment of the present invention, a developer may develop a software program for implementing the article searching method provided in the embodiment of the present invention based on the system architecture of the android operating system shown in fig. 1, so that the article searching method may operate based on the android operating system shown in fig. 1. That is, the processor or the electronic device may implement the item searching method provided by the embodiment of the present invention by running the software program in the android operating system.

The following describes an article searching method according to an embodiment of the present invention with reference to a flowchart of the article searching method shown in fig. 2, where fig. 2 is a schematic flowchart of an article searching method according to an embodiment of the present invention, and includes steps 201 and 202:

step 201: the electronic equipment displays a shooting preview interface.

In this embodiment of the present invention, the shooting preview interface may be a preview interface of a front camera of the electronic device, may also be a preview interface of a rear camera of the electronic device, and may also be a preview interface of a front camera and a preview interface of a rear camera of the electronic device, which may be determined specifically according to actual use requirements, and this is not limited in this embodiment of the present invention.

Step 202; and in the case that the preview image displayed in the shooting preview interface comprises the target object, the electronic equipment displays N item identifications in the shooting preview interface.

In embodiments of the present invention, each item identifier is indicative of an item.

In an embodiment of the present invention, the target object contains N articles indicated by the N article identifiers. Wherein N is a positive integer.

In an embodiment of the present invention, the preview image is a real-time image obtained by the camera.

In the embodiment of the present invention, the target object may be a common furniture (for example, a wardrobe), a common electrical appliance (for example, a refrigerator), or an intelligent home device (for example, an intelligent wardrobe or an intelligent refrigerator), which is not limited in the embodiment of the present invention.

In the embodiment of the present invention, there may be one or more target objects, and the embodiment of the present invention is not limited to this. For example, when there are a plurality of targets, the N articles may be all articles stored in the plurality of targets, or may be some articles stored in the plurality of targets (for example, articles stored in one target).

In the embodiment of the present invention, the identifier in the present application may include at least one of the following: text, image, voice. For example, if the above-mentioned mark is a character, the mark may be an article name; if the mark is an image, the mark may be an image of the article.

In the embodiment of the present invention, the identifier in the present application may be a tag, for example, the tag may be an Augmented Reality (AR) tag, and the AR tag may include text or an image. Illustratively, the AR tag may be: and the electronic equipment superposes and displays the tag generated based on the AR technology on the real picture in the shooting preview interface.

In the embodiment of the present invention, the article in the embodiment of the present invention may be a daily product (e.g., a towel, clothes, etc.), an electronic product (e.g., a usb disk, a camera, etc.), and food (e.g., vegetables, fruits, etc.), and the embodiment of the present invention is not limited thereto.

In one example, the N articles may be the same type of article (e.g., the N articles may all be skirts) or may be associated articles (e.g., matched skirts, shoes, and bags).

For example, one or more identifiers may be used in the embodiment of the present invention, and the embodiment of the present invention is not limited thereto.

Optionally, in the embodiment of the present invention, the electronic device may display the N item identifiers on areas where the N items are located in the shooting preview interface, respectively.

Illustratively, the identifier is used to indicate the positions of the N items in the shooting preview interface.

For example, taking a target object as an intelligent wardrobe as an example, as shown in fig. 3, when a user opens a camera of an electronic device to scan the intelligent wardrobe, a preview image of the intelligent wardrobe is displayed in a display shooting preview interface of the electronic device.

Example 1, as shown in fig. 3 (a), the electronic device may display 5 storage item AR tags around the smart wardrobe in the shooting preview interface (i.e., 31 in fig. 3 (a)), the 5 storage item AR tags being an item name of facial cleanser "and an item image (i.e., 32 in fig. 3 (a)), an item name of hat" and an item image (i.e., 33 in fig. 3 (a)), an item name of comb "and an item image (i.e., 34 in fig. 3 (a)), an item name of comb" and an item image of comb "(i.e., 35 in fig. 3 (a)), an item name of cosmetic brush" and an item image (i.e., 35 in fig. 3 (a)), and an item name of skirt "and an item image (i.e., 36 in fig. 3 (a)).

Example 2, as shown in fig. 3 (b), the electronic device may display the AR tags of the 5 stored items at the positions of the 5 stored items on the smart wardrobe in the shooting preview interface (i.e., 31 in fig. 3 (b)), where the AR tags of the 5 stored items are the item name "facial cleanser" and the item image of facial cleanser (i.e., 32 in fig. 3 (b)), the item name "hat" and the item image of hat (i.e., 33 in fig. 3 (b)), the item name "comb" and the item image of comb (i.e., 34 in fig. 3 (b)), the item name "cosmetic brush" and the item image of cosmetic brush (i.e., 35 in fig. 3 (b)), and the item name "skirt" and the item image of skirt (i.e., 36 in fig. 3 (b)), respectively.

Optionally, in the embodiment of the present invention, the electronic device may display the above-mentioned N item identifiers according to a predetermined display effect to prompt the user of the current states of the N items.

Illustratively, the step 202 may specifically include the following step 202 a:

step 202 a: in the shooting preview interface, the electronic device displays N article identifiers according to the article placement information of the N articles with a preset display effect.

Illustratively, the article placement information includes at least one of: the article placement time, the article position information and the article placement environment.

Illustratively, the predetermined display effect includes at least one of: frozen, highlighted and enlarged.

Example 1, if the predetermined display effect is ice seal. The electronic equipment can render the ice sealing effect on the N article identifications, and can also distinguish different ice sealing degrees according to the unused time length of the articles, wherein the unused time length of the articles is in direct proportion to the ice sealing degree.

For example, taking an electronic device as an intelligent wardrobe as an example, as shown in fig. 3 and in combination with the intelligent wardrobe, as shown in fig. 4, the electronic device acquires the use time of the facial cleanser, the hat, the comb, the cosmetic brush, and the skirt, and determines that the facial cleanser and the comb are not used for a long time, the electronic device may display the AR tag 32 corresponding to the facial cleanser and the AR tag 34 corresponding to the comb on the preview image 31 of the intelligent wardrobe according to the ice-sealing effect.

Example 2, if the predetermined display effect is highlight. When N article are food, electronic equipment can also come the fresh degree of rendering food according to the shelf life of food to help the user more directly perceivedly know the article state, in time eat article.

For example, taking an electronic device as an intelligent refrigerator as an example, as shown in fig. 5, when a user turns on a camera of the electronic device to scan the intelligent refrigerator, a preview image (i.e., 41 in fig. 5) of the intelligent refrigerator is displayed in a screen of the electronic device, the electronic device displays 4 items-in-storage AR tags on the preview image 41, and the 4 items-in-storage AR tags are respectively an item name "cake" and an item image (i.e., 42 in fig. 5) of a cake, an item name "fish" and an item image (i.e., 43 in fig. 5) of a fish, an item name "tomato" and an item image (i.e., 44 in fig. 5) of a tomato, and an item name "strawberry" and an item image (i.e., 45 in fig. 5) of a strawberry. In combination with an intelligent refrigerator, the electronic device obtains the quality guarantee periods of cakes, fish, tomatoes and strawberries, judges the freshness of the cakes, the fish, the tomatoes and the strawberries to render based on the current scanning moment, displays three stars on the area where the cakes are located in the shooting preview interface 41 according to the freshness, displays two stars on the area where the cakes are located in the shooting preview interface 41, displays four stars on the area where the strawberries are located in the shooting preview interface 41, and displays characters 'suggest eating as soon as possible' on the area where the fishes are located in the shooting preview interface 41.

It should be noted that the number of stars is used to indicate the freshness of the food (e.g., from zero to 5 stars), wherein more stars indicates that the food is fresher.

The article searching method provided by the embodiment of the invention can be applied to a scene of rendering articles according to article placement information, and the electronic equipment can display the N articles with different display effects, so that a user can be prompted about the placement duration, the placement position or the placement environment of different articles.

Optionally, in this embodiment of the present invention, after receiving a left-slide input and a right-slide input of the user on the screen of the electronic device, the electronic device may switch to display the identifiers of the different items on the screen of the electronic device.

According to the item searching method provided by the embodiment of the invention, if the electronic equipment displays the shooting preview interface, under the condition that the shooting preview interface of the electronic equipment contains the target objects containing N items, the electronic equipment can display N item identifiers on the shooting preview interface, and each item identifier is used for indicating one item. Therefore, the user can quickly find the object to be searched through the N object identifiers displayed by the electronic equipment, so that the user can check all objects accommodated by the target object without opening the target object, and the whole object searching process is simple and efficient.

Optionally, in the embodiment of the present invention, the electronic device may mark the target object in advance, and then perform comparison according to the mark when the shooting preview interface includes the target object.

Illustratively, before the step 201, the method further includes the following step a 1:

step A1: and the electronic equipment identifies the target object and generates an identifier corresponding to the target object.

Illustratively, the tags described above may include at least one of: name of the target object, image of the target object.

For example, the electronic device may capture an image of the target object through a camera and then identify the target object. The camera in the embodiment of the present invention may be a front camera of the electronic device, a rear camera of the electronic device, or an external camera of the electronic device, which is not limited in the embodiment of the present invention.

For example, the electronic device may generate the identifier for the target object through a smart graph recognition (image recognition) technique. For example, the identification corresponding to the target object may be an AR tag.

For example, taking the target object as an intelligent wardrobe as an example, as shown in fig. 6, a user may open a camera of an electronic device, enter an AR scanning interface (i.e., 51 in fig. 6), and scan the intelligent wardrobe using the camera, after the scanning and the identification are successful, the electronic device generates an AR tag for the intelligent wardrobe, where the AR tag includes a name "wardrobe" of the intelligent wardrobe and an image of the intelligent wardrobe, and displays an "enter" key (i.e., 52 in fig. 6).

The article searching method provided by the embodiment of the invention can be applied to a scene of generating the corresponding identification of the target object, and when the shooting preview interface contains the target object, the electronic equipment can perform comparison according to the identification so as to determine the target object.

Further optionally, in an embodiment of the present invention, after the step a1, the method further includes the following step a 2:

step A2: and the electronic equipment uploads the information of the target object to a server.

In the embodiment of the present invention, the information of the target object may include identification information and location information of the target object. The position information comprises the position of the target object and the surrounding distance of the target object.

Illustratively, the information of the target object stored in the server is downloaded by other electronic devices through accessing the server.

In an example, the identification information of the target object may further include time information, where the time information may be a time when the electronic device identifies the target object, or a time when the electronic device generates a corresponding identification of the target object.

For example, the Location information of the target object may be Location Based Service (LBS) Location.

For example, the electronic device may obtain the position information of the target object through an AR technology based on instantaneous positioning and mapping (SLAM).

It should be noted that, the electronic device records position information of the target object, and when the target object is identical in appearance to another object, the electronic device may determine the target object through the position information, and display N article identifiers stored in the target object.

For example, the server in the embodiment of the present invention may be a cloud server, and the server may be accessed through the same electronic device or through different electronic devices.

The article searching method provided by the embodiment of the invention can be applied to a scene of sharing the target object, and the electronic equipment can upload the identifier corresponding to the target object to the server so as to share the identifier to other users.

Optionally, in the embodiment of the present invention, the electronic device may perform identification marking on the N articles, that is, generate the N article identifications, and may be generated in at least two possible implementation manners, where a specific scheme is as follows.

In a first possible implementation (active generation):

for example, before displaying N item identifiers in the shooting preview interface in step 202, the method may further include the following steps 202b and 202 c:

step 202 b: the electronic equipment acquires a first image acquired by the camera.

Illustratively, the first image includes the N articles.

Step 202 c: the electronic device identifies the item features of the N items in the first image and generates the N item identifiers.

For example, the first image and the preview image each include a target object, each item identifier corresponds to position information of an item, and each item identifier is used to indicate a storage position of the corresponding item.

Illustratively, the above-mentioned identification may comprise at least one of: item name, item image.

For example, the electronic device may identify any one of the N articles by a smart recognition (image recognition) technique to obtain an identification result, where the identification result is used to indicate an article name of the any one article.

In one example, in the process of identifying the N items by the electronic device, the electronic device may display an identification progress bar, and the identification progress bar may prompt the user that the electronic device identifies the progress of the N items.

Illustratively, when the electronic device uses the camera to capture the first image including the N items, the item pictures of the N items may also be obtained.

For example, taking the target object as an intelligent wardrobe as an example, in conjunction with fig. 6, if the user wants to mark the articles stored in the intelligent wardrobe, the user may click the "enter" button, and at this time, as shown in fig. 7, the electronic device displays a stored article entry interface (i.e., 61 in fig. 7), and a "complete" button (i.e., 62 in fig. 7) and a "stored article" list (i.e., 63 in fig. 7) are displayed on the interface 61. The stored article list 63 displays article names "face wash", "hat", "comb", and "cosmetic brush" of stored articles that have been successfully scanned and identified by the electronic apparatus, and thumbnails of these 4 article images. At this time, the electronic device may perform AR scanning on a certain storage article, the electronic device may display a recognition progress bar (i.e., 64 in fig. 7) when the scanning is started, and the electronic device may recognize the certain storage article by using a smart recognition technology. When the electronic device successfully identifies the certain storage article, an AR tag can be automatically generated and marked for the identified certain storage article, as shown in fig. 8, the certain storage article is identified as a skirt through the electronic device, and simultaneously, the name of the article "skirt" and the image of the article added by scanning are synchronously updated and displayed in the storage article list 63 on the right side of the storage article entry interface 61. When the electronic device has completed scanning and identifying all of the desired items to be entered, the user may click the "done" button 62.

In a second possible implementation (passive generation):

for example, before displaying N item identifiers in the shooting preview interface in the step 202, the method may further include the following steps B1 and B2:

step B1: and under the condition that the camera of the electronic equipment collects the N articles, the electronic equipment receives a third input aiming at the N articles from the user.

Illustratively, the third input described above may be a third operation.

For example, the third input may specifically include: the input of the user in the text box or the voice instruction input by the user may be determined specifically according to actual use requirements, which is not limited in the embodiment of the present invention.

Step B2: and responding to the third input, and generating the N item identifications by the electronic equipment.

For example, the item identifier may include a word (e.g., an item name) entered by the user through a text box.

For example, the electronic device may collect each of the N articles respectively.

For example, referring to fig. 7, after the electronic device successfully identifies the certain storage article, a text box may pop up on the storage article entry interface 61, so that the user may manually input a text (e.g., a skirt) related to the certain storage article, and the electronic device may generate an AR tag of the certain storage article for marking. By analogy, the electronic equipment marks all the stored articles.

The article searching method provided by the embodiment of the invention can be applied to a scene of generating article identifiers, the electronic equipment can automatically generate the N article identifiers, or a user can manually mark the N article identifiers, so that when the user wants to search for articles, the electronic equipment can display the N article identifiers, and the user can quickly search for articles through the identifiers displayed by the electronic equipment.

Further optionally, in the embodiment of the present invention, if the user wants to enable another user to search for an item through the electronic device, the user may share the marked item through the electronic device.

Illustratively, after the step 202a2, the method may further include the step 202d of:

step 202 d: and the electronic equipment uploads the information of the N articles to a server.

Illustratively, the information for each item includes identification information and location information for the corresponding item.

Illustratively, the information of the articles stored in the server is downloaded by other electronic devices through accessing the server.

For example, after the electronic device uploads the information of the N items to the server, the electronic device may set access rights for the information of the N items. The electronic device with access right in other electronic devices can access the server to acquire the information of the N articles, while the electronic device without access right cannot access the server and cannot acquire the information of the N articles.

For example, the electronic device with access right may download the information of the N items while accessing the information of the N items.

In an example, the information of the N items may further include time information, where the time information may be a time when the electronic device scans the N items, or a time when the electronic device generates N item identifiers.

For example, the Location information of the N items may be Location Based Service (LBS) Location.

For example, the electronic device may obtain the location information of the N items through an AR technology based on instantaneous location and mapping (SLAM).

For example, the electronic device may upload, to the server, user information and authorization information in addition to the information about the N items. Wherein the user information is used to access the server, and the authorization information includes authorized user information.

For example, the user information may include a user name and a password, and the user may perform item lookup through any electronic device.

In one example, the electronic device may upload an image of a target object, LBS location, a list of stored items, user information, and authorization information to the cloud server, when other users want to search for items, the other users may start an "item search" function of the electronic device, and then may scan the target object again at the same location using other electronic devices, at this time, the other electronic devices may upload the acquired image of the target object, LBS location, and user information of the other users to the cloud server for matching, if the user information of the other users matches with the authorized user information prestored in the server, the image of the target object and the LBS location are matched, and if the matching is successful, the other electronic devices may download the N item identifiers of the target object from the cloud server, and displaying the N item identifications on a shooting preview interface of the electronic equipment.

The article searching method provided by the embodiment of the invention can be applied to a scene of sharing article identification, the electronic equipment can conveniently check the articles contained in the target object by scanning the target object under the condition that the target object is not opened by a user and other users by uploading the information of the N articles to the server, and a more vivid article management platform is provided for other users.

Further optionally, in the embodiment of the present invention, after the electronic device displays the N item identifiers, if a user or another user takes out a certain item or transfers the certain item to another placement location, the N item identifiers may be adjusted by the electronic device.

Illustratively, based on the step 202d, after the step 202, the method may further include the following steps 203 and 204:

step 203: the electronic equipment receives a first input that a user drags a first mark in the N item marks to a target area.

Illustratively, the first input described above may be a first operation.

Illustratively, the first input may include: the specific gesture input by the user may be determined according to actual use requirements, and the embodiment of the present invention does not limit this.

The specific gesture in the embodiment of the invention can be any one of a single-click gesture, a sliding gesture, a dragging gesture, a pressure identification gesture, a long-press gesture, an area change gesture, a double-press gesture and a double-click gesture; the click input in the embodiment of the invention can be single click input, double click input or click input of any times, and can also be long-time press input or short-time press input; the drag input in the embodiment of the present invention may be a drag input in any direction, for example, a clockwise drag, a counterclockwise drag, an upward drag, a downward drag, a leftward drag, or a rightward drag. The concrete can be set according to actual requirements.

In an example, the first input may be a drag input that a user drags a first identifier of the N item identifiers to an edge of the screen.

Illustratively, the target area may be any area of a shooting preview interface of the electronic device. For example, the target area may be an edge area of the electronic device.

Step 204: and responding to the first input, the electronic equipment removes the first identification and sends a first control message to the server.

For example, the first control message is used to instruct the server to delete the information of the first item corresponding to the first identifier.

For example, the information of the first item may include identification information and location information of the first item.

For example, taking the target object as an intelligent wardrobe as an example, as shown in (a) in fig. 3, when a user opens a camera of an electronic device to scan the intelligent wardrobe, a shooting preview interface 31 of the intelligent wardrobe is displayed in a screen of the electronic device, and the electronic device displays, on the shooting preview interface 31, AR tags of 5 storage articles, where the AR tags of the 5 storage articles are respectively an article name "facial cleanser", "hat", "comb", "cosmetic brush", and "skirt", and an article image corresponding to the 5 storage articles. The electronic device also displays a "+" key (i.e., 37 in (a) of fig. 3) and a "-" key (i.e., the above-mentioned target key, such as 38 in (a) of fig. 3) on the shooting preview interface 31, wherein the "+" key 37 is used for adding the identifier, and the "-" key 38 is used for removing the identifier. When a user places a new article in the intelligent wardrobe, the user can click the '+' button 37, the electronic device can display an article storage entry interface, namely the electronic device can open the camera, perform AR scanning on the new article, generate an AR label of the new article, and upload the AR label and LBS positioning of the new article to the server. After the user takes the skirt, the user can click the' key 38, then the user can press the AR label of the skirt and drag the AR label to the edge area of the screen of the electronic device, and after the finger of the user slides out of the screen, the electronic device can remove the AR label of the skirt and send a deletion instruction to the server, and after the server receives the deletion instruction, the AR label corresponding to the skirt and LBS positioning can be deleted.

The article searching method provided by the embodiment of the invention can be applied to a scene of updating the article identification, when a user takes an article from a target object, the user can trigger the electronic equipment to remove the article identification corresponding to the article, synchronously delete the identification information corresponding to the article stored in the server, and update the material library of the target object stored in the server for accommodating the article.

Optionally, in the embodiment of the present invention, the electronic device may recommend the relevant items to the user through the collected popularity trend or the collocation habit of the user.

Illustratively, after the step 202, the method may further include the following steps 205 and 206:

step 205: and the electronic equipment receives a second input of a second identifier in the N item identifiers from the user.

Illustratively, the second input described above may be a second operation.

For example, the second input may include: the specific gesture input by the user may be determined according to actual use requirements, and the embodiment of the present invention does not limit this.

Step 206: and responding to the second input, and displaying the target identification in the area where the second article is located in the shooting preview interface by the electronic equipment.

For example, the second article is: and the articles in the N articles are related to the articles corresponding to the second identification.

For example, the target identifier is used to indicate the second item.

For example, the item related to the item corresponding to the second identifier and the item corresponding to the second identifier may establish a connection through dimensions such as item type, applicable season, applicable gender, applicable age, and the like. For example, an identification association database may be provided in the cloud server.

For example, the electronic device may display target identifiers with different colors on an area where the second identifier corresponds to the article in the shooting preview interface and an area where the second article is located, which is not limited in the embodiment of the present invention. For example, the electronic device displays a red target identifier on an area where the second identifier corresponds to the article in the shooting preview interface, and displays a green target identifier on the area where the second article is located in the shooting preview interface.

For example, the target identifier may be a selection box, a number, or a character, and may be specifically set according to actual requirements, which is not limited in the embodiment of the present invention.

For example, taking the target identifier as a rectangular selection frame as an example, with reference to (a) in fig. 3, after the user clicks the AR tag of the "skirt", as shown in fig. 9, the electronic device may display a rectangular frame (i.e., 39 in fig. 9) in the area where the skirt is located in the shooting preview interface 31 of the intelligent wardrobe, and may also display a rectangular frame (i.e., 40 in fig. 9) in the area where the hat is located in the shooting preview interface of the intelligent wardrobe, so as to recommend the hat collocated with the skirt to the user, thereby assisting the user to carry out collocation quickly.

The article searching method provided by the embodiment of the invention can be applied to a scene that the electronic equipment recommends articles for the user, and the electronic equipment can recommend other articles related to the article to the user after the user selects one article, so that the searching efficiency of the user is improved.

Optionally, in the embodiment of the present invention, when the user finds an item to be found out of the N items displayed by the electronic device, a cabinet door or a drawer, etc. of a target object storing the item may be opened by the electronic device.

Illustratively, after the step 202, the method may further include the following steps 207 and 208:

step 207: and under the condition that the target object is intelligent home equipment and the electronic equipment is in communication connection with the intelligent home equipment, the electronic equipment receives third input of a user on a third identifier in the N article identifiers.

Illustratively, the third input described above may be a third operation.

Illustratively, the third input may include: the click input by the user for the target identifier, or the voice instruction input by the user, or the specific gesture input by the user may be determined according to the actual use requirement, which is not limited in the embodiment of the present invention.

Step 208: and responding to the third input, and the electronic equipment sends a second control message to the intelligent household equipment.

Illustratively, the second control message includes the third identifier, and the second control message is used for controlling the smart home device based on the third identifier.

The article searching method provided by the embodiment of the invention can be applied to a scene that the electronic equipment controls the intelligent household equipment, and the electronic equipment can send the second control message to the intelligent household equipment so as to realize automatic control of the intelligent household equipment.

Further optionally, in the embodiment of the present invention, the electronic device may control the smart home device to open a cabinet door or a drawer for accommodating a target object of the item.

For example, based on the step 208, the controlling the smart home device based on the third identifier may specifically include the following step 208 a:

step 208 a: and the electronic equipment controls the intelligent household equipment to open or close the household part corresponding to the third identifier.

In example 1, if the smart home device is a smart wardrobe, the home component may be a cabinet door of the smart wardrobe or a drawer. The above-mentioned smart home devices of control include at least one of: the cabinet door of the intelligent wardrobe is opened, the cabinet door of the intelligent wardrobe is closed, the drawer of the intelligent wardrobe is opened, and the drawer of the intelligent wardrobe is closed.

In example 2, if the smart home device is a smart refrigerator, the home component may be a cabinet door of the smart refrigerator. The above-mentioned smart home devices of control include at least one of: and opening the cabinet door of the intelligent refrigerator and closing the cabinet door of the intelligent refrigerator.

For example, taking a target object as an intelligent wardrobe as an example, with reference to fig. 3, 5 AR tags for storing articles are displayed on a shooting preview interface 31 of the wardrobe by the electronic device, and if a user finds a skirt to be searched, the user can press the AR tag of the skirt for a long time, as shown in fig. 10, the electronic device can control the intelligent wardrobe to open the cabinet door.

The article searching method provided by the embodiment of the invention can be applied to a scene that the electronic equipment controls the intelligent household equipment, and the user can control the intelligent household equipment through the electronic equipment, so that the actual position of the article corresponding to the target identifier on the intelligent household equipment can be quickly positioned, and the user does not need to open or close the household part of the intelligent household equipment, thereby saving the time for the user to search the article and improving the efficiency for the user to search the article.

Optionally, in the embodiment of the present invention, when a plurality of articles are accommodated in the target object, the user may quickly search for the article to be found through the electronic device.

In one example, after the step 202, the method may further include the following steps 211 and 212:

step 211: and in the case that the shooting preview interface comprises an item search area, the electronic equipment receives a fifth input of the item search area by the user.

Illustratively, the fifth input described above may be a fifth operation.

Illustratively, the fifth input may include: the click input of the user for the item search area, or the voice instruction input by the user, or the specific gesture input by the user may be specifically determined according to the actual use requirement, which is not limited in the embodiment of the present invention.

Step 212: and responding to the fifth input, and displaying the item identification corresponding to the first item information input by the fifth input by the electronic equipment.

For example, the item identifier corresponding to the first item information is an item identifier of an item that is received by the user in the item search area.

For example, the item search area may be displayed in a floating manner on the photographing preview interface.

For example, the item search area may also be moved on the photographing preview interface as the user's finger moves.

For example, text or voice information may be inputted in the item search area. The item search area is used for triggering the electronic equipment to retrieve the information input in the item search area.

In another example, before the electronic device displays N item identifiers in the shooting preview interface in the step 202, the method may further include the following steps C1 and C2:

step C1: in a case where the item search area is included in the above-mentioned photographing preview interface, the electronic device receives a sixth input of the user in the item search area.

For example, the sixth input may be a sixth operation.

Illustratively, the sixth input may include: the click input of the user for the item search area, or the voice instruction input by the user, or the specific gesture input by the user may be specifically determined according to the actual use requirement, which is not limited in the embodiment of the present invention.

Step C2: and responding to the sixth input, and displaying the N item identifications by the electronic equipment in the shooting preview interface.

Illustratively, the above-mentioned N item identifiers are item identifiers of items entered by the user in the item search area.

The article searching method provided by the embodiment of the invention can be applied to a scene of quickly searching articles, and the electronic equipment can input the articles to be searched through the article searching area, so that a user can quickly search the articles to be searched.

Further optionally, in the embodiment of the present invention, after the step C2, the method further includes the following steps C3 and C4:

step C3: the electronic device receives a seventh input of a fourth one of the N item identifiers.

Step C4: in response to the seventh input, the electronic device displays an item detail interface.

Illustratively, the seventh input described above may be a seventh operation.

Illustratively, the seventh input may include: the click input by the user for the fourth identifier, or the voice instruction input by the user, or the specific gesture input by the user may be specifically determined according to the actual use requirement, which is not limited in the embodiment of the present invention.

Illustratively, the item detail interface described above includes: and fourthly, identifying the article image of the corresponding article and the image of the target object.

For example, after the user inputs the text "skirt" in the search box of the shooting preview interface, as shown in fig. 11, a screen (i.e., 71 in fig. 11) of the electronic device displays a search box (i.e., 72 in fig. 11) and 4 AR tags, where the name "skirt" of the article to be searched and input by the user is displayed in the search box 72, and all the articles corresponding to the 4 AR tags are skirt, and when the user finds the skirt to be searched, the AR tag corresponding to the skirt (i.e., the third identifier described above) can be clicked. At this time, as shown in fig. 12, the electronic device displays an article detail interface (i.e., 81 in fig. 12) of the skirt, and an image of the skirt and an image of the stored intelligent wardrobe are displayed on the article detail interface 81.

The article searching method provided by the embodiment of the invention can be applied to a scene of displaying a target object for accommodating an article and the article, and the electronic equipment can prompt a user of a specific placement position of the article to be searched through an article detail display interface, so that the user can be assisted in quick positioning, and the searching efficiency is improved.

For example, the item detail interface described above may also include specific placement location information in the target object. For example, in conjunction with fig. 12, the electronic device may also display the text "skirt second layer on left side of wardrobe" on the item detail interface.

It should be noted that, when the target object is an intelligent home device, the electronic device may control the intelligent home device while displaying the item detail interface.

Optionally, in the embodiment of the present invention, after the electronic device displays the N item identifiers, a shooting preview interface for displaying N items may be used as an entry for displaying all item identifiers stored in the electronic device.

Illustratively, after the step 202, the method may further include the following steps 209 and 210:

step 209: the electronic device receives a fourth input from the user.

Illustratively, the fourth input described above may be a fourth operation.

Illustratively, the fourth input may include: the click input of the user on the screen of the electronic device, or the voice instruction input by the user, or the specific gesture input by the user may be determined according to the actual use requirement, which is not limited in the embodiment of the present invention.

Step 210: and responding to the fourth input, and displaying all the item identifications stored in the electronic equipment by the electronic equipment.

Illustratively, the electronic device displays all item identifiers described above on the target interface.

For example, an AR map may be displayed on the target interface, where the AR map includes all item identifiers described above.

For example, referring to fig. 3, after the electronic device displays the AR tags of 5 stored items on the shooting preview interface 31, if the user wants to view all the items stored in the electronic device, the user may press the screen of the electronic device for a long time. At this time, as shown in fig. 13, the electronic device displays the AR map on the article presentation interface (i.e., the above-mentioned target interface, such as 91 in fig. 13). The AR map displays the AR tags of 8 storage items and 1 search box (i.e., 92 in fig. 13). The AR labels of the 8 stored articles are respectively the article names "facial cleanser", "hat", "comb", "cosmetic brush", and 3 "skirt", and the article images corresponding to the 8 stored articles. And the 8 storage articles can be displayed in a manner of being large or small according to the LBS positioning and the distance from the user.

The article searching method provided by the embodiment of the invention can be applied to a scene of displaying all articles, and the electronic equipment can sequentially display the article identifications of all articles stored in the electronic equipment from near to far according to the physical distance, so that a user can conveniently search the articles.

Fig. 14 is a schematic structural diagram of an electronic device according to an embodiment of the present invention, and as shown in fig. 14, the electronic device 600 includes: the display module 601, is used for displaying and shooting the preview interface; and displaying N article identifiers in the shooting preview interface under the condition that the preview image displayed in the shooting preview interface comprises the target object; each article identification indicates one article, the target object contains N articles indicated by the N article identifications, and N is a positive integer.

Optionally, as shown in fig. 14, the electronic device 600 further includes: an obtaining module 602 and an executing module 603, wherein: the acquiring module 602 is configured to acquire a first image acquired by a camera; the executing module 603 is configured to identify the item features of the N items in the first image acquired by the acquiring module 602, and generate the N item identifiers; the first image and the preview image both comprise target objects, each article identifier corresponds to position information of one article, and each article identifier is used for indicating a storage position of the corresponding article.

Optionally, as shown in fig. 14, the electronic device 600 further includes: an upload module 604, wherein: the upload module 604 is configured to upload information of the N articles to a server, where the information of each article includes identification information and location information of a corresponding article; wherein, the information of the articles stored in the server is downloaded by other electronic equipment through accessing the server.

Optionally, as shown in fig. 14, the electronic device 600 further includes: a receiving module 605, wherein: the receiving module 605 is configured to receive a first input that a user drags a first identifier of the N item identifiers to a target area; the executing module 603 is further configured to remove the first identifier in response to the first input received by the receiving module 605, and send a first control message to the server, where the first control message is used to instruct the server to delete the information of the first item corresponding to the first identifier.

The article searching method provided by the embodiment of the invention can be applied to a scene of updating the article identification, when a user takes an article from a target object, the user can trigger the electronic equipment to remove the article identification corresponding to the article, synchronously delete information corresponding to the article stored in the server, and update the material library of the target object stored in the server, wherein the material library is used for storing articles.

Optionally, as shown in fig. 14, the electronic device 600 further includes: a receiving module 605, wherein: the receiving module 605 is configured to receive a second input of a second identifier of the N item identifiers from the user; the display module 601 is further configured to respond to the second input received by the receiving module 605, and display a target identifier in an area where a second item is located in the shooting preview interface; wherein the second article is: the object identifier is used for indicating the second object, and the object identifier is related to the object corresponding to the second identifier in the N objects.

Optionally, as shown in fig. 14, the electronic device 600 further includes: a receiving module 605 and an executing module 603, wherein: the receiving module 605, when the target object is an intelligent home device and the electronic device is in communication connection with the intelligent home device, receives a third input of a third identifier of the N article identifiers from a user; the executing module 603 is configured to send, in response to the third input received by the receiving module 605, a second control message to the smart home device, where the second control message includes the third identifier, and the second control message is used to control the smart home device based on the third identifier.

Optionally, the executing module 603 is specifically configured to control the smart home device to turn on or turn off the home component corresponding to the third identifier.

Optionally, as shown in fig. 14, the electronic device 600 further includes: a receiving module 605, wherein: the receiving module 605 is configured to receive a fourth input from the user; the display module 601 is further configured to display all item identifiers stored in the electronic device in response to the fourth input received by the receiving module 605.

Optionally, as shown in fig. 14, the electronic device 600 further includes: a receiving module 605, wherein: the receiving module 605 is configured to receive a fifth input of the item search area from the user when the shooting preview interface includes the item search area; the display module 601 is further configured to respond to the fifth input received by the receiving module 605, and display an item identifier corresponding to the first item information input by the fifth input.

Optionally, as shown in fig. 14, the display module 601 is specifically configured to display N item identifiers in the shooting preview interface according to the item placement information of the N items with a preset display effect; wherein the item placement information includes at least one of: the article placement time, the article position information and the article placement environment.

It should be noted that, as shown in fig. 14, modules that are necessarily included in the electronic device 600 are illustrated by solid line boxes, such as a display module 601; modules that may or may not be included in the electronic device 600 are illustrated with dashed boxes as the receiving module 605.

According to the electronic device provided by the embodiment of the invention, if the electronic device displays the shooting preview interface, under the condition that the shooting preview interface of the electronic device contains the target objects containing N articles, the electronic device can display N article identifiers on the shooting preview interface, and each article identifier is used for indicating one article. Therefore, the user can quickly find the object to be searched through the N object identifiers displayed by the electronic equipment, so that the user can check all objects accommodated by the target object without opening the target object, and the whole object searching process is simple and efficient.

The electronic device provided by the embodiment of the present invention can implement each process implemented by the electronic device in the above method embodiments, and is not described herein again to avoid repetition.

Fig. 15 is a schematic diagram of a hardware structure of an electronic device 100 for implementing various embodiments of the present invention, where the electronic device 100 includes, but is not limited to: radio frequency unit 101, network module 102, audio output unit 103, input unit 104, sensor 105, display unit 106, user input unit 107, interface unit 108, memory 109, processor 110, and power supply 111. Those skilled in the art will appreciate that the configuration of electronic device 100 shown in fig. 15 does not constitute a limitation of the electronic device, and that electronic device 100 may include more or fewer components than shown, or combine certain components, or a different arrangement of components. In the embodiment of the present invention, the electronic device 100 includes, but is not limited to, a mobile phone, a tablet computer, a notebook computer, a palm computer, a vehicle-mounted terminal device, a wearable device, a pedometer, and the like.

The display unit 106 is configured to display a shooting preview interface; and displaying N article identifiers in the shooting preview interface under the condition that the preview image displayed in the shooting preview interface comprises the target object; each article identification indicates one article, the target object contains N articles indicated by the N article identifications, and N is a positive integer.

It should be understood that, in the embodiment of the present invention, the radio frequency unit 101 may be used for receiving and sending signals during a message transmission or call process, and specifically, after receiving downlink data from a base station, the downlink data is processed by the processor 110; in addition, the uplink data is transmitted to the base station. Typically, radio frequency unit 101 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency unit 101 can also communicate with a network and other devices through a wireless communication system.

The electronic device 100 provides wireless broadband internet access to the user via the network module 102, such as assisting the user in sending and receiving e-mails, browsing web pages, and accessing streaming media.

The audio output unit 103 may convert audio data received by the radio frequency unit 101 or the network module 102 or stored in the memory 109 into an audio signal and output as sound. Also, the audio output unit 103 may also provide audio output related to a specific function performed by the electronic apparatus 100 (e.g., a call signal reception sound, a message reception sound, etc.). The audio output unit 103 includes a speaker, a buzzer, a receiver, and the like.

The input unit 104 is used to receive an audio or video signal. The input Unit 104 may include a Graphics Processing Unit (GPU) 1041 and a microphone 1042, and the Graphics processor 1041 processes image data of a still picture or video obtained by an image capturing device (e.g., a camera) in a video capturing mode or an image capturing mode. The processed image frames may be displayed on the display unit 106. The image frames processed by the graphic processor 1041 may be stored in the memory 109 (or other storage medium) or transmitted via the radio frequency unit 101 or the network module 102. The microphone 1042 may receive sound and may be capable of processing such sound into audio data. The processed audio data may be converted into a format output transmittable to a mobile communication base station via the radio frequency unit 101 in case of a phone call mode.

The electronic device 100 also includes at least one sensor 105, such as a light sensor, motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor that can adjust the brightness of the display panel 1061 according to the brightness of ambient light, and a proximity sensor that can turn off the display panel 1061 and/or the backlight when the electronic device 100 is moved to the ear. As one type of motion sensor, an accelerometer sensor can detect the magnitude of acceleration in each direction (generally three axes), detect the magnitude and direction of gravity when stationary, and can be used to identify the posture of an electronic device (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), and vibration identification related functions (such as pedometer, tapping); the sensors 105 may also include fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc., which are not described in detail herein.

The display unit 106 is used to display information input by a user or information provided to the user. The Display unit 106 may include a Display panel 1061, and the Display panel 1061 may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like.

The user input unit 107 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the electronic apparatus 100. Specifically, the user input unit 107 includes a touch panel 1071 and other input devices 1072. Touch panel 1071, also referred to as a touch screen, may collect touch operations by a user on or near the touch panel 1071 (e.g., operations by a user on or near touch panel 1071 using a finger, stylus, or any suitable object or attachment). The touch panel 1071 may include two parts of a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 110, and receives and executes commands sent by the processor 110. In addition, the touch panel 1071 may be implemented in various types, such as a resistive type, a capacitive type, an infrared ray, and a surface acoustic wave. In addition to the touch panel 1071, the user input unit 107 may include other input devices 1072. Specifically, other input devices 1072 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described in detail herein.

Further, the touch panel 1071 may be overlaid on the display panel 1061, and when the touch panel 1071 detects a touch operation thereon or nearby, the touch panel 1071 transmits the touch operation to the processor 110 to determine the type of the touch event, and then the processor 110 provides a corresponding visual output on the display panel 1061 according to the type of the touch event. Although in fig. 15, the touch panel 1071 and the display panel 1061 are two independent components to implement the input and output functions of the electronic device 100, in some embodiments, the touch panel 1071 and the display panel 1061 may be integrated to implement the input and output functions of the electronic device 100, and is not limited herein.

The interface unit 108 is an interface for connecting an external device to the electronic apparatus 100. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The interface unit 108 may be used to receive input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more elements within the electronic apparatus 100 or may be used to transmit data between the electronic apparatus 100 and the external device.

The memory 109 may be used to store software programs as well as various data. The memory 109 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the cellular phone, and the like. Further, the memory 109 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.

The processor 110 is a control center of the electronic device 100, connects various parts of the entire electronic device 100 using various interfaces and lines, and performs various functions of the electronic device 100 and processes data by running or executing software programs and/or modules stored in the memory 109 and calling data stored in the memory 109, thereby performing overall monitoring of the electronic device 100. Processor 110 may include one or more processing units; alternatively, the processor 110 may integrate an application processor, which mainly handles operating systems, user interfaces, application programs, etc., and a modem processor, which mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 110.

The electronic device 100 may further include a power supply 111 (e.g., a battery) for supplying power to each component, and optionally, the power supply 111 may be logically connected to the processor 110 through a power management system, so as to implement functions of managing charging, discharging, and power consumption through the power management system.

In addition, the electronic device 100 includes some functional modules that are not shown, and are not described in detail herein.

Optionally, an embodiment of the present invention further provides an electronic device, which includes a processor, a memory, and a computer program stored in the memory and capable of running on the processor, where the computer program, when executed by the processor, implements each process of the above-mentioned embodiment of the article search method, and can achieve the same technical effect, and in order to avoid repetition, details are not described here again.

Optionally, an embodiment of the present invention further provides an AR device, including a processor, a memory, and a computer program stored in the memory and capable of running on the processor, where the computer program, when executed by the processor, implements the processes of the foregoing method embodiment, and can achieve the same technical effect, and details are not described here to avoid repetition.

Optionally, in this embodiment of the present invention, the electronic device in the above embodiment may be an AR device. Specifically, when the electronic device in the above embodiment (for example, the electronic device shown in fig. 15) is an AR device, the AR device may include all or part of the functional modules in the electronic device. Of course, the AR device may further include a functional module not included in the electronic device.

It is to be understood that, in the embodiment of the present invention, when the electronic device in the above embodiment is an AR device, the electronic device may be an electronic device integrated with AR technology. The AR technology is a technology for realizing the combination of a real scene and a virtual scene. By adopting the AR technology, the visual function of human can be restored, so that human can experience the feeling of combining a real scene and a virtual scene through the AR technology, and further the human can experience the experience of being personally on the scene better.

Taking the AR device as AR glasses as an example, when the user wears the AR glasses, the scene viewed by the user is generated by processing through the AR technology, that is, the virtual scene can be displayed in the real scene in an overlapping manner through the AR technology. When the user operates the content displayed by the AR glasses, the user can see that the AR glasses peel off the real scene, so that a more real side is displayed to the user. For example, only the case of the carton can be observed when a user visually observes one carton, but the user can directly observe the internal structure of the carton through AR glasses when the user wears the AR glasses.

The AR equipment can comprise the camera, so that the AR equipment can be combined with the virtual picture to display and interact on the basis of the picture shot by the camera. For example, in the embodiment of the present invention, the AR device may display N article identifiers on a shooting preview interface displaying a preview image of an intelligent wardrobe containing N articles, on the basis of shooting the preview image by using the camera, and since each article identifier is used to indicate one article, a user may quickly find an article to be found by using the N article identifiers displayed by the electronic device, so that the user may view all articles contained in the intelligent wardrobe without opening only the wardrobe, and further the whole article finding process is simple and efficient.

Optionally, an embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the computer program implements each process of the above embodiment of the article searching method, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here. The computer-readable storage medium may be a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.

Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present application may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling an electronic device (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present application.

While the present embodiments have been described with reference to the accompanying drawings, it is to be understood that the invention is not limited to the precise embodiments described above, which are meant to be illustrative and not restrictive, and that various changes may be made therein by those skilled in the art without departing from the spirit and scope of the invention as defined by the appended claims.

Claims

1. An article searching method applied to electronic equipment is characterized by comprising the following steps:

displaying a shooting preview interface;

displaying N article identifiers in the shooting preview interface under the condition that the preview image displayed in the shooting preview interface comprises a target object;

each article identification indicates one article, N articles indicated by the N article identifications are contained in the target object, and N is a positive integer;

after displaying the N item identifiers in the shooting preview interface, the method further includes:

receiving a second input of a user to a second identifier of the N item identifiers;

responding to the second input, and displaying a target identifier in an area where a second article is located in the shooting preview interface;

wherein the second article is: and the target identifier is used for indicating the second item.

2. The method of claim 1, wherein prior to displaying N item identifiers in the capture preview interface, the method further comprises:

acquiring a first image acquired by a camera;

identifying item features of the N items in the first image, and generating N item identifications;

the first image and the preview image both comprise target objects, each article identification corresponds to position information of one article, and each article identification is used for indicating a storage position of the corresponding article.

3. The method of claim 2, wherein after identifying item features of the N items in the first image, generating the N item identifications, the method further comprises:

uploading the information of the N articles to a server, wherein the information of each article comprises identification information and position information of the corresponding article;

and the information of the articles stored in the server is downloaded by other electronic equipment through accessing the server.

4. The method of claim 3, wherein after displaying N item identifiers in the capture preview interface, the method further comprises:

receiving first input of dragging a first identifier in the N article identifiers to a target area by a user;

and responding to the first input, removing the first identification, and sending a first control message to the server, wherein the first control message is used for instructing the server to delete the information of the first item corresponding to the first identification.

5. The method according to claim 1, wherein the target object is smart home equipment, and the electronic equipment is in communication connection with the smart home equipment;

after the displaying of the N item identifiers, the method further comprises:

receiving a third input of a third identifier of the N item identifiers from the user;

and responding to the third input, and sending a second control message to the intelligent household equipment, wherein the second control message comprises the third identifier, and the second control message is used for controlling the intelligent household equipment based on the third identifier.

6. The method according to claim 5, wherein the controlling the smart home device based on the third identifier comprises:

and controlling the intelligent household equipment to open or close the household part corresponding to the third identifier.

7. The method of claim 1, wherein after displaying N item identifiers in the capture preview interface, the method further comprises:

receiving a fourth input from the user;

displaying all item identifications stored in the electronic device in response to the fourth input.

8. The method of claim 1, wherein the photographic preview interface includes an item search area;

receiving a fifth input of the item search area by the user;

and responding to the fifth input, and displaying the item identification corresponding to the first item information input by the fifth input.

9. The method of claim 1, wherein displaying N item identifiers in the capture preview interface comprises:

in the shooting preview interface, displaying N article identifications according to article placement information of the N articles with a preset display effect;

wherein the item placement information comprises at least one of: the article placement time, the article position information and the article placement environment.

10. An electronic device, characterized in that the electronic device comprises:

the display module is used for displaying a shooting preview interface; and displaying N article identifiers in the shooting preview interface under the condition that the preview image displayed in the shooting preview interface comprises a target object;

the receiving module is used for receiving second input of a user on a second identifier in the N item identifiers;

the display module is further configured to respond to the second input received by the receiving module, and display a target identifier in an area where a second item is located in the shooting preview interface;

wherein the second article is: and the target identifier is used for indicating the second article.

11. An electronic device, comprising a processor, a memory and a computer program stored on the memory and executable on the processor, the computer program, when executed by the processor, implementing the steps of the item lookup method according to any one of claims 1 to 9.

12. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the item finding method according to one of claims 1 to 9.