WO2023061298A1 - Système et procédé de sauvegarde d'image et dispositif - Google Patents

Système et procédé de sauvegarde d'image et dispositif Download PDF

Info

Publication number
WO2023061298A1
WO2023061298A1 PCT/CN2022/124141 CN2022124141W WO2023061298A1 WO 2023061298 A1 WO2023061298 A1 WO 2023061298A1 CN 2022124141 W CN2022124141 W CN 2022124141W WO 2023061298 A1 WO2023061298 A1 WO 2023061298A1
Authority
WO
WIPO (PCT)
Prior art keywords
picture
user
information
target
candidate
Prior art date
Application number
PCT/CN2022/124141
Other languages
English (en)
Chinese (zh)
Inventor
李雪峰
Original Assignee
花瓣云科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 花瓣云科技有限公司 filed Critical 花瓣云科技有限公司
Publication of WO2023061298A1 publication Critical patent/WO2023061298A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14—Error detection or correction of the data by redundancy in operation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/74—Image or video pattern matching; Proximity measures in feature spaces

Definitions

  • the present application relates to the technical field of terminals, and in particular to a picture backup system, method and device.
  • the data volume of the pictures stored by the user using the terminal device is also increasing.
  • more and more users choose to backup and store pictures on cloud servers.
  • the user can upload the local pictures of the terminal device to the server through the picture backup software.
  • the picture backup software When a user needs to view a picture, he can search for the picture in the picture backup software at any time and download it locally.
  • the terminal device backs up the pictures to the server has great requirements on the bandwidth cost and storage cost of the server.
  • the commonly used method to improve photo transmission performance is: when uploading pictures, the terminal device recodes the pictures into high-definition thumbnails, and then uploads the high-definition thumbnails to the server. In this way, image transmission bandwidth is saved and storage costs are saved.
  • this processing method will cause the picture stored on the server to be a changed picture and cannot be restored, which will affect the user experience.
  • the present application provides a picture backup system, method and device.
  • the present application provides a picture backup system, which includes a terminal device and a storage device.
  • the terminal device is configured to send the backup request to the storage device, where the backup request is used to request to back up the target picture in the storage device;
  • the system is configured to determine, from stored picture information of at least one candidate picture, picture information of a reference picture corresponding to the target picture; wherein the at least one candidate picture includes a first A picture backed up in the storage device by at least one second user associated with the user; determining difference information of the target picture relative to the reference picture.
  • the storage device or the terminal device can determine the picture information of the reference picture corresponding to the target picture from at least one candidate picture stored.
  • at least one candidate picture includes a picture backed up in a storage device by at least one second user associated with the first user, and screening reference pictures in the pictures backed up by at least one second user can narrow the range of candidate pictures, thereby improving Determine the efficiency of the reference picture.
  • the storage device or the terminal device may determine difference information of the target picture relative to the reference picture.
  • the terminal device does not need to actually upload the target picture
  • the storage device does not need to store the target picture, but stores the difference information of the target picture to realize the backup of the target picture, saving the bandwidth cost of picture backup and saving the storage cost, and efficiently realizes Image backup.
  • the similarity between the reference picture and the target picture is greater than a set threshold.
  • the reference picture is a picture similar to the target picture
  • the picture backup system can determine the reference picture and calculate the difference information between the target picture and the reference picture, so as to back up the target picture by using the difference information.
  • system is further configured to: acquire user information of the first user; determine at least one second user associated with the first user according to the user information of the first user.
  • the storage device or the terminal device can acquire the user information of the first user and determine at least one second user associated with the first user.
  • the picture backed up by the second user in the storage device may be similar to the target picture requested by the first user, so the range of pictures to be selected when searching for a reference picture can be narrowed down to improve the accuracy of determining the reference picture. s efficiency.
  • the user information of the first user includes at least one of the following:
  • the usual wireless local area network of the first user is the usual wireless local area network of the first user
  • a tag of the first user where the tag is information selected by the first user to represent preferences or characteristics of the first user.
  • the first user and the second user meet at least one of the following conditions:
  • the first user and the second user have the same common wireless local area network
  • said first user has the same Internet Protocol address as said second user
  • the distance between the permanent address of the first user and the permanent address of the second user is less than a first threshold
  • the degree of coincidence between the movement trajectory of the first user and the movement trajectory of the second user is greater than a second threshold
  • the number of times the first user contacts the second user through a social application is greater than a third threshold
  • the second user is a user selected by the first user who has a close relationship with the first user
  • the first user has the same tag as the second user.
  • At least one second user associated with the first user can be determined according to the user information.
  • the user information can include information such as user preference or user characteristics, so as to ensure that the determined second user is associated with the first user.
  • the step of determining the picture information of the reference picture corresponding to the target picture from the stored picture information of at least one candidate picture is performed by the terminal device or the storage device.
  • both the storage device and the terminal device can be used to determine the picture information of the reference picture, and flexibly realize the picture backup method provided in this application.
  • the backup request includes the picture information of the target picture; the system is specifically configured to: acquire the picture information of the at least one candidate picture, and according to the picture information of the target picture and the match the picture information of the at least one candidate picture, and determine the picture information of the reference picture.
  • the picture information of the target picture can be carried in the backup request.
  • the storage device or the terminal device can determine the reference picture corresponding to the target picture from at least one candidate picture according to the picture information of the target picture and the picture information of the candidate picture, so that the found reference picture is a picture similar to the target picture, and can be used to calculate difference information.
  • the picture information of the target picture matches the picture information of at least one candidate picture, which may be part or all of the content contained in the picture information of the target picture and the content contained in the picture information of the candidate picture, or part or all of the content contained in the picture information. All content matches the preset matching criteria.
  • the candidate picture may be determined to be the reference picture.
  • the difference between the shooting location of the target picture and the shooting time of a candidate picture is less than a preset threshold, and the distance between the shooting location of the target picture and the shooting location of the candidate picture is smaller than the preset threshold, then it can be The candidate picture is determined as a reference picture.
  • the content contained in the picture information of the target picture and the candidate picture may involve many dimensions, such as the picture itself, attribute information of the picture, shooting information of the picture, and the like.
  • the matching condition may be that the similarity of information in one or more dimensions in the picture information of the target picture and the picture information of the candidate picture is greater than a preset threshold.
  • the backup request includes the picture information of the reference picture; the storage device is further configured to: acquire the picture information of the at least one candidate picture, and store the picture information of the at least one candidate picture The picture information is sent to the terminal device; the terminal device is further configured to: receive the picture information of at least one candidate picture sent by the storage device, and according to the picture information of the target picture and the picture information of the at least one candidate picture The picture information is used to determine the picture information of the reference picture.
  • the terminal device can determine the picture information of the reference picture corresponding to the target picture, and carry the picture information of the reference picture in the backup request, so that the storage device can obtain the picture information of the reference picture after receiving the backup request, reducing The calculation amount of the storage device improves the backup efficiency.
  • the picture information of any candidate picture or the picture information of the target picture includes at least one of the following:
  • the picture itself picture logo, picture size, shooting time, shooting location, thumbnail;
  • the picture information of the target picture and the picture information of the reference picture meet at least one of the following conditions:
  • the picture size of the target image is the same as the picture size of the reference picture
  • the difference between the shooting time of the target picture and the shooting time of the reference picture is less than a fourth threshold
  • the distance between the shooting position of the target picture and the shooting position of the reference picture is smaller than a fifth threshold.
  • the picture information can include at least one item of logo, picture size, shooting time, shooting location, and thumbnail, so that when the storage device or terminal device determines the picture information of the reference picture of the target picture, it can The picture information and the picture information of the candidate pictures select qualified candidate pictures as reference pictures to ensure that the determined reference pictures are similar pictures to the target picture and can be used to calculate difference information.
  • the step of determining the difference information of the target picture relative to the reference picture is performed by the terminal device or the storage device.
  • the difference information of the target picture can be determined by the terminal device and then sent to the storage device, or can be determined by the storage device, so that the difference information of the target picture can be flexibly calculated.
  • the picture information of the reference picture determined by the storage device is the reference picture itself.
  • the storage device is specifically configured to: determine at least one similar picture from the at least one candidate picture according to the picture information of the target picture and the picture information of the at least one candidate picture; based on a deep learning algorithm, from The reference picture is determined from the at least one similar picture.
  • the storage device is specifically configured to: respectively input at least one thumbnail of a similar picture and the thumbnail of the target picture into the deep learning model; obtain each picture output by the deep learning model The similarity between the similar picture and the target picture; using a similar picture with a similarity with the target picture greater than a set threshold as the reference picture.
  • the storage device when the storage device determines the reference picture corresponding to the target picture, it can first determine at least one similar picture from at least one candidate picture, and then determine the reference picture from at least one similar picture based on the deep learning algorithm to further optimize Search space when screening reference images, improving the efficiency and accuracy of determining reference images.
  • the terminal device is further configured to: send a download request to the storage device, where the download request is used to request acquisition of the target picture; receive the difference information sent by the storage device and the the picture information of the reference picture; generating the target picture according to the difference information and the picture information of the reference picture;
  • the storage device is further configured to: send the difference information and the picture information of the reference picture to the terminal device.
  • the terminal device after the terminal device backs up the target picture to the storage device, when the terminal device needs to download the target picture to the local again, it can send a download request to the storage device.
  • the storage device may send the picture information and difference information of the reference picture to the terminal device, and the terminal device may generate a target picture according to the picture information and difference information of the reference picture.
  • the difference information stored in the storage device and the picture information of the reference picture can be used to restore the target picture, ensuring the accuracy of the backup target picture.
  • the storage device is a server or a home storage device.
  • the present application provides a picture backup method, which is applied to a storage device.
  • the method includes:
  • the method further includes: acquiring user information of the first user; and determining at least one second user associated with the first user according to the user information of the first user.
  • the user information of the first user includes at least one of the following:
  • the usual wireless local area network of the first user is the usual wireless local area network of the first user
  • a tag of the first user where the tag is information selected by the first user to represent preferences or characteristics of the first user.
  • the first user and the second user meet at least one of the following conditions:
  • the first user and the second user have the same common wireless local area network
  • said first user has the same Internet Protocol address as said second user
  • the distance between the permanent address of the first user and the permanent address of the second user is less than a first threshold
  • the degree of coincidence between the movement trajectory of the first user and the movement trajectory of the second user is greater than a second threshold
  • the number of times the first user contacts the second user through a social application is greater than a third threshold
  • the second user is a user selected by the first user who has a close relationship with the first user
  • the first user has the same tag as the second user.
  • the determining the picture information of the reference picture corresponding to the target picture from the stored picture information of at least one candidate picture includes: acquiring the picture information of the at least one candidate picture, according to the match the picture information of the target picture with the picture information of the at least one candidate picture, and determine the picture information of the reference picture.
  • the picture information of any candidate picture or the picture information of the target picture includes at least one of the following:
  • the picture itself picture logo, picture size, shooting time, shooting location, thumbnail;
  • the picture information of the target picture and the picture information of the reference picture meet at least one of the following conditions:
  • the picture size of the target image is the same as the picture size of the reference picture
  • the difference between the shooting time of the target picture and the shooting time of the reference picture is less than a fourth threshold
  • the distance between the shooting position of the target picture and the shooting position of the reference picture is smaller than a fifth threshold.
  • the method further includes: receiving a download request sent by the terminal device, where the download request is used to request acquisition of the target picture; sending the difference information and the picture information of the reference picture to to the terminal device, so that the terminal device generates the target picture according to the difference information and the picture information of the reference picture.
  • the storage device is a server or a home storage device.
  • the present application provides a picture backup method, which is applied to a terminal device.
  • the method includes:
  • the method before determining the picture information of the reference picture corresponding to the target picture from the stored picture information of at least one candidate picture, the method further includes: receiving the at least one picture information sent by the storage device.
  • the picture information of a candidate picture before determining the picture information of the reference picture corresponding to the target picture from the stored picture information of at least one candidate picture, the method further includes: receiving the at least one picture information sent by the storage device. The picture information of a candidate picture.
  • the method further includes: sending the user information of the first user to the storage device, so that the storage device determines the user information of the first user according to the user information of the first user associated at least one second user; or determine the at least one second user selected by the first user, and send the user identification of the at least one second user to the storage device, so that the storage device At least one second user associated with the first user is determined according to the user identifier of the at least one second user.
  • the user information of the first user includes at least one of the following:
  • the usual wireless local area network of the first user is the usual wireless local area network of the first user
  • a tag of the first user where the tag is information selected by the first user to represent preferences or characteristics of the first user.
  • the first user and the second user meet at least one of the following conditions:
  • the first user and the second user have the same common wireless local area network
  • said first user has the same Internet Protocol address as said second user
  • the distance between the permanent address of the first user and the permanent address of the second user is less than a first threshold
  • the degree of coincidence between the movement trajectory of the first user and the movement trajectory of the second user is greater than a second threshold
  • the number of times the first user contacts the second user through a social application is greater than a third threshold
  • the second user is a user selected by the first user who has a close relationship with the first user
  • the first user has the same label as the second user.
  • the determining the picture information of the reference picture corresponding to the target picture from the stored picture information of at least one candidate picture includes: acquiring the picture information of the at least one candidate picture, according to the match the picture information of the target picture with the picture information of the at least one candidate picture, and determine the picture information of the reference picture.
  • the picture information of any candidate picture or the picture information of the target picture includes at least one of the following:
  • the picture itself picture logo, picture size, shooting time, shooting location, thumbnail;
  • the picture information of the target picture and the picture information of the reference picture meet at least one of the following conditions:
  • the picture size of the target image is the same as the picture size of the reference picture
  • the difference between the shooting time of the target picture and the shooting time of the reference picture is less than a fourth threshold
  • the distance between the shooting position of the target picture and the shooting position of the reference picture is smaller than a fifth threshold.
  • the method further includes: sending a download request to the storage device, where the download request is used to request acquisition of the target picture; receiving the difference information and the reference image sent by the storage device Picture information of a picture; generating the target picture according to the difference information and the picture information of the reference picture.
  • the present application provides a picture backup device, the device includes a plurality of functional modules; the plurality of functional modules interact to implement the methods in any one of the above aspects and implementations thereof.
  • the multiple functional modules can be implemented based on software, hardware or a combination of software and hardware, and the multiple functional modules can be combined or divided arbitrarily based on specific implementations.
  • the present application provides a storage device, including at least one processor and at least one memory, where computer program instructions are stored in the at least one memory, and when the storage device is running, the at least one processor executes any of the above-mentioned Aspects and methods executed by storage devices in various implementations thereof.
  • the present application provides a terminal device, including at least one processor and at least one memory, where computer program instructions are stored in the at least one memory, and when the electronic device is running, the at least one processor executes any of the above-mentioned Aspects and methods executed by a terminal device in various implementation manners thereof.
  • the present application further provides a computer program, which, when the computer program is run on a computer, causes the computer to execute the method in any one of the above aspects and its various implementation manners.
  • the present application also provides a computer-readable storage medium, where a computer program is stored in the computer-readable storage medium, and when the computer program is executed by a computer, the computer executes any one of the above-mentioned aspects and its methods in various embodiments.
  • the present application further provides a chip, which is used for reading a computer program stored in a memory, and executing the method in any one of the above aspects and each implementation manner thereof.
  • the present application further provides a system-on-a-chip, where the system-on-a-chip includes a processor, configured to support a computer device to implement any one of the above aspects and the method in each implementation manner.
  • the chip system further includes a memory, and the memory is used to store necessary programs and data of the computer device.
  • the system-on-a-chip may consist of chips, or may include chips and other discrete devices.
  • FIG. 1 is a schematic diagram of a picture backup scene provided by an embodiment of the present application
  • FIG. 2 is a schematic interface diagram of a picture backup application provided by an embodiment of the present application
  • FIG. 3 is a schematic structural diagram of a terminal device provided in an embodiment of the present application.
  • FIG. 4 is a software structural block diagram of a terminal device provided in an embodiment of the present application.
  • FIG. 5 is a flow chart of a picture backup method provided by an embodiment of the present application.
  • FIG. 6 is a schematic diagram of a terminal device reporting user information to a server according to an embodiment of the present application
  • FIG. 7A is a schematic diagram of a server accessing a user's backup picture collection provided by an embodiment of the present application.
  • FIG. 7B is a schematic diagram of yet another server accessing a user's backup picture collection provided by an embodiment of the present application.
  • FIG. 8 is a flow chart of a method for determining a reference picture provided in an embodiment of the present application.
  • FIG. 9 is a schematic diagram of a difference calculation provided by an embodiment of the present application.
  • Fig. 10 is a method flowchart of the first picture backup example provided by the present application.
  • Fig. 11 is a method flow chart of the second picture backup example provided by the present application.
  • Fig. 12 is the method flowchart of the third picture backup example provided by the present application.
  • Fig. 13 is a method flowchart of the fourth picture backup example provided by the present application.
  • FIG. 14 is a schematic diagram of a module structure and functions of a server provided by an embodiment of the present application.
  • Difference calculation refers to performing difference calculation on at least two pictures to determine the difference information between the pictures, and the difference information can be used to represent the difference between the pictures.
  • Thumbnails refer to pictures with reduced pixels after recoding the pictures, and the data volume of the thumbnail pictures will be reduced compared with the original picture.
  • FIG. 1 is a schematic diagram of a picture backup scenario provided by an embodiment of the present application.
  • the scenario includes multiple terminal devices and at least one storage device.
  • three terminal devices terminal device A, terminal device B, and terminal device C
  • the storage device may be a server or a home storage device, such as a network attached storage (network attached storage, NAS).
  • network attached storage network attached storage
  • the user When the user needs to back up the pictures, he can operate to upload the pictures on the terminal device to the server, so as to save the uploaded pictures in the server, so as to realize the picture backup. After the user uploads the picture to the server, he can choose to delete the picture stored on the terminal device, thereby releasing the storage space of the terminal device. When the user wants to view these pictures, he can view the pictures uploaded to the server through the picture backup application and choose to download them locally, so as to obtain these pictures again.
  • FIG. 2 is a schematic interface diagram of an image backup application provided in an embodiment of the present application.
  • the user may click "upload picture" and select a picture to be uploaded in the picture preview interface.
  • the terminal device uploads the picture selected by the user to the server, and the server receives the picture and stores the received picture in the storage space of the server.
  • the picture backup application may be an application or preset function built into the operating system of the terminal device, such as a cloud disk application built into the operating system; or the picture backup application may be an embedded application developed by a third-party manufacturer. This embodiment of the present application does not limit it.
  • the image backup method has great requirements on the bandwidth cost and storage cost of the server.
  • the following two methods to improve image transmission performance are introduced.
  • Method 1 The terminal device uploads the thumbnail image to the server.
  • the terminal device After responding to the upload instruction triggered by the user, the terminal device recodes the picture to be uploaded into a high-definition thumbnail, and uploads the high-definition thumbnail to the server, so as to save picture transmission bandwidth and storage cost of the server.
  • the terminal device After responding to the upload instruction triggered by the user, the terminal device sends a request for uploading pictures to the server, and the request may carry an identifier of the picture to be uploaded.
  • the server After the server receives the request for uploading pictures, it determines that the ID of the picture to be uploaded is the same as the ID of the picture stored in the server, indicating that the picture to be uploaded has been stored in the server. Create a picture reference in the folder, and the picture reference may include the identification and/or storage address of the picture uploaded to the server.
  • the server searches the pictures stored in the server according to the identification of picture A, and determines that picture B and picture A have the same identification, that is, picture A and picture B is the same picture.
  • the server may notify the terminal device that there is no need to upload the picture A, but to create a new picture reference in the folder corresponding to the user requesting to upload the picture A, and the picture reference includes the identification and/or storage address of the picture B.
  • the server stores the picture information of the picture A in a folder corresponding to the user, and completes the backup of the picture A.
  • the server can search for the picture B stored in the server according to the identification and/or storage address of picture B in the picture reference, and the server sends the picture information of picture B and picture A to the terminal device , the terminal device saves the picture information of picture B and picture A locally, and completes the download of backed up picture A.
  • the terminal device can realize picture backup without actually uploading the picture to be uploaded to the server. That is to say, for the same picture, only one copy of the picture needs to be stored in the server, and the picture can be associated with multiple picture information, and each picture information includes relevant data when the user uploads the picture.
  • the clarity of the picture needs to be lost, and the method of recoding to a thumbnail will cause the picture stored on the server to be a changed picture, which cannot be restored, affecting users. experience.
  • the instant transmission function in method 2 can only obtain greater benefits in the scenario where the user uploads pictures with a high repetition rate, while the benefit is small in the scenario where individual users upload pictures, and cannot significantly improve the image transmission performance.
  • an embodiment of the present application provides a picture backup method, which is used to save bandwidth cost and storage cost in the picture backup method.
  • the server may obtain user information and determine a user set.
  • the terminal device corresponding to any user in the user set sends an upload request to the server for backing up the target picture
  • the server can determine the reference picture of the target picture in the candidate picture set composed of the backup pictures of all users in the user set, and determine Difference information of the target picture compared to the reference picture. Therefore, the server can use the reference picture identifier and difference information as the backup information of the target picture, and the target picture can be backed up without the terminal device uploading the target picture.
  • the terminal device in the embodiment of the present application can be a mobile phone, a tablet computer, a wearable device (such as a watch, a bracelet, a helmet, a headset, etc.), a vehicle device, an augmented reality (augmented reality, AR)/virtual reality (virtual reality, VR) devices, laptops, ultra-mobile personal computers (UMPCs), netbooks, personal digital assistants (PDAs), smart home devices (e.g., smart TVs, smart speakers, smart camera, etc.) etc.
  • augmented reality augmented reality, AR
  • VR virtual reality
  • laptops laptops
  • UMPCs ultra-mobile personal computers
  • PDAs personal digital assistants
  • smart home devices e.g., smart TVs, smart speakers, smart camera, etc.
  • FIG. 3 is a schematic structural diagram of a terminal device 100 provided in an embodiment of the present application.
  • the terminal device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (universal serial bus, USB) interface 130, a charging management module 140, a power management module 141, and a battery 142 , antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, earphone jack 170D, sensor module 180, button 190, motor 191, indicator 192, camera 193 , a display screen 194, and a subscriber identification module (subscriber identification module, SIM) card interface 195, etc.
  • SIM subscriber identification module
  • the processor 110 may include one or more processing units, for example: the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processing unit (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), controller, memory, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural network processor (neural-network processing unit, NPU) wait. Wherein, different processing units may be independent devices, or may be integrated in one or more processors. Wherein, the controller may be the nerve center and command center of the terminal device 100 . The controller can generate an operation control signal according to the instruction opcode and timing signal, and complete the control of fetching and executing the instruction.
  • a memory may also be provided in the processor 110 for storing instructions and data.
  • the memory in processor 110 is a cache memory.
  • the memory may hold instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to use the instruction or data again, it can be called directly from the memory. Repeated access is avoided, and the waiting time of the processor 110 is reduced, thus improving the efficiency of the system.
  • the USB interface 130 is an interface conforming to the USB standard specification, specifically, it can be a Mini USB interface, a Micro USB interface, a USB Type C interface, and the like.
  • the USB interface 130 can be used to connect a charger to charge the terminal device 100, and can also be used to transmit data between the terminal device 100 and peripheral devices.
  • the charging management module 140 is configured to receive a charging input from a charger.
  • the power management module 141 is used for connecting the battery 142 , the charging management module 140 and the processor 110 .
  • the power management module 141 receives the input from the battery 142 and/or the charging management module 140 to provide power for the processor 110 , the internal memory 121 , the external memory, the display screen 194 , the camera 193 , and the wireless communication module 160 .
  • the wireless communication function of the terminal device 100 may be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, a modem processor, a baseband processor, and the like.
  • Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals.
  • Each antenna in the terminal device 100 can be used to cover single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization of the antennas.
  • Antenna 1 can be multiplexed as a diversity antenna of a wireless local area network.
  • the antenna may be used in conjunction with a tuning switch.
  • the mobile communication module 150 can provide wireless communication solutions including 2G/3G/4G/5G applied on the terminal device 100 .
  • the mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (low noise amplifier, LNA) and the like.
  • the mobile communication module 150 can receive electromagnetic waves through the antenna 1, filter and amplify the received electromagnetic waves, and send them to the modem processor for demodulation.
  • the mobile communication module 150 can also amplify the signals modulated by the modem processor, and convert them into electromagnetic waves through the antenna 1 for radiation.
  • at least part of the functional modules of the mobile communication module 150 may be set in the processor 110 .
  • at least part of the functional modules of the mobile communication module 150 and at least part of the modules of the processor 110 may be set in the same device.
  • the wireless communication module 160 can provide wireless local area networks (wireless local area networks, WLAN) (such as wireless fidelity (Wireless Fidelity, Wi-Fi) network), bluetooth (bluetooth, BT), global navigation satellite, etc. System (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field communication technology (near field communication, NFC), infrared technology (infrared, IR) and other wireless communication solutions.
  • the wireless communication module 160 may be one or more devices integrating at least one communication processing module.
  • the wireless communication module 160 receives electromagnetic waves via the antenna 2 , frequency-modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110 .
  • the wireless communication module 160 can also receive the signal to be sent from the processor 110 , frequency-modulate it, amplify it, and convert it into electromagnetic waves through the antenna 2 for radiation.
  • the antenna 1 of the terminal device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the terminal device 100 can communicate with the network and other devices through wireless communication technology.
  • the wireless communication technology may include global system for mobile communications (GSM), general packet radio service (general packet radio service, GPRS), code division multiple access (code division multiple access, CDMA), broadband Code division multiple access (wideband code division multiple access, WCDMA), time division code division multiple access (time-division code division multiple access, TD-SCDMA), long term evolution (long term evolution, LTE), BT, GNSS, WLAN, NFC , FM, and/or IR techniques, etc.
  • GSM global system for mobile communications
  • GPRS general packet radio service
  • code division multiple access code division multiple access
  • CDMA broadband Code division multiple access
  • WCDMA wideband code division multiple access
  • time division code division multiple access time-division code division multiple access
  • TD-SCDMA time-division code division multiple access
  • the GNSS may include a global positioning system (global positioning system, GPS), a global navigation satellite system (global navigation satellite system, GLONASS), a Beidou navigation satellite system (beidou navigation satellite system, BDS), a quasi-zenith satellite system (quasi -zenith satellite system (QZSS) and/or satellite based augmentation systems (SBAS).
  • GPS global positioning system
  • GLONASS global navigation satellite system
  • Beidou navigation satellite system beidou navigation satellite system
  • BDS Beidou navigation satellite system
  • QZSS quasi-zenith satellite system
  • SBAS satellite based augmentation systems
  • the display screen 194 is used for displaying a display interface of an application, for example, displaying a desktop of the terminal device 100, which may include icons of applications installed on the terminal device 100, and the like.
  • the display screen 194 includes a display panel.
  • the display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active matrix organic light emitting diode or an active matrix organic light emitting diode (active-matrix organic light emitting diode, AMOLED), flexible light-emitting diode (flex light-emitting diode, FLED), Miniled, MicroLed, Micro-oLed, quantum dot light emitting diodes (quantum dot light emitting diodes, QLED), etc.
  • the terminal device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1.
  • Camera 193 is used to capture still images or video.
  • the object generates an optical image through the lens and projects it to the photosensitive element.
  • the photosensitive element may be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor.
  • CMOS complementary metal-oxide-semiconductor
  • the photosensitive element converts the light signal into an electrical signal, and then transmits the electrical signal to the ISP to convert it into a digital image signal.
  • the ISP outputs the digital image signal to the DSP for processing.
  • DSP converts digital image signals into standard RGB, YUV and other image signals.
  • the terminal device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.
  • the internal memory 121 may be used to store computer-executable program codes including instructions.
  • the processor 110 executes various functional applications and data processing of the terminal device 100 by executing instructions stored in the internal memory 121.
  • the internal memory 121 may include an area for storing programs and an area for storing data.
  • the storage program area can store an operating system, software codes of at least one application program, and the like.
  • the storage data area can store data generated during use of the terminal device 100 (such as captured images, recorded videos, etc.) and the like.
  • the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, flash memory device, universal flash storage (universal flash storage, UFS) and the like.
  • the external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the terminal device.
  • the external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function. For example, save pictures, videos and other files in the external memory card.
  • the terminal device 100 may implement an audio function through an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, and an application processor. Such as music playback, recording, etc.
  • the sensor module 180 may include a pressure sensor 180A, an acceleration sensor 180B, a touch sensor 180C and the like.
  • the pressure sensor 180A is used to sense the pressure signal and convert the pressure signal into an electrical signal.
  • pressure sensor 180A may be disposed on display screen 194 .
  • the touch sensor 180C is also called “touch panel”.
  • the touch sensor 180C can be disposed on the display screen 194, and the touch sensor 180C and the display screen 194 form a touch screen, also called “touch screen”.
  • the touch sensor 180C is used to detect a touch operation on or near it.
  • the touch sensor can pass the detected touch operation to the application processor to determine the type of touch event.
  • Visual output related to the touch operation can be provided through the display screen 194 .
  • the touch sensor 180C may also be disposed on the surface of the terminal device 100 , which is different from the position of the display screen 194 .
  • the keys 190 include a power key, a volume key and the like.
  • the key 190 may be a mechanical key. It can also be a touch button.
  • the terminal device 100 may receive key input and generate key signal input related to user settings and function control of the terminal device 100 .
  • the motor 191 can generate a vibrating reminder.
  • the motor 191 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. For example, touch operations applied to different applications (such as taking pictures, playing audio, etc.) may correspond to different vibration feedback effects.
  • the touch vibration feedback effect can also support customization.
  • the indicator 192 can be an indicator light, and can be used to indicate charging status, power change, and can also be used to indicate messages, missed calls, notifications, and the like.
  • the SIM card interface 195 is used for connecting a SIM card. The SIM card can be connected and separated from the terminal device 100 by inserting it into the SIM card interface 195 or pulling it out from the SIM card interface 195 .
  • the components shown in FIG. 3 do not constitute a specific limitation on the terminal device 100, and the terminal device may also include more or fewer components than shown in the figure, or combine some components, or split some components , or different component arrangements.
  • the combination/connection relationship between the components in FIG. 3 can also be adjusted and modified.
  • FIG. 4 is a block diagram of a software structure of a terminal device provided by an embodiment of the present application.
  • the software structure of the terminal device may be a layered architecture, for example, the software may be divided into several layers, and each layer has a clear role and division of labor. Layers communicate through software interfaces.
  • the operating system is divided into four layers, which are application program layer, application program framework layer (framework, FWK), runtime and system library, and kernel layer from top to bottom.
  • the application layer can consist of a series of application packages. As shown in FIG. 4 , the application layer may include camera, setting, skin module, user interface (user interface, UI), three-party application program, and the like. Among them, the three-party application may include gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message and so on.
  • the application framework layer provides an application programming interface (application programming interface, API) and a programming framework for applications in the application layer.
  • the application framework layer can include some predefined functions. As shown in Figure 4, the application framework layer can include window manager, content provider, view system, phone manager, resource manager, notification manager, etc.
  • a window manager is used to manage window programs.
  • the window manager can get the size of the display screen, determine whether there is a status bar, lock the screen, capture the screen, etc.
  • Content providers are used to store and retrieve data and make it accessible to applications. Said data may include video, images, audio, calls made and received, browsing history and bookmarks, phonebook, etc.
  • the view system includes visual controls, such as controls for displaying text, controls for displaying pictures, and so on.
  • the view system can be used to build applications.
  • a display interface can consist of one or more views.
  • a display interface including a text message notification icon may include a view for displaying text and a view for displaying pictures.
  • the telephony manager is used to provide the communication function of the terminal equipment. For example, the management of call status (including connected, hung up, etc.).
  • the resource manager provides various resources for the application, such as localized strings, icons, pictures, layout files, video files, and so on.
  • the notification manager enables the application to display notification information in the status bar, which can be used to convey notification-type messages, and can automatically disappear after a short stay without user interaction.
  • the notification manager is used to notify the download completion, message reminder, etc.
  • the notification manager can also be a notification that appears on the top status bar of the system in the form of a chart or scroll bar text, such as a notification of an application running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is displayed in the status bar, a prompt sound is issued, the terminal device vibrates, and the indicator light flashes, etc.
  • the runtime includes the core library and virtual machine.
  • the runtime is responsible for the scheduling and management of the operating system.
  • the core library consists of two parts: one part is the function function that the java language needs to call, and the other part is the core library of the operating system.
  • the application layer and the application framework layer run in virtual machines.
  • the virtual machine executes the java files of the application program layer and the application program framework layer as binary files.
  • the virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.
  • a system library can include multiple function modules. For example: surface manager (surface manager), media library (media libraries), 3D graphics processing library (eg: OpenGL ES), 2D graphics engine (eg: SGL), etc.
  • the surface manager is used to manage the display subsystem and provides the fusion of 2D and 3D layers for multiple applications.
  • the media library supports playback and recording of various commonly used audio and video formats, as well as still image files, etc.
  • the media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.
  • the 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing, etc.
  • 2D graphics engine is a drawing engine for 2D drawing.
  • a 3D graphics processing library can be used to draw a 3D motion track image
  • a 2D graphics engine can be used to draw a 2D motion track image
  • the kernel layer is the layer between hardware and software.
  • the kernel layer includes at least a display driver, a camera driver, an audio driver, and a sensor driver.
  • the hardware layer may include various types of sensors, such as acceleration sensors, gyroscope sensors, touch sensors, and the like.
  • FIG. 5 is a flow chart of a picture backup method provided by an embodiment of the present application. With reference to Fig. 5, this method comprises the following steps:
  • S501 The server acquires user information of a first user, and determines at least one second user associated with the first user.
  • the user information may include a user identifier of the first user, information of a wireless local area network (wlan) commonly used by the first user, an IP address of a terminal device corresponding to the first user, a resident location of the first user, and the like.
  • the resident location of the first user may be, for example, the GPS location of the terminal device or the location of the base station with which the terminal device is always connected.
  • the terminal device may report the user information of the first user to the server. Before the terminal device reports user information to the server, it needs to obtain user authorization. For example, the terminal device displays a message of obtaining user authorization on the display screen, and after the user agrees to the authorization, the terminal device sends the user information of the first user to the server.
  • the terminal device may report the encrypted user information to the server, and the server may determine the user set of the first user according to the encrypted user information after receiving the encrypted user information.
  • the manner in which the terminal device encrypts the user information may be, for example, to process the user information by using an encryption algorithm.
  • FIG. 6 is a schematic diagram of a terminal device reporting user information to a server according to an embodiment of the present application.
  • FIG. 6 shows three terminal devices as an example, each terminal device corresponds to a user, and each terminal device reports the user information of the user to the server respectively.
  • the server may receive user information reported by all terminal devices, analyze the received user information, and determine multiple user sets. The users included in each user set can be considered as closely related users, and there may be similar pictures in the pictures that these users need to back up.
  • the server may determine at least one second user associated with the first user, and at least one second user and the first user may form the first user corresponding The first user set of .
  • the second user may be a second user who has a close relationship with the first user.
  • the second user who has a close relationship with the first user may be a user who is closer to the permanent address of the first user, or a user who has frequent contacts with the first user.
  • the first user may select a second user who is closely related to the first user, and the first user and the second user together form the first user set.
  • the terminal device may send the user identifiers of the first user and the selected second user to the server, so that the server can determine the first user set.
  • the relationship between the first user and the second user in the first user set is different according to the manner in which the server determines the first user set.
  • the following describes the manner in which the server determines the first user set in the embodiment of the present application.
  • the first user and the second user have the same common wlan.
  • the server may determine the second users who have the same common wlan as the first user, and the terminal devices used by these second users have accessed the same wireless local area network as the terminal device used by the first user, then these second users may be considered as The user may have a close relationship with the first user, and the server may divide the first user and the determined second user into a first user set.
  • IP Internet protocol address
  • the server may determine that the second user has the same IP address as the first user, that is, the first user and the second user have logged in their own accounts using the same terminal device, then the first user and the second user may be considered as The two users may have a close relationship, and the server may divide the first user and the second user into a first user set.
  • the server may determine the second users whose distance to the permanent address of the first user is less than a first threshold, and the server may divide the first users and the second users into a first user set.
  • the server may divide the first users and the second users into a first user set.
  • the resident address of the first user may be, for example, the GPS address of the terminal device, or may be the location of the base station to which the terminal device is always connected.
  • Mode 4 The degree of coincidence between the movement trajectory of the first user and the movement trajectory of the second user is greater than a second threshold.
  • the user information of the first user may include the movement track of the first user, and the server may determine the second user whose movement track coincidence with the first user is greater than a second threshold, and the server may combine the first user and the second user
  • the users are divided into a first set of users.
  • the activity areas of the second user and the first user determined in this way are relatively similar, and the pictures uploaded by the first user and the second user may be relatively similar at this time.
  • Manner 5 The number of times the first user contacts the second user through social applications is greater than a third threshold.
  • the user information of the first user may also include users and contact times of the first user through social applications, and the server may associate the second user whose contact times with the first user through social applications is greater than a third threshold with the first user.
  • the users are divided into a first set of users.
  • the pictures uploaded by the first user and the second user may be relatively similar.
  • the first user may send pictures to the second user through social applications, and the first user And the second user chooses to backup the picture to the server.
  • the second user is a user selected by the first user who has a close relationship with the first user.
  • the user information of the first user may further include an identifier of a second user selected by the first user as a closely related user.
  • the server may divide the first user and the second user into a first user set.
  • the first user and the second user are users with the same tag.
  • the user information of the first user may also include the user's label, which may be selected by the user, for example, the user's label may be the user's hobbies: travel, food, and so on.
  • the server may divide the first user and the second user with the same tag as the first user into a first user set.
  • the server may determine the first user set in combination with at least one of the above multiple methods during implementation, which is not limited in this embodiment of the present application.
  • each way of determining the first user set may correspond to a different weight, so that the server may determine the first user set according to the multiple ways and the weight corresponding to each way,
  • priorities may be set for multiple methods, and the server may select a method with a higher priority to determine the first user set.
  • the server determines the first user set corresponding to the first user, when there are many pictures similar to the pictures to be uploaded by the first user in the second user's backup picture set in the first user set , the picture backup method provided by this application can obtain greater benefits.
  • the server may also add a third user to the first user set, and the third user may be a virtual user.
  • the backup picture set of the third user may include pictures preset by the server. For example, when the first user and the second user in the first user set are users with relatively close resident addresses, the third user's backup picture set may include pictures of landmark buildings near the first user's resident address. For another example, when the first user and the second user in the first user set have the same travel tag, the backup picture set of the third user may include pictures of common scenic spots.
  • S502 The server receives the upload request sent by the terminal device.
  • the terminal device is a terminal device corresponding to the first user, and the upload request is used to request to upload the target picture to the server, so as to realize picture backup.
  • the upload request may include image information of the target image, and the image information of the target image may include part or all of image ID, image size, shooting time, shooting location, thumbnail, and pixel feature value.
  • the picture identifier may be, for example, a hash value of the picture, and it can be seen from the foregoing introduction that the hash value of the picture may be used as a unique identifier of the picture to distinguish different pictures.
  • the thumbnail image may be a recoded image of the target icon, and the pixels of the thumbnail image are lower than those of the target image.
  • the pixel feature value is a vector feature extracted based on the pixel information of the picture.
  • the pixel feature value may include the brightness of the picture, the shape of the object in the picture, and so on.
  • S503 The server determines picture information of a reference picture corresponding to the target picture.
  • the server may use the pictures in the backup picture set corresponding to some or all users in the first user set as candidate pictures, and at least one candidate picture forms the candidate picture set .
  • the server when it receives an upload request sent by any user in the first user set, it may access the backup picture sets of some or all users in the first user set to determine the reference picture corresponding to the picture to be uploaded. image information. For example, the server may determine the picture itself of the reference picture from at least one candidate picture in the candidate picture set. Before accessing the user's backup picture collection, the server may send an authorization request to the terminal device used by the user, and then access the user's backup picture collection after receiving a message from the terminal device that the user agrees to the authorization. Alternatively, the user may choose to enable the function of sharing the backup picture collection, and at this time the server may access the user's backup picture collection. Further, when the server accesses the user's backup picture collection, it can access the encrypted backup picture, that is, what the server can obtain is the encrypted ciphertext of the backup picture.
  • FIG. 7A is a schematic diagram of a server accessing a user's backup picture collection according to an embodiment of the present application.
  • the first user is user A
  • the second users are user B and user C
  • user D does not belong to the first user set.
  • the server can access the backup picture sets of user B and user C after obtaining the authorization of user A, user B and user C, and when receiving the upload request sent by the terminal device corresponding to user A.
  • the server cannot access user D's backup picture collection at this time.
  • FIG. 7B is a schematic diagram of yet another server accessing a user's backup picture collection provided by an embodiment of the present application.
  • the first user is user A
  • the second users are user B, user C, and user D.
  • the server receives the upload request sent by the terminal device corresponding to user A, if the server determines that the authorization of user D is not obtained, or the server determines that user D has disabled the function of sharing the backup picture collection, the server cannot access user D's backup Picture collection.
  • the server may store picture information of at least one candidate picture in the set of candidate pictures. After receiving the upload request sent by the terminal device, the server may determine the reference picture from the at least one candidate picture according to the picture information of the target picture and the picture information of the at least one candidate picture in the upload request.
  • the server may also send the picture information of at least one candidate picture in the candidate picture set to the terminal device.
  • the server may send the picture information of at least one candidate picture to the terminal device through wireless fidelity (wireless fidelity, WiFi) direct connection technology or Bluetooth technology.
  • the terminal device stores the picture information of at least one candidate picture, and determines the picture information of the reference picture according to the picture information of the target picture and the picture information of the at least one candidate picture.
  • the terminal device may carry the picture information of the reference picture in the upload request, for example, carry the picture identifier of the reference picture in the upload request.
  • the server may determine the reference picture according to the picture information of the reference picture in the upload request.
  • the server may determine the picture information of the reference picture, or the terminal device may determine the picture information of the reference picture, and then send the picture information of the reference picture to the server through an upload request.
  • the method for determining the reference picture provided by the embodiment of the present application is introduced below by taking the server determining the reference picture as an example.
  • FIG. 8 is a flowchart of a method for determining a reference picture provided by an embodiment of the present application. Referring to Figure 8, the method comprises the following steps:
  • S801 The server obtains the image information of the target image from the received upload request.
  • S802 The server judges whether there is a candidate picture with the same identifier as the target picture in the set of candidate pictures; if yes, go to S803; otherwise, go to S804.
  • S803 The server transmits the target picture within seconds.
  • the server may transmit the target picture in seconds. That is to say, the terminal device does not need to actually upload the target picture, and the server can create a reference to the target picture in the backup picture set of the first user, so as to realize the backup of the target picture by the first user.
  • S804 The server judges whether there is a similar picture similar to the target picture in the set of candidate pictures; if yes, go to S805; otherwise, go to S807.
  • S804 may be regarded as a step in which the server initially screens pictures similar to the target picture from the candidate picture set.
  • the server may determine whether there is a similar picture similar to the target picture in the set of candidate pictures according to information such as picture size, shooting time, and shooting location included in the picture information.
  • the server may use a candidate picture whose picture size is the same as that of the target picture as a similar picture.
  • the server may use candidate pictures whose shooting time and shooting time of the target picture are smaller than a fourth threshold as similar pictures.
  • the server may also use candidate pictures whose distance between the shooting location and the shooting location of the target picture is smaller than the fifth threshold as similar pictures.
  • the server in the embodiment of the present application judges whether there are similar pictures in the set of candidate pictures, it is not limited to the above examples in the embodiment of the present application.
  • the picture information may also include information such as the brightness and contrast of the picture. It can also be used to determine whether there are similar pictures in the candidate picture set, which is not limited in this embodiment of the present application.
  • S805 The server judges whether there is a reference picture among the similar pictures based on a deep learning algorithm; if yes, go to S806; otherwise, go to S807.
  • S806 The server determines a reference picture corresponding to the target picture.
  • the server may input the thumbnails of the similar pictures and the thumbnails of the target picture into the deep learning model, and obtain the similarity between the similar pictures output by the deep learning model and the target picture.
  • the server may use a similar picture whose similarity with the target picture is greater than a set threshold as a reference picture.
  • the deep learning model in the embodiment of the present application can be a model that has been trained and can be used to calculate the similarity of pictures.
  • the deep learning module can be a support vector machine (support vector machines, SVM) model, volume product neural network models, etc.
  • the deep learning model can be trained based on the feature information of the picture, where the feature information of the picture can include, for example, the histogram of oriented gradient (HOG) feature of the picture, cosine similarity, and histogram-based Calculated similarity, etc.
  • HOG histogram of oriented gradient
  • the server may also input the similar picture and the target picture into the deep learning model to determine the similarity between the similar picture and the target picture.
  • the terminal device is required to upload the target picture to the server first.
  • the server may not store the target picture in the backup picture set of the first user, but determine the target picture corresponding to the target picture in the candidate picture set according to the above method. reference image.
  • the bandwidth cost of the terminal device does not change during the process of backing up the target picture, but when the server determines that there is a reference picture corresponding to the target picture in the candidate picture set, the picture backup method provided in the embodiment of the application can be used The difference information of the target picture is determined, and the difference information is stored in the server, thereby saving storage cost.
  • the server may determine a plurality of pictures whose similarity with the target picture is greater than a set threshold from the similar pictures, and at this time, the server may use the picture with the highest similarity as a reference picture; or, the server may Use these multiple pictures as reference pictures.
  • S807 The server determines that there is no reference picture corresponding to the target picture in the candidate picture set.
  • the server determines that there is no similar picture in the candidate picture set, or there is no reference picture in the similar picture.
  • the server determines that there is no reference picture corresponding to the target picture in the candidate picture set.
  • the terminal device needs to upload the target picture normally, and after receiving the target picture, the server stores it in the backup picture set corresponding to the first user.
  • the manner of determining the reference picture can also be performed by the terminal device, and can be specifically implemented with reference to the manner shown in FIG. 8 , which will not be repeated here.
  • S504 The server determines difference information between the target picture and the reference picture.
  • the difference information may be binary data corresponding to a difference part between the target picture and the reference picture, or the difference information may be information of a position where there is a difference between the target picture and the reference picture.
  • the server may perform difference calculation on the target picture and the reference picture to determine difference information corresponding to the target picture.
  • the terminal device may perform difference calculation on the target picture and the reference picture, determine the difference information corresponding to the target picture, and send the difference information corresponding to the target picture to the server.
  • the server may receive the message sent by the terminal device and obtain difference information corresponding to the target picture therefrom.
  • FIG. 9 is a schematic diagram of difference calculation provided by the embodiment of the present application.
  • the server or the terminal device when it calculates the difference between the target picture and the reference picture, it may calculate the pixel values at the same position of the target picture and the reference picture, such as subtracting the pixel values to obtain difference information; or The server or the terminal device may use the information on the location of the difference between the target picture and the reference picture as the difference information.
  • the server or terminal device may separately calculate the difference between each reference picture and the target picture, determine multiple difference information, and retain the difference information with the smallest amount of data and its Corresponding reference pictures.
  • S505 The server saves the difference information corresponding to the target picture.
  • the server may use the reference picture identifier and the difference information as backup information of the target icon, and store the backup information. That is to say, the terminal device does not need to upload the target picture, and the server does not need to store the target picture, but stores backup information to realize the backup of the target picture.
  • the server When the backup information of the target picture is stored in the server, if the server receives a download request sent by the terminal device, the download request is used to request to download the target picture, and the server can send the backup information of the target picture and the reference picture to the terminal device, The terminal device synthesizes the target picture according to the backup information and the reference picture; or, the server can synthesize the target picture according to the backup information of the target picture and the reference picture, and then sends the target picture to the terminal device.
  • the server when the terminal device needs to back up the target picture on the server, the server can first determine at least one second user associated with the first user, and the pictures backed up by at least one second user in the storage device Can be used as at least one candidate picture. Screening the reference picture from at least one picture backed up by the second user can narrow down the range of candidate pictures, thereby improving the efficiency of determining the reference picture.
  • the storage device or the terminal device may determine difference information of the target picture relative to the reference picture.
  • the terminal device does not need to actually upload the target picture
  • the storage device does not need to store the target picture, but stores the difference information of the target picture to realize the backup of the target picture, saving the bandwidth cost of picture backup and saving the storage cost, and efficiently realizes Image backup.
  • the first user set may further include multiple subsets, and different subsets may correspond to different relationships between the first user and the second user.
  • a first set of users may include subset A, subset B, subset C, and subset D.
  • the second user in the subset A is a user who has the same common wlan as the first user
  • the second user's motion track in the subset B is a user whose motion track coincidence degree with the first user is greater than a second threshold
  • the subset The second user in the set C is the user who has the same label as the first user
  • the second user in the subset D is the user who has the same label as the first user.
  • the terminal device may request to upload multiple pictures in batches to the server.
  • the terminal device may classify the multiple pictures, and different types of pictures may correspond to different sub-sets in the first user set. For example, pictures whose type is "attractions" may correspond to the above-mentioned subset C, and pictures whose type is "food” may correspond to the above-mentioned subset D.
  • the server or terminal device can search for the reference picture corresponding to the picture to be uploaded in the backup pictures of the sub-set corresponding to the type, so as to prioritize the search space and improve the efficiency of searching for the reference picture.
  • FIG. 10 is a flow chart of the method for the first picture backup example provided in this application.
  • the server determines the reference picture corresponding to the target picture requested to be uploaded by the terminal device, and calculates the difference information corresponding to the target picture.
  • the method includes the following steps:
  • S1001 The server acquires user information of a first user, and determines a first user set corresponding to the first user.
  • the first user set includes at least one second user associated with the first user.
  • S1002 The server determines a candidate picture set corresponding to the first user set.
  • the set of candidate pictures includes at least one candidate picture.
  • S1003 The terminal device sends an upload request to the server.
  • the upload request is used to request to upload the target picture, and the upload request includes the target picture and the picture information of the target picture.
  • the server determines a reference picture corresponding to the target picture according to the picture information of the target picture and the picture information of at least one candidate picture.
  • S1005 The server performs difference calculation on the target picture and the reference picture, and determines difference information corresponding to the target picture.
  • S1006 The server saves the difference information corresponding to the target picture.
  • FIG. 11 is a flow chart of the second picture backup example method provided by the present application.
  • the server determines the reference picture corresponding to the target picture that the terminal device requests to upload, but the terminal device calculates the difference information corresponding to the target picture.
  • the method includes the following steps:
  • the server acquires user information of the first user, and determines a first user set corresponding to the first user.
  • the first user set includes at least one second user associated with the first user.
  • S1102 The server determines a candidate picture set corresponding to the first user set.
  • the set of candidate pictures includes at least one candidate picture.
  • S1103 The terminal device sends an upload request to the server.
  • the upload request is used to request to upload the target picture, and the upload request includes picture information of the target picture.
  • S1104 The server determines a reference picture corresponding to the target picture according to the picture information of the target picture and the picture information of at least one candidate picture in the candidate picture set.
  • S1105 The server sends the thumbnail of the reference picture to the terminal device.
  • S1106 The terminal device performs difference calculation on the thumbnail image of the target picture and the thumbnail image of the reference picture, and determines difference information corresponding to the target picture.
  • the terminal device sends the difference information corresponding to the target picture to the server.
  • S1108 The server saves the difference information corresponding to the target picture.
  • FIG. 12 is a flow chart of the third example of picture backup provided by the present application.
  • the terminal device determines the reference picture corresponding to the target picture, and the server calculates the difference information corresponding to the target picture.
  • the method includes the following steps:
  • S1201 The server acquires user information of the first user, and determines a first user set corresponding to the first user.
  • the first user set includes at least one second user associated with the first user.
  • S1202 The server determines a candidate picture set corresponding to the first user set.
  • the set of candidate pictures includes at least one candidate picture.
  • S1203 The server sends the picture information of at least one candidate picture in the candidate picture set to the terminal device.
  • the terminal device determines the picture information of a reference picture corresponding to the target picture according to the picture information of the target picture and the picture information of at least one candidate picture.
  • S1205 The terminal device sends an upload request to the server.
  • the upload request is used to request to upload the target picture, and the upload request may include picture information of the target picture and picture information of the reference picture.
  • S1206 The server obtains the picture information of the reference picture in the upload request, and performs difference calculation on the target picture and the reference picture to determine difference information corresponding to the target picture.
  • S1207 The server saves the difference information corresponding to the target picture.
  • FIG. 13 is a flowchart of a fourth example of picture backup provided by the present application.
  • the terminal device determines the reference picture corresponding to the target picture, and calculates the difference information corresponding to the target picture.
  • the method includes the following steps:
  • the server acquires user information of the first user, and determines a first user set corresponding to the first user.
  • the first user set includes at least one second user associated with the first user.
  • S1302 The server determines a candidate picture set corresponding to the first user set.
  • the set of candidate pictures includes at least one candidate picture.
  • the server sends the picture information of at least one candidate picture in the candidate picture set to the terminal device.
  • the terminal device determines the picture information of a reference picture corresponding to the target picture according to the picture information of the target picture and the picture information of at least one candidate picture.
  • S1305 The terminal device performs difference calculation on the thumbnail image of the target picture and the thumbnail image of the reference picture, and determines difference information corresponding to the target picture.
  • S1306 The terminal device sends an upload request to the server.
  • the upload request includes the picture information of the reference picture corresponding to the target picture and the difference information corresponding to the target picture.
  • S1307 The server saves the difference information corresponding to the target picture.
  • the server determines the reference picture corresponding to the target picture requested by the terminal device to be uploaded, and the server calculates difference information corresponding to the target picture.
  • the server may include the following modules: a user set identification module, a candidate picture set determination module, a reference photo identification module, a difference calculation module, and a backup information storage module.
  • FIG. 14 is a schematic diagram of a module structure and functions of a server provided by an embodiment of the present application. The function of each module in the server will be further introduced below in conjunction with FIG. 14 .
  • the user set identification module is configured to determine the first user set corresponding to the first user according to the user information of the first user and user information of other users after receiving the user information of the first user reported by the terminal device.
  • the manner in which the user set identification module determines the first user set can refer to the implementation of S501 in FIG. 5 , which will not be repeated here.
  • the candidate picture set determining module is configured to form a candidate picture set from all pictures in the backup picture set uploaded by all users in the first user set to the server. All the pictures in the candidate picture set can be used to find whether there is a reference picture similar to the target picture to be uploaded.
  • a reference picture identifying module configured to determine a reference picture corresponding to the target picture from the candidate picture set.
  • the reference picture module may perform preliminary screening according to the picture information of the target picture and the picture information of all candidate pictures in the candidate picture set to determine similar pictures corresponding to the target picture. Then, the reference picture module can determine a reference picture corresponding to the target picture from similar pictures based on a deep learning algorithm.
  • the difference calculation module is configured to perform difference calculation on the target picture and the reference picture to obtain difference information corresponding to the target picture.
  • the difference calculation module may calculate the thumbnails of the target picture and the thumbnails of the reference picture to determine the difference information corresponding to the target picture.
  • the backup information storage module is used to generate the backup information of the target picture and store the backup information.
  • the backup information of the target picture may be a reference picture identifier and difference information corresponding to the target picture.
  • the present application further provides a picture backup device, the device includes multiple functional modules; the multiple functional modules interact to implement the methods described in the embodiments of the present application.
  • the multiple functional modules can be implemented based on software, hardware or a combination of software and hardware, and the multiple functional modules can be combined or divided arbitrarily based on specific implementations.
  • the present application also provides a storage device, which includes at least one processor and at least one memory, where computer program instructions are stored in the at least one memory, and when the storage device is running, the at least one processing The device executes the methods described in the embodiments of this application.
  • the present application further provides a computer program that, when the computer program is run on a computer, causes the computer to execute the methods described in the embodiments of the present application.
  • the present application also provides a computer-readable storage medium, where a computer program is stored in the computer-readable storage medium, and when the computer program is executed by a computer, the computer executes the computer program described in the embodiments of the present application. methods described.
  • the present application also provides a chip, the chip is used to read the computer program stored in the memory, and implement the methods described in the embodiments of the present application.
  • the present application provides a system-on-a-chip, where the system-on-a-chip includes a processor, configured to support a computer device to implement the methods described in the embodiments of the present application.
  • the chip system further includes a memory, and the memory is used to store necessary programs and data of the computer device.
  • the system-on-a-chip may consist of chips, or may include chips and other discrete devices.
  • the embodiments of the present application may be provided as methods, systems, or computer program products. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein.
  • computer-usable storage media including but not limited to disk storage, CD-ROM, optical storage, etc.
  • These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing apparatus to operate in a specific manner, such that the instructions stored in the computer-readable memory produce an article of manufacture comprising instruction means, the instructions
  • the device realizes the function specified in one or more procedures of the flowchart and/or one or more blocks of the block diagram.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Computing Systems (AREA)
  • Evolutionary Computation (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Software Systems (AREA)
  • Databases & Information Systems (AREA)
  • Artificial Intelligence (AREA)
  • Health & Medical Sciences (AREA)
  • Multimedia (AREA)
  • Quality & Reliability (AREA)
  • General Engineering & Computer Science (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

La présente demande concerne un système et un procédé de sauvegarde d'image et un dispositif. Le système de sauvegarde d'image comprend un dispositif terminal et un dispositif de stockage. Dans le système, lorsque le dispositif terminal a besoin de sauvegarder une image cible sur le dispositif de stockage, le dispositif terminal envoie une demande de sauvegarde au dispositif de stockage et le système de sauvegarde d'image peut déterminer, à partir d'au moins une image candidate stockée, des informations d'image d'une image de référence correspondant à l'image cible, la ou les images candidates comprenant une image sauvegardée dans le dispositif de stockage par au moins un second utilisateur associé à un premier utilisateur et l'image de référence étant tamisée à partir d'images sauvegardées par la ou les seconds utilisateurs de telle sorte que la gamme d'images candidates puisse être réduite, ce qui permet d'améliorer l'efficacité de détermination de l'image de référence. Après détermination de l'image de référence, le système de sauvegarde d'image peut déterminer des informations de différence de l'image cible par rapport à l'image de référence, ce qui permet d'économiser les coûts de largeur de bande et les coûts de stockage d'une sauvegarde d'image et de mettre en œuvre efficacement la sauvegarde d'image.
PCT/CN2022/124141 2021-10-15 2022-10-09 Système et procédé de sauvegarde d'image et dispositif WO2023061298A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202111202758.X 2021-10-15
CN202111202758.XA CN115994051A (zh) 2021-10-15 2021-10-15 一种图片备份***、方法与设备

Publications (1)

Publication Number Publication Date
WO2023061298A1 true WO2023061298A1 (fr) 2023-04-20

Family

ID=85988094

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/124141 WO2023061298A1 (fr) 2021-10-15 2022-10-09 Système et procédé de sauvegarde d'image et dispositif

Country Status (2)

Country Link
CN (1) CN115994051A (fr)
WO (1) WO2023061298A1 (fr)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100119170A1 (en) * 2008-11-07 2010-05-13 Yahoo! Inc. Image compression by comparison to large database
CN102999400A (zh) * 2012-11-22 2013-03-27 中国电信股份有限公司云计算分公司 一种云存储***数据备份方法及装置
CN103713964A (zh) * 2012-09-29 2014-04-09 联想(北京)有限公司 一种数据备份、恢复的方法和电子设备
CN105069075A (zh) * 2015-07-31 2015-11-18 小米科技有限责任公司 照片共享方法和装置
WO2017023332A1 (fr) * 2015-08-06 2017-02-09 Hewlett Packard Enterprise Development Lp Ensembles de données de différences
CN109271538A (zh) * 2018-08-20 2019-01-25 深圳和而泰智能控制股份有限公司 一种图片存储方法及相关设备

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100119170A1 (en) * 2008-11-07 2010-05-13 Yahoo! Inc. Image compression by comparison to large database
CN103713964A (zh) * 2012-09-29 2014-04-09 联想(北京)有限公司 一种数据备份、恢复的方法和电子设备
CN102999400A (zh) * 2012-11-22 2013-03-27 中国电信股份有限公司云计算分公司 一种云存储***数据备份方法及装置
CN105069075A (zh) * 2015-07-31 2015-11-18 小米科技有限责任公司 照片共享方法和装置
WO2017023332A1 (fr) * 2015-08-06 2017-02-09 Hewlett Packard Enterprise Development Lp Ensembles de données de différences
CN109271538A (zh) * 2018-08-20 2019-01-25 深圳和而泰智能控制股份有限公司 一种图片存储方法及相关设备

Also Published As

Publication number Publication date
CN115994051A (zh) 2023-04-21

Similar Documents

Publication Publication Date Title
JP2022532102A (ja) スクリーンショット方法及び電子装置
JP7268275B2 (ja) 着信があるときに電子デバイス上に映像を提示するための方法、および電子デバイス
US20230070358A1 (en) File Sharing Method, System, and Related Device
US20220358089A1 (en) Learning-Based Keyword Search Method and Electronic Device
WO2021088881A1 (fr) Procédé de sélection d'image et dispositif électronique
US12010257B2 (en) Image classification method and electronic device
CN113805797B (zh) 网络资源的处理方法、电子设备及计算机可读存储介质
CN116095413B (zh) 视频处理方法及电子设备
WO2023236794A1 (fr) Procédé de marquage de piste audio et dispositif électronique
US20240126424A1 (en) Picture sharing method and electronic device
CN113391743B (zh) 一种显示方法及电子设备
WO2023061298A1 (fr) Système et procédé de sauvegarde d'image et dispositif
WO2021204103A1 (fr) Procédé de prévisualisation d'images, dispositif électronique et support de stockage
WO2024041456A1 (fr) Procédé de sauvegarde de données d'application et dispositif électronique
WO2024041338A1 (fr) Procédé d'accès à des données et dispositif électronique
WO2022252805A1 (fr) Procédé d'affichage et dispositif électronique
CN115567666B (zh) 屏幕录制方法、电子设备及可读存储介质
WO2024093703A1 (fr) Procédé et appareil de gestion d'instance, et dispositif électronique et support de stockage
WO2022206600A1 (fr) Procédé et système de projection d'écran et appareil associé
WO2024022119A1 (fr) Procédé de synchronisation de données, dispositif électronique et système
WO2023045774A1 (fr) Procédé d'affichage et dispositif électronique
CN118170966A (zh) 一种推荐方法、电子设备及服务器
CN118057798A (zh) 一种应用分享方法及电子设备
CN117724640A (zh) 分屏显示方法、电子设备及存储介质
CN117724825A (zh) 一种界面显示方法及电子设备

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22880237

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE