WO2019034108A1 - Method and device for storing and displaying video data, and smart glasses - Google Patents

Method and device for storing and displaying video data, and smart glasses Download PDF

Info

Publication number
WO2019034108A1
WO2019034108A1 PCT/CN2018/100828 CN2018100828W WO2019034108A1 WO 2019034108 A1 WO2019034108 A1 WO 2019034108A1 CN 2018100828 W CN2018100828 W CN 2018100828W WO 2019034108 A1 WO2019034108 A1 WO 2019034108A1
Authority
WO
WIPO (PCT)
Prior art keywords
video data
video
target
frame
smart glasses
Prior art date
Application number
PCT/CN2018/100828
Other languages
French (fr)
Chinese (zh)
Inventor
吴志群
Original Assignee
北京达佳互联信息技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 北京达佳互联信息技术有限公司 filed Critical 北京达佳互联信息技术有限公司
Publication of WO2019034108A1 publication Critical patent/WO2019034108A1/en

Links

Images

Classifications

    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B20/00Signal processing not specific to the method of recording or reproducing; Circuits therefor
    • G11B20/10Digital recording or reproducing
    • G11B20/10527Audio or video recording; Data buffering arrangements
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/74Browsing; Visualisation therefor
    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B20/00Signal processing not specific to the method of recording or reproducing; Circuits therefor
    • G11B20/10Digital recording or reproducing
    • G11B20/10527Audio or video recording; Data buffering arrangements
    • G11B2020/10537Audio or video recording

Definitions

  • the present application relates to the field of video transmission technologies, and in particular, to a method and device for storing and displaying video data, and a smart glasses, a mobile terminal, and a computer readable storage medium.
  • the camera function component is started to be added to the eyewear device that is worn daily to realize the function of recording the content and events seen by the eye at any time; in addition, the user shares the video recorded by the glasses device, It is also necessary to transmit the video recorded by the glasses device to the mobile terminal side, thereby utilizing the mobile terminal to share the captured video.
  • the video transmission interface on the mobile terminal side can only display the transmission progress (for example, 10%), and the user cannot see the specific video content currently transmitted. .
  • the present application provides a method for storing video data, a display method, a storage device, a display device, a smart glasses, a mobile terminal, and a computer readable storage medium to solve the problem of transmitting video files to a mobile terminal through smart glasses in the prior art.
  • the video transmission interface on the mobile terminal side cannot display the problem of the specific video content currently transmitted.
  • the present application discloses a method for storing video data, which is applied to smart glasses, including:
  • the present application discloses a method for displaying video data, which is applied to a mobile terminal, and includes:
  • the at least one frame target picture is controlled to be displayed on a video transmission interface of the mobile terminal.
  • the present application discloses a storage device for video data, which is applied to smart glasses, and includes:
  • a first receiving module configured to receive a video recording instruction
  • a recording module configured to record video data according to the video recording instruction
  • An extracting module configured to extract at least one frame of the image in the video data
  • a first storage module configured to store the at least one frame of pictures in association with the video data.
  • the present application discloses a display device for video data, which is applied to a mobile terminal, and includes:
  • a first receiving module configured to receive a pairing instruction sent by the smart glasses
  • a pairing module configured to pair the smart glasses with a mobile terminal application according to the pairing instruction
  • a sending module configured to send a video synchronization instruction to the smart glasses after the pairing is successful, where the video synchronization instruction includes attribute information of the first target video data to be synchronized;
  • a second receiving module configured to receive first target video data and at least one frame target image, where the at least one frame target picture is extracted from the first target video data;
  • a control module configured to control, during the transmission of the first target video data, the at least one frame target image to be displayed on a video transmission interface of the mobile terminal.
  • the present application discloses a smart glasses, including: a memory, a processor, a camera, and a first button;
  • the processor is configured to receive a video recording instruction triggered by the first button, and control the camera to record video data according to the video recording instruction, and extract at least one frame of the image in the video data, And transmitting the stored data and the at least one frame picture to the memory;
  • the memory is configured to store the at least one frame of pictures in association with the video data.
  • the present application discloses a mobile terminal, comprising: a memory, a processor, and a display program of video data stored on the memory and operable on the processor, the video data
  • the display method of the video data applied to the mobile terminal described above is implemented when the display program is executed by the processor.
  • the present application discloses a computer readable storage medium having stored thereon a stored program of video data, the stored program of the video data being executed by a processor A method of storing video data as described on the one hand.
  • the present application discloses a computer readable storage medium having a display program of video data stored thereon, the display program of the video data being implemented by a processor to implement the above A display method of video data applied to a mobile terminal.
  • the present application includes the following advantages:
  • the present application extracts at least one frame of the recorded video data, and associates the at least one frame of the image with the corresponding video data, so that the video data recorded on the smart glasses side is recorded.
  • the video transmission interface on the mobile terminal side can display the specific video content of the currently transmitted video data, avoiding the problem that the user experience is boring or the waiting time is too long, etc. during the video transmission process.
  • FIG. 1 is a flow chart showing the steps of an embodiment of a method for storing video data applied to smart glasses according to the present application
  • FIG. 2 is a flow chart showing the steps of another embodiment of a method for displaying video data applied to a mobile terminal according to the present application;
  • FIG. 3 is a structural block diagram of an embodiment of a storage device for video data applied to smart glasses according to the present application
  • FIG. 4 is a structural block diagram of another embodiment of a display device for video data applied to a mobile terminal according to the present application
  • FIG. 5 is a structural block diagram of an embodiment of a smart glasses according to the present application.
  • a flow chart of a method for storing a video data according to an application of the present application, which is applied to the smart glasses, may specifically include the following steps:
  • Step 101 Receive a video recording instruction.
  • the user can trigger a video recording instruction to perform video recording by clicking a button on the smart glasses.
  • Step 102 Record video data according to the video recording instruction.
  • the smart glasses can open the camera of the smart glasses in response to the video recording instruction to perform video recording on the scene in the field of view of the user wearing the smart glasses, thereby obtaining video data.
  • Step 103 Extract at least one frame of the picture in the video data.
  • the one frame of the picture may be a key frame from the video data, or may be a non-key frame; it may be the first frame or the last frame. That is to say, the specific position of the frame picture in the video data is not specifically limited.
  • Step 104 Store the at least one frame of pictures in association with the video data.
  • the extracted at least one frame of the picture is stored in association with the video data that generated the picture.
  • the name includes information such as the identifier of the video 1.
  • the storage method of association between one frame of picture and corresponding video data is not limited thereto, and any one of them can realize one frame of picture and video data. Establish an associated storage method.
  • the present application extracts at least one frame of the recorded video data, and associates the at least one frame of the image with the corresponding video data, so that the video data recorded on the smart glasses side is recorded.
  • the video transmission interface on the mobile terminal side can display the specific video content of the currently transmitted video data, avoiding the problem that the user experience is boring or the waiting time is too long, etc. during the video transmission process.
  • the first frame picture and the last frame picture may also be extracted in the video data
  • the embodiment of the present application can extract the first frame picture at the beginning of the video and the last frame picture at the end of the video in the recorded video data.
  • Step 104 Store the first frame picture and the last frame picture in association with the video data.
  • the association storage manner between the two frames of pictures and the corresponding video data is not limited thereto, and any one of them can realize two frames of pictures and videos. How data is stored in association.
  • the embodiment of the present application obtains one frame of the starting time point and one frame of the ending time point in the recorded video data, and stores them in association with the recorded video data, so that when the video data is subsequently transmitted.
  • the two frames of the video-specific content can be presented to the video transmission interface on the mobile terminal side to play the video preview effect.
  • the method according to the embodiment of the present application may further include:
  • the preset image processing may include reducing the resolution of the image, cropping the edge region of the image, and the like, and the image processing manner that can make the image content of the processed image substantially consistent while reducing the storage space of the image.
  • a frame of a picture may be pixel-drawn to reduce the image size, thereby obtaining a thumbnail having a resolution of 320*240 and a size of 8k per thumbnail.
  • the at least one frame of the picture is stored in association with the video data
  • the at least one thumbnail image and the video data may be stored in association
  • the present application can save the disk storage space on the smart glasses side by processing the frame picture as a thumbnail and associating the thumbnail with the corresponding video data, and saving the video data on the smart glasses side;
  • the thumbnail can be sent to the mobile terminal side together, and the thumbnail has a small size, thereby reducing the transmission time of the thumbnail and increasing the transmission speed of the thumbnail, and the user can be paired with the smart glasses installed on the mobile terminal side.
  • the video transmission interface of the connected glasses application quickly browses the approximate video content of the video file currently transmitted by the smart glasses in a short time, so as to avoid problems such as the user feeling boring or waiting too long during the video transmission process;
  • the transfer speed of the thumbnail is fast, the influence on the transfer speed of the video data when the thumbnail is transmitted can be further reduced.
  • the actual data transmission rate is 90k-100k/s, then at least 10 thumbnails can be transmitted per second.
  • the glasses APP on the mobile terminal side can read about 10 thumbnail files in one second.
  • the method according to the embodiment of the present application may further include: receiving a video synchronization instruction sent by the mobile terminal application that is paired with the smart glasses;
  • the video recording command corresponds to a recording duration. Therefore, when the length of the recorded video reaches the recording duration, the smart glasses side stops the recording of the video.
  • the smart glasses side may further send an instruction indicating that the video data recording is completed to the glasses App (ie, the mobile terminal application) of the mobile terminal that is paired with the smart glasses, and then After receiving the instruction, the glasses App can send a video synchronization command, that is, synchronize the video data recorded on the smart glasses side to the mobile terminal side, thereby facilitating sharing by the user.
  • the video synchronization command carries the attribute information such as the ID of the video data to be synchronized, so that the smart glasses side can perform video search. Therefore, the smart glasses can search for the paired connected glasses in the recorded video data according to the video synchronization instruction.
  • the recorded video data may include multiple pieces, and only the first target video data pointed by the video synchronization instruction needs to be found from the plurality of video data.
  • the smart glasses side can respond to the video synchronization instruction to the first target video data and the at least one frame target corresponding to the first target video data extracted during video recording.
  • the picture is transmitted synchronously to the glasses app of the mobile terminal.
  • the at least one frame of the target picture may be transmitted before the first target video data, or may be simultaneously transmitted.
  • the at least one target thumbnail corresponding to the at least one frame target image is synchronized with the first target video data to the glasses App.
  • the present application transmits the transmitted video data and at least one frame of the picture corresponding to the video data to the mobile terminal when the smart glasses synchronously transmit the video data to the mobile terminal, so that the mobile
  • the video transmission interface on the terminal side can display the specific video content of the currently transmitted video data, avoiding the problem that the user experience is boring or the waiting time is too long during the video transmission process.
  • the method can also include:
  • the stored at least one frame target image is deleted, and the association relationship between the at least one frame target picture and the first target video data is deleted.
  • the glasses app of the mobile terminal sends an instruction indicating that the video synchronization is completed, and the smart glasses side Upon receiving the instruction, at least one frame of the target picture corresponding to the video that is temporarily saved is deleted, and the association relationship between the at least one frame of the target picture and the video is deleted.
  • the embodiment of the present application automatically deletes at least one frame of the video corresponding to the video on the smart glasses side (of course, if the thumbnail is deleted temporarily, the thumbnail is deleted), thereby saving Storage space on the side of the smart glasses.
  • the method according to the embodiment of the present application may further include:
  • the stored second target video data is deleted.
  • the video deletion instruction may carry attribute information such as an ID of the video data to be deleted, so that the smart glasses side can perform video search. Therefore, the smart glasses can search for the paired connection in the recorded video data according to the video deletion instruction.
  • the recorded video data may include multiple pieces, and only the second target video data pointed to by the video deletion instruction needs to be found from the plurality of video data.
  • the method according to the embodiment of the present application may further include:
  • the mobile terminal (for example, a mobile phone) side is installed with a glasses App (ie, a mobile terminal application) used in conjunction with the smart glasses, and the glasses App may generate a two-dimensional code for pairing with the smart glasses (where the two The dimension code includes the user ID of the glasses app, and the mobile terminal side needs to turn on the Bluetooth, so that the Bluetooth address is sent to the smart glasses to realize the Bluetooth connection between the mobile terminal and the smart glasses; and the user needs to wear the smart glasses and look at the mobile phone.
  • a glasses App ie, a mobile terminal application
  • the glasses App may generate a two-dimensional code for pairing with the smart glasses (where the two The dimension code includes the user ID of the glasses app, and the mobile terminal side needs to turn on the Bluetooth, so that the Bluetooth address is sent to the smart glasses to realize the Bluetooth connection between the mobile terminal and the smart glasses; and the user needs to wear the smart glasses and look at the mobile phone.
  • the two-dimensional code so that the smart glasses side scans the two-dimensional code to send a pairing instruction (which may include the ID of the smart glasses), and the mobile terminal side can associate the smart glasses with the smart glasses according to the ID
  • the mobile terminal application (for example, the user ID registered to the glasses App) is paired, and if the pairing is successful, the mobile terminal and the smart glasses can be communicatively connected.
  • the so-called pairing succeeds, if the user ID pre-registers the usage rights of the glasses device for the smart glasses ID, the pairing is successful, otherwise the pairing fails.
  • the mobile terminal side can save the ID of the glasses device pre-registered by the user ID, and when matching, the received ID from the current smart glasses can be matched with the saved glasses device ID, if consistent , the pairing is successful, otherwise, the pairing fails.
  • the mobile terminal may send the ID information of the first user logged into the glasses App to the smart glasses.
  • the smart glasses side allocates a path dedicated to storing the video data recorded by the first user, that is, the first target storage path here, to the first user who logs in to the glasses App.
  • the smart glasses side can pre-allocate different video data storage paths for different login users of the paired glasses app.
  • the storage paths of the different users of the glasses App on the smart glasses side are independent of each other and cannot be operated in an intersecting manner.
  • the video recording instruction of the first user when receiving the video recording instruction, the video recording instruction of the first user may be received;
  • the video data is stored to the first target storage path after the video data recording is completed.
  • the video data recorded in the process of pairing with the first user is stored in the first user corresponding to the first user.
  • Target storage path
  • the solution for assigning a storage path to the first user is to default that the first user is successfully connected to the smart glasses in the manner of logging in the glasses App for the first time; instead, if the first user is logged in to the glasses App and If the pairing with the smart glasses has been successful, the smart glasses side has already assigned a storage path to it in advance. Here, there is no need to allocate again, but when the video data recorded by the login user is stored, the corresponding user is directly searched.
  • the storage path can be used to store video data.
  • the present application stores video data to the smart by storing a storage path for the login user of the glasses app that is currently successfully paired with the smart glasses, and storing the video data recorded by the login user.
  • the glasses side is directed to the storage path of the logged-in user, so that video data recorded by different users of the mobile terminal application registered with the smart glasses can be stored independently of each other on the smart glasses side, and each user can only manage the videos taken by the user.
  • the data cannot be viewed by the video data captured by other users, thereby realizing the access control of the video data captured by different users of the paired mobile terminal application on the smart glasses side, thereby avoiding the problem of user privacy leakage.
  • the embodiment of the present application can separately store and store the recorded video according to different users of the login glasses App, so that each user of the glasses APP can only manage the video recorded by himself and the captured picture.
  • the user since the videos recorded on the smart glasses side are separately stored according to the login user identifier of the paired connection glasses APP, the user can only synchronize and delete the videos recorded by the smart glasses, but cannot record to other users. The video does anything.
  • the method of classifying and storing the video data according to the user ID of the login glasses App in the embodiment of the present application enables the problem that the video data privacy leakage does not exist even if the smart glasses are lost; moreover, in the smart glasses After the loss, the user can also control the smart glasses through the glasses APP of the mobile terminal, thereby clearing the data corresponding to the user ID stored in the smart glasses, and ensuring data security.
  • the method according to the embodiment of the present application may further include:
  • the currently recorded video data is transmitted in real time to the mobile terminal application that is paired with the smart glasses.
  • the user can click the live button of the smart glasses to send a live broadcast command (for the currently recorded video).
  • the upper limit of the cache of the high-definition video is 12M, and the upper limit of the cache of the low-definition video is 2M. That is to say, in the video recording process, the recorded video data is first written into the memory for buffering. When the written video data exceeds the corresponding upper limit of the cache, the embodiment of the present application can write the video data buffered in the memory at one time. The FLASH memory is inserted, and then the video data buffered in the memory is cleared; and the subsequent videos that continue to be recorded can continue to be written into the memory buffer from the beginning. In this way, on the one hand, the number of times of writing FLASH is reduced to improve the service life of FLASH; on the other hand, the power consumption of writing memory is lower than that of writing FLASH, which saves power.
  • the method in the embodiment of the present application can notify the RTSP (Real Time Streaming Protocol) service program that the available frame data arrives, and send the memory address of the currently recorded video data to the RTSP service.
  • the program, the RTSP service program after the video data is read in the specified memory address, is further sent to the RTSP client on the mobile terminal side, thereby realizing the live video, so that the user wears the smart glasses of the embodiment of the present application, and the smart glasses
  • the control is such that the various scenes seen by the user wearing the glasses are broadcast live.
  • the newly recorded video data is necessarily cached in the memory, the currently recorded video data can be directly read from the memory, and the video is broadcasted live, thereby realizing uninterrupted video live broadcast and reducing time delay.
  • the smart glasses of the embodiment can be controlled by touch control or by a button, and the smart glasses applying the above-mentioned storage method of the video data can include a frame and a temple, and the frame can be arranged by a foldable hinge structure between the temples and the frame. Rotatingly pivoted together within a fixed range.
  • An accommodating space is disposed in the temple or the frame of the glasses, wherein a printed circuit board (PCB) is disposed, and the chip is provided with a chip and a memory (including but not limited to double rate synchronous dynamic random access memory (DDR), Flash (FLASH) and MultiMedia Card (EMMC), communication modules (including but not limited to Bluetooth and/or WiFi), power components (including but not limited to batteries, charging interfaces, devices that calculate power (eg Coulomb) ()), video signal acquisition components (such as one or two cameras), audio signal acquisition components (such as one or two microphones), temperature sensors (used to measure the operating temperature of the PCB), one or two RGB LED lights (One of the RGB LEDs is placed on the outward facing side of the frame, and the other RGB LED is placed on the inside of the frame or temple near the user's left or right eye, within the wearer's visual range).
  • PCB printed circuit board
  • the chip is provided with a chip and a memory (including but not limited to double rate synchronous dynamic random access memory (DDR), Flash
  • two chips can be disposed on the PCB, one chip is used as the main control chip, and is in a sleep state in a normal state to reduce power consumption; the other chip is responsible for external interaction, and can be Bluetooth low power. Consumption (BLE) chip.
  • BLE Bluetooth low power. Consumption
  • the BLE chip is based on the 2.4 GHz ISM (Industrial Scientific Medical Band) frequency band and wirelessly communicates with the glasses APP on the mobile device.
  • the BLE chip has two peripheral device interfaces, namely a bidirectional two-wire synchronous serial bus (I 2 C) and a universal asynchronous transceiver transmitter (UART); wherein, the I 2 C external LED lamp, coulomb counter, temperature sensor;
  • the UART is connected to the main control chip. Normally, only the BLE chip is working, and the BLE chip is transmitting a broadcast packet in the working state, and is sent once every 1 second, so that the glasses APP can scan and connect to the smart glasses.
  • the BLE chip performs a write data operation on the register of the LED chip through I 2 C to control the LED lamp, and the write data command includes: an I 2 C bus address, a register address of the LED chip, and a value of a register of the LED chip, without a read operation;
  • the writeable data information of the LED includes: three color values of red, green, and blue, brightness and extinction, brightness, and the like.
  • the BLE chip controls the coulomb timing and can read data from the registers of the coulomb chip through the I 2 C bus.
  • the read data commands include: I 2 C bus address, address of the coulomb chip register, and value of the coulomb chip register.
  • Write operation wherein the readable data information of the coulomb counter includes battery power and voltage.
  • the BLE chip can read and write data to the register of the charging IC chip through the I 2 C bus.
  • the read and write commands include: I 2 C bus address, address of the charging IC register, and value of the charging IC register, data Including: charging status, charging current, charging current / voltage threshold and other related parameters.
  • the main control chip is mainly responsible for the shooting and storage of video and photos, and data transmission through Bluetooth and WIFI.
  • the BLE chip also maintains a heartbeat packet with the master chip through the UART to ensure that the master chip is always in the correct working state during power-on.
  • the main control chip sends a heartbeat packet to the BLE chip every 5 seconds. If the BLE does not receive the heartbeat packet from the main control chip for more than 3 consecutive times, the BLE will automatically power off the main control chip.
  • the BLE chip itself relies on the Watchdog Timer (WDT) to monitor whether the BLE system itself is working properly.
  • WDT Watchdog Timer
  • the WDT is an integral part of the microcontroller. It is actually a counter, generally giving the watchdog a number.
  • the WDT starts counting down after the program starts running. If the program is running normally, the CPU should issue an instruction to reset the WDT and restart the countdown. If the WDT is reduced to 0, the program is considered to be not working properly, forcing the entire system to reset. As long as the battery of the device has remaining power, the BLE chip always keeps working. If the BLE chip is not working properly, the whole system is equal. Therefore, in order to ensure the abnormal phenomenon of program running in unpredictable situations, this application implements For example, use WDT to monitor software working status.
  • event commands that the BLE chip can generate and transmit to the main control chip include: click, double click, long press for 1 second, long press for 7 seconds, and long press for 30 seconds.
  • event commands herein are merely illustrative examples and are not intended to be limited to the present application.
  • the main working states include: whether it is recording, whether it is being broadcast live, whether WIFI/Bluetooth is Work, OTA upgrade, disk storage space change, etc.
  • the BLE chip controls the power-on universal input/output (GPIO) interface to power on the main control chip, and the main control chip starts to record after starting;
  • GPIO universal input/output
  • the main control chip After the recording is completed, the main control chip sends the recorded information to the BLE chip through the UART, and the BLE chip notifies the glasses APP in time, and then the glasses APP can send corresponding instructions to the BLE chip to open the Bluetooth or WIFI function of the main control chip, and the BLE chip receives After the instruction, the instruction is transmitted to the main control chip through the UART.
  • the main control chip turns on the Bluetooth or WIFI, the BLE chip is notified by the UART to complete the opening, and finally the BLE chip will be notified of the completion of the opening to the APP;
  • the glasses APP After receiving the Bluetooth or WIFI notification, the glasses APP can bypass the BLE chip and communicate directly with the main control chip via Bluetooth/WIFI.
  • the glasses APP can read low-definition video data from the main control chip through Bluetooth, and write the OTA upgrade file of the main control chip; the HD video data can be read from the main control chip through the WIFI;
  • the glasses APP After the video data is read, the glasses APP sends an instruction to the BLE chip to turn off the Bluetooth or WIFI, and the BLE chip forwards the instruction to the main control chip, and the main control chip will uninstall the Bluetooth/WIFI service and driver, and give the Bluetooth/WIFI chip. Electricity.
  • the main control chip will start the sensor of the camera, take the original video stream, and convert the original video stream into H264 format and write it into the memory through the hardware encoder.
  • the memory will be Video data is written to the memory and the sensor of the camera is turned off;
  • the upper limit of the cache of the high-definition video is 12M, and the upper limit of the cache of the low-definition video is 2M. That is to say, in the video recording process, the recorded video data is first written into the memory for buffering. When the written video data exceeds the corresponding upper limit of the cache, the embodiment of the present application can write the video data buffered in the memory at one time. The FLASH memory is inserted, and then the video data buffered in the memory is cleared; and the subsequent videos that continue to be recorded can continue to be written into the memory buffer from the beginning. In this way, on the one hand, the number of times of writing FLASH is reduced to improve the service life of FLASH; on the other hand, the power consumption of writing memory is lower than that of writing FLASH, which saves power.
  • the main control chip receives the live broadcast command sent by the BLE chip during the recording process, it will notify the RTSP service program that the available frame data arrives, and send the memory address of the video data to the RTSP service program, and the RTSP service program specifies After the memory address is read into the video data, it is further sent to the RTSP client of the mobile APP's glasses APP.
  • the newly recorded video data is necessarily cached in the memory, the currently recorded video data can be directly read from the memory, and the video is broadcasted live, thereby realizing uninterrupted video live broadcast and reducing time delay.
  • the user can record and take photos on different keys on the smart glasses side.
  • button A is used to control the photo taken
  • button B is used to capture the video
  • the length of the recorded video can be determined by the number of intermittent presses.
  • the BLE chip responds to the interrupt, and powers up the main control chip (in the idle state, the main control chip is in the power-off state, that is, the sleep state, to reduce power consumption), and The interrupt signal is transmitted to the master chip.
  • the main control chip can recognize the interrupt signal after being powered on, and the main control chip judges by using an interrupt signal attribute pre-existing in the memory (ie, the type of operation expressed by each interrupt signal), and then the user determines that the user wants to shoot for a predetermined period of time. (for example, 11 seconds) video.
  • an interrupt signal attribute pre-existing in the memory ie, the type of operation expressed by each interrupt signal
  • the main control chip starts the camera to open the video recording. If the user does not perform any operation during the recording of the video, the main control chip controls the camera to terminate the shooting after the countdown ends.
  • the method of the embodiment of the present application can continuously store the video data buffered in the memory into the FLASH memory and give each video file according to the memory cache mechanism of the present application. Named according to the predetermined rules.
  • the main control chip After the video recording is completed, the main control chip will not be powered off immediately, and will continue to power up for a period of time, waiting for the user to trigger the command again, but if the user does not sense the trigger command within a certain period of time, it will be Electricity to avoid power consumption caused by frequent power-up and power-down.
  • the main control chip can adjust the camera parameters to control the resolution of the video recorded by the smart glasses or the photos taken.
  • the user can query the current presence of the smart glasses through the glasses APP.
  • the number of low-definition video files and the description file generated by a certain video file during the recording process thereby obtaining description information such as file name, size, date, resolution, picture, etc. of the video file; and then reading according to the description information
  • Corresponding low-definition video or picture file wherein the number of single-read bytes does not exceed 40,960 bytes; then the glasses APP can send instructions to the smart glasses to delete the read file data to improve the utilization of the storage space of the smart glasses.
  • the glasses APP can send the Bluetooth control command to the BLE chip through Bluetooth in time.
  • the embodiment of the present application can set the time for delaying the Bluetooth to be turned off, in consideration of the video behavior that the user may follow immediately. For example, when the system does not have an associated Bluetooth operation within 90 seconds, the Bluetooth module of the smart glasses is automatically turned off to save power.
  • the trigger is interrupted
  • the BLE chip responds to the interrupt
  • the interrupt signal is transmitted to the main control chip
  • the main control chip controls the camera to extend the shooting for 11 seconds, wherein the button B is pressed once.
  • the corresponding shooting time is 11 seconds. Therefore, if you click the button B again, the camera will delay shooting for 11 seconds. If you press the button B again, the additional shooting time will continue until the maximum time for setting a single shot is reached.
  • the main control chip can intercept the key frames in the video stream each time the video recording is started and the video recording is ended (I Frame). Data, and two key frame data are subjected to sampling processing to reduce image pixels to form thumbnails, and stored in the main control chip in association with the video; when the user performs video synchronization with the mobile terminal through Bluetooth or WIFI, the mobile terminal The two-frame thumbnail corresponding to the video may be received first, thereby providing the user with an experience of quickly previewing the video in the video transmission interface of the glasses APP of the mobile terminal.
  • all the video thumbnail files can be quickly read and previewed at one time, so that the user can select whether to further read the video. If it is not the data desired by the user, the user can choose to delete directly without performing the video data. Video reading.
  • the button B can be used to control video shooting
  • the button A can be used to control photo shooting.
  • the photo taken by the button A has higher definition, such as 4K image, when the smart glasses wearer
  • the BLE chip responds to the interrupt and transmits the interrupt signal to the master chip.
  • the main control chip is in the power-down sleep state at this time, the BLE chip first sends a power-on command to the main control chip to be powered on, then the main control chip starts, and the main control chip recognizes the interrupt signal as a photographing instruction, and then controls The camera captures a 4K image and, finally, the image is also stored in memory.
  • the ID of the smart glasses is generated and stored in a memory (for example, FLASH) for identifying the smart glasses, and the ID will always exist unless the FLASH is erased.
  • a memory for example, FLASH
  • the smart glasses only allow the user ID of one glasses APP to log in at the same time (ie, the communication connection), and all the video data generated by the system, the user configuration, etc., and the registered glasses only after the glasses APP is logged in until the other glasses APP is logged in.
  • the APP account is related to other accounts that are not logged in to protect the privacy of the user. Even if the device is lost, the video data will not be leaked.
  • the APP can be controlled by the APP to clear the memory of the glasses. The data corresponding to the ID.
  • the coulomb counter can periodically detect the remaining battery power of the smart glasses.
  • the power of the main control chip is controlled to ensure the safe operation of the smart glasses.
  • the smart glasses can also set only one button A, and the main control chip can distinguish the operation of taking a photo or recording a video by different pressing manners of the button A, for example, double-clicking the button A, and continuously interrupting twice.
  • the main control chip recognizes that the operation is a photographing instruction, and the main control chip captures a high-definition picture through the camera.
  • the smart glasses are provided with a plurality of LED lights, the LED flashing effects and color changes can be coordinated with the keys to avoid user misoperation.
  • the electrical state When the system power is lower than 8%, and the device is in the battery power state, the recording behavior will be ignored and the LED status will be changed to prompt the user.
  • the temperature sensor detects the overheated state: when the system temperature exceeds 60 degrees, the recording behavior will be ignored and the LED status will be changed to prompt the user.
  • FIG. 2 a flow chart of the steps of the method for displaying another video data of the present application is shown, which is applied to the mobile terminal.
  • the method may include the following steps:
  • Step 201 Receive a pairing instruction sent by the smart glasses.
  • the glasses App installed in the mobile terminal (for example, a mobile phone) side and used in conjunction with the smart glasses may generate a two-dimensional code for pairing with the smart glasses (where the two-dimensional code includes a user ID of the glasses App), Moreover, the mobile terminal side needs to turn on the Bluetooth, so that the Bluetooth address is sent to the smart glasses to realize the Bluetooth connection between the mobile terminal and the smart glasses; and the user needs to wear the smart glasses and look at the two-dimensional code on the mobile phone, thereby realizing the smart glasses side pair
  • the scanning of the two-dimensional code is to send a pairing instruction (which may include the ID of the smart glasses), and the glasses App of the mobile terminal side can receive the pairing instruction.
  • Step 202 Pair the smart glasses with a mobile terminal application according to the pairing instruction
  • the smart glasses can be paired with the glasses App of the mobile terminal according to the ID of the smart glasses in the pairing instruction. If the pairing is successful, the glasses App of the mobile terminal and the smart glasses can be communicably connected. In the so-called pairing success, if the user ID registered in the glasses app is registered in advance with the right to use the glasses device of the smart glasses ID, the pairing is successful, otherwise it fails.
  • the mobile terminal side can save the ID of the glasses device pre-registered by the user ID, and when matching, the received ID from the current smart glasses can be matched with the saved glasses device ID. The match is successful, otherwise it fails.
  • Step 203 After the pairing is successful, send a video synchronization instruction to the smart glasses, where the video synchronization instruction includes attribute information of the first target video data to be synchronized;
  • the video recording instruction can correspond to a recording duration. Therefore, when the length of the recorded video reaches the recording duration or after, the smart glasses side stops the recording of the video, and the mobile terminal side glasses App can end at the video recording.
  • the video sync command is sent to the smart glasses later (immediately or over a period of time).
  • the smart glasses side may further send an instruction indicating that the video data recording is completed to the mobile terminal side, and after the mobile terminal receives the instruction, the mobile terminal side may pass the foregoing.
  • the glasses APP sends a video synchronization command, that is, the video data recorded on the smart glasses side is synchronized to the glasses App on the mobile terminal side, thereby facilitating sharing by the user.
  • the video synchronization instruction carries the attribute information of the first target video data to be synchronized (for example, the identification information such as the ID of the first target video data), thereby facilitating the video search by the smart glasses side;
  • the smart glasses can search for the first target video data that the user needs to synchronize in the recorded video data according to the video synchronization instruction.
  • the recorded video data may include multiple pieces, and only the first target video data pointed by the video synchronization instruction needs to be found from the plurality of video data.
  • Step 204 Receive first target video data and at least one frame target image, where the at least one frame target picture is extracted from the first target video data.
  • the mobile terminal can receive the first target video data sent by the smart glasses side in response to the video synchronization instruction and at least one frame corresponding to the first target video data.
  • Target image After the smart glasses side finds the first target video data, the mobile terminal can receive the first target video data sent by the smart glasses side in response to the video synchronization instruction and at least one frame corresponding to the first target video data. Target image.
  • the at least one frame of the target picture may be transmitted before the first target video data, or may be simultaneously transmitted.
  • the one frame of the picture may be a key frame extracted from the video data, or may be a non-key frame; it may be the first frame or the last frame. That is to say, the present application does not specifically limit the specific location of a frame of picture in the video data.
  • Step 205 Control, during the transmission of the first target video data, the at least one frame target image to be displayed on a video transmission interface of the mobile terminal.
  • the mobile terminal may control the at least one frame of the target picture to be displayed on the video transmission interface of the glasses APP during the first target video data transmission.
  • the application sends a video synchronization instruction to the smart glasses, so that when receiving the first target video data from the smart glasses, at least the extracted from the first target video data may be received.
  • a frame of the target picture thereby controlling at least one frame of the target picture to be displayed on the video transmission interface of the first target video data, so that when the video data is synchronized from the smart glasses to the mobile terminal, the user can preview the specific content of the video data in the video transmission interface.
  • Video content avoiding the problem of poor user experience, such as the user feeling boring during the video transmission process or feeling that the waiting time is too long.
  • one frame of the target picture is controlled to be displayed in full screen on the video transmission interface of the mobile terminal.
  • the frame image can be displayed as a cover image on the video transmission interface of the glasses APP.
  • At least two frames of target pictures are controlled to be alternately displayed on the video transmission interface of the mobile terminal.
  • two or more frames of pictures can be alternately displayed in the video transmission interface of the corresponding video, as for the two frames of the adjacent display.
  • the time intervals can be the same or different.
  • the method according to the embodiment of the present application may further include: sending identification information of the first user that logs in to the mobile terminal application. .
  • the smart glasses side can realize the access control to realize the independent access of the video data of different users, and the smart glasses can be received according to the received
  • the first user's identification information (such as an ID) to allocate a storage path for the first user to exclusively store the video data of the recording
  • the storage path of the first user may be directly determined according to the identification information of the first user, thereby facilitating subsequent recording. Specialized storage of video data.
  • the method according to the embodiment of the present application may further include:
  • the glasses app of the mobile terminal side after the glasses app of the mobile terminal is successfully paired with the smart glasses, the glasses app of the mobile terminal side also saves the identification information of the smart glasses, and the user can use the glasses APP to the smart glasses.
  • the naming is performed so that the user can manage a plurality of smart glasses devices connected to the mobile terminal.
  • the method according to the embodiment of the present application may further include:
  • the video deletion instruction includes attribute information of the second target video data to be deleted (eg, identifier of the second target video data) information).
  • the mobile terminal can control to delete the video data recorded by the mobile terminal on the smart glasses side through the glasses APP.
  • the method according to the embodiment of the present application may further include:
  • the currently recorded video data from the smart glasses is received and played in real time.
  • the user can click the live button of the smart glasses to send a live broadcast command (for the currently recorded video) to the smart glasses side. Then the smart glasses side can promptly notify the RTSP service program that the available frame data arrives, and send the memory address of the currently recorded video data to the RTSP service program, and the RTSP service program will read the video data at the specified memory address, further
  • the RTSP client is sent to the mobile terminal side to realize live video, so that the RTSP client of the mobile terminal can receive the video data sent by the RTSP service program of the smart glasses in real time and perform live broadcast. In this way, the user performs live video broadcast on various scenes seen by the user on the mobile terminal side by wearing the smart glasses of the embodiment of the present application.
  • FIG. 3 a block diagram of a storage device embodiment of the video data of the present application is shown, which is applied to the smart glasses.
  • Can include the following modules:
  • a first receiving module 31 configured to receive a video recording instruction
  • the recording module 32 is configured to record video data according to the video recording instruction
  • An extracting module 33 configured to extract at least one frame of the picture in the video data
  • the first storage module 34 is configured to store the at least one frame of pictures in association with the video data.
  • the device may further include:
  • a processing module configured to perform preset image processing on the at least one frame of the image to obtain at least one thumbnail image
  • the first storage module 34 includes:
  • a storage submodule configured to store the at least one thumbnail and the video data in association.
  • the device may further include:
  • a second receiving module configured to receive a video synchronization instruction sent by a mobile terminal application that is paired with the smart glasses
  • a searching module configured to search, in the video data, the first target video data to be synchronized according to the video synchronization instruction
  • a synchronization module configured to synchronize the first target video data and the at least one frame target picture corresponding to the first target video data to the mobile terminal.
  • the device may further include:
  • a deleting module configured to delete the stored at least one frame target image and delete the at least one frame target image and the first target video, if receiving an instruction indicating that the first target video data is synchronized The relationship of the data.
  • the device may further include:
  • a sending module configured to send a pairing instruction to the mobile terminal application
  • a third receiving module configured to: if the smart glasses are successfully paired with the mobile terminal application, receive identification information of the first user that logs in to the mobile terminal application;
  • An allocating module configured to allocate, by the first user, a first target storage path for storing video data recorded by the first user, according to the identifier information of the first user;
  • the first receiving module 31 includes: a receiving submodule, configured to receive a video recording instruction of the first user;
  • a second storage module configured to store the video data to the first target storage path after the video data recording is completed.
  • the device may further include:
  • the transmission module is configured to transmit the currently recorded video data to the mobile terminal application in real time if the live broadcast command is received during the video recording process.
  • FIG. 4 a structural block diagram of an embodiment of a display device for video data according to the present application is shown, which is applied to a mobile terminal.
  • Can include the following modules:
  • the first receiving module 41 is configured to receive a pairing instruction sent by the smart glasses
  • the pairing module 42 is configured to pair the smart glasses with the mobile terminal application according to the pairing instruction;
  • the sending module 43 is configured to send a video synchronization instruction to the smart glasses after the pairing is successful, where the video synchronization instruction includes attribute information of the first target video data to be synchronized;
  • the second receiving module 44 is configured to receive the first target video data and the at least one frame target image, where the at least one frame target image is extracted from the first target video data;
  • the control module 45 is configured to control the at least one frame of the target picture to be displayed on the video transmission interface of the mobile terminal during the transmission of the first target video data.
  • control module 45 includes:
  • a first control submodule configured to: when a quantity of the at least one frame of the target picture is one, control a frame of the target picture to be full screen on the video transmission interface of the mobile terminal during the transmission of the first target video data display.
  • control module 45 includes:
  • a second control submodule configured to control at least two target frame pictures in the transmitting process of the first target video data when the number of the at least one frame target picture is two or more
  • the video transmission interface of the mobile terminal is alternately displayed.
  • FIG. 5 a block diagram of a smart glasses embodiment of the present application is shown, which may specifically include: a memory 51, a processor. 52, the camera 53, the first button 54;
  • the processor 52 is configured to receive a video recording instruction triggered by the first button 54 and control the camera 53 to record video data according to the video recording instruction, and extract at least one of the video data. Frame the picture, and send the stored data and the at least one frame picture to the memory 51;
  • the memory 51 is configured to store the at least one frame of pictures in association with the video data.
  • the processor 52 is further configured to perform preset image processing on the at least one frame of the image, obtain at least one thumbnail image, and send the at least one thumbnail image to the memory 51;
  • the memory 51 is further configured to store the at least one thumbnail and the video data in association.
  • the smart glasses according to the embodiments of the present application may further include:
  • the receiver is configured to receive a video synchronization command sent by the mobile terminal application that is paired with the smart glasses and sent to the processor 52;
  • the processor 52 is further configured to search, in the video data stored in the memory 51, the first target video data to be synchronized and the at least one frame target corresponding to the first target video data according to the video synchronization instruction. And transmitting the first target video data and the at least one frame target picture to the transmitter;
  • the transmitter is configured to synchronize the first target video data and the at least one frame target picture to the mobile terminal application.
  • the processor 52 is further configured to: when the receiver receives an instruction indicating that the first target video data synchronization is completed, storing the At least one frame of the target picture is deleted, and the association relationship between the at least one frame of the target picture and the first target video data is deleted.
  • the transmitter is further configured to send a pairing instruction to the mobile terminal application
  • the receiver is further configured to receive, when the smart glasses are successfully paired with the mobile terminal application, the identification information of the first user that logs in to the mobile terminal application, and send the identification information to the processor 52;
  • the processor 52 is configured to allocate, according to the identifier information of the first user, a first target storage path configured to store video data recorded by the first user, for the first user;
  • the processor 52 is further configured to receive a video recording instruction triggered by the first user pressing the first button 54;
  • the memory 51 is further configured to store the video data recorded by the camera 53 to the first target storage path after the video data recording is completed.
  • the transmitter is further configured to transmit the video data currently recorded by the camera 53 in real time when the receiver is configured to receive a live broadcast command during video recording.
  • the transmitter is further configured to transmit the video data currently recorded by the camera 53 in real time when the receiver is configured to receive a live broadcast command during video recording.
  • a mobile terminal comprising: a memory, a processor, and a display program of video data stored on the memory and operable on the processor, the video data The step of implementing the display method of the video data applied to the mobile terminal as described above when the program is executed by the processor.
  • a computer readable storage medium having stored thereon a display program of video data, the display program of the video data being executed by a processor as described above A step in a display method of video data applied to a mobile terminal.
  • the device the smart glasses, the mobile terminal, and the computer readable storage medium embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the description of the method embodiment.
  • embodiments of the embodiments of the present application can be provided as a method, apparatus, or computer program product. Therefore, the embodiments of the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware. Moreover, embodiments of the present application can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) including computer usable program code.
  • computer-usable storage media including but not limited to disk storage, CD-ROM, optical storage, etc.
  • Embodiments of the present application are described with reference to flowcharts and/or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the present application. It will be understood that each flow and/or block of the flowchart illustrations and/or FIG.
  • These computer program instructions can be provided to a processor of a general purpose computer, special purpose computer, embedded processor or other programmable data processing terminal device to produce a machine such that instructions are executed by a processor of a computer or other programmable data processing terminal device
  • Means are provided for implementing the functions specified in one or more of the flow or in a block or blocks of a flow diagram.
  • the computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing terminal device to operate in a particular manner, such that instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device.
  • the instruction device implements the functions specified in one or more blocks of the flow or in a flow or block diagram of the flowchart.
  • the method for storing video data applied to smart glasses provided by the present application, a display method for video data applied to a mobile terminal, a storage device for video data applied to smart glasses, and a method for moving
  • a display device for video data of a terminal, a smart glasses, a mobile terminal, and a computer readable storage medium applied to the mobile terminal are described in detail.
  • a specific example is applied to the principle and implementation manner of the present application.
  • the descriptions of the above embodiments are only used to help understand the method of the present application and its core ideas; at the same time, for those skilled in the art, according to the idea of the present application, there will be specific implementations and application scopes.
  • the contents of the present specification should not be construed as limiting the present application.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Mobile Radio Communication Systems (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

A method and device for storing video data applied to smart glasses. The method comprises: transmitting a pairing instruction to a mobile terminal; if the pairing between smart glasses and the mobile terminal is successful, receiving a video recording instruction (101); recording video data according to the video recording instruction (102); extracting at least one image of the video data (103); and associating the at least one image with the video data and storing the same (104). The above method uses smart glasses to record video data, extracts at least one image of the recorded video data and associates the at least one image with the corresponding video data and stores the same, such that when the video data recorded at the smart glasses is transferred to a mobile terminal, a video transferring interface at the mobile terminal can display particular video contents of the currently transferred video data to address the problem of poor user experience caused when a user is bored or waits for too long during a video transferring process.

Description

视频数据的存储、显示方法和装置以及智能眼镜Video data storage, display method and device, and smart glasses
交互参考Cross reference
本申请要求以下优先权:2017年08月17日提出的申请号:201710708979.1,名称:“视频数据的存储、显示方法和装置以及智能眼镜”的中国专利,本申请参考引用了如上所述申请的全部内容。The present application claims the following priority: Application No.: 201710708979.1, entitled: "Storage, Display Method and Apparatus for Video Data, and Smart Glasses", filed on Aug. 17, 2017, the disclosure of which is incorporated herein by reference. all content.
技术领域Technical field
本申请涉及视频传输技术领域,特别是涉及一种视频数据的存储、显示方法和装置以及一种智能眼镜、移动终端和计算机可读存储介质。The present application relates to the field of video transmission technologies, and in particular, to a method and device for storing and displaying video data, and a smart glasses, a mobile terminal, and a computer readable storage medium.
背景技术Background technique
随着科技发展,用户越来越多地希望能够通过电子设备记录生活中发生的事件,传统技术中,用户通过手机或者相机进行拍摄,但是该些传统的电子设备(例如相机、平板电脑、手机等)体积较大,并且在使用时需要较长的反应时间,而需要记录的事件的持续时间往往很短。例如在使用相机时,用户需要先开机,再对焦,最后进行拍摄等动作,而一系列的动作完成后,需要记录的事件已经结束,这给用户带来较差的事件记录体验。With the development of technology, users are increasingly hoping to record events happening in their lives through electronic devices. In traditional technology, users use mobile phones or cameras to shoot, but these traditional electronic devices (such as cameras, tablets, mobile phones) Etc.) is bulky and requires a long reaction time when used, and the duration of events that need to be recorded is often very short. For example, when using the camera, the user needs to start up, focus again, and finally perform shooting, and after a series of actions are completed, the event to be recorded has ended, which brings a poor event recording experience to the user.
因此,相关技术中,开始在日常佩戴的眼镜设备中加入摄像功能组件,以实现对眼睛所看到的内容和事件进行随时记录的功能;此外,用户为了实现对眼镜设备记录的视频进行分享,还需要将眼镜设备记录的视频传输到移动终端侧,从而利用移动终端来对拍摄的视频进行分享。Therefore, in the related art, the camera function component is started to be added to the eyewear device that is worn daily to realize the function of recording the content and events seen by the eye at any time; in addition, the user shares the video recorded by the glasses device, It is also necessary to transmit the video recorded by the glasses device to the mobile terminal side, thereby utilizing the mobile terminal to share the captured video.
但是,在相关技术中,用户通过智能眼镜向移动终端传输视频文件时,移动终端侧的视频传输界面只能显示传输进度(例如10%),而用户并不能看到当前所传输的具体视频内容。However, in the related art, when a user transmits a video file to a mobile terminal through the smart glasses, the video transmission interface on the mobile terminal side can only display the transmission progress (for example, 10%), and the user cannot see the specific video content currently transmitted. .
发明内容Summary of the invention
本申请提供了一种视频数据的存储方法、显示方法、存储装置、显示装置、智能眼镜、移动终端和计算机可读存储介质,以解决现有技术中在通过智能眼镜向移动终端传输视频文件时,移动终端侧的视频传输界面无法显示当前所传输的具体视频内容的问题。The present application provides a method for storing video data, a display method, a storage device, a display device, a smart glasses, a mobile terminal, and a computer readable storage medium to solve the problem of transmitting video files to a mobile terminal through smart glasses in the prior art. The video transmission interface on the mobile terminal side cannot display the problem of the specific video content currently transmitted.
为了解决上述问题,根据本申请的第一方面,本申请公开了一种视频数据的存储方法,应用于智能眼镜,包括:In order to solve the above problem, according to the first aspect of the present application, the present application discloses a method for storing video data, which is applied to smart glasses, including:
接收视频录制指令;Receiving a video recording instruction;
根据所述视频录制指令,录制视频数据;Recording video data according to the video recording instruction;
在所述视频数据中提取至少一帧图片;Extracting at least one frame of the picture in the video data;
将所述至少一帧图片与所述视频数据关联存储。And storing the at least one frame of pictures in association with the video data.
根据本申请的第二方面,本申请公开了一种视频数据的显示方法,应用于移动终端,包括:According to the second aspect of the present application, the present application discloses a method for displaying video data, which is applied to a mobile terminal, and includes:
接收智能眼镜发送的配对指令;Receiving a pairing instruction sent by the smart glasses;
根据所述配对指令将所述智能眼镜与移动终端应用程序配对;Pairing the smart glasses with a mobile terminal application according to the pairing instruction;
在配对成功后,发送视频同步指令至所述智能眼镜,所述视频同步指令包括待同步的第一目标视频数据的属性信息;After the pairing is successful, sending a video synchronization instruction to the smart glasses, where the video synchronization instruction includes attribute information of the first target video data to be synchronized;
接收第一目标视频数据和至少一帧目标图片,其中,所述至少一帧目标图片提取自所述第一目标视频数据;Receiving first target video data and at least one frame target image, wherein the at least one frame target picture is extracted from the first target video data;
在所述第一目标视频数据的传输过程中,控制所述至少一帧目标图片在所述移动终端的视频传输界面显示。During the transmission of the first target video data, the at least one frame target picture is controlled to be displayed on a video transmission interface of the mobile terminal.
根据本申请的第三方面,本申请公开了一种视频数据的存储装置,应用于智能眼镜,包括:According to the third aspect of the present application, the present application discloses a storage device for video data, which is applied to smart glasses, and includes:
第一接收模块,用于接收视频录制指令;a first receiving module, configured to receive a video recording instruction;
录制模块,用于根据所述视频录制指令,录制视频数据;a recording module, configured to record video data according to the video recording instruction;
提取模块,用于在所述视频数据中提取至少一帧图片;An extracting module, configured to extract at least one frame of the image in the video data;
第一存储模块,用于将所述至少一帧图片与所述视频数据关联存储。a first storage module, configured to store the at least one frame of pictures in association with the video data.
根据本申请的第四方面,本申请公开了一种视频数据的显示装置,应用于移动终端,包括:According to the fourth aspect of the present application, the present application discloses a display device for video data, which is applied to a mobile terminal, and includes:
第一接收模块,用于接收智能眼镜发送的配对指令;a first receiving module, configured to receive a pairing instruction sent by the smart glasses;
配对模块,用于根据所述配对指令将所述智能眼镜与移动终端应用程序配对;a pairing module, configured to pair the smart glasses with a mobile terminal application according to the pairing instruction;
发送模块,用于在配对成功后,发送视频同步指令至所述智能眼镜,所述视频同步指令包括待同步的第一目标视频数据的属性信息;a sending module, configured to send a video synchronization instruction to the smart glasses after the pairing is successful, where the video synchronization instruction includes attribute information of the first target video data to be synchronized;
第二接收模块,用于接收第一目标视频数据和至少一帧目标图片,其中,所述至少一帧目标图片提取自所述第一目标视频数据;a second receiving module, configured to receive first target video data and at least one frame target image, where the at least one frame target picture is extracted from the first target video data;
控制模块,用于在所述第一目标视频数据的传输过程中,控制所述至少一帧目标图片在所述移动终端的视频传输界面显示。And a control module, configured to control, during the transmission of the first target video data, the at least one frame target image to be displayed on a video transmission interface of the mobile terminal.
根据本申请的第五方面,本申请公开了一种智能眼镜,包括:存储器、处理器、摄像头、第一按键;According to a fifth aspect of the present application, the present application discloses a smart glasses, including: a memory, a processor, a camera, and a first button;
所述处理器,被配置为接收由所述第一按键触发的视频录制指令,并根据所述视频录制指令,控制所述摄像头录制视频数据,并在所述视频数据中提取至少一帧图片,并将所述存储数据和所述至少一帧图片发送至所述存储器;The processor is configured to receive a video recording instruction triggered by the first button, and control the camera to record video data according to the video recording instruction, and extract at least one frame of the image in the video data, And transmitting the stored data and the at least one frame picture to the memory;
所述存储器,被配置为将所述至少一帧图片与所述视频数据关联存储。The memory is configured to store the at least one frame of pictures in association with the video data.
根据本申请的第六方面,本申请公开了一种移动终端,包括:存储器、处理器及存储在所述存储器上并可在所述处理器上运行的视频数据的显示程序,所述视频数据的显示程序被所述处理器执行时实现上述应用于移动终端的视频数据的显示方法。According to a sixth aspect of the present application, the present application discloses a mobile terminal, comprising: a memory, a processor, and a display program of video data stored on the memory and operable on the processor, the video data The display method of the video data applied to the mobile terminal described above is implemented when the display program is executed by the processor.
根据本申请的第七方面,本申请公开了一种计算机可读存储介质,所述计算机可读存储介质上存储有视频数据的存储程序,所述视频数据的存储程序被处理器执行时实现第一方面所述的视频数据的存储方法。According to a seventh aspect of the present application, the present application discloses a computer readable storage medium having stored thereon a stored program of video data, the stored program of the video data being executed by a processor A method of storing video data as described on the one hand.
根据本申请的第八方面,本申请公开了一种计算机可读存储介质,所述计算机可读存储介质上存储有视频数据的显示程序,所述视频数据的显示程序被处理器执行时实现上述应用于移动终端的视频数据的显示方法。According to an eighth aspect of the present application, the present application discloses a computer readable storage medium having a display program of video data stored thereon, the display program of the video data being implemented by a processor to implement the above A display method of video data applied to a mobile terminal.
与现有技术相比,本申请包括以下优点:Compared with the prior art, the present application includes the following advantages:
这样,本申请通过使用智能眼镜录制视频数据时,并对录制的视频数据提取至少一帧图片,并将该至少一帧图片与对应的视频数据关联存储,使得在将智能眼镜侧录制的视频数据传输至移动终端时,能够使移动终端侧的视频传输界面显示当前传输的视频数据的具体视频内容,避免在视频传输过程中用户感觉枯燥或觉得等待时间太长 等用户体验差的问题。In this way, when the video data is recorded by using the smart glasses, the present application extracts at least one frame of the recorded video data, and associates the at least one frame of the image with the corresponding video data, so that the video data recorded on the smart glasses side is recorded. When transmitting to the mobile terminal, the video transmission interface on the mobile terminal side can display the specific video content of the currently transmitted video data, avoiding the problem that the user experience is boring or the waiting time is too long, etc. during the video transmission process.
附图说明DRAWINGS
图1是本申请的一种应用于智能眼镜的视频数据的存储方法实施例的步骤流程图;1 is a flow chart showing the steps of an embodiment of a method for storing video data applied to smart glasses according to the present application;
图2是本申请的另一种应用于移动终端的视频数据的显示方法实施例的步骤流程图;2 is a flow chart showing the steps of another embodiment of a method for displaying video data applied to a mobile terminal according to the present application;
图3是本申请的一种应用于智能眼镜的视频数据的存储装置实施例的结构框图;3 is a structural block diagram of an embodiment of a storage device for video data applied to smart glasses according to the present application;
图4是本申请的另一种应用于移动终端的视频数据的显示装置实施例的结构框图;4 is a structural block diagram of another embodiment of a display device for video data applied to a mobile terminal according to the present application;
图5是本申请的一种智能眼镜实施例的结构框图。FIG. 5 is a structural block diagram of an embodiment of a smart glasses according to the present application.
具体实施方式Detailed ways
为使本申请的上述目的、特征和优点能够更加明显易懂,下面结合附图和具体实施方式对本申请作进一步详细的说明。The above described objects, features and advantages of the present application will become more apparent and understood.
参照图1,示出了本申请的一种视频数据的存储方法实施例的步骤流程图,应用于智能眼镜,具体可以包括如下步骤:Referring to FIG. 1 , a flow chart of a method for storing a video data according to an application of the present application, which is applied to the smart glasses, may specifically include the following steps:
步骤101,接收视频录制指令;Step 101: Receive a video recording instruction.
其中,用户就可以通过点击智能眼镜上的某个按键来触发视频录制指令以进行视频录制。Among them, the user can trigger a video recording instruction to perform video recording by clicking a button on the smart glasses.
步骤102,根据所述视频录制指令,录制视频数据;Step 102: Record video data according to the video recording instruction.
其中,智能眼镜可以响应于该视频录制指令,开启智能眼镜的摄像头,来对佩戴该智能眼镜的用户视野内的场景进行视频录制,从而得到视频数据。The smart glasses can open the camera of the smart glasses in response to the video recording instruction to perform video recording on the scene in the field of view of the user wearing the smart glasses, thereby obtaining video data.
步骤103,在所述视频数据中提取至少一帧图片;Step 103: Extract at least one frame of the picture in the video data.
其中,上述一帧图片可以是来自视频数据中的关键帧,也可以是非关键帧;可以是第一帧,也可以是最后一帧。也就是说,本申请对于该帧图片在视频数据中的具***置并不作具体限制。The one frame of the picture may be a key frame from the video data, or may be a non-key frame; it may be the first frame or the last frame. That is to say, the specific position of the frame picture in the video data is not specifically limited.
步骤104,将所述至少一帧图片与所述视频数据关联存储。Step 104: Store the at least one frame of pictures in association with the video data.
也就是说,提取的至少一帧图片与产生该图片的视频数据是关联存储的。在一个具体实例中,例如在视频1中提取一帧图片1、一帧图片2,则将一帧图片1和一帧图片2存储在一个文件夹名称为视频1的临时文件夹中;或是将一帧图片1和一帧图片2临时存储时,在对帧图片命名时,其名称包括视频1的标识等信息。当然这里只是列举了一些建立关联存储的示例,而在实际应用中,一帧图片与对应的视频数据之间的关联存储方式并不限于此,可以是任意一种能够实现一帧图片与视频数据建立关联的存储方式。That is to say, the extracted at least one frame of the picture is stored in association with the video data that generated the picture. In a specific example, for example, when one frame of picture 1 and one frame of picture 2 are extracted in video 1, one picture 1 and one picture 2 are stored in a temporary folder whose name is video 1; or When one frame picture 1 and one frame picture 2 are temporarily stored, when the frame picture is named, the name includes information such as the identifier of the video 1. Of course, only some examples of establishing association storage are listed here. In practical applications, the storage method of association between one frame of picture and corresponding video data is not limited thereto, and any one of them can realize one frame of picture and video data. Establish an associated storage method.
另外,需要注意的是,本申请实施例的至少一帧图片在智能眼镜侧保存时,可以以临时文件的方式进行保存。In addition, it should be noted that when at least one frame of the image in the embodiment of the present application is saved on the smart glasses side, it may be saved as a temporary file.
这样,本申请通过使用智能眼镜录制视频数据时,并对录制的视频数据提取至少一帧图片,并将该至少一帧图片与对应的视频数据关联存储,使得在将智能眼镜侧录制的视频数据传输至移动终端时,能够使移动终端侧的视频传输界面显示当前传输的视频数据的具体视频内容,避免在视频传输过程中用户感觉枯燥或觉得等待时间太长等用户体验差的问题。In this way, when the video data is recorded by using the smart glasses, the present application extracts at least one frame of the recorded video data, and associates the at least one frame of the image with the corresponding video data, so that the video data recorded on the smart glasses side is recorded. When transmitting to the mobile terminal, the video transmission interface on the mobile terminal side can display the specific video content of the currently transmitted video data, avoiding the problem that the user experience is boring or the waiting time is too long, etc. during the video transmission process.
在一种可能的实施方式中,在执行步骤103时,还可以在所述视频数据中提取第一帧图片和最后一帧图片;In a possible implementation manner, when performing step 103, the first frame picture and the last frame picture may also be extracted in the video data;
也就是说,本申请实施例可以在录制完成的视频数据中提取视频开始时的第一帧图片和视频结束时的最后一帧图片。That is to say, the embodiment of the present application can extract the first frame picture at the beginning of the video and the last frame picture at the end of the video in the recorded video data.
步骤104,将所述第一帧图片和最后一帧图片与所述视频数据关联存储。Step 104: Store the first frame picture and the last frame picture in association with the video data.
在一个具体实例中,例如在视频1中提取第一帧图片1、最后一帧图片2,则将第一帧图片1、最后一帧图片2存储在一个文件夹名称为视频1的临时文件夹中;或是将第一帧图片1、最后一帧图片2临时存储时,在对帧图片命名时,其名称包括视频1的标识等信息。当然这里只是列举了一些建立关联存储的示例,而在实际应用中,这两帧图片与对应的视频数据之间的关联存储方式并不限于此,可以是任意一种能够实现两帧图片与视频数据建立关联的存储方式。In a specific example, for example, when the first frame picture 1 and the last frame picture 2 are extracted in the video 1, the first frame picture 1 and the last frame picture 2 are stored in a temporary folder whose folder name is video 1. When the first frame picture 1 and the last frame picture 2 are temporarily stored, when the frame picture is named, the name includes the information of the video 1 and the like. Of course, only some examples of establishing association storage are listed here. In practical applications, the association storage manner between the two frames of pictures and the corresponding video data is not limited thereto, and any one of them can realize two frames of pictures and videos. How data is stored in association.
这样,本申请实施例通过获取录制的视频数据中开始时间点的一帧图片和结束时间点的一帧图片,并将它们与所录制的视频数据关联存储,使得在后续进行视频数据的传输时,能够将这两帧体现视频具体内容的图片呈现至移动终端侧的视频传输界面,起到视频预览的效果。In this way, the embodiment of the present application obtains one frame of the starting time point and one frame of the ending time point in the recorded video data, and stores them in association with the recorded video data, so that when the video data is subsequently transmitted. The two frames of the video-specific content can be presented to the video transmission interface on the mobile terminal side to play the video preview effect.
在一种可能的实施方式中,在执行步骤104之前,根据本申请实施例的方法还可以包括:In a possible implementation, before the step 104 is performed, the method according to the embodiment of the present application may further include:
对所述至少一帧图片作预设图像处理,得到至少一个缩略图;Performing preset image processing on the at least one frame of the image to obtain at least one thumbnail image;
其中,该预设图像处理可以包括降低图片的分辨率、裁剪图片的边缘区域等能够使处理后的图片的图像内容基本一致而又能够降低图片所在存储空间的图像处理方式。The preset image processing may include reducing the resolution of the image, cropping the edge region of the image, and the like, and the image processing manner that can make the image content of the processed image substantially consistent while reducing the storage space of the image.
在一个具体实例中,可以对一帧图片进行像素抽点以降低图像尺寸,从而得到一个缩略图,缩略图的分辨率为320*240,每张缩略图尺寸大小为8k。In a specific example, a frame of a picture may be pixel-drawn to reduce the image size, thereby obtaining a thumbnail having a resolution of 320*240 and a size of 8k per thumbnail.
相应的,那么在将所述至少一帧图片与所述视频数据关联存储时,则可以将所述至少一个缩略图和所述视频数据关联存储;Correspondingly, when the at least one frame of the picture is stored in association with the video data, the at least one thumbnail image and the video data may be stored in association;
这样,本申请通过将帧图片处理为缩略图并将缩略图与相应的视频数据关联存储,而由于缩略图的尺寸小,从而可以节约智能眼镜侧的磁盘存储空间;并且,在同步视频数据时,就可以将该缩略图一起发送至移动终端侧,而缩略图由于具有尺寸小,从而可以减少缩略图的传输时间,提升缩略图的传输速度,用户可以在移动终端侧安装的与智能眼镜配对连接的眼镜应用程序(APP,application)的视频传输界面短时间内快速浏览智能眼镜当前传输的视频文件的大致视频内容,以避免在视频传输过程中用户感觉枯燥或觉得等待时间太长等问题;此外,由于缩略图的传输速度快,并可进一步的减小传输缩略图时对视频数据的传输速度的影响。Thus, the present application can save the disk storage space on the smart glasses side by processing the frame picture as a thumbnail and associating the thumbnail with the corresponding video data, and saving the video data on the smart glasses side; The thumbnail can be sent to the mobile terminal side together, and the thumbnail has a small size, thereby reducing the transmission time of the thumbnail and increasing the transmission speed of the thumbnail, and the user can be paired with the smart glasses installed on the mobile terminal side. The video transmission interface of the connected glasses application (APP, application) quickly browses the approximate video content of the video file currently transmitted by the smart glasses in a short time, so as to avoid problems such as the user feeling boring or waiting too long during the video transmission process; In addition, since the transfer speed of the thumbnail is fast, the influence on the transfer speed of the video data when the thumbnail is transmitted can be further reduced.
以移动终端与智能眼镜蓝牙连接为例,按照蓝牙的RFCOMM(一种串行线性仿真协议)传输,数据的传输实际速率为90k-100k/s,那么每秒钟就可以至少传输10张缩略图,使得移动终端侧的眼镜APP在1秒钟内可以读取约10个缩略图文件。Taking the Bluetooth connection of the mobile terminal and the smart glasses as an example, according to the RFCOMM (a serial linear simulation protocol) of Bluetooth transmission, the actual data transmission rate is 90k-100k/s, then at least 10 thumbnails can be transmitted per second. The glasses APP on the mobile terminal side can read about 10 thumbnail files in one second.
在一种可能的实施方式中,在步骤104之后,根据本申请实施例的方法还可以包括:接收与所述智能眼镜配对连接的移动终端应用程序发送的视频同步指令;In a possible implementation, after the step 104, the method according to the embodiment of the present application may further include: receiving a video synchronization instruction sent by the mobile terminal application that is paired with the smart glasses;
根据所述视频同步指令在所述视频数据中查找待同步的第一目标视频数据;Searching, in the video data, the first target video data to be synchronized according to the video synchronization instruction;
将所述第一目标视频数据以及与所述第一目标视频数据对应的至少一帧目标图片同步至所述移动终端应用程序。And synchronizing the first target video data and the at least one frame target picture corresponding to the first target video data to the mobile terminal application.
其中,由于视频录制指令会对应一个录制时长,因此,在录制的视频的时间长度达到该录制时长时,则智能眼镜侧会停止视频的录制。在一种可能的实施方式中,在 视频录制完成后,智能眼镜侧还可以向与智能眼镜配对连接的移动终端的眼镜App(即移动终端应用程序)发送表示视频数据录制完成的指令,那么在眼镜App接收到该指令后,眼镜App侧就可以发送视频同步指令,即将智能眼镜侧录制的视频数据同步到移动终端侧,从而便于用户进行分享。The video recording command corresponds to a recording duration. Therefore, when the length of the recorded video reaches the recording duration, the smart glasses side stops the recording of the video. In a possible implementation manner, after the video recording is completed, the smart glasses side may further send an instruction indicating that the video data recording is completed to the glasses App (ie, the mobile terminal application) of the mobile terminal that is paired with the smart glasses, and then After receiving the instruction, the glasses App can send a video synchronization command, that is, synchronize the video data recorded on the smart glasses side to the mobile terminal side, thereby facilitating sharing by the user.
而视频同步指令中会携带有待同步的视频数据的ID等属性信息,从而便于智能眼镜侧进行视频查找,因此,智能眼镜可以根据该视频同步指令在录制的视频数据中查找该配对连接的眼镜App的登录用户所需要同步的第一目标视频数据。其中,录制的视频数据可能包括多个,而这里只需要从多个视频数据中查找到该视频同步指令所指向的第一目标视频数据。The video synchronization command carries the attribute information such as the ID of the video data to be synchronized, so that the smart glasses side can perform video search. Therefore, the smart glasses can search for the paired connected glasses in the recorded video data according to the video synchronization instruction. The first target video data that the logged in user needs to synchronize. The recorded video data may include multiple pieces, and only the first target video data pointed by the video synchronization instruction needs to be found from the plurality of video data.
而在查找到该第一目标视频数据后,智能眼镜侧就可以响应于该视频同步指令将该第一目标视频数据以及在视频录制时提取的对应于该第一目标视频数据的至少一帧目标图片同步传输至移动终端的眼镜App。After the first target video data is found, the smart glasses side can respond to the video synchronization instruction to the first target video data and the at least one frame target corresponding to the first target video data extracted during video recording. The picture is transmitted synchronously to the glasses app of the mobile terminal.
其中,至少一帧目标图片可以先于该第一目标视频数据传输,也可以同时传输。The at least one frame of the target picture may be transmitted before the first target video data, or may be simultaneously transmitted.
其中,如果该目标图片经过了上述预设图像处理,则这里连同第一目标视频数据同步至眼镜App的就是该至少一帧目标图片对应的至少一个目标缩略图。Wherein, if the target image passes the preset image processing, the at least one target thumbnail corresponding to the at least one frame target image is synchronized with the first target video data to the glasses App.
借助于本申请上述实施例的技术方案,本申请通过在智能眼镜向移动终端同步传输视频数据时,将传输的视频数据以及对应于该视频数据的至少一帧图片均发送至移动终端,使得移动终端侧的视频传输界面能够显示当前传输的视频数据的具体视频内容,避免在视频传输过程中用户感觉枯燥或觉得等待时间太长等用户体验差的问题。With the technical solution of the foregoing embodiment of the present application, the present application transmits the transmitted video data and at least one frame of the picture corresponding to the video data to the mobile terminal when the smart glasses synchronously transmit the video data to the mobile terminal, so that the mobile The video transmission interface on the terminal side can display the specific video content of the currently transmitted video data, avoiding the problem that the user experience is boring or the waiting time is too long during the video transmission process.
在一种可能的实施方式中,所述将所述第一目标视频数据以及与所述第一目标视频数据对应的至少一帧目标图片同步至所述移动终端应用程序之后,根据本申请实施例的方法还可以包括:In a possible implementation manner, after the first target video data and the at least one frame target picture corresponding to the first target video data are synchronized to the mobile terminal application, according to the embodiment of the present application The method can also include:
若接收到表示所述第一目标视频数据同步完成的指令,则将存储的所述至少一帧目标图片删除,并删除所述至少一帧目标图片与所述第一目标视频数据的关联关系。If the instruction indicating that the first target video data is synchronized is received, the stored at least one frame target image is deleted, and the association relationship between the at least one frame target picture and the first target video data is deleted.
具体而言,当某个视频和对应的至少一帧目标图片从智能眼镜侧完全传输至移动终端侧的眼镜App后,移动终端的眼镜App会发送表示该视频同步完成的指令,而智能眼镜侧一旦接收到该指令,则会将临时保存的对应该视频的至少一帧目标图片删除,并删除该至少一帧目标图片与该视频的关联关系。Specifically, when a certain video and a corresponding at least one frame target picture are completely transmitted from the smart glasses side to the glasses app of the mobile terminal side, the glasses app of the mobile terminal sends an instruction indicating that the video synchronization is completed, and the smart glasses side Upon receiving the instruction, at least one frame of the target picture corresponding to the video that is temporarily saved is deleted, and the association relationship between the at least one frame of the target picture and the video is deleted.
这样,本申请实施例通过在对同步的视频同步完成后,就将智能眼镜侧的对应该视频的至少一帧图片(当然如果临时保存的为缩略图则删除缩略图)进行自动删除,从而节约智能眼镜侧的存储空间。In this way, after the synchronization of the synchronized video is completed, the embodiment of the present application automatically deletes at least one frame of the video corresponding to the video on the smart glasses side (of course, if the thumbnail is deleted temporarily, the thumbnail is deleted), thereby saving Storage space on the side of the smart glasses.
在一种可能的实施方式中,在步骤103之后,根据本申请实施例的方法还可以包括:In a possible implementation, after the step 103, the method according to the embodiment of the present application may further include:
接收与所述智能眼镜配对连接的移动终端应用程序发送的视频删除指令;Receiving a video deletion instruction sent by the mobile terminal application that is paired with the smart glasses;
根据所述视频删除指令在所述视频数据中查找待删除的第二目标视频数据;Searching, in the video data, the second target video data to be deleted according to the video deletion instruction;
将存储的所述第二目标视频数据删除。The stored second target video data is deleted.
其中,该视频删除指令中可以携带有待删除的视频数据的ID等属性信息,从而便于智能眼镜侧进行视频查找,因此,智能眼镜可以根据该视频删除指令在录制的视频数据中查找该配对连接的眼镜App的登录用户所需要删除的第二目标视频数据。其中,录制的视频数据可能包括多个,而这里只需要从多个视频数据中查找到该视频删除指 令所指向的第二目标视频数据。The video deletion instruction may carry attribute information such as an ID of the video data to be deleted, so that the smart glasses side can perform video search. Therefore, the smart glasses can search for the paired connection in the recorded video data according to the video deletion instruction. The second target video data that the login user of the glasses App needs to delete. The recorded video data may include multiple pieces, and only the second target video data pointed to by the video deletion instruction needs to be found from the plurality of video data.
在一种可能的实施方式中,在步骤101之前,根据本申请实施例的方法还可以包括:In a possible implementation, before the step 101, the method according to the embodiment of the present application may further include:
发送配对指令至移动终端应用程序;Send a pairing command to the mobile terminal application;
其中,移动终端(例如手机)侧安装有与所述智能眼镜配套使用的眼镜App(即移动终端应用程序),该眼镜App可以生成用于与智能眼镜配对连接的二维码(其中,该二维码包括登录该眼镜App的用户ID),并且,移动终端侧需要开启蓝牙,从而发送蓝牙地址给智能眼镜实现移动终端与智能眼镜的蓝牙连接;而用户则需要佩戴该智能眼镜并注视手机上的该二维码,从而实现智能眼镜侧对该二维码的扫描以发送配对指令(可以包括智能眼镜的ID),而移动终端侧就可以根据该智能眼镜的ID来将该智能眼镜与该移动终端应用程序(例如登录该眼镜App的用户ID)配对,如果配对成功,则移动终端与智能眼镜可以通信连接。所谓配对成功,如果该用户ID预先注册了对该智能眼镜ID的眼镜设备的使用权限,则可以配对成功,否则,配对失败。Wherein, the mobile terminal (for example, a mobile phone) side is installed with a glasses App (ie, a mobile terminal application) used in conjunction with the smart glasses, and the glasses App may generate a two-dimensional code for pairing with the smart glasses (where the two The dimension code includes the user ID of the glasses app, and the mobile terminal side needs to turn on the Bluetooth, so that the Bluetooth address is sent to the smart glasses to realize the Bluetooth connection between the mobile terminal and the smart glasses; and the user needs to wear the smart glasses and look at the mobile phone. The two-dimensional code, so that the smart glasses side scans the two-dimensional code to send a pairing instruction (which may include the ID of the smart glasses), and the mobile terminal side can associate the smart glasses with the smart glasses according to the ID The mobile terminal application (for example, the user ID registered to the glasses App) is paired, and if the pairing is successful, the mobile terminal and the smart glasses can be communicatively connected. The so-called pairing succeeds, if the user ID pre-registers the usage rights of the glasses device for the smart glasses ID, the pairing is successful, otherwise the pairing fails.
换句话说,移动终端侧可以保存该用户ID所预先注册过的眼镜设备的ID,而在匹配时,就可以将接收到的来自当前智能眼镜的ID与保存的眼镜设备ID进行匹配,若一致,则配对成功,否则,配对失败。In other words, the mobile terminal side can save the ID of the glasses device pre-registered by the user ID, and when matching, the received ID from the current smart glasses can be matched with the saved glasses device ID, if consistent , the pairing is successful, otherwise, the pairing fails.
若所述智能眼镜与所述移动终端应用程序配对成功,则接收登录所述移动终端应用程序的第一用户的标识信息;And if the smart glasses are successfully paired with the mobile terminal application, receiving identification information of the first user that logs in to the mobile terminal application;
其中,如果该智能眼镜与眼镜App配对成功,则移动终端可以将登录至该眼镜App的第一用户的ID信息发送至智能眼镜。Wherein, if the smart glasses are successfully paired with the glasses App, the mobile terminal may send the ID information of the first user logged into the glasses App to the smart glasses.
根据所述第一用户的标识信息,为所述第一用户分配用于存储所述第一用户录制的视频数据的第一目标存储路径;Assigning, to the first user, a first target storage path for storing video data recorded by the first user, according to the identifier information of the first user;
其中,当配对成功后,智能眼镜侧会对登录至该眼镜App的该第一用户分配专门用于存储该第一用户录制的视频数据的路径,即这里的第一目标存储路径。When the pairing is successful, the smart glasses side allocates a path dedicated to storing the video data recorded by the first user, that is, the first target storage path here, to the first user who logs in to the glasses App.
这样,智能眼镜侧就可以为配对成功的眼镜App的不同登录用户预先分配不同的视频数据存储路径。其中,眼镜App的不同用户在智能眼镜侧的存储路径是相互独立的,无法交叉操作。In this way, the smart glasses side can pre-allocate different video data storage paths for different login users of the paired glasses app. The storage paths of the different users of the glasses App on the smart glasses side are independent of each other and cannot be operated in an intersecting manner.
相应的,在接收视频录制指令时,就可以接收所述第一用户的视频录制指令;Correspondingly, when receiving the video recording instruction, the video recording instruction of the first user may be received;
最后,在视频数据录制完成之后,将所述视频数据存储至所述第一目标存储路径。Finally, the video data is stored to the first target storage path after the video data recording is completed.
其中,由于当前与智能眼镜配对连接的眼镜App的登录用户为第一用户,因此,在与该第一用户配对连接的过程中所录制的视频数据会存储至该第一用户所对应的第一目标存储路径。The video data recorded in the process of pairing with the first user is stored in the first user corresponding to the first user. Target storage path.
其中,上述为第一用户分配存储路径的方案是默认该第一用户为首次以登录眼镜App的方式来与智能眼镜配对连接成功的情况;相反,如果该第一用户为曾经登录该眼镜App并与智能眼镜配对成功过的情况,则智能眼镜侧已经预先为其分配了存储路径,这里则无需再次进行分配,而是在对该登录用户录制的视频数据进行存储时,直接查找对应该登录用户的存储路径进行视频数据的存储即可。The solution for assigning a storage path to the first user is to default that the first user is successfully connected to the smart glasses in the manner of logging in the glasses App for the first time; instead, if the first user is logged in to the glasses App and If the pairing with the smart glasses has been successful, the smart glasses side has already assigned a storage path to it in advance. Here, there is no need to allocate again, but when the video data recorded by the login user is stored, the corresponding user is directly searched. The storage path can be used to store video data.
借助于本申请上述实施例的技术方案,本申请通过为当前与智能眼镜配对成功的眼镜App的登录用户分配存储路径,并对该登录用户录制的视频数据进行存储时,将视频数据存储至智能眼镜侧针对该登录用户的存储路径,使得登录与智能眼镜配对的 移动终端应用程序的不同用户所录制的视频数据能够在智能眼镜侧相互独立的存储,每个用户只能管理自己所拍摄的视频数据,而无法查看其他用户拍摄的视频数据,从而实现了智能眼镜侧对配对移动终端应用程序的不同用户所拍摄的视频数据的访问权限控制,避免了用户隐私泄露的问题。With the technical solution of the foregoing embodiment of the present application, the present application stores video data to the smart by storing a storage path for the login user of the glasses app that is currently successfully paired with the smart glasses, and storing the video data recorded by the login user. The glasses side is directed to the storage path of the logged-in user, so that video data recorded by different users of the mobile terminal application registered with the smart glasses can be stored independently of each other on the smart glasses side, and each user can only manage the videos taken by the user. The data cannot be viewed by the video data captured by other users, thereby realizing the access control of the video data captured by different users of the paired mobile terminal application on the smart glasses side, thereby avoiding the problem of user privacy leakage.
由于存在用户将智能眼镜分享给朋友使用的情况,造成同一个智能眼镜由眼镜APP的多个用户注册使用,那么不同用户拍摄的视频和图片都涉及隐私问题,因此,为了保证视频和图片的安全和隐私,本申请实施例可以对录制的视频按照登录眼镜App的用户不同而进行单独分类存储,从而使得眼镜APP的各个用户只能管理自己录制的视频和拍摄的图片。Since the user shares the smart glasses with friends, the same smart glasses are registered and used by multiple users of the glasses APP, and the videos and pictures taken by different users involve privacy issues, so in order to ensure the security of videos and pictures. And the privacy, the embodiment of the present application can separately store and store the recorded video according to different users of the login glasses App, so that each user of the glasses APP can only manage the video recorded by himself and the captured picture.
相应的,在执行根据所述视频同步指令在所述视频数据中查找待同步的第一目标视频数据步骤时,就可以通过以下方式来实现:Correspondingly, when performing the step of searching for the first target video data to be synchronized in the video data according to the video synchronization instruction, the following can be implemented:
根据所述视频同步指令在所述第一目标存储路径中查找待同步的第一目标视频数据。And searching, according to the video synchronization instruction, the first target video data to be synchronized in the first target storage path.
相应的,在执行根据所述视频删除指令在所述视频数据中查找待删除的第二目标视频数据步骤时,就可以通过以下方式来实现:Correspondingly, when performing the step of searching for the second target video data to be deleted in the video data according to the video deletion instruction, the following manner can be implemented:
根据所述视频同步指令在所述第一目标存储路径中查找待删除的第二目标视频数据。And searching for the second target video data to be deleted in the first target storage path according to the video synchronization instruction.
参照上述实施例,由于智能眼镜侧录制的视频都按照配对连接眼镜APP的登录用户标识进行了分别存储,因此,用户只能同步、删除智能眼镜中自己录制的视频,而无法对其他用户录制的视频进行任何操作。Referring to the above embodiment, since the videos recorded on the smart glasses side are separately stored according to the login user identifier of the paired connection glasses APP, the user can only synchronize and delete the videos recorded by the smart glasses, but cannot record to other users. The video does anything.
本申请实施例的这种通过将视频数据按照登录眼镜App的用户ID进行分类存储的方式,能够使得即便发生智能眼镜丢失的情况,也不会存在视频数据隐私泄露的问题;而且,在智能眼镜丢失后,用户还可以通过移动终端的眼镜APP来对智能眼镜进行控制,从而清除智能眼镜中存储的对应该用户ID的数据,保证数据安全。The method of classifying and storing the video data according to the user ID of the login glasses App in the embodiment of the present application enables the problem that the video data privacy leakage does not exist even if the smart glasses are lost; moreover, in the smart glasses After the loss, the user can also control the smart glasses through the glasses APP of the mobile terminal, thereby clearing the data corresponding to the user ID stored in the smart glasses, and ensuring data security.
在一种可能的实施方式中,在执行上述步骤101之后,根据本申请实施例的方法还可以包括:In a possible implementation manner, after performing the foregoing step 101, the method according to the embodiment of the present application may further include:
若在视频录制过程中,接收到开启直播指令,则将当前录制的视频数据实时传输至与所述智能眼镜配对连接的所述移动终端应用程序。If the live broadcast command is received during the video recording process, the currently recorded video data is transmitted in real time to the mobile terminal application that is paired with the smart glasses.
具体而言,在智能眼镜进行视频录制的过程中,用户可以点击智能眼镜的直播按键,从而发送开启直播指令(针于当前录制的视频)。Specifically, in the process of video recording of the smart glasses, the user can click the live button of the smart glasses to send a live broadcast command (for the currently recorded video).
其中,本申请针对录制的视频可以采用内存缓存机制,其中,高清视频的缓存上限为12M,低清视频的缓存上限为2M。也就是说,在视频录制过程中,录制的视频数据首先会写入内存进行缓存,当写入的视频数据超过相应的缓存上限时,本申请实施例可以将内存中缓存的视频数据一次性写入FLASH存储器,然后将内存中缓存的视频数据清空;而继续录制的后续视频则可继续从头写入内存缓存。这样,一方面减少写FLASH的次数,以提高FLASH使用寿命;另一方面写内存的功耗低于写FLASH的功耗,起到省电的目的。The upper limit of the cache of the high-definition video is 12M, and the upper limit of the cache of the low-definition video is 2M. That is to say, in the video recording process, the recorded video data is first written into the memory for buffering. When the written video data exceeds the corresponding upper limit of the cache, the embodiment of the present application can write the video data buffered in the memory at one time. The FLASH memory is inserted, and then the video data buffered in the memory is cleared; and the subsequent videos that continue to be recorded can continue to be written into the memory buffer from the beginning. In this way, on the one hand, the number of times of writing FLASH is reduced to improve the service life of FLASH; on the other hand, the power consumption of writing memory is lower than that of writing FLASH, which saves power.
那么,在智能眼镜接收到开启直播指令后,本申请实施例的方法可以及时通知RTSP(实时流传输协议)服务程序有可用帧数据到达,并将当前录制的视频数据的内存地址发送给RTSP服务程序,RTSP服务程序会在指定的内存地址读取到视频数据后, 进一步发送给移动终端侧的RTSP客户端,从而实现视频直播,这样用户通过佩戴本申请实施例的智能眼镜,并对智能眼镜的控制,从而实现用户佩戴眼镜所看到的各种场景进行视频直播。其中,由于最新录制的视频数据必然是缓存在内存中,因此,可以直接从内存中读取当前录制的视频数据,进行视频直播,从而实现不间断的视频直播,减少时间延迟。Then, after the smart glasses receive the live broadcast command, the method in the embodiment of the present application can notify the RTSP (Real Time Streaming Protocol) service program that the available frame data arrives, and send the memory address of the currently recorded video data to the RTSP service. The program, the RTSP service program, after the video data is read in the specified memory address, is further sent to the RTSP client on the mobile terminal side, thereby realizing the live video, so that the user wears the smart glasses of the embodiment of the present application, and the smart glasses The control is such that the various scenes seen by the user wearing the glasses are broadcast live. Among them, since the newly recorded video data is necessarily cached in the memory, the currently recorded video data can be directly read from the memory, and the video is broadcasted live, thereby realizing uninterrupted video live broadcast and reducing time delay.
为了更好的理解本申请实施例的上述技术方案,下面结合一具体实例来对本申请实施例的上述方法和智能眼镜进行详细阐述。In order to better understand the above technical solutions of the embodiments of the present application, the above method and smart glasses of the embodiments of the present application are described in detail below with reference to a specific example.
本实施例的智能眼镜可以通过触摸控制或者通过按键进行控制,应用上述视频数据的存储方法的智能眼镜,可以包括镜框和镜脚,镜脚与镜框之间可以通过可折叠的铰链结构可在设定幅度范围内转动地枢接在一起。The smart glasses of the embodiment can be controlled by touch control or by a button, and the smart glasses applying the above-mentioned storage method of the video data can include a frame and a temple, and the frame can be arranged by a foldable hinge structure between the temples and the frame. Rotatingly pivoted together within a fixed range.
在眼镜的镜腿或者镜框内设置有容置空间,其中,容置有印刷电路板(PCB),该PCB上设置有芯片、存储器(包括但不限于双倍速率同步动态随机存储器(DDR)、闪存(FLASH)和多媒体卡(EMMC,Embedded Multi Media Card))、通信模块(包括但不限于蓝牙和/或WiFi)、电力组件(包括但不限于电池、充电接口、计算电量的器件(例如库仑计))、视频信号采集组件(例如一个或两个摄像头)、音频信号采集组件(例如一个或两个麦克风)、温度传感器(用于测量PCB的工作状态温度)、一个或两个RGB LED灯(其中一个RGB LED灯,设置于镜框上面向外部的一侧,另一个RGB LED灯设置在镜框或眼镜腿的内侧靠近用户左眼或右眼的位置,位于佩戴者的视觉范围内)。An accommodating space is disposed in the temple or the frame of the glasses, wherein a printed circuit board (PCB) is disposed, and the chip is provided with a chip and a memory (including but not limited to double rate synchronous dynamic random access memory (DDR), Flash (FLASH) and MultiMedia Card (EMMC), communication modules (including but not limited to Bluetooth and/or WiFi), power components (including but not limited to batteries, charging interfaces, devices that calculate power (eg Coulomb) ()), video signal acquisition components (such as one or two cameras), audio signal acquisition components (such as one or two microphones), temperature sensors (used to measure the operating temperature of the PCB), one or two RGB LED lights (One of the RGB LEDs is placed on the outward facing side of the frame, and the other RGB LED is placed on the inside of the frame or temple near the user's left or right eye, within the wearer's visual range).
在不同的实施例中,PCB板上还可以设置有两块芯片,一个芯片作为主控芯片,常规状态下处于休眠状态,以降低功耗;另一块芯片承担对外交互功能,可以是蓝牙低功耗(BLE)芯片。当然,在不考虑功耗的情况下,也可以不采用双控制芯片的方案。In different embodiments, two chips can be disposed on the PCB, one chip is used as the main control chip, and is in a sleep state in a normal state to reduce power consumption; the other chip is responsible for external interaction, and can be Bluetooth low power. Consumption (BLE) chip. Of course, without considering the power consumption, it is also possible not to adopt a dual control chip scheme.
其中,BLE芯片基于2.4GHz的ISM(Industrial Scientific Medical Band)频段与移动设备上的与该智能眼镜配套的眼镜APP进行无线通讯。其中,BLE芯片具有两种***设备接口,分别是双向二线制同步串行总线(I 2C)和通用异步收发传输器(UART);其中,I 2C外接LED灯、库仑计、温度传感器;UART则外接主控芯片。通常情况下,只有BLE芯片在工作,工作状态时BLE芯片在发送广播包,1秒钟发送一次,以便眼镜APP可扫描并连接到智能眼镜。 The BLE chip is based on the 2.4 GHz ISM (Industrial Scientific Medical Band) frequency band and wirelessly communicates with the glasses APP on the mobile device. The BLE chip has two peripheral device interfaces, namely a bidirectional two-wire synchronous serial bus (I 2 C) and a universal asynchronous transceiver transmitter (UART); wherein, the I 2 C external LED lamp, coulomb counter, temperature sensor; The UART is connected to the main control chip. Normally, only the BLE chip is working, and the BLE chip is transmitting a broadcast packet in the working state, and is sent once every 1 second, so that the glasses APP can scan and connect to the smart glasses.
其中,BLE芯片通过I 2C对LED芯片的寄存器进行写数据操作以控制LED灯,写数据命令包括:I 2C总线地址、LED芯片的寄存器地址和LED芯片的寄存器的值,无需读操作;其中,LED的可写数据信息包括:红、绿、蓝三种颜色值、亮和灭、亮度等。 Wherein, the BLE chip performs a write data operation on the register of the LED chip through I 2 C to control the LED lamp, and the write data command includes: an I 2 C bus address, a register address of the LED chip, and a value of a register of the LED chip, without a read operation; The writeable data information of the LED includes: three color values of red, green, and blue, brightness and extinction, brightness, and the like.
BLE芯片在控制库仑计时,可以通过I 2C总线对库仑计芯片的寄存器进行读数据操作,读数据命令包括:I 2C总线地址、库仑计芯片寄存器的地址和库仑计芯片寄存器的值,无需写操作;其中,库仑计的可读数据信息包括电池电量和电压。 The BLE chip controls the coulomb timing and can read data from the registers of the coulomb chip through the I 2 C bus. The read data commands include: I 2 C bus address, address of the coulomb chip register, and value of the coulomb chip register. Write operation; wherein the readable data information of the coulomb counter includes battery power and voltage.
BLE芯片在控制充电IC时,可以通过I 2C总线对充电IC芯片的寄存器进行读写数据操作,读写命令包括:I 2C总线地址、充电IC寄存器的地址和充电IC寄存器的值,数据包括:充电状态、充电电流、充电电流/电压阀值等相关参数。 When controlling the charging IC, the BLE chip can read and write data to the register of the charging IC chip through the I 2 C bus. The read and write commands include: I 2 C bus address, address of the charging IC register, and value of the charging IC register, data Including: charging status, charging current, charging current / voltage threshold and other related parameters.
其中,主控芯片主要负责视频和照片的拍摄和存储、以及通过蓝牙、WIFI进行数 据传输。Among them, the main control chip is mainly responsible for the shooting and storage of video and photos, and data transmission through Bluetooth and WIFI.
此外,BLE芯片还要与主控芯片之间通过UART维持心跳包,以确保主控芯片通电过程中,始终保持在正确工作状态。主控芯片每隔5秒钟发送一次心跳包给BLE芯片,如果BLE连续超过3次未收到来自主控芯片的心跳包,则BLE将自动给主控芯片进行下电复位操作。In addition, the BLE chip also maintains a heartbeat packet with the master chip through the UART to ensure that the master chip is always in the correct working state during power-on. The main control chip sends a heartbeat packet to the BLE chip every 5 seconds. If the BLE does not receive the heartbeat packet from the main control chip for more than 3 consecutive times, the BLE will automatically power off the main control chip.
而BLE芯片本身则依赖看门狗定时器(WDT,Watch Dog Timer)来监视BLE***本身是否工作正常,WDT是单片机的一个组成部分,它实际上是一个计数器,一般给看门狗一个数字,程序开始运行后WDT开始倒计数。如果程序运行正常,过一段时间CPU应发出指令让WDT复位,重新开始倒计数。如果WDT减到0就认为程序没有正常工作,强制整个***复位。只要设备电池有剩余电量,BLE芯片就始终保持工作状态,如果BLE芯片工作不正常,整个***就等于瘫痪了,因此,为了确保在不可预知的情况下出现程序跑飞的异常现象,本申请实施例使用WDT来监视软件工作状态。The BLE chip itself relies on the Watchdog Timer (WDT) to monitor whether the BLE system itself is working properly. The WDT is an integral part of the microcontroller. It is actually a counter, generally giving the watchdog a number. The WDT starts counting down after the program starts running. If the program is running normally, the CPU should issue an instruction to reset the WDT and restart the countdown. If the WDT is reduced to 0, the program is considered to be not working properly, forcing the entire system to reset. As long as the battery of the device has remaining power, the BLE chip always keeps working. If the BLE chip is not working properly, the whole system is equal. Therefore, in order to ensure the abnormal phenomenon of program running in unpredictable situations, this application implements For example, use WDT to monitor software working status.
其中,主控芯片处于这五种状态时,不允许下电,分别为:绑定、录像、直播、蓝牙/WIFI传输、空中下载技术(OTA,Over-The-Air Technology)升级。Among them, when the main control chip is in these five states, power-off is not allowed, namely: binding, recording, live broadcast, Bluetooth/WIFI transmission, over-the-air technology (OTA) upgrade.
其中,在使用该智能眼镜与眼镜APP交互时,大部分和眼镜APP交互的指令都是通过BLE芯片透传完成:也就是眼镜APP发送指令给BLE芯片,BLE芯片通过UART再转发给主控芯片,反之亦然。涉及透传的包括:更新***时间、清除视频数据,固件升级、蓝牙配对、WIFI配网等等。Wherein, when using the smart glasses to interact with the glasses APP, most of the instructions for interacting with the glasses APP are completely transparently transmitted through the BLE chip: that is, the glasses APP sends instructions to the BLE chip, and the BLE chip is forwarded to the master chip through the UART. ,vice versa. Involved in transparent transmission, including: update system time, clear video data, firmware upgrade, Bluetooth pairing, WIFI distribution network and so on.
此外,BLE芯片可以产生并传输给主控芯片的事件命令包括:单击、双击、长按1秒、长按7秒和长按30秒。当然,这里的事件命令只是示意性举例并不用于限于本申请。In addition, the event commands that the BLE chip can generate and transmit to the main control chip include: click, double click, long press for 1 second, long press for 7 seconds, and long press for 30 seconds. Of course, the event commands herein are merely illustrative examples and are not intended to be limited to the present application.
此外,在主控芯片本身的工作状态发生改变时,会及时通过UART传输BLE芯片,BLE芯片则会进一步通知给眼镜APP,主要的工作状态包括:是否正在录像、是否正在直播、WIFI/蓝牙是否正在工作、是否可以进行OTA升级、磁盘存储空间发生改变等。In addition, when the working state of the main control chip itself changes, the BLE chip will be transmitted through the UART in time, and the BLE chip will further notify the glasses APP. The main working states include: whether it is recording, whether it is being broadcast live, whether WIFI/Bluetooth is Work, OTA upgrade, disk storage space change, etc.
在实际使用时,当用户点击移动终端的眼镜APP的录像按钮后,BLE芯片控制上电通用输入/输出(GPIO)接口来给主控芯片上电,主控芯片启动后开始录像;In actual use, when the user clicks the recording button of the glasses APP of the mobile terminal, the BLE chip controls the power-on universal input/output (GPIO) interface to power on the main control chip, and the main control chip starts to record after starting;
录像完毕后,主控芯片通过UART将录像的信息发送给BLE芯片,BLE芯片及时通知到眼镜APP,之后眼镜APP可以发送相应指令给BLE芯片以打开主控芯片的蓝牙或WIFI功能,BLE芯片收到指令后将指令通过UART传输给主控芯片,主控芯片开启蓝牙或WIFI后又通过UART通知BLE芯片表示开启完毕,最后BLE芯片将开启完毕通知转发给APP;After the recording is completed, the main control chip sends the recorded information to the BLE chip through the UART, and the BLE chip notifies the glasses APP in time, and then the glasses APP can send corresponding instructions to the BLE chip to open the Bluetooth or WIFI function of the main control chip, and the BLE chip receives After the instruction, the instruction is transmitted to the main control chip through the UART. After the main control chip turns on the Bluetooth or WIFI, the BLE chip is notified by the UART to complete the opening, and finally the BLE chip will be notified of the completion of the opening to the APP;
眼镜APP收到蓝牙或WIFI开启完毕通知后,就可以绕过BLE芯片直接通过蓝牙/WIFI与主控芯片进行通讯了。After receiving the Bluetooth or WIFI notification, the glasses APP can bypass the BLE chip and communicate directly with the main control chip via Bluetooth/WIFI.
眼镜APP可通过蓝牙从主控芯片读取低清视频数据、对主控芯片的OTA升级文件进行写入;可通过WIFI从主控芯片读取高清视频数据;The glasses APP can read low-definition video data from the main control chip through Bluetooth, and write the OTA upgrade file of the main control chip; the HD video data can be read from the main control chip through the WIFI;
在视频数据读取完毕后,眼镜APP发送指令给BLE芯片关闭蓝牙或者WIFI,BLE芯片将指令转发给主控芯片,主控芯片将卸载蓝牙/WIFI服务及驱动,并给将蓝牙/WIFI芯片下电。After the video data is read, the glasses APP sends an instruction to the BLE chip to turn off the Bluetooth or WIFI, and the BLE chip forwards the instruction to the main control chip, and the main control chip will uninstall the Bluetooth/WIFI service and driver, and give the Bluetooth/WIFI chip. Electricity.
其中,主控芯片在录像过程中,会先启动摄像头的传感器,拍摄原始视频流,并 通过硬件编码器将原始视频流转化为H264格式并写入内存,当录像结束后,再将内存中的视频数据写入存储器并关闭摄像头的传感器;Among them, during the recording process, the main control chip will start the sensor of the camera, take the original video stream, and convert the original video stream into H264 format and write it into the memory through the hardware encoder. When the recording ends, the memory will be Video data is written to the memory and the sensor of the camera is turned off;
其中,本申请针对录制的视频可以采用内存缓存机制,其中,高清视频的缓存上限为12M,低清视频的缓存上限为2M。也就是说,在视频录制过程中,录制的视频数据首先会写入内存进行缓存,当写入的视频数据超过相应的缓存上限时,本申请实施例可以将内存中缓存的视频数据一次性写入FLASH存储器,然后将内存中缓存的视频数据清空;而继续录制的后续视频则可继续从头写入内存缓存。这样,一方面减少写FLASH的次数,以提高FLASH使用寿命;另一方面写内存的功耗低于写FLASH的功耗,起到省电的目的。The upper limit of the cache of the high-definition video is 12M, and the upper limit of the cache of the low-definition video is 2M. That is to say, in the video recording process, the recorded video data is first written into the memory for buffering. When the written video data exceeds the corresponding upper limit of the cache, the embodiment of the present application can write the video data buffered in the memory at one time. The FLASH memory is inserted, and then the video data buffered in the memory is cleared; and the subsequent videos that continue to be recorded can continue to be written into the memory buffer from the beginning. In this way, on the one hand, the number of times of writing FLASH is reduced to improve the service life of FLASH; on the other hand, the power consumption of writing memory is lower than that of writing FLASH, which saves power.
那么如果主控芯片在录像过程中接收到BLE芯片发送的开通直播指令,则会及时通知RTSP服务程序有可用帧数据到达,并将视频数据的内存地址发送给RTSP服务程序,RTSP服务程序在指定的内存地址读取到视频数据后,进一步发送给移动终端的眼镜APP的RTSP客户端。其中,由于最新录制的视频数据必然是缓存在内存中,因此,可以直接从内存中读取当前录制的视频数据,进行视频直播,从而实现不间断的视频直播,减少时间延迟。Then, if the main control chip receives the live broadcast command sent by the BLE chip during the recording process, it will notify the RTSP service program that the available frame data arrives, and send the memory address of the video data to the RTSP service program, and the RTSP service program specifies After the memory address is read into the video data, it is further sent to the RTSP client of the mobile APP's glasses APP. Among them, since the newly recorded video data is necessarily cached in the memory, the currently recorded video data can be directly read from the memory, and the video is broadcasted live, thereby realizing uninterrupted video live broadcast and reducing time delay.
在使用上述智能眼镜进行实际应用时,用户可以对智能眼镜侧的不同按键来进行录像和拍照。例如按键A用来控制拍照片,按键B用来拍摄视频,在按压按键B时可以通过间断按压次数,来确定录制视频的时间长度。When using the above smart glasses for practical application, the user can record and take photos on different keys on the smart glasses side. For example, button A is used to control the photo taken, button B is used to capture the video, and when the button B is pressed, the length of the recorded video can be determined by the number of intermittent presses.
例如,当用户按压一次按键B之后,触发中断,BLE芯片响应中断,并给主控芯片上电(在空闲状态下,主控芯片处于下电状态,即休眠状态,以降低功耗),并将中断信号传输给主控芯片。For example, when the user presses the button B once, the interrupt is triggered, the BLE chip responds to the interrupt, and powers up the main control chip (in the idle state, the main control chip is in the power-off state, that is, the sleep state, to reduce power consumption), and The interrupt signal is transmitted to the master chip.
主控芯片上电后可以识别该中断信号,主控芯片通过预存在存储器中的中断信号定语(即每种中断信号表达的操作类型)进行判断,那么经过判断确定,用户想要拍摄一个预定时长(例如11秒)的视频。The main control chip can recognize the interrupt signal after being powered on, and the main control chip judges by using an interrupt signal attribute pre-existing in the memory (ie, the type of operation expressed by each interrupt signal), and then the user determines that the user wants to shoot for a predetermined period of time. (for example, 11 seconds) video.
之后主控芯片启动摄像头开启视频录制,如果在录制视频的过程中,用户没有进行任何操作,则在倒计时结束后,主控芯片控制摄像头终止拍摄。而基于上述实施例所述的本申请的内存缓存机制,因此,在拍摄的过程中本申请实施例的方法可以将内存中缓存的视频数据持续地存储到FLASH存储器中,并给每个视频文件按照预定的规则命名。After that, the main control chip starts the camera to open the video recording. If the user does not perform any operation during the recording of the video, the main control chip controls the camera to terminate the shooting after the countdown ends. The method of the embodiment of the present application can continuously store the video data buffered in the memory into the FLASH memory and give each video file according to the memory cache mechanism of the present application. Named according to the predetermined rules.
在视频录制完成后,主控芯片并不会立即下电,还会持续一段时间的上电状态,等待用户再次触发指令,但是如果在一段时间内,没有感应到用户的触发指令,则会下电,从而避免频繁上电和掉电造成的功耗。After the video recording is completed, the main control chip will not be powered off immediately, and will continue to power up for a period of time, waiting for the user to trigger the command again, but if the user does not sense the trigger command within a certain period of time, it will be Electricity to avoid power consumption caused by frequent power-up and power-down.
主控芯片可以通过调整摄像头参数,控制智能眼镜所录制的视频或者拍摄的照片的清晰度,当用户通过眼镜App将移动终端与智能眼镜通信连接之后,用户可以通过眼镜APP查询智能眼镜侧当前存在的低清视频文件个数以及某一个视频文件在录像过程中生成的描述文件,从而获取该视频文件的文件名称、大小、日期、分辨率、图片等描述信息;然后,根据描述信息来读取对应的低清视频或图片文件,其中,单次读取字节数不超过40960bytes;然后眼镜APP就可以发送指令给智能眼镜来删除已读取的文件数据以提升智能眼镜的存储空间的利用率;那么在所有数据读取完毕后,眼镜APP可以及时通过蓝牙向BLE芯片发送关闭蓝牙的控制命令。The main control chip can adjust the camera parameters to control the resolution of the video recorded by the smart glasses or the photos taken. After the user communicates the mobile terminal with the smart glasses through the glasses app, the user can query the current presence of the smart glasses through the glasses APP. The number of low-definition video files and the description file generated by a certain video file during the recording process, thereby obtaining description information such as file name, size, date, resolution, picture, etc. of the video file; and then reading according to the description information Corresponding low-definition video or picture file, wherein the number of single-read bytes does not exceed 40,960 bytes; then the glasses APP can send instructions to the smart glasses to delete the read file data to improve the utilization of the storage space of the smart glasses. Then, after all the data is read, the glasses APP can send the Bluetooth control command to the BLE chip through Bluetooth in time.
其中,考虑到用户可能紧接着又持续性的录像行为,本申请实施例可以设定延迟关闭蓝牙的时间。例如当***在90秒内没有相关的蓝牙操作,则将智能眼镜的蓝牙模块自动关闭以节省功耗。The embodiment of the present application can set the time for delaying the Bluetooth to be turned off, in consideration of the video behavior that the user may follow immediately. For example, when the system does not have an associated Bluetooth operation within 90 seconds, the Bluetooth module of the smart glasses is automatically turned off to save power.
如果在拍摄的过程中,用户再一次按压按键B,则触发中断,BLE芯片响应中断,并将中断信号传输给主控芯片,主控芯片控制摄像头延长拍摄11秒,其中,由于按压一次按键B对应的拍摄时长为11秒,因此,这里再次点击一次按键B则延迟拍摄11秒,若再次按压按键B,则继续追加拍摄时长,直至到达设置单次拍摄的最大时长。If the user presses the button B again during the shooting process, the trigger is interrupted, the BLE chip responds to the interrupt, and the interrupt signal is transmitted to the main control chip, and the main control chip controls the camera to extend the shooting for 11 seconds, wherein the button B is pressed once. The corresponding shooting time is 11 seconds. Therefore, if you click the button B again, the camera will delay shooting for 11 seconds. If you press the button B again, the additional shooting time will continue until the maximum time for setting a single shot is reached.
为了便于用户快速通过蓝牙或者WIFI在移动终端(例如手机或者平板电脑)上预览录像信息,主控芯片可以在每次启动视频录制和结束视频录制时,分别截取视频流中的关键帧(I Frame)数据,并将两个关键帧数据进行抽点处理减少图像像素形成缩略图,并与该视频关联的方式存储在主控芯片;当用户通过蓝牙或者WIFI与移动终端进行视频同步时,移动终端可以先接收与该视频对应的两帧缩略图,从而提供给用户在移动终端的眼镜APP的视频传输界面中快速预览视频的体验。In order to facilitate the user to quickly preview the video information on the mobile terminal (such as a mobile phone or a tablet) through Bluetooth or WIFI, the main control chip can intercept the key frames in the video stream each time the video recording is started and the video recording is ended (I Frame). Data, and two key frame data are subjected to sampling processing to reduce image pixels to form thumbnails, and stored in the main control chip in association with the video; when the user performs video synchronization with the mobile terminal through Bluetooth or WIFI, the mobile terminal The two-frame thumbnail corresponding to the video may be received first, thereby providing the user with an experience of quickly previewing the video in the video transmission interface of the glasses APP of the mobile terminal.
此外,眼镜App读取视频数据时,可以一次性将所有视频缩略图文件快速读取并预览,以方便用户选择是否要进一步读取视频,如果不是用户希望的数据,可以选择直接删除而不进行视频的读取。In addition, when the glasses App reads the video data, all the video thumbnail files can be quickly read and previewed at one time, so that the user can select whether to further read the video. If it is not the data desired by the user, the user can choose to delete directly without performing the video data. Video reading.
如前面实施例所述,按键B可以用于控制视频拍摄,而按键A可以用于控制照片拍摄,通常的,通过按键A拍摄的照片具有更高清晰度,例如4K图像,当智能眼镜佩戴者按下智能眼镜的按键A时,BLE芯片响应中断,并将中断信号传输给主控芯片。类似的,如果此时主控芯片处于下电休眠状态,则BLE芯片先发送上电指令给主控芯片上电,之后主控芯片启动,主控芯片识别中断信号为拍照的指令,之后,控制摄像头拍摄4K图像,最后,该图像也被存储于存储器中。As described in the previous embodiment, the button B can be used to control video shooting, and the button A can be used to control photo shooting. Generally, the photo taken by the button A has higher definition, such as 4K image, when the smart glasses wearer When the button A of the smart glasses is pressed, the BLE chip responds to the interrupt and transmits the interrupt signal to the master chip. Similarly, if the main control chip is in the power-down sleep state at this time, the BLE chip first sends a power-on command to the main control chip to be powered on, then the main control chip starts, and the main control chip recognizes the interrupt signal as a photographing instruction, and then controls The camera captures a 4K image and, finally, the image is also stored in memory.
在BLE芯片首次启动时,会生成智能眼镜的ID,并存储至存储器(例如FLASH)中,用于标识该智能眼镜,除非对FLASH进行擦除,该ID将一直存在。When the BLE chip is first started, the ID of the smart glasses is generated and stored in a memory (for example, FLASH) for identifying the smart glasses, and the ID will always exist unless the FLASH is erased.
此外,智能眼镜同一时间只允许一个眼镜APP的用户ID进行登录(即通信连接),在该眼镜APP登录后直到其它眼镜APP登录之前,***产生的所有视频数据,用户配置等只和该登录眼镜APP账号相关,对于后续登录的其它账户不可见,用以保护用户隐私,即使设备丢失,也不至于导致视频数据泄露,该用户ID在登录时,能够通过APP控制,清除眼镜的存储器中与该ID对应的数据。In addition, the smart glasses only allow the user ID of one glasses APP to log in at the same time (ie, the communication connection), and all the video data generated by the system, the user configuration, etc., and the registered glasses only after the glasses APP is logged in until the other glasses APP is logged in. The APP account is related to other accounts that are not logged in to protect the privacy of the user. Even if the device is lost, the video data will not be leaked. When the user ID is logged in, the APP can be controlled by the APP to clear the memory of the glasses. The data corresponding to the ID.
在其他的实施方式中,库仑计可以定时检测智能眼镜的电池剩余电量,当检测到电池剩余电量不高于设定阈值时,则控制主控芯片的上电,从而确保智能眼镜的安全工作,并且能够避免智能眼镜在拍摄过程中产生中断,影响用户的拍摄体验,并且避免因为电量被消耗过多导致降低电池使用寿命的问题。In other embodiments, the coulomb counter can periodically detect the remaining battery power of the smart glasses. When detecting that the remaining battery power is not higher than the set threshold, the power of the main control chip is controlled to ensure the safe operation of the smart glasses. Moreover, it is possible to prevent the smart glasses from being interrupted during the shooting process, affecting the user's shooting experience, and avoiding the problem of reducing the battery life due to excessive power consumption.
在其他的实施方式中,智能眼镜还可以只设置一个按键A,通过按键A的不同按压方式来使得主控芯片来区分拍摄照片或者录制视频的操作,例如,双击按键A,两次连续中断,主控芯片识别该操作为拍照指令,则主控芯片通过摄像头拍摄一张高清图片。In other embodiments, the smart glasses can also set only one button A, and the main control chip can distinguish the operation of taking a photo or recording a video by different pressing manners of the button A, for example, double-clicking the button A, and continuously interrupting twice. The main control chip recognizes that the operation is a photographing instruction, and the main control chip captures a high-definition picture through the camera.
此外,由于智能眼镜上设置有若干个LED灯,可以通过不同的LED灯光闪烁效果和颜色变化与按键协同,以避免用户的误操作。例如,电状态:当***电量低于8%,且设备处于电池供电状态,将忽略录像行为并改变LED状态提示用户。In addition, since the smart glasses are provided with a plurality of LED lights, the LED flashing effects and color changes can be coordinated with the keys to avoid user misoperation. For example, the electrical state: When the system power is lower than 8%, and the device is in the battery power state, the recording behavior will be ignored and the LED status will be changed to prompt the user.
温度传感器检测过热状态:当***温度超过60度,将忽略录像行为并改变LED状态提示用户。The temperature sensor detects the overheated state: when the system temperature exceeds 60 degrees, the recording behavior will be ignored and the LED status will be changed to prompt the user.
与上述本申请实施例所提供的应用于智能眼镜的视频数据的存储方法相对应,参照图2,示出了本申请另一种视频数据的显示方法实施例的步骤流程图,应用于移动终端,具体可以包括如下步骤:Corresponding to the storage method of the video data applied to the smart glasses provided by the embodiment of the present application, referring to FIG. 2, a flow chart of the steps of the method for displaying another video data of the present application is shown, which is applied to the mobile terminal. Specifically, the method may include the following steps:
步骤201,接收智能眼镜发送的配对指令;Step 201: Receive a pairing instruction sent by the smart glasses.
其中,移动终端(例如手机)侧安装的与所述智能眼镜配套使用的眼镜App,可以生成用于与智能眼镜配对连接的二维码(其中,该二维码包括眼镜App的用户ID),并且,移动终端侧需要开启蓝牙,从而发送蓝牙地址给智能眼镜实现移动终端与智能眼镜的蓝牙连接;而用户则需要佩戴该智能眼镜并注视手机上的该二维码,从而实现智能眼镜侧对该二维码的扫描以发送配对指令(可以包括智能眼镜的ID),而移动终端侧的眼镜App就可以接收到该配对指令。The glasses App installed in the mobile terminal (for example, a mobile phone) side and used in conjunction with the smart glasses may generate a two-dimensional code for pairing with the smart glasses (where the two-dimensional code includes a user ID of the glasses App), Moreover, the mobile terminal side needs to turn on the Bluetooth, so that the Bluetooth address is sent to the smart glasses to realize the Bluetooth connection between the mobile terminal and the smart glasses; and the user needs to wear the smart glasses and look at the two-dimensional code on the mobile phone, thereby realizing the smart glasses side pair The scanning of the two-dimensional code is to send a pairing instruction (which may include the ID of the smart glasses), and the glasses App of the mobile terminal side can receive the pairing instruction.
步骤202,根据所述配对指令将所述智能眼镜与移动终端应用程序配对;Step 202: Pair the smart glasses with a mobile terminal application according to the pairing instruction;
移动终端侧,可以根据配对指令中该智能眼镜的ID来将该智能眼镜与该移动终端的眼镜App配对,如果配对成功,则移动终端的眼镜App与智能眼镜可以通信连接。所谓配对成功,如果登录该眼镜App的用户ID预先注册了对该智能眼镜ID的眼镜设备的使用权限,则可以配对成功,否则失败。On the mobile terminal side, the smart glasses can be paired with the glasses App of the mobile terminal according to the ID of the smart glasses in the pairing instruction. If the pairing is successful, the glasses App of the mobile terminal and the smart glasses can be communicably connected. In the so-called pairing success, if the user ID registered in the glasses app is registered in advance with the right to use the glasses device of the smart glasses ID, the pairing is successful, otherwise it fails.
换句话说,移动终端侧可以保存该用户ID预先注册过的眼镜设备的ID,而在匹配时,就可以将接收到的来自当前智能眼镜的ID与保存的眼镜设备ID进行匹配,若一致,则匹配成功,否则失败。In other words, the mobile terminal side can save the ID of the glasses device pre-registered by the user ID, and when matching, the received ID from the current smart glasses can be matched with the saved glasses device ID. The match is successful, otherwise it fails.
步骤203,在配对成功后,发送视频同步指令至所述智能眼镜,所述视频同步指令包括待同步的第一目标视频数据的属性信息;Step 203: After the pairing is successful, send a video synchronization instruction to the smart glasses, where the video synchronization instruction includes attribute information of the first target video data to be synchronized;
其中,视频录制指令可以对应一个录制时长,因此,在录制的视频的时间长度达到该录制时长时或之后,则智能眼镜侧会停止视频的录制,而移动终端侧的眼镜App可以在视频录制结束后(立即或过一段时间)向智能眼镜来发送视频同步指令。在一种可能的实施方式中,在视频录制完成后,智能眼镜侧还可以向移动终端侧发送表示视频数据录制完成的指令,那么在移动终端接收到该指令后,移动终端侧就可以通过上述眼镜APP来发送视频同步指令,即将智能眼镜侧录制的视频数据同步到移动终端侧的眼镜App,从而便于用户进行分享。而视频同步指令中会携带待同步的第一目标视频数据的属性信息(例如第一目标视频数据的ID等标识信息),从而便于智能眼镜侧进行视频查找;The video recording instruction can correspond to a recording duration. Therefore, when the length of the recorded video reaches the recording duration or after, the smart glasses side stops the recording of the video, and the mobile terminal side glasses App can end at the video recording. The video sync command is sent to the smart glasses later (immediately or over a period of time). In a possible implementation manner, after the video recording is completed, the smart glasses side may further send an instruction indicating that the video data recording is completed to the mobile terminal side, and after the mobile terminal receives the instruction, the mobile terminal side may pass the foregoing. The glasses APP sends a video synchronization command, that is, the video data recorded on the smart glasses side is synchronized to the glasses App on the mobile terminal side, thereby facilitating sharing by the user. The video synchronization instruction carries the attribute information of the first target video data to be synchronized (for example, the identification information such as the ID of the first target video data), thereby facilitating the video search by the smart glasses side;
那么参照上述实施例,智能眼镜可以根据该视频同步指令在录制的视频数据中查找用户需要同步的第一目标视频数据。其中,录制的视频数据可能包括多个,而这里只需要从多个视频数据中查找到该视频同步指令所指向的第一目标视频数据。Then, referring to the above embodiment, the smart glasses can search for the first target video data that the user needs to synchronize in the recorded video data according to the video synchronization instruction. The recorded video data may include multiple pieces, and only the first target video data pointed by the video synchronization instruction needs to be found from the plurality of video data.
步骤204,接收第一目标视频数据和至少一帧目标图片,其中,所述至少一帧目标图片提取自所述第一目标视频数据;Step 204: Receive first target video data and at least one frame target image, where the at least one frame target picture is extracted from the first target video data.
而智能眼镜侧在查找到该第一目标视频数据后,移动终端就可以接收智能眼镜侧发送的响应于该视频同步指令的第一目标视频数据以及对应于该第一目标视频数据的至少一帧目标图片。After the smart glasses side finds the first target video data, the mobile terminal can receive the first target video data sent by the smart glasses side in response to the video synchronization instruction and at least one frame corresponding to the first target video data. Target image.
其中,至少一帧目标图片可以先于该第一目标视频数据传输,也可以同时传输。The at least one frame of the target picture may be transmitted before the first target video data, or may be simultaneously transmitted.
其中,一帧图片可以是提取自视频数据中的关键帧,也可以是非关键帧;可以是第一帧,也可以是最后一帧。也就是说,本申请对于一帧图片在视频数据中的具***置并不作具体限制。The one frame of the picture may be a key frame extracted from the video data, or may be a non-key frame; it may be the first frame or the last frame. That is to say, the present application does not specifically limit the specific location of a frame of picture in the video data.
步骤205,在所述第一目标视频数据的传输过程中,控制所述至少一帧目标图片在所述移动终端的视频传输界面显示。Step 205: Control, during the transmission of the first target video data, the at least one frame target image to be displayed on a video transmission interface of the mobile terminal.
其中,在该第一目标视频数据传输过程中,移动终端可以控制该至少一帧目标图片在眼镜APP的视频传输界面进行显示。The mobile terminal may control the at least one frame of the target picture to be displayed on the video transmission interface of the glasses APP during the first target video data transmission.
借助于本申请上述实施例的技术方案,本申请通过向智能眼镜发送视频同步指令,使得在接收来自智能眼镜的第一目标视频数据时,还可以接收到提取自该第一目标视频数据的至少一帧目标图片,从而控制至少一帧目标图片在该第一目标视频数据的视频传输界面显示,使得从智能眼镜向移动终端同步视频数据时,用户可以在视频传输界面预览到该视频数据的具体视频内容,避免在视频传输过程中用户感觉枯燥或觉得等待时间太长等用户体验差的问题。With the technical solution of the foregoing embodiment of the present application, the application sends a video synchronization instruction to the smart glasses, so that when receiving the first target video data from the smart glasses, at least the extracted from the first target video data may be received. a frame of the target picture, thereby controlling at least one frame of the target picture to be displayed on the video transmission interface of the first target video data, so that when the video data is synchronized from the smart glasses to the mobile terminal, the user can preview the specific content of the video data in the video transmission interface. Video content, avoiding the problem of poor user experience, such as the user feeling boring during the video transmission process or feeling that the waiting time is too long.
在一种可能的实施方式中,当所述至少一帧目标图片的数量为一个时,在执行上述步骤205时,可以通过以下方式来实现:In a possible implementation manner, when the number of the target pictures of the at least one frame is one, when performing the foregoing step 205, the following manner may be implemented:
在所述第一目标视频数据的传输过程中,控制一帧目标图片在所述移动终端的视频传输界面全屏显示。During the transmission of the first target video data, one frame of the target picture is controlled to be displayed in full screen on the video transmission interface of the mobile terminal.
也就是说,当传输的一个视频提取了一帧图片时,则可以将该帧图片作为封面图显示在该眼镜APP的视频传输界面上。That is to say, when one video is extracted and one frame is extracted, the frame image can be displayed as a cover image on the video transmission interface of the glasses APP.
而在另一种可能的实施方式中,当所述至少一帧目标图片的帧数为两个或两个以上时,即提取了多帧目标图片,则在执行上述步骤205时,则可以通过以下方式来实现:In another possible implementation manner, when the number of frames of the target picture of the at least one frame is two or more, that is, the multi-frame target picture is extracted, when the step 205 is performed, the The following ways to achieve:
在所述第一目标视频数据的传输过程中,控制至少两帧目标图片在所述移动终端的视频传输界面交替显示。During the transmission of the first target video data, at least two frames of target pictures are controlled to be alternately displayed on the video transmission interface of the mobile terminal.
也就是说,当传输的一个视频提取了两帧或两帧以上图片时,两帧或两帧以上的图片可以在相应视频的视频传输界面轮换交替显示,至于相邻显示的两帧图片之间的时间间隔可以相同或不同。That is to say, when two or more frames of a video are extracted, two or more frames of pictures can be alternately displayed in the video transmission interface of the corresponding video, as for the two frames of the adjacent display. The time intervals can be the same or different.
在一种可能的实施方式中,所述发送视频同步指令至所述智能眼镜的步骤之前,根据本申请实施例的方法还可以包括:发送登录所述移动终端应用程序的第一用户的标识信息。In a possible implementation manner, before the step of sending the video synchronization instruction to the smart glasses, the method according to the embodiment of the present application may further include: sending identification information of the first user that logs in to the mobile terminal application. .
这样,如果该第一用户登录该眼镜App后,该眼镜App首次与智能眼镜配对成功,则智能眼镜侧为了实现不同用户的视频数据的独立访问,实现访问权限控制,智能眼镜可以根据接收到的该第一用户的标识信息(例如ID)来为第一用户分配用于专门存储其录制的视频数据的存储路径;In this way, if the glasses app is successfully paired with the smart glasses for the first time after the first user logs in to the glasses app, the smart glasses side can realize the access control to realize the independent access of the video data of different users, and the smart glasses can be received according to the received The first user's identification information (such as an ID) to allocate a storage path for the first user to exclusively store the video data of the recording;
而如果该第一用户登录该眼镜App后,该眼镜App并非首次与智能眼镜配对成功,则可以直接根据该第一用户的标识信息来确定第一用户的存储路径,从而便于后续的对录制的视频数据的专门存储。If the glasses are not successfully paired with the smart glasses for the first time after the first user logs in to the glasses, the storage path of the first user may be directly determined according to the identification information of the first user, thereby facilitating subsequent recording. Specialized storage of video data.
在一种可能的实施方式中,根据本申请实施例的方法还可以包括:In a possible implementation manner, the method according to the embodiment of the present application may further include:
若所述第一目标视频数据传输完成,则发送表示所述第一目标视频数据同步完成的指令至所述智能眼镜。And if the first target video data transmission is completed, sending an instruction indicating that the first target video data is synchronized to the smart glasses.
在一种可能的实施方式中,当移动终端的眼镜App与智能眼镜配对成功后,移动终端侧(的眼镜App)也会保存智能眼镜的标识信息,那么用户可以通过眼镜APP来对该智能眼镜进行命名,这样用户可以对多个与该移动终端连接的智能眼镜设备进行管理。In a possible implementation manner, after the glasses app of the mobile terminal is successfully paired with the smart glasses, the glasses app of the mobile terminal side also saves the identification information of the smart glasses, and the user can use the glasses APP to the smart glasses. The naming is performed so that the user can manage a plurality of smart glasses devices connected to the mobile terminal.
在一种可能的实施方式中,根据本申请实施例的方法还可以包括:In a possible implementation manner, the method according to the embodiment of the present application may further include:
在所述智能眼镜与移动终端应用程序配对成功后,发送视频删除指令至所述智能眼镜,所述视频删除指令包括待删除的第二目标视频数据的属性信息(例如第二目标视频数据的标识信息)。After the pairing of the smart glasses and the mobile terminal application is successful, sending a video deletion instruction to the smart glasses, where the video deletion instruction includes attribute information of the second target video data to be deleted (eg, identifier of the second target video data) information).
也就是说,移动终端可以通过眼镜APP来控制删除智能眼镜侧该移动终端录制的视频数据。That is to say, the mobile terminal can control to delete the video data recorded by the mobile terminal on the smart glasses side through the glasses APP.
在一种可能的实施方式中,根据本申请实施例的方法还可以包括:In a possible implementation manner, the method according to the embodiment of the present application may further include:
在视频录制过程中,实时接收来自所述智能眼镜的当前录制的视频数据并播放。During the video recording process, the currently recorded video data from the smart glasses is received and played in real time.
具体而言,在移动终端控制智能眼镜进行视频录制的过程中,用户可以点击智能眼镜的直播按键,从而向智能眼镜侧发送开启直播指令(针于当前录制的视频)。那么智能眼镜侧就可以及时通知RTSP服务程序有可用帧数据到达,并将当前录制的视频数据的内存地址发送给RTSP服务程序,RTSP服务程序会在指定的内存地址读取到视频数据后,进一步发送给移动终端侧的RTSP客户端,从而实现视频直播,这样移动终端的RTSP客户端就可以实时接收来自智能眼镜的RTSP服务程序发送的视频数据,并进行直播。这样用户通过佩戴本申请实施例的智能眼镜,来在移动终端侧对用户所看到的各种场景进行视频直播。Specifically, in the process that the mobile terminal controls the smart glasses to perform video recording, the user can click the live button of the smart glasses to send a live broadcast command (for the currently recorded video) to the smart glasses side. Then the smart glasses side can promptly notify the RTSP service program that the available frame data arrives, and send the memory address of the currently recorded video data to the RTSP service program, and the RTSP service program will read the video data at the specified memory address, further The RTSP client is sent to the mobile terminal side to realize live video, so that the RTSP client of the mobile terminal can receive the video data sent by the RTSP service program of the smart glasses in real time and perform live broadcast. In this way, the user performs live video broadcast on various scenes seen by the user on the mobile terminal side by wearing the smart glasses of the embodiment of the present application.
需要说明的是,对于方法实施例,为了简单描述,故将其都表述为一系列的动作组合,但是本领域技术人员应该知悉,本申请实施例并不受所描述的动作顺序的限制,因为依据本申请实施例,某些步骤可以采用其他顺序或者同时进行。其次,本领域技术人员也应该知悉,说明书中所描述的实施例均属于可选实施例,所涉及的动作并不一定是本申请实施例所必须的。It should be noted that, for the method embodiments, for the sake of simple description, they are all expressed as a series of action combinations, but those skilled in the art should understand that the embodiments of the present application are not limited by the described action sequence, because In accordance with embodiments of the present application, certain steps may be performed in other sequences or concurrently. In the following, those skilled in the art should also understand that the embodiments described in the specification are optional embodiments, and the actions involved are not necessarily required in the embodiments of the present application.
与上述本申请实施例所提供的应用于智能眼镜的视频数据的存储方法相对应,参照图3,示出了本申请一种视频数据的存储装置实施例的结构框图,应用于智能眼镜,具体可以包括如下模块:Corresponding to the storage method of the video data applied to the smart glasses provided by the embodiment of the present application, with reference to FIG. 3, a block diagram of a storage device embodiment of the video data of the present application is shown, which is applied to the smart glasses. Can include the following modules:
第一接收模块31,用于接收视频录制指令;a first receiving module 31, configured to receive a video recording instruction;
录制模块32,用于根据所述视频录制指令,录制视频数据;The recording module 32 is configured to record video data according to the video recording instruction;
提取模块33,用于在所述视频数据中提取至少一帧图片;An extracting module 33, configured to extract at least one frame of the picture in the video data;
第一存储模块34,用于将所述至少一帧图片与所述视频数据关联存储。The first storage module 34 is configured to store the at least one frame of pictures in association with the video data.
在一种可能的实施方式中,所述装置还可以包括:In a possible implementation, the device may further include:
处理模块,用于对所述至少一帧图片作预设图像处理,得到至少一个缩略图;a processing module, configured to perform preset image processing on the at least one frame of the image to obtain at least one thumbnail image;
所述第一存储模块34,包括:The first storage module 34 includes:
存储子模块,用于将所述至少一个缩略图和所述视频数据关联存储。And a storage submodule, configured to store the at least one thumbnail and the video data in association.
在一种可能的实施方式中,所述装置还可以包括:In a possible implementation, the device may further include:
第二接收模块,用于接收与所述智能眼镜配对连接的移动终端应用程序发送的视频同步指令;a second receiving module, configured to receive a video synchronization instruction sent by a mobile terminal application that is paired with the smart glasses;
查找模块,用于根据所述视频同步指令在所述视频数据中查找待同步的第一目标 视频数据;a searching module, configured to search, in the video data, the first target video data to be synchronized according to the video synchronization instruction;
同步模块,用于将所述第一目标视频数据以及与所述第一目标视频数据对应的至少一帧目标图片同步至所述移动终端。And a synchronization module, configured to synchronize the first target video data and the at least one frame target picture corresponding to the first target video data to the mobile terminal.
在一种可能的实施方式中,所述装置还可以包括:In a possible implementation, the device may further include:
删除模块,用于若接收到表示所述第一目标视频数据同步完成的指令,则将存储的所述至少一帧目标图片删除,并删除所述至少一帧目标图片与所述第一目标视频数据的关联关系。a deleting module, configured to delete the stored at least one frame target image and delete the at least one frame target image and the first target video, if receiving an instruction indicating that the first target video data is synchronized The relationship of the data.
在一种可能的实施方式中,所述装置还可以包括:In a possible implementation, the device may further include:
发送模块,用于发送配对指令至移动终端应用程序;a sending module, configured to send a pairing instruction to the mobile terminal application;
第三接收模块,用于若所述智能眼镜与所述移动终端应用程序配对成功,则接收登录所述移动终端应用程序的第一用户的标识信息;a third receiving module, configured to: if the smart glasses are successfully paired with the mobile terminal application, receive identification information of the first user that logs in to the mobile terminal application;
分配模块,用于根据所述第一用户的标识信息,为所述第一用户分配用于存储所述第一用户录制的视频数据的第一目标存储路径;An allocating module, configured to allocate, by the first user, a first target storage path for storing video data recorded by the first user, according to the identifier information of the first user;
所述第一接收模块31包括:接收子模块,用于接收所述第一用户的视频录制指令;The first receiving module 31 includes: a receiving submodule, configured to receive a video recording instruction of the first user;
第二存储模块,用于在视频数据录制完成之后,将所述视频数据存储至所述第一目标存储路径。And a second storage module, configured to store the video data to the first target storage path after the video data recording is completed.
在一种可能的实施方式中,所述装置还可以包括:In a possible implementation, the device may further include:
传输模块,用于若在视频录制过程中,接收到开启直播指令,则将当前录制的视频数据实时传输至所述移动终端应用程序。The transmission module is configured to transmit the currently recorded video data to the mobile terminal application in real time if the live broadcast command is received during the video recording process.
与上述本申请实施例所提供的应用于智能眼镜的视频数据的显示方法相对应,参照图4,示出了本申请一种视频数据的显示装置实施例的结构框图,应用于移动终端,具体可以包括如下模块:Corresponding to the display method of the video data applied to the smart glasses provided by the embodiment of the present application, with reference to FIG. 4, a structural block diagram of an embodiment of a display device for video data according to the present application is shown, which is applied to a mobile terminal. Can include the following modules:
第一接收模块41,用于接收智能眼镜发送的配对指令;The first receiving module 41 is configured to receive a pairing instruction sent by the smart glasses;
配对模块42,用于根据所述配对指令将所述智能眼镜与移动终端应用程序配对;The pairing module 42 is configured to pair the smart glasses with the mobile terminal application according to the pairing instruction;
发送模块43,用于在配对成功后,发送视频同步指令至所述智能眼镜,所述视频同步指令包括待同步的第一目标视频数据的属性信息;The sending module 43 is configured to send a video synchronization instruction to the smart glasses after the pairing is successful, where the video synchronization instruction includes attribute information of the first target video data to be synchronized;
第二接收模块44,用于接收第一目标视频数据和至少一帧目标图片,其中,所述至少一帧目标图片提取自所述第一目标视频数据;The second receiving module 44 is configured to receive the first target video data and the at least one frame target image, where the at least one frame target image is extracted from the first target video data;
控制模块45,用于在所述第一目标视频数据的传输过程中,控制所述至少一帧目标图片在所述移动终端的视频传输界面显示。The control module 45 is configured to control the at least one frame of the target picture to be displayed on the video transmission interface of the mobile terminal during the transmission of the first target video data.
在一种可能的实施方式中,所述控制模块45包括:In a possible implementation, the control module 45 includes:
第一控制子模块,用于当所述至少一帧目标图片的数量为一个时,在所述第一目标视频数据的传输过程中,控制一帧目标图片在所述移动终端的视频传输界面全屏显示。a first control submodule, configured to: when a quantity of the at least one frame of the target picture is one, control a frame of the target picture to be full screen on the video transmission interface of the mobile terminal during the transmission of the first target video data display.
在一种可能的实施方式中,所述控制模块45包括:In a possible implementation, the control module 45 includes:
第二控制子模块,用于当所述至少一帧目标图片的数量为两个或两个以上时,在所述第一目标视频数据的传输过程中,控制至少两个目标帧图片在所述移动终端的视频传输界面交替显示。a second control submodule, configured to control at least two target frame pictures in the transmitting process of the first target video data when the number of the at least one frame target picture is two or more The video transmission interface of the mobile terminal is alternately displayed.
与上述本申请实施例所提供的应用于智能眼镜的视频数据的存储装置相对应,参照图5,示出了本申请一种智能眼镜实施例的结构框图,具体可以包括:存储器51、 处理器52、摄像头53、第一按键54;Corresponding to the storage device for the video data of the smart glasses provided by the embodiment of the present application, with reference to FIG. 5, a block diagram of a smart glasses embodiment of the present application is shown, which may specifically include: a memory 51, a processor. 52, the camera 53, the first button 54;
所述处理器52,被配置为接收由所述第一按键54触发的视频录制指令,并根据所述视频录制指令,控制所述摄像头53录制视频数据,并在所述视频数据中提取至少一帧图片,并将所述存储数据和所述至少一帧图片发送至所述存储器51;The processor 52 is configured to receive a video recording instruction triggered by the first button 54 and control the camera 53 to record video data according to the video recording instruction, and extract at least one of the video data. Frame the picture, and send the stored data and the at least one frame picture to the memory 51;
所述存储器51,被配置为将所述至少一帧图片与所述视频数据关联存储。The memory 51 is configured to store the at least one frame of pictures in association with the video data.
在一种可能的实施方式中,In a possible implementation manner,
所述处理器52,还被配置为对所述至少一帧图片作预设图像处理,得到至少一个缩略图,并将所述至少一个缩略图发送至所述存储器51;The processor 52 is further configured to perform preset image processing on the at least one frame of the image, obtain at least one thumbnail image, and send the at least one thumbnail image to the memory 51;
所述存储器51,还被配置为将所述至少一个缩略图和所述视频数据关联存储。The memory 51 is further configured to store the at least one thumbnail and the video data in association.
在一种可能的实施方式中,根据本申请实施例的智能眼镜还可以包括:In a possible implementation manner, the smart glasses according to the embodiments of the present application may further include:
发送器、接收器;Transmitter, receiver;
所述接收器,被配置为接收与所述智能眼镜配对连接的移动终端应用程序发送的视频同步指令并发送至所述处理器52;The receiver is configured to receive a video synchronization command sent by the mobile terminal application that is paired with the smart glasses and sent to the processor 52;
所述处理器52,还被配置为根据所述视频同步指令在所述存储器51存储的视频数据中查找待同步的第一目标视频数据以及与所述第一目标视频数据对应的至少一帧目标图片,并将所述第一目标视频数据以及所述至少一帧目标图片发送至所述发送器;The processor 52 is further configured to search, in the video data stored in the memory 51, the first target video data to be synchronized and the at least one frame target corresponding to the first target video data according to the video synchronization instruction. And transmitting the first target video data and the at least one frame target picture to the transmitter;
所述发送器,被配置为将所述第一目标视频数据以及所述至少一帧目标图片同步至所述移动终端应用程序。The transmitter is configured to synchronize the first target video data and the at least one frame target picture to the mobile terminal application.
在一种可能的实施方式中,所述处理器52,还被配置为在所述接收器接收到表示所述第一目标视频数据同步完成的指令时,将所述存储器51中存储的所述至少一帧目标图片删除,并删除所述至少一帧目标图片与所述第一目标视频数据的关联关系。In a possible implementation manner, the processor 52 is further configured to: when the receiver receives an instruction indicating that the first target video data synchronization is completed, storing the At least one frame of the target picture is deleted, and the association relationship between the at least one frame of the target picture and the first target video data is deleted.
在一种可能的实施方式中,In a possible implementation manner,
所述发送器,还被配置为发送配对指令至移动终端应用程序;The transmitter is further configured to send a pairing instruction to the mobile terminal application;
所述接收器,还被配置为在所述智能眼镜与所述移动终端应用程序配对成功时,接收登录所述移动终端应用程序的第一用户的标识信息并发送至所述处理器52;The receiver is further configured to receive, when the smart glasses are successfully paired with the mobile terminal application, the identification information of the first user that logs in to the mobile terminal application, and send the identification information to the processor 52;
所述处理器52,被配置为根据所述第一用户的标识信息,为所述第一用户分配被配置为存储所述第一用户录制的视频数据的第一目标存储路径;The processor 52 is configured to allocate, according to the identifier information of the first user, a first target storage path configured to store video data recorded by the first user, for the first user;
所述处理器52,还被配置为接收由所述第一用户按压所述第一按键54而触发的视频录制指令;The processor 52 is further configured to receive a video recording instruction triggered by the first user pressing the first button 54;
所述存储器51,还被配置为在视频数据录制完成之后,将所述摄像头53录制的所述视频数据存储至所述第一目标存储路径。The memory 51 is further configured to store the video data recorded by the camera 53 to the first target storage path after the video data recording is completed.
在一种可能的实施方式中,所述发送器还被配置为在所述接收器被配置为在视频录制过程中,接收到开启直播指令时,将所述摄像头53当前录制的视频数据实时传输至与所述智能眼镜配对连接的移动终端应用程序。In a possible implementation manner, the transmitter is further configured to transmit the video data currently recorded by the camera 53 in real time when the receiver is configured to receive a live broadcast command during video recording. To a mobile terminal application that is paired with the smart glasses.
根据本申请的一个实施例,还提供了一种移动终端,包括:存储器、处理器及存储在所述存储器上并可在所述处理器上运行的视频数据的显示程序,所述视频数据的显示程序被所述处理器执行时实现如上述应用于移动终端的视频数据的显示方法中的步骤。According to an embodiment of the present application, there is also provided a mobile terminal, comprising: a memory, a processor, and a display program of video data stored on the memory and operable on the processor, the video data The step of implementing the display method of the video data applied to the mobile terminal as described above when the program is executed by the processor.
根据本申请的一个实施例,还提供了一种计算机可读存储介质,所述计算机可读存储介质上存储有视频数据的显示程序,所述视频数据的显示程序被处理器执行时实 现如上述应用于移动终端的视频数据的显示方法中的步骤。According to an embodiment of the present application, there is also provided a computer readable storage medium having stored thereon a display program of video data, the display program of the video data being executed by a processor as described above A step in a display method of video data applied to a mobile terminal.
对于装置、智能眼镜、移动终端、计算机可读存储介质实施例而言,由于其与方法实施例基本相似,所以描述的比较简单,相关之处参见方法实施例的部分说明即可。For the device, the smart glasses, the mobile terminal, and the computer readable storage medium embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the description of the method embodiment.
本说明书中的各个实施例均采用递进的方式描述,每个实施例重点说明的都是与其他实施例的不同之处,各个实施例之间相同相似的部分互相参见即可。The various embodiments in the present specification are described in a progressive manner, and each embodiment focuses on differences from other embodiments, and the same similar parts between the various embodiments can be referred to each other.
本领域内的技术人员应明白,本申请实施例的实施例可提供为方法、装置、或计算机程序产品。因此,本申请实施例可采用完全硬件实施例、完全软件实施例、或结合软件和硬件方面的实施例的形式。而且,本申请实施例可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘存储器、CD-ROM、光学存储器等)上实施的计算机程序产品的形式。Those skilled in the art will appreciate that embodiments of the embodiments of the present application can be provided as a method, apparatus, or computer program product. Therefore, the embodiments of the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware. Moreover, embodiments of the present application can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) including computer usable program code.
本申请实施例是参照根据本申请实施例的方法、终端设备(***)、和计算机程序产品的流程图和/或方框图来描述的。应理解可由计算机程序指令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理终端设备的处理器以产生一个机器,使得通过计算机或其他可编程数据处理终端设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的装置。Embodiments of the present application are described with reference to flowcharts and/or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the present application. It will be understood that each flow and/or block of the flowchart illustrations and/or FIG. These computer program instructions can be provided to a processor of a general purpose computer, special purpose computer, embedded processor or other programmable data processing terminal device to produce a machine such that instructions are executed by a processor of a computer or other programmable data processing terminal device Means are provided for implementing the functions specified in one or more of the flow or in a block or blocks of a flow diagram.
这些计算机程序指令也可存储在能引导计算机或其他可编程数据处理终端设备以特定方式工作的计算机可读存储器中,使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品,该指令装置实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能。The computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing terminal device to operate in a particular manner, such that instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device. The instruction device implements the functions specified in one or more blocks of the flow or in a flow or block diagram of the flowchart.
这些计算机程序指令也可装载到计算机或其他可编程数据处理终端设备上,使得在计算机或其他可编程终端设备上执行一系列操作步骤以产生计算机实现的处理,从而在计算机或其他可编程终端设备上执行的指令提供用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的步骤。These computer program instructions can also be loaded onto a computer or other programmable data processing terminal device such that a series of operational steps are performed on the computer or other programmable terminal device to produce computer-implemented processing, such that the computer or other programmable terminal device The instructions executed above provide steps for implementing the functions specified in one or more blocks of the flowchart or in a block or blocks of the flowchart.
尽管已描述了本申请实施例的可选实施例,但本领域内的技术人员一旦得知了基本创造性概念,则可对这些实施例做出另外的变更和修改。所以,所附权利要求意欲解释为包括可选实施例以及落入本申请实施例范围的所有变更和修改。Although alternative embodiments of the embodiments of the present application have been described, those skilled in the art can make additional changes and modifications to the embodiments once they are aware of the basic inventive concept. Therefore, the appended claims are intended to be interpreted as including all alternatives and modifications of the embodiments.
最后,还需要说明的是,在本文中,诸如第一和第二等之类的关系术语仅仅用来将一个实体或者操作与另一个实体或操作区分开来,而不一定要求或者暗示这些实体或操作之间存在任何这种实际的关系或者顺序。而且,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者终端设备不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者终端设备所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括所述要素的过程、方法、物品或者终端设备中还存在另外的相同要素。Finally, it should also be noted that in this context, relational terms such as first and second are used merely to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply these entities. There is any such actual relationship or order between operations. Furthermore, the terms "comprises" or "comprising" or "comprising" or any other variations are intended to encompass a non-exclusive inclusion, such that a process, method, article, or terminal device that includes a plurality of elements includes not only those elements but also Other elements that are included, or include elements inherent to such a process, method, article, or terminal device. An element defined by the phrase "comprising a ..." does not exclude the presence of additional identical elements in the process, method, article, or terminal device that comprises the element, without further limitation.
以上对本申请所提供的一种应用于智能眼镜的视频数据的存储方法、一种应用于移动终端的视频数据的显示方法、一种应用于智能眼镜的视频数据的存储装置、一种应用于移动终端的视频数据的显示装置、一种智能眼镜、一种移动终端和一种应用于移动终端的计算机可读存储介质,进行了详细介绍,本文中应用了具体个例对本申请 的原理及实施方式进行了阐述,以上实施例的说明只是用于帮助理解本申请的方法及其核心思想;同时,对于本领域的一般技术人员,依据本申请的思想,在具体实施方式及应用范围上均会有改变之处,综上所述,本说明书内容不应理解为对本申请的限制。The method for storing video data applied to smart glasses provided by the present application, a display method for video data applied to a mobile terminal, a storage device for video data applied to smart glasses, and a method for moving A display device for video data of a terminal, a smart glasses, a mobile terminal, and a computer readable storage medium applied to the mobile terminal are described in detail. In this paper, a specific example is applied to the principle and implementation manner of the present application. The descriptions of the above embodiments are only used to help understand the method of the present application and its core ideas; at the same time, for those skilled in the art, according to the idea of the present application, there will be specific implementations and application scopes. In view of the above, the contents of the present specification should not be construed as limiting the present application.

Claims (22)

  1. 一种视频数据的存储方法,应用于智能眼镜,其特征在于,包括:A method for storing video data, which is applied to smart glasses, and includes:
    接收视频录制指令;Receiving a video recording instruction;
    根据所述视频录制指令,录制视频数据;Recording video data according to the video recording instruction;
    在所述视频数据中提取至少一帧图片;Extracting at least one frame of the picture in the video data;
    将所述至少一帧图片与所述视频数据关联存储。And storing the at least one frame of pictures in association with the video data.
  2. 根据权利要求1所述的方法,其特征在于,所述将所述至少一帧图片与所述视频数据关联存储之前,所述方法还包括:The method according to claim 1, wherein the method further comprises: before the storing the at least one frame of pictures in association with the video data, the method further comprising:
    对所述至少一帧图片作预设图像处理,得到至少一个缩略图;Performing preset image processing on the at least one frame of the image to obtain at least one thumbnail image;
    所述将所述至少一帧图片与所述视频数据关联存储,包括:The associating the at least one frame of the picture with the video data includes:
    将所述至少一个缩略图和所述视频数据关联存储。The at least one thumbnail and the video data are stored in association.
  3. 根据权利要求1所述的方法,其特征在于,所述将所述至少一帧图片与所述视频数据关联存储之后,所述方法还包括:The method according to claim 1, wherein after the storing the at least one frame of pictures in association with the video data, the method further comprises:
    接收与所述智能眼镜配对连接的移动终端应用程序发送的视频同步指令;Receiving a video synchronization instruction sent by a mobile terminal application that is paired with the smart glasses;
    根据所述视频同步指令在所述视频数据中查找待同步的第一目标视频数据;Searching, in the video data, the first target video data to be synchronized according to the video synchronization instruction;
    将所述第一目标视频数据以及与所述第一目标视频数据对应的至少一帧目标图片同步至所述移动终端应用程序。And synchronizing the first target video data and the at least one frame target picture corresponding to the first target video data to the mobile terminal application.
  4. 根据权利要求3所述的方法,其特征在于,所述将所述第一目标视频数据以及与所述第一目标视频数据对应的至少一帧目标图片同步至所述移动终端应用程序之后,所述方法还包括:The method according to claim 3, wherein after the first target video data and at least one frame target picture corresponding to the first target video data are synchronized to the mobile terminal application, The method also includes:
    若接收到表示所述第一目标视频数据同步完成的指令,则将存储的所述至少一帧目标图片删除,并删除所述至少一帧目标图片与所述第一目标视频数据的关联关系。If the instruction indicating that the first target video data is synchronized is received, the stored at least one frame target image is deleted, and the association relationship between the at least one frame target picture and the first target video data is deleted.
  5. 根据权利要求1所述的方法,其特征在于,所述接收视频录制指令之前,所述方法还包括:The method according to claim 1, wherein before the receiving the video recording instruction, the method further comprises:
    发送配对指令至移动终端应用程序;Send a pairing command to the mobile terminal application;
    若所述智能眼镜与所述移动终端应用程序配对成功,则接收登录所述移动终端应用程序的第一用户的标识信息;And if the smart glasses are successfully paired with the mobile terminal application, receiving identification information of the first user that logs in to the mobile terminal application;
    根据所述第一用户的标识信息,为所述第一用户分配用于存储所述第一用户录制的视频数据的第一目标存储路径;Assigning, to the first user, a first target storage path for storing video data recorded by the first user, according to the identifier information of the first user;
    所述接收视频录制指令,包括:接收所述第一用户的视频录制指令;The receiving a video recording instruction includes: receiving a video recording instruction of the first user;
    在视频数据录制完成之后,将所述视频数据存储至所述第一目标存储路径。The video data is stored to the first target storage path after the video data recording is completed.
  6. 根据权利要求1所述的方法,其特征在于,所述在接收视频录制指令之后,所述方法还包括:The method according to claim 1, wherein after receiving the video recording instruction, the method further comprises:
    若在视频录制过程中,接收到开启直播指令,则将当前录制的视频数据实时传输至与所述智能眼镜配对连接的移动终端应用程序。If the live broadcast command is received during the video recording process, the currently recorded video data is transmitted in real time to the mobile terminal application that is paired with the smart glasses.
  7. 一种视频数据的显示方法,应用于移动终端,其特征在于,包括:A method for displaying video data, which is applied to a mobile terminal, and includes:
    接收智能眼镜发送的配对指令;Receiving a pairing instruction sent by the smart glasses;
    根据所述配对指令将所述智能眼镜与移动终端应用程序配对;Pairing the smart glasses with a mobile terminal application according to the pairing instruction;
    在配对成功后,发送视频同步指令至所述智能眼镜,所述视频同步指令包括待同步的第一目标视频数据的属性信息;After the pairing is successful, sending a video synchronization instruction to the smart glasses, where the video synchronization instruction includes attribute information of the first target video data to be synchronized;
    接收第一目标视频数据和至少一帧目标图片,其中,所述至少一帧目标图片提取自所述第一目标视频数据;Receiving first target video data and at least one frame target image, wherein the at least one frame target picture is extracted from the first target video data;
    在所述第一目标视频数据的传输过程中,控制所述至少一帧目标图片在所述移动终端的视频传输界面显示。During the transmission of the first target video data, the at least one frame target picture is controlled to be displayed on a video transmission interface of the mobile terminal.
  8. 根据权利要求7所述的方法,其特征在于,所述至少一帧目标图片的数量为一个,所述在所述第一目标视频数据的传输过程中,控制所述至少一帧目标图片在所述移动终端的视频传输界面显示,包括:The method according to claim 7, wherein the number of the at least one frame of the target picture is one, and the controlling the at least one frame of the target picture in the transmission of the first target video data The video transmission interface display of the mobile terminal includes:
    在所述第一目标视频数据的传输过程中,控制一帧目标图片在所述移动终端的视频传输界面全屏显示。During the transmission of the first target video data, one frame of the target picture is controlled to be displayed in full screen on the video transmission interface of the mobile terminal.
  9. 根据权利要求7所述的方法,其特征在于,所述至少一帧目标图片的帧数为两个或两个以上,所述在所述第一目标视频数据的传输过程中,控制所述至少一帧目标图片在所述移动终端的视频传输界面显示,包括:The method according to claim 7, wherein the number of frames of the at least one frame target picture is two or more, and the at least one of the first target video data is controlled during transmission. A frame of the target picture is displayed on the video transmission interface of the mobile terminal, including:
    在所述第一目标视频数据的传输过程中,控制至少两帧目标图片在所述移动终端的视频传输界面交替显示。During the transmission of the first target video data, at least two frames of target pictures are controlled to be alternately displayed on the video transmission interface of the mobile terminal.
  10. 一种视频数据的存储装置,应用于智能眼镜,其特征在于,包括:A storage device for video data, which is applied to smart glasses, and includes:
    第一接收模块,用于接收视频录制指令;a first receiving module, configured to receive a video recording instruction;
    录制模块,用于根据所述视频录制指令,录制视频数据;a recording module, configured to record video data according to the video recording instruction;
    提取模块,用于在所述视频数据中提取至少一帧图片;An extracting module, configured to extract at least one frame of the image in the video data;
    第一存储模块,用于将所述至少一帧图片与所述视频数据关联存储。a first storage module, configured to store the at least one frame of pictures in association with the video data.
  11. 根据权利要求10所述的装置,其特征在于,所述装置还包括:The device according to claim 10, wherein the device further comprises:
    处理模块,用于对所述至少一个帧图片作预设图像处理,得到至少一个缩略图;a processing module, configured to perform preset image processing on the at least one frame picture to obtain at least one thumbnail image;
    所述第一存储模块,包括:The first storage module includes:
    存储子模块,用于将所述至少一个缩略图和所述视频数据关联存储。And a storage submodule, configured to store the at least one thumbnail and the video data in association.
  12. 根据权利要求10所述的装置,其特征在于,所述装置还包括:The device according to claim 10, wherein the device further comprises:
    第二接收模块,用于接收与所述智能眼镜配对连接的移动终端应用程序发送的视频同步指令;a second receiving module, configured to receive a video synchronization instruction sent by a mobile terminal application that is paired with the smart glasses;
    查找模块,用于根据所述视频同步指令在所述视频数据中查找待同步的第一目标视频数据;a searching module, configured to search, in the video data, the first target video data to be synchronized according to the video synchronization instruction;
    同步模块,用于将所述第一目标视频数据以及与所述第一目标视频数据对应的至少一个目标帧图片同步至所述移动终端。And a synchronization module, configured to synchronize the first target video data and the at least one target frame picture corresponding to the first target video data to the mobile terminal.
  13. 一种视频数据的显示装置,应用于移动终端,其特征在于,包括:A display device for video data, which is applied to a mobile terminal, and includes:
    第一接收模块,用于接收智能眼镜发送的配对指令;a first receiving module, configured to receive a pairing instruction sent by the smart glasses;
    配对模块,用于根据所述配对指令将所述智能眼镜与移动终端应用程序配对;a pairing module, configured to pair the smart glasses with a mobile terminal application according to the pairing instruction;
    发送模块,用于在配对成功后,发送视频同步指令至所述智能眼镜,所述视频同步指令包括待同步的第一目标视频数据的属性信息;a sending module, configured to send a video synchronization instruction to the smart glasses after the pairing is successful, where the video synchronization instruction includes attribute information of the first target video data to be synchronized;
    第二接收模块,用于接收第一目标视频数据和至少一帧目标图片,其中,所述至少一帧目标图片提取自所述第一目标视频数据;a second receiving module, configured to receive first target video data and at least one frame target image, where the at least one frame target picture is extracted from the first target video data;
    控制模块,用于在所述第一目标视频数据的传输过程中,控制所述至少一帧目标图片在所述移动终端的视频传输界面显示。And a control module, configured to control, during the transmission of the first target video data, the at least one frame target image to be displayed on a video transmission interface of the mobile terminal.
  14. 一种智能眼镜,其特征在于,包括:存储器、处理器、摄像头、第一按键;A smart glasses, comprising: a memory, a processor, a camera, and a first button;
    所述处理器,被配置为接收由所述第一按键触发的视频录制指令,并根据所述视频录制指令,控制所述摄像头录制视频数据,并在所述视频数据中提取至少一帧图片,并将所述存储数据和所述至少一帧图片发送至所述存储器;The processor is configured to receive a video recording instruction triggered by the first button, and control the camera to record video data according to the video recording instruction, and extract at least one frame of the image in the video data, And transmitting the stored data and the at least one frame picture to the memory;
    所述存储器,被配置为将所述至少一帧图片与所述视频数据关联存储。The memory is configured to store the at least one frame of pictures in association with the video data.
  15. 根据权利要求14所述的智能眼镜,其特征在于,The smart glasses according to claim 14, wherein
    所述处理器,还被配置为对所述至少一帧图片作预设图像处理,得到至少一个缩略图,并将所述至少一个缩略图发送至所述存储器;The processor is further configured to perform preset image processing on the at least one frame of pictures, obtain at least one thumbnail image, and send the at least one thumbnail image to the memory;
    所述存储器,还被配置为将所述至少一个缩略图和所述视频数据关联存储。The memory is further configured to store the at least one thumbnail and the video data in association.
  16. 根据权利要求14所述的智能眼镜,其特征在于,所述智能眼镜还包括:The smart glasses according to claim 14, wherein the smart glasses further comprise:
    发送器、接收器;Transmitter, receiver;
    所述接收器,被配置为接收与所述智能眼镜配对连接的移动终端应用程序发送的视频同步指令并发送至所述处理器;The receiver is configured to receive a video synchronization instruction sent by a mobile terminal application that is paired with the smart glasses and send the video synchronization instruction to the processor;
    所述处理器,还被配置为根据所述视频同步指令在所述存储器存储的视频数据中查找待同步的第一目标视频数据以及与所述第一目标视频数据对应的至少一帧目标图片,并将所述第一目标视频数据以及所述至少一帧目标图片发送至所述发送器;The processor is further configured to: search, according to the video synchronization instruction, the first target video data to be synchronized and the at least one frame target image corresponding to the first target video data, in the video data stored in the memory, And transmitting the first target video data and the at least one frame target picture to the transmitter;
    所述发送器,被配置为将所述第一目标视频数据以及所述至少一帧目标图片同步至所述移动终端应用程序。The transmitter is configured to synchronize the first target video data and the at least one frame target picture to the mobile terminal application.
  17. 根据权利要求16所述的智能眼镜,其特征在于,The smart glasses according to claim 16, wherein
    所述处理器,还被配置为在所述接收器接收到表示所述第一目标视频数据同步完成的指令时,将所述存储器中存储的所述至少一帧目标图片删除,并删除所述至少一帧目标图片与所述第一目标视频数据的关联关系。The processor is further configured to, when the receiver receives an instruction indicating that the first target video data is synchronized, delete the at least one frame target picture stored in the memory, and delete the Correlation relationship between at least one frame of the target picture and the first target video data.
  18. 根据权利要求14所述的智能眼镜,其特征在于,所述智能眼镜还包括:The smart glasses according to claim 14, wherein the smart glasses further comprise:
    发送器,接收器;Transmitter
    所述发送器,被配置为发送配对指令至移动终端应用程序;The transmitter is configured to send a pairing instruction to the mobile terminal application;
    所述接收器,被配置为在所述智能眼镜与所述移动终端应用程序配对成功时,接收登录所述移动终端应用程序的第一用户的标识信息并发送至所述处理器;The receiver is configured to receive, when the smart glasses are successfully paired with the mobile terminal application, identification information of a first user that logs in to the mobile terminal application, and send the identifier information to the processor;
    所述处理器,被配置为根据所述第一用户的标识信息,为所述第一用户分配用于存储所述第一用户录制的视频数据的第一目标存储路径;The processor is configured to allocate, by the first user, a first target storage path for storing video data recorded by the first user, according to the identifier information of the first user;
    所述处理器,还被配置为接收由所述第一用户按压所述第一按键而触发的视频录制指令;The processor is further configured to receive a video recording instruction triggered by the first user pressing the first button;
    所述存储器,还被配置为在视频数据录制完成之后,将所述摄像头录制的所述视频数据存储至所述第一目标存储路径。The memory is further configured to store the video data recorded by the camera to the first target storage path after the video data recording is completed.
  19. 根据权利要求14所述的智能眼镜,其特征在于,所述智能眼镜还包括:The smart glasses according to claim 14, wherein the smart glasses further comprise:
    发送器,接收器;Transmitter
    所述发送器被配置为在所述接收器被配置为在视频录制过程中,接收到开启直播指令时,将所述摄像头当前录制的视频数据实时传输至与所述智能眼镜配对连接的移动终端应用程序。The transmitter is configured to transmit the video data currently recorded by the camera to a mobile terminal paired with the smart glasses in real time when the receiver is configured to receive a live broadcast command during video recording application.
  20. 一种移动终端,其特征在于,包括:存储器、处理器及存储在所述存储器上并可在所述处理器上运行的视频数据的显示程序,所述视频数据的显示程序被所述处理器执行时实现如权利要求7至9中任一项所述的视频数据的显示方法。A mobile terminal, comprising: a memory, a processor, and a display program of video data stored on the memory and operable on the processor, the display program of the video data being used by the processor The method of displaying video data according to any one of claims 7 to 9 is implemented at the time of execution.
  21. 一种计算机可读存储介质,其特征在于,所述计算机可读存储介质上存储有视频数据的存储程序,所述视频数据的存储程序被处理器执行时实现如权利要求1至6中任一项所述的视频数据的存储方法。A computer readable storage medium, wherein the computer readable storage medium stores a stored program of video data, and the stored program of the video data is executed by a processor to implement any one of claims 1 to 6 The method of storing video data as described in the item.
  22. 一种计算机可读存储介质,其特征在于,所述计算机可读存储介质上存储有视频数据的显示程序,所述视频数据的显示程序被处理器执行时实现如权利要求7至9中任一项所述的视频数据的显示方法。A computer readable storage medium, wherein the computer readable storage medium stores a display program of video data, and the display program of the video data is executed by a processor to implement any one of claims 7 to 9 The method of displaying the video data described in the item.
PCT/CN2018/100828 2017-08-17 2018-08-16 Method and device for storing and displaying video data, and smart glasses WO2019034108A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201710708979.1 2017-08-17
CN201710708979.1A CN107452407A (en) 2017-08-17 2017-08-17 Storage, display methods and the device and intelligent glasses of video data

Publications (1)

Publication Number Publication Date
WO2019034108A1 true WO2019034108A1 (en) 2019-02-21

Family

ID=60492455

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/100828 WO2019034108A1 (en) 2017-08-17 2018-08-16 Method and device for storing and displaying video data, and smart glasses

Country Status (2)

Country Link
CN (1) CN107452407A (en)
WO (1) WO2019034108A1 (en)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107452407A (en) * 2017-08-17 2017-12-08 北京达佳互联信息技术有限公司 Storage, display methods and the device and intelligent glasses of video data
WO2019172671A1 (en) 2018-03-09 2019-09-12 Samsung Electronics Co., Ltd. Display device and control method thereof
KR102092915B1 (en) * 2018-03-09 2020-03-24 삼성전자주식회사 Method for controlling of a display apparatus and display apparatus thereof
CN108900850B (en) * 2018-05-31 2019-09-27 北京达佳互联信息技术有限公司 A kind of live broadcasting method, device and intelligent glasses
CN108924641A (en) * 2018-07-16 2018-11-30 北京达佳互联信息技术有限公司 Live broadcasting method, device and computer equipment and storage medium
CN108924642B (en) * 2018-07-16 2019-08-27 北京达佳互联信息技术有限公司 Stream media live broadcasting method, device and computer equipment and storage medium
CN111405221B (en) * 2020-01-13 2023-03-24 Vidaa(荷兰)国际控股有限公司 Display device and display method of recording file list
CN113556492B (en) * 2021-07-09 2023-10-20 深圳传音控股股份有限公司 Thumbnail generation method, mobile terminal and readable storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101669363A (en) * 2007-04-24 2010-03-10 雅虎公司 Method and system for previewing media over a network
CN103338408A (en) * 2013-05-31 2013-10-02 东莞宇龙通信科技有限公司 Method, system and mobile terminal for selecting video preview frames
CN106685929A (en) * 2016-12-06 2017-05-17 南京金雀智能科技有限公司 Wearable Bluetooth video earphone based communication processing system and method
CN106792272A (en) * 2016-11-28 2017-05-31 维沃移动通信有限公司 The generation method and mobile terminal of a kind of video thumbnails
CN107452407A (en) * 2017-08-17 2017-12-08 北京达佳互联信息技术有限公司 Storage, display methods and the device and intelligent glasses of video data

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3077165B2 (en) * 1990-05-22 2000-08-14 ソニー株式会社 Glasses-type image display device
KR102271741B1 (en) * 2015-01-14 2021-07-02 삼성전자주식회사 Generating and Display of Highlight Video associated with Source Contents

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101669363A (en) * 2007-04-24 2010-03-10 雅虎公司 Method and system for previewing media over a network
CN103338408A (en) * 2013-05-31 2013-10-02 东莞宇龙通信科技有限公司 Method, system and mobile terminal for selecting video preview frames
CN106792272A (en) * 2016-11-28 2017-05-31 维沃移动通信有限公司 The generation method and mobile terminal of a kind of video thumbnails
CN106685929A (en) * 2016-12-06 2017-05-17 南京金雀智能科技有限公司 Wearable Bluetooth video earphone based communication processing system and method
CN107452407A (en) * 2017-08-17 2017-12-08 北京达佳互联信息技术有限公司 Storage, display methods and the device and intelligent glasses of video data

Also Published As

Publication number Publication date
CN107452407A (en) 2017-12-08

Similar Documents

Publication Publication Date Title
WO2019034108A1 (en) Method and device for storing and displaying video data, and smart glasses
WO2019034109A1 (en) Method and device for storing video data, and smart glasses
US10523839B2 (en) Context and content based automated image and media sharing
US10108640B2 (en) Communication apparatus capable of communicating with external apparatus in which contents are recorded, and receiving metadata of contents
CN108900850B (en) A kind of live broadcasting method, device and intelligent glasses
WO2020014880A1 (en) Multi-screen interaction method and device
EP2999232A1 (en) Media playing method, device and system
US9124548B2 (en) Method for uploading media file, electronic device using the same, and non-transitory storage medium
CN111061445A (en) Screen projection method and computing equipment
KR20150022532A (en) Method for reproducing a content, terminal thereof, and system thereof
CN102629974B (en) Image capturing apparatus and its control method
US10235963B2 (en) Communication apparatus communicable with external apparatus, control method of communication apparatus, and storage medium
WO2023045712A1 (en) Screen mirroring abnormality processing method and electronic device
CN114691059A (en) Screen projection display method and electronic equipment
WO2019034107A1 (en) Power saving method and smart glasses
WO2021238967A1 (en) Content sharing method, apparatus and system
WO2019129101A1 (en) Photographing method and mobile electronic terminal
CN114363678A (en) Screen projection method and equipment
US9756195B2 (en) Communication apparatus capable of communicating with external apparatus, control method for communication apparatus, and storage medium
US8648925B2 (en) Control apparatus, control method, and control system for reproducing captured image data
WO2022088926A1 (en) Capturing method and terminal device
US9052989B2 (en) Storage control apparatus and storage method therefor
JP2020091787A (en) Communication device and control method thereof
WO2016175664A2 (en) Video recording device, systems and method
KR20170028593A (en) Method and program for making moving image

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18846584

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 10.09.2020)

122 Ep: pct application non-entry in european phase

Ref document number: 18846584

Country of ref document: EP

Kind code of ref document: A1