CN111787379A

CN111787379A - Interactive method for generating video collection file, display device and intelligent terminal

Info

Publication number: CN111787379A
Application number: CN202010640381.5A
Authority: CN
Inventors: 王学磊
Original assignee: Hisense Visual Technology Co Ltd
Current assignee: Hisense Visual Technology Co Ltd
Priority date: 2020-07-06
Filing date: 2020-07-06
Publication date: 2020-10-16
Anticipated expiration: 2040-07-06
Also published as: CN111787379B

Abstract

The application discloses an interaction method for generating a video collection file, a display device and an intelligent terminal, wherein the display device or the intelligent terminal controls the starting and the closing of a video recording function of the display device. The intelligent terminal and the display equipment are both provided with video recording starting inlets, and the controller receives a video recording starting instruction generated when the video recording starting inlets are triggered so as to indicate the camera to collect a moving image material of a moving target within a preset recording time length according to a preset collection frequency; and splicing and synthesizing the specified number of motion image materials to generate a video collection file. Therefore, according to the method and the display device provided by the invention, after the user starts the video recording function, the user does not need to operate in real time, the controller can actively call the camera in real time to collect the moving image material of the moving object, and synthesize the video collection file, so that the user can know the moving condition of the moving object within the preset recording duration according to the video collection file, and good experience is brought to the user.

Description

Interactive method for generating video collection file, display device and intelligent terminal

Technical Field

The application relates to the technical field of video processing, in particular to an interaction method for generating a video collection file, a display device and an intelligent terminal.

Background

With the rapid development of display devices, the display devices have more and more abundant functions and more powerful performances. Display devices such as smart televisions, smart set-top boxes, smart boxes, and smart terminal products with smart display screens. The display device is used as a sharing device of home entertainment and is provided with an intelligent software system, and the intelligent software system can realize various functions and pre-install various application programs and provide rich content services for users.

When the display equipment is used for realizing the network video call function or other functions needing to acquire images, a camera needs to be installed on the display equipment to acquire the images. With the development of the AI technology, the camera serves as a basic function of intelligent terminal equipment such as an intelligent television, so that the use scenes of the display equipment adopting the camera are more and more abundant, and the most common use scenes are shooting and video recording.

However, in some families, the family members can raise the pets, but if the family members are working in the daytime, the family members can only keep the pets at home, and the family members cannot know the life of the pets in the daytime and miss the wonderful moment of the pets in the daytime. Although the existing display equipment can record videos of pets by using a camera, the video recording requires a user to operate the display equipment in real time to call the camera to realize image acquisition so as to obtain a video file. If the user is not at home in the daytime, the video recording function cannot be started, and the video file for recording the pet cannot be obtained.

Disclosure of Invention

The application provides an interaction method for generating a video collection file, a display device and an intelligent terminal, and aims to solve the problem that the conventional display device cannot record videos of pets to obtain video files when a user does not operate in real time.

In a first aspect, the present application provides a display device comprising:

a display configured to present a user interface on which a video recording start entry is displayed, the video recording start entry being used to start a function of realizing recording of a moving image and generating a video highlight file by video recording within a preset recording duration;

the camera is configured to collect a moving image material of a moving target according to a preset collection frequency, wherein the moving target is a target which needs to record a moving image through video recording within a preset recording time length so as to generate a video collection file;

a controller connected to the camera and display, the controller configured to:

receiving a video recording starting instruction generated when the video recording starting entrance is triggered, wherein the video recording starting instruction is used for indicating a camera to collect a moving image material of a moving target within a preset recording duration according to a preset collection frequency;

when the end time of the preset recording time length is reached, acquiring a plurality of moving image materials of the moving target collected by the camera in the preset recording time length;

and splicing and synthesizing the specified number of the motion image materials to generate a video collection file for recording the motion target within a preset recording time length.

In some embodiments of the present application, the camera, in executing the acquiring of the moving image material of the moving object according to the preset acquisition frequency, is further configured to:

receiving a camera calling instruction generated when the controller responds to the video recording starting instruction;

responding to the camera calling instruction, and collecting the moving image material of the moving target according to a preset collection frequency from the initial time of the preset recording duration;

and when the ending time of the preset recording time length is reached, ending the collection of the moving image material of the moving target.

In some embodiments of the present application, the controller collects, at a preset collection frequency, the moving image material of the moving object from an initial time of the preset recording duration executed by the camera, and is further configured to:

acquiring a preview picture acquired by the camera from the initial time of the preset recording duration;

performing image recognition on the preview picture, and judging whether the moving target exists in the preview picture;

and if the moving target exists in the preview picture, calling a camera to collect the moving image material of the moving target according to a preset collection frequency.

and when the moving target exists in the preview picture, calling the camera to execute a process of collecting the moving image material of the moving target once.

In some embodiments of the present application, the preset acquisition frequency includes a preset acquisition duration and a preset acquisition interval duration;

the camera is further configured to, when executing the acquiring of the moving image material of the moving object according to the preset acquisition frequency:

collecting a first section of moving image material of the moving target according to the preset collection duration from the moment when the moving target is judged to exist in the preview picture;

and after the preset acquisition interval duration, acquiring a second section of moving image material of the moving target according to the preset acquisition duration.

In some embodiments of the present application, the controller, when executing the start command in response to video recording, generates a camera call command, further configured to:

responding to the video recording starting instruction, and acquiring the current running state of the camera;

and if the current running state of the camera is the non-called state, generating a camera calling instruction, wherein the camera calling instruction is used for calling the camera to collect the moving image material.

In some embodiments of the present application, the controller is further configured to:

when the camera starts to collect the moving image material of a moving target in response to a video recording starting instruction, acquiring each section of moving image material collected by the camera;

and generating an image material list interface in the user interface, and displaying each section of the moving image material in the image material list interface according to the time sequence.

In some embodiments of the present application, an operation prompt item is displayed in the image material list interface; and the controller is further configured to:

receiving an interactive function call instruction generated when a user executes corresponding operation according to the operation prompt item;

responding to the interactive function starting instruction, and presenting a functional interactive floating layer in the image material list interface, wherein the functional interactive floating layer comprises a plurality of functional controls;

and responding to a target control instruction generated when the target function control is triggered, and executing target operation corresponding to the target function control.

In some embodiments of the present application, the controller, in performing the displaying each of the moving image materials in the image material list interface in chronological order, is further configured to:

acquiring the starting acquisition time of each section of the moving image material;

generating a time watermark comprising the acquisition starting time, wherein the time watermark corresponds to the moving image materials one to one;

and displaying each section of the moving image material and the corresponding time watermark in the image material list interface according to the time sequence of the acquisition starting time, wherein the time watermark is displayed at the bottom or the top of the corresponding moving image material.

In some embodiments of the present application, the controller, in performing the stitching and synthesizing of the specified number of the moving image materials, generating a video album file recording the moving object within a preset recording duration, is further configured to:

acquiring the total material quantity of the motion image materials collected by the camera within a preset recording time;

if the total material quantity is less than or equal to the designated quantity, splicing and synthesizing the moving image materials of the total material quantity according to the time sequence;

selecting a specified number of target motion image materials in the motion image material set if the total material number is greater than a specified number;

and splicing and synthesizing the specified number of target motion image materials according to a time sequence to generate a video collection file for recording the motion target within a preset recording time length.

In some embodiments of the present application, the controller, in performing selecting a specified number of target moving image materials in the moving image material set if the total material amount is greater than a specified amount, is further configured to:

dividing the starting acquisition time corresponding to each section of the moving image materials into a plurality of material acquisition time periods according to the time period of the starting acquisition time, wherein each material acquisition time period comprises a plurality of moving image materials;

and respectively selecting the moving image materials with the target quantity in each material acquisition time interval as target moving image materials, wherein the sum of the target quantity respectively selected in each material acquisition time interval is equal to the specified quantity.

splicing and synthesizing the specified number of the moving image materials to obtain a video file recording the moving target within a preset recording duration;

acquiring a preset audio file and a broadcast starting watermark, wherein the broadcast starting watermark is used for identifying the product information of the display equipment;

and overlapping the audio file, the broadcast starting watermark and the video file to generate a video collection file for recording the moving target within a preset recording time.

acquiring the generation time of each video collection file;

creating a generation-time watermark including the generation time;

displaying each section of the video collection file and the corresponding generation time watermark in the image material list interface according to the time sequence of the generation time, wherein the generation time watermark is displayed at the bottom or the top of the corresponding video collection file;

and deleting the moving image material for generating the video collection file.

creating a video recording mark, wherein the video recording mark is used for identifying a video collection file generated according to video recording;

and adding the video recording mark on a thumbnail of the video collection file displayed in the image material list interface.

generating a push notification according to the video collection file, wherein the push notification comprises push content and an operation prompt;

displaying the push notification on a system homepage interface presented on the display when the display device is started.

presenting a system homepage interface in the display in response to a device start instruction generated when a user starts the display device, wherein a target application program is displayed on the system homepage interface;

and presenting a user interface in the display in response to a call-up instruction generated when the target application program is triggered, wherein a video recording starting inlet is displayed in the user interface.

In some embodiments of the present application, the controller, when executing the video recording initiation instruction generated when receiving the trigger video recording initiation entry, is further configured to:

presenting a function effect display interface in the display in response to a starting instruction generated when the video recording starting entry is triggered, wherein a starting confirmation entry is displayed on the function effect display interface;

and responding to a confirmation instruction generated by triggering the confirmation starting entrance, canceling the display of the function effect display interface in the display, and generating a video recording starting instruction.

In a second aspect, the present application further provides an intelligent terminal, including:

a display configured to present an end user interface displaying a video recording start entry for starting a video recording function that enables recording of a moving image by video recording within a preset recording duration and generates a video highlight file, the video recording function being configured in a controller of a display device;

a processor coupled to the controller in the display device, the processor having a designated application configured therein, the processor configured to:

receiving a video recording function call instruction generated when the specified application program is triggered;

presenting a terminal user interface with a video recording start entry displayed therein in response to the video recording function call-up instruction;

receiving and triggering a video recording starting instruction generated by the video recording starting inlet, and sending the video recording starting instruction to a controller, wherein the video recording starting instruction is used for indicating the controller to call a camera in display equipment to collect moving image materials of a moving target according to a preset collection frequency within a preset recording time length, and splicing and synthesizing the specified number of the moving image materials to generate and record a video collection file of the moving target within the preset recording time length.

In some embodiments of the present application, the processor is further configured to:

presenting a video list interface in the display in response to the video recording initiation instruction;

and acquiring the moving image material and the video collection file stored in the controller, and displaying the moving image material and the video collection file in the video list interface.

displaying personalized operation controls at the bottom of each moving image material and video collection file displayed in the video list interface;

and responding to the personalized operation instruction generated by triggering the target personalized operation control, and executing the target personalized operation corresponding to the target personalized operation control.

In some embodiments of the present application, a device sharing control is presented in the end user interface; and the processor is further configured to:

receiving a device sharing instruction generated when the device sharing control is triggered, wherein the device sharing instruction is used for establishing an association relation with an opposite terminal intelligent terminal;

and sending the equipment sharing instruction to at least one opposite-end intelligent terminal, and establishing an incidence relation between the local-end intelligent terminal and the at least one opposite-end intelligent terminal, wherein the equipment sharing instruction is used for indicating the opposite-end intelligent terminal to execute personalized operation on the video collection file according to the incidence relation.

In a third aspect, the present application further provides an interactive method for generating a video highlight file, which is applied to a display device, and the method includes:

receiving a video recording starting instruction generated when the video recording starting entry is triggered, wherein the video recording starting instruction is used for indicating a camera to collect a moving image material of a moving object according to a preset collection frequency within a preset recording time length, the video recording starting entry is used for starting a function of recording the moving image and generating a video collection file through video recording within the preset recording time length, and the moving object is a target which needs to record the moving image through the video recording within the preset recording time length to generate the video collection file;

In a fourth aspect, the present application further provides an interactive method for generating a video highlight file, which is applied to an intelligent terminal, and the method includes:

responding to the video recording function starting instruction, presenting a terminal user interface with a video recording starting inlet in the display, wherein the video recording starting inlet is used for starting a video recording function of recording a moving image and generating a video collection file through video recording within a preset recording time length, and the video recording function is configured in a controller of the display equipment;

In a fifth aspect, the present application further provides a storage medium, where the computer storage medium may store a program, and the program may implement, when executed, some or all of the steps in the embodiments of the interaction method for generating a video highlight file provided in the present application.

According to the technical scheme, the interactive method for generating the video collection file, the display device and the intelligent terminal are provided by the embodiment of the invention, and the starting and the closing of the video recording function of the display device are executed by the controller or the intelligent terminal in the display device. The intelligent terminal and the display equipment are both provided with video recording starting inlets, and the controller receives a video recording starting instruction generated when the video recording starting inlets are triggered so as to indicate the camera to collect a moving image material of a moving target within a preset recording time length according to a preset collection frequency; and when the ending time of the preset recording time is reached, splicing and synthesizing the appointed number of motion image materials to generate a video collection file for recording the motion target within the preset recording time. Therefore, the display device provided by the embodiment of the invention does not need real-time operation of a user after the user starts the video recording function, the controller can actively call the camera in real time to acquire the moving image material of the moving object, and synthesize the video collection file after image acquisition is completed, so that the user can know the movement condition of the moving object within the preset recording duration according to the video collection file, and good experience can be brought to the user.

Drawings

In order to more clearly explain the technical solution of the present application, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious to those skilled in the art that other drawings can be obtained according to the drawings without any creative effort.

Fig. 1 is a schematic diagram illustrating an operational scenario between a display device and a control apparatus according to some embodiments;

a block diagram of a hardware configuration of a display device 200 according to some embodiments is illustrated in fig. 2;

a block diagram of the hardware configuration of the control device 100 according to some embodiments is illustrated in fig. 3;

a schematic diagram of a software configuration in a display device 200 according to some embodiments is illustrated in fig. 4;

FIG. 5 illustrates an icon control interface display diagram of an application in the display device 200, according to some embodiments;

FIG. 6 is a block diagram illustrating the structure of a display device according to some embodiments;

an interface schematic of a user interface according to some embodiments is illustrated in fig. 7;

an interface diagram of a functional effects presentation interface according to some embodiments is illustrated in FIG. 8;

FIG. 9 is an interface diagram illustrating a video recording function launch page according to some embodiments;

FIG. 10 illustrates a first interface diagram of an image material list interface, according to some embodiments;

FIG. 11 illustrates a second interface diagram of an image material list interface, according to some embodiments;

a flow diagram of an interactive method of generating a video highlight file according to some embodiments is illustrated in fig. 12;

a flow chart of a method for capturing moving image material by a camera according to some embodiments is illustrated in fig. 13;

a flow diagram of a method of generating a video highlight file according to some embodiments is illustrated in fig. 14;

another method of generating a video highlight file according to some embodiments is illustrated in fig. 15;

a display diagram of enabling a watermark according to some embodiments is illustrated in fig. 16;

FIG. 17 is a schematic diagram illustrating an interactive interface for performing a share to friend function, according to some embodiments;

FIG. 18 is an exemplary illustration of an interactive interface for performing a delete selected records function in accordance with some embodiments;

FIG. 19 is an exemplary illustration of an interactive interface diagram for performing a flush all records function in accordance with some embodiments;

an interactive interface diagram for performing an operation to turn off this functionality according to some embodiments is illustrated in FIG. 20;

an interface schematic diagram showing a video album file in an image material list interface according to some embodiments is illustrated in fig. 21;

FIG. 22 is an interface diagram illustrating the display of a push notification, according to some embodiments;

a block diagram of a smart terminal according to some embodiments is illustrated in fig. 23;

another flow diagram of an interactive method of generating a video highlight file according to some embodiments is illustrated in fig. 24;

an interface schematic of an end user interface according to some embodiments is illustrated in fig. 25;

an interface schematic of a video list interface according to some embodiments is illustrated in fig. 26;

an interface diagram of a terminal settings interface according to some embodiments is illustrated in fig. 27;

fig. 28 is an interface diagram illustrating a presentation of an operation interface in a peer smart terminal according to some embodiments.

Detailed Description

To make the objects, embodiments and advantages of the present application clearer, the following description of exemplary embodiments of the present application will clearly and completely describe the exemplary embodiments of the present application with reference to the accompanying drawings in the exemplary embodiments of the present application, and it is to be understood that the described exemplary embodiments are only a part of the embodiments of the present application, and not all of the embodiments.

All other embodiments, which can be derived by a person skilled in the art from the exemplary embodiments described herein without inventive step, are intended to be within the scope of the claims appended hereto. In addition, while the disclosure herein has been presented in terms of one or more exemplary examples, it should be appreciated that aspects of the disclosure may be implemented solely as a complete embodiment.

It should be noted that the brief descriptions of the terms in the present application are only for the convenience of understanding the embodiments described below, and are not intended to limit the embodiments of the present application. These terms should be understood in their ordinary and customary meaning unless otherwise indicated.

The terms "first," "second," "third," and the like in the description and claims of this application and in the above-described drawings are used for distinguishing between similar or analogous objects or entities and are not necessarily intended to limit the order or sequence of any particular one, Unless otherwise indicated. It is to be understood that the terms so used are interchangeable under appropriate circumstances such that the embodiments described herein are, for example, capable of operation in sequences other than those illustrated or otherwise described herein.

Furthermore, the terms "comprises" and "comprising," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or device that comprises a list of elements is not necessarily limited to those elements explicitly listed, but may include other elements not expressly listed or inherent to such product or device.

The term "module," as used herein, refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and/or software code that is capable of performing the functionality associated with that element.

The term "remote control" as used in this application refers to a component of an electronic device (such as the display device disclosed in this application) that is typically wirelessly controllable over a relatively short range of distances. Typically using infrared and/or Radio Frequency (RF) signals and/or bluetooth to connect with the electronic device, and may also include WiFi, wireless USB, bluetooth, motion sensor, etc. For example: the hand-held touch remote controller replaces most of the physical built-in hard keys in the common remote control device with the user interface in the touch screen.

The term "gesture" as used in this application refers to a user's behavior through a change in hand shape or an action such as hand motion to convey a desired idea, action, purpose, or result.

Fig. 1 is a schematic diagram illustrating an operation scenario between a display device and a control apparatus according to an embodiment. As shown in fig. 1, a user may operate the display device 200 through the mobile terminal 300 and the control apparatus 100.

In some embodiments, the control apparatus 100 may be a remote controller, and the communication between the remote controller and the display device includes an infrared protocol communication or a bluetooth protocol communication, and other short-distance communication methods, etc., and the display device 200 is controlled by wireless or other wired methods. The user may input a user command through a key on a remote controller, voice input, control panel input, etc. to control the display apparatus 200. Such as: the user can input a corresponding control command through a volume up/down key, a channel control key, up/down/left/right moving keys, a voice input key, a menu key, a power on/off key, etc. on the remote controller, to implement the function of controlling the display device 200.

In some embodiments, mobile terminals, tablets, computers, laptops, and other smart devices may also be used to control the display device 200. For example, the display device 200 is controlled using an application program running on the smart device. The application, through configuration, may provide the user with various controls in an intuitive User Interface (UI) on a screen associated with the smart device.

In some embodiments, the mobile terminal 300 may install a software application with the display device 200 to implement connection communication through a network communication protocol for the purpose of one-to-one control operation and data communication. Such as: the mobile terminal 300 and the display device 200 can establish a control instruction protocol, synchronize a remote control keyboard to the mobile terminal 300, and control the display device 200 by controlling a user interface on the mobile terminal 300. The audio and video content displayed on the mobile terminal 300 can also be transmitted to the display device 200, so as to realize the synchronous display function.

As also shown in fig. 1, the display apparatus 200 also performs data communication with the server 400 through various communication means. The display device 200 may be allowed to be communicatively connected through a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display apparatus 200. Illustratively, the display device 200 receives software program updates, or accesses a remotely stored digital media library, by sending and receiving information, as well as Electronic Program Guide (EPG) interactions. The server 400 may be a cluster or a plurality of clusters, and may include one or more types of servers. Other web service contents such as video on demand and advertisement services are provided through the server 400.

The display device 200 may be a liquid crystal display, an OLED display, a projection display device. The particular display device type, size, resolution, etc. are not limiting, and those skilled in the art will appreciate that the display device 200 may be modified in performance and configuration as desired.

The display apparatus 200 may additionally provide an intelligent network tv function of a computer support function including, but not limited to, a network tv, an intelligent tv, an Internet Protocol Tv (IPTV), and the like, in addition to the broadcast receiving tv function.

A hardware configuration block diagram of a display device 200 according to an exemplary embodiment is exemplarily shown in fig. 2.

In some embodiments, at least one of the controller 250, the tuner demodulator 210, the communicator 220, the detector 230, the input/output interface 255, the display 275, the audio output interface 285, the memory 260, the power supply 290, the user interface 265, and the external device interface 240 is included in the display apparatus 200.

In some embodiments, a display 275 receives image signals originating from the first processor output and displays video content and images and components of the menu manipulation interface.

In some embodiments, the display 275, includes a display screen assembly for presenting a picture, and a driving assembly that drives the display of an image.

In some embodiments, the video content is displayed from broadcast television content, or alternatively, from various broadcast signals that may be received via wired or wireless communication protocols. Alternatively, various image contents received from the network communication protocol and sent from the network server side can be displayed.

In some embodiments, the display 275 is used to present a user-manipulated UI interface generated in the display apparatus 200 and used to control the display apparatus 200.

In some embodiments, a driver assembly for driving the display is also included, depending on the type of display 275.

In some embodiments, display 275 is a projection display and may also include a projection device and a projection screen.

In some embodiments, communicator 220 is a component for communicating with external devices or external servers according to various communication protocol types. For example: the communicator may include at least one of a Wifi chip, a bluetooth communication protocol chip, a wired ethernet communication protocol chip, and other network communication protocol chips or near field communication protocol chips, and an infrared receiver.

In some embodiments, the display apparatus 200 may establish control signal and data signal transmission and reception with the external control apparatus 100 or the content providing apparatus through the communicator 220.

In some embodiments, the user interface 265 may be configured to receive infrared control signals from a control device 100 (e.g., an infrared remote control, etc.).

In some embodiments, the detector 230 is a signal used by the display device 200 to collect an external environment or interact with the outside.

In some embodiments, the detector 230 includes a light receiver, a sensor for collecting the intensity of ambient light, and parameters changes can be adaptively displayed by collecting the ambient light, and the like.

In some embodiments, the detector 230 may further include an image collector, such as a camera, etc., which may be configured to collect external environment scenes, collect attributes of the user or gestures interacted with the user, adaptively change display parameters, and recognize user gestures, so as to implement a function of interaction with the user.

In some embodiments, the detector 230 may also include a temperature sensor or the like, such as by sensing ambient temperature.

In some embodiments, the display apparatus 200 may adaptively adjust a display color temperature of an image. For example, the display apparatus 200 may be adjusted to display a cool tone when the temperature is in a high environment, or the display apparatus 200 may be adjusted to display a warm tone when the temperature is in a low environment.

In some embodiments, the detector 230 may also be a sound collector or the like, such as a microphone, which may be used to receive the user's voice. Illustratively, a voice signal including a control instruction of the user to control the display device 200, or to collect an ambient sound for recognizing an ambient scene type, so that the display device 200 can adaptively adapt to an ambient noise.

In some embodiments, as shown in fig. 2, the input/output interface 255 is configured to allow data transfer between the controller 250 and external other devices or other controllers 250. Such as receiving video signal data and audio signal data of an external device, or command instruction data, etc.

In some embodiments, the external device interface 240 may include, but is not limited to, the following: the interface can be any one or more of a high-definition multimedia interface (HDMI), an analog or data high-definition component input interface, a composite video input interface, a USB input interface, an RGB port and the like. The plurality of interfaces may form a composite input/output interface.

In some embodiments, as shown in fig. 2, the tuning demodulator 210 is configured to receive a broadcast television signal through a wired or wireless receiving manner, perform modulation and demodulation processing such as amplification, mixing, resonance, and the like, and demodulate an audio and video signal from a plurality of wireless or wired broadcast television signals, where the audio and video signal may include a television audio and video signal carried in a television channel frequency selected by a user and an EPG data signal.

In some embodiments, the frequency points demodulated by the tuner demodulator 210 are controlled by the controller 250, and the controller 250 can send out control signals according to user selection, so that the modem responds to the television signal frequency selected by the user and modulates and demodulates the television signal carried by the frequency.

In some embodiments, the broadcast television signal may be classified into a terrestrial broadcast signal, a cable broadcast signal, a satellite broadcast signal, an internet broadcast signal, or the like according to the broadcasting system of the television signal. Or may be classified into a digital modulation signal, an analog modulation signal, and the like according to a modulation type. Or the signals are classified into digital signals, analog signals and the like according to the types of the signals.

In some embodiments, the controller 250 and the modem 210 may be located in different separate devices, that is, the modem 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box. Therefore, the set top box outputs the television audio and video signals modulated and demodulated by the received broadcast television signals to the main body equipment, and the main body equipment receives the audio and video signals through the first input/output interface.

In some embodiments, the controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in memory. The controller 250 may control the overall operation of the display apparatus 200. For example: in response to receiving a user command for selecting a UI object to be displayed on the display 275, the controller 250 may perform an operation related to the object selected by the user command.

In some embodiments, the object may be any one of selectable objects, such as a hyperlink or an icon. Operations related to the selected object, such as: displaying an operation connected to a hyperlink page, document, image, or the like, or performing an operation of a program corresponding to the icon. The user command for selecting the UI object may be a command input through various input means (e.g., a mouse, a keyboard, a touch pad, etc.) connected to the display apparatus 200 or a voice command corresponding to a voice spoken by the user.

As shown in fig. 2, the controller 250 includes at least one of a Random Access Memory 251 (RAM), a Read-Only Memory 252 (ROM), a video processor 270, an audio processor 280, other processors 253 (e.g., a Graphics Processing Unit (GPU), a central Processing Unit 254 (CPU), a Communication Interface (Communication Interface), and a Communication Bus 256(Bus), which connects the respective components.

In some embodiments, RAM 251 is used to store temporary data for the operating system or other programs that are running

In some embodiments, ROM252 is used to store instructions for various system boots.

In some embodiments, the ROM252 is used to store a Basic Input Output System (BIOS). The system is used for completing power-on self-test of the system, initialization of each functional module in the system, a driver of basic input/output of the system and booting an operating system.

In some embodiments, when the power-on signal is received, the display device 200 starts to power up, the CPU executes the system boot instruction in the ROM252, and copies the temporary data of the operating system stored in the memory to the RAM 251 so as to start or run the operating system. After the start of the operating system is completed, the CPU copies the temporary data of the various application programs in the memory to the RAM 251, and then, the various application programs are started or run.

In some embodiments, CPU processor 254 is used to execute operating system and application program instructions stored in memory. And executing various application programs, data and contents according to various interactive instructions received from the outside so as to finally display and play various audio and video contents.

In some example embodiments, the CPU processor 254 may comprise a plurality of processors. The plurality of processors may include a main processor and one or more sub-processors. A main processor for performing some operations of the display apparatus 200 in a pre-power-up mode and/or operations of displaying a screen in a normal mode. One or more sub-processors for one operation in a standby mode or the like.

In some embodiments, the graphics processor 253 is used to generate various graphics objects, such as: icons, operation menus, user input instruction display graphics, and the like. The display device comprises an arithmetic unit which carries out operation by receiving various interactive instructions input by a user and displays various objects according to display attributes. And the system comprises a renderer for rendering various objects obtained based on the arithmetic unit, wherein the rendered objects are used for being displayed on a display.

In some embodiments, the video processor 270 is configured to receive an external video signal, and perform video processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, image synthesis, and the like according to a standard codec protocol of the input signal, so as to obtain a signal that can be displayed or played on the direct display device 200.

In some embodiments, video processor 270 includes a demultiplexing module, a video decoding module, an image synthesis module, a frame rate conversion module, a display formatting module, and the like.

The demultiplexing module is used for demultiplexing the input audio and video data stream, and if the input MPEG-2 is input, the demultiplexing module demultiplexes the input audio and video data stream into a video signal and an audio signal.

And the video decoding module is used for processing the video signal after demultiplexing, including decoding, scaling and the like.

And the image synthesis module is used for carrying out superposition mixing processing on the GUI signal input by the user or generated by the user and the video image after the zooming processing by the graphic generator so as to generate an image signal for display.

The frame rate conversion module is configured to convert an input video frame rate, such as a 60Hz frame rate into a 120Hz frame rate or a 240Hz frame rate, and the normal format is implemented in, for example, an interpolation frame mode.

The display format module is used for converting the received video output signal after the frame rate conversion, and changing the signal to conform to the signal of the display format, such as outputting an RGB data signal.

In some embodiments, the graphics processor 253 and the video processor may be integrated or separately configured, and when the graphics processor and the video processor are integrated, the graphics processor and the video processor may perform processing of graphics signals output to the display, and when the graphics processor and the video processor are separately configured, the graphics processor and the video processor may perform different functions, respectively, for example, a GPU + frc (frame Rate conversion) architecture.

In some embodiments, the audio processor 280 is configured to receive an external audio signal, decompress and decode the received audio signal according to a standard codec protocol of the input signal, and perform noise reduction, digital-to-analog conversion, and amplification processes to obtain an audio signal that can be played in a speaker.

In some embodiments, video processor 270 may comprise one or more chips. The audio processor may also comprise one or more chips.

In some embodiments, the video processor 270 and the audio processor 280 may be separate chips or may be integrated together with the controller in one or more chips.

In some embodiments, the audio output, under the control of controller 250, receives sound signals output by audio processor 280, such as: the speaker 286, and an external sound output terminal of a generating device that can output to an external device, in addition to the speaker carried by the display device 200 itself, such as: external sound interface or earphone interface, etc., and may also include a near field communication module in the communication interface, for example: and the Bluetooth module is used for outputting sound of the Bluetooth loudspeaker.

The power supply 290 supplies power to the display device 200 from the power input from the external power source under the control of the controller 250. The power supply 290 may include a built-in power supply circuit installed inside the display apparatus 200, or may be a power supply interface installed outside the display apparatus 200 to provide an external power supply in the display apparatus 200.

A user interface 265 for receiving an input signal of a user and then transmitting the received user input signal to the controller 250. The user input signal may be a remote controller signal received through an infrared receiver, and various user control signals may be received through the network communication module.

In some embodiments, the user inputs a user command through the control apparatus 100 or the mobile terminal 300, the user input interface responds to the user input through the controller 250 according to the user input, and the display device 200 responds to the user input through the controller 250.

In some embodiments, a user may enter user commands on a Graphical User Interface (GUI) displayed on the display 275, and the user input interface receives the user input commands through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface receives the user input command by recognizing the sound or gesture through the sensor.

In some embodiments, a "user interface" is a media interface for interaction and information exchange between an application or operating system and a user that enables conversion between an internal form of information and a form that is acceptable to the user. A commonly used presentation form of the User Interface is a Graphical User Interface (GUI), which refers to a User Interface related to computer operations and displayed in a graphical manner. It may be an interface element such as an icon, a window, a control, etc. displayed in the display screen of the electronic device, where the control may include a visual interface element such as an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, etc.

The memory 260 includes a memory storing various software modules for driving the display device 200. Such as: various software modules stored in the first memory, including: at least one of a basic module, a detection module, a communication module, a display control module, a browser module, and various service modules.

The base module is a bottom layer software module for signal communication between various hardware in the display device 200 and for sending processing and control signals to the upper layer module. The detection module is used for collecting various information from various sensors or user input interfaces, and the management module is used for performing digital-to-analog conversion and analysis management.

For example, the voice recognition module comprises a voice analysis module and a voice instruction database module. The display control module is used for controlling the display to display the image content, and can be used for playing the multimedia image content, UI interface and other information. And the communication module is used for carrying out control and data communication with external equipment. And the browser module is used for executing a module for data communication between browsing servers. And the service module is used for providing various services and modules including various application programs. Meanwhile, the memory 260 may store a visual effect map for receiving external data and user data, images of various items in various user interfaces, and a focus object, etc.

Fig. 3 exemplarily shows a block diagram of a configuration of the control apparatus 100 according to an exemplary embodiment. As shown in fig. 3, the control apparatus 100 includes a controller 110, a communication interface 130, a user input/output interface, a memory, and a power supply source.

The control device 100 is configured to control the display device 200 and may receive an input operation instruction of a user and convert the operation instruction into an instruction recognizable and responsive by the display device 200, serving as an interaction intermediary between the user and the display device 200. Such as: the user responds to the channel up and down operation by operating the channel up and down keys on the control device 100.

In some embodiments, the control device 100 may be a smart device. Such as: the control apparatus 100 may install various applications that control the display apparatus 200 according to user demands.

In some embodiments, as shown in fig. 1, a mobile terminal 300 or other intelligent electronic device may function similar to the control device 100 after installing an application that manipulates the display device 200. Such as: the user may implement the functions of controlling the physical keys of the device 100 by installing applications, various function keys or virtual buttons of a graphical user interface available on the mobile terminal 300 or other intelligent electronic device.

The controller 110 includes a processor 112 and RAM 113 and ROM 114, a communication interface 130, and a communication bus. The controller is used to control the operation of the control device 100, as well as the communication cooperation between the internal components and the external and internal data processing functions.

The communication interface 130 enables communication of control signals and data signals with the display apparatus 200 under the control of the controller 110. Such as: the received user input signal is transmitted to the display apparatus 200. The communication interface 130 may include at least one of a WiFi chip 131, a bluetooth module 132, an NFC module 133, and other near field communication modules.

A user input/output interface 140, wherein the input interface includes at least one of a microphone 141, a touch pad 142, a sensor 143, keys 144, and other input interfaces. Such as: the user can realize a user instruction input function through actions such as voice, touch, gesture, pressing, and the like, and the input interface converts the received analog signal into a digital signal and converts the digital signal into a corresponding instruction signal, and sends the instruction signal to the display device 200.

The output interface includes an interface that transmits the received user instruction to the display apparatus 200. In some embodiments, the interface may be an infrared interface or a radio frequency interface. Such as: when the infrared signal interface is used, the user input instruction needs to be converted into an infrared control signal according to an infrared control protocol, and the infrared control signal is sent to the display device 200 through the infrared sending module. The following steps are repeated: when the rf signal interface is used, a user input command needs to be converted into a digital signal, and then the digital signal is modulated according to the rf control signal modulation protocol and then transmitted to the display device 200 through the rf transmitting terminal.

In some embodiments, the control device 100 includes at least one of a communication interface 130 and an input-output interface 140. The control device 100 is provided with a communication interface 130, such as: the WiFi, bluetooth, NFC, etc. modules may transmit the user input command to the display device 200 through the WiFi protocol, or the bluetooth protocol, or the NFC protocol code.

A memory 190 for storing various operation programs, data and applications for driving and controlling the control apparatus 200 under the control of the controller. The memory 190 may store various control signal commands input by a user.

And a power supply 180 for providing operational power support to the various elements of the control device 100 under the control of the controller. A battery and associated control circuitry.

In some embodiments, the system may include a Kernel (Kernel), a command parser (shell), a file system, and an application program. The kernel, shell, and file system together make up the basic operating system structure that allows users to manage files, run programs, and use the system. After power-on, the kernel is started, kernel space is activated, hardware is abstracted, hardware parameters are initialized, and virtual memory, a scheduler, signals and interprocess communication (IPC) are operated and maintained. And after the kernel is started, loading the Shell and the user application program. The application program is compiled into machine code after being started, and a process is formed.

Referring to fig. 4, in some embodiments, the system is divided into four layers, which are an Application (Applications) layer (abbreviated as "Application layer"), an Application Framework (Application Framework) layer (abbreviated as "Framework layer"), an Android runtime (Android runtime) and system library layer (abbreviated as "system runtime library layer"), and a kernel layer from top to bottom.

In some embodiments, at least one application program runs in the application program layer, and the application programs can be Window (Window) programs carried by an operating system, system setting programs, clock programs, camera applications and the like; or may be an application developed by a third party developer such as a hi program, a karaoke program, a magic mirror program, or the like. In specific implementation, the application packages in the application layer are not limited to the above examples, and may actually include other application packages, which is not limited in this embodiment of the present application.

The framework layer provides an Application Programming Interface (API) and a programming framework for the application program of the application layer. The application framework layer includes a number of predefined functions. The application framework layer acts as a processing center that decides to let the applications in the application layer act. The application program can access the resource in the system and obtain the service of the system in execution through the API interface

As shown in fig. 4, in the embodiment of the present application, the application framework layer includes a manager (Managers), a Content Provider (Content Provider), and the like, where the manager includes at least one of the following modules: an activity manager (ActivityManager) is used to interact with all activities running in the system; the Location Manager (Location Manager) is used for providing the system service or application with the access of the system Location service; a Package Manager (Package Manager) for retrieving various information related to an application Package currently installed on the device; a notification manager (notifiationmanager) for controlling display and clearing of notification messages; a Window Manager (Window Manager) is used to manage the icons, windows, toolbars, wallpapers, and desktop components on a user interface.

In some embodiments, the activity manager is to: managing the life cycle of each application program and the general navigation backspacing function, such as controlling the exit of the application program (including switching the user interface currently displayed in the display window to the system desktop), opening, backing (including switching the user interface currently displayed in the display window to the previous user interface of the user interface currently displayed), and the like.

In some embodiments, the window manager is configured to manage all window processes, such as obtaining a display size, determining whether a status bar is available, locking a screen, intercepting a screen, controlling a display change (e.g., zooming out, dithering, distorting, etc.) and the like.

In some embodiments, the system runtime layer provides support for the upper layer, i.e., the framework layer, and when the framework layer is used, the android operating system runs the C/C + + library included in the system runtime layer to implement the functions to be implemented by the framework layer.

In some embodiments, the kernel layer is a layer between hardware and software. As shown in fig. 4, the core layer includes at least one of the following drivers: audio drive, display drive, bluetooth drive, camera drive, WIFI drive, USB drive, HDMI drive, sensor drive (such as fingerprint sensor, temperature sensor, touch sensor, pressure sensor, etc.), and so on.

In some embodiments, the kernel layer further comprises a power driver module for power management.

In some embodiments, software programs and/or modules corresponding to the software architecture of fig. 4 are stored in the first memory or the second memory shown in fig. 2 or 3.

In some embodiments, taking the magic mirror application (photographing application) as an example, when the remote control receiving device receives a remote control input operation, a corresponding hardware interrupt is sent to the kernel layer. The kernel layer processes the input operation into an original input event (including information such as a value of the input operation, a timestamp of the input operation, etc.). The raw input events are stored at the kernel layer. The application program framework layer obtains an original input event from the kernel layer, identifies a control corresponding to the input event according to the current position of the focus and uses the input operation as a confirmation operation, the control corresponding to the confirmation operation is a control of a magic mirror application icon, the magic mirror application calls an interface of the application framework layer to start the magic mirror application, and then the kernel layer is called to start a camera driver, so that a static image or a video is captured through the camera.

In some embodiments, for a display device with a touch function, taking a split screen operation as an example, the display device receives an input operation (such as a split screen operation) that a user acts on a display screen, and the kernel layer may generate a corresponding input event according to the input operation and report the event to the application framework layer. The window mode (such as multi-window mode) corresponding to the input operation, the position and size of the window and the like are set by an activity manager of the application framework layer. And the window management of the application program framework layer draws a window according to the setting of the activity manager, then sends the drawn window data to the display driver of the kernel layer, and the display driver displays the corresponding application interface in different display areas of the display screen.

In some embodiments, as shown in fig. 5, the application layer containing at least one application may display a corresponding icon control in the display, such as: the system comprises a live television application icon control, a video on demand application icon control, a media center application icon control, an application center icon control, a game application icon control and the like.

In some embodiments, the live television application may provide live television via different signal sources. For example, a live television application may provide television signals using input from cable television, radio broadcasts, satellite services, or other types of live television services. And, the live television application may display video of the live television signal on the display device 200.

In some embodiments, a video-on-demand application may provide video from different storage sources. Unlike live television applications, video on demand provides a video display from some storage source. For example, the video on demand may come from a server side of the cloud storage, from a local hard disk storage containing stored video programs.

In some embodiments, the media center application may provide various applications for multimedia content playback. For example, a media center, which may be other than live television or video on demand, may provide services that a user may access to various images or audio through a media center application.

In some embodiments, an application center may provide storage for various applications. The application may be a game, an application, or some other application associated with a computer system or other device that may be run on the smart television. The application center may obtain these applications from different sources, store them in local storage, and then be operable on the display device 200.

In some embodiments, the display device uses a camera usage scenario, for example, a day of life of a pet is recorded by way of video recording. Because the existing display equipment is used for recording videos of pets, a user generally needs to operate the display equipment in real time to call a camera to realize image acquisition, and then a video file can be obtained. Therefore, in order to facilitate the user to record the wonderful life of the pet by calling the camera when the user is not at home in the daytime, the video recording function can be configured in the display device, and the richness of the use scene of the camera adopted by the display device is improved.

After the video recording function in the display equipment is started, the display equipment can call the camera in real time to acquire the moving image materials of the pet. The process that the display device calls the camera to collect the images in real time does not need real-time operation of a user, and the process can be automatically realized by the display device as long as the display device is powered on and networked. Finally, the display equipment can also generate a video collection file according to a plurality of moving image materials collected by the camera in one day and push the video collection file to the user, so that the user is prevented from missing wonderful life of the pet after leaving home in the daytime.

The video recording function is suitable for recording the wonderful life of a pet in one day, and can also record the conditions of other moving objects, such as the conditions of a baby of a user at home. When the display equipment starts a video recording function, as long as moving objects such as pets or babies appear in a shooting area of the camera, the camera collects moving image materials, finally, a plurality of moving image materials collected in one day are generated into a video collection file, and the video collection file is pushed to a user when the user starts the display equipment next time so as to be convenient for the user to check. The user can learn the life condition of a pet or a baby at home one day according to the video collection file, and good experience can be brought to the user.

A block diagram of a display device according to some embodiments is illustrated in fig. 6. Referring to fig. 6, in order to facilitate a user to record a wonderful life of a pet by using a camera when the user is not at home and generate a video highlight file, an embodiment of the present invention provides a display device 200, which includes a display 275, a camera 232, and a controller 250. The display is configured to present a user interface displaying a video recording start entry for starting a function of recording a moving image and generating a video highlight file by video recording within a preset recording duration; the camera is configured to collect a moving image material of a moving object according to a preset collection frequency, wherein the moving object refers to an object which needs to record a moving image through video recording within a preset recording duration to generate a video collection file.

The controller is respectively connected with the camera and the display, and is used for starting a video recording function configured in the display equipment, calling the camera to collect moving image materials of a moving target and finally generating a video collection file. In order to facilitate faster and more convenient operation of a user when interacting with a display device, an interaction method for generating a video album file is provided, which can instruct the user how to start a video recording function and how to perform interactive operation on the video album file.

To implement the video recording function, a target application is configured in the display device, specifically, a controller, and the target application is displayed on a system homepage interface of the display device. The target application is used to provide access to initiate the video recording function.

To cause a user interface with a video recording initiation entry displayed therein to be presented in the display, the controller is further configured to:

step 011, responding to a device starting instruction generated when the user starts the display device, and presenting a system homepage interface in the display, wherein the target application program is displayed on the system homepage interface.

And step 012, responding to a call-up instruction generated when the target application program is triggered, and presenting a user interface in the display, wherein a video recording starting inlet is displayed in the user interface.

When the user turns on the display device, a device start instruction is generated. The controller can call a system homepage interface according to the equipment starting instruction and display the system homepage interface in the display, and the target application program is displayed on the system homepage interface.

The user triggers the target application program through a remote controller or a voice mode to generate a call-up instruction, and the controller calls up a user interface according to the call-up instruction to be displayed in the display. At this time, the content displayed on the display is switched from the display system homepage interface to the user interface. The user interface is a main page of the target application program.

When the user interface is called up, the video recording starting entry is displayed in the user interface, and a user clicks the video recording starting entry through a remote controller or a voice mode, so that the video recording function of the display equipment can be started, namely, the collection of the moving image material of the moving object is started, and the video collection file is generated.

An interface diagram of a user interface according to some embodiments is illustrated in fig. 7. Referring to fig. 7, if the target application is "small-focus at home", the user interface displayed after "small-focus at home" is triggered, and a video recording start entry is displayed, for example, a "day of favorite lovely" displayed in the upper right corner of the user interface. And triggering the favorite day to start the video recording function of the display equipment.

In some embodiments, a video recording start entry may also be added to the system homepage interface in the form of a shortcut, so that the user can quickly start the video recording function of the display device through the video recording start entry on the system homepage interface after starting the display device.

The user triggers the video recording starting entrance on the user interface or the system homepage interface, and then a video recording starting instruction can be generated, so that the controller starts the video recording function of the display device, namely, the camera is called to start to collect images. Specifically, the controller generates a video recording start instruction when executing the triggered video recording start entry, and is further configured to:

and 021, responding to a starting instruction generated when the video record is triggered to start the entrance, and displaying a functional effect display interface in the display, wherein a confirmed starting entrance is displayed on the functional effect display interface.

022, responding to a confirmation instruction generated by the trigger confirmation starting inlet, canceling the display function effect display interface in the display, and generating a video recording starting instruction.

In order to enable a user to clearly know the implementation effect of the video recording function when the user uses the function for the first time, a function effect display interface can be displayed in a display when the video recording starting inlet is triggered. The content displayed on the function effect display interface comprises the function brief introduction and the available effect display.

An interface diagram of a functional effects presentation interface according to some embodiments is illustrated in fig. 8. The pages shown in (a) and (b) in fig. 8 are exemplary presentation interfaces of the functional effect presentation interface, and a user can have a certain understanding of the video recording function according to the content presented on the functional effect presentation interface.

The user triggers a video recording start-up entry on a user interface or a system homepage interface through a remote controller, and a start-up instruction is generated. The controller may set up the function effect display interface shown in fig. 8 according to the start instruction and display the function effect display interface in the display, and at this time, the content displayed in the display is switched from the display user interface to the function effect display interface.

In order to facilitate the user to quickly start the video recording function, a confirmation start entry may be displayed on the last interface of the functional effect presentation interface, such as an "open" control shown in fig. 8 (b).

The user triggers the start confirmation entry through the remote control, which generates a confirmation instruction indicating that the user wants to start the video recording function. At this time, the controller cancels the display function effect display interface in the display according to the confirmation instruction, and generates a video recording start instruction to start the video recording function of the display device.

In some embodiments, if the user starts the video recording function of the display device for the second time or subsequent times (the user starts the video recording function and then closes the video recording function for the first time), the user may not display the function effect display interface any longer but directly display the video recording function start interface when triggering the video recording start entry on the user interface.

An interface schematic of a video recording function launch page according to some embodiments is illustrated in fig. 9. Referring to fig. 9, a user triggers a video recording start entry in the user interface shown in fig. 7 to generate a start instruction, the controller invokes a video recording function start interface according to the start instruction and displays the video recording function start interface in the display, and at this time, the content displayed in the display is switched from the user interface shown in fig. 7 to the video recording function start interface shown in fig. 9.

A confirmation launch entry, such as the "open" control shown in fig. 9, is displayed on the video recording function launch interface. The user triggers the confirmation initiation entry, which generates a confirmation instruction. At this time, the controller cancels the display of the video recording function starting interface in the display according to the confirmation instruction, and generates a video recording starting instruction to start the video recording function of the display device.

After the video recording function of the display equipment is started, an image material list interface is presented in the display, namely, after the controller responds to a confirmation instruction, the image material list interface is called up and displayed in the display, and the image material list interface is used for displaying the moving image material and the video collection file. At this time, the content displayed in the display is switched from being displayed as the image material list interface by displaying the function effect presentation interface shown in fig. 8 (or, the video recording function start interface shown in fig. 9).

In some embodiments, if the user first activates the video recording function of the display device, it indicates that the camera has not captured any moving image material, and no video album file has been generated, and therefore, no content is displayed in the image material list interface.

A first interface diagram of an image material list interface according to some embodiments is illustrated in fig. 10. The content displayed in the image material list interface when the user first starts the video recording function is as shown in fig. 10 (a). At this time, the prompt content "pet has not been found" is displayed in the image material list interface, and the operation prompt item "pressing menu key, function can be turned off or video deletion can be shared" is presented in the upper right corner of the image material list interface.

Since no content is displayed in the image material list interface, the menu key is triggered at this time, and only the close function can be realized. The user triggers a menu key configured on the remote controller according to the operation prompt to call out the floating layer, and the function is turned off as shown in (b) in fig. 10. The user triggers the confirm key on the remote controller to execute the function of closing the video recording function.

In some embodiments, if the user does not start the video recording function of the display device for the first time, but starts the video recording function of the display device for the second or subsequent times, it indicates that the camera has collected the moving image material, and may also generate the video album file, and at this time, the moving image material collected by the camera in history and the video album file generated by the controller in history are displayed in the image material list interface.

A second interface diagram of an image material list interface according to some embodiments is illustrated in fig. 11. When the user activates the video recording function for the second or subsequent times, the contents displayed in the image material list interface are as shown in fig. 11. Meanwhile, the upper right corner of the image material list interface presents an operation prompt item 'pressing a menu key, and the function can be closed or the deleted video can be shared'.

After the user triggers the video recording starting inlet through the remote controller, the video recording function of the display equipment can be started. That is to say, the display device can actively call the camera to collect the moving image material of the moving object in real time without real-time operation of the user, and generate a video collection file from a plurality of moving image materials after completing video recording of one day, wherein the video collection file is the life condition of the moving object in one day.

A flow diagram of an interactive method of generating a video highlight file according to some embodiments is illustrated in fig. 12. In order to facilitate the display device to actively call the camera and generate the video highlight file, referring to fig. 12, in the display device according to the embodiment of the present invention, when the interactive method for generating the video highlight file is executed, the controller is configured to execute the following steps:

and S11, receiving a video recording starting instruction generated when the video recording starting entrance is triggered, wherein the video recording starting instruction is used for indicating the camera to collect the moving image material of the moving object within a preset recording time length according to a preset collection frequency.

The user triggers the video recording starting entrance on a user interface or a system homepage interface to generate a video recording starting instruction, and the controller can start the video recording function of the display device according to the video recording starting instruction, namely, the camera is called to start to collect the moving image material of the moving object. The moving image material includes a moving picture or a moving video.

Since the time when the user is separated from the pet or baby is generally in the daytime, that is, the display device only needs to record the life condition of the pet or baby in the daytime, the preset recording time period can be set. The preset recording time is a time period for the controller to automatically call the camera to collect the moving image materials.

In some embodiments, the preset recording time period may be set to 6:00-18:00, i.e., the controller calls the camera to capture the moving image material within a time period of 6:00-18: 00. In other embodiments, the preset recording duration may be set to be other time periods according to the actual application condition of the user.

When the camera collects the moving image material of the moving object, if the moving object always keeps a posture and does not move in the shooting range of the camera, the moving image material collected by the camera is the same content. In order to avoid that the camera collects the same material for a long time and occupies too large storage space, in some embodiments, the camera can be controlled to collect the moving image material of the moving object according to the preset collection frequency.

A flow chart of a method for capturing moving image material by a camera according to some embodiments is illustrated in fig. 13. Referring to fig. 13, the camera, in performing capturing of moving image material of a moving object at a preset capturing frequency, is further configured to perform the following steps:

and S111, receiving a camera calling instruction generated when the controller responds to the video recording starting instruction.

After the controller receives a video recording starting instruction, the camera can be called to carry out image acquisition. Therefore, after the controller receives a video recording starting instruction, a camera calling instruction is generated and sent to the camera, and the camera can be started and starts to collect the moving image material of the moving target according to the camera calling instruction.

And at this time, the controller cannot call the camera to collect the moving image material of the moving object. Therefore, the controller needs to judge that the camera can be called first, and send a camera calling instruction to the camera if the camera can be called.

In some embodiments, the controller generates the camera call instruction before sending the camera call instruction to the camera, i.e. when executing the video recording initiation instruction in response to the video recording initiation instruction, further configured to perform the steps of:

and 1111, responding to the video recording starting instruction, and acquiring the current running state of the camera.

And step 1112, if the current running state of the camera is an un-called state, generating a camera calling instruction, wherein the camera calling instruction is used for calling the camera to collect the moving image material.

And the controller acquires the current running state of the camera according to the video recording starting instruction so as to judge whether the camera can be called or not. And when the camera is judged to be in the non-called state, the camera can be called to collect the moving image material of the moving object.

At the moment, the controller generates a camera calling instruction and sends the camera calling instruction to the camera so as to start the camera and call the camera to collect the moving image materials.

After the video recording function is started, the controller calls the camera to continuously collect the moving image materials of the moving target all the time as long as the camera is not occupied by other application programs.

And S112, responding to a camera calling instruction, and collecting the moving image material of the moving object according to a preset collection frequency from the initial time of a preset recording time length.

And S113, when the ending time of the preset recording time length is reached, ending the collection of the moving image material of the moving target.

After the camera receives a camera calling instruction sent by the controller, the camera can execute the instruction every day to collect the moving image materials of the moving object. Therefore, the time when the image material of the camera starts to be collected is the initial time of the preset recording time.

The camera collects the moving image materials of the moving object according to a preset collection frequency from the initial time of a preset recording time length every day until the collection is finished when the end time of the preset recording time length is reached. For example, the camera starts capturing moving image material for a moving object at 6:00 a day and ends capturing at 18:00 a day.

And when the end time of the preset recording time length is reached, the controller generates a camera call stop instruction and sends the camera call stop instruction to the camera so as to control the camera to end the collection of the moving image material of the moving target.

After the camera is called, images are not collected all the time, but the moving image materials are collected after the moving target appears in the shooting range of the camera, so that the problem that the camera collects useless image materials to cause resource waste is avoided.

In some embodiments, in order to accurately determine that the camera can capture moving image material including a moving object, the controller captures the moving image material of the moving object at a preset capture frequency from an initial time of a preset recording time period, the controller is further configured to perform the following steps:

step 1121, obtaining a preview picture collected by the camera from the initial time of the preset recording duration.

In step 1122, image recognition is performed on the preview screen to determine whether or not a moving object is present on the preview screen.

And 1123, if the moving object exists in the preview picture, calling a camera to collect the moving image material of the moving object according to the preset collection frequency.

After the camera is called, the camera can acquire a preview picture in real time from the initial moment of the preset recording time, and the problem of occupying storage space can be avoided because the preview picture shows that video recording is not carried out.

The controller carries out image recognition on a preview picture acquired by the camera in real time, and determines whether the moving target appears in a shooting area of the camera according to an image recognition result. And only when the moving target appears in the shooting area of the camera, the camera is called to collect the moving image material of the moving target.

The controller can send a control instruction to the camera after judging that the moving object exists in the preview picture, and at the moment, the camera can collect the moving image material of the moving object according to the preset collection frequency after receiving the control instruction.

In some embodiments, to avoid the situation that the camera continuously collects the moving object with unchanged motion state in a short time, the collecting process may be performed only once when the moving object is present in the shooting area of the camera, that is, the camera collects the moving image material of the moving object according to the preset collecting frequency, and the method is further configured to: and when the moving target exists in the preview picture, calling the camera to execute a process of collecting the moving image material of the moving target once.

When the controller judges that a moving target appears in the camera shooting area through image recognition, only the camera is called to collect a section of moving image material of the moving target, and if the moving target leaves the camera shooting area and then enters the camera shooting area again, the camera is called again to collect a section of moving image material of the moving target.

For example, when a moving object enters a shooting area of a camera at 9:00 time, the camera is called to collect a first section of moving image material, and the moving object leaves the shooting area of the camera at 9:10 time; after a period of time, the moving object enters the shooting area of the camera again at the time of 10:23, the camera is called again to collect a second section of moving image materials, and the moving object leaves the shooting area of the camera at the time of 10: 40. Therefore, the camera only collects a section of moving image materials between 9:00 and 9:10, and the camera also collects a section of moving image materials between 10:23 and 10: 40. The collection process of the camera is analogized in this way, and is not described in detail.

In other embodiments, the preset acquisition frequency comprises a preset acquisition duration and a preset acquisition interval duration; then, the camera, in performing capturing of the moving image material of the moving object at a preset capturing frequency, is further configured to:

and 11231, collecting a first section of moving image material of the moving object according to a preset collection time length from the moment when the moving object is judged to exist in the preview picture.

And 11232, after the preset acquisition interval duration, acquiring a second section of moving image material of the moving object according to the preset acquisition duration.

Starting from the moment when the moving object exists in the preview picture, namely after a control instruction sent by the controller is received, collecting a first section of moving image material of the moving object, wherein the time length of the first section of moving image material is preset collecting time length.

In order to avoid the situation that the camera collects the moving target which does not change the moving state in a short time, the camera needs to be controlled to wait for a period of time after completing the collection of a section of moving image material, and then the collection of the next section of moving image material is carried out. After the camera collects the first section of moving image material, waiting for the time of the preset collection interval duration, and collecting the second section of moving image material of the moving target again, wherein the duration of the second section of moving image material is the preset collection duration.

Here, "first" and "second" are only processes of distinguishing between two adjacent shots of the camera, and are not intended to limit the number of segments of the moving image material.

In some embodiments, the preset acquisition time period may be set to 5s, and the preset acquisition interval time period may be set to 2 s. That is to say, when the moving object is located in the shooting area of the camera, the time length of the moving image material collected by the camera is 5s, and the interval between two adjacent collections is 2 s.

And if the moving target moves out of the shooting area of the camera again, the controller performs image recognition on the collected picture of the camera again. And if the moving object does not appear in the shooting area of the camera, controlling the camera to stop collecting the moving image.

That is to say, in the process of collecting the moving image material of the moving object by the camera, the image recognition is carried out on the collected picture of the camera in real time, and once the motion is not found in the collected picture, a stop control instruction is immediately sent to the camera so that the camera stops collecting.

Within the preset recording duration, the moving object may appear in the shooting area of the camera many times, and multiple motion states may appear in the shooting area of the camera, so that the camera may collect multiple sections of moving image materials according to the preset collection frequency.

And S12, when the end time of the preset recording time length is reached, acquiring a plurality of moving image materials of the moving object collected by the camera in the preset recording time length.

After the video recording function of the display equipment is started, the camera is always in the state of collecting image materials as long as the camera is not occupied by other application programs. The moment when the camera stops collecting the moving image material of the moving object is the end moment when the preset recording time length is reached, for example, when the current 18:00 is reached, the controller generates a stop control instruction and sends the stop control instruction to the camera so as to control the camera to stop collecting the moving image material of the moving object.

At this time, within a preset recording duration, the camera may collect a plurality of moving image materials, and the controller may acquire the plurality of moving image materials to synthesize the video collection file.

And S13, splicing and synthesizing the specified number of moving image materials to generate a video collection file for recording the moving object within the preset recording time.

In order to ensure that the synthesized video album file meets the requirement of the short video, when a plurality of moving image materials are synthesized into the video album file, the video album file with the specified number needs to be synthesized. In some embodiments, the specified number may be set to 6 pieces, and the 6 pieces of moving image material are synthesized in the chronological order of the acquisition time. For example, if the time length of each moving image material can be 5s, the total time length of the video album file composed of 6 pieces of moving image materials is 30 s.

And each moving image material comprises the motion condition of the moving object, and the video collection file records the motion condition of the moving object within the preset recording time length. When the user views the video collection file, the user can watch the wonderful life of a moving object, such as a pet or a baby, within the preset recording time.

Because a camera may collect a large amount of moving image materials within a preset recording time, only a few moving image materials may be collected. Therefore, in order to ensure that the controller can generate short videos meeting the requirement of the duration when generating the video collection file, whether the total number of the moving image materials collected by the camera in the current preset recording duration meets the requirement of the specified number can be judged before the video collection file is generated.

A flow diagram of a method of generating a video highlight file according to some embodiments is illustrated in fig. 14. In some embodiments, in order to be able to quickly and accurately generate a video highlight file meeting the short video requirement, the controller is further configured to perform the following steps when performing stitching composition on a specified number of moving image materials to generate a video highlight file recording a moving object within a preset recording duration:

s131, acquiring the total material quantity of the moving image materials collected by the camera in the preset recording time.

And S132, if the total material quantity is less than or equal to the designated quantity, splicing and combining the moving image materials of the total material quantity according to the time sequence.

S133, if the total material amount is larger than the specified amount, the specified amount of target moving image materials are selected in the moving image material set.

And S134, splicing and synthesizing the target motion image materials of the specified number according to the time sequence to generate a video collection file for recording the motion target within the preset recording duration.

Every section motion image material of gathering of camera all can be sent to the controller, and in the length of time of predetermineeing the record, the total material quantity of motion image material that the controller can gather by the statistics camera.

In some embodiments, the total duration of the combined video album file is about 30s, which meets the duration requirement of the short video, that is, at most 6 segments of moving image materials are required to be combined, and if the total material quantity exceeds 6 segments, 6 segments of suitable moving image materials are selected from the total material quantity to be combined.

The total material quantity of the moving image materials collected by the camera is compared with the specified quantity, if the total material quantity is smaller than or equal to the specified quantity, the requirement of the duration of the short video is met, and at the moment, the moving image materials of the total material quantity can be directly spliced and synthesized according to the time sequence.

If the total material quantity is larger than the designated quantity, the total duration of the video collection file exceeds the duration of the short video after the moving image materials of the total material quantity are combined into the video collection file, and the video collection file is a file which does not meet the requirement. Therefore, in order to ensure smooth composition of the video album file, the controller may select a specified number of target moving image materials in the moving image material set corresponding to the total material number. And splicing and synthesizing the target motion image materials of the specified number according to the time sequence to generate a video collection file for recording the motion target within the preset recording duration.

For example, if the specified number is set to 6 segments and the total material number of the moving image materials is 5 segments, then 5 segments of the moving image materials can be directly spliced and synthesized to obtain a video album file; if the total number of the motion image materials is 10, then a suitable target motion image material needs to be selected from the 10 motion image materials, and then the 6 target motion image materials are spliced and synthesized to obtain the video collection file.

In some embodiments, when the total material amount exceeds a specified amount to select a specified amount of target moving image materials in the moving image material set corresponding to the total material amount, the time span between the selected target moving image materials may be made larger. For example, if the camera collects moving image materials in the front section, the middle section and the rear section of the preset recording time, when the target moving image material is selected, it is required to ensure that the moving materials are selected in the front section, the middle section and the rear section of the preset recording time, so as to ensure that the living condition of the moving target contained in the composite video collection file is richer.

To this end, the controller, in executing step 133, namely executing selecting a specified number of target moving image materials in the moving image material set if the total material amount is larger than the specified number, is further configured to execute the steps of:

step 1331 obtains a start capture time for each piece of moving image material.

Step 1332, dividing the acquisition starting time corresponding to each section of the moving image material into a plurality of material acquisition time periods according to the time period to which the acquisition starting time belongs, wherein each material acquisition time period comprises a plurality of moving image materials.

Step 1333, selecting the target number of the moving image materials in each material collecting time interval as the target moving image materials, wherein the sum of the target number selected in each material collecting time interval is equal to the designated number.

When the camera collects the moving image materials, the time of each section of moving image materials is marked by the collection starting time, so that the time period of each section of moving image materials when collected can be determined, namely the time period of the front section, the middle section or the rear section of the preset recording time.

For example, if the preset recording time period is 6:00-18:00, the former period may refer to the morning time period, the middle period may refer to the noon time period, and the latter period may refer to the afternoon time period. According to different settings of preset recording duration, the division of the belonged time period is different, and the number of the division sections of the belonged time period can be determined according to actual conditions.

After each piece of moving image material is marked with the belonging time period, the moving image material can be divided into a plurality of material collection time periods according to the collection starting time, for example, the material collection time periods are the morning time period, the noon time period and the afternoon time period. Each material collection period includes at least one section of moving image material.

In order to ensure that the time span of a plurality of moving image materials of the composite video collection file is large, a certain number of moving image materials can be selected in each material acquisition time interval respectively. For example, selecting n during the morning hours₁A moving image material, n is selected in the noon time period₂Selecting n from the moving image material in the afternoon₃A moving image material. Wherein n is guaranteed₁+n₂+n₃A specified number.

Finally, the selected n in the morning time period₁A moving image material located at n of the noon time period₂A moving image material, and n in the afternoon time period₃And splicing and synthesizing the motion image materials according to the time sequence of the acquisition starting time to obtain the video collection file.

In some embodiments, to improve the viewing effect of the video album file, the background music may be automatically superimposed and the start-playing watermark may be added to the video album file when the video album file is synthesized.

Another method of generating a video highlight file according to some embodiments is illustrated in fig. 15. Referring to fig. 15, in order to improve the viewing effect of the video highlight file, the controller performs stitching and synthesizing on a specified number of moving image materials to generate the video highlight file recording the moving object within the preset recording duration, and is further configured to:

and S141, splicing and synthesizing the specified number of moving image materials to obtain a video file for recording the moving object within the preset recording time.

And S142, acquiring a preset audio file and a broadcast starting watermark, wherein the broadcast starting watermark is used for identifying the product information of the display equipment.

And S143, overlapping the audio file, the broadcast starting watermark and the video file to generate a video collection file for recording the moving target within a preset recording duration.

Firstly, a specified number of moving image materials are spliced and synthesized, and the moving image materials can be pictures or videos to obtain video files. A plurality of audio files are preset in the controller, and one of the audio files is randomly selected to be synthesized with the video file.

Meanwhile, the broadcast starting watermark is obtained and added into the picture of the video file, in order to avoid shielding the video content, the broadcast starting watermark can be added at the lower right corner of the picture, and the actual adding position can be set according to the preference of a user. The broadcast starting watermark is used for identifying the affiliated product information of the display equipment.

A display schematic of a start-up watermark according to some embodiments is illustrated in fig. 16. The start-up watermark may include a title watermark and a product watermark, and referring to fig. 16 (a), when the video file starts to be played, the title watermark "my family diary, 30/4/2020" is displayed, and the title watermark disappears after being displayed for several seconds; referring to fig. 16 (b), "XX social television with the product watermark added to the lower right corner of the video file is instantly seen and is focused on one screen", and the product watermark is always displayed on the video file.

And overlapping the audio file, the broadcast starting watermark and the video file to generate a video collection file for recording the moving target within a preset recording duration.

In order to provide more operation requirements for users, the moving image materials collected by the camera can be stored and displayed on the display. The user can perform functions such as deletion and editing according to the displayed moving image material.

In some embodiments, to facilitate user manipulation of the number of moving image materials, the controller is further configured to: when the camera starts to collect the moving image material of the moving target in response to the video recording starting instruction, acquiring each section of moving image material collected by the camera; an image material list interface is generated in the user interface, and each piece of moving image material is displayed in the image material list interface in chronological order.

A video recording starting inlet is displayed in the user interface, and an image material list interface can be presented in the display after the user triggers the video recording starting inlet. The image material list interface is used for displaying the moving image material and the video collection file. Each section of motion image material collected by the camera is displayed in the image material list interface.

The image material list interface is shown in fig. 11, and the image material list interface is displayed in the order of the time of starting the acquisition of each piece of moving image material.

The user can operate the moving image material displayed in the image material list interface to realize different functions, such as sharing to a friend circle, deleting a selected record, clearing a record, closing a video recording function, and the like. And displaying an operation prompt item 'pressing a menu key to close the function or sharing and deleting the video' on the upper right corner of the image material list interface, and enabling a user to act according to the operation indicated by the operation prompt item to realize the interaction function.

In some embodiments, in order for a user to perform a corresponding operation on the moving image material displayed in the image material list interface, the controller is further configured to perform the steps of:

and 151, receiving an interactive function call instruction generated when the user executes corresponding operation according to the operation prompt item.

And 152, responding to the interactive function starting instruction, and presenting a functional interactive floating layer in the image material list interface, wherein the functional interactive floating layer comprises a plurality of functional controls.

And step 153, responding to a target control instruction generated when the target function control is triggered, and executing a target operation corresponding to the target function control.

The image material list interface does not display the interactive function entry when the content is normally displayed. If the user wants to realize a certain interactive function, the user needs to call the interactive function entry first, that is, the user can call the interactive function entry by triggering the menu key through the remote controller according to the content of the operation prompt item.

And when the user executes corresponding operation according to the operation prompt item, generating an interactive function calling instruction, calling out the functional interactive floating layer as an interactive function inlet by the controller according to the interactive function calling instruction, and displaying the functional interactive floating layer in the display. The functional interaction floating layer covers the bottom of the image material list interface in a floating layer mode, and when the functional interaction floating layer is adjusted to display, the image material list interface does not disappear to display.

The function interaction floating layer comprises a plurality of function controls, for example, a "share friend circle" control, a "delete selected record" control, an "clear all records" control, a "close this function" control, and the like. If a user wants to execute a certain interactive function on the moving image material, the corresponding function control is triggered through the remote controller.

The 'sharing to friend circle' control is used for executing sharing operation, the 'deleting selected record' control is used for executing operation of deleting a certain moving image material or video collection file, the 'emptying all records' control is used for executing operation of emptying all display contents in an image material list interface, and the 'closing function' control is used for executing operation of closing a video recording function of the display equipment.

An interactive interface diagram for performing a share-to-friend function according to some embodiments is illustrated in fig. 17. Referring to fig. 17 (a), if a user wants to share a certain moving image material or video album file to a friend circle, after selecting a file to be shared, a "share a friend circle" control is selected as a target function control through a remote controller.

The user clicks the target function control again through the remote controller to "share the circle of relatives and friends", then the display interface in the display jumps to the sharing interface at this time, and the sharing interface is as shown in (b) in fig. 17. In the sharing interface, a certain moving image material or video collection file can be shared to a friend circle.

An interactive interface diagram for performing a delete selected records function according to some embodiments is illustrated in FIG. 18. Referring to fig. 18 (a), if the user wants to delete a certain moving image material or video album file, after selecting a file to be shared, the "delete selected record" control is selected as the target function control through the remote controller.

The user clicks the target function control again through the remote controller to "delete the selected record", and at this time, the display interface in the display jumps to the deletion interface, which is shown in fig. 18 (b). In the deleting interface, the deletion of a certain moving image material or video collection file can be realized. The user can execute the deleting operation by triggering the deleting control based on the deleting interface, and a prompt of 'deleted' is displayed in the deleting interface.

An interactive interface diagram for performing the purge all records function according to some embodiments is illustrated in fig. 19. Referring to fig. 19 (a), if the user wants to completely empty the moving image material collected by the camera or the generated video album file, the "empty all records" control may be selected as the target function control by the remote controller.

The user clicks the target function control again through the remote controller to "clear all records", and at this time, the display interface in the display jumps to a clear interface, which is shown in fig. 19 (b). In the emptying interface, the moving image materials or video collection files displayed in the pixel material list interface can be emptied completely. The user can execute the emptying operation by triggering the emptying control based on the emptying interface, and a prompt of emptying all housekeeping records is displayed in the emptying interface.

An interactive interface diagram for performing the operation of turning off this functionality according to some embodiments is illustrated in fig. 20. Referring to fig. 20 (a), if the user wants to turn off the video recording function of the display apparatus, the "turn off this function" control may be selected as the target function control through the remote controller.

The user clicks the target function control again through the remote controller to "close the function", and at this time, the display interface in the display jumps to the closing interface, and the closing interface is as shown in fig. 20 (b). In the closing interface, the video recording function of the display equipment can be closed. And the user can execute the closing operation by triggering the closing control based on the closing interface, and displays a prompt of being closed in the closing interface.

After the video recording function of the display device is closed, the user can click the sharing link to view the video shared by the user. If the user wants to turn on the function again, the user can continue to check the moving image materials of the previous camera and the generated video album file.

In some embodiments, to facilitate a user viewing each moving image material based on the image material list interface, a temporal watermark may be added to each moving image material as it is displayed into the image material list interface.

Thus, the controller, in performing displaying each piece of moving image material in chronological order in the image material list interface, is further configured to perform the steps of:

step 161 acquires the start acquisition time of each piece of moving image material.

And step 162, generating a time watermark comprising the acquisition starting time, wherein the time watermark corresponds to the motion image materials one by one.

And 163, displaying each section of the moving image material and the corresponding time watermark in the image material list interface according to the time sequence of the acquisition starting time, wherein the time watermark is displayed at the bottom or the top of the corresponding moving image material.

To identify each segment of motion picture material, it may be marked by means of a temporal watermark. The time watermark is a watermark generated according to the starting acquisition time of each section of motion image material, and each section of motion image material has an independent corresponding time watermark.

Each section of moving image material is displayed in the image material list interface according to the time sequence of the acquisition starting time, and similarly, each time watermark is displayed in the image material list interface according to the time sequence of the acquisition starting time, so that the time watermarks are in one-to-one correspondence with the moving image material. The time sequence may be in order from near to far from the current time, so that the newly acquired moving image material is displayed in the front of the image material list interface.

The display position of the time watermark may be determined according to the actual use situation, and may be displayed, for example, at the bottom, top, left, or right of the corresponding moving image material. Taking the image material list interface shown in fig. 11 as an example, the time watermark is displayed at the bottom of the corresponding moving image material, such as "3 months, 23 days, 9: 28".

In some embodiments, since the video album file composed of the moving image material collected by the camera and the controller is displayed in the image material list interface, a time watermark may also be added to the video album file in order to identify the video album file.

To this end, when adding the temporal watermark to the video album file, the controller is further configured to perform the steps of:

and 171, acquiring the generation time of each video collection file.

Step 172, create a generation time watermark including a generation time.

And 173, displaying each video collection file and the corresponding generation time watermark in an image material list interface according to the time sequence of the generation time, wherein the generation time watermark is displayed at the bottom or the top of the corresponding video collection file.

Step 174, the moving image material of the generated video album file is deleted.

In order to identify each video collection file, a time watermark can be generated for marking. The generated time watermark is the watermark generated according to the generation time of each video collection file, and each video collection file has an independent and corresponding generated time watermark.

Each section of video collection file is displayed in the image material list interface according to the time sequence of the generation time, and similarly, each generation time watermark is displayed in the image material list interface according to the time sequence of the generation time, so that the generation time watermarks correspond to the video collection files one to one. The chronological order may be in order from near to far from the current time, such that the newly generated video album file is displayed at the front of the image material list interface and the video album file is displayed before the moving image material.

An interface schematic diagram showing a video album file in an image material list interface according to some embodiments is illustrated in fig. 21. The display position of the time watermark may be determined according to the actual use condition, and for example, the time watermark may be displayed at the bottom, the top, the left part or the right part of the corresponding video album file. Taking the image material list interface shown in fig. 21 as an example, the generated time watermark is displayed at the bottom of the corresponding video album file, such as "3 months, 23 days, 19: 30".

Because the controller can synthesize the video collection file according to the moving image materials collected by the camera on the same day every day, the controller can store each section of moving image materials and the video collection file. In order to avoid occupying too much storage space of the display device, the controller may delete the moving image material that has been composed into the video album file.

The rest of the moving image materials which do not generate the video album file can be stored in the controller and displayed in the image material list interface together with the video album file, so that the user can perform interactive operation on the moving image materials or the video album file.

The video collection file and the moving image material without the video collection file are stored in a home cloud storage NAS, and if the display device is not provided with the home cloud storage NAS, the video collection file and the moving image material without the video collection file are stored locally on the display device. The video collection file and the moving image material of the video collection file which is not generated can be stored for 30 days, and after the storage time exceeds 30 days, the corresponding video collection file or the moving image material of the video collection file which is not generated can be deleted, so that the phenomenon that the occupied space is large due to the fact that excessive files are stored in the display equipment is avoided.

Because the moving image material collected by the camera and the video collection file synthesized by the controller are both displayed in the image material list interface, the video collection file and the moving image material are distinguished, so that a user can quickly select a target video collection file or a target moving image material which the user wants to operate.

In some embodiments, the distinction may be made by adding a video recording mark on the video album file. To this end, the controller is further configured to perform the steps of: creating a video recording mark, wherein the video recording mark is used for identifying a video collection file generated according to video recording; and adding the video recording mark on the thumbnail of the video collection file displayed in the image material list interface.

When the video collection file and the moving image material are displayed in the image material list interface, the video collection file and the moving image material can be viewed by a user and are displayed in the form of picture thumbnails. Therefore, for the sake of distinction, when the video album file is displayed in the image material list interface, the video recording mark may be displayed on the thumbnail of the video album file.

The video recording mark can be created when the video collection file is generated, and can also be stored in the controller in advance, namely when the video collection file is generated, the controller calls the video recording mark, displays the video recording mark in the image material list interface when the video collection file is generated, and synchronously displays the video recording mark on the thumbnail of the video collection file.

In some embodiments, a video recording mark may be added to a corner of a thumbnail of a video album file, and the mark content may be "Vlog," such as the marks on the first and second thumbnails shown in FIG. 21.

By adding the video recording mark on the thumbnail of the video collection file, the video collection file and the moving image material displayed in the image material list interface can be distinguished remarkably, and the user can check and select the video collection file conveniently.

In order to remind a user of timely checking a video collection file collected and synthesized by a camera automatically called by a controller when the user is not at home, the video collection file synthesized on the same day needs to be pushed to the user.

To this end, the controller is further configured to perform the following steps when pushing the video album file to the user: generating a push notification according to the video collection file, wherein the push notification comprises push content and an operation prompt; upon startup of the display device, a push notification is displayed on a system homepage interface presented on the display.

Since the video collection file is generated by collecting the moving image material of the moving object within the preset recording duration of the day, the user may not start the display device within the preset recording duration. Thus, the video album file may be pushed to the user when the user starts the display device for the first time after the video album file is generated. Namely, when the user starts the display device for the first time, a push notification is generated according to the video collection file and is displayed on a system homepage interface presented on the display.

An interface diagram showing push notifications according to some embodiments is illustrated in fig. 22. Referring to fig. 22, the push notification includes push content such as "your favorite-specific Vlog has been generated, see the bar soon" and an operation prompt such as "press menu key to see details". The user can check the pushed video collection file by triggering the menu key through the remote controller.

In some embodiments, the video album file is pushed only once, and when a user after the video album file is generated first starts the display device. For example, if the preset recording time is 6:00-18:00, when the recording time reaches 18:00, the controller controls the camera to stop collecting the moving image materials, and simultaneously, the specified number of the moving image materials are spliced and combined to obtain the video collection file. After 18:00, if the user first starts the display at 19:00, the video album file is displayed on the system home interface in the form of a push notification to prompt the user to view a day of recording the wonderful moment of the pet or baby.

It can be seen that in the display device provided in the embodiment of the present invention, the display is configured to present and display a user interface having a video recording start entry, where the video recording start entry is used to start a video recording function of the display device. The controller receives a video recording starting instruction generated when a video recording starting inlet is triggered so as to indicate the camera to collect a moving image material of a moving target according to a preset collection frequency within a preset recording duration; and when the ending time of the preset recording time is reached, splicing and synthesizing the appointed number of motion image materials to generate a video collection file for recording the motion target within the preset recording time. Therefore, the display device provided by the embodiment of the invention does not need real-time operation of a user after the user starts the video recording function, the controller can actively call the camera in real time to acquire the moving image material of the moving object, and synthesize the video collection file after image acquisition is completed, so that the user can know the movement condition of the moving object within the preset recording duration according to the video collection file, and good experience can be brought to the user.

The implementation process for starting the video recording function of the display device provided by the above embodiment is implemented by the controller in the display device, and in other embodiments, the intelligent terminal connected to the display device can also be used for starting the video recording function of the display device. And at the intelligent terminal side, the starting of the video recording function of the display equipment, the browsing and editing of the moving image materials and the viewing and sharing of the video collection files are supported.

A block diagram of an intelligent terminal according to some embodiments is illustrated in fig. 23. Referring to fig. 23, in order to implement a process of starting a video recording function of a display device by an intelligent terminal, an intelligent terminal 300 according to an embodiment of the present invention includes: a display 320 and a processor 310 connected to each other. The display 320 is configured to present an end user interface displaying a video recording start entry for starting a video recording function that enables recording of a moving image by video recording within a preset recording duration and generating a video album file, the video recording function being configured in a controller of the display apparatus.

The processor 310 is coupled to the controller 250 in the display device and has a designated application configured therein for invoking an end user interface for display in the display 320. The processor receives a video recording starting instruction generated when a user operates the intelligent terminal, and sends the video recording starting instruction to the controller in the display device, so that the video recording function of the display device is started by the controller, namely the camera is actively called in real time to collect the moving image material of the moving target and synthesize the video collection file.

Another flow diagram of an interactive method of generating a video highlight file according to some embodiments is illustrated in fig. 24. To facilitate the intelligent terminal to be able to start the video recording function of the display device, referring to fig. 24, an embodiment of the present invention provides an intelligent terminal, when executing the interactive method for generating a video album file, the processor of which is configured to execute the following steps:

and S21, receiving a video recording function call instruction generated when the specified application program is triggered.

In order to start the video recording function of the display device, the intelligent terminal needs to configure a designated application program in a processor of the intelligent terminal, and the designated application program is displayed on a terminal homepage. The designated application is used to provide access to initiate the video recording function.

A user manually triggers the designated application program to generate a video recording function call instruction, and the processor can call an inlet for starting the video recording function according to the video recording function call instruction.

And S22, responding to the video recording function starting instruction, and presenting an end user interface with a video recording starting entrance in the display.

After receiving the video recording function call instruction, the processor presents a terminal user interface in the display 320 of the intelligent terminal, and displays a video recording start entry in the terminal user interface.

An interface schematic of an end user interface according to some embodiments is illustrated in fig. 25. After the user triggers the designated application, the end user interface is displayed in the display and the video recording initiation entry is presented in the end user interface, as shown in fig. 25 as "day of pet budding". The user clicks the "day of catching a pet", a video recording function starting interface can be generated, for example, a page shown in fig. 25 is displayed on the page, and the user triggers the "starting" control, so that the video recording function can be started.

And S23, receiving a video recording starting instruction generated by triggering a video recording starting entrance, and sending the video recording starting instruction to the controller, wherein the video recording starting instruction is used for instructing the controller to call a camera in the display device to collect the moving image material of the moving object within a preset recording time length according to a preset collection frequency, and splicing and synthesizing the specified number of moving image materials to generate a video collection file for recording the moving object within the preset recording time length.

The user starts an entry based on the video recording displayed on the terminal user interface, and the entry is triggered, namely the control is opened, so that a video recording starting instruction can be generated. And then the processor sends the video recording starting instruction to a controller in the display equipment, and after the controller receives the video recording starting instruction, the video recording function of the display equipment can be started, namely, the related steps of calling a camera in the display equipment within a preset recording time length, collecting the moving image material of the moving object according to a preset collection frequency, splicing and synthesizing the specified number of moving image materials, and generating a video collection file for recording the moving object within the preset recording time length are executed. The steps related to the controller performing the video recording function can be based on the content of the display device portion with reference to the foregoing embodiments, and are not described herein again.

After the video recording function of the display equipment is started, a video list interface is displayed in a display of the intelligent terminal. In presenting the video list interface, the processor is further configured to perform the steps of:

and 241, responding to a video recording starting instruction, and presenting a video list interface in the display.

Step 242, the moving image material and the video album file stored in the controller are obtained, and the moving image material and the video album file are displayed in the video list interface.

The processor receives a video recording starting instruction generated when a user triggers a video recording starting inlet, and simultaneously sends the video recording starting instruction to the controller so as to start a video recording function of the display equipment, and simultaneously switches display contents of a display of the intelligent terminal according to the video recording starting instruction, namely, a terminal user interface displayed in the display of the intelligent terminal is switched and displayed as a video list interface.

The video list interface is similar to the image material list interface in the display device and is used for displaying the moving image material and the video album file. The moving image material and the synthesized video collection file collected by the camera can be stored in the controller, the controller displays the moving image material and the synthesized video collection file on the image material list interface and simultaneously sends the moving image material and the synthesized video collection file to the processor of the intelligent terminal, and the processor displays the moving image material and the synthesized video collection file on the video list interface. That is, the video list interface is identical to the content displayed by the image material list interface.

In some embodiments, if the user first activates the video recording function of the display device, it indicates that the camera has not captured any moving image material, and no video album file has been generated, and therefore, no content is displayed in the video list interface.

An interface schematic of a video list interface according to some embodiments is illustrated in fig. 26. When the user first starts the video recording function, the contents displayed in the video list interface are as shown in fig. 26 (a). At this time, the prompt content "pet not found yet" is displayed in the video list interface.

In some embodiments, if the user does not start the video recording function of the display device for the first time, but starts the video recording function of the display device for the second or subsequent times, it is said that the camera has collected the moving image material, and the video album file may also be generated, and at this time, the moving image material collected by the camera in history and the video album file generated by the controller in history are displayed in the video list interface, such as the video list interface shown in (b) of fig. 26.

The display sequence of the moving image material and the video album file in the video list interface may be the same as that in the image material list interface, and will not be described herein again.

The user can perform personalized operation on the moving image materials and the video collection files displayed in the video list interface so as to realize different functions, such as sharing, downloading and the like. To this end, when the user performs a personalization operation based on the video list interface, the processor is further configured to perform the steps of:

and 251, displaying personalized operation controls at the bottom of each moving image material and video collection file displayed in the video list interface.

Step 2452, in response to the personalized operation instruction generated by triggering the target personalized operation control, executing the target personalized operation corresponding to the target personalized operation control.

Personalized operation controls are displayed in the video listing interface at the bottom of each moving image material and each video album file, and in some embodiments, the personalized operation controls include a "share" control and a "download" control, as shown in fig. 26 (b). The "share" control may perform an operation of sharing a certain moving image material or video album file to another platform, and the "download" control is used to perform an operation of downloading a certain moving image material or video album file locally.

The user triggers a certain personalized operation control to generate a personalized operation instruction, and the processor can execute corresponding personalized operation according to the personalized operation instruction, such as sharing to other platforms or downloading to the local.

An interface diagram of a terminal settings interface according to some embodiments is illustrated in fig. 27. Because the intelligent terminal can execute the opening and closing of the video recording function of the display equipment, a quick starting inlet can be configured in the terminal setting interface of the intelligent terminal. Referring to fig. 27, a "setup" entry is displayed in the terminal user interface, and a user may present the terminal setup interface in the display of the intelligent terminal by triggering the "setup" entry. The user triggers the quick start entrance in the terminal setting interface, namely the video recording function can be started, and the quick start entrance is triggered again, so the video recording function can be closed.

In some embodiments, in order to enable family members to perform personalized operation on the moving image material and the video collection file displayed in the video list interface through the intelligent terminal, the home terminal intelligent terminal can authorize the authority of other intelligent terminals to operate the video list interface.

When the local intelligent terminal authorizes other intelligent terminals to perform personalized operation on the video list interface, the processor is further configured to execute the following steps:

and 261, receiving a device sharing instruction generated when the device sharing control is triggered, wherein the device sharing instruction is used for establishing an association relation with the opposite terminal intelligent terminal.

Step 262, sending the device sharing instruction to at least one opposite-end intelligent terminal, and establishing an association relationship between the local-end intelligent terminal and the at least one opposite-end intelligent terminal, wherein the device sharing instruction is used for instructing the opposite-end intelligent terminal to execute personalized operation on the video collection file according to the association relationship.

A setting entry is displayed in the terminal user interface, and a user triggers the setting entry, that is, a terminal setting interface is presented in the display of the intelligent terminal, and a device sharing control, such as the device sharing control shown in fig. 27, is configured in the terminal setting interface.

And triggering the equipment sharing control in the terminal setting interface by the user to generate an equipment sharing instruction. And the processor of the local terminal intelligent terminal sends the equipment sharing instruction to an opposite terminal intelligent terminal which needs to perform personalized operation on the video list interface. And the opposite-end intelligent terminal can establish an association relation with the local-end intelligent terminal after receiving the equipment sharing instruction, so that the opposite-end intelligent terminal operates the video list interface.

Fig. 28 is an interface diagram illustrating a presentation of an operation interface in a peer smart terminal according to some embodiments. When the opposite-end intelligent terminal operates the video list interface, an operation interface is presented in a display of the opposite-end intelligent terminal, as shown in fig. 28 (a). The opposite-end user can perform personalized operation on the moving image materials and the video album files in the video list interface based on the operation page, for example, viewing, sharing or downloading operation is performed on the moving image materials and the video album files.

The operation steps of the opposite-end user operating the opposite-end intelligent terminal and the local-end user operating the local-end intelligent terminal are the same as the operation steps of the local-end user operating the local-end intelligent terminal and the pages displayed by the corresponding displays, and the only difference is that the opposite-end user cannot operate the opposite-end intelligent terminal to perform opening and closing operations on the video recording function of the display equipment.

And if the home terminal user does not start the video recording function of the display equipment, no content is displayed in the video list interface. At this time, if the peer user triggers the video recording start entry on the terminal user interface of the peer intelligent terminal, a prompt is displayed on the terminal user interface, as shown in fig. 28 (b), the prompt content may be "the prompt can be viewed only when the administrator starts the function", and the administrator refers to the peer user. That is, after the home terminal user starts the video recording function of the display device based on the home terminal intelligent terminal, the opposite terminal user can perform personalized operation on the moving image material and the video collection file on the opposite terminal intelligent terminal.

Therefore, in the intelligent terminal provided by the embodiment of the present invention, the display is configured to present and display a terminal user interface having a video recording start entry, and the video recording start entry is used for starting a video recording function of the display device. The processor is connected with the controller in the display device, and the processor is configured to: receiving a video recording function starting instruction generated when a specified application program is triggered, and displaying a terminal user interface with a video recording starting inlet in a display; the method comprises the steps of receiving a video recording starting instruction generated by triggering a video recording starting inlet, and sending the video recording starting instruction to a controller, wherein the video recording starting instruction is used for indicating the controller to call a camera in display equipment to collect moving image materials of a moving object within preset recording duration according to preset collection frequency, and splicing and synthesizing the specified number of moving image materials to generate a video collection file for recording the moving object within the preset recording duration. Therefore, according to the intelligent terminal provided by the embodiment of the invention, the user can start the video recording function of the display device through the intelligent terminal, the function of the display device for collecting the moving image material of the moving object and synthesizing the video collection file can be realized without operating the display device in real time, and the user can know the movement condition of the moving object within the preset recording duration according to the video collection file, so that good experience can be brought to the user.

A flow diagram of an interactive method of generating a video highlight file according to some embodiments is illustrated in fig. 12. Referring to fig. 12, the present application further provides an interactive method for generating a video highlight file, which is applied to a display device, and the method includes:

s11, receiving a video recording starting instruction generated when the video recording starting entry is triggered, wherein the video recording starting instruction is used for indicating a camera to collect a moving image material of a moving object according to a preset collection frequency in a preset recording time length, the video recording starting entry is used for starting the function of recording the moving image and generating a video collection file through video recording in the preset recording time length, and the moving object is an object which needs to record the moving image through video recording in the preset recording time length to generate the video collection file;

s12, when the end time of the preset recording time length is reached, acquiring a plurality of moving image materials of the moving object collected by the camera in the preset recording time length;

and S13, splicing and synthesizing the specified number of the moving image materials to generate a video collection file for recording the moving object within a preset recording time.

Another flow diagram of an interactive method of generating a video highlight file according to some embodiments is illustrated in fig. 24. Referring to fig. 24, the present application further provides an interactive method for generating a video highlight file, which is applied to an intelligent terminal, and the method includes:

s21, receiving a video recording function call instruction generated when the specified application program is triggered;

s22, responding to the video recording function starting instruction, and displaying a terminal user interface with a video recording starting inlet in the display, wherein the video recording starting inlet is used for starting a video recording function of recording a moving image and generating a video highlight file through video recording within a preset recording time length, and the video recording function is configured in a controller of the display device;

s23, receiving and triggering a video recording starting instruction generated by the video recording starting inlet, and sending the video recording starting instruction to the controller, wherein the video recording starting instruction is used for indicating the controller to call a camera in the display device to collect the moving image material of the moving object according to the preset collection frequency within the preset recording time length, and the specified number of the moving image material is spliced and synthesized to generate and record the video collection file of the moving object within the preset recording time length.

In a specific implementation, the present invention further provides a computer storage medium, where the computer storage medium may store a program, and the program may include some or all of the steps in each embodiment of the interaction method for generating a video album file provided by the present invention when executed. The storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM) or a Random Access Memory (RAM).

Those skilled in the art will readily appreciate that the techniques of the embodiments of the present invention may be implemented as software plus a required general purpose hardware platform. Based on such understanding, the technical solutions in the embodiments of the present invention may be essentially or partially implemented in the form of a software product, which may be stored in a storage medium, such as ROM/RAM, magnetic disk, optical disk, etc., and includes several instructions for enabling a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the method according to the embodiments or some parts of the embodiments.

Finally, it should be noted that: the above embodiments are only used for illustrating the technical solutions of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present application.

The foregoing description, for purposes of explanation, has been presented in conjunction with specific embodiments. However, the illustrative discussions above are not intended to be exhaustive or to limit the embodiments to the precise forms disclosed above. Many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles and the practical application, to thereby enable others skilled in the art to best utilize the embodiments and various embodiments with various modifications as are suited to the particular use contemplated.

Claims

1. A display device, comprising:

a controller connected to the camera and display, the controller configured to:

2. The display device according to claim 1, wherein the camera, in performing the capturing of the moving image material of the moving object at the preset capturing frequency, is further configured to:

3. The display device according to claim 2, wherein the controller acquires moving image material of the moving object at a preset acquisition frequency from an initial timing at which the camera performs the recording from a preset recording time period, and is further configured to:

4. The display device according to claim 3, wherein the camera, in performing the capturing of the moving image material of the moving object at the preset capturing frequency, is further configured to:

5. The display device of claim 3, wherein the preset acquisition frequency comprises a preset acquisition duration and a preset acquisition interval duration;

6. The display device of claim 2, wherein the controller, when executing the responsive video recording initiation instruction, generates a camera call instruction, further configured to:

7. The display device of claim 1, wherein the controller is further configured to:

8. The display device according to claim 7, wherein an operation prompt item is displayed in the image material list interface; and the controller is further configured to:

9. The display device according to claim 7, wherein the controller, in performing the displaying of each piece of moving image material in chronological order in the image material list interface, is further configured to:

10. The display device according to claim 1, wherein the controller, in performing the stitch composition of a specified number of the moving image materials, generating a video album file recording the moving object within a preset recording duration, is further configured to:

11. The display device according to claim 10, wherein the controller, in performing selection of a specified number of target moving image materials in the moving image material set if the total material amount is larger than a specified amount, is further configured to:

12. The display device according to claim 1, wherein the controller, in performing the stitch composition of a specified number of the moving image materials, generating a video album file recording the moving object within a preset recording duration, is further configured to:

13. The display device of claim 1, wherein the controller is further configured to:

acquiring the generation time of each video collection file;

creating a generation-time watermark including the generation time;

14. The display device of claim 13, wherein the controller is further configured to:

15. The display device of claim 1, wherein the controller is further configured to:

16. The display device of claim 1, wherein the controller is further configured to:

17. The display device of claim 2, wherein the controller, in executing the video recording initiation instruction generated upon receiving the trigger video recording initiation entry, is further configured to:

18. An intelligent terminal, comprising:

19. The intelligent terminal of claim 18, wherein the processor is further configured to:

20. The intelligent terminal of claim 19, wherein the processor is further configured to:

21. The intelligent terminal of claim 18, wherein a device sharing control is presented in the terminal user interface; and the processor is further configured to:

22. An interactive method for generating a video collection file, applied to a display device, is characterized in that the method comprises the following steps:

23. An interactive method for generating a video collection file is applied to an intelligent terminal, and is characterized in that the method comprises the following steps: