CN114285985A

CN114285985A - Method for determining preview direction of camera and display equipment

Info

Publication number: CN114285985A
Application number: CN202110901318.7A
Authority: CN
Inventors: 刘兆磊; 田德利; 姜俊厚
Original assignee: Hisense Visual Technology Co Ltd
Current assignee: Hisense Visual Technology Co Ltd
Priority date: 2021-08-06
Filing date: 2021-08-06
Publication date: 2022-04-05
Anticipated expiration: 2041-08-06
Also published as: CN114285985B

Abstract

According to the embodiment of the application, images shot by the camera are adjusted according to the type of the camera, the port information and the screen state, so that the images are normally displayed in a display, and the use experience of a user is improved. The method comprises the following steps: receiving an instruction for starting a preset application, and acquiring port information, a screen state and a rotation state, wherein the port information is used for indicating a port into which a camera is inserted, the screen state is used for indicating that a screen is placed transversely or longitudinally, and the rotation state is used for indicating whether an image rotates or not; determining the type of a camera according to the port information, the screen state and the rotation state; and controlling the camera to shoot images according to the type of the camera, the port information and the screen state.

Description

Method for determining preview direction of camera and display equipment

Technical Field

The present application relates to the field of camera preview technologies, and in particular, to a method for determining a camera preview direction and a display device.

Background

In the related art, the display of the rotating television can be rotated, and thus, the rotating television is applied to various use scenes. The current rotating television has a port capable of being externally connected with a camera, one port is positioned at the upper end of the display when the display is in a transverse screen, and the other port is positioned at the upper end of the display when the display is in a vertical screen, namely one side of the display when the display is in the transverse screen. When a user selects a certain port to insert a camera and uses the camera to shoot images, the problem that the shot images rotate when being displayed on a display is often found, and the use experience of the user is influenced.

Disclosure of Invention

The embodiment of the application provides a method for determining the preview direction of a camera and display equipment, so that images shot by the camera can be normally displayed on a display.

In a first aspect, there is provided a display device comprising:

a display for displaying a user interface;

a user interface for receiving an input signal;

a controller respectively coupled to the display and the user interface for performing:

receiving an instruction for starting a preset application, and acquiring port information, a screen state and a rotation state, wherein the port information is used for indicating a port into which a camera is inserted, the screen state is used for indicating that a screen is placed transversely or longitudinally, and the rotation state is used for indicating whether an image rotates or not;

determining the type of a camera according to the port information, the screen state and the rotation state;

and controlling the camera to shoot images according to the type of the camera, the port information and the screen state so as to normally display the shot images in the display.

In some embodiments, the controller, prior to obtaining the port information, is further configured to:

judging whether a camera is inserted into the display equipment or not;

and if so, determining that the camera is inserted into a port of a display device, wherein the port comprises a first port or a second port, the first port is positioned at the upper end of the display, and the second port is positioned at one side of the display.

In some embodiments, the controller is configured to determine the camera type based on the port information, the screen status, and the rotation status according to the following steps:

the screen state comprises a horizontal screen state or a vertical screen state; the rotation state comprises rotation or no rotation; the camera type comprises a direct insertion type or a sitting type;

if the port information is a first port, the screen state is a vertical screen state, and the image rotates, determining that the camera type is a direct insertion type;

if the port information is a second port, the screen state is a horizontal screen state, and the image rotates, determining that the camera type is a direct insertion type;

if the port information is a first port, the screen state is a horizontal screen state and the image is not rotated, determining that the type of the camera is a preset type, wherein the preset type comprises a direct insertion type or a sitting type;

if the port information is a second port, the screen state is a horizontal screen state and the image is not rotated, determining that the camera type is a sitting type;

if the port information is a first port, the screen state is a vertical screen state and the image is not rotated, determining that the camera type is a sitting type;

and if the port information is a second port, the screen state is a vertical screen state, and the image is not rotated, determining that the camera type is a preset type.

In some embodiments, the controller is configured to control the camera to capture the image according to the camera type, the port information and the screen state according to the following steps:

if the camera type is a sitting type and the screen state is a horizontal screen state, controlling the camera to shoot images according to a preset preview image ratio m: n; receiving a display rotation instruction, changing a screen state and rotating the display to a vertical screen; judging whether the camera supports the preview image ratio of n: m, if so, controlling the camera to shoot the image according to the preview image ratio of n: m; if not, intercepting an image shot by the camera according to a preset preview image proportion according to the preview image proportion n: m, and displaying the intercepted image in a display;

if the camera type is a sitting type and the screen state is a vertical screen state, judging whether the camera supports the preview image proportion n: m, if so, controlling the camera to shoot the image according to the preview image proportion n: m; if not, intercepting an image shot by the camera according to a preset preview image proportion according to the preview image proportion n: m, and displaying the intercepted image in a display; receiving a display rotation instruction, controlling to change the screen state, rotating the display to a vertical screen, controlling a camera to shoot an image according to the preview image proportion n: m, and displaying the image on the display;

if the camera is in a direct insertion type, the port information is a first port, and the screen state is in a vertical screen state, rotating an image shot by the camera according to a preset preview image proportion m: n by a preset angle, and displaying the image on a display; receiving a display rotation instruction, changing a screen state, rotating the display to a transverse screen, and controlling a camera to shoot images according to a preset preview image ratio m: n;

if the camera type is a direct insertion type, the port information is a first port, and the screen state is a horizontal screen state, the camera is controlled to shoot images according to a preset preview image ratio m: n; receiving a display rotation instruction, changing the screen state, rotating the display to a vertical screen, and displaying an image shot by a camera according to a preset preview image ratio m: n on the display after rotating a preset angle;

if the camera type is a direct insertion type and the port information is a second port, judging whether the camera supports a preview image ratio of n: m, if so, judging whether the screen state is a vertical screen state, and if so, controlling the camera to shoot an image according to the preview image ratio of n: m; receiving a display rotation instruction, changing the screen state, rotating the display to a transverse screen, and displaying an image shot by a camera according to a preview image ratio n: m on the display after rotating the image by a preset angle; and if the screen state is a horizontal screen state, rotating an image shot by the camera according to the preview image ratio n: m by a preset angle, displaying the image on the display, receiving a display rotation instruction, changing the screen state, rotating the display to the horizontal screen, controlling the camera to shoot the image according to the preset preview image ratio m: n, and displaying the image on the display.

If the screen state is not supported, judging whether the screen state is a vertical screen state, if so, intercepting an image shot by a camera according to a preset preview image proportion according to a preview image proportion n: m, and displaying the intercepted image on a display; receiving a display rotation instruction, changing a screen state, rotating the display to a transverse screen, controlling a camera to shoot images according to a preset preview image proportion m: n, rotating by a preset angle, and displaying the rotated images on the display; if the screen state is a horizontal screen state, intercepting an image m: n of an image shot by a camera according to a preset preview image proportion, intercepting the image to obtain an image with the proportion of n: m, rotating the intercepted image by a preset angle, and displaying the image on a display; and receiving a display rotation instruction, changing the screen state, enabling the display to be vertical, reversely rotating the image by a preset angle, and displaying the image on the display.

In some embodiments, the controller is configured to perform determining the rotation state according to the following steps: acquiring an image shot by a camera; and determining the rotation state of the image according to the image.

In some embodiments, the controller is configured to determine a rotation state of the image from the image by: and inputting the image into a preset classifier, and determining the rotation state of the image.

In some embodiments, the controller is further configured to perform:

detecting that a camera is inserted into display equipment, and generating a first preset file;

the step of judging whether a camera is inserted into the display device comprises the following steps: judging whether a first preset file exists or not;

if the first preset file exists, determining that a camera is inserted into the display equipment;

and if the first preset file does not exist, determining that no camera is inserted into the display equipment.

In some embodiments, the controller is further configured to perform: and if the camera is not inserted into the display equipment, controlling the display to display prompt information of the inserted camera.

In some embodiments, the controller is further configured to perform:

detecting that a camera is inserted into the display equipment, and generating a second preset file;

the step of determining the port information of the camera inserted into the display device comprises: judging whether a second preset file exists or not; and if the second preset file exists, determining the port information according to the file name of the second preset file.

In some embodiments, the display device further comprises a gyroscope with which the screen state is determined.

In a second aspect, a method for determining a preview direction of a camera is provided, including:

In the embodiment of the application, the image shot by the camera is adjusted according to the type of the camera, the port information and the screen state, so that the image is normally displayed in a display, and the use experience of a user is improved. The method comprises the following steps: receiving an instruction for starting a preset application, and acquiring port information, a screen state and a rotation state, wherein the port information is used for indicating a port into which a camera is inserted, the screen state is used for indicating that a screen is placed transversely or longitudinally, and the rotation state is used for indicating whether an image rotates or not; determining the type of a camera according to the port information, the screen state and the rotation state; and controlling the camera to shoot images according to the type of the camera, the port information and the screen state.

Drawings

Fig. 1A is an application scenario diagram of a display device according to some embodiments of the present application;

fig. 1B is a rear view of a display device according to some embodiments of the present application;

fig. 2 is a block diagram of a hardware configuration of the control device 100 in fig. 1 according to some embodiments of the present disclosure;

fig. 3 is a block diagram of a hardware configuration of the display device 200 in fig. 1 according to some embodiments of the present disclosure;

FIG. 4 is a block diagram of an architectural configuration of an operating system in memory of a display device 200 according to some embodiments of the present application;

a schematic view of cameras of different camera types according to some embodiments is illustrated in fig. 5;

fig. 6-13 are schematic diagrams illustrating images captured by a camera in the related art;

fig. 14 is a flowchart illustrating a method of determining a preview direction of a camera;

FIG. 15 is a schematic diagram of a user interface;

another user interface diagram is illustrated in fig. 16.

Detailed Description

In order to make those skilled in the art better understand the technical solutions in the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

The rotary television is a novel intelligent television and mainly comprises a display and a rotary component. The display is fixed on a wall or a support through the rotating assembly, and the placing angle of the display can be adjusted through the rotating assembly, so that the purpose of rotation is achieved, and the display device is suitable for display pictures with different aspect ratios. For example, in most cases the display is positioned laterally to display video frames having aspect ratios of 16: 9, 18: 9, etc. When the aspect ratio of the video frame is 9: 16, 9: 18, etc., the horizontally positioned display needs to be scaled and black areas are displayed on both sides of the display. Thus, the display can be positioned vertically by rotating the assembly to accommodate video frames of 9: 16, 9: 18, etc. scale.

In order to facilitate a user to display a target media asset detail page in different horizontal and vertical screen states of a display and to facilitate improvement of user viewing experience of a display device in different viewing states, embodiments of the present application provide a display device, a detail page display method, and a computer storage medium, where the display device is, for example, a rotating television. It should be noted that the method provided in this embodiment is not only applicable to the rotating television, but also applicable to other display devices, such as a computer, a tablet computer, and the like.

The term "module" as used in various embodiments of the present application may refer to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and/or software code that is capable of performing the functionality associated with that element.

The term "remote control" as used in the various embodiments of the present application refers to a component of an electronic device, such as the display device disclosed in the present application, that is capable of wirelessly controlling the electronic device, typically over a relatively short distance. The component may typically be connected to the electronic device using infrared and/or Radio Frequency (RF) signals and/or bluetooth, and may also include functional modules such as WiFi, wireless USB, bluetooth, motion sensors, etc. For example: the hand-held touch remote controller replaces most of the physical built-in hard keys in the common remote control device with the user interface in the touch screen.

The term "gesture" as used in the embodiments of the present application refers to a user's behavior through a change in hand shape or an action such as hand movement to express an intended idea, action, purpose, or result.

The term "hardware system" used in the embodiments of the present application may refer to a physical component having computing, controlling, storing, inputting and outputting functions, which is formed by a mechanical, optical, electrical and magnetic device such as an Integrated Circuit (IC), a Printed Circuit Board (PCB) and the like. In various embodiments of the present application, a hardware system may also be generally referred to as a motherboard (motherboard) or a host chip or controller.

Referring to fig. 1A, an application scenario diagram of a display device according to some embodiments of the present application is provided. As shown in fig. 1A, the control apparatus 100 and the display device 200 may communicate with each other in a wired or wireless manner.

Among them, the control apparatus 100 is configured to control the display device 200, which may receive an operation instruction input by a user and convert the operation instruction into an instruction recognizable and responsive by the display device 200, serving as an intermediary for interaction between the user and the display device 200. Such as: the user operates the channel up/down key on the control device 100, and the display device 200 responds to the channel up/down operation.

The control device 100 may be a remote controller 100A, which includes infrared protocol communication or bluetooth protocol communication, and other short-distance communication methods, etc. to control the display apparatus 200 in a wireless or other wired manner. The user may input a user instruction through a key on a remote controller, voice input, control panel input, etc., to control the display apparatus 200. Such as: the user can input a corresponding control command through a volume up/down key, a channel control key, up/down/left/right moving keys, a voice input key, a menu key, a power on/off key, etc. on the remote controller, to implement the function of controlling the display device 200.

The control device 100 may also be an intelligent device, such as a mobile terminal 100B, a tablet computer, a notebook computer, and the like. For example, the display device 200 is controlled using an application program running on the smart device. The application program may provide various controls to a user through an intuitive User Interface (UI) on a screen associated with the smart device through configuration.

For example, the mobile terminal 100B may install a software application with the display device 200 to implement connection communication through a network communication protocol for the purpose of one-to-one control operation and data communication. Such as: the mobile terminal 100B may be caused to establish a control instruction protocol with the display device 200, and the functions of the physical keys as arranged by the remote control 100A may be implemented by operating various function keys or virtual controls of the user interface provided on the mobile terminal 100B. The audio and video content displayed on the mobile terminal 100B may also be transmitted to the display device 200, so as to implement a synchronous display function.

The display apparatus 200 may provide a network television function of a broadcast receiving function and a computer support function. The display device may be implemented as a digital television, a web television, an Internet Protocol Television (IPTV), or the like.

The display device 200 may be a liquid crystal display, an organic light emitting display, a projection device. The specific display device type, size, resolution, etc. are not limited.

The display apparatus 200 also performs data communication with the server 300 through various communication means. Here, the display apparatus 200 may be allowed to be communicatively connected through a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 300 may provide various contents and interactions to the display apparatus 200. By way of example, the display device 200 may send and receive information such as: receiving Electronic Program Guide (EPG) data, receiving software program updates, or accessing a remotely stored digital media library. The servers 300 may be a group or groups of servers, and may be one or more types of servers. Other web service contents such as a video on demand and an advertisement service are provided through the server 300.

In some embodiments, as shown in fig. 1B, the display device 200 includes a rotating component 276, a controller 250, a display 275, and a rotating component 276 connected to the back plate, where the rotating component 276 may be a rotating component that rotates the display screen, and the rotating component 276 may rotate the display screen to a portrait state, that is, a state where the side length of the vertical direction of the screen is greater than the side length of the horizontal direction of the screen, or may rotate the screen to a landscape state, that is, a state where the side length of the horizontal direction of the screen is greater than the side length of the vertical direction of the screen.

Fig. 2 is a block diagram illustrating the configuration of the control device 100. As shown in fig. 2, the control device 100 includes a controller 110, a memory 120, a communicator 130, a user input interface 140, a user output interface 150, and a power supply 160.

A hardware configuration block diagram of the display device 200 is exemplarily shown in fig. 3. As shown in fig. 3, a tuner demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a memory 260, a user interface 265, a video processor 270, a display 275, a rotating component 276, a monitoring component 277, an audio processor 280, an audio output interface 285, and a power supply 290 may be included in the display apparatus 200.

The monitoring component 277 can be disposed independently or in the controller.

The rotating assembly 276 may include a driving motor, a rotating shaft, and the like. Wherein, the driving motor can be connected to the controller 250 and output the rotation angle under the control of the controller 250; one end of the rotation shaft is connected to a power output shaft of the driving motor, and the other end is connected to the display 275, so that the display 275 can be fixedly mounted on a wall or a bracket through the rotation member 276.

The rotating assembly 276 may also include other components, such as a transmission component, a detection component, and the like. Wherein, the transmission component can adjust the rotating speed and the torque output by the rotating component 276 through a specific transmission ratio, and can be in a gear transmission mode; the detection means may be composed of a sensor, such as an angle sensor, an attitude sensor, or the like, provided on the rotation shaft. These sensors may detect parameters such as the angle at which the rotating assembly 276 is rotated and transmit the detected parameters to the controller 250, so that the controller 250 can determine or adjust the state of the display apparatus 200 according to the detected parameters. In practice, rotating assembly 276 may include, but is not limited to, one or more of the components described above.

A monitoring assembly 277 for monitoring assembly rotation information of the rotating assembly 276 and outputting the assembly rotation information to the controller.

The tuner demodulator 210 receives the broadcast television signal in a wired or wireless manner, may perform modulation and demodulation processing such as amplification, mixing, and resonance, and is configured to demodulate, from a plurality of wireless or wired broadcast television signals, an audio/video signal carried in a frequency of a television channel selected by a user, and additional information (e.g., EPG data).

In other exemplary embodiments, the tuning demodulator 210 may also be in an external device, such as an external set-top box. In this way, the set-top box outputs a television signal after modulation and demodulation, and inputs the television signal into the display apparatus 200 through the external device interface 240.

The communicator 220 is a component for communicating with an external device or an external server according to various communication protocol types. For example, the display apparatus 200 may transmit content data to an external apparatus connected via the communicator 220, or browse and download content data from an external apparatus connected via the communicator 220. The communicator 220 may include a network communication protocol module or a near field communication protocol module, such as a WIFI module 221, a bluetooth communication protocol module 222, and a wired ethernet communication protocol module 223, so that the communicator 220 may receive a control signal of the control device 100 according to the control of the controller 250 and implement the control signal as a WIFI signal, a bluetooth signal, a radio frequency signal, and the like.

The detector 230 is a component of the display apparatus 200 for collecting signals of an external environment or interaction with the outside. The detector 230 may include a sound collector 231, such as a microphone, which may be used to receive a user's sound, such as a voice signal of a control instruction of the user to control the display device 200; alternatively, ambient sounds may be collected that identify the type of ambient scene, enabling the display device 200 to adapt to ambient noise.

In some other exemplary embodiments, the detector 230, which may further include an image collector 232, such as a camera, a video camera, etc., may be configured to collect external environment scenes to adaptively change the display parameters of the display device 200; and the function of acquiring the attribute of the user or interacting gestures with the user so as to realize the interaction between the display equipment and the user.

In some other exemplary embodiments, the detector 230 may further include a temperature sensor, such as by sensing an ambient temperature, and the display device 200 may adaptively adjust a display color temperature of the image. For example, when the temperature is higher, the display apparatus 200 may be adjusted to display a color temperature of an image that is cooler; when the temperature is lower, the display device 200 may be adjusted to display a warmer color temperature of the image.

The external device interface 240 is a component for providing the controller 250 to control data transmission between the display apparatus 200 and an external apparatus. The external device interface 240 may be connected to an external apparatus such as a set-top box, a game device, a notebook computer, etc. in a wired/wireless manner, and may receive data such as a video signal (e.g., moving image), an audio signal (e.g., music), additional information (e.g., EPG), etc. of the external apparatus.

The external device interface 240 may include: a High Definition Multimedia Interface (HDMI) terminal 241, a Composite Video Blanking Sync (CVBS) terminal 242, an analog or digital Component terminal 243, a Universal Serial Bus (USB) terminal 244, a Component terminal (not shown), a red, green, blue (RGB) terminal (not shown), and the like.

The controller 250 controls the operation of the display device 200 and responds to the operation of the user by running various software control programs (such as an operating system and various application programs) stored on the memory 260.

As shown in fig. 3, the controller 250 includes a Random Access Memory (RAM)251, a Read Only Memory (ROM)252, a graphic processor 253, a CPU processor 254, a communication interface 255, a communication bus 256, a rotation processor 257, and an animation processor 258. The RAM251, the ROM252, the graphic processor 253, the CPU processor 254, the communication interface 255, the rotation processor 257, and the animation processor 258 are connected by a communication bus 256. The functions of the rotation processor 257 and the animation processor 258 will be described in detail in the following embodiments.

The controller 250 may control the overall operation of the display apparatus 200. For example: in response to receiving a user input command for selecting a GUI object displayed on the display 275, the controller 250 may perform an operation related to the object selected by the user input command.

Where the object may be any one of the selectable objects, such as a hyperlink or an icon. The operation related to the selected object is, for example, an operation of displaying a link to a hyperlink page, document, image, or the like, or an operation of executing a program corresponding to the object. The user input command for selecting the GUI object may be a command input through various input means (e.g., a mouse, a keyboard, a touch panel, etc.) connected to the display apparatus 200 or a voice command corresponding to a voice spoken by the user.

A memory 260 for storing various types of data, software programs, or applications for driving and controlling the operation of the display device 200. The memory 260 may include volatile and/or nonvolatile memory. And the term "memory" includes the memory 260, the RAM251 and the ROM252 of the controller 250, or a memory card in the display device 200.

In some embodiments, the memory 260 is specifically used for storing an operating program for driving the controller 250 of the display device 200; storing various application programs built in the display apparatus 200 and downloaded by a user from an external apparatus; data such as visual effect images for configuring various GUIs provided by the display 275, various objects related to the GUIs, and selectors for selecting GUI objects are stored.

In some embodiments, memory 260 is specifically configured to store drivers for tuner demodulator 210, communicator 220, detector 230, external device interface 240, video processor 270, display 275, audio processor 280, etc., and related data, such as external data (e.g., audio-visual data) received from the external device interface or user data (e.g., key information, voice information, touch information, etc.) received by the user interface.

A block diagram of the architectural configuration of the operating system in the memory of the display device 200 is illustrated in fig. 4. The operating system architecture comprises an application layer, a middleware layer and a kernel layer from top to bottom.

The application layer, the application programs built in the system and the non-system-level application programs belong to the application layer. Is responsible for direct interaction with the user. The application layer may include a plurality of applications such as a setup application, a post application, a media center application, and the like. The application programs are mainly developed based on an Android system and can be Java/C + +, which is a development language. These applications may also be implemented as Web applications that execute based on a WebKit engine, and in particular may be developed and executed based on HTML5, Cascading Style Sheets (CSS), and JavaScript.

The middleware layer may provide some standardized interfaces to support the operation of various environments and systems. For example, the middleware layer may be implemented as multimedia and hypermedia information coding experts group (MHEG) middleware related to data broadcasting, DLNA middleware which is middleware related to communication with an external device, middleware which provides a browser environment in which each application program in the display device operates, and the like.

The kernel layer provides core system services, such as: file management, memory management, process management, network management, system security authority management and the like. The kernel layer may be implemented as a kernel based on various operating systems, for example, a kernel based on the Linux operating system.

The kernel layer also provides communication between system software and hardware, and provides device driver services for various hardware, such as: provide display drivers for display 275, camera drivers for the camera, key drivers for the remote control, WIFI drivers for the WIFI module, audio drivers for the audio output interface, power management drivers for the Power Management (PM) module, etc.

In FIG. 3, user interface 265, receives various user interactions. Specifically, it is used to transmit an input signal of a user to the controller 250 or transmit an output signal from the controller 250 to the user. For example, the remote controller 100A may transmit an input signal, such as a power switch signal, a channel selection signal, a volume adjustment signal, etc., input by the user to the user interface 265, and then the input signal is transferred to the controller 250 through the user interface 265; alternatively, the remote controller 100A may receive an output signal such as audio, video, or data output from the user interface 265 via the controller 250, and display the received output signal or output the received output signal in audio or vibration form.

In some embodiments, a user may enter user commands on a Graphical User Interface (GUI) displayed on the display 275, and the user interface 265 receives the user input commands through the GUI. Specifically, the user interface 265 may receive user input commands for controlling the position of a selector in the GUI to select different objects or items. A "user interface," as used herein, is a media interface for interaction and information exchange between an application or operating system and a user that enables conversion between an internal form of information and a form acceptable to the user. A common presentation form of a user interface is a Graphical User Interface (GUI), which refers to a user interface related to computer operations and displayed in a graphical manner. It may be an interface element such as an icon, a window, a control, etc. displayed in the display screen of the electronic device, where the control may include a visual interface element such as an icon, a control, a menu, a tab, a text box, a dialog box, a status bar, a channel bar, a Widget, etc.

Alternatively, the user may input a user command by inputting a specific sound or gesture, and the user interface 265 receives the user input command by recognizing the sound or gesture through the sensor.

The video processor 270 is configured to receive an external video signal, and perform video data processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, and image synthesis according to a standard codec protocol of the input signal, so as to obtain a video signal that is directly displayed or played on the display 275.

A display 275 for receiving the image signal from the video processor 270 and displaying the video content, the image and the menu manipulation interface. The display video content may be from the video content in the broadcast signal received by the tuner-demodulator 210, or from the video content input by the communicator 220 or the external device interface 240. The display 275, while displaying a user manipulation interface UI generated in the display apparatus 200 and used to control the display apparatus 200.

And, the display 275 may include a display screen assembly for presenting a picture and a driving assembly for driving the display of an image. Alternatively, a projection device and projection screen may be included, provided that the display 275 is a projection display 275.

Rotating assembly 276, the controller may issue a control signal to cause rotating assembly 276 to rotate display 275.

The audio processor 280 is configured to receive an external audio signal, decompress and decode the received audio signal according to a standard codec protocol of the input signal, and perform audio data processing such as noise reduction, digital-to-analog conversion, and amplification processing to obtain an audio signal that can be played by the speaker 286.

Illustratively, audio processor 280 may support various audio formats. Such as MPEG-2, MPEG-4, Advanced Audio Coding (AAC), high efficiency AAC (HE-AAC), and the like.

The audio output interface 285 is used for receiving an audio signal output by the audio processor 280 under the control of the controller 250, and the audio output interface 285 may include a speaker 286 or an external sound output terminal 287, such as an earphone output terminal, for outputting to a generating device of an external device.

And a power supply 290 for supplying power supply support to the display apparatus 200 from the power input from the external power source under the control of the controller 250. The power supply 290 may be a built-in power supply circuit installed inside the display apparatus 200 or may be a power supply installed outside the display apparatus 200.

In the related art, the display of the rotating television can be rotated, and thus, the rotating television is applied to various use scenes. For convenience of use, the current rotating television has a port capable of being externally connected with a camera, the port comprises a first port and a second port, the first port is positioned at the upper end of the display when the display is in a transverse screen, and the second port is positioned at the upper end of the display when the display is in a vertical screen, namely one side of the display when the display is in the transverse screen. When a user selects a certain port to insert a camera and uses the camera to shoot images, the problem that the shot images rotate when being displayed on a display is often found, and the use experience of the user is influenced.

In the embodiment of the present application, the display device supports insertion of cameras of different camera types through a port, the camera types include an in-line type or a sitting type, as shown in fig. 5, an in-line type camera 51 indicates that the camera will rotate along with the display, a sitting type camera 52 indicates that the camera and the port are connected through a transmission line 53, and the sitting type camera does not rotate when the display rotates.

Fig. 6 to 13 show images taken by the camera in different situations, wherein the images in fig. 6 to 13 were taken with the position of the object being taken unchanged. Fig. 6 shows that the screen is in a horizontal screen state, the camera is inserted into the first port, and when the camera is in a direct-insertion type, the image shot by the camera is displayed normally. Fig. 7 shows that the screen state is in a horizontal screen state, the camera is inserted into the first port, and when the camera type is a sitting-standing type, the image shot by the camera is normally displayed and does not rotate. In the embodiment of the present application, the placement position of the sitting-standing type camera may be set arbitrarily, for example, when the image in fig. 7 is obtained by shooting, the position of the sitting-standing type camera is the same as that of the in-line type camera in fig. 6, and fig. 7 only shows that the sitting-standing type camera exists, but does not show the position of the sitting-standing type camera when the image in fig. 7 is obtained by shooting.

Fig. 8 shows that the screen is in a horizontal screen state, the camera is inserted into the second port, and when the camera is in a direct-insert type, the image shot by the camera cannot be normally displayed and is rotated.

In the embodiment of the application, since the cameras are located at the first port and the second port, and the positions of the cameras are different relative to the characters, the shooting ranges of the camera located at the first port and the camera located at the second port are also different, for example, the characters do not exceed the display interface boundary of the display in fig. 7, and the characters exceed the display interface boundary in fig. 8, at this time, the user can adjust the positions of the characters to realize that the characters are all located in the display interface.

Fig. 9 shows that the screen state is in the horizontal screen state, the camera is inserted into the second port, and when the camera type is the sitting-standing type, the image shot by the camera is normally displayed and does not rotate. Fig. 10 shows that the screen is in a vertical screen state, the camera is inserted into the first port, the camera is in a direct insertion type, and the image shot by the camera cannot be normally displayed and is rotated. Fig. 11 shows that the screen is in a vertical screen state, the camera is inserted into the first port, the camera is in a sitting-standing type, and the image shot by the camera can be normally displayed and does not rotate. Fig. 12 shows that the screen is in a vertical screen state, the camera is inserted into the second port, and the camera is in a direct insertion type, and the image shot by the camera can be normally displayed and does not rotate. Fig. 13 shows that the screen is in a vertical screen state, the camera is inserted into the second port, the camera is in a sitting-standing type, and the image shot by the camera can be normally displayed and does not rotate.

In conclusion, it can be seen that when the screen state is in the horizontal screen state, the camera is inserted into the second port, the camera type is in a direct insertion type, the screen state is in the vertical screen state, the camera is inserted into the first port, the camera type is in a direct insertion type, and images cannot be normally displayed under two conditions. It should be noted that the image turning direction of the abnormal situation in fig. 8 and fig. 10 is only an example, in some embodiments, the abnormal situation may further include other turning directions, for example, as shown in fig. 8, the direction of the camera in the display device is a forward direction, the direction of the avatar in fig. 8 is located in a reverse direction of the camera relative to the display device, and in some embodiments, the direction of the avatar in the portrait is located in the same direction of the camera relative to the display device.

It should be noted that, in the solution related to the present application, when the number of cameras inserted into the display device is one, the display device is unfolded, and when there are two cameras, the user is prompted to pull out one of the two cameras, or select one of the two cameras for shooting an image according to a preset method, without inserting two cameras.

In order to solve the foregoing technical problem, an embodiment of the present application provides a method for determining a preview direction of a camera, where the method enables an image captured by the camera to be normally displayed on a display when a screen state is in a horizontal screen state, the camera is inserted into a second port, and the camera type is in an in-line type, and the screen state is in a vertical screen state, the camera is inserted into a first port, and the camera type is in the in-line type.

In some embodiments, the method, as shown in fig. 14, comprises:

s100, receiving an instruction of starting a preset application, and judging whether a camera is inserted into the display equipment.

In some embodiments, the instruction for starting the preset application may be a photographing application, the focus on the display device is moved by the control device, the focus is moved to a control of the preset application, and a confirmation key on the control device is pressed to generate an instruction for starting the preset application, after the preset application is started, a user interface is displayed as shown in fig. 15, and an image photographed by the camera is displayed in a preview frame of the user interface. In some embodiments, the user can move the focus to the photographing control through the control device to achieve the purpose of taking a picture.

And if the camera is inserted into the display equipment, determining the port information of the camera inserted into the display equipment, wherein the port information comprises the first port or the second port. And when the camera is inserted into the display equipment, determining that the camera is specifically inserted into a port in the display equipment.

If the camera is not inserted into the display device, the display is controlled to display prompt information for inserting the camera, the prompt information is not limited in form and can be pictures, characters or sounds, and for example, as shown in fig. 16, the prompt information is that the camera is not detected and whether the current camera is connected or not is checked.

In some embodiments, the camera is detected to be inserted into the display device, and the first preset file is generated. The step of judging whether a camera is inserted into the display device comprises the following steps: judging whether a first preset file exists or not; if the first preset file exists, determining that a camera is inserted into the display equipment; and if the first preset file does not exist, determining that no camera is inserted into the display equipment. In the embodiment of the application, when the camera is inserted into the display device, the first preset file is automatically generated. When the step of judging whether the camera is inserted into the display equipment is executed, directly judging whether a first preset file exists. If so, determining that the camera is inserted into the display device, and if not, determining that the camera is not inserted into the display device. The method may also be used to determine whether the camera is inserted into the display device by other methods, and the method is not particularly limited in the present application.

In some embodiments, port information indicating a port into which a camera is inserted, a screen state indicating that a screen is placed horizontally or vertically, and a rotation state indicating whether an image is rotated are obtained.

In some embodiments, detecting that a camera is inserted into the display device, and generating a second preset file; the step of determining the port information of the camera inserted into the display device comprises: judging whether a second preset file exists or not; and if the second preset file exists, determining the port information according to the file name of the second preset file. In the embodiment of the application, when the camera is inserted into the display device, the second preset file is automatically generated according to the inserted port. The file names of the second preset files are generated according to the ports, and when the second preset files are inserted into different ports, the file names of the second preset files are different. When the port information is a first port, the file name of the second preset file is a first file name; when the port information is a second port, the file name of a second preset file is a second file name; the step of determining the port information according to the file name of the second preset file includes: and judging whether a second preset file with the first file name exists or not, if so, determining that the port information is a first port, and if not, determining that the port information is a second port.

In some embodiments, the step of determining the rotation state comprises: acquiring an image shot by a camera; and determining the rotation state of the image according to the image, wherein the rotation state comprises rotation or non-rotation. In some embodiments, determining the rotation state of the image from the image comprises: extracting the features of the image, inputting the features into a preset classifier, and determining the rotation state of the image.

In the embodiment of the application, the preset classifier is trained through sample data. In some embodiments, the feature of the image is a texture feature, and the texture feature refers to a contour of the object. The sample data includes texture features and a rotation state in the object when the rotation occurs, and a preset classifier is trained through the sample data, it should be noted that in the embodiment of the present application, the rotation occurs only by 90 ° rotation.

In some embodiments, the texture features of the image are extracted and input into a preset classifier to obtain the rotation state of the image.

In some embodiments, the number of the preset classifiers may be multiple, and the example includes a first preset classifier and a second preset classifier, the features of the image are extracted first, the first preset classifier is input to obtain a rotation state of the image, in order to avoid using the first preset classifier to determine that the rotation state of the image is inaccurate, the rotation state of the image determined by using the first preset classifier is an image corresponding to the rotation, the features of the image corresponding to the second preset classifier are continuously extracted, the second preset classifier is input to obtain the rotation state of the image, and if the rotation state of the image is still determined to be the rotation by using the second preset classifier, the rotation state of the image is finally determined to be the rotation, so that the rotation state of the image can be accurately determined.

In the embodiment of the application, the display device further comprises a gyroscope, and the gyroscope is utilized to determine the screen state, and the screen state is used for indicating the transverse or longitudinal placement of the screen.

In the embodiment of the application, before the image is displayed on the user interface, the image shot by the camera is adjusted, so that the image can be normally displayed on the user interface, and the phenomenon that the image is rotated to influence the use of a user is avoided.

In some embodiments, the camera type is determined according to the port information, the screen state and the rotation state S200.

In some embodiments, the step of determining the camera type according to the port information, the screen state and the rotation state comprises:

the screen state comprises a horizontal screen state or a vertical screen state; the rotation state comprises rotation or no rotation; the camera type comprises a direct insertion type or a sitting type. In some embodiments, the in-line type camera may be an external camera, and in other embodiments, the in-line type camera may be a camera built in the display device.

And if the port information is a first port, the screen state is a vertical screen state, and the image rotates, determining that the camera type is a direct insertion type.

And if the port information is a second port, the screen state is a horizontal screen state, and the image rotates, determining that the camera type is a direct insertion type.

And if the port information is a first port, the screen state is a horizontal screen state and the image is not rotated, determining that the type of the camera is a preset type, wherein the preset type comprises a direct insertion type or a sitting type.

And if the port information is a second port, the screen state is a horizontal screen state and the image is not rotated, determining that the camera type is a sitting type.

And if the port information is a first port, the screen state is a vertical screen state and the image is not rotated, determining that the camera type is a sitting type.

In some embodiments, S300, controlling the camera to capture an image according to the type of the camera, the port information, and the screen state, so that the captured image is normally displayed on the display, where the normal display in the display means that the image is not rotated.

In some embodiments, the step of controlling the camera to capture the image according to the type of the camera, the port information, and the screen state includes:

if the camera type is a sitting type and the screen state is a horizontal screen state, controlling the camera to shoot images according to a preset preview image ratio m: n; and receiving a display rotation instruction, changing the screen state and rotating the display to the vertical screen. In some embodiments, a user interface is provided with a rotary control, and a user can move a focus to the rotary control through a control device and press a confirmation key on the control device to generate a display rotation instruction; when the screen state of the display is a vertical screen state, judging whether the camera supports the preview image proportion n: m, if so, controlling the camera to shoot an image according to the preview image proportion n: m; if not, intercepting the image shot by the camera according to the preset preview image proportion according to the preview image proportion n: m, reserving the shot image content to the maximum extent, and displaying the intercepted image in the display. Illustratively, the display has a ratio of m: n, the display has a size of 1920: 1080, and the preset preview image has a ratio of m: n, m is 16, and n is 9. When the screen state of the display is the vertical screen state and the preview image ratio is not supported by 9: 16, the image according to the preset preview image ratio of 16: 9 is intercepted, the preview image ratio of the intercepted image is 9: 16, and the intercepted image is displayed on the display.

In the embodiment of the application, the preview image proportion supported by the camera is prestored, for example, when the camera supports the preview image proportion of n: m, the image proportion shot by the camera is n: m, but due to different performances of different cameras, some cameras cannot support the preview image proportion of n: m. Therefore, when the screen state is a horizontal screen state, a display rotation instruction is received, the display is rotated to a vertical screen, and because the camera does not support the preview image proportion of n: m, the image shot by the camera needs to be processed, and the processed image is displayed in the display.

If the camera type is a sitting type and the screen state is a vertical screen state, judging whether the camera supports the preview image proportion n: m, if so, controlling the camera to shoot the image according to the preview image proportion n: m; if not, intercepting an image shot by the camera according to a preset preview image proportion according to the preview image proportion n: m, and displaying the intercepted image in a display; and receiving a display rotation instruction, controlling to change the screen state, rotating the display to the transverse screen, controlling the camera to shoot images according to a preset preview ratio m: n, and displaying the shot images in the display.

If the camera is in a direct-insert type, the port information is a first port, and the screen state is in a vertical screen state, an image shot by the camera according to a preset preview image proportion m: n is displayed on a display after being rotated by a preset angle, illustratively, the preset angle is 90 degrees, and when the preset angle is rotated, the image is normally displayed on the display without being rotated. And receiving a display rotation instruction, changing the screen state, rotating the display to the transverse screen, controlling the camera to shoot images according to a preset preview image proportion m: n, and displaying the shot images in the display.

If the camera type is a direct insertion type, the port information is a first port, and the screen state is a horizontal screen state, the camera is controlled to shoot images according to a preset preview image ratio m: n; and receiving a display rotation instruction, changing the screen state, rotating the display to a vertical screen, and displaying an image shot by the camera according to a preset preview image ratio m: n on the display after rotating a preset angle.

If the camera type is a direct insertion type and the port information is a second port, judging whether the camera supports a preview image ratio of n: m, if so, judging whether the screen state is a vertical screen state, and if so, controlling the camera to shoot an image according to the preview image ratio of n: m; receiving a display rotation instruction, changing the screen state, rotating the display to a transverse screen, and displaying an image shot by a camera according to a preview image ratio n: m on the display after rotating the image by a preset angle; and if the screen state is a horizontal screen state, rotating an image shot by the camera according to the preview image proportion n: m by a preset angle, displaying the image on the display, receiving a display rotation instruction, changing the screen state, rotating the display to a vertical screen, controlling the camera to shoot the image according to the preview image proportion n: m, and displaying the image on the display.

If the screen state is not supported, judging whether the screen state is a vertical screen state, if so, intercepting an image shot by a camera according to a preset preview image proportion according to a preview image proportion n: m, and displaying the intercepted image on a display; receiving a display rotation instruction, changing a screen state, rotating the display to a transverse screen, controlling a camera to shoot images according to a preset preview image proportion m: n, rotating by a preset angle, and displaying the rotated images on the display; if the screen state is a horizontal screen state, intercepting an image m: n of an image shot by a camera according to a preset preview image proportion, intercepting the image to obtain an image with the proportion of n: m, rotating the intercepted image by a preset angle, and displaying the image on a display; and receiving a display rotation instruction, changing the screen state, enabling the display to be vertical, reversely rotating the image by a preset angle, and displaying the image on the display. In some embodiments, the intercepted and rotated image is displayed full screen on the display.

In the embodiment, the image shot by the camera is adjusted according to the type of the camera, the port information and the screen state, so that the image is normally displayed in a display, and the use experience of a user is improved. The method comprises the following steps: receiving an instruction for starting a preset application, and acquiring port information, a screen state and a rotation state, wherein the port information is used for indicating a port into which a camera is inserted, the screen state is used for indicating that a screen is placed transversely or longitudinally, and the rotation state is used for indicating whether an image rotates or not; determining the type of a camera according to the port information, the screen state and the rotation state; and controlling the camera to shoot images according to the type of the camera, the port information and the screen state.

Finally, it should be noted that: the above embodiments are only used for illustrating the technical solutions of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present application.

The foregoing description, for purposes of explanation, has been presented in conjunction with specific embodiments. However, the illustrative discussions above are not intended to be exhaustive or to limit the embodiments to the precise forms disclosed above. Many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles and the practical application, to thereby enable others skilled in the art to best utilize the embodiments and various embodiments with various modifications as are suited to the particular use contemplated.

Claims

1. A display device, comprising:

a display for displaying a user interface;

a user interface for receiving an input signal;

2. The display device according to claim 1, wherein the controller, before acquiring the port information, is further configured to:

judging whether a camera is inserted into the display equipment or not;

3. The display device according to claim 2, wherein the controller is configured to determine the camera type based on the port information, the screen state, and the rotation state according to the following steps:

4. The display device according to claim 3, wherein the controller is configured to control a camera to capture an image according to the camera type, port information, and screen status by:

if the camera type is a direct insertion type and the port information is a second port, judging whether the camera supports a preview image ratio of n: m, and if so, judging whether the screen state is a vertical screen state; if the screen state is a horizontal screen state, rotating an image shot by the camera according to a preview image ratio n: m by a preset angle, displaying the image on the display, receiving a display rotation instruction, changing the screen state, rotating the display to the horizontal screen, controlling the camera to shoot the image according to the preset preview image ratio m: n, and displaying the image on the display;

if the screen state is not supported, judging whether the screen state is a vertical screen state or not, if the screen state is a horizontal screen state, intercepting an image m: n of an image shot by a camera according to a preset preview image proportion, intercepting the image to obtain an image with the proportion of n: m, rotating the intercepted image by a preset angle, and displaying the image on a display; and receiving a display rotation instruction, changing the screen state, enabling the display to be vertical, reversely rotating the image by a preset angle, and displaying the image on the display.

5. The display device according to claim 1, wherein the controller is configured to perform determining the rotation state according to the following steps: acquiring an image shot by a camera; and determining the rotation state of the image according to the image.

6. The display device of claim 1, wherein the controller is configured to determine the rotation state of the image based on the image by: and inputting the image into a preset classifier, and determining the rotation state of the image.

7. The display device according to claim 2, wherein the controller is further configured to perform:

8. The display device according to claim 2, wherein the controller is further configured to perform: and if the camera is not inserted into the display equipment, controlling the display to display prompt information of the inserted camera.

9. The display device according to claim 2, wherein the controller is further configured to perform:

10. A method for determining a preview direction of a camera is characterized by comprising the following steps: