CN107241199B - Image processing method and device for conference terminal - Google Patents
Image processing method and device for conference terminal Download PDFInfo
- Publication number
- CN107241199B CN107241199B CN201710422856.1A CN201710422856A CN107241199B CN 107241199 B CN107241199 B CN 107241199B CN 201710422856 A CN201710422856 A CN 201710422856A CN 107241199 B CN107241199 B CN 107241199B
- Authority
- CN
- China
- Prior art keywords
- operating system
- image
- function
- kylin operating
- calling
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 34
- 230000006870 function Effects 0.000 claims abstract description 98
- 238000006243 chemical reaction Methods 0.000 claims description 6
- 238000000034 method Methods 0.000 abstract description 22
- 238000010586 diagram Methods 0.000 description 6
- 239000003086 colorant Substances 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 4
- 230000005540 biological transmission Effects 0.000 description 3
- 230000006835 compression Effects 0.000 description 2
- 238000007906 compression Methods 0.000 description 2
- 238000004590 computer program Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/02—Details
- H04L12/16—Arrangements for providing special services to substations
- H04L12/18—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast
- H04L12/1813—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast for computer conferences, e.g. chat rooms
- H04L12/1827—Network arrangements for conference optimisation or adaptation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/445—Program loading or initiating
- G06F9/44505—Configuring for program initiating, e.g. using registry, configuration files
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
- H04N21/4316—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Software Systems (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Marketing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Business, Economics & Management (AREA)
- Computer Networks & Wireless Communication (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Telephonic Communication Services (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The invention provides an image processing method and device of a conference terminal, wherein the method comprises the steps of calling an XopenDisplay function in an kylin operating system to open an image window of the kylin operating system; secondly, acquiring configuration parameters of an image window of the kylin operating system; then, calling an XGetImage function in the kylin operating system to acquire a screen image displayed on an image window of the kylin operating system; and finally, coding the screen image displayed by the acquired image window and sending the coded screen image to other conference terminals. The method comprises the steps of opening an image window of an kylin operating system by calling XopenDisplay and XGetImage functions in the kylin operating system, and collecting a screen image displayed by the image window; the method can realize the real-time acquisition of the screen image in the kylin operating system under the original video conference system, namely, can realize the compatibility of the original video conference system and the kylin operating system.
Description
Technical Field
The invention relates to the technical field of video conferences, in particular to an image processing method and device for a conference terminal.
Background
Video Conference Systems (VCS), including software Video Conference systems and hardware Video Conference systems, refer to individuals or groups in two or more different locations, and distribute various data such as static and dynamic images, voice, text, and pictures of people to computers of users through various existing telecommunication transmission media, so that geographically dispersed users can share one location to exchange information in various ways such as graphics and voice, thereby increasing the comprehension ability of both parties to contents. At present, the video conference gradually develops towards the direction of multi-network cooperation, high-definition and development.
A video conference system in the prior art includes a Multipoint controller (MCU for short), a conference room terminal, a PC desktop terminal, and a telephone access gateway. Since the PC is already in standard office configuration and the desktop conference terminal does not need to add much hardware investment, the PC desktop terminal has become a priority choice for video conferences of various enterprises.
In the prior art, a real-time desktop double-stream acquisition technology based on an h.323 protocol of a desktop video conference on a local area network is mainly applied to a windows operating system to acquire desktop images in real time, encode the desktop images and send the desktop images to a remote conference television terminal.
However, the image acquisition and playing method in the prior art is incompatible with the Linux operating system, so that the existing real-time desktop dual-stream acquisition and playing technology cannot be used on a domestic kylin operating system desktop platform.
Disclosure of Invention
The invention aims to overcome the defect that a real-time desktop double-flow acquisition technology in the prior art cannot be compatible with an kylin operating system desktop platform.
In view of this, the present invention provides an image processing method and apparatus for a conference terminal.
According to a first aspect, an embodiment of the present invention provides an image processing method for a conference terminal, where the conference terminal employs an kylin operating system, and the image processing method includes the following steps:
calling an XopenDisplay function in an kylin operating system, and opening an image window of the kylin operating system through the XopenDisplay function;
acquiring configuration parameters of an image window of the kylin operating system;
calling an XGetImage function in the kylin operating system, and acquiring a screen image displayed on an image window of the kylin operating system by using the configuration parameters through the XGetImage function;
and coding the acquired screen image displayed on the image window of the kylin operating system, and sending the coded screen image to other conference terminals.
Optionally, the method further comprises:
receiving video images sent by other conference terminals, and decoding the video images;
calling an SDL _ Init function of the kylin operating system, and initializing a decoded video code stream through the SDL _ Init function;
calling an SDL _ SetVideoMode function of the kylin operating system, and creating an image window through the SDL _ SetVideoMode function;
and processing the video code stream to be displayed on the created image window.
Optionally, the step of encoding the collected screen image displayed in the image window of the kylin operating system and sending the encoded screen image to other conference terminals includes:
converting a screen image displayed by an image window of the kylin operating system from a first format to a second format;
and calling an image coding function, coding the converted screen image, and sending the coded image information to other conference terminals.
Optionally, the first format is an RGB format, and the second format is a YUV format.
According to a second aspect, an embodiment of the present invention further provides an image processing apparatus of a conference terminal, including:
the first calling unit is used for calling an XopenDisplay function in the kylin operating system and opening an image window of the kylin operating system through the XopenDisplay function;
the first acquisition unit is used for acquiring configuration parameters of an image window of the kylin operating system;
the second calling unit is used for calling an XGetImage function in the kylin operating system and acquiring a screen image displayed on an image window of the kylin operating system by using the configuration parameters through the XGetImage function;
and the coding unit is used for coding the acquired screen image displayed by the window of the kylin operating system and sending the screen image to other conference terminals.
Optionally, the image processing apparatus further includes:
the decoding unit is used for receiving video images sent by other conference terminals and decoding the video images;
a third calling unit, configured to call an SDL _ Init function of the kylin operating system, and initialize the decoded video code stream through the SDL _ Init function;
a fourth calling unit, configured to call an SDL _ SetVideoMode function of the kylin operating system, and create an image window through the SDL _ SetVideoMode function;
and the processing unit is used for processing the video code stream so as to display the video code stream on the created image window.
Optionally, the encoding unit includes:
the conversion unit is used for converting the screen image displayed by the image window of the kylin operating system from a first format to a second format;
and the fifth calling unit is used for calling an image coding function, coding the converted screen image and sending the coded image information to other conference terminals.
Optionally, the first format is an RGB format, and the second format is a YUV format.
According to a third aspect, an embodiment of the present invention further provides a conference terminal, including: at least one processor; and a memory communicatively coupled to the at least one processor; wherein the memory stores instructions executable by the at least one processor to cause the at least one processor to perform the image processing method of the first aspect or any one of the alternatives of the first aspect.
According to a fourth aspect, embodiments of the present invention also provide a non-transitory computer-readable storage medium storing computer instructions for causing a computer to perform the image processing method according to the first aspect or any one of the alternatives of the first aspect.
The technical scheme of the invention has the following advantages:
1. the image processing method of the conference terminal provided by the invention adopts the kylin operating system, firstly calls the XopenDisplay function in the kylin operating system, and opens the image window of the kylin operating system through the XopenDisplay function; secondly, acquiring configuration parameters of an image window of the kylin operating system; then, calling an XGetImage function in the kylin operating system, and acquiring a screen image displayed on an image window of the kylin operating system by using configuration parameters through the XGetImage function; and finally, coding the acquired screen image displayed on the image window of the kylin operating system, and sending the coded screen image to other conference terminals. The image processing method is used in a conference terminal, the method opens an image window of an kylin operating system by calling an XopenDisplay function in the kylin operating system, then collects a screen image displayed by the image window of the kylin operating system by calling an XGetImage function in the kylin operating system, and finally codes and sends the collected screen image; the method can realize the real-time acquisition function of the screen image in the kylin operating system under the original video conference system without influencing the use scene and the operation mode of the original conference, thereby realizing the compatibility of the original video conference system and the kylin operating system.
2. The image processing method of the conference terminal provided by the invention also comprises the steps of receiving video images sent by other conference terminals and decoding the video images; calling an SDL _ Init function of the kylin operating system, and initializing a decoded video code stream through the SDL _ Init function; calling an SDL _ SetVideoMode function of an kylin operating system, and creating an image window through the SDL _ SetVideoMode function; and processing the video code stream to be displayed on the created image window. Initializing a decoded video code stream by calling an SDL _ Init function of an kylin operating system, and creating an image window by calling an SDL _ SetVideoMode function of the kylin operating system to display the processed video code stream; the method can realize the real-time acquisition and playing of the images in the kylin operating system, thereby realizing the compatibility of the kylin operating system and the original video conference system under the condition of not influencing the use scene and the operation mode of the original conference.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and other drawings can be obtained by those skilled in the art without creative efforts.
Fig. 1 is a flowchart of an image processing method of a conference terminal according to embodiment 1 of the present invention;
fig. 2 is a flowchart of an image processing method of a conference terminal according to embodiment 2 of the present invention;
fig. 3 is a schematic structural diagram of an image processing apparatus of a conference terminal according to embodiment 3 of the present invention;
fig. 4 is a schematic structural diagram of a play function of the image processing apparatus of the conference terminal according to embodiment 4 of the present invention;
fig. 5 is a schematic structural diagram of a conference terminal according to embodiment 5 of the present invention.
Detailed Description
The technical solutions of the present invention will be described clearly and completely with reference to the accompanying drawings, and it should be understood that the described embodiments are some, but not all embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
In the description of the present invention, it should be noted that the terms "first", "second", and "third" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance.
In addition, the technical features involved in the different embodiments of the present invention described below may be combined with each other as long as they do not conflict with each other.
Example 1
The embodiment provides an image processing method of a conference terminal, which is used in the conference terminal. The conference terminal adopts an kylin operating system and needs to have image acquisition and display functions. The conference terminal can be a smart phone, a computer, a tablet, a smart television and the like with the functions. The image processing method can be applied to an kylin operating system, the flow chart of the method is shown in FIG. 1, and the method comprises the following processes:
s11: calling a XopenDisplay function in the kylin operating system, and opening an image window of the kylin operating system through the function.
The conference terminal realizes the display of the image window to be collected of the kylin operating system on the screen by calling the XopenDisplay function for opening the image window in the kylin operating system. The XopenDisplay function is preset in a source program of the kylin operating system, is used for opening an image window of the kylin operating system, and is reserved with a program interface, so that the XopenDisplay function can be called by the outside through the interface.
The XopenDisplay function for opening the image window is set in the source program of the kylin operating system, so that the conference terminal can open the image window to be acquired in the kylin operating system based on the XopenDisplay function.
S12: and acquiring configuration parameters of an image window of the kylin operating system.
In the conference terminal, the configuration parameter information of the display corresponding to the image window of the kylin operating system can be obtained according to the actual operating conditions, for example, the configuration parameter information of the display can be the width and height of the display, the color quality and the refresh rate. In this embodiment, since an image displayed on the screen needs to be acquired, the resolution of the display, that is, the pixel points on the width and height of the display, needs to be acquired.
S13: and calling an XGetImage function in the kylin operating system, and acquiring a screen image displayed by an image window of the kylin operating system by using the configuration parameters through the function.
After an image window to be acquired is opened on a display of the conference terminal, the conference terminal calls an XGetImage function for acquiring screen images in an kylin operating system, and the screen images displayed in the display are acquired according to configuration parameters of the display. In this embodiment, when the screen image is acquired, the screen image is obtained according to the resolution of the screen.
The XGetImage function is preset in a source program of the kylin operating system, is used for collecting a screen image of the kylin operating system, and is reserved with a program interface so that the XGetImage function can be called by the outside through the interface.
The XGetImage function for acquiring the screen image is set in the source program of the kylin operating system, so that the conference terminal can acquire the screen image of the opened image window to be acquired in the kylin operating system based on the XGetImage function.
S14: and coding the acquired screen image displayed in the image window of the kylin operating system, and sending the coded screen image to other conference terminals. The other conference terminals described herein may be terminals capable of carrying out a conference arbitrarily, and may be conference terminals adopting a Windows system, or conference terminals adopting an kylin system.
To accurately describe colors, the concept of color space is introduced. Just as the coordinate space is used geometrically to describe the set of coordinates, the color space is used mathematically to describe the set of colors. Common 3 basic color models are RGB, CMYK and YUV. Among them, RGB (Red, Green, Blue) is the most common color space in computers, which generates other colors by adding 3 primary colors of Red, Green, and Blue, and is widely used in computer graphics, imaging systems, and color televisions due to its device independence; the CMYK (Cyan, Magenta, Yellow, Black) color space generates other colors by color subtraction, which is convenient to implement and widely used in the printing industry; the YUV or YIQ or YCb-Cr color space describes the concept of gray and color difference, and is widely used in broadcasting and television systems due to easy implementation of compression, convenient transmission and processing. Because of this, it is also widely used in computer video and image processing, such as JPEG images and MPEG, both use YUV as a format for storage pixels. Under the condition of obtaining the support of display hardware, the color conversion processing can be reduced and eliminated by using YUV, and the display speed of the image is greatly accelerated.
In this embodiment, the format of the screen image collected by the conference terminal is RGB, so that, in order to easily implement compression and facilitate transmission and processing, before the screen image is encoded and transmitted, the RGB format image needs to be converted into YUV format.
After conversion, the image acquisition terminal firstly calls an image coding function, codes the converted screen image, and sends the coded image information to other conference terminals, wherein the other conference terminals can be of an kylin operating system or of other operating systems, such as a windows operating system. In this embodiment, the image coding is selected from but not limited to huffman coding, and all methods capable of implementing image coding, such as shannon-fanno coding, run-length coding, and arithmetic coding, fall within the scope of the present invention.
The image processing method can realize the real-time acquisition function of the screen image under the original video conference system without influencing the use scene and the operation mode of the original conference, namely can realize the compatibility of the original video conference system and the kylin operation system.
Example 2
The embodiment provides an image processing method of a conference terminal, which is used in the conference terminal. The conference terminal adopts an kylin operating system and needs to have image acquisition and display functions. The image collecting, encoding and sending method in the image processing method in this embodiment refers to the image processing method in embodiment 1.
As shown in fig. 2, the image processing method in this embodiment further includes:
s21: and receiving and decoding video images sent by other conference terminals.
In the conference terminal adopting the kylin operating system in this embodiment, first, a video conference sent by another conference terminal is received, where the another conference terminal may be of the kylin operating system, or of another operating system, for example, of a windows operating system; then, the received video image is decoded. In this embodiment, the image decoding is selected from but not limited to huffman decoding, and all methods capable of implementing image decoding, such as shannon-fanuo decoding, run-length decoding, and arithmetic decoding, fall within the scope of the present invention.
S22: and calling an SDL _ Init function of the kylin operating system, and initializing the decoded video code stream by using the function.
The conference terminal calls an SDL _ Init function used for initializing the video code stream in the kylin operating system, and prepares for displaying the video code stream by initializing parameters such as video coding frames, video code stream initialization values, video quality and the like. The SDL _ Init function is preset in a source program of the kylin operating system, is used for initializing a video code stream in the kylin operating system, and is reserved with a program interface so that the external world can call the SDL _ Init function through the interface.
The SDL _ Init function for initializing the video code stream is set in the source program of the kylin operating system, so that the conference terminal can initialize the relevant parameters of the decoded video code stream in the kylin operating system based on the SDL _ Init function and prepare for displaying the video code stream.
S23: calling the SDL _ SetVideoMode function of the kylin operating system and creating an image window.
In the conference terminal, the configuration parameter information of the display corresponding to the image window of the kylin operating system can be obtained according to the actual operating conditions, for example, the configuration parameter information of the display can be the width and height of the display, the color quality and the refresh rate. In this embodiment, since an image displayed on the screen needs to be acquired, the resolution of the display, that is, the pixel points on the width and height of the display, needs to be acquired.
The conference terminal calls an SDL _ SetVideoMode function used for creating an image window in the kylin operating system, the width and the height of the created image window are set according to the resolution of a display corresponding to the acquired image window of the kylin operating system, and the image window created by the function is defaulted to be two small windows which are divided into left and right halves. The SDL _ SetVideoMode function is preset in a source program of the kylin operating system and used for creating an image window in the kylin operating system, and a program interface is reserved in the image window, so that the external world can call the SDL _ SetVideoMode function through the interface.
By setting the SDL _ SetVideoMode function for creating the image window in the source program of the kylin operating system, the conference terminal can set the width and height of the display window for the display corresponding to the image window in the kylin operating system based on the SDL _ SetVideoMode function.
S24: and processing the video code stream to be displayed on the created image window.
And the image processing device processes the decoded video code stream to display on the created image window. The method for processing the video code stream comprises the step of calling an SDL _ CreateThread function of the kylin operating system, wherein the SDL _ CreateThread function is used for creating a first thread and a second thread in the kylin operating system.
The format conversion is carried out on the video code stream through the first thread, and the created image window is controlled to display, namely, the decoded image in the YUV format is converted, in the embodiment, the converted image is selected from but not limited to the RGB format, and all image formats capable of achieving the purpose of the invention belong to the protection range of the invention; and receiving a control command input by a user through the second thread. In this embodiment, on the basis of the image window created by the SDL _ SetVideoMode function, the image window is controlled by the first thread, so that the left widget of the window displays the video image of the local video conference terminal, and the right widget of the window displays the video image of the remote video conference terminal that receives the decoding.
And receiving a control instruction input by a user through a second thread, wherein the second thread is used for circularly controlling the received message to enlarge or reduce the window and responding to a mouse instruction.
And calling the SDL _ CreateThread function of the kylin operating system to realize the processing of the video code stream so as to display the video code stream on the created image window. The video image of the local video conference terminal and the video image of the remote video conference terminal can be realized in the image window of the kylin operating system.
The image processing method of the conference terminal in the embodiment can realize the real-time acquisition and playing of the image in the kylin operating system, thereby realizing the compatibility of the kylin operating system and the original video conference system under the condition of not influencing the use scene and the operation mode of the original conference.
It should be noted that, since the above steps S21-S24 belong to image playing and the steps S11-S14 belong to image capturing, and they do not conflict with each other, the above steps S21-S24 can be executed before or after any of the steps S11-S14 shown in fig. 1, or can be executed simultaneously.
Example 3
The present embodiment provides an image processing apparatus of a conference terminal, configured to execute the image processing method of the conference terminal in embodiment 1, where the image processing apparatus of the conference terminal adopts the kylin operating system, and a block diagram of the structure is shown in fig. 3, and includes:
the first calling unit 31 is used for calling an xponedisplay function in the kylin operating system and opening an image window of the kylin operating system through the xponedisplay function;
a first obtaining unit 32, configured to obtain configuration parameters of an image window of an kylin operating system;
the second calling unit 33 is used for calling an XGetImage function in the kylin operating system, and acquiring a screen image displayed on an image window of the kylin operating system by using the configuration parameters through the XGetImage function;
and the encoding unit 34 is used for encoding the acquired screen image displayed by the window of the kylin operating system and sending the encoded screen image to other conference terminals.
Wherein, the encoding unit 34 includes:
a conversion unit 341, configured to convert the screen image displayed in the image window of the kylin operating system from the first format to the second format;
the fifth calling unit 342 is configured to use an image coding function to code the converted screen image and send the coded image information to other conference terminals.
Preferably, the first format is an RGB format and the second format is a YUV format.
Further, the configuration parameter is the resolution of the display, i.e. the pixel points on the width and height of the display.
For details of the technique not described in detail in the embodiment, reference may be made to the related description in the embodiment shown in fig. 1.
Example 4
The image processing apparatus of the conference terminal of this embodiment is configured to execute the image processing method of the conference terminal described in embodiment 2, and the image processing apparatus of the conference terminal adopts the kylin operating system. The image processing apparatus of the conference terminal executes the image processing method of the conference terminal described in embodiment 1, please refer to the embodiment described with reference to fig. 3. Fig. 4 is a schematic structural diagram of a play function of the image processing apparatus of the conference terminal, and the apparatus includes:
a decoding unit 41, configured to receive and receive video images sent by other conference terminals, where the other conference terminals in this embodiment may be of an kylin operating system, and may also be of other operating systems, for example, a windows operating system; and decoding the video image, in this embodiment, the image decoding is selected from but not limited to huffman decoding, and all methods capable of implementing image decoding, such as shannon-fannuo decoding, run-length decoding, and arithmetic decoding, fall within the scope of the present invention.
And a third calling unit 42, configured to call an SDL _ Init function of the kylin operating system to initialize the decoded video code stream.
A fourth calling unit 43, configured to call the SDL _ SetVideoMode function of the kylin operating system to create the image window.
A processing unit 44 for processing the video code stream to be displayed on the created image window
For details of the technique not described in detail in the embodiment, reference may be made to the related description in the embodiment shown in fig. 3.
Example 5
Fig. 5 is a schematic hardware structure diagram of a conference terminal according to an embodiment of the present invention, where the conference terminal uses the kylin operating system, as shown in fig. 5, the device includes one or more processors 51 and a memory 52, and one processor 51 is taken as an example in fig. 3.
The conference terminal may further include: a video collector (not shown) for collecting video or images. The processor 51, the memory 52 and the video player may be connected by a bus or other means, as exemplified by the bus connection in fig. 3.
The processor 51 may be a central processor. The processor 51 may also be other general purpose processors, digital signal processors, application specific integrated circuits, field programmable gate arrays or other programmable logic devices, discrete gate or transistor logic, discrete hardware components, or any combination thereof. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
The memory 52 is a non-transitory computer readable storage medium, and can be used to store non-transitory software programs, non-transitory computer executable programs, and modules, such as program instructions/modules corresponding to the processing method of the image processing operation of the conference terminal in the embodiment of the present application. The processor 51 executes various functional applications of the server and data processing by running non-transitory software programs, instructions, and modules stored in the memory 52, that is, implements the image processing method of the conference terminal in the above-described embodiment.
The one or more modules are stored in the memory 52 and, when executed by the one or more processors 51, perform an image processing method of the conference terminal as shown in fig. 1 or 2.
The product can execute the method provided by the embodiment of the invention, and has corresponding functional modules and beneficial effects of the execution method. For details of the technology not described in detail in the present embodiment, reference may be made to the description of the embodiment shown in fig. 1 or 2.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, apparatus or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-RAM, optical storage, and the like) having computer-usable program code embodied therein.
It should be understood that the above examples are only for clarity of illustration and are not intended to limit the embodiments. Other variations and modifications will be apparent to persons skilled in the art in light of the above description. And are neither required nor exhaustive of all embodiments. And obvious variations or modifications therefrom are within the scope of the invention.
Claims (8)
1. An image processing method of a conference terminal is characterized in that the conference terminal adopts an kylin operating system, and the image processing method comprises the following steps:
calling an XopenDisplay function in an kylin operating system, and opening an image window of the kylin operating system through the XopenDisplay function;
acquiring configuration parameters of an image window of the kylin operating system; the configuration parameter is configuration parameter information of a display corresponding to the image window;
calling an XGetImage function in the kylin operating system, and acquiring a screen image displayed on an image window of the kylin operating system by using the configuration parameters through the XGetImage function;
coding the acquired screen image displayed on the image window of the kylin operating system, and sending the coded screen image to other conference terminals;
receiving video images sent by other conference terminals, and decoding the video images;
calling an SDL _ Init function of the kylin operating system, and initializing a decoded video code stream through the SDL _ Init function;
calling an SDL _ SetVideoMode function of the kylin operating system, and creating an image window through the SDL _ SetVideoMode function;
and processing the video code stream to be displayed on the created image window.
2. The image processing method according to claim 1, wherein the step of encoding the collected screen image displayed in the image window of the kylin operating system and transmitting the encoded screen image to other conference terminals comprises:
converting a screen image displayed by an image window of the kylin operating system from a first format to a second format;
and calling an image coding function to code the converted screen image and sending the coded image information to other conference terminals.
3. The image processing method according to claim 2, wherein the first format is an RGB format and the second format is a YUV format.
4. An image processing apparatus of a conference terminal, characterized by comprising:
the first calling unit is used for calling an XopenDisplay function in the kylin operating system and opening an image window of the kylin operating system through the XopenDisplay function;
the first acquisition unit is used for acquiring configuration parameters of an image window of the kylin operating system; the configuration parameter is configuration parameter information of a display corresponding to the image window;
the second calling unit is used for calling an XGetImage function in the kylin operating system and acquiring a screen image displayed on an image window of the kylin operating system by using the configuration parameters through the XGetImage function;
the coding unit is used for coding the acquired screen image displayed by the window of the kylin operating system and sending the screen image to other conference terminals;
the decoding unit is used for receiving video images sent by other conference terminals and decoding the video images;
a third calling unit, configured to call an SDL _ Init function of the kylin operating system, and initialize the decoded video code stream through the SDL _ Init function;
a fourth calling unit, configured to call an SDL _ SetVideoMode function of the kylin operating system, and create an image window through the SDL _ SetVideoMode function;
and the processing unit is used for processing the video code stream so as to display the video code stream on the created image window.
5. The image processing apparatus according to claim 4, wherein the encoding unit includes:
the conversion unit is used for converting the screen image displayed by the image window of the kylin operating system from a first format to a second format;
and the fifth calling unit is used for calling an image coding function so as to code the converted screen image and send the coded image information to other conference terminals.
6. The image processing apparatus according to claim 5, wherein the first format is an RGB format, and the second format is a YUV format.
7. A conference terminal, comprising: at least one processor; and a memory communicatively coupled to the at least one processor; wherein the memory stores instructions executable by the one processor to cause the at least one processor to perform the image processing method of any one of claims 1 to 3.
8. A non-transitory computer-readable storage medium storing computer instructions for causing a computer to execute the image processing method according to any one of claims 1 to 3.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710422856.1A CN107241199B (en) | 2017-06-07 | 2017-06-07 | Image processing method and device for conference terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710422856.1A CN107241199B (en) | 2017-06-07 | 2017-06-07 | Image processing method and device for conference terminal |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107241199A CN107241199A (en) | 2017-10-10 |
| CN107241199B true CN107241199B (en) | 2021-04-13 |
Family
ID=59986764
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710422856.1A Active CN107241199B (en) | 2017-06-07 | 2017-06-07 | Image processing method and device for conference terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107241199B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112738427B (en) * | 2020-12-04 | 2022-07-08 | 麒麟软件有限公司 | SM768 multi-channel video self-adaptive output method |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106534764A (en) * | 2015-09-09 | 2017-03-22 | 阎哲 | H264 coding-based embedded remote monitoring system |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030191860A1 (en) * | 2002-04-05 | 2003-10-09 | Gadepalli Krishna K. | Accelerated collaboration of high frame rate applications |
-
2017
- 2017-06-07 CN CN201710422856.1A patent/CN107241199B/en active Active
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106534764A (en) * | 2015-09-09 | 2017-03-22 | 阎哲 | H264 coding-based embedded remote monitoring system |
Non-Patent Citations (2)
| Title |
|---|
| 基于DaVinci平台和嵌入式Linux***构建图形桌面环境;王丹;《中国优秀硕士学位论文全文数据库》;20090430;摘要，正文17-18页，34-37页 * |
| 王丹.基于DaVinci平台和嵌入式Linux***构建图形桌面环境.《中国优秀硕士学位论文全文数据库》.2009,摘要，正文17-18页，34-37页. * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107241199A (en) | 2017-10-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9013536B2 (en) | Augmented video calls on mobile devices | |
| US5970233A (en) | Multiple codecs for video encoding format compatibility | |
| JP6338688B2 (en) | Video synchronized playback method, apparatus, and system | |
| WO2019210822A1 (en) | Video encoding and decoding method, device, and system, and storage medium | |
| US20190208161A1 (en) | Video signal transmission method and device | |
| CN107357585B (en) | Video acquisition method and device, video equipment and storage medium | |
| CN110636305B (en) | Image rendering and encoding method and related device | |
| WO2020135357A1 (en) | Data compression method and apparatus, and data encoding/decoding method and apparatus | |
| CN114786040B (en) | Data communication method, system, electronic device and storage medium | |
| CN111147801A (en) | Video data processing method and device for video networking terminal | |
| CN108616711A (en) | A kind of exchange method solving information network isolation based on vision signal | |
| CN111385518B (en) | Video processing system, video processing method, video processing device, storage medium, and electronic device | |
| WO2021147464A1 (en) | Video processing method and apparatus, and electronic device | |
| CN107241199B (en) | Image processing method and device for conference terminal | |
| WO2021147463A1 (en) | Video processing method and device, and electronic apparatus | |
| CN110719484B (en) | Image processing method | |
| CN113141352A (en) | Multimedia data transmission method and device, computer equipment and storage medium | |
| CN114938408B (en) | Data transmission method, system, equipment and medium of cloud mobile phone | |
| CN114245027B (en) | Video data hybrid processing method, system, electronic equipment and storage medium | |
| US20060139445A1 (en) | Multiple-picture out method and system | |
| CN114827620A (en) | Image processing method, apparatus, device and medium | |
| WO2021169817A1 (en) | Video processing method and electronic device | |
| US20210360236A1 (en) | System and method for encoding a block-based volumetric video having a plurality of video frames of a 3d object into a 2d video format | |
| CN110740286A (en) | video conference control method, multipoint control unit and video conference terminal | |
| WO2021217428A1 (en) | Image processing method and apparatus, photographic device and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP03 | Change of name, title or address |
Address after: No. 92 Zijin Road, Suzhou High tech Zone, Suzhou City, Jiangsu Province, 215011 Patentee after: SUZHOU KEDA SPECIAL VIDEO Co.,Ltd. Country or region after: China Address before: No.131, Jinshan East Road, high tech Zone, Changzhou City, Jiangsu Province, 215011 Patentee before: SUZHOU KEDA SPECIAL VIDEO Co.,Ltd. Country or region before: China |
|
| CP03 | Change of name, title or address |