CN111506419B - GPU resource sharing method and device - Google Patents

GPU resource sharing method and device Download PDF

Info

Publication number
CN111506419B
CN111506419B CN202010164599.8A CN202010164599A CN111506419B CN 111506419 B CN111506419 B CN 111506419B CN 202010164599 A CN202010164599 A CN 202010164599A CN 111506419 B CN111506419 B CN 111506419B
Authority
CN
China
Prior art keywords
virtual machine
resources
gpu physical
gpu
physical resources
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202010164599.8A
Other languages
Chinese (zh)
Other versions
CN111506419A (en
Inventor
郭彦辉
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
BEIJING LIANCHUANG XINAN TECHNOLOGY CO LTD
Original Assignee
BEIJING LIANCHUANG XINAN TECHNOLOGY CO LTD
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by BEIJING LIANCHUANG XINAN TECHNOLOGY CO LTD filed Critical BEIJING LIANCHUANG XINAN TECHNOLOGY CO LTD
Priority to CN202010164599.8A priority Critical patent/CN111506419B/en
Publication of CN111506419A publication Critical patent/CN111506419A/en
Application granted granted Critical
Publication of CN111506419B publication Critical patent/CN111506419B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/50Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5005Allocation of resources, e.g. of the central processing unit [CPU] to service a request
    • G06F9/5027Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/455Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
    • G06F9/45533Hypervisors; Virtual machine monitors
    • G06F9/45558Hypervisor-specific management and integration aspects
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/455Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
    • G06F9/45533Hypervisors; Virtual machine monitors
    • G06F9/45558Hypervisor-specific management and integration aspects
    • G06F2009/4557Distribution of virtual machine instances; Migration and load balancing

Landscapes

  • Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Debugging And Monitoring (AREA)
  • Stored Programmes (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)

Abstract

The invention relates to a GPU resource sharing method and device, wherein the method comprises the steps of comparing GPU physical resource requirements of a virtual machine with unallocated resources in a resource pool; if the unallocated resources in the resource pool do not meet the GPU physical resource requirements of the virtual machine, adjusting the GPU physical resources allocated to the virtual machine according to the GPU physical resource utilization rate allocated to the virtual machine, and allocating the GPU physical resources to the virtual machine according to the unallocated resources in the adjusted resource pool; otherwise, GPU physical resources are allocated to the virtual machine according to GPU physical resource requirements of the virtual machine. The GPU resource sharing method and device provided by the invention can realize that a plurality of virtual machines directly use GPU resources, thereby improving the computing capacity of the virtual machines and effectively improving the utilization rate of the GPU resources.

Description

GPU resource sharing method and device
Technical Field
The invention belongs to the technical field of resource sharing, and particularly relates to a GPU resource sharing method and device.
Background
With the rapid development of technology, in order to meet the increasing computing demands, each laboratory has more and more outstanding computing demands, and the common scientific research laboratory cannot configure GPU equipment for each person, so that sGPU technology solves the difficulty of GPU sharing use.
The current technology for realizing GPU resource sharing includes a GPU virtualization technology and a GPU direct-through technology. The GPU direct connection technology can only be used by binding to one virtual machine, the single virtual machine completely monopolizes GPU equipment, other virtual machines cannot be used, resources of the GPU cannot be completely used by the single virtual machine, and great resource waste is caused. GPU virtualization technology is used for virtualizing a plurality of GPU devices to be distributed to a plurality of virtual machines, GPU resource distribution occupation is consistent, and in addition, the limitation of IO virtualization performance problem is added, so that reasonable resource distribution and effective resource utilization cannot be achieved.
Disclosure of Invention
Aiming at the defects of the prior art, the invention provides the GPU resource sharing method and the GPU resource sharing device, which directly allocate GPU physical resources to a virtual machine for use, can fully exert the physical properties of a graphics card, simultaneously allocate the GPU resources to multiple people for common use, and effectively improve the utilization rate of the GPU resources.
The invention aims at adopting the following technical scheme:
in a method for GPU resource sharing, the improvement comprising:
comparing GPU physical resource requirements of the virtual machine with unallocated resources in a resource pool;
If the unallocated resources in the resource pool do not meet the GPU physical resource requirements of the virtual machine, adjusting the GPU physical resources allocated to the virtual machine according to the GPU physical resource utilization rate allocated to the virtual machine, and allocating the GPU physical resources to the virtual machine according to the unallocated resources in the adjusted resource pool;
otherwise, GPU physical resources are allocated to the virtual machine according to GPU physical resource requirements of the virtual machine.
Preferably, the adjusting the GPU physical resources allocated to the virtual machine according to the GPU physical resource utilization ratio allocated to the virtual machine includes:
If the utilization rate of the GPU physical resources by the virtual machine is not 100%, reducing the distribution percentage of the GPU physical resources of the virtual machine until the utilization rate of the GPU physical resources by the virtual machine is 90%, and marking the GPU physical resources released in the reduction process as unallocated resources;
If the utilization rate of the GPU physical resources by the virtual machine reaches 100%, the distribution percentage of the GPU physical resources of the virtual machine is increased until the utilization rate of the GPU physical resources by the virtual machine reaches 90%, and the GPU physical resources occupied in the increasing process are marked as distributed resources.
Preferably, the allocating GPU physical resources to the virtual machine according to the unallocated resources in the adjusted resource pool includes:
if the unallocated resources in the adjusted resource pool meet the GPU physical resource requirements of the virtual machine, allocating GPU physical resources to the virtual machine according to the GPU physical resource requirements of the virtual machine;
And if the unallocated resources in the adjusted resource pool still do not meet the GPU physical resource requirements of the virtual machine, sending alarm information to the virtual machine.
Preferably, the allocating GPU physical resources to the virtual machine according to GPU physical resource requirements of the virtual machine includes:
Determining a GPU physical resource allocation percentage for the virtual machine based on GPU physical resource requirements of the virtual machine;
Distributing GPU physical resources with corresponding percentages in the resource pool to corresponding virtual machines;
marking the allocated resources and unallocated resources in the resource pool;
The resource pool is formed by pooling GPU physical resources.
Preferably, the determining the GPU physical resource allocation percentage for the virtual machine based on the GPU physical resource requirement of the virtual machine includes:
And taking the ratio of the GPU physical resource requirement of the virtual machine sending the requirement response to all resources in the resource pool as the distribution percentage of the GPU physical resources of the virtual machine.
Based on the same inventive concept, the invention also provides a GPU resource sharing device, which is improved in that the device comprises:
The comparison unit is used for comparing the GPU physical resource requirement of the virtual machine with unallocated resources in the resource pool; when the unallocated resources in the resource pool do not meet the GPU physical resource requirements of the virtual machine, jumping to an adjusting unit; otherwise, jumping to a second distribution unit;
the adjusting unit is used for adjusting the GPU physical resources allocated to the virtual machine according to the utilization rate of the GPU physical resources allocated to the virtual machine;
the first allocation unit allocates GPU physical resources to the virtual machine according to the unallocated resources in the resource pool adjusted by the adjustment unit;
and the second allocation unit is used for allocating GPU physical resources to the virtual machine according to the GPU physical resource requirements of the virtual machine.
Preferably, the adjusting unit is specifically configured to:
If the utilization rate of the GPU physical resources by the virtual machine is not 100%, reducing the distribution percentage of the GPU physical resources of the virtual machine until the utilization rate of the GPU physical resources by the virtual machine is 90%, and marking the GPU physical resources released in the reduction process as unallocated resources;
If the utilization rate of the GPU physical resources by the virtual machine reaches 100%, the distribution percentage of the GPU physical resources of the virtual machine is increased until the utilization rate of the GPU physical resources by the virtual machine reaches 90%, and the GPU physical resources occupied in the increasing process are marked as distributed resources.
Preferably, the first dispensing unit is further specifically configured to:
If the unallocated resources in the adjusted resource pool meet the GPU physical resource requirements of the virtual machine, jumping to a second allocation unit;
And if the unallocated resources in the adjusted resource pool still do not meet the GPU physical resource requirements of the virtual machine, sending alarm information to the virtual machine.
Preferably, the second distributing unit includes:
the computing subunit is used for determining the distribution percentage of the GPU physical resources of the virtual machine based on the GPU physical resource requirements of the virtual machine;
The allocation subunit is used for allocating the GPU physical resources with corresponding percentages in the resource pool to the corresponding virtual machines according to the allocation percentages of the GPU physical resources to the virtual machines;
a marking subunit, configured to mark allocated resources and unallocated resources in the resource pool;
the resource pool is formed by pooling GPU physical resources.
Preferably, the computing subunit is specifically configured to:
And taking the ratio of the GPU physical resource requirement of the virtual machine sending the requirement response to all resources in the resource pool as the distribution percentage of the GPU physical resources of the virtual machine.
Compared with the closest prior art, the invention has the following beneficial effects:
The invention provides a GPU resource sharing method and device, comprising the steps of comparing GPU physical resource requirements of a virtual machine with unallocated resources in a resource pool; if the unallocated resources in the resource pool do not meet the GPU physical resource requirements of the virtual machine, adjusting the GPU physical resources allocated to the virtual machine according to the GPU physical resource utilization rate allocated to the virtual machine, and allocating the GPU physical resources to the virtual machine according to the unallocated resources in the adjusted resource pool; otherwise, GPU physical resources are allocated to the virtual machine according to GPU physical resource requirements of the virtual machine. The GPU resource sharing method and device provided by the invention can realize that a plurality of virtual machines directly use GPU resources, thereby improving the computing capacity of the virtual machines and effectively improving the utilization rate of the GPU resources.
Drawings
FIG. 1 is a flowchart of a GPU resource sharing method according to the present invention;
FIG. 2 is a schematic diagram of a GPU resource allocation percentage in an embodiment;
FIG. 3 is a diagram of a GPU resource sharing device according to the present invention.
Detailed Description
The following describes the embodiments of the present invention in further detail with reference to the drawings.
For the purpose of making the objects, technical solutions and advantages of the embodiments of the present invention more apparent, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention, and it is apparent that the described embodiments are some embodiments of the present invention, but not all embodiments of the present invention. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
In order to solve the problem of low GPU resource utilization rate caused by excessive or insufficient GPU resource allocation, the invention provides a GPU resource sharing method, as shown in FIG. 1, comprising the following steps:
comparing GPU physical resource requirements of the virtual machine with unallocated resources in a resource pool;
If the unallocated resources in the resource pool do not meet the GPU physical resource requirements of the virtual machine, adjusting the GPU physical resources allocated to the virtual machine according to the GPU physical resource utilization rate allocated to the virtual machine, and allocating the GPU physical resources to the virtual machine according to the unallocated resources in the adjusted resource pool;
otherwise, GPU physical resources are allocated to the virtual machine according to GPU physical resource requirements of the virtual machine.
For the purpose of illustrating the invention more clearly, the method of the invention is further explained below in connection with specific examples:
In an embodiment of the present invention, adjusting the GPU physical resources allocated to the virtual machine according to the GPU physical resource utilization allocated to the virtual machine may include:
If the utilization rate of the GPU physical resources by the virtual machine is not 100%, reducing the distribution percentage of the GPU physical resources of the virtual machine until the utilization rate of the GPU physical resources by the virtual machine is 90%, and marking the GPU physical resources released in the reduction process as unallocated resources;
If the utilization rate of the GPU physical resources by the virtual machine reaches 100%, the distribution percentage of the GPU physical resources of the virtual machine is increased until the utilization rate of the GPU physical resources by the virtual machine reaches 90%, and the GPU physical resources occupied in the increasing process are marked as distributed resources.
In an embodiment of the present invention, allocating GPU physical resources to a virtual machine according to unallocated resources in an adjusted resource pool may include:
if the unallocated resources in the adjusted resource pool meet the GPU physical resource requirements of the virtual machine, allocating GPU physical resources to the virtual machine according to the GPU physical resource requirements of the virtual machine;
And if the unallocated resources in the adjusted resource pool still do not meet the GPU physical resource requirements of the virtual machine, sending alarm information to the virtual machine.
In an embodiment of the present invention, allocating GPU physical resources to a virtual machine according to GPU physical resource requirements of the virtual machine may include:
Determining a GPU physical resource allocation percentage for the virtual machine based on GPU physical resource requirements of the virtual machine;
Distributing GPU physical resources with corresponding percentages in the resource pool to corresponding virtual machines;
marking the allocated resources and unallocated resources in the resource pool;
the resource pool is formed by pooling GPU physical resources in advance, and the ratio of all resources in the resource pool in an initial state is marked with 100%.
In the embodiment of the invention, in order to make the use of the allocated resources not affected, the GPU physical resources of each virtual machine are also isolated by an isolation technology.
In an embodiment of the present invention, determining the GPU physical resource allocation percentage for the virtual machine based on the GPU physical resource requirements of the virtual machine may include:
Taking the ratio of the GPU physical resource requirement of the virtual machine sending the requirement response to all resources in the resource pool as the distribution percentage of the GPU physical resources of the virtual machine;
Wherein all resources in the resource pool include allocated resources and unallocated resources.
In the embodiment provided by the invention, as shown in fig. 2, the GPU physical resources of each virtual machine may be divided into 20%, 30% and 50% according to the GPU physical resource requirements of each virtual machine, and then the GPU resources with the divided percentages are allocated to the virtual machines with corresponding percentage requirements.
Based on the same inventive concept, the present invention also provides a GPU resource sharing device, as shown in fig. 3, including:
The comparison unit is used for comparing the GPU physical resource requirement of the virtual machine with unallocated resources in the resource pool; when the unallocated resources in the resource pool do not meet the GPU physical resource requirements of the virtual machine, jumping to an adjusting unit; otherwise, jumping to a second distribution unit;
the adjusting unit is used for adjusting the GPU physical resources allocated to the virtual machine according to the utilization rate of the GPU physical resources allocated to the virtual machine;
the first allocation unit allocates GPU physical resources to the virtual machine according to the unallocated resources in the resource pool adjusted by the adjustment unit;
and the second allocation unit is used for allocating GPU physical resources to the virtual machine according to the GPU physical resource requirements of the virtual machine.
In an embodiment of the present invention, the adjusting unit is specifically configured to:
If the utilization rate of the GPU physical resources by the virtual machine is not 100%, reducing the distribution percentage of the GPU physical resources of the virtual machine until the utilization rate of the GPU physical resources by the virtual machine is 90%, and marking the GPU physical resources released in the reduction process as unallocated resources;
If the utilization rate of the GPU physical resources by the virtual machine reaches 100%, the distribution percentage of the GPU physical resources of the virtual machine is increased until the utilization rate of the GPU physical resources by the virtual machine reaches 90%, and the GPU physical resources occupied in the increasing process are marked as distributed resources.
In an embodiment of the invention, the first distribution unit is specifically configured to:
If the unallocated resources in the adjusted resource pool meet the GPU physical resource requirements of the virtual machine, jumping to a second allocation unit;
And if the unallocated resources in the adjusted resource pool still do not meet the GPU physical resource requirements of the virtual machine, sending alarm information to the virtual machine.
In an embodiment of the present invention, the second allocation unit may include:
the computing subunit is used for determining the distribution percentage of the GPU physical resources of the virtual machine based on the GPU physical resource requirements of the virtual machine;
The allocation subunit is used for allocating the GPU physical resources with corresponding percentages in the resource pool to the corresponding virtual machines according to the allocation percentages of the GPU physical resources to the virtual machines;
a marking subunit, configured to mark allocated resources and unallocated resources in the resource pool;
the resource pool is formed by pooling GPU physical resources.
In an embodiment of the invention, the computing subunit is specifically configured to:
And taking the ratio of the GPU physical resource requirement of the virtual machine sending the requirement response to all resources in the resource pool as the distribution percentage of the GPU physical resources of the virtual machine.
In summary, the method and the device for sharing the GPU resources can realize that a plurality of virtual machines directly use the GPU resources, and improve the computing capacity of the virtual machines; the GPU resources can be dynamically adjusted according to the utilization rate of the virtual machine to the GPU physical resources, and the utilization rate of the GPU resources is effectively improved.
It will be appreciated by those skilled in the art that embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
Finally, it should be noted that: the above embodiments are only for illustrating the technical aspects of the present invention and not for limiting the same, and although the present invention has been described in detail with reference to the above embodiments, it should be understood by those of ordinary skill in the art that: modifications and equivalents may be made to the specific embodiments of the invention without departing from the spirit and scope of the invention, which is intended to be covered by the claims.

Claims (8)

1. A method for sharing GPU resources, comprising:
comparing GPU physical resource requirements of the virtual machine with unallocated resources in a resource pool;
If the unallocated resources in the resource pool do not meet the GPU physical resource requirements of the virtual machine, adjusting the GPU physical resources allocated to the virtual machine according to the GPU physical resource utilization rate allocated to the virtual machine, and allocating the GPU physical resources to the virtual machine according to the unallocated resources in the adjusted resource pool;
Otherwise, distributing GPU physical resources to the virtual machine according to GPU physical resource requirements of the virtual machine;
The adjusting the GPU physical resources allocated to the virtual machine according to the GPU physical resource utilization rate allocated to the virtual machine comprises:
If the utilization rate of the GPU physical resources by the virtual machine is not 100%, reducing the distribution percentage of the GPU physical resources of the virtual machine until the utilization rate of the GPU physical resources by the virtual machine is 90%, and marking the GPU physical resources released in the reduction process as unallocated resources;
If the utilization rate of the GPU physical resources by the virtual machine reaches 100%, the distribution percentage of the GPU physical resources of the virtual machine is increased until the utilization rate of the GPU physical resources by the virtual machine reaches 90%, and the GPU physical resources occupied in the increasing process are marked as distributed resources.
2. The method of claim 1, wherein the allocating GPU physical resources to the virtual machine based on unallocated resources in the adjusted resource pool comprises:
if the unallocated resources in the adjusted resource pool meet the GPU physical resource requirements of the virtual machine, allocating GPU physical resources to the virtual machine according to the GPU physical resource requirements of the virtual machine;
And if the unallocated resources in the adjusted resource pool still do not meet the GPU physical resource requirements of the virtual machine, sending alarm information to the virtual machine.
3. The method of claim 1 or 2, wherein the allocating GPU physical resources to the virtual machine according to GPU physical resource requirements of the virtual machine comprises:
Determining a GPU physical resource allocation percentage for the virtual machine based on GPU physical resource requirements of the virtual machine;
Distributing GPU physical resources with corresponding percentages in the resource pool to corresponding virtual machines;
marking the allocated resources and unallocated resources in the resource pool;
The resource pool is formed by pooling GPU physical resources.
4. The method of claim 3, wherein the determining the GPU physical resource allocation percentage for the virtual machine based on GPU physical resource requirements of the virtual machine comprises:
And taking the ratio of the GPU physical resource requirement of the virtual machine sending the requirement response to all resources in the resource pool as the distribution percentage of the GPU physical resources of the virtual machine.
5. A GPU resource sharing device, comprising:
The comparison unit is used for comparing the GPU physical resource requirement of the virtual machine with unallocated resources in the resource pool; when the unallocated resources in the resource pool do not meet the GPU physical resource requirements of the virtual machine, jumping to an adjusting unit; otherwise, jumping to a second distribution unit;
the adjusting unit is used for adjusting the GPU physical resources allocated to the virtual machine according to the utilization rate of the GPU physical resources allocated to the virtual machine;
the first allocation unit allocates GPU physical resources to the virtual machine according to the unallocated resources in the resource pool adjusted by the adjustment unit;
the second allocation unit is used for allocating GPU physical resources to the virtual machine according to GPU physical resource requirements of the virtual machine;
The adjusting unit is specifically configured to:
If the utilization rate of the GPU physical resources by the virtual machine is not 100%, reducing the distribution percentage of the GPU physical resources of the virtual machine until the utilization rate of the GPU physical resources by the virtual machine is 90%, and marking the GPU physical resources released in the reduction process as unallocated resources;
If the utilization rate of the GPU physical resources by the virtual machine reaches 100%, the distribution percentage of the GPU physical resources of the virtual machine is increased until the utilization rate of the GPU physical resources by the virtual machine reaches 90%, and the GPU physical resources occupied in the increasing process are marked as distributed resources.
6. The apparatus according to claim 5, wherein the first distribution unit is further specifically configured to:
If the unallocated resources in the adjusted resource pool meet the GPU physical resource requirements of the virtual machine, jumping to a second allocation unit;
And if the unallocated resources in the adjusted resource pool still do not meet the GPU physical resource requirements of the virtual machine, sending alarm information to the virtual machine.
7. The apparatus of claim 5 or 6, wherein the second distribution unit comprises:
the computing subunit is used for determining the distribution percentage of the GPU physical resources of the virtual machine based on the GPU physical resource requirements of the virtual machine;
The allocation subunit is used for allocating the GPU physical resources with corresponding percentages in the resource pool to the corresponding virtual machines according to the allocation percentages of the GPU physical resources to the virtual machines;
a marking subunit, configured to mark allocated resources and unallocated resources in the resource pool;
the resource pool is formed by pooling GPU physical resources.
8. The apparatus of claim 7, wherein the computing subunit is configured to:
And taking the ratio of the GPU physical resource requirement of the virtual machine sending the requirement response to the total resources of the resource pool as the distribution percentage of the GPU physical resources of the virtual machine.
CN202010164599.8A 2020-03-11 2020-03-11 GPU resource sharing method and device Active CN111506419B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010164599.8A CN111506419B (en) 2020-03-11 2020-03-11 GPU resource sharing method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010164599.8A CN111506419B (en) 2020-03-11 2020-03-11 GPU resource sharing method and device

Publications (2)

Publication Number Publication Date
CN111506419A CN111506419A (en) 2020-08-07
CN111506419B true CN111506419B (en) 2024-07-02

Family

ID=71863853

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010164599.8A Active CN111506419B (en) 2020-03-11 2020-03-11 GPU resource sharing method and device

Country Status (1)

Country Link
CN (1) CN111506419B (en)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101593134A (en) * 2009-06-29 2009-12-02 北京航空航天大学 Virtual machine cpu resource distribution method and device
CN103180830A (en) * 2012-08-31 2013-06-26 华为技术有限公司 Cpu resource distribution method and calculating node

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8103769B1 (en) * 2009-09-03 2012-01-24 Amazon Technologies, Inc. Dynamic isolation of shared resources
KR20120100833A (en) * 2011-03-04 2012-09-12 한국항공대학교산학협력단 Method and terminal for performing direct communication between terminals
CN105491569A (en) * 2014-09-19 2016-04-13 电信科学技术研究院 Spectrum resource distribution, acquisition method and device
CN105242957A (en) * 2015-09-28 2016-01-13 广州云晫信息科技有限公司 Method and system for cloud computing system to allocate GPU resources to virtual machine
CN105224805B (en) * 2015-10-10 2018-03-16 百度在线网络技术(北京)有限公司 Method for managing resource and device based on streaming computing
CN105589751B (en) * 2015-11-27 2019-03-15 新华三技术有限公司 A kind of physics resource scheduling method and device
CN107515786B (en) * 2017-08-04 2021-02-19 北京奇虎科技有限公司 Resource allocation method, master device, slave device and distributed computing system
US10394680B2 (en) * 2018-01-17 2019-08-27 Microsoft Technology Licensing, Llc Techniques for tracking graphics processing resource utilization
CN109213555B (en) * 2018-08-16 2020-04-10 北京交通大学 Resource dynamic scheduling method for virtual desktop cloud
CN109558210B (en) * 2018-11-21 2021-01-15 苏州浪潮智能科技有限公司 Method and system for virtual machine to apply GPU (graphics processing Unit) equipment of host

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101593134A (en) * 2009-06-29 2009-12-02 北京航空航天大学 Virtual machine cpu resource distribution method and device
CN103180830A (en) * 2012-08-31 2013-06-26 华为技术有限公司 Cpu resource distribution method and calculating node

Also Published As

Publication number Publication date
CN111506419A (en) 2020-08-07

Similar Documents

Publication Publication Date Title
CN108984264B (en) Virtual GPU (graphics processing Unit) implementation method, device and system
WO2018119952A1 (en) Device virtualization method, apparatus, system, and electronic device, and computer program product
US20160239333A1 (en) Apparatus and method for scheduling graphics processing unit workloads from virtual machines
CN109726005B (en) Method, server system and computer readable medium for managing resources
EP3195128B1 (en) Memory management in virtualized environment
CN102779074B (en) Internal memory resource distribution method based on internal memory hole mechanism
CN103577345A (en) Methods and structure for improved flexibility in shared storage caching by multiple systems
CN107077375B (en) Display method and device for multiple operating systems and electronic equipment
CN109712060B (en) Cloud desktop display card sharing method and system based on GPU container technology
WO2023093843A1 (en) Configuration device, scheduling device, configuration method, and scheduling method
CN104598298A (en) Virtual machine dispatching algorithm based on task load and current work property of virtual machine
US8352702B2 (en) Data processing system memory allocation
WO2016202154A1 (en) Gpu resource allocation method and system
JP2020503609A (en) Memory access method, apparatus and electronic equipment for multi-operating system
CN111104219A (en) Binding method, device, equipment and storage medium of virtual core and physical core
CN113821308A (en) System on chip, virtual machine task processing method and device, and storage medium
US20140089624A1 (en) Cooperation of hoarding memory allocators in a multi-process system
CN104156663B (en) A kind of hardware virtual port and processor system
CN106598696B (en) Method and device for data interaction between virtual machines
CN109558210B (en) Method and system for virtual machine to apply GPU (graphics processing Unit) equipment of host
US10996865B2 (en) Application-specific memory scaling in multi-device systems
CN111506419B (en) GPU resource sharing method and device
CN106775925B (en) Quota processing method and device for CPU of virtual machine
US10684900B2 (en) Enhanced message control banks
CN110447019B (en) Memory allocation manager and method for managing memory allocation performed thereby

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant