HIGHLY PARALLEL PROCESSING SYSTEM

Abstract

Disclosed is a highly parallel processing system for processing graphics applications written in a high-level programming language. The high-performance computing architecture includes a graphics processing unit with numerous processing cores, such as hundreds to thousands of processing cores. The graphics processing unit includes routines written in a low-level programming language. The routines of the graphics processing unit are invoked to process highly computational intensive tasks by the numerous processing cores in parallel.

Claims

1. A highly parallel processing system comprising: a central processing unit (CPU), the CPU is configured to run an application; a highly parallel processing unit (HPPU) comprising an array of at least hundreds of parallel processing cores, libraries of graphics codes written in a low-level programming language; and wherein the CPU calls the HPPU for execution of highly computational intensive tasks of the application in parallel.

2. The highly parallel processing system of claim 1 wherein the HPPU comprises a graphics processing unit (GPU).

3. The highly parallel processing system of claim 2 wherein the array of processing cores comprises Compute Unified Device Architecture (CUDA) cores.

4. The highly parallel process system of claim 2 the low-level programming language of the graphics codes comprises Vulkan.

5. The highly parallel processing system of claim 1 wherein the array of processing cores comprises thousands of processing cores.

6. The highly parallel processing system of claim 1 wherein the execution of the highly computational intensive tasks are accelerated by thousands of parallel threads running on processing cores of the HPPU.

7. The highly parallel processing system of claim 1 wherein the graphics codes are for performing heavy intensive computational computer vision tasks.

8. The highly parallel processing system of claim 7 wherein the heavy intensive computational computer vision tasks includes classification, objection detection, 3D computer graphics and modeling tasks.

9. The highly parallel processing system of claim 4 wherein the graphics codes are for performing heavy intensive computational computer vision tasks.

10. The highly parallel processing system of claim 9 wherein the heavy intensive computational computer vision tasks includes classification, objection detection, 3D computer graphics and modeling tasks.

11. A method for highly parallel processing of a software application comprising; running the software application by a CPU; calling a HPPU comprising an array of at least hundreds of parallel processing cores and libraries of graphics codes written in a low-level programming language for executing the highly intensive computational tasks of the software application in parallel by the numerous processing cores using the graphics codes; and returning results of the highly intensive computational tasks to the CPU.

12. The method of claim 11 wherein the HPPU comprises a graphics processing unit (GPU).

13. The method of claim 12 wherein the array of processing cores comprises Compute Unified Device Architecture (CUDA) cores.

14. The method of claim 12 wherein the low-level programming language of the graphics codes comprises Vulkan.

15. The method of claim 13 wherein the array of processing cores comprises thousands of CUDA processing cores.

16. The method of claim 11 wherein executing the highly computational intensive tasks are accelerated by thousands of parallel threads running on the processing cores of the HPPU.

17. The method of claim 11 wherein the graphics codes are for performing heavy intensive computational computer vision tasks.

18. The method of claim 17 wherein the heavy intensive computational computer vision tasks includes classification, objection detection, 3D computer graphics and modeling tasks.

19. The method of claim 14 wherein the graphics codes are for performing heavy intensive computational computer vision tasks.

20. The method of claim 19 wherein the heavy intensive computational computer vision tasks includes classification, objection detection, 3D computer graphics and modeling tasks.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

[0010] In the drawings, like reference characters generally refer to the same parts throughout the different views. Also, the drawings are not necessarily to scale, emphasis instead generally being placed upon illustrating the principles of the invention. In the following description, various embodiments of the present disclosure are described with reference to the following drawings, in which:

[0011] FIG. 1 shows a simplified diagram of an embodiment of a high-speed processing system; and

[0012] FIG. 2 shows an exemplary pseudo-code residing in a graphics processing unit (GPU).

DETAILED DESCRIPTION

[0013] Embodiments described herein generally relate to highly parallel processing systems. For example, embodiments relate to high-speed processing architectures. Highly parallel processing systems are particularly useful for processing computer vision and 3D graphics applications which include graphics, including 3D graphics.

[0014] FIG. 1 shows a block diagram of an embodiment of a highly parallel processing system 100. The highly parallel processing system includes a central processing unit (CPU) 110. The CPU, for example, runs a software application written in a high-level programming language (high-level App). The high-level application may be written in various high-level programming languages, such as C++, Java, JS, Python, as well as other high-level programming languages. The high-level App, for example, may be a 3D graphics or computer vision application. The high-level App may include a user interface (UI) as well as other functions. For example, the high-level App may issue calls to the application programming interfaces (APIs). Other types of applications may also be useful.

[0015] In one embodiment, the highly parallel processing system includes a highly parallel processing unit (HPPU) 120. The HPPU, in one embodiment, is a graphics processing unit (GPU). Other types of HPPUs may also be useful. The HPPU, for example, may be an application specific integrated circuit (ASIC) or field programmable gate array (FPGA) based processing unit. HPPUs may also include, for example, Tensor Processing Units (TPUs), Neural Processing Units (NPUs) as well as other types of massively parallel processing units in the form of software and chipsets.

[0016] In one embodiment, the GPU includes an array 130 of hundreds to thousands of processing cores 135, such as Compute Unified Device Architecture (CUDA) cores 135. Graphics codes or routines 140 are provided within the framework of the GPU. For example, the GPU framework includes libraries of graphics codes. The graphics codes are employed for various heavy intensive computational computer vision tasks, including classification, objection detection, 3D computer graphics and modeling tasks. In one embodiment, the graphics codes are written in a low-level programming language. For example, the low-level graphics routines are written using native APIs, such as Vulkan. Other low-level programming languages may also be employed, depending on, for example, the type of HPPU. The codes are processed across thousands of parallel cores.

[0017] The CPU, when it encounters heavy computational tasks while running the high-level App, invokes the GPU. For example, the CPU makes calls to the GPU, invoking the codes for parallel processing of the tasks across the thousands of cores. When the tasks are completed, the GPU returns the results to the CPU.

[0018] FIG. 2 shows exemplary pseudo-codes 200 residing in the HPPU. For example, the codes are written in a low-level programming language, such as Vulkan in the case of a GPU.

[0019] As described, the HPPU enables massively parallel applications to be created. For example, utilizing high-performance codes written in a low-level programming language, the tasks are accelerated by thousands of parallel threads running on cores. As such, execution of computation—and bandwidth-hungry graphics applications is accelerated with the present highly parallel processing system. The highly parallel processing system with the libraries and frameworks of codes underpin the ongoing revolution in artificial intelligence known as Deep Learning.

[0020] The inventive concept of the present disclosure may be embodied in other specific forms without departing from the spirit or essential characteristics thereof. The foregoing embodiments, therefore, are to be considered in all respects illustrative rather than limiting the invention described herein.