MOBILE DATA CENTER AND METHOD OF OPERATING THE SAME
20210092875 ยท 2021-03-25
Assignee
Inventors
Cpc classification
H05K7/20745
ELECTRICITY
International classification
H05K7/20
ELECTRICITY
Abstract
Mobile data center (10) comprising a plurality of computing modules (38, 40) to be air-cooled, a container (12) with an inner chamber for housing the plurality of computing modules, said container having four outer side walls, a bottom wall and a top wall, a plurality of air inlets (30, 32) to the inner chamber, at least two fans (34, 36) arranged for creating an air pressure gradient inside said inner chamber, and piping (52) arranged for guiding air through the inlets to the computing modules to be air-cooled when said air pressure gradient is created.
Claims
1. Mobile data center comprising: a plurality of computing modules to be air-cooled, a container, said container comprising an inner chamber for housing said plurality of computing modules, at least four outer side walls, a bottom wall and a top wall, a plurality of air inlets to the inner chamber, said air inlets arranged in the side walls of the container, and at least two fans for creating an air pressure gradient inside said inner chamber; piping arranged for guiding air through the air inlets to the computing modules to be air-cooled when said air pressure gradient is created, and a control unit controlling the operation of said at least two fans to create an air pressure gradient in said inner chamber causing ambient air to enter the inner chamber via said air inlets.
2. The mobile data center according to claim 1, wherein each computing module have/has at least one air inlet exclusively associated with it.
3. The mobile data center according to claim 1, wherein the air inlets are distributed in different outer side walls of the container.
4. The mobile data center according to claim 1, wherein each inlet is formed by an elbow pipe piece arranged with its outer end facing downwards on the outside of the container.
5. The mobile data center according to claim 1, further comprising at least one inner partition wall defining a partition between the inner chamber and an air intake chamber formed in the container, wherein at least some of the air inlets are distributed in the inner partition wall of the container.
6. The mobile data center according to claim 5, wherein said air intake chamber is formed by the partition wall, one outer side wall and adjacent portions of two other outer sidewalls, the bottom and the top wall and comprises at least one air intake opening having a larger effective intake area than the single air inlets to the inner chamber.
7. The mobile data center according to claim 1, wherein at least some of the computing modules are arranged in their own housings, each housing having an air inlet and an air outlet, said air inlet directly connected with at least one of the air inlets of the inner chamber and said air outlet communicating with the inside of the inner chamber.
8. The mobile data center according to claim 1, wherein the at least two fans are arranged in or attached to opposite side walls of the container.
9. (canceled)
10. Mobile data center according to claim 1, wherein said container is designed to be stackable with other containers.
11. Mobile data center according to claim 1, wherein said container is a standard ISO freight container, in particular a twenty foot ISO freight container or a forty foot ISO freight container.
12. (canceled)
13. (canceled)
14. The mobile data center according to claim 1, wherein at least some of the computing modules are ASIC miners or GPU miners.
15. Mobile data center according to claim 14, comprising ASIC miners, wherein each ASIC miner is arranged in its own housing, said housing having at least one air inlet of the inner chamber exclusively associated with it.
16. Mobile data center according to claim 14, comprising GPU miners, each GPU miner comprising a plurality of graphic cards arranged in parallel on a support, each GPU miner being directly connected to a plurality of air inlets of the inner chamber, in particular to two to four air inlets and preferably to three air inlets.
17. (canceled)
18. (canceled)
19. (canceled)
20. (canceled)
21. (canceled)
22. Mobile data center according to claim 1, further comprising one or more sensors for determining at least one of the temperature in said inner chamber, the temperature outside said container, the power consumption of the operating computing modules, the air pressure in said inner chamber, the air pressure outside said container, the speed of the propellers of the fans, the volume flow created by the fans, the humidity in said inner chamber or in an air inlet of said inner chamber, the humidity outside said container.
23. Mobile data center according to claim 1, further comprising automatically controllable throttle valves in at least some of the air inlets of the inner chamber and/or, if present, in the air intake opening of the air intake chamber, said control unit controlling the operation of said throttle valves.
24. (canceled)
25. (canceled)
26. (canceled)
27. (canceled)
28. A method of operating a mobile data center comprising a plurality of computing modules to be air-cooled, a container with an inner chamber for housing the plurality of computing modules, a plurality of air inlets to the inner chamber, at least two fans arranged for creating an air pressure gradient in the inner chamber, and piping arranged for guiding air through the inlets to the computing modules to be air-cooled, comprising a step of operating said at least two fans to create an air pressure gradient in said inner chamber causing ambient air to enter the inner chamber via said air inlets.
29. The method according to claim 28, comprising monitoring the operational status of each fan and increasing the volume flow of at least one of the at least two fans if the volume flow of at least one of the at least two fans drops.
30. The method according to claim 28, further comprising monitoring the air pressure gradient created by said fans and reversing the direction of operation of said fans for a limited time period when said air pressure gradient exceeds a predetermined threshold value.
31. (canceled)
32. (canceled)
33. The method according to claim 28, further comprising monitoring at least one of the following physical properties: temperature inside said inner chamber, temperature outside said container, air pressure in said inner chamber, air pressure outside said container, speed of the propellers of the fans, volume flow created by the fans, humidity in said inner chamber or in an air inlet of said inner chamber, humidity outside said container; and controlling at least one of the volume flow created by said fans and the current computing power performed by the computing modules taking into account the at least one monitored physical property.
34. The method according to claim 33, further comprising controlling throttle valves provided in at least some of the air inlets and/or in, if present, an air intake opening in the container for closing and opening said air inlets and/or said air intake opening.
35. (canceled)
36. (canceled)
Description
BRIEF DESCRIPTION OF THE DRAWING
[0022]
[0023]
[0024]
[0025]
[0026]
[0027]
[0028]
DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS AND IMPLEMENTATIONS
[0029]
[0030] One of the side walls, in this case side wall 20, is formed by two door wings 26 and 28. It should be noted that as a side wall can be formed by door wings or may comprise at least one door, the term in a wall of the container as used in this description and in the claims also denotes that something is provided in a door wing or a door that may be present in a wall of the container.
[0031] The container 12 is provided with numerous air inlets 30 and 32, of which only some are provided with reference numbers for sake of clarity. As in this embodiment the outer walls of the container form the inner chamber, i.e. the inside of the container 12 is the inner chamber, the air inlets 30 and 32 form air inlets to the inner chamber. In this embodiment, each air inlet 30 and 32 comprises an elbow pipe piece arranged with its outer end facing downwards on the outside of the container 12.
[0032] The air inlets 30 and 32 may be provided with wire meshes and/or filters depending on the ambient conditions, in which the container 12 shall be placed. Whereas wire meshes generally do not influence the air flow to a substantial degree, filters such as sand or dust filters may obstruct the air flow and hence it may be necessary to increase the air pressure difference between the inside and the outside of the container to ensure the same air flow rate in case the air inlets are provided with such filters compared to a case where no such filters are present. Creating such air flow will be described later. Embodiments of the invention advantageously allow the user of the mobile data center to decide depending on the ambient conditions, whether or not filters shall be foreseen. In some cases, it may be fully sufficient to protect the equipment inside the container from insects and particles by providing the air inlets with fine wire meshes that do not substantially hinder the air flow. Such wire meshes and/or filters may be provided at any convenient location, e.g. at the free end of the elbow pipes or in the air inlets or they may from a transition from an air inlet to the piping distributing the air entering the container.
[0033] At least some of the air inlets 30 and 32 and/or some of the piping may further be provided with automatically controllable throttle valves for controlling the air flow through the respective air inlets and the piping, which may be useful in certain circumstances as will be described later.
[0034] Two fans 34 and 36 are arranged on opposite side walls 14 and 18 of the container 12 for creating an air pressure gradient in the container 12. For a typical twenty foot ISO freight container, it has turned out that two fans having propellers with diameters in the region of 400 to 500 mm and a maximum power in the region of 150 to 400 W such that each fan may create a volume flow in the region of about 4.000 to 8.000 m.sup.3/h are perfectly sufficient for ensuring sufficient cooling of computing modules typically arranged in the container, provided that the computing modules are arranged according to the invention such that the air entering the container 12 via the air inlets 30 respectively 32 is directed to the computing modules. This arrangement will be described later.
[0035] In the embodiment shown in
[0036]
[0037] In this embodiment, four groups of three computing modules 40 are arranged in the four upper corner areas of the container. These computing modules 40 may be ASIC miners, which typically come in individual cuboid housings such as the ones shown in the drawing. The housings have openings on two opposite end faces sides for blowing air through the housings. In operation, ambient air is introduced into the housings on one end through a respective one of the air inlets 32 and piping in form of a funnel like adapter 52. The air leaves each housing on the respective other end, which communicates with the inside of the container.
[0038] Eight groups of six computing modules 38 are arranged on eight racks, each rack comprising three shelves. Pairs of two computing modules 38 are arranged with their main axis aligned on each shelve. As explained, neither the racks nor the shelves are shown. What is shown are the upper pairs of rails 44 and 46, each pair guiding a group of four racks, which can be moved along the rails in a known fashion by turning a very schematically depicted handwheel 54 provided on each rack. Such rack systems are typically used in archives and libraries and can advantageously be used in the data center to move the racks along the rails for maintenance and installation purposes. In a preferred embodiment, the shelves of each rack are slightly shifted in height with respect to the shelves of a neighboring rack, which ensures that if computing modules of the same construction type are arranged on neighboring shelves, the hot regions of neighboring computing modules are slightly shifted. An example of such arrangement is depicted in
[0039] In an actual embodiment, the computing modules 38 schematically indicated by cuboid boxes correspond to GPU miners, each miner comprising a plurality of graphic cards on a support. Unlike the drawing suggests, such GPU miners may not necessarily be provided in a separate housing, but may have a rather open structure. In such case, the air inlets 32 are not needed and each GPU miner is supplied with air via three air inlets 30. Typically, computing modules of this type will be directly connected to a plurality of air inlets of the container, in particular to two to four air inlets. The piping is such that airstreams parallel to the graphic cards are created.
[0040] Each graphic card has two main surfaces called sides, one of which being called the hot side, on which the electronic devices that during operation get hot are arranged, and the other one being called the cold side. In a preferred embodiment the graphic cards in such GPU miner are arranged in parallel such that where possible, two hot sides and two cold sides face each other while the distance between the hot sides of the cards is maximized and the distance between the cold sides is minimized, i.e. pairs of cards are arranged close together with their cold sides facing each other and their hot sides facing in opposite directions towards, if present, the hot sides of other cards further apart. In operation, air will mainly flow through the space created between the hots sides, and the space between the cold sides may even be closed for airstreams.
[0041] Of the piping used for guiding the air from the air inlets to the computing modules, only some is shown. For example, the air inlets arranged to form a second, a fourth and a sixth row of air inlets 30 as seen from the bottom wall 22 of the container look as if they would terminate either above or in one of the computing modules 38 placed on a rack close to the side wall of the container, in which the respective air inlets are provided. In fact, piping (not shown in
[0042] In this embodiment, the mobile data center comprises two power distribution and control units 48 and 50 from which power input via power connectors 42, of which only some are provided with reference numbers, arranged on the outside of the container is distributed to the fans 34 and 36, to the computing modules 38 and 40, and to any other electrical equipment that may be present in the mobile data center. The control units 48 and 50 preferably also comprise hardware for controlling the operation of the mobile data center, e.g. PID controllers for the fans and optionally also for the computing modules as it may in certain cases be advantageous not only to control the speed of the fans and hence the volume flow created but also to adjust the calculation speed and hence the power consumed and the heat created by the computing modules.
[0043] If throttle valves are provided for opening/closing at least certain air inlets, these throttle valves may also be controlled by the control unit 48 and 50 or remotely. For example, if a mobile data center is placed outdoors and it is via respective sensors or by an (remote) operator detected that there is heavy rain or a sand storm, it may be expedient to decrease the air pressure gradient in the container, i.e. to turn down the speed of the fans to prevent that humidity or sand is drawn into the container. To avoid overheating in such circumstances, as less cooling air will be directed to the computing modules, it is possible to decrease the computing power such that less heat is generated during operation of the computing modules.
[0044] In a preferred embodiment, respective PID controllers, in which e.g. the current temperature in the container and the air pressure difference between the inside of the container and the ambient air is input, may be set up to output values of voltage supplied to the fans to control the speed of their propellers and the computing power of the computing modules, e.g. by decreasing their hash rate, which is proportional to the head created by the computing modules. The power distribution may be controlled for example by small e.g. Linux-based server systems and chip-based microcontrollers.
[0045] The power connections of the individual power supply units of the computing modules may be controlled using a set of solid state relays that are triggered using e.g. the general purpose in-out pins of a server-connected control board or of a raspberry single-pcb-computer, which in turn are controlled e.g. using node.js-based applications and access via http-served dash boards.
[0046] The control units 48 and 50 may have a redundant layout, i.e. they may be designed and connected to back-up each other such that in case one of the units fails, the other may still be able to control the mobile data center and in particular the power distribution to the computing modules and to the fans.
[0047] The control units 48 and 50 preferably also comprise hardware for executing special startup and/or shutdown routines and maintenance operations such as for example an air inlet cleaning mode, in which the turning direction of the fans is reversed to increase the air pressure in the container and to blow air out of the container via the air inlets to free the air inlets and in particular any wire meshes and filters in the air inlets from particles and other impurities that may obstruct the air flow into the container. For this purpose, the mobile data center may be provided with sensors for measuring the air pressure gradient in the container, i.e. the difference between the air pressure inside the container and the ambient air. It is easy to determine which air pressure gradient will occur for a certain combination of open air inlets and certain operating speeds of the fans. Such data can either be represented in form of a calibration curve or in a look-up table.
[0048] Monitoring the air pressure gradient allows to determine anomalies and in particular to determine, when the gradient exceeds a certain threshold value, in case of which it may be assumed that the air flow into the container is obstructed for example by particles clogging the filters or wire meshes of the air inlets. In such case, the mentioned cleaning circle may be started and the fans may be run in reverse mode (i.e. in a mode, in which the turning direction of the fans is opposite to the turning direction in the standard operation mode, in which the fans are run to blow air out of the inner chamber) and be used to suck air into the inner chamber, hence reversing the airstream through the air inlets and blowing out clogging particles. Such cleaning circle may be executed fully automatically. It may be preset that a cleaning circle is run for predetermined time period, for example five minutes, after which the fans resume their normal mode of operation and air will be drawn into the container via the air inlets.
[0049] Similar to
[0050] In this embodiment, computing modules in form of ASIC miners 40 are arranged in the container, the walls of which are not shown. Each ASIC miner 40 is connected via respective piping, in particular a funnel like adapter 52 to one air inlet 32. In this respect, it should be noted that depending on the arrangement of the computing modules inside the container, the piping may simply consist in an elbow pipe piece provided in the container wall and forming an air intake. If the distance between the computing module to be air cooled and the container wall is longer, typically a pipe will guide air from the inlet to the respective computing module.
[0051] It should also be noted that the air inlets in the container walls may have other structures than the shown elbow pipe pieces and, depending on ambient conditions, may simply consist in holes in the container wall. One advantage of the invention is the flexibility, i.e. adjustability of its inner structure to different computing requirements.
[0052] Depending on the computing modules arranged in the container for establishing the mobile data center, the piping can fairly easy be adjusted such that air from the air inlets is guided to the computing modules to be cooled or to special parts of such computing modules. The piping may be set up using standard plastic tubes. In the embodiment shown in
[0053] In the embodiment shown in
[0054] The GPU miners 38 are arranged on eight racks (not shown), each rack comprising four shelves (not shown), and two GPU miners 38 are arranged on each shelve, such that in total sixty four GPU miners 38 are arranged in the container. The racks are movable along the rails by turning respective handwheels 64. Optionally, as very schematically indicated by propellers 66 in the lower part of each rack, supplementary fans may be installed, which can create an airflow supporting the drawing out of hot air from the container. These supplementary fans may only be started in case the temperature in the respective areas of the container exceeds a certain maximum, and may generally run at low speed, hence not consuming substantive energy amounts. However, for most cases and ambient conditions no such fans are necessary.
[0055] Each GPU miner 38 is associated with three air inlets 30 either directly or via piping 68 schematically indicated in
[0056] As is best seen in
[0057]
[0060] Each partition wall 70 is provided with numerous air inlets 72, via which in operation of the data center ambient air enters the inner chamber via the air intake chambers and is directed to the modules to be cooled as described above.
[0061] To allow ambient air to enter the air intake chambers, in this embodiment the bottom wall 22 has been provided with two large, rectangular cutouts 74 each adjacent to one of the side walls 14 and its opposite side wall (18 in
[0062] Although in this embodiment it must be ensured, for example by placing the container on supports, that sufficient ambient air can enter the air intake chambers, this embodiment has for certain environments and conditions advantages over the embodiment in which the walls of the container directly form the inner chamber. For example, the partition walls separate the hot inner chamber from at least two of the outer sidewalls and allow to maintain the general rather smooth outer appearance of a standard container without numerous visible air inlets. In this respect, it should be noted that while two partition walls running parallel to two side walls have been described above, it is possible to use only one partition wall or to use more than two, and to provide them for example parallel to the top and/or the bottom wall(s). Also, as during operation sound is created at the air inlets 72, embodiments with one or more air intake chambers and large air intake openings can lead to a reduction of the noise audible at the outside of the container. Another advantage is that the air inlets 72 even in dusty environments do not have to be provided with individual air filters as the ambient can already be filtered upon entering the air intake chamber(s), such that instead of multiple filters only a few large filter units need to be maintained. Like the air inlets mentioned above, the cutouts may be provided with automatically controllable throttle valves for example in form of adjustable fins for controlling the air flow through the cutouts.
[0063] In its simplest implementation, a method of operating a mobile data center according to an embodiment of the invention may comprise a step of operating the at least two fans to create a pressure gradient in the inner chamber causing ambient air to enter the inner chamber via the air inlets. Preferably, the operating status of each fan is monitored, i.e. it is monitored if each fan operates as intended. For this purpose, for example the power input of each fan or the speed of rotation of each propeller of each fan can be monitored and under normal circumstances each fan is operated as less than its maximum power. In case one of the fans fails or goes into an anomalous operating state, the other fan may be operated at higher power output to compensate the failing fan. Preferably, an alarm signal is created if it is detected that one of the fans is not operating normally and the signal is preferably automatically forwarded to an operator, who may then arrange for maintenance or repair of the fain.
[0064] Advantageously, the mobile data center may be provided with at least one, preferably more than one sensor for measuring at least one, preferably more than one of the following physical properties: temperature in the inner chamber, ambient temperature, air pressure in the inner chamber, ambient air pressure, humidity in the inner chamber and/or in certain air inlets, ambient humidity, and the method of operating the mobile data center may take into account the at least one, preferably more than one of the measured physical properties. For example, if it is detected that the air pressure gradient in the inner chamber exceeds a certain value, a cleaning circle as described above may be started automatically and the turning directions of the fans may be reversed.
[0065] If it is detected that the temperature in the inner chamber exceeds a certain maximum value although the fans already run at their maximum speed, the computing power of the computing modules may be turned down such that less heat will be created in the container. Likewise, if it is detected that the ambient air is quite humid for example due to heavy rain, or that there is a sand storm, computing power may be turned down such that less cooling is necessary and less air and accordingly less humidity or sand is drawn into the inner chamber or into the filters in the air inlets. In certain cases, the computing modules may even be switched off and the air inlets may be closed for example via throttle valves. Obviously, if the mobile data center is set up for operation under harsh ambient conditions, the fans of the container may be provided e.g. with adjustable rotor blades or other hardware allowing to close the fan openings in certain cases. In this respect, the invention advantageously allows the operator of a mobile data center to define his own criteria for operating the mobile data center under the respective ambient conditions that meet his requirements best.
[0066] The hardware and the method for operating the mobile data center may in particular provide a time shifted start of at least some of the computing models upon powering up the mobile data center and likewise a time shifted shutdown of at least some of the computing models upon powering down the mobile data center. Generally, due to the high total power consumption of the computing units arranged in the container, surge current protection is useful. In one embodiment and implementation, solid-state relays are used for activating the computing units. Upon powering up, all solid-state relays are off. After about ten seconds, a Linux-based server system and chip-based micro controllers are run up and ready. A start-up script is then automatically executed, randomly activating the solid-state relays for the computing modules, ensuring that not all computing modules receive power at the same time.
[0067] The powering up may also be done sequentially on a rack-by-rack and a computing-module-by-computing-module basis, i.e. power may be distributed to certain racks, which have their own rack-specific set of solid-state relays controlled by a micro controller allowing to switch on (or off) certain computing modules in the respective rack. Such automatic start-up hardware and method allow to safely connect standard plugs to the mobile data center without the need of special and expensive circuit breakers and ensures the versatility of the mobile data center to be plugged into virtually any sufficient power source. Likewise, hardware and method steps for automatically powering down the mobile data center are advantageously provided, ensuring that the computing modules are disconnected from power via shutting down all solid-state relays in a random or sequential order and not all at the same time, so that plugs can be removed safely without the danger of creating electric arcs inside the plugs.
[0068] Although it has turned out that the mobile data center according to an embodiment of the invention has an astonishing power usage effectiveness, the efficiency of the energy used and the environmental performance of the mobile data center can even be increased if the mobile data center is used for heating purposes such as for example heating a green house, a factory hall, a residential building, a swimming pool, a sports hall, a storehouse etc. Depending on the respective conditions, it is generally quite easy to either directly blow the air heated by the computing modules in the mobile data center into an air conducting system of a building or, in case of for example a factory hall, to simply place the mobile data center at a suitable position in the hall and use the air blown out of the mobile data center for heating purposes. In other environments, the hot air may be guided to heat exchangers and may for example be used for heating water. As the computing equipment is well protected in the container, it is easily possible to position the mobile data center where the hot air can conveniently be used.