JP3976275B2 - Non-interventional dynamic hot plug and hot removal of server nodes in SMP - Google Patents

Description

  The present invention relates generally to data processing systems and, more particularly, to hot-pluggable components of data processing systems. More specifically, the present invention relates to a method, system, and data processing system configuration that enables non-intervening hot plug expansion and reduction of processor nodes of a symmetric multiprocessor (SMP) data processing system.

  The need for better, resource-rich data processing systems, both personal and commercial, continues to improve systems designed for customer use in the industry. In general, for both commercial and personal use, improvements have been made with a focus on faster processors, higher-level cache, larger read-only memory (ROM), and increased random access memory (RAM) space. It has been broken.

  To meet customer demands, customers need to be able to enhance or extend existing systems with additional resources, including hardware resources. For example, a customer who has a computer with a CD-ROM may later try to “upgrade” to a DVD drive or add a DVD drive. Alternatively, a customer may purchase a system with a Pentium 1 processor with 64K bytes of memory and later upgrade / change the chip to a Pentium 3 chip to increase the memory capacity to 256K bytes.

  Current data processing systems are designed to make these basic changes to the system hardware configuration with little effort. As is known to those skilled in the art, to upgrade a processor or memory, the computer's outer box can be removed and the new chip or memory stick can be "fastened" in an available processor deck or memory slot on the motherboard. is necessary. Similarly, a DVD player can be connected to one of the internal input / output (I / O) ports on the motherboard. In some systems, an external DVD drive can be connected to one of the serial port or USB port.

  In addition, especially in commercial systems, rather than increasing processing resources, ie replacing current processors with faster ones, you can purchase several more identical processing systems and link them together to get the overall processing power Improvements have been made, including increasing Modern commercial systems are designed to have multiple processors in a single system. Many commercial systems are distributed or networked systems, where many individual systems are interconnected with each other and share processing tasks / workloads. However, even these “large” commercial systems must be upgraded or expanded frequently as customer demands change.

  In particular, when upgrading or changing the system, it is often necessary to power down the system before completing the installation, especially for internally added components. However, for externally connected I / O components, it may be sufficient to simply plug in the components while the system is up and running. Regardless of the method used to add the component (internal addition or external addition), the system includes logic associated with a connection mechanism called a fabric, which allows additional hardware to be added, or simply Recognize that the system configuration has changed. This logic then prompts the user (or automatically) to initiate a system configuration upgrade and, if necessary, loads the necessary drivers to complete the installation of the new hardware. Can do. In particular, system configuration upgrades are also necessary when removing components from the system.

  The process of making new I / O hardware available almost immediately by a data processing system is commonly referred to in the art as “plug and play”. With the function of the current system, once a component is recognized and a driver or the like necessary for proper operation is installed, the system can automatically use the component by the system.

  FIG. 1 shows a commercial SMP. It comprises a first processor 101, a second processor 102, a memory 104, and an input / output (I / O) device 106, all connected by an interconnect mechanism 108. The interconnect mechanism 108 includes wires and control logic, thereby routing communications between components and controlling the MP 100 response to changes in hardware configuration. Thus, new hardware components are also connected (either directly or indirectly) to existing components via the interconnect mechanism 108.

  As illustrated in FIG. 1, the MP 100 includes a logical partition 110 (that is, a partition implemented by software) indicated by a dotted line, which logically separates the first processor 101 from the second processor 102. By using the logical partition 110 in the MP 100, the first processor 101 and the second processor 102 can operate independently of each other. In addition, the logical partition 110 substantially isolates each processor from other processor operating problems and downtime.

  Commercial systems such as SMP 100 can be expanded to meet customer demands as described above. In addition, changes to commercial systems may be made when a component fails and the system becomes unable to operate fully or, in the worst case, becomes inoperable. In that case, the failed component must be replaced. A customer asks the system manufacturer / supplier to manage the necessary repairs or upgrades. Other customers hire service technicians (or technical support personnel). The main task of such service technicians is to significantly impair the ability of the system to function and the ability of customer employees to access the system and to keep the system sensitive to processing time. Rather, complete the upgrades and repairs necessary for the system.

In current systems, if a customer (ie, a technical support representative) wants to remove one processor (eg, the first processor 101) from the system of FIG. 1, the customer must complete the following sequence of steps:
(1) Stop execution of instructions on the first processor 101 and block all I / O.
(2) Put a partition between processors.
(3) Next, the system is shut down (power is turned off). From the customer's point of view, it appears to be a failure stop because the system is no longer capable of any processing (ie, the operation on the second processor 102 is also stopped).
(4) Remove the first processor 101 and turn on the system again.
(5) Next, the system (second processor 102) is released from hibernation. The hibernation release process involves system restart, OS reboot, I / O operation restart, and instruction processing.

Similarly, if a customer wishes to add a processor (eg, the first processor 101) to a system that has only the second processor 102, a series of steps reverse to the previous must be performed.
(1) Stop execution of instructions on the second processor 102 and block all I / O. From the customer's point of view, the system is no longer capable of doing anything (i.e., the operation on the second processor 102 stops) and appears to be a failure stop.
(2) Next, shut down the system (turn off the power).
(3) The first processor 101 is added and the system is turned on again. The first processor 101 is initialized at this point. Initialization usually involves performing a series of tests including BIST (Built-in Self-Diagnosis Test) and the like.
(4) Next, the system is released from hibernation. The hibernation release process involves restarting the system, resuming I / O operations, and resuming instruction processing on both processors.

  In large commercial systems, the process described above can take a very long time and can take hours to hours to complete depending on the situation. During this downtime, the customer cannot use / access the system. Thus, a failure outage can be a significant economic loss depending on the specific use of the industry or system. Also, as noted above, a small or complete reboot of the system is required to complete either the addition or removal of processes. The failure outage described above is also experienced in systems with actual physical partitions, as will be described below.

  FIG. 2 shows an example of an MP server cluster having physical partitions. The MP server cluster 120 includes three servers 121, 122, and 123 that are interconnected via a backplane connector 128. Each server is a complete processing system having a processor 131, a memory 136, and an I / O 138, similar to the MP 100 of FIG. A physical partition 126 indicated by a dotted line separates the server 123 from the servers 121 and 122. Servers 121 and 122 can be initially coupled to each other, and server 123 is added later. Alternatively, all servers can be coupled together first and server 123 is removed later. Regardless of whether the server 123 is added or removed, the multi-step process described above, which involves reconfiguration of the entire system and the customer experiences a failure outage, adds / removes the server 123 in the MP server cluster 120. Is the only known method.

  Removing a server or processor from a larger system is often triggered by a problem that the component has in operation. These problems can arise for a variety of reasons, such as bad transistors, failed logic or wiring. Typically, when a system / resource is manufactured, the system undergoes a series of tests to determine whether the system is operating properly. This is particularly true for server systems such as those in FIG. Even with nearly 100 percent accuracy in the test, some problems may not be detected during manufacturing. In addition, internal components (such as transistors) often fail after a short time after manufacture, but the system may be shipped to the customer and added to the customer's existing system. Typically, when a system is connected to a customer's existing system, the system performs a second series of tests to ensure that the additional system is operating within the established parameters of the existing system. The latter test sequence (customer level) is initiated by an engineer (or design engineer). Its job is to ensure that existing systems continue to operate with as little downtime as possible.

  In very large and complex systems, the task of performing tests on existing and newly added systems often occupies a large portion of the technician's time. If a problem occurs, this problem is usually not recognized until some time (possibly several days) after the problem has occurred. If a problem is found with a particular resource, this resource often must be replaced. As noted above, replacing a resource allows the technician to reconfigure the entire system, even if the resource being replaced / removed is logically or physically separated from the rest of the system. There must be.

  If problematic components share the workload of the system, the result can be less efficient in generating work than systems that do not have that component. Alternatively, problematic components can cause processing errors, which can make the entire system inefficient. Currently, to remove such components, a technician must first test the entire system, isolate the offending component, and then initiate the removal step sequence described above. For this reason, the majority of system maintenance requires engineers to continually perform system diagnostic tests. System monitoring can be labor intensive and can be very costly to the customer. Also, problematic components may not be identified until a technician performs a diagnosis and may not be identified until the operation being processed by the system is compromised. It may be necessary to discard the processing results and back up the system to the last correct state.

  The present invention recognizes that it is desirable for a system to provide a system and method for extending the hot plug functionality of external plug and play components to large server systems that require additional processing power. ing. A method and system for hot plugging an MP server to SMP would be a desirable improvement. It would be further desirable if no downtime was experienced in the system during hot plug operation, so that this operation remains invisible to the customer. These and other advantages are provided by the invention described herein.

  Disclosed is a data processing system that provides hot plug addition / removal functions for individual hot pluggable components without interfering with the current operation of the entire processing system. The processing system includes main components such as a processor, memory, and I / O devices. These components are connected to each other via an interconnection mechanism (interconnect fabric) consisting of connection wires, connection ports, and logical components. The connection port supports hot plug components and allows external hot pluggable components to be coupled to the data processing system. In addition to the hardware components, the data processing system includes software components, i.e., service elements and an operating system (OS). The logic components include configuration, routing logic, and operational logic. The configuration logic selects the configuration profile / parameter that the data processing system follows during operation. Routing logic and operational logic provides a routing protocol that controls how communications (such as data) are routed on the data processing system.

  When connecting a hot-pluggable component to an available system connector, the service element automatically detects the connection and selects the correct configuration file for the expansion system. The service component of the first component assumes the role of master, and the service component of the newly added component is controlled by the master service element. Once the configuration file is loaded into the hardware configuration register, the new element is integrated into the existing system once the system check for the new element indicates that the new element is ready for operation. The service element informs the OS that it will begin assigning workload to the new element. From the customer's point of view, the entire process takes place without turning off power or interrupting the operation of existing elements.

  In another embodiment, removal of hot-pluggable components is also achieved without intervening in the current processing of the remaining main system. This removal can be initiated by a service technician or automated.

  The above as well as additional objectives, features, and advantages of the present invention will become apparent in the following detailed written description.

  The novel features believed characteristic of the invention are set forth in the appended claims. However, the invention itself, together with its preferred mode of use and further objects and advantages, will be best understood by referring to the following detailed description of exemplary embodiments read in conjunction with the accompanying drawings.

  The present invention provides a method and system that allows hot plug addition / removal of the functionality of the main components of the processing system without resulting in downtime that is unavoidable with current systems. Specifically, the present invention provides three major advances in the data processing system industry. (1) A hot-pluggable processor / server in a symmetric multiprocessor system (SMP) without intervening in ongoing system operation. (2) Hot-pluggable components including memory, heterogeneous processors, and input / output (I / O) expansion devices in a multiprocessor system (MP) without intervening in ongoing system operation, and (3) others Automatic detection of problems affecting system hot-plug components and dynamic removal of problematic components without disrupting the operation of other system components.

  For simplicity, the above three improvements are presented as sections identified by separate headings, and the general hot plug functionality is divided into hot add sections and separate hot remove sections. The contents of these sections may overlap. However, the duplication that occurs in the function of the embodiments will be described in detail when it occurs first and when it is later referenced.

I. Hardware Configuration Referring now to the drawings, and particularly to FIG. 3, there is shown a multiprocessor system (MP) designed with connection mechanisms and other components that enable implementation of the various mechanisms of the present invention. The MP 200 includes processors 201 and 202. The MP 200 also includes a memory 204 and an input / output (I / O) component 206. The various components are interconnected via an interconnect mechanism 208 that includes a hot plug connector 220. The addition of new hot-pluggable components is done (either directly or indirectly) via the hot-plug connector 220 of the interconnect mechanism 208, as will be described in more detail below.

  The interconnect mechanism 208 includes wiring and control logic to route communications between components and to control the MP 200 response to hardware configuration changes. The control logic includes routing logic 207 and configuration setting logic 209. Specifically, as shown on the left side of the MP 200, the configuration setting logic 209 includes first and second configuration settings, that is, a configuration A 214 and a configuration B 216. Configuration A 214 and configuration B 216 are coupled to a mode setting register 218 controlled by latch 217. The actual operation of the components in the configuration logic 209 is described in further detail below.

  In addition to the components described above, the MP 200 also includes a service element (SE) 212. S. E. 212 is a small microcontroller with special software encoding logic (separate from the operating system (OS)) that is used to maintain system components and complete interface operations for large systems Let For this reason, S.H. E. 212 executes code necessary for controlling the MP 200. S. E. 212 notifies the OS of additional processor resources (that is, increase / decrease in the number of processors) in the MP, and notifies addition / removal of other system resources (that is, memory, I / O, etc.).

  4 and 5 show two MPs similar to 200 in FIG. 3, which are coupled together via a hot plug connector 220 to form a larger symmetric MP (SMP) system. MP 200 is shown as element 0 and element 1, but such an indication is necessary for purposes of explanation. Element 1 can be coupled to element 0 via wires, connector pins, or cable connections designed to couple separate MP hot plug connectors 220. In one embodiment, the MP can actually be plugged into the background processor expansion rack, thereby extending the customer's SMP to accommodate additional MPs.

  As an example, element 0 is the customer's main system (or server), and this customer wants to increase the processing capabilities / resources of the main system. Element 1 is a secondary system that is added to the main system by a system engineer. According to the present invention, the addition of element 1 is performed by the hot plug operation provided herein, and the customer does not experience element 0 downtime while connecting element 1.

  As shown in FIGS. 4 and 5, the SMP 300 includes a physical partition 210 indicated by a dotted line, which separates element 0 from element 1. The physical partitions 210 allow each MP 200 to operate to some extent independently of each other. In one implementation, physical partition 210 substantially isolates each MP 200 from other MP 200 operational problems and downtime.

II. Non-Interventional Hot Pluggable Addition of Processor in SMP FIG. 6 shows a flowchart of a process for performing a non-interventional hot plug operation to add element 1 to element 0. In the “hot addition” example described below, the initial operating state of the MP 200 is as follows.
Element 0: OS and application are running on the interconnect mechanism 208 using configuration A214. Element 0 is electrically and logically separated from element 1.
Service element 0: managing a single MP, i.e. element 0 component.
Connection mechanism: routing control via configuration A 214, etc. The latch position is set in configuration A.
Element 1: Does not yet exist or exists but has not yet been plugged into the system.

  Other hardware components are possible other than those shown in FIGS. What has been provided is shown for illustrative purposes only and is not intended to limit the invention. In the present embodiment, the MP 200 also includes logic for enabling switching within the set number of cycles, so that there is no apparent loss of operating time for the customer. A certain number of cycles can be assigned and switched. The connection mechanism control logic requests the cycle amount from the arbiter to perform the configuration switch. In most implementations, the actual time required is about one millionth of a second (1 microsecond), which is negligible (or invisible) from the customer's perspective.

  Returning to FIG. 6, the process begins at block 402 where the service technician physically transfers element 1 (EL1) to element 0 hot plug connector 220 while element 0 (EL0) is running. Plug in. Then, power is applied to element 1 as shown in block 404. In one implementation, the technician physically connects element 1 to a power source. However, in the present invention, it is also conceivable to supply power via the hot plug connector 220, so only the main system or element 0 has to be connected directly to the power source. This can be achieved via a backplane connector that plugs all MPs.

  Once element 1 receives power, the S.I. E. Completes the sequence of checkpoint steps for initializing element 1. In one embodiment, element 1 is provided with a set of physical pins that are selected by a service technician to initiate the checkpoint process. However, in the embodiment described herein, S.P. E. 0 completes automatic detection of another element's plug-in for element 0. Then S. E. 0 assumes the role of the master. E. Trigger 1 to initiate a power-on reset (POR) of element 1 as shown in block 408. As a result of the POR, the clock is turned on, BIST is executed, and the processor, memory and connection mechanism of the element 1 are initialized.

  In one embodiment, S.I. E. 1 executes the test application to ensure that element 1 is operating properly. Thus, at block 410, based on the above test, it is determined whether element 1 is “clean”, ie, ready to be integrated into the main system (element 0). Assuming that element 1 has been cleared for integration, then S.I. E. 0 and S.M. E. 1 initializes the interconnection between the connection mechanisms of each MP 200 while both MPs 200 are operating / executing. This process frees the communication highway so that both connection mechanisms can share tasks and efficiently coordinate information routing. This process includes enabling the electrically connected driver and receiver and, if necessary, adjusting the interface for the most efficient operation of the combined system, as shown in block 414. For example. In one embodiment, interface coordination is an internal process and is completed automatically by the control logic of the attachment mechanism. In order to synchronize operations throughout the system, the control logic of element 0 assumes the role of the master. Then, the control logic of element 0 controls all operations of both element 0 and element 1. Element 1's control logic automatically detects the operating parameters of element 0 (eg, configuration mode settings) and synchronizes its own operating parameters to reflect those of element 0. Interconnect mechanism 208 is logically and physically coupled under the control of element 0 logic.

  During interface adjustment, configuration B 216 is loaded into the mode setting register 218 of both elements, as shown in block 416. By loading the same configuration mode, this combined system can operate with the same routing protocol at the attachment level. The process of selecting either configuration mode / protocol is controlled by latch 217. In the dynamic example, S.M. E. Sets up the configuration registers on both the existing and new elements for the new topology when indicates that the next element has been plugged in, completed initialization, and ready to be incorporated into the system . The SE then issues a “go” command to the hardware. In the illustrated embodiment, upon executing a go command, the automated state machine temporarily stops operation of the connection mechanism, changes the latch 217 and uses configuration B to resume operation of the connection mechanism. In an alternative embodiment, the SE Go command changes the latches 217 on all elements synchronously. In either embodiment, the OS and I / O devices in the computer system do not experience a failure outage. This is because configuration switching occurs in approximately processor cycles (less than microseconds in this embodiment). The value of the latch indicates to the hardware how to route information on the SMP and determines the routing / operation protocol implemented on the connection mechanism. In one embodiment, the latch functions as a select input for a multiplexer (MUX), whose data input port is coupled to one of the configuration registers. The value in the latch causes one configuration register or the other configuration register to be selected as the MUX output. The output of the MUX is loaded into the mode setting register 218. The automated state machine controller then implements the protocol while the system is running.

The operating state of the system after the hot plug operation is as follows.
Element 0: The OS and application are executed using the configuration B 216 on the connection mechanism 208. Element 0 is electrically and logically connected to element 1.
Element 1: An OS and an application are executed on the connection mechanism 208 using the configuration B 216. Element 1 is electrically and logically connected to element 0.
Service element 0: Manages both components of element 0 and element 1.
Connection mechanism: routing control via configuration B, etc. The latch position is set in configuration B.

  As shown in block 418, the combined system continues to operate with a new routing protocol that takes into account increased processing power, distributed memory, and the like. Customers immediately benefit from the increased processing resources / capacity of the combined system without experiencing downtime of the main system and without having to reboot the system.

  The process described above can be extended to include the connection of multiple additional elements, either one at a time or multiple simultaneously. When one is completed at a time, the selected configuration register is switched each time a new element is added (or removed). In another embodiment, different configuration register ranges can be provided to handle up to a certain number of hot-plugged elements. For example, based on the system including 1, 2, 3, or 4 elements, 4 different register files are available for selection. The configuration register indicates a specific location in memory, where a larger operation / routing protocol designed for a specific hardware configuration is stored and activated based on the current configuration of the processing system .

III. Memory, I / O Channels, and Heterogeneous Processor Non-Intrusive Hot Plug FIG. 8 illustrates one additional extension of the hot plug functionality. Specifically, FIG. 8 extends the non-intervening hot plug functionality mechanism described above to accommodate additional memory and I / O channels and heterogeneous processor hot plug additions. The MP 500 includes main components similar to those of the MP 200 in FIG. 2, and new components are identified by reference numbers in the 500s. In addition to the main components (ie, processors 201 and 202, memory 504A, and I / O channel 506A coupled together via interconnect mechanism 208), MP 500 has several additional connector ports on connection mechanism 208. including. Among these connector ports, a hot plug memory expansion port 521, a hot plug I / O expansion port 522, and a hot plug processor expansion port 523 are included.

  Each expansion port has corresponding configuration logic 509A, 509B, and 509C to control hot plug operation for the respective component. In addition to memory 504A, additional memory 504B can be “plugged in” to memory expansion port 521 of connection mechanism 208, similar to the process described above for MP 300 and element 0 and element 1. The initial memory range from addresses 0 to N is expanded to include addresses from N + 1 to M. Any size memory configuration mode can be selected by latch 517A. When the additional memory 504B is added to the latch 517A, the S.L. E. 212. Also, additional I / O channels can be provided by hot plugging the I / O channels 506B, 506C to the hot plug I / O expansion port 522. Again, when additional I / O channels 506B, 506C are added, the configuration mode for the size of the I / O channel is S.I. E. This can be selected by a latch 517C set by 212.

  Finally, an asymmetric processor (ie, a processor configured / configured differently than processors 201 and 202 in MP 200) is plugged into hot plug processor expansion port 523 and similar to the process described above for server / element 1 It can be initialized. However, unlike the other configuration logic 509A, 509B, where only an increase in the amount of available memory and I / O resources must be considered, the configuration logic 509C for adding processors considers more parameters. There is a need. This is because the processor is asymmetric, and workload division, allocation, etc. must be considered in selecting the correct configuration mode.

  With the above-described configuration, the system can reduce / expand the processor, memory, I / O channel, and the like without causing a significant obstacle to processing on the MP 500. Specifically, the above configuration makes it possible to expand (and reduce) the address space that can be used by both the memory and the I / O. Each add-on or removal is treated independently of each other, i.e. as processor-to-memory or I / O, and is controlled by separate logic as shown. Thus, the present invention extends the concept of “hot plugging” to devices that cannot be hot plugged in the conventional sense of the word.

  The initial state of the system shown in FIG. 8 includes the amount of memory space N, the number of I / O spaces (that is, channels connecting I / O devices) R, the processing capacity amount Y at speed Z, and the like.

  The final state of the system ranges from the initial state described above to the memory space amount M (M> N), the number of I / O channels T (T> R), and the processing capacity amount Y + X at speeds Z and Z + W. .

  The above variables are used for illustrative purposes only and are not intended to indicate particular parameter values or limit the invention.

  In the above embodiment, the service technician installs the new component (s) by physically plugging in additional memory, processor or I / O, and then E. 212 completes the auto-detection and initialization / configuration process. When additional memory is installed, S.M. E. 212 performs a reliability test, and S.212 E. 212 executes the BIST. Then S. E. 212 initializes the interface (represented by a dotted line) and sets up alternative configuration register (s). S. E. 212 completes the entire hardware switch in less than 1 microsecond and then notifies the OS of the availability of the new resource. The OS then completes the workload assignment according to which components are available and which configuration is running.

IV. Non-interventional removal of hot-plugged components in a processing system FIG. 7 shows a flowchart of a process for completing non-interventional removal of hot-plug components. Hereinafter, the removal of element 1 in a processing system including both element 1 and element 0 will be described with reference to FIGS. 4 and 5 as well. In the example of removal shown in FIG. 7, the first operation state of SMP is the above-described operation state after the hot plug operation of FIG.

  In order to remove element 1, the service technician must first inform the removal of the wait state in some way. In one embodiment, a hot removal button 225 is provided on the outer surface of each element. Button 225 includes a light emitting diode (LED) or other signal means, so that the active element is visually “online”, ie plugged in and functioning, or offline by a service technician as being offline. Can be identified. Thus, in FIG. 7, if the service technician wishes to remove element 1, the technician first presses button 225, as shown in block 452. In another embodiment, it is assumed that each element is fastened to some type of backplane connector, and the S.P. E. 212 notifies the start of the reconfiguration process. In yet another embodiment, the system administrator may E. 212 can be triggered to initiate the removal operation of a particular component. Triggering is performed by selecting a removal option within a software configuration utility running on the system. Section 5 below describes an automatic removal method that does not require initiation by a service technician or system administrator.

  Once button 225 is pressed, it is hidden from the customer (ie, element 0 remains running) and the reconstruction process begins in the background. As shown in block 454, S.I. E. 212 notifies the OS of the process of losing the resource of the element 1. In response, the OS reassigns the task / workload from element 1 to element 0 and releases element 1 as shown in block 456. S. E. 212 monitors an indication that the OS has completed the reassignment of all processing (and data storage) from element 1 to element 0, and determines at block 458 whether the reassignment is complete. Once the reassignment is complete, the OS E. A message is sent to 212 and S.212 is entered as shown in block 462. E. 212 loads alternative configuration settings into configuration register 218. To load an alternative configuration setting, E. 212 sets a value in latch 217 to select that configuration setting. In another embodiment, latch 217 is set when button 225 is first pressed to trigger removal. Element 1 is logically removed and electrically removed from the SMP attachment without interrupting element 0. Then, as shown in block 464, S.I. E. 212 brightens the button 225. This lighting informs the service technician that the reconstruction process is complete. The technician then turns off and physically removes element 1 as shown in block 466.

  In the above-described embodiment, the operating state of the server is notified using the LED in the button 225. For this reason, a pre-established color code is set so that customers or technicians can recognize when an element is turned on (hot plug) or turned off (removed). For example, a blue color indicates that the element is fully functional and is electrically and logically attached, and a red color indicates that the element is in the process of being reconfigured and must not yet be physically removed Green (or no illumination) indicates that the element has been reconfigured (or no longer logically or electrically present) and can be physically removed.

V. Non-interventional automatic detection and removal of problematic components Given the manual removal capability described above with hot-plug components, the present invention can be extended to provide non-interventional automatic detection of problematic elements (or components) and pre- Automatic separation of elements that are not functioning at the established (or desired) level of operation or defective elements is performed. The non-intervening hot plug feature of the present invention allows technicians to remove problematic elements without disassembling the entire processing system. The present invention extends this functionality a further step to allow automatic problem detection of components plugged into the system and then from the system non-interventional (while the system is running). Dynamically remove problem / bad components. Unlike engineer-initiated reconfiguration, this problem element / component detection and corresponding reconfiguration takes place automatically and in the background without significant failure outages in the rest of the processing system. This embodiment allows for efficient detection of problematic / bad components and mitigates potential problems for overall system integrity when problematic components are used for processing tasks. This embodiment further helps to replace defective components in a timely manner without causing a failure outage in the rest of the system.

  FIG. 9 illustrates the process of automatic detection and dynamic deallocation of problematic components within a hot plug environment. The process begins at block 602 and S.P. E. Detects new components being added to the system and saves the current active operating state of the system (configuration state of the processor, configuration registers, etc.). Alternatively, automatically E. Saves the operating state at pre-established time intervals during system operation and whenever a new component is added to the system. As shown in block 604, a new operating state is entered to test the system hardware configuration (including new components). In block 606, it is determined whether a new operating state and system configuration test generates an OK signal. System configuration tests may include BIST for the entire system or BIST for new components only, and other configuration tests such as new component reliability tests. If the test returns an OK signal, the new operating state is saved as the current state, as shown in block 608. The new operating state is then implemented throughout the system, as shown at block 610. The process loop returns to testing for any new operating state when there is a change or when a predetermined time interval has elapsed.

  If the test returns an indication of a problem, for example if the BIST fails or the runtime error check circuit is activated, the deallocation phase of the detection and deallocation process is started. S. E. Is a series of steps similar to those shown in FIG. 7, but unlike FIG. 7, where the service technician started the removal process, the removal process of this embodiment is automated and tested at a certain level. Start as a direct result of receiving an indication of failure. S. E. Begins the removal process as shown in block 612. As shown in block 614, a message is sent to the output device to inform the customer or service technician that a problem has been found with a particular component and that the component has been removed (or removed) (ie taken offline). ) In one embodiment, the output device is a monitor connected to the processing system, whereby the service technician monitors the operating parameters of the entire system. In another embodiment, the problem is sent as a message (via a network medium) to the manufacturer or supplier, who then prompts to replace or repair the defective component, as shown in block 616. Can take various actions.

  In one embodiment, the detection step includes testing at the chip level. For this reason, manufacturer-level tests are performed on the system while the system is operating and after the system has been shipped to the customer. The process described above allows the system to make manufacturing quality self-test functions and automatic non-intervening dynamic reconfiguration based on those tests. One particular embodiment involves partition virtualization. Save partition status when switching partitions. Manufacturer quality self-tests are performed by dedicated hardware on various components. The test only takes about the same amount of time (1 microsecond) as it takes to switch partitions without intervention as described above. If the test shows that the partition is bad, S.M. E. Automatically reassigns workload from bad components and restores previous good state saved.

  Although the invention has been particularly shown and described with reference to preferred embodiments, those skilled in the art will recognize that various changes can be made in form and detail without departing from the spirit and scope of the invention. Let's be done.

1 is a block diagram of the main components of a multiprocessor system (MP) according to the prior art. It is a block diagram which shows several servers of the server cluster by a prior art. 1 is a block diagram of a data processing system (server) designed with attachment mechanism control logic used to provide various hot-plug mechanisms in accordance with one embodiment of the present invention. FIG. FIG. 4 is a block diagram of an MP including the two servers of FIG. 3 configured for hot plug according to one embodiment of the present invention. FIG. 4 is a block diagram of an MP including the two servers of FIG. 3 configured for hot plug according to one embodiment of the present invention. FIG. 5 is a flowchart illustrating a process for adding a server to the MP of FIG. 4 in accordance with an embodiment of the present invention. 5 is a flowchart illustrating a process for removing a server from the MP of FIG. 4 in accordance with one embodiment of the present invention. 1 is a block diagram of a data processing system that enables hot plug expansion of all main components in accordance with one embodiment of the present invention. FIG. 4 is a flowchart illustrating a process for completing automatic detection and dynamic removal of hot-plugged components that are causing a detectable problem, in accordance with one embodiment of the present invention.

Claims (21)

A data processing system,
A first processing unit including an interconnect mechanism for interconnecting internal components, the interconnect mechanism including at least one hot plug connector, and the interconnect mechanism includes routing and communication operations of the interconnect mechanism Said first processing unit further comprising logic for dynamically selecting a configuration for controlling the plurality of configurations;
A second processing unit that can be electrically and logically connected to the first processing unit via the hot plug connector;
Means for performing an electrical and logical connection between the first processing unit and the second processing unit without intervening operations being performed on the first processing unit;
And the data processing system includes only the first processing unit, the logic selects a first configuration, and the data processing system includes both the first processing unit and the second processing unit. A data processing system, wherein the logic selects a second configuration. The data processing system of claim 1, further comprising means for causing the second processing unit to automatically share the workload of the first processing unit after the electrical and logical connections.   The means for performing the connection is a service element that operates in the first processing unit, and detects that the second processing unit is connected to the first processing unit. The data processing system according to claim 1, further comprising a service element that triggers and selects the second configuration. The first processing unit controls operations on the data processing system and allocates workload among processors and other components in the data processing system based on the current configuration of the data processing system (OS)
The means for executing the connection operates in the first processing unit and triggers the OS to cause the first processing between the first processing unit and the second processing unit. Including service elements that allocate unit workloads,
The data processing system according to claim 1 .   The means for performing the connection operates in the first processing unit and is responsive to detecting that the second processing unit is connected to the first processing unit. 3. A data processing system according to claim 1 or 2, comprising a service element that triggers a series of operational tests on a plurality of processing units, wherein the logical connection is completed only after the operational test returns a positive result.   The connection backplane of claim 1 or 2, further comprising a connection backplane that provides a connection port for interconnecting the hot plug connector of the first processing unit and an associated hot plug connector of the second processing unit. Data processing system.   And further includes means for removing electrical and logical connections between the first processing unit and the second processing unit without intervening operations being performed on the first processing unit. The data processing system according to claim 1 or 2.   The hot plug connector is a first hot plug connector, and the second processing unit is used to connect the second processing unit to the first processing unit via the hot plug connector. The data processing system of claim 1 or 2, comprising a second interconnect mechanism having a second hot plug connector.   And further comprising means for performing electrical and logical removal of the second processing unit from the first processing unit without intervening operations being performed on the first processing unit. Item 3. The data processing system according to Item 1 or 2. The means for performing the removal is a service element that operates in the first processing unit, and detects the start of removal of the second processing unit from the first processing unit. The data processing system of claim 9 , comprising a service element that triggers to select the first configuration. The first processing unit controls operations on the data processing system and allocates workload among processors and other components in the data processing system based on the current configuration of the data processing system (OS)
The means for performing the removal includes a service element that operates within the first processing unit and that triggers the OS to assign a workload from the second processing unit to the first processing unit. The data processing system according to claim 9 . The means for performing the removal includes a service element that operates within the first processing unit and that automatically generates a logical separation between the second processing unit and the first processing unit. The data processing system according to claim 9 , comprising: The data processing of claim 9 , further comprising a connection backplane that provides a connection port for interconnecting the hot plug connector of the first processing unit and an associated hot plug connector of the second processing unit. system. A third processing unit;
For dynamically establishing an electrical and logical connection between the first processing unit and the third processing unit without intervening in operations being performed on the first processing unit; Means,
Means for dynamically reconfiguring the data processing system to provide the third processing unit without intervening operation on the first processing system;
The data processing system of claim 9 , further comprising: A data processing system for hot plugging a second processing unit to a first processing unit, the first processing unit including an interconnect mechanism, wherein the interconnect mechanism includes at least one hot plug connector and the interconnect. Logic for dynamically selecting a configuration for controlling routing and communication operations of the attachment mechanism from a plurality of configurations;
The data processing system includes:
Means for connecting the second processing unit to the first processing unit via the hot plug connector;
Means for detecting a connection of the second processing unit and determining whether the second processing unit is functioning correctly;
If a second processing unit that is functioning correctly is detected, means for enabling the second processing unit; and if the data processing system includes only the first processing unit, A data processing system, wherein the logic selects a first configuration and the logic selects a second configuration when the data processing system includes both the first processing unit and the second processing unit. 16. The data processing system of claim 15 , further comprising means for causing the second processing unit to share the work load of the first processing unit. 17. A data processing system according to claim 15 or 16 , further comprising means for enabling hot removal of the second processing unit without intervening in the operation of the first processing unit. An operating system (OS) that controls operations on the data processing system and that allocates a workload among processors and other components within the data processing system based on a current configuration of the data processing system. Item 16. The data processing system according to Item 15 . In a data processing system including a first processing unit, a method for hot plugging a second processing unit into the first processing unit, the first processing unit including an interconnection mechanism, wherein the mutual processing The connection mechanism includes at least one hot plug connector, and the interconnect mechanism further includes logic for dynamically selecting a configuration for controlling routing and communication operations of the interconnect mechanism from a plurality of configurations;
The method
Detecting a connection of a second processing unit to the first processing unit via the hot plug connector;
Determining whether the second processing unit is functioning correctly;
Enabling the second processing unit to operate without intervening in the operation on the first processing system if the second processing unit is detected and functioning correctly, the data processing system comprising: If the data processing system includes only the first processing unit, the logic selects the first configuration, and if the data processing system includes both the first processing unit and the second processing unit, the logic is A method of selecting a second configuration. The method of claim 19 , further comprising causing the second processing unit to share a workload of the first processing unit. 21. A method according to claim 19 or 20 , further comprising the step of allowing hot removal of the second processing unit without intervening in the operation of the first processing unit.

Images