In a distributed computing system, a failure detector is a computer application or a subsystem that is responsible for the detection of node failures or crashes.[1] Failure detectors were first introduced in 1996 by Chandra and Toueg in their book Unreliable Failure Detectors for Reliable Distributed Systems. The book depicts the failure detector as a tool to improve consensus (the achievement of reliability) and atomic broadcast (the same sequence of messages) in the distributed system. In other words, failure detectors seek errors in the process, and the system will maintain a level of reliability. In practice, after failure detectors spot crashes, the system will ban the processes that are making mistakes to prevent any further serious crashes or errors.[2][3]
In the 21st century, failure detectors are widely used in distributed computing systems to detect application errors, such as a software application stops functioning properly. As the distributed computing projects (see List of distributed computing projects) become more and more popular, the usage of the failure detects also becomes important and critical.[4][5]
Chandra and Toueg, the co-authors of the book Unreliable Failure Detectors for Reliable Distributed Systems (1996), approached the concept of detecting failure nodes by introducing the unreliable failure detector.[6] They describe the behavior of a unreliable failure detector in a distributed computing system as: after each process in the system entered a local failure detector component, each local component will examine a portion of all processes within the system.[5] In addition, each process must also contain programs that are currently suspected by failure detectors.[5]
Chandra and Toueg claimed that an unreliable failure detector can still be reliable in detecting the errors made by the system.[6] They generalize unreliable failure detectors to all forms of failure detectors because unreliable failure detectors and failure detectors share the same properties. Furthermore, Chandra and Toueg point out an important fact that the failure detector does not prevent any crashes in the system, even if the crashed program has been suspected previously. The construction of a failure detector is an essential, but a very difficult problem that occurred in the development of the fault-tolerant component in a distributed computer system. As a result, the failure detector was invented because of the need for detecting errors in the massive information transaction in distributed computing systems.[1][3][5]
The classes of failure detectors are distinguished by two important properties: completeness and accuracy. Completeness means that the failure detectors would find the programs that finally crashed in a process, whereas accuracy means that correct decisions that the failure detectors made in a process.[5]
The degrees of completeness depend on the number of crashed process is suspected by a failure detector in a certain period.[5]
The degrees of accuracy depend on the number of mistakes that a failure detector made in a certain period.[5]
Failure detectors can be categorized in the following eight types:[1][7]
The properties of these failure detectors are described below:[1]
Accuracy
|
Strong Perpetual Accuracy |
Weak Perpetual Accuracy |
Strong Eventual Accuracy |
Weak Eventual Accuracy |
|---|---|---|---|---|
| Strong Completeness | P | S | ♦P | ♦S |
| Weak Completeness | Q | W | ♦Q | ♦W |
In a nutshell, the properties of failure detectors depend on how fast the failure detector detects actual failures and how well it avoids false detection. A perfect failure detector will find all errors without any mistakes, whereas a weak failure detector will not find any errors and make numerous mistakes.[3][8]
Different types of failure detectors can be obtained by changing the properties of failure detectors.[3][6] The first examples show that how to increase completeness of a failure detector, and the second example shows that how to change one type of the failure detector to another.
The following is an example abstracted from the Department of Computer Science at Yale University. It functions by boosting the completeness of a failure detector.[6]
initially suspects = ∅
do forever:
for each process p:
if my weak-detector suspects p, then send p to all processes
upon receiving p from some process q:
suspects := suspects + p - q
From the example above, if p crashes, then the weak-detector will eventually suspect it. All failure detectors in the system will eventually suspect the p because of the infinite loop created by failure detectors. This example also shows that a weak completeness failure detector can also suspect all crashes eventually.[6] The inspection of crashed programs does not depend on completeness.[5]
The following are correctness arguments to satisfy the algorithm of changing a failure detector W to a failure detector S.[1] The failure detector W is weak in completeness, and the failure detector S is strong in completeness. They are both weak in accuracy.[6]
If all arguments above are satisfied, the reduction of a weak failure detector W to a strong failure detector S will agree with the algorithm within the distributed computing system.[1]
