09/01/1994 09:00 AM
Computer Engineering
The question \"How much testing is enough?\" has led many to structural testing methods. Much has been written about their fault detecting ability, but how does this vary by the class of fault? This paper introduces the term \"Affected Branch Coverage\". An affected branch is a branch which had to be modified in order to fix a fault. Affected Branch Coverage describes the percentage of affected branches that had been exercised in testing. The study was done on a leading on-line transaction processing product, analyzing ninety eight field errors. The specific questions addressed are: - Which classes of faults are most commonly observed? - Which fault classes can be associated with covered code and which with uncovered code? - Is affected branch coverage related to the maturity of the software? Our results show that whether or not a fault would appear in covered code depends strongly on the fault class. While this was true in both newer and older code, it was more vivid in newer code. Overall, we found that affected branch coverage was slightly less than 50%, suggesting that increasing branch coverage would offer limited gains in fault detection.
