Starting with a wieght matrix of all zero's, use the delta rule (as explained in the handout and in class) to generate a new matrix of weights based on case A. Use the format on the handout, with a "train" column and a "test" column. Does the new weight matrix reduce the error to zero?
Now apply this new matrix and the delta rule to Case B to generate a second matrix. Show how this matrix handles Cases A and B.
Finally, apply the second matrix to case C to derive a third matrix. Show how this matrix handles all three cases. How low is the error for each case using this third matrix? Characterize the value of the delta rule as illustrated in this exercise.
| Case A: | Input: | -1 | 1 | 1 | -1 | Output: | -2 | -2 | 2 | 2 | Case B: | Input: | -1 | -1 | 1 | 1 | Output: | 2 | 2 | -2 | -2 | Case C: | Input: | -1 | -1 | -1 | -1 | Output: | 2 | 2 | 2 | 2 |