Deep Learning Step6 Computational Graphs
Deep Learning Step6 Step 6 Computational Graphs About Computational Graphs There are many computational graphs in AI. They make it easy for us to understand visually how AI model is made. Computational graphs below are shown in this step. ・Additional Nodes ・Multiplicated Nodes ・Separated Nodes ・Repeated Nodes ・Sum Nodes ・MatMul Nodes About additional Nodes Additional nodes add up 2 nodes like X and Y in Fig.6.1. Where L means Loss function. Fig.6.1 Forward Propagation of additional nodes On the other hand, in back propagation of it, additional nodes doesn't change the differentiation value from the upper value of the differentiation. Fig.6.2 Back Propagation of additional nodes About Multiplicated Nodes Multiplicated nodes make multiplication of X and Y like in Fig.6.3. Fig.6.3 Forward Propagation of multiplicated nodes The back propagation will be like in Fig.6.4. ∂Z/∂X is equal to Y if Z is X × Y, ∂Z/∂Y is equa...