Convolutional neural network (CNN) is a deep learning model with strong expression and classification ability
and is currently widely used
but there are a variety of specific algorithms. In this paper
the realization of deep learning algorithm based on convolutional neural network CNN
including the function of convolution kernel
the role of pooling
the selection of activation function and the training process are discussed. And one example is explained
which facilitates the mastery of CNN. Finally
the future research direction of convolution neural network is summarized and forecasted.
关键词
Keywords
references
KRIZHEVSKY A, SUTSKEVER I, HINTON G E. ImageNet classification with deep convolutional neural networks[C]//International Conference on Neural Information Processing Systems.[S.l.]: [s.n.], 2012: 1097-1105.
ZEILER M D, FERGUS R. Visualizing and understanding convolutional networks[C]//[s.n.]. European conference on computer vision.[S.l.]: Springer, Cham, 2014: 818-833.
SIMONYAN K, ZISSERMAN A. Very deep convolutional networks for large-scale image recognition[J]. arXiv preprint arXiv, 2014: 1409. 1556.
SZEGEDY C, LIU W, JIA Y, et al. Going deeper with convolutions[C]//IEEE. Proceedings of the IEEE conference on computer vision and pattern recognition.[S.l.]: [s.n.], 2015: 1-9.
HE K, ZHANG X, REN S, et al. Deep residual learning for image recognition[C]//IEEE. Proceedings of the IEEE conference on computer vision and pattern recognition.[S.l.: s.n.], 2016: 770-778.
GIRSHICK R, DONAHUE J, DARRELL T, et al. Rich feature hierarchies for accurate object detection and semantic segmentation[C]//IEEE. Proceedings of the IEEE conference on computer vision and pattern recognition.[S.l.]: [s.n.], 2014: 580-587.
GIRSHICK R. Fast r-cnn[C]//IEEE.Proceedings of the IEEE international conference on computer vision.[S.l.: s.n.], 2015: 1440-1448.
REN S, HE K, GIRSHICK R, et al . Faster R-CNN: Towards real-time object detection with region proposal networks [J ] . IEEE Transactions on Pattern Analysis and Machine Intelligence, 2017, 39(6): 1137-1149.
TIAN Z, HUANG W, HE T, et al. Detecting text in natural image with connectionist text proposal network[C]//European Conference on Computer Vision.[S.l.]: Springer International Publishing, 2016: 56-72.
ZEILER M D, FERGUS R. Stochastic pooling for regularization of deep convolutional neural networks[J]. arXiv preprint arXiv, 2013: 1301. 3557.
CLEVERT D, UNTERTHINER T, HOCHREITER S, et al. Fast and accurate deep network learning by exponential linear units (elus)[J]. arXiv preprint arXiv, 2015: 1511. 07289.
SRIVASTAVA N, HINTON G, KRIZHEVSKY A, et al . Dropout: a simple way to prevent neural networks from overfitting [J ] . Journal of Machine Learning Research, 2014, 15(1): 1929-1958.
SRIVASTAVA R K,GREFF K, SCHMIDHUBER J, et al. Training very deep networks[C]//Advances in neural information processing systems.[S.l.]: [s.n.], 2015: 2377-2385.
GLOROT X, BENGIO Y. Understanding the difficulty of training deep feed forward neural networks [J]. Journal of Machine Learning Research, 2010, 9: 249-256.
HE K, ZHANG X, REN S, et al. Delving deep into rectifiers: Surpassing human-level performance on imagenet classification[C]//IEEE. Proceedings of the IEEE international conference on computer vision.[S.l.]: [s.n.] 2015: 1026-1034.
HE K, ZHANG X, REN S, et al . Spatial Pyramid Pooling in deep convolutional networks for visual recognition [J ] . IEEE Transactions on Pattern Analysis Machine Intelligence, 2014, 37(9): 1904-1916.