精编干货｜史上最全神经网络结构图画图工具介绍，没有之一

来源：量化投资与机器学习

作者：编辑部西西

本文长度为1700字，建议阅读10分钟

本文为大家比较全面详细的介绍关于神经网络结构图的工具。

我们给出了部分内容

完整内容请在文末获取

LaTeX

绘制网络结点图的tikz库

在控制论或者是智能领域，神经网络是经常接触到的，另外，研究网络时，也经常需要绘制网络结点图，下面介绍一个tikz库可以非常方便地绘制这类图。

The following example shows a Rearrangeable Clos Network：

Kalman Filter System Model

神经网络绘图包

包的整体设计非常不错，使用也很方便，作者使用该包写了一个版面不错的文档。

Linear regression may be visualised as a graph. The output is simply the weighted sum of the inputs:

Logistic regression is a powerful tool but it can only form simple hypotheses, since it operates on a linear combination of the input values (albeit applying a non-linear function as soon as possible). Neural networks are constructed from layers of such non-linear mixing elements, allowing development of more complex hypotheses. This is achieved by stacking4 logistic regression networks to produce more complex behaviour. The inclusion of extra non-linear mixing stages between the input and the output nodes can increase the complexity of the network, allowing it to develop more advanced hypotheses. This is relatively simple:

The presence of multiple layers can be used to construct all the elementary logic gates. This in turn allows construction of advanced digital processing logic in neural networks – and this construction occurs automatically during the learning stage. Some examples are shown below, which take inputs of 0/1 and which return a positive output for true and a non-positive output for false:

From these, it becomes trivial to construct other gates. Negating the values produces the inverted gates, and these can be used to construct more complex gates. Thus, neural networks may be understood as “self-designing microchips”, capable of both digital and analogue processing：

Omnigraffle

OmniGraffle是由The Omni Group制作的一款绘图软件，其只能于运行在Mac OS X和iPad平台之上，添加公式可以配合latexit使用。可以用来绘制图表，流程图，组织结构图以及插图，也可以用来组织头脑中思考的信息，组织头脑风暴的结果，绘制心智图，作为样式管理器，或设计网页或PDF文档的原型。嵌入在论文里导出成pdf，嵌入在网页里导出成svg。十分方便。

Python

draw_convnet

Python script for illustrating Convolutional Neural Network (ConvNet)：

部分代码：

DSL

DSL 深度神经网络，支持 Torch 和 Caffe

DNNGraph - A deep neural network model generation DSL in Haskell

It consists of several parts:

• A DSL for specifying the model. This uses the lens library for elegant, composable constructions, and the fgl graph library for specifying the network layout.

• A set of optimization passes that run over the graph representation to improve the performance of the model. For example, we can take advantage of the fact that several layers types (ReLU, Dropout) can operate in-place.

• A set of backends to generate code for the platform. Currently, we generate

• Caffe (by generating model prototxt files)

• Torch (by generating Lua scripts)

• A set of useful CLI tools for exporting, visualizing and understanding a model (visualization of network structure, parameter density)

DSL Examples：

（部分）

Joseph Paul Cohen Ph.D

* Postdoctoral Fellow at Montreal Institute for Learning Algorithms at University of Montreal

* Friend of the Farlow Fellow at Harvard University

* National Science Foundation Graduate Fellow

Visualizing CNN architectures side by side with mxnet

Convolutional Neural Networks can be visualized as computation graphs with input nodes where the computation starts and output nodes where the result can be read. Here the models that are provided with mxnet are compared using the mx.viz.plot_network method. The output node is at the top and the input node is at the bottom.

（部分）

Python + Graphviz

针对节点较多的网络，不可避免需要投入大量时间来写重复的脚本代码。用python编写了一个简单的dot脚本生成工具（MakeNN），可以很方便的输入参数生成nn结构图。

部分代码：

Graphviz - dot

在dot里面label的玩法比较多，在上面看到的每个节点都是简单的一段文字，如果想要比较复杂的结构怎么办？如下图：

对应的代码如下：

这个还不算厉害的，label还支持HTML格式的，这样你能想得到的大部分样子的节点都可以被定义出来了：

对应的代码如下：

接着来看cluster的概念，在dot中以cluster开头的子图会被当做是一个新的布局来处理，而不是在原图的基础上继续操作。比如：

对应的代码如下：

如果没有cluster的话我们大概能想象的出来最后的结果是什么样子的。可能会想能不能将一个节点直接指向cluster？答案是不能！对于这种需求可以用lhead来搞定：

生成图片如下：

Keras

使用Keras框架（后端可选tensorflow或者theano），可以画出卷积神经网络的结构图。

from keras.layers import Input, Convolution2D, Flatten, Dense, Activationfrom keras.models import Sequentialfrom keras.optimizers import SGD , Adamfrom keras.initializations import normalfrom keras.utils.visualize_util import plot# apply a 3x3 convolution with 64 output filters on a 256x256 image:model = Sequential()

from keras.layers import Input, Convolution2D, MaxPooling2D, Flatten, Dense
from keras.models import Model
from keras.utils.visualize_util import plotinputs = Input(shape=(229, 229, 3))x = Convolution2D(32, 3, 3, subsample=(2, 2), border_mode='valid', dim_ordering='tf')(inputs)x = Flatten()(x)loss = Dense(32, activation='relu', name='loss')(x)model = Model(input=inputs, output=loss)model.compile(optimizer='rmsprop', loss='binary_crossentropy')# visualize model layout with pydot_ngplot(model, to_file='model2.png', show_shapes=True)

from keras.layers import Input, Convolution2D, Flatten, Dense, Activationfrom keras.models import Sequentialfrom keras.optimizers import SGD , Adamfrom keras.initializations import normalfrom keras.utils.visualize_util import plot

Netscope

Netscope是个支持prototxt格式描述的神经网络结构的在线可视工具，地址：

http://ethereon.github.io/netscope/quickstart.html

它可以用来可视化Caffe结构里prototxt格式的网络结构。地址：

http://ethereon.github.io/netscope/#/editor

点击Launch Editor，把你描述神经网络结构的prototxt文件复制到该编辑框里，按shift＋enter，就可以直接以图形方式显示网络的结构。

比如,以mnist的LeNet网络结构为例，把Caffe中example/mnist/lenet_train_test.prototxt文件的内容复制到编译框，按shift + enter,立即就可以得到可视化的结构图。

Keras

Python/draw_net.py, 这个文件，就是用来绘制网络模型的。也就是将网络模型由prototxt变成一张图片。

绘制Lenet模型

# sudo python python/draw_net.py examples/mnist/lenet_train_test.prototxt netImage/lenet.png --rankdir=TB

（部分）

Keras