Manoj Rao bio photo

Manoj Rao

Your Average Common Man

Email Twitter Github

Train the Neural Network

  • This is where all the previous parts of the Crash Course come together.
  • Follow along from previous post
  • Train the previously defined network with data
from mxnet import nd, gluon, init, autograd
from mxnet.gluon import nn
from mxnet.gluon.data.vision import datasets, transforms
from IPython import display
import matplotlib.pyplot as plt
import time
import mxnet as mx
from mxnet import profiler
profiler.set_config(profile_all=True, aggregate_stats=True, filename='profile_output.json')

Get Data

  • Handwritten digit MNIST dataset is commonly used datasets in deep learning. But it is rather simple.
  • In this case, we use more complicated dataset called FashionMNIST.
  • Goal is to classify clothing type.
  • Dataset can be automatically downloaded through Gluon’s data.vision.datasets module.
mnist_train = datasets.FashionMNIST(train=True)
X, y = mnist_train[0]
('X shape: ', X.shape, 'X dtype', X.dtype, 'y:', y)
('X shape: ', (28, 28, 1), 'X dtype', numpy.uint8, 'y:', 2)
  • Each example in the dataset is a 28x28 grey image presented as NDArray with the shape of format (height, width, channel)
text_labels = ['t-shirt', 'trouser', 'pullover', 'dress', 'coat', 'sandal', 'shirt', 'sneaker', 'bag', 'ankle boot']

X, y = mnist_train[0:10]

# plot images
display.set_matplotlib_formats('png')
_, figs = plt.subplots(1, X.shape[0], figsize=(15, 15))
for f, x, yi in zip (figs, X, y):
    # 3D -> 2D by removing the last channel dim
    f.imshow(x.reshape((28, 28)).asnumpy())
    ax = f.axes
    ax.set_title(text_labels[int(yi)])
    ax.title.set_fontsize(14)
    ax.get_xaxis().set_visible(False)
    ax.get_yaxis().set_visible(False)
plt.show()

png

  • To feed data into Gluon model, we need to convert the images to (channel, height, width) format. This can be done with transforms.ToTensor().
  • We also need to normalize all pixel values with a mean value of 0.13 and std_dev of 0.31. This can be done with transforms.Normalize()
  • We can chain these transforms together and apply it to the first element of the data pair.
transformer = transforms.Compose([
    transforms.ToTensor(),
    transforms.Normalize(0.13, 0.31)]  
)

mnist_train = mnist_train.transform_first(transformer)
  • FashionMNIST is a subclass of gluon.data.Dataset which defines how to get the i-th example.
  • Here we use gluon.data.DataLoader and spin off 4 worker threads to process data in paralle.
batch_size = 256
train_data = gluon.data.DataLoader(
            mnist_train, batch_size=batch_size, shuffle=True, num_workers=4)
  • The returned train_data is an iteratable object that yields batches of images and label pairs.
for data, label in train_data:
    print(data.shape, label.shape)
    break

(256, 1, 28, 28) (256,)
  • Finally, we create a validation dataset and data loader
mnist_valid = gluon.data.vision.FashionMNIST(train=False)
valid_data = gluon.data.DataLoader(
    mnist_valid.transform_first(transformer),
    batch_size=batch_size, num_workers=4)

Define the Model

  • We reimplement the same LeNet model introduced before.
  • The difference here is that the weight initialization method is changed to Xavier which is a popular choice for deep convolutional neural network
net = nn.Sequential()

net.add(
    nn.Conv2D(channels=6, kernel_size=5, activation='relu'),
    nn.MaxPool2D(pool_size=2, strides=2),
    nn.Conv2D(channels=16, kernel_size=3, activation='relu'),
    nn.MaxPool2D(pool_size=2, strides=2),
    nn.Flatten(),
    nn.Dense(120, activation="relu"),
    nn.Dense(84, activation="relu"),
    nn.Dense(10)
)

net.initialize(init=init.Xavier())
  • That was the network and it’s layers, now we need to define the loss function and optimization method for training
  • We will use standard softmax cross entropy loss for classification problems.
  • It first performs softmax on the output to obtain the prdeicted probability, and then compares the label with the cross entropy (one-hot encoding I think)
  • Also, note that this is the same done in the Udacity class.
softmax_cross_entropy = gluon.loss.SoftmaxCrossEntropyLoss()
  • Optimization Method is the standard stochastic gradient descent with constant learning rate of 0.1
# This code is failing in mxnet 1.2.1
trainer = gluon.Trainer(net.collect_params(), 'sgd', {'learning_rate' : 0.1, 'lazy_update': False})#, lazy_update=True)
  • The trainer is created with all params (weights and gradients) in net.
  • From now on, we need to only call step() method to update its weights.

Train

  • We create an auxiliary function to calculate the model accuracy
def acc(output, label):
    # output: (batch, num_output) float32 ndarray
    # label: (batch, ) int32 ndarray
    return (output.argmax(axis=1) ==
           label.astype('float32')).mean().asscalar()
  • Implement the complete training loop
#mx.profiler.set_config(profile_all=True, aggregate_stats=True, filename='profile_output_test.json')

#mx.profiler.set_config(filename='profile_output_test.json')
count = 0
mx.profiler.set_state('run')
for epoch in range(2):
    train_loss, train_acc, valid_acc = 0., 0., 0.
    tic = time.time()
    for data, label in train_data:
        # forward + backward
        with autograd.record():
            output = net(data)
            loss = softmax_cross_entropy(output, label)
        loss.backward()
        # update parameters
        trainer.step(batch_size)#, lazy_update=True)
        # calculate training metrics
        train_loss += loss.mean().asscalar()
        train_acc += acc(output, label)
        mx.nd.waitall()
        print(mx.profiler.dumps())
        #mx.profiler.pause()
        count += 1
    # calc validation accuracy
    for data, label in valid_data:
        valid_acc += acc(net(data), label)
    print("Epoch %d: loss %.3f, train_acc %.3f, test acc %.3f, in %.1f sec" % (
        epoch, train_loss/len(train_data), train_acc/len(train_data),
        valid_acc/len(valid_data), time.time() - tic
        )
    )

mx.profiler.set_state('stop')
Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       37254       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3306        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             470        1871.0150           0.3060          73.5850           3.9809
MXNDArrayCreateEx                     551          18.8610           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      471       10161.7070           5.6130          24.8060          21.5747
MXNDArraySyncCopyToCPU               1022        8066.7949           0.1180          24.1980           7.8931
MXNDArrayGetDType                    1022           0.3560           0.0000           0.0010           0.0003
MXNDArrayGetShape                    2595           1.2030           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1102           9.6770           0.0070           0.0280           0.0088
MXNDArrayFree                       12273         125.5670           0.0000           0.9140           0.0102
MXNet C API Calls                   54797         542.1540         487.3580         542.1540          27.3980
MXNet C API Concurrency            109593           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording              942           0.4510           0.0000           0.0040           0.0005
MXNDArrayGetGradState                4710           2.4350           0.0000           0.0230           0.0005
MXNDArraySetGradState                4710           2.4020           0.0000           0.0010           0.0005
MXAutogradSetIsTraining               942           0.4060           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  471         256.0930           0.5250           0.6810           0.5437
MXNDArrayGetContext                  7634           3.2950           0.0000           0.0070           0.0004
MXImperativeInvokeEx                15881         403.5790           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    1884        4568.6821           0.7010           3.7330           2.4250
FullyConnected                       3306         310.2470           0.0080           0.3430           0.0938
argmax                               1102          21.4350           0.0050           0.0480           0.0195
_backward_pick                        942          14.7070           0.0130           0.0260           0.0156
_backward_mul_scalar                  942           4.0580           0.0030           0.0160           0.0043
DeleteVariable                      40560         288.3490           0.0010           0.9010           0.0071
Flatten                              1102          45.5040           0.0080           0.1120           0.0413
Activation                           4408         198.3770           0.0030           0.3430           0.0450
SetValueOp                            942           6.0010           0.0050           0.0180           0.0064
pick                                  942           7.3280           0.0060           0.0280           0.0078
Pooling                              2204        3013.7991           0.0640           3.1720           1.3674
Convolution                          2204       12509.4717           0.2260          13.2050           5.6758
CopyCPU2CPU                          1102           6.3130           0.0030           0.0340           0.0057
log_softmax                           942          28.8560           0.0150           0.0500           0.0306
_backward_copy                        942          48.3820           0.0220           0.0760           0.0514
_backward_Convolution                1884       17332.5391           2.6370          12.4340           9.1999
_mul_scalar                           942           3.3120           0.0020           0.0230           0.0035
_backward_log_softmax                 942          15.6330           0.0090           0.0400           0.0166
mean                                 2986          56.8470           0.0080           0.0530           0.0190
_backward_mean                        942          10.2220           0.0080           0.1030           0.0109
_backward_FullyConnected             2826         522.7040           0.0280           0.5940           0.1850
WaitForVar                           2044          18.0920           0.0060           0.0280           0.0089
broadcast_equal                      1102           5.4350           0.0030           0.0100           0.0049
sgd_update                           9420          90.5080           0.0020           0.0640           0.0096
_backward_Activation                 3768         274.3250           0.0070           0.3900           0.0728



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       37328       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3312        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             471        1875.0341           0.3060          73.5850           3.9810
MXNDArrayCreateEx                     552          18.8960           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      472       10186.3789           5.6130          24.8060          21.5813
MXNDArraySyncCopyToCPU               1024        8084.5708           0.1180          24.1980           7.8951
MXNDArrayGetDType                    1024           0.3570           0.0000           0.0010           0.0003
MXNDArrayGetShape                    2600           1.2040           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1104           9.6960           0.0070           0.0280           0.0088
MXNDArrayFree                       12296         125.8260           0.0000           0.9140           0.0102
MXNet C API Calls                   54904         542.2610         487.3580         542.2610          27.4515
MXNet C API Concurrency            109807           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording              944           0.4520           0.0000           0.0040           0.0005
MXNDArrayGetGradState                4720           2.4640           0.0000           0.0230           0.0005
MXNDArraySetGradState                4720           2.4080           0.0000           0.0010           0.0005
MXAutogradSetIsTraining               944           0.4080           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  472         256.6920           0.5250           0.6810           0.5438
MXNDArrayGetContext                  7648           3.3010           0.0000           0.0070           0.0004
MXImperativeInvokeEx                15912         404.4320           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    1888        4580.9038           0.7010           3.7500           2.4263
FullyConnected                       3312         311.1820           0.0080           0.3430           0.0940
argmax                               1104          21.4860           0.0050           0.0480           0.0195
_backward_pick                        944          14.7450           0.0130           0.0260           0.0156
_backward_mul_scalar                  944           4.0670           0.0030           0.0160           0.0043
DeleteVariable                      40640         288.9830           0.0010           0.9010           0.0071
Flatten                              1104          45.6010           0.0080           0.1120           0.0413
Activation                           4416         198.9590           0.0030           0.3430           0.0451
SetValueOp                            944           6.0180           0.0050           0.0180           0.0064
pick                                  944           7.3470           0.0060           0.0280           0.0078
Pooling                              2208        3023.3240           0.0640           3.1720           1.3693
Convolution                          2208       12531.7891           0.2260          13.2050           5.6756
CopyCPU2CPU                          1104           6.3250           0.0030           0.0340           0.0057
log_softmax                           944          28.9380           0.0150           0.0500           0.0307
_backward_copy                        944          48.4900           0.0220           0.0760           0.0514
_backward_Convolution                1888       17373.5645           2.6370          12.4520           9.2021
_mul_scalar                           944           3.3220           0.0020           0.0230           0.0035
_backward_log_softmax                 944          15.6810           0.0090           0.0400           0.0166
mean                                 2992          56.9790           0.0080           0.0530           0.0190
_backward_mean                        944          10.2490           0.0080           0.1030           0.0109
_backward_FullyConnected             2832         524.4380           0.0280           0.5940           0.1852
WaitForVar                           2048          18.1350           0.0060           0.0280           0.0089
broadcast_equal                      1104           5.4480           0.0030           0.0100           0.0049
sgd_update                           9440          90.8100           0.0020           0.0640           0.0096
_backward_Activation                 3776         275.1580           0.0070           0.3900           0.0729



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       37402       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3318        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             472        1878.9390           0.3060          73.5850           3.9808
MXNDArrayCreateEx                     553          18.9300           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      473       10210.9893           5.6130          24.8060          21.5877
MXNDArraySyncCopyToCPU               1026        8102.4761           0.1180          24.1980           7.8972
MXNDArrayGetDType                    1026           0.3580           0.0000           0.0010           0.0003
MXNDArrayGetShape                    2605           1.2070           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1106           9.7130           0.0070           0.0280           0.0088
MXNDArrayFree                       12319         126.0700           0.0000           0.9140           0.0102
MXNet C API Calls                   55011         542.3680         487.3580         542.3680          27.5050
MXNet C API Concurrency            110021           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording              946           0.4530           0.0000           0.0040           0.0005
MXNDArrayGetGradState                4730           2.4690           0.0000           0.0230           0.0005
MXNDArraySetGradState                4730           2.4160           0.0000           0.0010           0.0005
MXAutogradSetIsTraining               946           0.4100           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  473         257.2280           0.5250           0.6810           0.5438
MXNDArrayGetContext                  7662           3.3070           0.0000           0.0070           0.0004
MXImperativeInvokeEx                15943         405.2070           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    1892        4593.1709           0.7010           3.7500           2.4277
FullyConnected                       3318         312.0800           0.0080           0.3430           0.0941
argmax                               1106          21.5360           0.0050           0.0480           0.0195
_backward_pick                        946          14.7810           0.0130           0.0260           0.0156
_backward_mul_scalar                  946           4.0750           0.0030           0.0160           0.0043
DeleteVariable                      40720         289.5980           0.0010           0.9010           0.0071
Flatten                              1106          45.6820           0.0080           0.1120           0.0413
Activation                           4424         199.4900           0.0030           0.3430           0.0451
SetValueOp                            946           6.0340           0.0050           0.0180           0.0064
pick                                  946           7.3660           0.0060           0.0280           0.0078
Pooling                              2212        3032.7900           0.0640           3.1720           1.3711
Convolution                          2212       12554.0596           0.2260          13.2050           5.6754
CopyCPU2CPU                          1106           6.3360           0.0030           0.0340           0.0057
log_softmax                           946          29.0150           0.0150           0.0500           0.0307
_backward_copy                        946          48.5880           0.0220           0.0760           0.0514
_backward_Convolution                1892       17414.5625           2.6370          12.4700           9.2043
_mul_scalar                           946           3.3300           0.0020           0.0230           0.0035
_backward_log_softmax                 946          15.7280           0.0090           0.0400           0.0166
mean                                 2998          57.1040           0.0080           0.0530           0.0190
_backward_mean                        946          10.2750           0.0080           0.1030           0.0109
_backward_FullyConnected             2838         526.1290           0.0280           0.5940           0.1854
WaitForVar                           2052          18.1760           0.0060           0.0280           0.0089
broadcast_equal                      1106           5.4600           0.0030           0.0100           0.0049
sgd_update                           9460          91.0470           0.0020           0.0640           0.0096
_backward_Activation                 3784         276.0180           0.0070           0.3900           0.0729



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       37476       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3324        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             473        1882.8390           0.3060          73.5850           3.9806
MXNDArrayCreateEx                     554          18.9640           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      474       10235.7041           5.6130          24.8060          21.5943
MXNDArraySyncCopyToCPU               1028        8120.3311           0.1180          24.1980           7.8992
MXNDArrayGetDType                    1028           0.3580           0.0000           0.0010           0.0003
MXNDArrayGetShape                    2610           1.2100           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1108           9.7290           0.0070           0.0280           0.0088
MXNDArrayFree                       12342         126.2940           0.0000           0.9140           0.0102
MXNet C API Calls                   55118         542.4750         487.3580         542.4750          27.5585
MXNet C API Concurrency            110235           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording              948           0.4540           0.0000           0.0040           0.0005
MXNDArrayGetGradState                4740           2.4750           0.0000           0.0230           0.0005
MXNDArraySetGradState                4740           2.4200           0.0000           0.0010           0.0005
MXAutogradSetIsTraining               948           0.4110           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  474         257.7610           0.5250           0.6810           0.5438
MXNDArrayGetContext                  7676           3.3120           0.0000           0.0070           0.0004
MXImperativeInvokeEx                15974         405.9780           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    1896        4605.3428           0.7010           3.7500           2.4290
FullyConnected                       3324         312.9420           0.0080           0.3430           0.0941
argmax                               1108          21.5850           0.0050           0.0480           0.0195
_backward_pick                        948          14.8160           0.0130           0.0260           0.0156
_backward_mul_scalar                  948           4.0840           0.0030           0.0160           0.0043
DeleteVariable                      40800         290.1710           0.0010           0.9010           0.0071
Flatten                              1108          45.7640           0.0080           0.1120           0.0413
Activation                           4432         200.0210           0.0030           0.3430           0.0451
SetValueOp                            948           6.0500           0.0050           0.0180           0.0064
pick                                  948           7.3840           0.0060           0.0280           0.0078
Pooling                              2216        3042.2451           0.0640           3.1720           1.3729
Convolution                          2216       12576.2920           0.2260          13.2050           5.6752
CopyCPU2CPU                          1108           6.3470           0.0030           0.0340           0.0057
log_softmax                           948          29.0910           0.0150           0.0500           0.0307
_backward_copy                        948          48.6840           0.0220           0.0760           0.0514
_backward_Convolution                1896       17455.7207           2.6370          12.5610           9.2066
_mul_scalar                           948           3.3390           0.0020           0.0230           0.0035
_backward_log_softmax                 948          15.7740           0.0090           0.0400           0.0166
mean                                 3004          57.2470           0.0080           0.0530           0.0191
_backward_mean                        948          10.3010           0.0080           0.1030           0.0109
_backward_FullyConnected             2844         527.8120           0.0280           0.5940           0.1856
WaitForVar                           2056          18.2170           0.0060           0.0280           0.0089
broadcast_equal                      1108           5.4720           0.0030           0.0100           0.0049
sgd_update                           9480          91.3450           0.0020           0.0640           0.0096
_backward_Activation                 3792         276.8340           0.0070           0.3900           0.0730



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       37550       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3330        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             474        1886.7330           0.3060          73.5850           3.9804
MXNDArrayCreateEx                     555          18.9970           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      475       10260.2012           5.6130          24.8060          21.6004
MXNDArraySyncCopyToCPU               1030        8138.1699           0.1180          24.1980           7.9011
MXNDArrayGetDType                    1030           0.3590           0.0000           0.0010           0.0003
MXNDArrayGetShape                    2615           1.2130           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1110           9.7460           0.0070           0.0280           0.0088
MXNDArrayFree                       12365         126.5300           0.0000           0.9140           0.0102
MXNet C API Calls                   55225         542.5820         487.3580         542.5820          27.6120
MXNet C API Concurrency            110449           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording              950           0.4560           0.0000           0.0040           0.0005
MXNDArrayGetGradState                4750           2.4800           0.0000           0.0230           0.0005
MXNDArraySetGradState                4750           2.4240           0.0000           0.0010           0.0005
MXAutogradSetIsTraining               950           0.4120           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  475         258.2930           0.5250           0.6810           0.5438
MXNDArrayGetContext                  7690           3.3180           0.0000           0.0070           0.0004
MXImperativeInvokeEx                16005         406.7510           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    1900        4617.3179           0.7010           3.7500           2.4302
FullyConnected                       3330         313.8490           0.0080           0.3430           0.0942
argmax                               1110          21.6350           0.0050           0.0480           0.0195
_backward_pick                        950          14.8510           0.0130           0.0260           0.0156
_backward_mul_scalar                  950           4.0920           0.0030           0.0160           0.0043
DeleteVariable                      40880         290.7580           0.0010           0.9010           0.0071
Flatten                              1110          45.8430           0.0080           0.1120           0.0413
Activation                           4440         200.5530           0.0030           0.3430           0.0452
SetValueOp                            950           6.0630           0.0050           0.0180           0.0064
pick                                  950           7.4030           0.0060           0.0280           0.0078
Pooling                              2220        3051.7500           0.0640           3.1720           1.3747
Convolution                          2220       12598.4551           0.2260          13.2050           5.6750
CopyCPU2CPU                          1110           6.3590           0.0030           0.0340           0.0057
log_softmax                           950          29.1680           0.0150           0.0500           0.0307
_backward_copy                        950          48.7830           0.0220           0.0760           0.0514
_backward_Convolution                1900       17496.6133           2.6370          12.5610           9.2087
_mul_scalar                           950           3.3470           0.0020           0.0230           0.0035
_backward_log_softmax                 950          15.8230           0.0090           0.0400           0.0167
mean                                 3010          57.3710           0.0080           0.0530           0.0191
_backward_mean                        950          10.3260           0.0080           0.1030           0.0109
_backward_FullyConnected             2850         529.5070           0.0280           0.5940           0.1858
WaitForVar                           2060          18.2580           0.0060           0.0280           0.0089
broadcast_equal                      1110           5.4850           0.0030           0.0100           0.0049
sgd_update                           9500          91.5800           0.0020           0.0640           0.0096
_backward_Activation                 3800         277.6920           0.0070           0.3900           0.0731



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       37624       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3336        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             475        1890.6300           0.3060          73.5850           3.9803
MXNDArrayCreateEx                     556          19.0310           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      476       10284.6680           5.6130          24.8060          21.6064
MXNDArraySyncCopyToCPU               1032        8155.9102           0.1180          24.1980           7.9030
MXNDArrayGetDType                    1032           0.3600           0.0000           0.0010           0.0003
MXNDArrayGetShape                    2620           1.2160           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1112           9.7620           0.0070           0.0280           0.0088
MXNDArrayFree                       12388         126.7740           0.0000           0.9140           0.0102
MXNet C API Calls                   55332         542.6890         487.3580         542.6890          27.6655
MXNet C API Concurrency            110663           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording              952           0.4570           0.0000           0.0040           0.0005
MXNDArrayGetGradState                4760           2.4850           0.0000           0.0230           0.0005
MXNDArraySetGradState                4760           2.4280           0.0000           0.0010           0.0005
MXAutogradSetIsTraining               952           0.4140           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  476         258.8260           0.5250           0.6810           0.5438
MXNDArrayGetContext                  7704           3.3250           0.0000           0.0070           0.0004
MXImperativeInvokeEx                16036         407.5240           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    1904        4629.4180           0.7010           3.7500           2.4314
FullyConnected                       3336         314.7580           0.0080           0.3430           0.0944
argmax                               1112          21.6840           0.0050           0.0480           0.0195
_backward_pick                        952          14.8870           0.0130           0.0260           0.0156
_backward_mul_scalar                  952           4.1010           0.0030           0.0160           0.0043
DeleteVariable                      40960         291.3630           0.0010           0.9010           0.0071
Flatten                              1112          45.9230           0.0080           0.1120           0.0413
Activation                           4448         201.0880           0.0030           0.3430           0.0452
SetValueOp                            952           6.0770           0.0050           0.0180           0.0064
pick                                  952           7.4220           0.0060           0.0280           0.0078
Pooling                              2224        3061.1689           0.0640           3.1720           1.3764
Convolution                          2224       12620.4971           0.2260          13.2050           5.6747
CopyCPU2CPU                          1112           6.3700           0.0030           0.0340           0.0057
log_softmax                           952          29.2460           0.0150           0.0500           0.0307
_backward_copy                        952          48.8810           0.0220           0.0760           0.0513
_backward_Convolution                1904       17537.3711           2.6370          12.5610           9.2108
_mul_scalar                           952           3.3570           0.0020           0.0230           0.0035
_backward_log_softmax                 952          15.8690           0.0090           0.0400           0.0167
mean                                 3016          57.4970           0.0080           0.0530           0.0191
_backward_mean                        952          10.3530           0.0080           0.1030           0.0109
_backward_FullyConnected             2856         531.2060           0.0280           0.5940           0.1860
WaitForVar                           2064          18.2990           0.0060           0.0280           0.0089
broadcast_equal                      1112           5.4970           0.0030           0.0100           0.0049
sgd_update                           9520          91.8800           0.0020           0.0640           0.0097
_backward_Activation                 3808         278.5000           0.0070           0.3900           0.0731



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       37698       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3342        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             476        1894.5330           0.3060          73.5850           3.9801
MXNDArrayCreateEx                     557          19.0640           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      477       10306.4551           5.6130          24.8060          21.6068
MXNDArraySyncCopyToCPU               1034        8173.7222           0.1180          24.1980           7.9050
MXNDArrayGetDType                    1034           0.3610           0.0000           0.0010           0.0003
MXNDArrayGetShape                    2625           1.2190           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1114           9.7780           0.0070           0.0280           0.0088
MXNDArrayFree                       12411         127.0040           0.0000           0.9140           0.0102
MXNet C API Calls                   55439         542.7960         487.3580         542.7960          27.7190
MXNet C API Concurrency            110877           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording              954           0.4590           0.0000           0.0040           0.0005
MXNDArrayGetGradState                4770           2.4860           0.0000           0.0230           0.0005
MXNDArraySetGradState                4770           2.4310           0.0000           0.0010           0.0005
MXAutogradSetIsTraining               954           0.4150           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  477         259.3590           0.5250           0.6810           0.5437
MXNDArrayGetContext                  7718           3.3290           0.0000           0.0070           0.0004
MXImperativeInvokeEx                16067         408.3020           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    1908        4640.1870           0.7010           3.7500           2.4320
FullyConnected                       3342         315.7010           0.0080           0.3430           0.0945
argmax                               1114          21.7330           0.0050           0.0480           0.0195
_backward_pick                        954          14.9230           0.0130           0.0260           0.0156
_backward_mul_scalar                  954           4.1100           0.0030           0.0160           0.0043
DeleteVariable                      41040         291.9310           0.0010           0.9010           0.0071
Flatten                              1114          46.0020           0.0080           0.1120           0.0413
Activation                           4456         201.6200           0.0030           0.3430           0.0452
SetValueOp                            954           6.0920           0.0050           0.0180           0.0064
pick                                  954           7.4400           0.0060           0.0280           0.0078
Pooling                              2228        3070.5801           0.0640           3.1720           1.3782
Convolution                          2228       12642.6738           0.2260          13.2050           5.6744
CopyCPU2CPU                          1114           6.3810           0.0030           0.0340           0.0057
log_softmax                           954          29.3250           0.0150           0.0500           0.0307
_backward_copy                        954          48.9790           0.0220           0.0760           0.0513
_backward_Convolution                1908       17574.3574           2.6370          12.5610           9.2109
_mul_scalar                           954           3.3660           0.0020           0.0230           0.0035
_backward_log_softmax                 954          15.9150           0.0090           0.0400           0.0167
mean                                 3022          57.7010           0.0080           0.0730           0.0191
_backward_mean                        954          10.3790           0.0080           0.1030           0.0109
_backward_FullyConnected             2862         532.8900           0.0280           0.5940           0.1862
WaitForVar                           2068          18.3410           0.0060           0.0280           0.0089
broadcast_equal                      1114           5.5080           0.0030           0.0100           0.0049
sgd_update                           9540          92.1640           0.0020           0.0640           0.0097
_backward_Activation                 3816         279.0540           0.0070           0.3900           0.0731



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       37772       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3348        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             477        1898.4270           0.3060          73.5850           3.9799
MXNDArrayCreateEx                     558          19.0980           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      478       10328.3584           5.6130          24.8060          21.6074
MXNDArraySyncCopyToCPU               1036        8188.5991           0.1180          24.1980           7.9041
MXNDArrayGetDType                    1036           0.3620           0.0000           0.0010           0.0003
MXNDArrayGetShape                    2630           1.2210           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1116           9.7940           0.0070           0.0280           0.0088
MXNDArrayFree                       12434         127.2420           0.0000           0.9140           0.0102
MXNet C API Calls                   55546         542.9030         487.3580         542.9030          27.7725
MXNet C API Concurrency            111091           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording              956           0.4590           0.0000           0.0040           0.0005
MXNDArrayGetGradState                4780           2.4910           0.0000           0.0230           0.0005
MXNDArraySetGradState                4780           2.4370           0.0000           0.0010           0.0005
MXAutogradSetIsTraining               956           0.4150           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  478         259.9130           0.5250           0.6810           0.5438
MXNDArrayGetContext                  7732           3.3360           0.0000           0.0070           0.0004
MXImperativeInvokeEx                16098         409.1020           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    1912        4649.9570           0.7010           3.7500           2.4320
FullyConnected                       3348         316.4840           0.0080           0.3430           0.0945
argmax                               1116          21.7790           0.0050           0.0480           0.0195
_backward_pick                        956          14.9580           0.0130           0.0260           0.0156
_backward_mul_scalar                  956           4.1200           0.0030           0.0160           0.0043
DeleteVariable                      41120         292.4930           0.0010           0.9010           0.0071
Flatten                              1116          46.1070           0.0080           0.1120           0.0413
Activation                           4464         202.0210           0.0030           0.3430           0.0453
SetValueOp                            956           6.1050           0.0050           0.0180           0.0064
pick                                  956           7.4570           0.0060           0.0280           0.0078
Pooling                              2232        3075.9619           0.0640           3.1720           1.3781
Convolution                          2232       12665.0479           0.2260          13.2050           5.6743
CopyCPU2CPU                          1116           6.3920           0.0030           0.0340           0.0057
log_softmax                           956          29.3990           0.0150           0.0500           0.0308
_backward_copy                        956          49.0890           0.0220           0.0760           0.0513
_backward_Convolution                1912       17611.4609           2.6370          12.5610           9.2110
_mul_scalar                           956           3.3730           0.0020           0.0230           0.0035
_backward_log_softmax                 956          15.9580           0.0090           0.0400           0.0167
mean                                 3028          57.8130           0.0080           0.0730           0.0191
_backward_mean                        956          10.4030           0.0080           0.1030           0.0109
_backward_FullyConnected             2868         534.3260           0.0280           0.5940           0.1863
WaitForVar                           2072          18.3790           0.0060           0.0280           0.0089
broadcast_equal                      1116           5.5190           0.0030           0.0100           0.0049
sgd_update                           9560          92.3800           0.0020           0.0640           0.0097
_backward_Activation                 3824         279.7460           0.0070           0.3900           0.0732



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       37846       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3354        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             478        1902.3521           0.3060          73.5850           3.9798
MXNDArrayCreateEx                     559          19.1330           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      479       10350.1650           5.6130          24.8060          21.6079
MXNDArraySyncCopyToCPU               1038        8203.0879           0.1180          24.1980           7.9028
MXNDArrayGetDType                    1038           0.3630           0.0000           0.0010           0.0003
MXNDArrayGetShape                    2635           1.2230           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1118           9.8120           0.0070           0.0280           0.0088
MXNDArrayFree                       12457         127.4740           0.0000           0.9140           0.0102
MXNet C API Calls                   55653         543.0100         487.3580         543.0100          27.8260
MXNet C API Concurrency            111305           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording              958           0.4600           0.0000           0.0040           0.0005
MXNDArrayGetGradState                4790           2.4980           0.0000           0.0230           0.0005
MXNDArraySetGradState                4790           2.4430           0.0000           0.0010           0.0005
MXAutogradSetIsTraining               958           0.4160           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  479         260.4790           0.5250           0.6810           0.5438
MXNDArrayGetContext                  7746           3.3410           0.0000           0.0070           0.0004
MXImperativeInvokeEx                16129         409.8880           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    1916        4659.7612           0.7010           3.7500           2.4320
FullyConnected                       3354         317.0450           0.0080           0.3430           0.0945
argmax                               1118          21.8180           0.0050           0.0480           0.0195
_backward_pick                        958          14.9910           0.0130           0.0260           0.0156
_backward_mul_scalar                  958           4.1290           0.0030           0.0160           0.0043
DeleteVariable                      41200         293.0230           0.0010           0.9010           0.0071
Flatten                              1118          46.2000           0.0080           0.1120           0.0413
Activation                           4472         202.3860           0.0030           0.3430           0.0453
SetValueOp                            958           6.1190           0.0050           0.0180           0.0064
pick                                  958           7.4730           0.0060           0.0280           0.0078
Pooling                              2236        3081.3879           0.0640           3.1720           1.3781
Convolution                          2236       12687.3555           0.2260          13.2050           5.6741
CopyCPU2CPU                          1118           6.4010           0.0030           0.0340           0.0057
log_softmax                           958          29.4600           0.0150           0.0500           0.0308
_backward_copy                        958          49.2000           0.0220           0.0760           0.0514
_backward_Convolution                1916       17648.3145           2.6370          12.5610           9.2110
_mul_scalar                           958           3.3810           0.0020           0.0230           0.0035
_backward_log_softmax                 958          15.9900           0.0090           0.0400           0.0167
mean                                 3034          57.9320           0.0080           0.0730           0.0191
_backward_mean                        958          10.4250           0.0080           0.1030           0.0109
_backward_FullyConnected             2874         535.4190           0.0280           0.5940           0.1863
WaitForVar                           2076          18.4160           0.0060           0.0280           0.0089
broadcast_equal                      1118           5.5300           0.0030           0.0100           0.0049
sgd_update                           9580          92.5870           0.0020           0.0640           0.0097
_backward_Activation                 3832         280.2830           0.0070           0.3900           0.0731



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       37920       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3360        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             479        1906.2570           0.3060          73.5850           3.9797
MXNDArrayCreateEx                     560          19.1670           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      480       10371.8340           5.6130          24.8060          21.6080
MXNDArraySyncCopyToCPU               1040        8217.5303           0.1180          24.1980           7.9015
MXNDArrayGetDType                    1040           0.3640           0.0000           0.0010           0.0003
MXNDArrayGetShape                    2640           1.2240           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1120           9.8290           0.0070           0.0280           0.0088
MXNDArrayFree                       12480         127.6990           0.0000           0.9140           0.0102
MXNet C API Calls                   55760         543.1170         487.3580         543.1170          27.8795
MXNet C API Concurrency            111519           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording              960           0.4600           0.0000           0.0040           0.0005
MXNDArrayGetGradState                4800           2.5020           0.0000           0.0230           0.0005
MXNDArraySetGradState                4800           2.4470           0.0000           0.0010           0.0005
MXAutogradSetIsTraining               960           0.4160           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  480         261.0160           0.5250           0.6810           0.5438
MXNDArrayGetContext                  7760           3.3460           0.0000           0.0070           0.0004
MXImperativeInvokeEx                16160         410.6850           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    1920        4669.3711           0.7010           3.7500           2.4320
FullyConnected                       3360         317.6020           0.0080           0.3430           0.0945
argmax                               1120          21.8560           0.0050           0.0480           0.0195
_backward_pick                        960          15.0230           0.0130           0.0260           0.0156
_backward_mul_scalar                  960           4.1380           0.0030           0.0160           0.0043
DeleteVariable                      41280         293.5830           0.0010           0.9010           0.0071
Flatten                              1120          46.2860           0.0080           0.1120           0.0413
Activation                           4480         202.7440           0.0030           0.3430           0.0453
SetValueOp                            960           6.1330           0.0050           0.0180           0.0064
pick                                  960           7.4880           0.0060           0.0280           0.0078
Pooling                              2240        3086.7600           0.0640           3.1720           1.3780
Convolution                          2240       12709.5234           0.2260          13.2050           5.6739
CopyCPU2CPU                          1120           6.4120           0.0030           0.0340           0.0057
log_softmax                           960          29.5200           0.0150           0.0500           0.0308
_backward_copy                        960          49.3140           0.0220           0.0760           0.0514
_backward_Convolution                1920       17685.1074           2.6370          12.5610           9.2110
_mul_scalar                           960           3.3880           0.0020           0.0230           0.0035
_backward_log_softmax                 960          16.0210           0.0090           0.0400           0.0167
mean                                 3040          58.0530           0.0080           0.0730           0.0191
_backward_mean                        960          10.4460           0.0080           0.1030           0.0109
_backward_FullyConnected             2880         536.5060           0.0280           0.5940           0.1863
WaitForVar                           2080          18.4530           0.0060           0.0280           0.0089
broadcast_equal                      1120           5.5400           0.0030           0.0100           0.0049
sgd_update                           9600          92.7970           0.0020           0.0640           0.0097
_backward_Activation                 3840         280.8360           0.0070           0.3900           0.0731



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       37994       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3366        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             480        1910.1770           0.3060          73.5850           3.9795
MXNDArrayCreateEx                     561          19.2010           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      481       10393.6709           5.6130          24.8060          21.6085
MXNDArraySyncCopyToCPU               1042        8231.8750           0.1180          24.1980           7.9001
MXNDArrayGetDType                    1042           0.3650           0.0000           0.0010           0.0004
MXNDArrayGetShape                    2645           1.2250           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1122           9.8470           0.0070           0.0280           0.0088
MXNDArrayFree                       12503         127.9390           0.0000           0.9140           0.0102
MXNet C API Calls                   55867         543.2240         487.3580         543.2240          27.9330
MXNet C API Concurrency            111733           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording              962           0.4620           0.0000           0.0040           0.0005
MXNDArrayGetGradState                4810           2.5070           0.0000           0.0230           0.0005
MXNDArraySetGradState                4810           2.4530           0.0000           0.0010           0.0005
MXAutogradSetIsTraining               962           0.4160           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  481         261.5740           0.5250           0.6810           0.5438
MXNDArrayGetContext                  7774           3.3520           0.0000           0.0070           0.0004
MXImperativeInvokeEx                16191         411.5010           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    1924        4679.0889           0.7010           3.7500           2.4320
FullyConnected                       3366         318.2210           0.0080           0.3430           0.0945
argmax                               1122          21.8960           0.0050           0.0480           0.0195
_backward_pick                        962          15.0560           0.0130           0.0260           0.0157
_backward_mul_scalar                  962           4.1470           0.0030           0.0160           0.0043
DeleteVariable                      41360         294.1200           0.0010           0.9010           0.0071
Flatten                              1122          46.3730           0.0080           0.1120           0.0413
Activation                           4488         203.1050           0.0030           0.3430           0.0453
SetValueOp                            962           6.1460           0.0050           0.0180           0.0064
pick                                  962           7.5030           0.0060           0.0280           0.0078
Pooling                              2244        3092.0959           0.0640           3.1720           1.3779
Convolution                          2244       12731.8047           0.2260          13.2050           5.6737
CopyCPU2CPU                          1122           6.4220           0.0030           0.0340           0.0057
log_softmax                           962          29.5810           0.0150           0.0500           0.0307
_backward_copy                        962          49.4270           0.0220           0.0760           0.0514
_backward_Convolution                1924       17722.1211           2.6370          12.5610           9.2111
_mul_scalar                           962           3.3960           0.0020           0.0230           0.0035
_backward_log_softmax                 962          16.0530           0.0090           0.0400           0.0167
mean                                 3046          58.1730           0.0080           0.0730           0.0191
_backward_mean                        962          10.4670           0.0080           0.1030           0.0109
_backward_FullyConnected             2886         537.5930           0.0280           0.5940           0.1863
WaitForVar                           2084          18.4910           0.0060           0.0280           0.0089
broadcast_equal                      1122           5.5490           0.0030           0.0100           0.0049
sgd_update                           9620          92.9530           0.0020           0.0640           0.0097
_backward_Activation                 3848         281.4720           0.0070           0.3900           0.0731



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       38068       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3372        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             481        1914.0790           0.3060          73.5850           3.9794
MXNDArrayCreateEx                     562          19.2350           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      482       10415.5293           5.6130          24.8060          21.6090
MXNDArraySyncCopyToCPU               1044        8246.8564           0.1180          24.1980           7.8993
MXNDArrayGetDType                    1044           0.3660           0.0000           0.0010           0.0004
MXNDArrayGetShape                    2650           1.2290           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1124           9.8640           0.0070           0.0280           0.0088
MXNDArrayFree                       12526         128.1680           0.0000           0.9140           0.0102
MXNet C API Calls                   55974         543.3310         487.3580         543.3310          27.9865
MXNet C API Concurrency            111947           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording              964           0.4630           0.0000           0.0040           0.0005
MXNDArrayGetGradState                4820           2.5110           0.0000           0.0230           0.0005
MXNDArraySetGradState                4820           2.4600           0.0000           0.0010           0.0005
MXAutogradSetIsTraining               964           0.4160           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  482         262.1100           0.5250           0.6810           0.5438
MXNDArrayGetContext                  7788           3.3570           0.0000           0.0070           0.0004
MXImperativeInvokeEx                16222         412.2890           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    1928        4688.8159           0.7010           3.7500           2.4320
FullyConnected                       3372         319.0140           0.0080           0.3430           0.0946
argmax                               1124          21.9410           0.0050           0.0480           0.0195
_backward_pick                        964          15.0910           0.0130           0.0260           0.0157
_backward_mul_scalar                  964           4.1560           0.0030           0.0160           0.0043
DeleteVariable                      41440         294.6690           0.0010           0.9010           0.0071
Flatten                              1124          46.4600           0.0080           0.1120           0.0413
Activation                           4496         203.5060           0.0030           0.3430           0.0453
SetValueOp                            964           6.1600           0.0050           0.0180           0.0064
pick                                  964           7.5190           0.0060           0.0280           0.0078
Pooling                              2248        3097.4719           0.0640           3.1720           1.3779
Convolution                          2248       12754.3271           0.2260          13.2050           5.6736
CopyCPU2CPU                          1124           6.4320           0.0030           0.0340           0.0057
log_softmax                           964          29.6530           0.0150           0.0500           0.0308
_backward_copy                        964          49.5370           0.0220           0.0760           0.0514
_backward_Convolution                1928       17759.1758           2.6370          12.5610           9.2112
_mul_scalar                           964           3.4040           0.0020           0.0230           0.0035
_backward_log_softmax                 964          16.0950           0.0090           0.0400           0.0167
mean                                 3052          58.2850           0.0080           0.0730           0.0191
_backward_mean                        964          10.4890           0.0080           0.1030           0.0109
_backward_FullyConnected             2892         539.0180           0.0280           0.5940           0.1864
WaitForVar                           2088          18.5300           0.0060           0.0280           0.0089
broadcast_equal                      1124           5.5600           0.0030           0.0100           0.0049
sgd_update                           9640          93.2200           0.0020           0.0640           0.0097
_backward_Activation                 3856         282.0720           0.0070           0.3900           0.0732



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       38142       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3378        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             482        1917.9919           0.3060          73.5850           3.9792
MXNDArrayCreateEx                     563          19.2690           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      483       10437.2930           5.6130          24.8060          21.6093
MXNDArraySyncCopyToCPU               1046        8261.2256           0.1180          24.1980           7.8979
MXNDArrayGetDType                    1046           0.3670           0.0000           0.0010           0.0004
MXNDArrayGetShape                    2655           1.2300           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1126           9.8810           0.0070           0.0280           0.0088
MXNDArrayFree                       12549         128.3930           0.0000           0.9140           0.0102
MXNet C API Calls                   56081         543.4380         487.3580         543.4380          28.0400
MXNet C API Concurrency            112161           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording              966           0.4630           0.0000           0.0040           0.0005
MXNDArrayGetGradState                4830           2.5160           0.0000           0.0230           0.0005
MXNDArraySetGradState                4830           2.4640           0.0000           0.0010           0.0005
MXAutogradSetIsTraining               966           0.4160           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  483         262.6450           0.5250           0.6810           0.5438
MXNDArrayGetContext                  7802           3.3660           0.0000           0.0070           0.0004
MXImperativeInvokeEx                16253         413.0840           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    1932        4698.5371           0.7010           3.7500           2.4320
FullyConnected                       3378         319.5440           0.0080           0.3430           0.0946
argmax                               1126          21.9790           0.0050           0.0480           0.0195
_backward_pick                        966          15.1220           0.0130           0.0260           0.0157
_backward_mul_scalar                  966           4.1650           0.0030           0.0160           0.0043
DeleteVariable                      41520         295.1960           0.0010           0.9010           0.0071
Flatten                              1126          46.5470           0.0080           0.1120           0.0413
Activation                           4504         203.9200           0.0030           0.3430           0.0453
SetValueOp                            966           6.1730           0.0050           0.0180           0.0064
pick                                  966           7.5340           0.0060           0.0280           0.0078
Pooling                              2252        3102.8220           0.0640           3.1720           1.3778
Convolution                          2252       12776.6396           0.2260          13.2050           5.6735
CopyCPU2CPU                          1126           6.4420           0.0030           0.0340           0.0057
log_softmax                           966          29.7140           0.0150           0.0500           0.0308
_backward_copy                        966          49.6510           0.0220           0.0760           0.0514
_backward_Convolution                1932       17795.9961           2.6370          12.5610           9.2112
_mul_scalar                           966           3.4110           0.0020           0.0230           0.0035
_backward_log_softmax                 966          16.1260           0.0090           0.0400           0.0167
mean                                 3058          58.4010           0.0080           0.0730           0.0191
_backward_mean                        966          10.5100           0.0080           0.1030           0.0109
_backward_FullyConnected             2898         540.1030           0.0280           0.5940           0.1864
WaitForVar                           2092          18.5670           0.0060           0.0280           0.0089
broadcast_equal                      1126           5.5710           0.0030           0.0100           0.0049
sgd_update                           9660          93.4250           0.0020           0.0640           0.0097
_backward_Activation                 3864         282.6410           0.0070           0.3900           0.0731



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       38216       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3384        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             483        1921.8950           0.3060          73.5850           3.9791
MXNDArrayCreateEx                     564          19.3040           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      484       10459.0283           5.6130          24.8060          21.6096
MXNDArraySyncCopyToCPU               1048        8275.7188           0.1180          24.1980           7.8967
MXNDArrayGetDType                    1048           0.3680           0.0000           0.0010           0.0004
MXNDArrayGetShape                    2660           1.2310           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1128           9.8990           0.0070           0.0280           0.0088
MXNDArrayFree                       12572         128.6200           0.0000           0.9140           0.0102
MXNet C API Calls                   56188         543.5450         487.3580         543.5450          28.0935
MXNet C API Concurrency            112375           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording              968           0.4650           0.0000           0.0040           0.0005
MXNDArrayGetGradState                4840           2.5200           0.0000           0.0230           0.0005
MXNDArraySetGradState                4840           2.4710           0.0000           0.0010           0.0005
MXAutogradSetIsTraining               968           0.4170           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  484         263.1790           0.5250           0.6810           0.5438
MXNDArrayGetContext                  7816           3.3720           0.0000           0.0070           0.0004
MXImperativeInvokeEx                16284         413.8820           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    1936        4708.2778           0.7010           3.7500           2.4320
FullyConnected                       3384         320.1470           0.0080           0.3430           0.0946
argmax                               1128          22.0170           0.0050           0.0480           0.0195
_backward_pick                        968          15.1530           0.0130           0.0260           0.0157
_backward_mul_scalar                  968           4.1730           0.0030           0.0160           0.0043
DeleteVariable                      41600         295.7170           0.0010           0.9010           0.0071
Flatten                              1128          46.6310           0.0080           0.1120           0.0413
Activation                           4512         204.2810           0.0030           0.3430           0.0453
SetValueOp                            968           6.1870           0.0050           0.0180           0.0064
pick                                  968           7.5490           0.0060           0.0280           0.0078
Pooling                              2256        3108.2151           0.0640           3.1720           1.3778
Convolution                          2256       12798.8477           0.2260          13.2050           5.6732
CopyCPU2CPU                          1128           6.4530           0.0030           0.0340           0.0057
log_softmax                           968          29.7740           0.0150           0.0500           0.0308
_backward_copy                        968          49.7640           0.0220           0.0760           0.0514
_backward_Convolution                1936       17832.8418           2.6370          12.5610           9.2112
_mul_scalar                           968           3.4180           0.0020           0.0230           0.0035
_backward_log_softmax                 968          16.1580           0.0090           0.0400           0.0167
mean                                 3064          58.5210           0.0080           0.0730           0.0191
_backward_mean                        968          10.5320           0.0080           0.1030           0.0109
_backward_FullyConnected             2904         541.1900           0.0280           0.5940           0.1864
WaitForVar                           2096          18.6030           0.0060           0.0280           0.0089
broadcast_equal                      1128           5.5810           0.0030           0.0100           0.0049
sgd_update                           9680          93.6340           0.0020           0.0640           0.0097
_backward_Activation                 3872         283.2130           0.0070           0.3900           0.0731



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       38290       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3390        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             484        1925.7920           0.3060          73.5850           3.9789
MXNDArrayCreateEx                     565          19.3380           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      485       10470.7949           5.6130          24.8060          21.5893
MXNDArraySyncCopyToCPU               1050        8299.9111           0.1180          24.1980           7.9047
MXNDArrayGetDType                    1050           0.3680           0.0000           0.0010           0.0004
MXNDArrayGetShape                    2665           1.2320           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1130           9.9170           0.0070           0.0280           0.0088
MXNDArrayFree                       12595         128.8600           0.0000           0.9140           0.0102
MXNet C API Calls                   56295         543.6520         487.3580         543.6520          28.1470
MXNet C API Concurrency            112589           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording              970           0.4650           0.0000           0.0040           0.0005
MXNDArrayGetGradState                4850           2.5250           0.0000           0.0230           0.0005
MXNDArraySetGradState                4850           2.4740           0.0000           0.0010           0.0005
MXAutogradSetIsTraining               970           0.4180           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  485         263.7130           0.5250           0.6810           0.5437
MXNDArrayGetContext                  7830           3.3780           0.0000           0.0070           0.0004
MXImperativeInvokeEx                16315         414.6800           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    1940        4718.0620           0.7010           3.7500           2.4320
FullyConnected                       3390         320.7030           0.0080           0.3430           0.0946
argmax                               1130          22.0560           0.0050           0.0480           0.0195
_backward_pick                        970          15.1850           0.0130           0.0260           0.0157
_backward_mul_scalar                  970           4.1820           0.0030           0.0160           0.0043
DeleteVariable                      41680         296.2610           0.0010           0.9010           0.0071
Flatten                              1130          46.7220           0.0080           0.1120           0.0413
Activation                           4520         204.6430           0.0030           0.3430           0.0453
SetValueOp                            970           6.2000           0.0050           0.0180           0.0064
pick                                  970           7.5640           0.0060           0.0280           0.0078
Pooling                              2260        3113.5430           0.0640           3.1720           1.3777
Convolution                          2260       12821.0938           0.2260          13.2050           5.6731
CopyCPU2CPU                          1130           6.5230           0.0030           0.0360           0.0058
log_softmax                           970          29.8340           0.0150           0.0500           0.0308
_backward_copy                        970          49.8770           0.0220           0.0760           0.0514
_backward_Convolution                1940       17869.8516           2.6370          12.5610           9.2113
_mul_scalar                           970           3.4260           0.0020           0.0230           0.0035
_backward_log_softmax                 970          16.1890           0.0090           0.0400           0.0167
mean                                 3070          58.5980           0.0080           0.0730           0.0191
_backward_mean                        970          10.5540           0.0080           0.1030           0.0109
_backward_FullyConnected             2910         542.2780           0.0280           0.5940           0.1863
WaitForVar                           2100          18.6390           0.0060           0.0280           0.0089
broadcast_equal                      1130           5.5920           0.0030           0.0100           0.0049
sgd_update                           9700          93.7860           0.0020           0.0640           0.0097
_backward_Activation                 3880         284.1110           0.0070           0.3900           0.0732



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       38364       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3396        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             485        1929.6980           0.3060          73.5850           3.9788
MXNDArrayCreateEx                     566          19.3720           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      486       10492.6426           5.6130          24.8060          21.5898
MXNDArraySyncCopyToCPU               1052        8314.8994           0.1180          24.1980           7.9039
MXNDArrayGetDType                    1052           0.3690           0.0000           0.0010           0.0004
MXNDArrayGetShape                    2670           1.2350           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1132           9.9340           0.0070           0.0280           0.0088
MXNDArrayFree                       12618         129.0980           0.0000           0.9140           0.0102
MXNet C API Calls                   56402         543.7590         487.3580         543.7590          28.2005
MXNet C API Concurrency            112803           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording              972           0.4650           0.0000           0.0040           0.0005
MXNDArrayGetGradState                4860           2.5310           0.0000           0.0230           0.0005
MXNDArraySetGradState                4860           2.4780           0.0000           0.0010           0.0005
MXAutogradSetIsTraining               972           0.4180           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  486         264.2500           0.5250           0.6810           0.5437
MXNDArrayGetContext                  7844           3.3810           0.0000           0.0070           0.0004
MXImperativeInvokeEx                16346         415.4770           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    1944        4727.7148           0.7010           3.7500           2.4320
FullyConnected                       3396         321.4870           0.0080           0.3430           0.0947
argmax                               1132          22.1000           0.0050           0.0480           0.0195
_backward_pick                        972          15.2200           0.0130           0.0260           0.0157
_backward_mul_scalar                  972           4.1920           0.0030           0.0160           0.0043
DeleteVariable                      41760         296.8000           0.0010           0.9010           0.0071
Flatten                              1132          46.8110           0.0080           0.1120           0.0414
Activation                           4528         205.0300           0.0030           0.3430           0.0453
SetValueOp                            972           6.2140           0.0050           0.0180           0.0064
pick                                  972           7.5820           0.0060           0.0280           0.0078
Pooling                              2264        3118.9360           0.0640           3.1720           1.3776
Convolution                          2264       12843.6084           0.2260          13.2050           5.6730
CopyCPU2CPU                          1132           6.5330           0.0030           0.0360           0.0058
log_softmax                           972          29.9070           0.0150           0.0500           0.0308
_backward_copy                        972          49.9880           0.0220           0.0760           0.0514
_backward_Convolution                1944       17906.9395           2.6370          12.5610           9.2114
_mul_scalar                           972           3.4330           0.0020           0.0230           0.0035
_backward_log_softmax                 972          16.2300           0.0090           0.0400           0.0167
mean                                 3076          58.7090           0.0080           0.0730           0.0191
_backward_mean                        972          10.5770           0.0080           0.1030           0.0109
_backward_FullyConnected             2916         543.7120           0.0280           0.5940           0.1865
WaitForVar                           2104          18.6760           0.0060           0.0280           0.0089
broadcast_equal                      1132           5.6020           0.0030           0.0100           0.0049
sgd_update                           9720          94.0670           0.0020           0.0640           0.0097
_backward_Activation                 3888         284.7250           0.0070           0.3900           0.0732



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       38438       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3402        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             486        1931.6639           0.3060          73.5850           3.9746
MXNDArrayCreateEx                     567          19.4050           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      487       10514.2939           5.6130          24.8060          21.5899
MXNDArraySyncCopyToCPU               1054        8329.3926           0.1180          24.1980           7.9026
MXNDArrayGetDType                    1054           0.3700           0.0000           0.0010           0.0004
MXNDArrayGetShape                    2675           1.2370           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1134           9.9510           0.0070           0.0280           0.0088
MXNDArrayFree                       12641         129.3240           0.0000           0.9140           0.0102
MXNet C API Calls                   56509         543.8660         487.3580         543.8660          28.2540
MXNet C API Concurrency            113017           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording              974           0.4660           0.0000           0.0040           0.0005
MXNDArrayGetGradState                4870           2.5360           0.0000           0.0230           0.0005
MXNDArraySetGradState                4870           2.4830           0.0000           0.0010           0.0005
MXAutogradSetIsTraining               974           0.4180           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  487         264.7880           0.5250           0.6810           0.5437
MXNDArrayGetContext                  7858           3.3890           0.0000           0.0070           0.0004
MXImperativeInvokeEx                16377         416.2840           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    1948        4737.3232           0.7010           3.7500           2.4319
FullyConnected                       3402         322.0410           0.0080           0.3430           0.0947
argmax                               1134          22.1380           0.0050           0.0480           0.0195
_backward_pick                        974          15.2510           0.0130           0.0260           0.0157
_backward_mul_scalar                  974           4.2010           0.0030           0.0160           0.0043
DeleteVariable                      41840         297.3300           0.0010           0.9010           0.0071
Flatten                              1134          46.8940           0.0080           0.1120           0.0414
Activation                           4536         205.3920           0.0030           0.3430           0.0453
SetValueOp                            974           6.2290           0.0050           0.0180           0.0064
pick                                  974           7.5980           0.0060           0.0280           0.0078
Pooling                              2268        3124.3560           0.0640           3.1720           1.3776
Convolution                          2268       12865.8574           0.2260          13.2050           5.6728
CopyCPU2CPU                          1134           6.5430           0.0030           0.0360           0.0058
log_softmax                           974          29.9670           0.0150           0.0500           0.0308
_backward_copy                        974          50.1010           0.0220           0.0760           0.0514
_backward_Convolution                1948       17943.6855           2.6370          12.5610           9.2113
_mul_scalar                           974           3.4400           0.0020           0.0230           0.0035
_backward_log_softmax                 974          16.2620           0.0090           0.0400           0.0167
mean                                 3082          58.8280           0.0080           0.0730           0.0191
_backward_mean                        974          10.5990           0.0080           0.1030           0.0109
_backward_FullyConnected             2922         544.7960           0.0280           0.5940           0.1864
WaitForVar                           2108          18.7130           0.0060           0.0280           0.0089
broadcast_equal                      1134           5.6130           0.0030           0.0100           0.0049
sgd_update                           9740          94.2190           0.0020           0.0640           0.0097
_backward_Activation                 3896         285.3640           0.0070           0.3900           0.0732



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       38512       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3408        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             487        1935.5601           0.3060          73.5850           3.9745
MXNDArrayCreateEx                     568          19.4390           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      488       10536.0762           5.6130          24.8060          21.5903
MXNDArraySyncCopyToCPU               1056        8343.8271           0.1180          24.1980           7.9014
MXNDArrayGetDType                    1056           0.3710           0.0000           0.0010           0.0004
MXNDArrayGetShape                    2680           1.2380           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1136           9.9670           0.0070           0.0280           0.0088
MXNDArrayFree                       12664         129.5480           0.0000           0.9140           0.0102
MXNet C API Calls                   56616         543.9730         487.3580         543.9730          28.3075
MXNet C API Concurrency            113231           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording              976           0.4670           0.0000           0.0040           0.0005
MXNDArrayGetGradState                4880           2.5420           0.0000           0.0230           0.0005
MXNDArraySetGradState                4880           2.4880           0.0000           0.0010           0.0005
MXAutogradSetIsTraining               976           0.4180           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  488         265.3210           0.5250           0.6810           0.5437
MXNDArrayGetContext                  7872           3.3930           0.0000           0.0070           0.0004
MXImperativeInvokeEx                16408         417.0600           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    1952        4747.1182           0.7010           3.7500           2.4319
FullyConnected                       3408         322.6290           0.0080           0.3430           0.0947
argmax                               1136          22.1760           0.0050           0.0480           0.0195
_backward_pick                        976          15.2840           0.0130           0.0260           0.0157
_backward_mul_scalar                  976           4.2100           0.0030           0.0160           0.0043
DeleteVariable                      41920         297.8400           0.0010           0.9010           0.0071
Flatten                              1136          46.9790           0.0080           0.1120           0.0414
Activation                           4544         205.7510           0.0030           0.3430           0.0453
SetValueOp                            976           6.2420           0.0050           0.0180           0.0064
pick                                  976           7.6140           0.0060           0.0280           0.0078
Pooling                              2272        3129.7129           0.0640           3.1720           1.3775
Convolution                          2272       12888.0293           0.2260          13.2050           5.6725
CopyCPU2CPU                          1136           6.5530           0.0030           0.0360           0.0058
log_softmax                           976          30.0260           0.0150           0.0500           0.0308
_backward_copy                        976          50.2120           0.0220           0.0760           0.0514
_backward_Convolution                1952       17980.4844           2.6370          12.5610           9.2113
_mul_scalar                           976           3.4470           0.0020           0.0230           0.0035
_backward_log_softmax                 976          16.2940           0.0090           0.0400           0.0167
mean                                 3088          58.9450           0.0080           0.0730           0.0191
_backward_mean                        976          10.6220           0.0080           0.1030           0.0109
_backward_FullyConnected             2928         545.8840           0.0280           0.5940           0.1864
WaitForVar                           2112          18.7490           0.0060           0.0280           0.0089
broadcast_equal                      1136           5.6240           0.0030           0.0100           0.0050
sgd_update                           9760          94.3720           0.0020           0.0640           0.0097
_backward_Activation                 3904         286.0140           0.0070           0.3900           0.0733



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       38586       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3414        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             488        1939.4640           0.3060          73.5850           3.9743
MXNDArrayCreateEx                     569          19.4710           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      489       10557.9297           5.6130          24.8060          21.5909
MXNDArraySyncCopyToCPU               1058        8358.2988           0.1180          24.1980           7.9001
MXNDArrayGetDType                    1058           0.3720           0.0000           0.0010           0.0004
MXNDArrayGetShape                    2685           1.2410           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1138           9.9860           0.0070           0.0280           0.0088
MXNDArrayFree                       12687         129.7750           0.0000           0.9140           0.0102
MXNet C API Calls                   56723         544.0800         487.3580         544.0800          28.3610
MXNet C API Concurrency            113445           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording              978           0.4680           0.0000           0.0040           0.0005
MXNDArrayGetGradState                4890           2.5450           0.0000           0.0230           0.0005
MXNDArraySetGradState                4890           2.4960           0.0000           0.0010           0.0005
MXAutogradSetIsTraining               978           0.4190           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  489         265.8550           0.5250           0.6810           0.5437
MXNDArrayGetContext                  7886           3.4010           0.0000           0.0070           0.0004
MXImperativeInvokeEx                16439         417.8400           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    1956        4756.8281           0.7010           3.7500           2.4319
FullyConnected                       3414         323.1590           0.0080           0.3430           0.0947
argmax                               1138          22.2150           0.0050           0.0480           0.0195
_backward_pick                        978          15.3150           0.0130           0.0260           0.0157
_backward_mul_scalar                  978           4.2190           0.0030           0.0160           0.0043
DeleteVariable                      42000         298.3670           0.0010           0.9010           0.0071
Flatten                              1138          47.0640           0.0080           0.1120           0.0414
Activation                           4552         206.1120           0.0030           0.3430           0.0453
SetValueOp                            978           6.2540           0.0050           0.0180           0.0064
pick                                  978           7.6290           0.0060           0.0280           0.0078
Pooling                              2276        3135.1350           0.0640           3.1720           1.3775
Convolution                          2276       12910.2783           0.2260          13.2050           5.6724
CopyCPU2CPU                          1138           6.5620           0.0030           0.0360           0.0058
log_softmax                           978          30.0860           0.0150           0.0500           0.0308
_backward_copy                        978          50.3250           0.0220           0.0760           0.0515
_backward_Convolution                1956       18017.5312           2.6370          12.5610           9.2114
_mul_scalar                           978           3.4540           0.0020           0.0230           0.0035
_backward_log_softmax                 978          16.3260           0.0090           0.0400           0.0167
mean                                 3094          59.0630           0.0080           0.0730           0.0191
_backward_mean                        978          10.6420           0.0080           0.1030           0.0109
_backward_FullyConnected             2934         546.9700           0.0280           0.5940           0.1864
WaitForVar                           2116          18.7860           0.0060           0.0280           0.0089
broadcast_equal                      1138           5.6340           0.0030           0.0100           0.0050
sgd_update                           9780          94.5850           0.0020           0.0640           0.0097
_backward_Activation                 3912         286.5720           0.0070           0.3900           0.0733



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       38660       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3420        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             489        1943.3680           0.3060          73.5850           3.9742
MXNDArrayCreateEx                     570          19.5040           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      490       10579.7861           5.6130          24.8060          21.5914
MXNDArraySyncCopyToCPU               1060        8373.2676           0.1180          24.1980           7.8993
MXNDArrayGetDType                    1060           0.3720           0.0000           0.0010           0.0004
MXNDArrayGetShape                    2690           1.2440           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1140          10.0040           0.0070           0.0280           0.0088
MXNDArrayFree                       12710         130.0060           0.0000           0.9140           0.0102
MXNet C API Calls                   56830         544.1870         487.3580         544.1870          28.4145
MXNet C API Concurrency            113659           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording              980           0.4690           0.0000           0.0040           0.0005
MXNDArrayGetGradState                4900           2.5510           0.0000           0.0230           0.0005
MXNDArraySetGradState                4900           2.5010           0.0000           0.0010           0.0005
MXAutogradSetIsTraining               980           0.4200           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  490         266.3850           0.5250           0.6810           0.5436
MXNDArrayGetContext                  7900           3.4060           0.0000           0.0070           0.0004
MXImperativeInvokeEx                16470         418.6120           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    1960        4766.5991           0.7010           3.7500           2.4319
FullyConnected                       3420         323.9640           0.0080           0.3430           0.0947
argmax                               1140          22.2600           0.0050           0.0480           0.0195
_backward_pick                        980          15.3500           0.0130           0.0260           0.0157
_backward_mul_scalar                  980           4.2270           0.0030           0.0160           0.0043
DeleteVariable                      42080         298.9170           0.0010           0.9010           0.0071
Flatten                              1140          47.1490           0.0080           0.1120           0.0414
Activation                           4560         206.5090           0.0030           0.3430           0.0453
SetValueOp                            980           6.2670           0.0050           0.0180           0.0064
pick                                  980           7.6460           0.0060           0.0280           0.0078
Pooling                              2280        3140.4929           0.0640           3.1720           1.3774
Convolution                          2280       12932.7236           0.2260          13.2050           5.6722
CopyCPU2CPU                          1140           6.5720           0.0030           0.0360           0.0058
log_softmax                           980          30.1600           0.0150           0.0500           0.0308
_backward_copy                        980          50.4340           0.0220           0.0760           0.0515
_backward_Convolution                1960       18054.5918           2.6370          12.5610           9.2115
_mul_scalar                           980           3.4610           0.0020           0.0230           0.0035
_backward_log_softmax                 980          16.3680           0.0090           0.0400           0.0167
mean                                 3100          59.1710           0.0080           0.0730           0.0191
_backward_mean                        980          10.6650           0.0080           0.1030           0.0109
_backward_FullyConnected             2940         548.4020           0.0280           0.5940           0.1865
WaitForVar                           2120          18.8250           0.0060           0.0280           0.0089
broadcast_equal                      1140           5.6450           0.0030           0.0100           0.0050
sgd_update                           9800          94.8030           0.0020           0.0640           0.0097
_backward_Activation                 3920         287.2520           0.0070           0.3900           0.0733



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       38734       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3426        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             490        1947.2820           0.3060          73.5850           3.9740
MXNDArrayCreateEx                     571          19.5370           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      491       10601.4961           5.6130          24.8060          21.5916
MXNDArraySyncCopyToCPU               1062        8387.7236           0.1180          24.1980           7.8980
MXNDArrayGetDType                    1062           0.3730           0.0000           0.0010           0.0004
MXNDArrayGetShape                    2695           1.2470           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1142          10.0220           0.0070           0.0280           0.0088
MXNDArrayFree                       12733         130.2380           0.0000           0.9140           0.0102
MXNet C API Calls                   56937         544.2940         487.3580         544.2940          28.4680
MXNet C API Concurrency            113873           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording              982           0.4700           0.0000           0.0040           0.0005
MXNDArrayGetGradState                4910           2.5550           0.0000           0.0230           0.0005
MXNDArraySetGradState                4910           2.5050           0.0000           0.0010           0.0005
MXAutogradSetIsTraining               982           0.4200           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  491         266.9220           0.5250           0.6810           0.5436
MXNDArrayGetContext                  7914           3.4110           0.0000           0.0070           0.0004
MXImperativeInvokeEx                16501         419.4030           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    1964        4776.3188           0.7010           3.7500           2.4319
FullyConnected                       3426         324.4970           0.0080           0.3430           0.0947
argmax                               1142          22.2990           0.0050           0.0480           0.0195
_backward_pick                        982          15.3800           0.0130           0.0260           0.0157
_backward_mul_scalar                  982           4.2360           0.0030           0.0160           0.0043
DeleteVariable                      42160         299.4610           0.0010           0.9010           0.0071
Flatten                              1142          47.2360           0.0080           0.1120           0.0414
Activation                           4568         206.8700           0.0030           0.3430           0.0453
SetValueOp                            982           6.2810           0.0050           0.0180           0.0064
pick                                  982           7.6620           0.0060           0.0280           0.0078
Pooling                              2284        3145.9180           0.0640           3.1720           1.3774
Convolution                          2284       12954.9961           0.2260          13.2050           5.6721
CopyCPU2CPU                          1142           6.5820           0.0030           0.0360           0.0058
log_softmax                           982          30.2200           0.0150           0.0500           0.0308
_backward_copy                        982          50.5470           0.0220           0.0760           0.0515
_backward_Convolution                1964       18091.3457           2.6370          12.5610           9.2115
_mul_scalar                           982           3.4690           0.0020           0.0230           0.0035
_backward_log_softmax                 982          16.3990           0.0090           0.0400           0.0167
mean                                 3106          59.2870           0.0080           0.0730           0.0191
_backward_mean                        982          10.6860           0.0080           0.1030           0.0109
_backward_FullyConnected             2946         549.4910           0.0280           0.5940           0.1865
WaitForVar                           2124          18.8620           0.0060           0.0280           0.0089
broadcast_equal                      1142           5.6540           0.0030           0.0100           0.0050
sgd_update                           9820          95.0090           0.0020           0.0640           0.0097
_backward_Activation                 3928         287.8110           0.0070           0.3900           0.0733



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       38808       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3432        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             491        1951.1860           0.3060          73.5850           3.9739
MXNDArrayCreateEx                     572          19.5710           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      492       10623.2217           5.6130          24.8060          21.5919
MXNDArraySyncCopyToCPU               1064        8402.1279           0.1180          24.1980           7.8967
MXNDArrayGetDType                    1064           0.3730           0.0000           0.0010           0.0004
MXNDArrayGetShape                    2700           1.2490           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1144          10.0400           0.0070           0.0280           0.0088
MXNDArrayFree                       12756         130.4610           0.0000           0.9140           0.0102
MXNet C API Calls                   57044         544.4010         487.3580         544.4010          28.5215
MXNet C API Concurrency            114087           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording              984           0.4710           0.0000           0.0040           0.0005
MXNDArrayGetGradState                4920           2.5600           0.0000           0.0230           0.0005
MXNDArraySetGradState                4920           2.5080           0.0000           0.0010           0.0005
MXAutogradSetIsTraining               984           0.4210           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  492         267.4530           0.5250           0.6810           0.5436
MXNDArrayGetContext                  7928           3.4170           0.0000           0.0070           0.0004
MXImperativeInvokeEx                16532         420.1790           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    1968        4786.0508           0.7010           3.7500           2.4319
FullyConnected                       3432         325.0230           0.0080           0.3430           0.0947
argmax                               1144          22.3370           0.0050           0.0480           0.0195
_backward_pick                        984          15.4110           0.0130           0.0260           0.0157
_backward_mul_scalar                  984           4.2450           0.0030           0.0160           0.0043
DeleteVariable                      42240         299.9980           0.0010           0.9010           0.0071
Flatten                              1144          47.3200           0.0080           0.1120           0.0414
Activation                           4576         207.2290           0.0030           0.3430           0.0453
SetValueOp                            984           6.2940           0.0050           0.0180           0.0064
pick                                  984           7.6770           0.0060           0.0280           0.0078
Pooling                              2288        3151.2639           0.0640           3.1720           1.3773
Convolution                          2288       12977.1514           0.2260          13.2050           5.6718
CopyCPU2CPU                          1144           6.5920           0.0030           0.0360           0.0058
log_softmax                           984          30.2800           0.0150           0.0500           0.0308
_backward_copy                        984          50.6590           0.0220           0.0760           0.0515
_backward_Convolution                1968       18128.1133           2.6370          12.5610           9.2114
_mul_scalar                           984           3.4770           0.0020           0.0230           0.0035
_backward_log_softmax                 984          16.4310           0.0090           0.0400           0.0167
mean                                 3112          59.3990           0.0080           0.0730           0.0191
_backward_mean                        984          10.7070           0.0080           0.1030           0.0109
_backward_FullyConnected             2952         550.5840           0.0280           0.5940           0.1865
WaitForVar                           2128          18.9000           0.0060           0.0280           0.0089
broadcast_equal                      1144           5.6640           0.0030           0.0100           0.0050
sgd_update                           9840          95.1610           0.0020           0.0640           0.0097
_backward_Activation                 3936         288.4300           0.0070           0.3900           0.0733



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       38882       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3438        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             492        1955.2930           0.3060          73.5850           3.9742
MXNDArrayCreateEx                     573          19.6050           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      493       10645.0938           5.6130          24.8060          21.5925
MXNDArraySyncCopyToCPU               1066        8416.6055           0.1180          24.1980           7.8955
MXNDArrayGetDType                    1066           0.3740           0.0000           0.0010           0.0004
MXNDArrayGetShape                    2705           1.2500           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1146          10.0570           0.0070           0.0280           0.0088
MXNDArrayFree                       12779         130.6920           0.0000           0.9140           0.0102
MXNet C API Calls                   57151         544.5080         487.3580         544.5080          28.5750
MXNet C API Concurrency            114301           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording              986           0.4720           0.0000           0.0040           0.0005
MXNDArrayGetGradState                4930           2.5670           0.0000           0.0230           0.0005
MXNDArraySetGradState                4930           2.5110           0.0000           0.0010           0.0005
MXAutogradSetIsTraining               986           0.4220           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  493         268.0070           0.5250           0.6810           0.5436
MXNDArrayGetContext                  7942           3.4230           0.0000           0.0070           0.0004
MXImperativeInvokeEx                16563         420.9490           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    1972        4795.8408           0.7010           3.7500           2.4320
FullyConnected                       3438         325.5770           0.0080           0.3430           0.0947
argmax                               1146          22.3750           0.0050           0.0480           0.0195
_backward_pick                        986          15.4440           0.0130           0.0260           0.0157
_backward_mul_scalar                  986           4.2540           0.0030           0.0160           0.0043
DeleteVariable                      42320         300.5210           0.0010           0.9010           0.0071
Flatten                              1146          47.4070           0.0080           0.1120           0.0414
Activation                           4584         207.5890           0.0030           0.3430           0.0453
SetValueOp                            986           6.3070           0.0050           0.0180           0.0064
pick                                  986           7.6930           0.0060           0.0280           0.0078
Pooling                              2292        3156.6699           0.0640           3.1720           1.3773
Convolution                          2292       12999.4053           0.2260          13.2050           5.6716
CopyCPU2CPU                          1146           6.6010           0.0030           0.0360           0.0058
log_softmax                           986          30.3410           0.0150           0.0500           0.0308
_backward_copy                        986          50.7720           0.0220           0.0760           0.0515
_backward_Convolution                1972       18165.1289           2.6370          12.5610           9.2115
_mul_scalar                           986           3.4840           0.0020           0.0230           0.0035
_backward_log_softmax                 986          16.4620           0.0090           0.0400           0.0167
mean                                 3118          59.5210           0.0080           0.0730           0.0191
_backward_mean                        986          10.7290           0.0080           0.1030           0.0109
_backward_FullyConnected             2958         551.6730           0.0280           0.5940           0.1865
WaitForVar                           2132          18.9370           0.0060           0.0280           0.0089
broadcast_equal                      1146           5.6750           0.0030           0.0100           0.0050
sgd_update                           9860          95.3110           0.0020           0.0640           0.0097
_backward_Activation                 3944         289.0480           0.0070           0.3900           0.0733



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       38956       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3444        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             493        1959.1960           0.3060          73.5850           3.9740
MXNDArrayCreateEx                     574          19.6390           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      494       10666.9648           5.6130          24.8060          21.5930
MXNDArraySyncCopyToCPU               1068        8431.5498           0.1180          24.1980           7.8947
MXNDArrayGetDType                    1068           0.3740           0.0000           0.0010           0.0004
MXNDArrayGetShape                    2710           1.2530           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1148          10.0740           0.0070           0.0280           0.0088
MXNDArrayFree                       12802         130.9180           0.0000           0.9140           0.0102
MXNet C API Calls                   57258         544.6150         487.3580         544.6150          28.6285
MXNet C API Concurrency            114515           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording              988           0.4730           0.0000           0.0040           0.0005
MXNDArrayGetGradState                4940           2.5730           0.0000           0.0230           0.0005
MXNDArraySetGradState                4940           2.5190           0.0000           0.0010           0.0005
MXAutogradSetIsTraining               988           0.4230           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  494         268.5390           0.5250           0.6810           0.5436
MXNDArrayGetContext                  7956           3.4270           0.0000           0.0070           0.0004
MXImperativeInvokeEx                16594         421.7230           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    1976        4805.6299           0.7010           3.7500           2.4320
FullyConnected                       3444         326.3650           0.0080           0.3430           0.0948
argmax                               1148          22.4200           0.0050           0.0480           0.0195
_backward_pick                        988          15.4770           0.0130           0.0260           0.0157
_backward_mul_scalar                  988           4.2630           0.0030           0.0160           0.0043
DeleteVariable                      42400         301.0640           0.0010           0.9010           0.0071
Flatten                              1148          47.4930           0.0080           0.1120           0.0414
Activation                           4592         207.9800           0.0030           0.3430           0.0453
SetValueOp                            988           6.3220           0.0050           0.0180           0.0064
pick                                  988           7.7100           0.0060           0.0280           0.0078
Pooling                              2296        3162.0400           0.0640           3.1720           1.3772
Convolution                          2296       13021.8467           0.2260          13.2050           5.6715
CopyCPU2CPU                          1148           6.6110           0.0030           0.0360           0.0058
log_softmax                           988          30.4150           0.0150           0.0500           0.0308
_backward_copy                        988          50.8830           0.0220           0.0760           0.0515
_backward_Convolution                1976       18202.1523           2.6370          12.5610           9.2116
_mul_scalar                           988           3.4910           0.0020           0.0230           0.0035
_backward_log_softmax                 988          16.5040           0.0090           0.0400           0.0167
mean                                 3124          59.6300           0.0080           0.0730           0.0191
_backward_mean                        988          10.7510           0.0080           0.1030           0.0109
_backward_FullyConnected             2964         553.1130           0.0280           0.5940           0.1866
WaitForVar                           2136          18.9740           0.0060           0.0280           0.0089
broadcast_equal                      1148           5.6850           0.0030           0.0100           0.0050
sgd_update                           9880          95.5810           0.0020           0.0640           0.0097
_backward_Activation                 3952         289.6680           0.0070           0.3900           0.0733



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       39030       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3450        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             494        1963.1030           0.3060          73.5850           3.9739
MXNDArrayCreateEx                     575          19.6730           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      495       10688.7012           5.6130          24.8060          21.5933
MXNDArraySyncCopyToCPU               1070        8445.9971           0.1180          24.1980           7.8935
MXNDArrayGetDType                    1070           0.3750           0.0000           0.0010           0.0004
MXNDArrayGetShape                    2715           1.2550           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1150          10.0910           0.0070           0.0280           0.0088
MXNDArrayFree                       12825         131.1540           0.0000           0.9140           0.0102
MXNet C API Calls                   57365         544.7220         487.3580         544.7220          28.6820
MXNet C API Concurrency            114729           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording              990           0.4740           0.0000           0.0040           0.0005
MXNDArrayGetGradState                4950           2.5800           0.0000           0.0230           0.0005
MXNDArraySetGradState                4950           2.5240           0.0000           0.0010           0.0005
MXAutogradSetIsTraining               990           0.4250           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  495         269.0720           0.5250           0.6810           0.5436
MXNDArrayGetContext                  7970           3.4310           0.0000           0.0070           0.0004
MXImperativeInvokeEx                16625         422.5010           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    1980        4815.3511           0.7010           3.7500           2.4320
FullyConnected                       3450         326.9190           0.0080           0.3430           0.0948
argmax                               1150          22.4590           0.0050           0.0480           0.0195
_backward_pick                        990          15.5100           0.0130           0.0260           0.0157
_backward_mul_scalar                  990           4.2720           0.0030           0.0160           0.0043
DeleteVariable                      42480         301.6260           0.0010           0.9010           0.0071
Flatten                              1150          47.5790           0.0080           0.1120           0.0414
Activation                           4600         208.3400           0.0030           0.3430           0.0453
SetValueOp                            990           6.3350           0.0050           0.0180           0.0064
pick                                  990           7.7250           0.0060           0.0280           0.0078
Pooling                              2300        3167.4099           0.0640           3.1720           1.3771
Convolution                          2300       13044.1094           0.2260          13.2050           5.6714
CopyCPU2CPU                          1150           6.6210           0.0030           0.0360           0.0058
log_softmax                           990          30.4740           0.0150           0.0500           0.0308
_backward_copy                        990          50.9960           0.0220           0.0760           0.0515
_backward_Convolution                1980       18238.9551           2.6370          12.5610           9.2116
_mul_scalar                           990           3.4970           0.0020           0.0230           0.0035
_backward_log_softmax                 990          16.5360           0.0090           0.0400           0.0167
mean                                 3130          59.7470           0.0080           0.0730           0.0191
_backward_mean                        990          10.7720           0.0080           0.1030           0.0109
_backward_FullyConnected             2970         554.2000           0.0280           0.5940           0.1866
WaitForVar                           2140          19.0110           0.0060           0.0280           0.0089
broadcast_equal                      1150           5.6950           0.0030           0.0100           0.0050
sgd_update                           9900          95.7840           0.0020           0.0640           0.0097
_backward_Activation                 3960         290.2140           0.0070           0.3900           0.0733



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       39104       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3456        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             495        1967.0160           0.3060          73.5850           3.9738
MXNDArrayCreateEx                     576          19.7070           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      496       10710.4609           5.6130          24.8060          21.5937
MXNDArraySyncCopyToCPU               1072        8460.4434           0.1180          24.1980           7.8922
MXNDArrayGetDType                    1072           0.3750           0.0000           0.0010           0.0003
MXNDArrayGetShape                    2720           1.2570           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1152          10.1090           0.0070           0.0280           0.0088
MXNDArrayFree                       12848         131.3790           0.0000           0.9140           0.0102
MXNet C API Calls                   57472         544.8290         487.3580         544.8290          28.7355
MXNet C API Concurrency            114943           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording              992           0.4740           0.0000           0.0040           0.0005
MXNDArrayGetGradState                4960           2.5850           0.0000           0.0230           0.0005
MXNDArraySetGradState                4960           2.5280           0.0000           0.0010           0.0005
MXAutogradSetIsTraining               992           0.4250           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  496         269.6080           0.5250           0.6810           0.5436
MXNDArrayGetContext                  7984           3.4380           0.0000           0.0070           0.0004
MXImperativeInvokeEx                16656         423.2750           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    1984        4825.1479           0.7010           3.7500           2.4320
FullyConnected                       3456         327.4680           0.0080           0.3430           0.0948
argmax                               1152          22.4980           0.0050           0.0480           0.0195
_backward_pick                        992          15.5420           0.0130           0.0260           0.0157
_backward_mul_scalar                  992           4.2800           0.0030           0.0160           0.0043
DeleteVariable                      42560         302.1720           0.0010           0.9010           0.0071
Flatten                              1152          47.6630           0.0080           0.1120           0.0414
Activation                           4608         208.7010           0.0030           0.3430           0.0453
SetValueOp                            992           6.3480           0.0050           0.0180           0.0064
pick                                  992           7.7410           0.0060           0.0280           0.0078
Pooling                              2304        3172.7639           0.0640           3.1720           1.3771
Convolution                          2304       13066.2852           0.2260          13.2050           5.6711
CopyCPU2CPU                          1152           6.6310           0.0030           0.0360           0.0058
log_softmax                           992          30.5330           0.0150           0.0500           0.0308
_backward_copy                        992          51.1080           0.0220           0.0760           0.0515
_backward_Convolution                1984       18275.7832           2.6370          12.5610           9.2116
_mul_scalar                           992           3.5040           0.0020           0.0230           0.0035
_backward_log_softmax                 992          16.5670           0.0090           0.0400           0.0167
mean                                 3136          59.8640           0.0080           0.0730           0.0191
_backward_mean                        992          10.7940           0.0080           0.1030           0.0109
_backward_FullyConnected             2976         555.2870           0.0280           0.5940           0.1866
WaitForVar                           2144          19.0480           0.0060           0.0280           0.0089
broadcast_equal                      1152           5.7040           0.0030           0.0100           0.0050
sgd_update                           9920          96.0210           0.0020           0.0640           0.0097
_backward_Activation                 3968         290.8000           0.0070           0.3900           0.0733



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       39178       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3462        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             496        1970.9091           0.3060          73.5850           3.9736
MXNDArrayCreateEx                     577          19.7410           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      497       10732.3311           5.6130          24.8060          21.5942
MXNDArraySyncCopyToCPU               1074        8474.7354           0.1180          24.1980           7.8908
MXNDArrayGetDType                    1074           0.3760           0.0000           0.0010           0.0004
MXNDArrayGetShape                    2725           1.2620           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1154          10.1260           0.0070           0.0280           0.0088
MXNDArrayFree                       12871         131.6030           0.0000           0.9140           0.0102
MXNet C API Calls                   57579         544.9360         487.3580         544.9360          28.7890
MXNet C API Concurrency            115157           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording              994           0.4750           0.0000           0.0040           0.0005
MXNDArrayGetGradState                4970           2.5890           0.0000           0.0230           0.0005
MXNDArraySetGradState                4970           2.5350           0.0000           0.0010           0.0005
MXAutogradSetIsTraining               994           0.4260           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  497         270.1630           0.5250           0.6810           0.5436
MXNDArrayGetContext                  7998           3.4480           0.0000           0.0070           0.0004
MXImperativeInvokeEx                16687         424.0760           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    1988        4834.8418           0.7010           3.7500           2.4320
FullyConnected                       3462         327.9970           0.0080           0.3430           0.0947
argmax                               1154          22.5350           0.0050           0.0480           0.0195
_backward_pick                        994          15.5750           0.0130           0.0260           0.0157
_backward_mul_scalar                  994           4.2890           0.0030           0.0160           0.0043
DeleteVariable                      42640         302.7030           0.0010           0.9010           0.0071
Flatten                              1154          47.7480           0.0080           0.1120           0.0414
Activation                           4616         209.0620           0.0030           0.3430           0.0453
SetValueOp                            994           6.3610           0.0050           0.0180           0.0064
pick                                  994           7.7560           0.0060           0.0280           0.0078
Pooling                              2308        3178.1130           0.0640           3.1720           1.3770
Convolution                          2308       13088.5283           0.2260          13.2050           5.6709
CopyCPU2CPU                          1154           6.6410           0.0030           0.0360           0.0058
log_softmax                           994          30.5930           0.0150           0.0500           0.0308
_backward_copy                        994          51.2190           0.0220           0.0760           0.0515
_backward_Convolution                1988       18312.8359           2.6370          12.5610           9.2117
_mul_scalar                           994           3.5110           0.0020           0.0230           0.0035
_backward_log_softmax                 994          16.5990           0.0090           0.0400           0.0167
mean                                 3142          59.9840           0.0080           0.0730           0.0191
_backward_mean                        994          10.8160           0.0080           0.1030           0.0109
_backward_FullyConnected             2982         556.4330           0.0280           0.5940           0.1866
WaitForVar                           2148          19.0800           0.0060           0.0280           0.0089
broadcast_equal                      1154           5.7130           0.0030           0.0100           0.0050
sgd_update                           9940          96.1750           0.0020           0.0640           0.0097
_backward_Activation                 3976         291.4170           0.0070           0.3900           0.0733



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       39252       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3468        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             497        1974.8101           0.3060          73.5850           3.9735
MXNDArrayCreateEx                     578          19.7740           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      498       10754.2764           5.6130          24.8060          21.5949
MXNDArraySyncCopyToCPU               1076        8489.7012           0.1180          24.1980           7.8901
MXNDArrayGetDType                    1076           0.3760           0.0000           0.0010           0.0003
MXNDArrayGetShape                    2730           1.2640           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1156          10.1430           0.0070           0.0280           0.0088
MXNDArrayFree                       12894         131.8320           0.0000           0.9140           0.0102
MXNet C API Calls                   57686         545.0430         487.3580         545.0430          28.8425
MXNet C API Concurrency            115371           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording              996           0.4760           0.0000           0.0040           0.0005
MXNDArrayGetGradState                4980           2.5930           0.0000           0.0230           0.0005
MXNDArraySetGradState                4980           2.5410           0.0000           0.0010           0.0005
MXAutogradSetIsTraining               996           0.4260           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  498         270.6970           0.5250           0.6810           0.5436
MXNDArrayGetContext                  8012           3.4550           0.0000           0.0070           0.0004
MXImperativeInvokeEx                16718         424.8790           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    1992        4844.5439           0.7010           3.7500           2.4320
FullyConnected                       3468         328.7980           0.0080           0.3430           0.0948
argmax                               1156          22.5800           0.0050           0.0480           0.0195
_backward_pick                        996          15.6090           0.0130           0.0260           0.0157
_backward_mul_scalar                  996           4.2990           0.0030           0.0160           0.0043
DeleteVariable                      42720         303.2580           0.0010           0.9010           0.0071
Flatten                              1156          47.8350           0.0080           0.1120           0.0414
Activation                           4624         209.4570           0.0030           0.3430           0.0453
SetValueOp                            996           6.3740           0.0050           0.0180           0.0064
pick                                  996           7.7730           0.0060           0.0280           0.0078
Pooling                              2312        3183.5200           0.0640           3.1720           1.3770
Convolution                          2312       13110.9805           0.2260          13.2050           5.6708
CopyCPU2CPU                          1156           6.6520           0.0030           0.0360           0.0058
log_softmax                           996          30.6670           0.0150           0.0500           0.0308
_backward_copy                        996          51.3290           0.0220           0.0760           0.0515
_backward_Convolution                1992       18350.0625           2.6370          12.5610           9.2119
_mul_scalar                           996           3.5180           0.0020           0.0230           0.0035
_backward_log_softmax                 996          16.6410           0.0090           0.0400           0.0167
mean                                 3148          60.0910           0.0080           0.0730           0.0191
_backward_mean                        996          10.8380           0.0080           0.1030           0.0109
_backward_FullyConnected             2988         557.8690           0.0280           0.5940           0.1867
WaitForVar                           2152          19.1180           0.0060           0.0280           0.0089
broadcast_equal                      1156           5.7230           0.0030           0.0100           0.0050
sgd_update                           9960          96.3930           0.0020           0.0640           0.0097
_backward_Activation                 3984         292.1000           0.0070           0.3900           0.0733



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       39326       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3474        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             498        1978.7280           0.3060          73.5850           3.9733
MXNDArrayCreateEx                     579          19.8080           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      499       10775.9873           5.6130          24.8060          21.5952
MXNDArraySyncCopyToCPU               1078        8504.0449           0.1180          24.1980           7.8887
MXNDArrayGetDType                    1078           0.3760           0.0000           0.0010           0.0003
MXNDArrayGetShape                    2735           1.2640           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1158          10.1600           0.0070           0.0280           0.0088
MXNDArrayFree                       12917         132.0590           0.0000           0.9140           0.0102
MXNet C API Calls                   57793         545.1500         487.3580         545.1500          28.8960
MXNet C API Concurrency            115585           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording              998           0.4770           0.0000           0.0040           0.0005
MXNDArrayGetGradState                4990           2.5980           0.0000           0.0230           0.0005
MXNDArraySetGradState                4990           2.5460           0.0000           0.0010           0.0005
MXAutogradSetIsTraining               998           0.4270           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  499         271.2510           0.5250           0.6810           0.5436
MXNDArrayGetContext                  8026           3.4580           0.0000           0.0070           0.0004
MXImperativeInvokeEx                16749         425.6840           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    1996        4854.1631           0.7010           3.7500           2.4319
FullyConnected                       3474         329.3520           0.0080           0.3430           0.0948
argmax                               1158          22.6190           0.0050           0.0480           0.0195
_backward_pick                        998          15.6400           0.0130           0.0260           0.0157
_backward_mul_scalar                  998           4.3080           0.0030           0.0160           0.0043
DeleteVariable                      42800         303.8020           0.0010           0.9010           0.0071
Flatten                              1158          47.9190           0.0080           0.1120           0.0414
Activation                           4632         209.8180           0.0030           0.3430           0.0453
SetValueOp                            998           6.3870           0.0050           0.0180           0.0064
pick                                  998           7.7880           0.0060           0.0280           0.0078
Pooling                              2316        3188.8840           0.0640           3.1720           1.3769
Convolution                          2316       13133.2510           0.2260          13.2050           5.6707
CopyCPU2CPU                          1158           6.6620           0.0030           0.0360           0.0058
log_softmax                           998          30.7280           0.0150           0.0500           0.0308
_backward_copy                        998          51.4420           0.0220           0.0760           0.0515
_backward_Convolution                1996       18386.9238           2.6370          12.5610           9.2119
_mul_scalar                           998           3.5250           0.0020           0.0230           0.0035
_backward_log_softmax                 998          16.6720           0.0090           0.0400           0.0167
mean                                 3154          60.2130           0.0080           0.0730           0.0191
_backward_mean                        998          10.8600           0.0080           0.1030           0.0109
_backward_FullyConnected             2994         558.9620           0.0280           0.5940           0.1867
WaitForVar                           2156          19.1540           0.0060           0.0280           0.0089
broadcast_equal                      1158           5.7320           0.0030           0.0100           0.0049
sgd_update                           9980          96.6020           0.0020           0.0640           0.0097
_backward_Activation                 3992         292.6680           0.0070           0.3900           0.0733



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       39400       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3480        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             499        1982.6270           0.3060          73.5850           3.9732
MXNDArrayCreateEx                     580          19.8420           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      500       10797.6719           5.6130          24.8060          21.5953
MXNDArraySyncCopyToCPU               1080        8518.4492           0.1180          24.1980           7.8875
MXNDArrayGetDType                    1080           0.3760           0.0000           0.0010           0.0003
MXNDArrayGetShape                    2740           1.2670           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1160          10.1770           0.0070           0.0280           0.0088
MXNDArrayFree                       12940         132.2830           0.0000           0.9140           0.0102
MXNet C API Calls                   57900         545.2570         487.3580         545.2570          28.9495
MXNet C API Concurrency            115799           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1000           0.4780           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5000           2.6020           0.0000           0.0230           0.0005
MXNDArraySetGradState                5000           2.5510           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1000           0.4270           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  500         271.7830           0.5250           0.6810           0.5436
MXNDArrayGetContext                  8040           3.4630           0.0000           0.0070           0.0004
MXImperativeInvokeEx                16780         426.4910           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2000        4863.8750           0.7010           3.7500           2.4319
FullyConnected                       3480         329.8830           0.0080           0.3430           0.0948
argmax                               1160          22.6560           0.0050           0.0480           0.0195
_backward_pick                       1000          15.6710           0.0130           0.0260           0.0157
_backward_mul_scalar                 1000           4.3160           0.0030           0.0160           0.0043
DeleteVariable                      42880         304.3190           0.0010           0.9010           0.0071
Flatten                              1160          48.0070           0.0080           0.1120           0.0414
Activation                           4640         210.1790           0.0030           0.3430           0.0453
SetValueOp                           1000           6.4000           0.0050           0.0180           0.0064
pick                                 1000           7.8030           0.0060           0.0280           0.0078
Pooling                              2320        3194.2820           0.0640           3.1720           1.3768
Convolution                          2320       13155.3965           0.2260          13.2050           5.6704
CopyCPU2CPU                          1160           6.6720           0.0030           0.0360           0.0058
log_softmax                          1000          30.7870           0.0150           0.0500           0.0308
_backward_copy                       1000          51.5540           0.0220           0.0760           0.0516
_backward_Convolution                2000       18423.6621           2.6370          12.5610           9.2118
_mul_scalar                          1000           3.5320           0.0020           0.0230           0.0035
_backward_log_softmax                1000          16.7030           0.0090           0.0400           0.0167
mean                                 3160          60.3350           0.0080           0.0730           0.0191
_backward_mean                       1000          10.8810           0.0080           0.1030           0.0109
_backward_FullyConnected             3000         560.0500           0.0280           0.5940           0.1867
WaitForVar                           2160          19.1900           0.0060           0.0280           0.0089
broadcast_equal                      1160           5.7420           0.0030           0.0100           0.0049
sgd_update                          10000          96.8060           0.0020           0.0640           0.0097
_backward_Activation                 4000         293.2170           0.0070           0.3900           0.0733



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       39474       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3486        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             500        1986.5400           0.3060          73.5850           3.9731
MXNDArrayCreateEx                     581          19.8750           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      501       10819.5723           5.6130          24.8060          21.5960
MXNDArraySyncCopyToCPU               1082        8532.9180           0.1180          24.1980           7.8862
MXNDArrayGetDType                    1082           0.3760           0.0000           0.0010           0.0003
MXNDArrayGetShape                    2745           1.2690           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1162          10.1950           0.0070           0.0280           0.0088
MXNDArrayFree                       12963         132.5110           0.0000           0.9140           0.0102
MXNet C API Calls                   58007         545.3640         487.3580         545.3640          29.0030
MXNet C API Concurrency            116013           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1002           0.4790           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5010           2.6080           0.0000           0.0230           0.0005
MXNDArraySetGradState                5010           2.5550           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1002           0.4290           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  501         272.3150           0.5250           0.6810           0.5435
MXNDArrayGetContext                  8054           3.4700           0.0000           0.0070           0.0004
MXImperativeInvokeEx                16811         427.2660           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2004        4873.5840           0.7010           3.7500           2.4319
FullyConnected                       3486         330.4100           0.0080           0.3430           0.0948
argmax                               1162          22.6940           0.0050           0.0480           0.0195
_backward_pick                       1002          15.7030           0.0130           0.0260           0.0157
_backward_mul_scalar                 1002           4.3250           0.0030           0.0160           0.0043
DeleteVariable                      42960         304.8390           0.0010           0.9010           0.0071
Flatten                              1162          48.0920           0.0080           0.1120           0.0414
Activation                           4648         210.5400           0.0030           0.3430           0.0453
SetValueOp                           1002           6.4130           0.0050           0.0180           0.0064
pick                                 1002           7.8180           0.0060           0.0280           0.0078
Pooling                              2324        3199.6421           0.0640           3.1720           1.3768
Convolution                          2324       13177.6572           0.2260          13.2050           5.6702
CopyCPU2CPU                          1162           6.6810           0.0030           0.0360           0.0057
log_softmax                          1002          30.8460           0.0150           0.0500           0.0308
_backward_copy                       1002          51.6660           0.0220           0.0760           0.0516
_backward_Convolution                2004       18460.7793           2.6370          12.5610           9.2120
_mul_scalar                          1002           3.5390           0.0020           0.0230           0.0035
_backward_log_softmax                1002          16.7360           0.0090           0.0400           0.0167
mean                                 3166          60.4510           0.0080           0.0730           0.0191
_backward_mean                       1002          10.9030           0.0080           0.1030           0.0109
_backward_FullyConnected             3006         561.1360           0.0280           0.5940           0.1867
WaitForVar                           2164          19.2280           0.0060           0.0280           0.0089
broadcast_equal                      1162           5.7520           0.0030           0.0100           0.0050
sgd_update                          10020          97.0060           0.0020           0.0640           0.0097
_backward_Activation                 4008         293.7860           0.0070           0.3900           0.0733



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       39548       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3492        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             501        1990.4290           0.3060          73.5850           3.9729
MXNDArrayCreateEx                     582          19.9080           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      502       10841.4502           5.6130          24.8060          21.5965
MXNDArraySyncCopyToCPU               1084        8547.8652           0.1180          24.1980           7.8855
MXNDArrayGetDType                    1084           0.3770           0.0000           0.0010           0.0003
MXNDArrayGetShape                    2750           1.2710           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1164          10.2120           0.0070           0.0280           0.0088
MXNDArrayFree                       12986         132.7390           0.0000           0.9140           0.0102
MXNet C API Calls                   58114         545.4710         487.3580         545.4710          29.0565
MXNet C API Concurrency            116227           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1004           0.4810           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5020           2.6140           0.0000           0.0230           0.0005
MXNDArraySetGradState                5020           2.5580           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1004           0.4290           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  502         272.8670           0.5250           0.6810           0.5436
MXNDArrayGetContext                  8068           3.4750           0.0000           0.0070           0.0004
MXImperativeInvokeEx                16842         428.0320           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2008        4883.2822           0.7010           3.7500           2.4319
FullyConnected                       3492         331.1930           0.0080           0.3430           0.0948
argmax                               1164          22.7390           0.0050           0.0480           0.0195
_backward_pick                       1004          15.7380           0.0130           0.0260           0.0157
_backward_mul_scalar                 1004           4.3340           0.0030           0.0160           0.0043
DeleteVariable                      43040         305.3800           0.0010           0.9010           0.0071
Flatten                              1164          48.1770           0.0080           0.1120           0.0414
Activation                           4656         210.9380           0.0030           0.3430           0.0453
SetValueOp                           1004           6.4270           0.0050           0.0180           0.0064
pick                                 1004           7.8350           0.0060           0.0280           0.0078
Pooling                              2328        3205.0449           0.0640           3.1720           1.3767
Convolution                          2328       13200.1035           0.2260          13.2050           5.6701
CopyCPU2CPU                          1164           6.6920           0.0030           0.0360           0.0057
log_softmax                          1004          30.9180           0.0150           0.0500           0.0308
_backward_copy                       1004          51.7750           0.0220           0.0760           0.0516
_backward_Convolution                2008       18497.8750           2.6370          12.5610           9.2121
_mul_scalar                          1004           3.5460           0.0020           0.0230           0.0035
_backward_log_softmax                1004          16.7790           0.0090           0.0400           0.0167
mean                                 3172          60.5580           0.0080           0.0730           0.0191
_backward_mean                       1004          10.9260           0.0080           0.1030           0.0109
_backward_FullyConnected             3012         562.5610           0.0280           0.5940           0.1868
WaitForVar                           2168          19.2660           0.0060           0.0280           0.0089
broadcast_equal                      1164           5.7620           0.0030           0.0100           0.0050
sgd_update                          10040          97.2740           0.0020           0.0640           0.0097
_backward_Activation                 4016         294.3750           0.0070           0.3900           0.0733



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       39622       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3498        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             502        1994.3330           0.3060          73.5850           3.9728
MXNDArrayCreateEx                     583          19.9410           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      503       10863.1494           5.6130          24.8060          21.5967
MXNDArraySyncCopyToCPU               1086        8562.3711           0.1180          24.1980           7.8843
MXNDArrayGetDType                    1086           0.3770           0.0000           0.0010           0.0003
MXNDArrayGetShape                    2755           1.2720           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1166          10.2290           0.0070           0.0280           0.0088
MXNDArrayFree                       13009         132.9620           0.0000           0.9140           0.0102
MXNet C API Calls                   58221         545.5780         487.3580         545.5780          29.1100
MXNet C API Concurrency            116441           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1006           0.4810           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5030           2.6210           0.0000           0.0230           0.0005
MXNDArraySetGradState                5030           2.5640           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1006           0.4290           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  503         273.3970           0.5250           0.6810           0.5435
MXNDArrayGetContext                  8082           3.4810           0.0000           0.0070           0.0004
MXImperativeInvokeEx                16873         428.8090           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2012        4892.9932           0.7010           3.7500           2.4319
FullyConnected                       3498         331.7210           0.0080           0.3430           0.0948
argmax                               1166          22.7760           0.0050           0.0480           0.0195
_backward_pick                       1006          15.7680           0.0130           0.0260           0.0157
_backward_mul_scalar                 1006           4.3430           0.0030           0.0160           0.0043
DeleteVariable                      43120         305.9120           0.0010           0.9010           0.0071
Flatten                              1166          48.2770           0.0080           0.1120           0.0414
Activation                           4664         211.3200           0.0030           0.3430           0.0453
SetValueOp                           1006           6.4400           0.0050           0.0180           0.0064
pick                                 1006           7.8510           0.0060           0.0280           0.0078
Pooling                              2332        3210.4021           0.0640           3.1720           1.3767
Convolution                          2332       13222.4219           0.2260          13.2050           5.6700
CopyCPU2CPU                          1166           6.7020           0.0030           0.0360           0.0057
log_softmax                          1006          30.9790           0.0150           0.0500           0.0308
_backward_copy                       1006          51.8790           0.0220           0.0760           0.0516
_backward_Convolution                2012       18534.6680           2.6370          12.5610           9.2121
_mul_scalar                          1006           3.5530           0.0020           0.0230           0.0035
_backward_log_softmax                1006          16.8110           0.0090           0.0400           0.0167
mean                                 3178          60.6700           0.0080           0.0730           0.0191
_backward_mean                       1006          10.9490           0.0080           0.1030           0.0109
_backward_FullyConnected             3018         563.6320           0.0280           0.5940           0.1868
WaitForVar                           2172          19.3020           0.0060           0.0280           0.0089
broadcast_equal                      1166           5.7720           0.0030           0.0100           0.0050
sgd_update                          10060          97.4730           0.0020           0.0640           0.0097
_backward_Activation                 4024         294.9270           0.0070           0.3900           0.0733



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       39696       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3504        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             503        1998.2330           0.3060          73.5850           3.9726
MXNDArrayCreateEx                     584          19.9750           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      504       10884.8516           5.6130          24.8060          21.5969
MXNDArraySyncCopyToCPU               1088        8576.7617           0.1180          24.1980           7.8831
MXNDArrayGetDType                    1088           0.3780           0.0000           0.0010           0.0003
MXNDArrayGetShape                    2760           1.2740           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1168          10.2460           0.0070           0.0280           0.0088
MXNDArrayFree                       13032         133.1780           0.0000           0.9140           0.0102
MXNet C API Calls                   58328         545.6850         487.3580         545.6850          29.1635
MXNet C API Concurrency            116655           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1008           0.4820           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5040           2.6270           0.0000           0.0230           0.0005
MXNDArraySetGradState                5040           2.5690           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1008           0.4310           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  504         273.9270           0.5250           0.6810           0.5435
MXNDArrayGetContext                  8096           3.4890           0.0000           0.0070           0.0004
MXImperativeInvokeEx                16904         429.5820           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2016        4902.6641           0.7010           3.7500           2.4319
FullyConnected                       3504         332.2640           0.0080           0.3430           0.0948
argmax                               1168          22.8140           0.0050           0.0480           0.0195
_backward_pick                       1008          15.8010           0.0130           0.0260           0.0157
_backward_mul_scalar                 1008           4.3520           0.0030           0.0160           0.0043
DeleteVariable                      43200         306.4380           0.0010           0.9010           0.0071
Flatten                              1168          48.3740           0.0080           0.1120           0.0414
Activation                           4672         211.6720           0.0030           0.3430           0.0453
SetValueOp                           1008           6.4530           0.0050           0.0180           0.0064
pick                                 1008           7.8660           0.0060           0.0280           0.0078
Pooling                              2336        3215.7590           0.0640           3.1720           1.3766
Convolution                          2336       13244.6504           0.2260          13.2050           5.6698
CopyCPU2CPU                          1168           6.7130           0.0030           0.0360           0.0057
log_softmax                          1008          31.0400           0.0150           0.0500           0.0308
_backward_copy                       1008          51.9820           0.0220           0.0760           0.0516
_backward_Convolution                2016       18571.4316           2.6370          12.5610           9.2120
_mul_scalar                          1008           3.5610           0.0020           0.0230           0.0035
_backward_log_softmax                1008          16.8430           0.0090           0.0400           0.0167
mean                                 3184          60.7830           0.0080           0.0730           0.0191
_backward_mean                       1008          10.9710           0.0080           0.1030           0.0109
_backward_FullyConnected             3024         564.7030           0.0280           0.5940           0.1867
WaitForVar                           2176          19.3380           0.0060           0.0280           0.0089
broadcast_equal                      1168           5.7810           0.0030           0.0100           0.0049
sgd_update                          10080          97.6250           0.0020           0.0640           0.0097
_backward_Activation                 4032         295.5140           0.0070           0.3900           0.0733



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       39770       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3510        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             504        2002.1270           0.3060          73.5850           3.9725
MXNDArrayCreateEx                     585          20.0090           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      505       10906.7031           5.6130          24.8060          21.5974
MXNDArraySyncCopyToCPU               1090        8591.1465           0.1180          24.1980           7.8818
MXNDArrayGetDType                    1090           0.3780           0.0000           0.0010           0.0003
MXNDArrayGetShape                    2765           1.2770           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1170          10.2630           0.0070           0.0280           0.0088
MXNDArrayFree                       13055         133.4030           0.0000           0.9140           0.0102
MXNet C API Calls                   58435         545.7920         487.3580         545.7920          29.2170
MXNet C API Concurrency            116869           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1010           0.4830           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5050           2.6320           0.0000           0.0230           0.0005
MXNDArraySetGradState                5050           2.5720           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1010           0.4330           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  505         274.4600           0.5250           0.6810           0.5435
MXNDArrayGetContext                  8110           3.4960           0.0000           0.0070           0.0004
MXImperativeInvokeEx                16935         430.3830           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2020        4912.3579           0.7010           3.7500           2.4319
FullyConnected                       3510         332.7910           0.0080           0.3430           0.0948
argmax                               1170          22.8510           0.0050           0.0480           0.0195
_backward_pick                       1010          15.8320           0.0130           0.0260           0.0157
_backward_mul_scalar                 1010           4.3590           0.0030           0.0160           0.0043
DeleteVariable                      43280         306.9430           0.0010           0.9010           0.0071
Flatten                              1170          48.4510           0.0080           0.1120           0.0414
Activation                           4680         212.0240           0.0030           0.3430           0.0453
SetValueOp                           1010           6.4670           0.0050           0.0180           0.0064
pick                                 1010           7.8810           0.0060           0.0280           0.0078
Pooling                              2340        3221.1599           0.0640           3.1720           1.3766
Convolution                          2340       13266.8164           0.2260          13.2050           5.6696
CopyCPU2CPU                          1170           6.7230           0.0030           0.0360           0.0057
log_softmax                          1010          31.0990           0.0150           0.0500           0.0308
_backward_copy                       1010          52.0850           0.0220           0.0760           0.0516
_backward_Convolution                2020       18608.5469           2.6370          12.5610           9.2122
_mul_scalar                          1010           3.5680           0.0020           0.0230           0.0035
_backward_log_softmax                1010          16.8740           0.0090           0.0400           0.0167
mean                                 3190          60.8990           0.0080           0.0730           0.0191
_backward_mean                       1010          10.9920           0.0080           0.1030           0.0109
_backward_FullyConnected             3030         565.7690           0.0280           0.5940           0.1867
WaitForVar                           2180          19.3730           0.0060           0.0280           0.0089
broadcast_equal                      1170           5.7910           0.0030           0.0100           0.0049
sgd_update                          10100          97.8240           0.0020           0.0640           0.0097
_backward_Activation                 4040         296.0840           0.0070           0.3900           0.0733



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       39844       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3516        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             505        2006.0410           0.3060          73.5850           3.9724
MXNDArrayCreateEx                     586          20.0420           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      506       10928.5986           5.6130          24.8060          21.5980
MXNDArraySyncCopyToCPU               1092        8605.9844           0.1180          24.1980           7.8809
MXNDArrayGetDType                    1092           0.3780           0.0000           0.0010           0.0003
MXNDArrayGetShape                    2770           1.2780           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1172          10.2800           0.0070           0.0280           0.0088
MXNDArrayFree                       13078         133.6460           0.0000           0.9140           0.0102
MXNet C API Calls                   58542         545.8990         487.3580         545.8990          29.2705
MXNet C API Concurrency            117083           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1012           0.4830           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5060           2.6360           0.0000           0.0230           0.0005
MXNDArraySetGradState                5060           2.5780           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1012           0.4330           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  506         274.9970           0.5250           0.6810           0.5435
MXNDArrayGetContext                  8124           3.4980           0.0000           0.0070           0.0004
MXImperativeInvokeEx                16966         431.1780           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2024        4922.1289           0.7010           3.7500           2.4319
FullyConnected                       3516         333.6060           0.0080           0.3430           0.0949
argmax                               1172          22.8960           0.0050           0.0480           0.0195
_backward_pick                       1012          15.8650           0.0130           0.0260           0.0157
_backward_mul_scalar                 1012           4.3660           0.0030           0.0160           0.0043
DeleteVariable                      43360         307.4960           0.0010           0.9010           0.0071
Flatten                              1172          48.5380           0.0080           0.1120           0.0414
Activation                           4688         212.4140           0.0030           0.3430           0.0453
SetValueOp                           1012           6.4800           0.0050           0.0180           0.0064
pick                                 1012           7.8960           0.0060           0.0280           0.0078
Pooling                              2344        3226.5181           0.0640           3.1720           1.3765
Convolution                          2344       13289.1641           0.2260          13.2050           5.6694
CopyCPU2CPU                          1172           6.7330           0.0030           0.0360           0.0057
log_softmax                          1012          31.1690           0.0150           0.0500           0.0308
_backward_copy                       1012          52.1860           0.0220           0.0760           0.0516
_backward_Convolution                2024       18645.6074           2.6370          12.5610           9.2123
_mul_scalar                          1012           3.5740           0.0020           0.0230           0.0035
_backward_log_softmax                1012          16.9170           0.0090           0.0400           0.0167
mean                                 3196          61.0100           0.0080           0.0730           0.0191
_backward_mean                       1012          11.0130           0.0080           0.1030           0.0109
_backward_FullyConnected             3036         567.1840           0.0280           0.5940           0.1868
WaitForVar                           2184          19.4070           0.0060           0.0280           0.0089
broadcast_equal                      1172           5.8000           0.0030           0.0100           0.0049
sgd_update                          10120          98.0950           0.0020           0.0640           0.0097
_backward_Activation                 4048         296.6670           0.0070           0.3900           0.0733



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       39918       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3522        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             506        2009.9320           0.3060          73.5850           3.9722
MXNDArrayCreateEx                     587          20.0750           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      507       10950.3340           5.6130          24.8060          21.5983
MXNDArraySyncCopyToCPU               1094        8620.3438           0.1180          24.1980           7.8797
MXNDArrayGetDType                    1094           0.3780           0.0000           0.0010           0.0003
MXNDArrayGetShape                    2775           1.2780           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1174          10.2980           0.0070           0.0280           0.0088
MXNDArrayFree                       13101         133.8690           0.0000           0.9140           0.0102
MXNet C API Calls                   58649         546.0060         487.3580         546.0060          29.3240
MXNet C API Concurrency            117297           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1014           0.4830           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5070           2.6390           0.0000           0.0230           0.0005
MXNDArraySetGradState                5070           2.5860           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1014           0.4340           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  507         275.5290           0.5250           0.6810           0.5434
MXNDArrayGetContext                  8138           3.5050           0.0000           0.0070           0.0004
MXImperativeInvokeEx                16997         431.9570           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2028        4931.8931           0.7010           3.7500           2.4319
FullyConnected                       3522         334.1610           0.0080           0.3430           0.0949
argmax                               1174          22.9340           0.0050           0.0480           0.0195
_backward_pick                       1014          15.8960           0.0130           0.0260           0.0157
_backward_mul_scalar                 1014           4.3740           0.0030           0.0160           0.0043
DeleteVariable                      43440         308.0290           0.0010           0.9010           0.0071
Flatten                              1174          48.6210           0.0080           0.1120           0.0414
Activation                           4696         212.7660           0.0030           0.3430           0.0453
SetValueOp                           1014           6.4920           0.0050           0.0180           0.0064
pick                                 1014           7.9110           0.0060           0.0280           0.0078
Pooling                              2348        3231.8899           0.0640           3.1720           1.3764
Convolution                          2348       13311.3193           0.2260          13.2050           5.6692
CopyCPU2CPU                          1174           6.7430           0.0030           0.0360           0.0057
log_softmax                          1014          31.2280           0.0150           0.0500           0.0308
_backward_copy                       1014          52.2910           0.0220           0.0760           0.0516
_backward_Convolution                2028       18682.4082           2.6370          12.5610           9.2122
_mul_scalar                          1014           3.5800           0.0020           0.0230           0.0035
_backward_log_softmax                1014          16.9480           0.0090           0.0400           0.0167
mean                                 3202          61.1230           0.0080           0.0730           0.0191
_backward_mean                       1014          11.0330           0.0080           0.1030           0.0109
_backward_FullyConnected             3042         568.2420           0.0280           0.5940           0.1868
WaitForVar                           2188          19.4410           0.0060           0.0280           0.0089
broadcast_equal                      1174           5.8090           0.0030           0.0100           0.0049
sgd_update                          10140          98.2490           0.0020           0.0640           0.0097
_backward_Activation                 4056         297.2790           0.0070           0.3900           0.0733



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       39992       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3528        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             507        2013.8300           0.3060          73.5850           3.9721
MXNDArrayCreateEx                     588          20.1130           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      508       10972.0645           5.6130          24.8060          21.5986
MXNDArraySyncCopyToCPU               1096        8633.8076           0.1180          24.1980           7.8776
MXNDArrayGetDType                    1096           0.3790           0.0000           0.0010           0.0003
MXNDArrayGetShape                    2780           1.2790           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1176          10.3170           0.0070           0.0280           0.0088
MXNDArrayFree                       13124         134.1020           0.0000           0.9140           0.0102
MXNet C API Calls                   58756         546.1130         487.3580         546.1130          29.3775
MXNet C API Concurrency            117511           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1016           0.4840           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5080           2.6450           0.0000           0.0230           0.0005
MXNDArraySetGradState                5080           2.5890           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1016           0.4360           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  508         276.0690           0.5250           0.6810           0.5434
MXNDArrayGetContext                  8152           3.5150           0.0000           0.0070           0.0004
MXImperativeInvokeEx                17028         432.7870           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2032        4941.5962           0.7010           3.7500           2.4319
FullyConnected                       3528         334.7110           0.0080           0.3430           0.0949
argmax                               1176          22.9720           0.0050           0.0480           0.0195
_backward_pick                       1016          15.9250           0.0130           0.0260           0.0157
_backward_mul_scalar                 1016           4.3830           0.0030           0.0160           0.0043
DeleteVariable                      43520         308.5650           0.0010           0.9010           0.0071
Flatten                              1176          48.6960           0.0080           0.1120           0.0414
Activation                           4704         213.1170           0.0030           0.3430           0.0453
SetValueOp                           1016           6.5050           0.0050           0.0180           0.0064
pick                                 1016           7.9260           0.0060           0.0280           0.0078
Pooling                              2352        3237.1980           0.0640           3.1720           1.3764
Convolution                          2352       13333.4287           0.2260          13.2050           5.6690
CopyCPU2CPU                          1176           6.7540           0.0030           0.0360           0.0057
log_softmax                          1016          31.2880           0.0150           0.0500           0.0308
_backward_copy                       1016          52.3940           0.0220           0.0760           0.0516
_backward_Convolution                2032       18719.1836           2.6370          12.5610           9.2122
_mul_scalar                          1016           3.5870           0.0020           0.0230           0.0035
_backward_log_softmax                1016          16.9790           0.0090           0.0400           0.0167
mean                                 3208          61.2430           0.0080           0.0730           0.0191
_backward_mean                       1016          11.0530           0.0080           0.1030           0.0109
_backward_FullyConnected             3048         569.3600           0.0280           0.5940           0.1868
WaitForVar                           2192          19.4750           0.0060           0.0280           0.0089
broadcast_equal                      1176           5.8180           0.0030           0.0100           0.0049
sgd_update                          10160          98.4030           0.0020           0.0640           0.0097
_backward_Activation                 4064         297.8700           0.0070           0.3900           0.0733



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       40066       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3534        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             508        2015.8350           0.3060          73.5850           3.9682
MXNDArrayCreateEx                     589          20.1460           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      509       10993.8975           5.6130          24.8060          21.5990
MXNDArraySyncCopyToCPU               1098        8648.1953           0.1180          24.1980           7.8763
MXNDArrayGetDType                    1098           0.3800           0.0000           0.0010           0.0003
MXNDArrayGetShape                    2785           1.2810           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1178          10.3350           0.0070           0.0280           0.0088
MXNDArrayFree                       13147         134.3570           0.0000           0.9140           0.0102
MXNet C API Calls                   58863         546.2200         487.3580         546.2200          29.4310
MXNet C API Concurrency            117725           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1018           0.4840           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5090           2.6500           0.0000           0.0230           0.0005
MXNDArraySetGradState                5090           2.5940           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1018           0.4360           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  509         276.6050           0.5250           0.6810           0.5434
MXNDArrayGetContext                  8166           3.5230           0.0000           0.0070           0.0004
MXImperativeInvokeEx                17059         433.5630           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2036        4951.3071           0.7010           3.7500           2.4319
FullyConnected                       3534         335.2310           0.0080           0.3430           0.0949
argmax                               1178          23.0090           0.0050           0.0480           0.0195
_backward_pick                       1018          15.9550           0.0130           0.0260           0.0157
_backward_mul_scalar                 1018           4.3920           0.0030           0.0160           0.0043
DeleteVariable                      43600         309.1360           0.0010           0.9010           0.0071
Flatten                              1178          48.7730           0.0080           0.1120           0.0414
Activation                           4712         213.5070           0.0030           0.3430           0.0453
SetValueOp                           1018           6.5160           0.0050           0.0180           0.0064
pick                                 1018           7.9400           0.0060           0.0280           0.0078
Pooling                              2356        3242.5710           0.0640           3.1720           1.3763
Convolution                          2356       13355.5957           0.2260          13.2050           5.6688
CopyCPU2CPU                          1178           6.7640           0.0030           0.0360           0.0057
log_softmax                          1018          31.3470           0.0150           0.0500           0.0308
_backward_copy                       1018          52.4980           0.0220           0.0760           0.0516
_backward_Convolution                2036       18756.2207           2.6370          12.5610           9.2123
_mul_scalar                          1018           3.5940           0.0020           0.0230           0.0035
_backward_log_softmax                1018          17.0100           0.0090           0.0400           0.0167
mean                                 3214          61.3600           0.0080           0.0730           0.0191
_backward_mean                       1018          11.0730           0.0080           0.1030           0.0109
_backward_FullyConnected             3054         570.4280           0.0280           0.5940           0.1868
WaitForVar                           2196          19.5090           0.0060           0.0280           0.0089
broadcast_equal                      1178           5.8270           0.0030           0.0100           0.0049
sgd_update                          10180          98.6060           0.0020           0.0640           0.0097
_backward_Activation                 4072         298.4260           0.0070           0.3900           0.0733



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       40140       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3540        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             509        2019.7250           0.3060          73.5850           3.9680
MXNDArrayCreateEx                     590          20.1790           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      510       11015.7646           5.6130          24.8060          21.5995
MXNDArraySyncCopyToCPU               1100        8662.9971           0.1180          24.1980           7.8755
MXNDArrayGetDType                    1100           0.3820           0.0000           0.0010           0.0003
MXNDArrayGetShape                    2790           1.2830           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1180          10.3520           0.0070           0.0280           0.0088
MXNDArrayFree                       13170         134.5950           0.0000           0.9140           0.0102
MXNet C API Calls                   58970         546.3270         487.3580         546.3270          29.4845
MXNet C API Concurrency            117939           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1020           0.4850           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5100           2.6540           0.0000           0.0230           0.0005
MXNDArraySetGradState                5100           2.6000           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1020           0.4380           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  510         277.1370           0.5250           0.6810           0.5434
MXNDArrayGetContext                  8180           3.5300           0.0000           0.0070           0.0004
MXImperativeInvokeEx                17090         434.3350           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2040        4960.9248           0.7010           3.7500           2.4318
FullyConnected                       3540         336.0300           0.0080           0.3430           0.0949
argmax                               1180          23.0530           0.0050           0.0480           0.0195
_backward_pick                       1020          15.9870           0.0130           0.0260           0.0157
_backward_mul_scalar                 1020           4.4000           0.0030           0.0160           0.0043
DeleteVariable                      43680         309.6970           0.0010           0.9010           0.0071
Flatten                              1180          48.8500           0.0080           0.1120           0.0414
Activation                           4720         213.8880           0.0030           0.3430           0.0453
SetValueOp                           1020           6.5290           0.0050           0.0180           0.0064
pick                                 1020           7.9550           0.0060           0.0280           0.0078
Pooling                              2360        3247.9451           0.0640           3.1720           1.3762
Convolution                          2360       13377.9180           0.2260          13.2050           5.6686
CopyCPU2CPU                          1180           6.7740           0.0030           0.0360           0.0057
log_softmax                          1020          31.4190           0.0150           0.0500           0.0308
_backward_copy                       1020          52.5990           0.0220           0.0760           0.0516
_backward_Convolution                2040       18793.3164           2.6370          12.5610           9.2124
_mul_scalar                          1020           3.6000           0.0020           0.0230           0.0035
_backward_log_softmax                1020          17.0510           0.0090           0.0400           0.0167
mean                                 3220          61.4690           0.0080           0.0730           0.0191
_backward_mean                       1020          11.0950           0.0080           0.1030           0.0109
_backward_FullyConnected             3060         571.8550           0.0280           0.5940           0.1869
WaitForVar                           2200          19.5440           0.0060           0.0280           0.0089
broadcast_equal                      1180           5.8360           0.0030           0.0100           0.0049
sgd_update                          10200          98.8160           0.0020           0.0640           0.0097
_backward_Activation                 4080         299.1000           0.0070           0.3900           0.0733



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       40214       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3546        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             510        2023.6379           0.3060          73.5850           3.9679
MXNDArrayCreateEx                     591          20.2120           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      511       11037.4736           5.6130          24.8060          21.5998
MXNDArraySyncCopyToCPU               1102        8677.3770           0.1180          24.1980           7.8742
MXNDArrayGetDType                    1102           0.3830           0.0000           0.0010           0.0003
MXNDArrayGetShape                    2795           1.2830           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1182          10.3690           0.0070           0.0280           0.0088
MXNDArrayFree                       13193         134.8430           0.0000           0.9140           0.0102
MXNet C API Calls                   59077         546.4340         487.3580         546.4340          29.5380
MXNet C API Concurrency            118153           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1022           0.4860           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5110           2.6610           0.0000           0.0230           0.0005
MXNDArraySetGradState                5110           2.6050           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1022           0.4400           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  511         277.6740           0.5250           0.6810           0.5434
MXNDArrayGetContext                  8194           3.5360           0.0000           0.0070           0.0004
MXImperativeInvokeEx                17121         435.1120           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2044        4970.5840           0.7010           3.7500           2.4318
FullyConnected                       3546         336.5530           0.0080           0.3430           0.0949
argmax                               1182          23.0920           0.0050           0.0480           0.0195
_backward_pick                       1022          16.0180           0.0130           0.0260           0.0157
_backward_mul_scalar                 1022           4.4080           0.0030           0.0160           0.0043
DeleteVariable                      43760         310.2930           0.0010           0.9010           0.0071
Flatten                              1182          48.9290           0.0080           0.1120           0.0414
Activation                           4728         214.2400           0.0030           0.3430           0.0453
SetValueOp                           1022           6.5410           0.0050           0.0180           0.0064
pick                                 1022           7.9700           0.0060           0.0280           0.0078
Pooling                              2364        3253.2949           0.0640           3.1720           1.3762
Convolution                          2364       13400.0957           0.2260          13.2050           5.6684
CopyCPU2CPU                          1182           6.7830           0.0030           0.0360           0.0057
log_softmax                          1022          31.4790           0.0150           0.0500           0.0308
_backward_copy                       1022          52.7020           0.0220           0.0760           0.0516
_backward_Convolution                2044       18830.1289           2.6370          12.5610           9.2124
_mul_scalar                          1022           3.6070           0.0020           0.0230           0.0035
_backward_log_softmax                1022          17.0820           0.0090           0.0400           0.0167
mean                                 3226          61.5820           0.0080           0.0730           0.0191
_backward_mean                       1022          11.1160           0.0080           0.1030           0.0109
_backward_FullyConnected             3066         572.9190           0.0280           0.5940           0.1869
WaitForVar                           2204          19.5780           0.0060           0.0280           0.0089
broadcast_equal                      1182           5.8450           0.0030           0.0100           0.0049
sgd_update                          10220          99.0170           0.0020           0.0640           0.0097
_backward_Activation                 4088         299.6800           0.0070           0.3900           0.0733



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       40288       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3552        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             511        2027.5410           0.3060          73.5850           3.9678
MXNDArrayCreateEx                     592          20.2450           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      512       11059.2041           5.6130          24.8060          21.6000
MXNDArraySyncCopyToCPU               1104        8691.6572           0.1180          24.1980           7.8729
MXNDArrayGetDType                    1104           0.3840           0.0000           0.0010           0.0003
MXNDArrayGetShape                    2800           1.2840           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1184          10.3850           0.0070           0.0280           0.0088
MXNDArrayFree                       13216         135.0640           0.0000           0.9140           0.0102
MXNet C API Calls                   59184         546.5410         487.3580         546.5410          29.5915
MXNet C API Concurrency            118367           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1024           0.4870           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5120           2.6640           0.0000           0.0230           0.0005
MXNDArraySetGradState                5120           2.6100           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1024           0.4410           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  512         278.2100           0.5250           0.6810           0.5434
MXNDArrayGetContext                  8208           3.5420           0.0000           0.0070           0.0004
MXImperativeInvokeEx                17152         435.8860           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2048        4980.3008           0.7010           3.7500           2.4318
FullyConnected                       3552         337.1450           0.0080           0.3430           0.0949
argmax                               1184          23.1300           0.0050           0.0480           0.0195
_backward_pick                       1024          16.0480           0.0130           0.0260           0.0157
_backward_mul_scalar                 1024           4.4160           0.0030           0.0160           0.0043
DeleteVariable                      43840         310.7980           0.0010           0.9010           0.0071
Flatten                              1184          49.0060           0.0080           0.1120           0.0414
Activation                           4736         214.5930           0.0030           0.3430           0.0453
SetValueOp                           1024           6.5530           0.0050           0.0180           0.0064
pick                                 1024           7.9850           0.0060           0.0280           0.0078
Pooling                              2368        3258.6499           0.0640           3.1720           1.3761
Convolution                          2368       13422.1904           0.2260          13.2050           5.6682
CopyCPU2CPU                          1184           6.7920           0.0030           0.0360           0.0057
log_softmax                          1024          31.5400           0.0150           0.0500           0.0308
_backward_copy                       1024          52.8050           0.0220           0.0760           0.0516
_backward_Convolution                2048       18866.8633           2.6370          12.5610           9.2123
_mul_scalar                          1024           3.6130           0.0020           0.0230           0.0035
_backward_log_softmax                1024          17.1130           0.0090           0.0400           0.0167
mean                                 3232          61.6900           0.0080           0.0730           0.0191
_backward_mean                       1024          11.1370           0.0080           0.1030           0.0109
_backward_FullyConnected             3072         573.9840           0.0280           0.5940           0.1868
WaitForVar                           2208          19.6120           0.0060           0.0280           0.0089
broadcast_equal                      1184           5.8540           0.0030           0.0100           0.0049
sgd_update                          10240          99.1670           0.0020           0.0640           0.0097
_backward_Activation                 4096         300.2950           0.0070           0.3900           0.0733



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       40362       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3558        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             512        2031.4390           0.3060          73.5850           3.9677
MXNDArrayCreateEx                     593          20.2780           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      513       11080.9941           5.6130          24.8060          21.6004
MXNDArraySyncCopyToCPU               1106        8706.0225           0.1180          24.1980           7.8716
MXNDArrayGetDType                    1106           0.3840           0.0000           0.0010           0.0003
MXNDArrayGetShape                    2805           1.2850           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1186          10.4030           0.0070           0.0280           0.0088
MXNDArrayFree                       13239         135.2900           0.0000           0.9140           0.0102
MXNet C API Calls                   59291         546.6480         487.3580         546.6480          29.6450
MXNet C API Concurrency            118581           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1026           0.4890           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5130           2.6680           0.0000           0.0230           0.0005
MXNDArraySetGradState                5130           2.6150           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1026           0.4410           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  513         278.7430           0.5250           0.6810           0.5434
MXNDArrayGetContext                  8222           3.5450           0.0000           0.0070           0.0004
MXImperativeInvokeEx                17183         436.6630           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2052        4989.9771           0.7010           3.7500           2.4318
FullyConnected                       3558         337.6890           0.0080           0.3430           0.0949
argmax                               1186          23.1670           0.0050           0.0480           0.0195
_backward_pick                       1026          16.0790           0.0130           0.0260           0.0157
_backward_mul_scalar                 1026           4.4240           0.0030           0.0160           0.0043
DeleteVariable                      43920         311.3000           0.0010           0.9010           0.0071
Flatten                              1186          49.0860           0.0080           0.1120           0.0414
Activation                           4744         214.9440           0.0030           0.3430           0.0453
SetValueOp                           1026           6.5650           0.0050           0.0180           0.0064
pick                                 1026           8.0000           0.0060           0.0280           0.0078
Pooling                              2372        3264.0239           0.0640           3.1720           1.3761
Convolution                          2372       13444.3721           0.2260          13.2050           5.6679
CopyCPU2CPU                          1186           6.8020           0.0030           0.0360           0.0057
log_softmax                          1026          31.5990           0.0150           0.0500           0.0308
_backward_copy                       1026          52.9100           0.0220           0.0760           0.0516
_backward_Convolution                2052       18903.8027           2.6370          12.5610           9.2124
_mul_scalar                          1026           3.6200           0.0020           0.0230           0.0035
_backward_log_softmax                1026          17.1440           0.0090           0.0400           0.0167
mean                                 3238          61.8040           0.0080           0.0730           0.0191
_backward_mean                       1026          11.1570           0.0080           0.1030           0.0109
_backward_FullyConnected             3078         575.0490           0.0280           0.5940           0.1868
WaitForVar                           2212          19.6460           0.0060           0.0280           0.0089
broadcast_equal                      1186           5.8630           0.0030           0.0100           0.0049
sgd_update                          10260          99.3160           0.0020           0.0640           0.0097
_backward_Activation                 4104         300.9110           0.0070           0.3900           0.0733



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       40436       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3564        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             513        2035.3440           0.3060          73.5850           3.9675
MXNDArrayCreateEx                     594          20.3110           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      514       11102.8213           5.6130          24.8060          21.6008
MXNDArraySyncCopyToCPU               1108        8720.8398           0.1180          24.1980           7.8708
MXNDArrayGetDType                    1108           0.3850           0.0000           0.0010           0.0003
MXNDArrayGetShape                    2810           1.2880           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1188          10.4200           0.0070           0.0280           0.0088
MXNDArrayFree                       13262         135.5200           0.0000           0.9140           0.0102
MXNet C API Calls                   59398         546.7550         487.3580         546.7550          29.6985
MXNet C API Concurrency            118795           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1028           0.4890           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5140           2.6750           0.0000           0.0230           0.0005
MXNDArraySetGradState                5140           2.6200           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1028           0.4420           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  514         279.2750           0.5250           0.6810           0.5433
MXNDArrayGetContext                  8236           3.5490           0.0000           0.0070           0.0004
MXImperativeInvokeEx                17214         437.4290           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2056        4999.6211           0.7010           3.7500           2.4317
FullyConnected                       3564         338.4910           0.0080           0.3430           0.0950
argmax                               1188          23.2110           0.0050           0.0480           0.0195
_backward_pick                       1028          16.1100           0.0130           0.0260           0.0157
_backward_mul_scalar                 1028           4.4330           0.0030           0.0160           0.0043
DeleteVariable                      44000         311.8330           0.0010           0.9010           0.0071
Flatten                              1188          49.1640           0.0080           0.1120           0.0414
Activation                           4752         215.3270           0.0030           0.3430           0.0453
SetValueOp                           1028           6.5780           0.0050           0.0180           0.0064
pick                                 1028           8.0160           0.0060           0.0280           0.0078
Pooling                              2376        3269.3550           0.0640           3.1720           1.3760
Convolution                          2376       13466.7100           0.2260          13.2050           5.6678
CopyCPU2CPU                          1188           6.8120           0.0030           0.0360           0.0057
log_softmax                          1028          31.6700           0.0150           0.0500           0.0308
_backward_copy                       1028          53.0110           0.0220           0.0760           0.0516
_backward_Convolution                2056       18940.8516           2.6370          12.5610           9.2125
_mul_scalar                          1028           3.6270           0.0020           0.0230           0.0035
_backward_log_softmax                1028          17.1860           0.0090           0.0400           0.0167
mean                                 3244          61.9120           0.0080           0.0730           0.0191
_backward_mean                       1028          11.1770           0.0080           0.1030           0.0109
_backward_FullyConnected             3084         576.5130           0.0280           0.5940           0.1869
WaitForVar                           2216          19.6800           0.0060           0.0280           0.0089
broadcast_equal                      1188           5.8720           0.0030           0.0100           0.0049
sgd_update                          10280          99.5890           0.0020           0.0640           0.0097
_backward_Activation                 4112         301.5000           0.0070           0.3900           0.0733



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       40510       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3570        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             514        2039.2500           0.3060          73.5850           3.9674
MXNDArrayCreateEx                     595          20.3450           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      515       11124.5371           5.6130          24.8060          21.6010
MXNDArraySyncCopyToCPU               1110        8735.2236           0.1180          24.1980           7.8696
MXNDArrayGetDType                    1110           0.3860           0.0000           0.0010           0.0003
MXNDArrayGetShape                    2815           1.2910           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1190          10.4370           0.0070           0.0280           0.0088
MXNDArrayFree                       13285         135.7520           0.0000           0.9140           0.0102
MXNet C API Calls                   59505         546.8620         487.3580         546.8620          29.7520
MXNet C API Concurrency            119009           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1030           0.4900           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5150           2.6810           0.0000           0.0230           0.0005
MXNDArraySetGradState                5150           2.6260           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1030           0.4420           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  515         279.8350           0.5250           0.6810           0.5434
MXNDArrayGetContext                  8250           3.5560           0.0000           0.0070           0.0004
MXImperativeInvokeEx                17245         438.1970           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2060        5009.3550           0.7010           3.7500           2.4317
FullyConnected                       3570         339.0190           0.0080           0.3430           0.0950
argmax                               1190          23.2490           0.0050           0.0480           0.0195
_backward_pick                       1030          16.1400           0.0130           0.0260           0.0157
_backward_mul_scalar                 1030           4.4420           0.0030           0.0160           0.0043
DeleteVariable                      44080         312.3610           0.0010           0.9010           0.0071
Flatten                              1190          49.2430           0.0080           0.1120           0.0414
Activation                           4760         215.6790           0.0030           0.3430           0.0453
SetValueOp                           1030           6.5910           0.0050           0.0180           0.0064
pick                                 1030           8.0310           0.0060           0.0280           0.0078
Pooling                              2380        3274.7900           0.0640           3.1720           1.3760
Convolution                          2380       13488.8838           0.2260          13.2050           5.6676
CopyCPU2CPU                          1190           6.8220           0.0030           0.0360           0.0057
log_softmax                          1030          31.7300           0.0150           0.0500           0.0308
_backward_copy                       1030          53.1150           0.0220           0.0760           0.0516
_backward_Convolution                2060       18977.5938           2.6370          12.5610           9.2124
_mul_scalar                          1030           3.6340           0.0020           0.0230           0.0035
_backward_log_softmax                1030          17.2170           0.0090           0.0400           0.0167
mean                                 3250          62.0260           0.0080           0.0730           0.0191
_backward_mean                       1030          11.1970           0.0080           0.1030           0.0109
_backward_FullyConnected             3090         577.5860           0.0280           0.5940           0.1869
WaitForVar                           2220          19.7150           0.0060           0.0280           0.0089
broadcast_equal                      1190           5.8820           0.0030           0.0100           0.0049
sgd_update                          10300          99.7960           0.0020           0.0640           0.0097
_backward_Activation                 4120         302.0760           0.0070           0.3900           0.0733



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       40584       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3576        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             515        2043.1460           0.3060          73.5850           3.9673
MXNDArrayCreateEx                     596          20.3790           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      516       11146.2939           5.6130          24.8060          21.6013
MXNDArraySyncCopyToCPU               1112        8749.5498           0.1180          24.1980           7.8683
MXNDArrayGetDType                    1112           0.3870           0.0000           0.0010           0.0003
MXNDArrayGetShape                    2820           1.2930           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1192          10.4540           0.0070           0.0280           0.0088
MXNDArrayFree                       13308         135.9780           0.0000           0.9140           0.0102
MXNet C API Calls                   59612         546.9690         487.3580         546.9690          29.8055
MXNet C API Concurrency            119223           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1032           0.4910           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5160           2.6840           0.0000           0.0230           0.0005
MXNDArraySetGradState                5160           2.6330           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1032           0.4420           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  516         280.3730           0.5250           0.6810           0.5434
MXNDArrayGetContext                  8264           3.5590           0.0000           0.0070           0.0004
MXImperativeInvokeEx                17276         438.9720           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2064        5019.1099           0.7010           3.7500           2.4317
FullyConnected                       3576         339.5500           0.0080           0.3430           0.0950
argmax                               1192          23.2880           0.0050           0.0480           0.0195
_backward_pick                       1032          16.1720           0.0130           0.0260           0.0157
_backward_mul_scalar                 1032           4.4510           0.0030           0.0160           0.0043
DeleteVariable                      44160         312.8750           0.0010           0.9010           0.0071
Flatten                              1192          49.3220           0.0080           0.1120           0.0414
Activation                           4768         216.0320           0.0030           0.3430           0.0453
SetValueOp                           1032           6.6030           0.0050           0.0180           0.0064
pick                                 1032           8.0460           0.0060           0.0280           0.0078
Pooling                              2384        3280.1389           0.0640           3.1720           1.3759
Convolution                          2384       13510.9502           0.2260          13.2050           5.6673
CopyCPU2CPU                          1192           6.8310           0.0030           0.0360           0.0057
log_softmax                          1032          31.7900           0.0150           0.0500           0.0308
_backward_copy                       1032          53.2180           0.0220           0.0760           0.0516
_backward_Convolution                2064       19014.4629           2.6370          12.5610           9.2124
_mul_scalar                          1032           3.6410           0.0020           0.0230           0.0035
_backward_log_softmax                1032          17.2480           0.0090           0.0400           0.0167
mean                                 3256          62.1430           0.0080           0.0730           0.0191
_backward_mean                       1032          11.2180           0.0080           0.1030           0.0109
_backward_FullyConnected             3096         578.6530           0.0280           0.5940           0.1869
WaitForVar                           2224          19.7490           0.0060           0.0280           0.0089
broadcast_equal                      1192           5.8910           0.0030           0.0100           0.0049
sgd_update                          10320          99.9980           0.0020           0.0640           0.0097
_backward_Activation                 4128         302.6190           0.0070           0.3900           0.0733



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       40658       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3582        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             516        2047.0439           0.3060          73.5850           3.9671
MXNDArrayCreateEx                     597          20.4120           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      517       11168.1562           5.6130          24.8060          21.6018
MXNDArraySyncCopyToCPU               1114        8763.9131           0.1180          24.1980           7.8671
MXNDArrayGetDType                    1114           0.3880           0.0000           0.0010           0.0003
MXNDArrayGetShape                    2825           1.2960           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1194          10.4720           0.0070           0.0280           0.0088
MXNDArrayFree                       13331         136.2010           0.0000           0.9140           0.0102
MXNet C API Calls                   59719         547.0760         487.3580         547.0760          29.8590
MXNet C API Concurrency            119437           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1034           0.4920           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5170           2.6910           0.0000           0.0230           0.0005
MXNDArraySetGradState                5170           2.6420           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1034           0.4430           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  517         280.9060           0.5250           0.6810           0.5433
MXNDArrayGetContext                  8278           3.5630           0.0000           0.0070           0.0004
MXImperativeInvokeEx                17307         439.7480           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2068        5028.8389           0.7010           3.7500           2.4317
FullyConnected                       3582         340.0730           0.0080           0.3430           0.0949
argmax                               1194          23.3250           0.0050           0.0480           0.0195
_backward_pick                       1034          16.2040           0.0130           0.0260           0.0157
_backward_mul_scalar                 1034           4.4590           0.0030           0.0160           0.0043
DeleteVariable                      44240         313.4040           0.0010           0.9010           0.0071
Flatten                              1194          49.4020           0.0080           0.1120           0.0414
Activation                           4776         216.3850           0.0030           0.3430           0.0453
SetValueOp                           1034           6.6140           0.0050           0.0180           0.0064
pick                                 1034           8.0610           0.0060           0.0280           0.0078
Pooling                              2388        3285.4641           0.0640           3.1720           1.3758
Convolution                          2388       13533.1201           0.2260          13.2050           5.6671
CopyCPU2CPU                          1194           6.8400           0.0030           0.0360           0.0057
log_softmax                          1034          31.8490           0.0150           0.0500           0.0308
_backward_copy                       1034          53.3210           0.0220           0.0760           0.0516
_backward_Convolution                2068       19051.5137           2.6370          12.5610           9.2125
_mul_scalar                          1034           3.6480           0.0020           0.0230           0.0035
_backward_log_softmax                1034          17.2810           0.0090           0.0400           0.0167
mean                                 3262          62.2600           0.0080           0.0730           0.0191
_backward_mean                       1034          11.2390           0.0080           0.1030           0.0109
_backward_FullyConnected             3102         579.7200           0.0280           0.5940           0.1869
WaitForVar                           2228          19.7830           0.0060           0.0280           0.0089
broadcast_equal                      1194           5.9000           0.0030           0.0100           0.0049
sgd_update                          10340         100.1480           0.0020           0.0640           0.0097
_backward_Activation                 4136         303.2450           0.0070           0.3900           0.0733



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       40732       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3588        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             517        2050.9541           0.3060          73.5850           3.9670
MXNDArrayCreateEx                     598          20.4470           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      518       11190.0225           5.6130          24.8060          21.6024
MXNDArraySyncCopyToCPU               1116        8778.6191           0.1180          24.1980           7.8661
MXNDArrayGetDType                    1116           0.3880           0.0000           0.0010           0.0003
MXNDArrayGetShape                    2830           1.2970           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1196          10.4900           0.0070           0.0280           0.0088
MXNDArrayFree                       13354         136.4420           0.0000           0.9140           0.0102
MXNet C API Calls                   59826         547.1830         487.3580         547.1830          29.9125
MXNet C API Concurrency            119651           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1036           0.4930           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5180           2.6970           0.0000           0.0230           0.0005
MXNDArraySetGradState                5180           2.6450           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1036           0.4430           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  518         281.4390           0.5250           0.6810           0.5433
MXNDArrayGetContext                  8292           3.5680           0.0000           0.0070           0.0004
MXImperativeInvokeEx                17338         440.5340           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2072        5038.5391           0.7010           3.7500           2.4317
FullyConnected                       3588         340.8460           0.0080           0.3430           0.0950
argmax                               1196          23.3680           0.0050           0.0480           0.0195
_backward_pick                       1036          16.2350           0.0130           0.0260           0.0157
_backward_mul_scalar                 1036           4.4680           0.0030           0.0160           0.0043
DeleteVariable                      44320         313.9590           0.0010           0.9010           0.0071
Flatten                              1196          49.4790           0.0080           0.1120           0.0414
Activation                           4784         216.7680           0.0030           0.3430           0.0453
SetValueOp                           1036           6.6250           0.0050           0.0180           0.0064
pick                                 1036           8.0760           0.0060           0.0280           0.0078
Pooling                              2392        3290.8479           0.0640           3.1720           1.3758
Convolution                          2392       13555.4395           0.2260          13.2050           5.6670
CopyCPU2CPU                          1196           6.8500           0.0030           0.0360           0.0057
log_softmax                          1036          31.9210           0.0150           0.0500           0.0308
_backward_copy                       1036          53.4220           0.0220           0.0760           0.0516
_backward_Convolution                2072       19088.6270           2.6370          12.5610           9.2127
_mul_scalar                          1036           3.6550           0.0020           0.0230           0.0035
_backward_log_softmax                1036          17.3230           0.0090           0.0400           0.0167
mean                                 3268          62.3660           0.0080           0.0730           0.0191
_backward_mean                       1036          11.2600           0.0080           0.1030           0.0109
_backward_FullyConnected             3108         581.1420           0.0280           0.5940           0.1870
WaitForVar                           2232          19.8180           0.0060           0.0280           0.0089
broadcast_equal                      1196           5.9090           0.0030           0.0100           0.0049
sgd_update                          10360         100.3770           0.0020           0.0640           0.0097
_backward_Activation                 4144         303.8930           0.0070           0.3900           0.0733



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       40806       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3594        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             518        2054.8501           0.3060          73.5850           3.9669
MXNDArrayCreateEx                     599          20.4800           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      519       11211.8105           5.6130          24.8060          21.6027
MXNDArraySyncCopyToCPU               1118        8793.0068           0.1180          24.1980           7.8649
MXNDArrayGetDType                    1118           0.3890           0.0000           0.0010           0.0003
MXNDArrayGetShape                    2835           1.2980           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1198          10.5070           0.0070           0.0280           0.0088
MXNDArrayFree                       13377         136.6700           0.0000           0.9140           0.0102
MXNet C API Calls                   59933         547.2900         487.3580         547.2900          29.9660
MXNet C API Concurrency            119865           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1038           0.4940           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5190           2.7020           0.0000           0.0230           0.0005
MXNDArraySetGradState                5190           2.6500           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1038           0.4450           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  519         281.9710           0.5250           0.6810           0.5433
MXNDArrayGetContext                  8306           3.5770           0.0000           0.0070           0.0004
MXImperativeInvokeEx                17369         441.3070           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2076        5048.3638           0.7010           3.7500           2.4318
FullyConnected                       3594         341.4130           0.0080           0.3430           0.0950
argmax                               1198          23.4050           0.0050           0.0480           0.0195
_backward_pick                       1038          16.2660           0.0130           0.0260           0.0157
_backward_mul_scalar                 1038           4.4760           0.0030           0.0160           0.0043
DeleteVariable                      44400         314.4740           0.0010           0.9010           0.0071
Flatten                              1198          49.5580           0.0080           0.1120           0.0414
Activation                           4792         217.1210           0.0030           0.3430           0.0453
SetValueOp                           1038           6.6380           0.0050           0.0180           0.0064
pick                                 1038           8.0910           0.0060           0.0280           0.0078
Pooling                              2396        3296.1899           0.0640           3.1720           1.3757
Convolution                          2396       13577.6533           0.2260          13.2050           5.6668
CopyCPU2CPU                          1198           6.8610           0.0030           0.0360           0.0057
log_softmax                          1038          31.9800           0.0150           0.0500           0.0308
_backward_copy                       1038          53.5260           0.0220           0.0760           0.0516
_backward_Convolution                2076       19125.4648           2.6370          12.5610           9.2127
_mul_scalar                          1038           3.6620           0.0020           0.0230           0.0035
_backward_log_softmax                1038          17.3560           0.0090           0.0400           0.0167
mean                                 3274          62.4820           0.0080           0.0730           0.0191
_backward_mean                       1038          11.2810           0.0080           0.1030           0.0109
_backward_FullyConnected             3114         582.2110           0.0280           0.5940           0.1870
WaitForVar                           2236          19.8560           0.0060           0.0280           0.0089
broadcast_equal                      1198           5.9190           0.0030           0.0100           0.0049
sgd_update                          10380         100.5810           0.0020           0.0640           0.0097
_backward_Activation                 4152         304.4430           0.0070           0.3900           0.0733



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       40880       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3600        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             519        2058.7881           0.3060          73.5850           3.9668
MXNDArrayCreateEx                     600          20.5170           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      520       11233.5146           5.6130          24.8060          21.6029
MXNDArraySyncCopyToCPU               1120        8807.4004           0.1180          24.1980           7.8637
MXNDArrayGetDType                    1120           0.3900           0.0000           0.0010           0.0003
MXNDArrayGetShape                    2840           1.3010           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1200          10.5250           0.0070           0.0280           0.0088
MXNDArrayFree                       13400         136.9060           0.0000           0.9140           0.0102
MXNet C API Calls                   60040         547.3970         487.3580         547.3970          30.0195
MXNet C API Concurrency            120079           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1040           0.4940           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5200           2.7070           0.0000           0.0230           0.0005
MXNDArraySetGradState                5200           2.6560           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1040           0.4450           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  520         282.5190           0.5250           0.6810           0.5433
MXNDArrayGetContext                  8320           3.5810           0.0000           0.0070           0.0004
MXImperativeInvokeEx                17400         442.1300           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2080        5058.1201           0.7010           3.7500           2.4318
FullyConnected                       3600         341.9600           0.0080           0.3430           0.0950
argmax                               1200          23.4440           0.0050           0.0480           0.0195
_backward_pick                       1040          16.2990           0.0130           0.0260           0.0157
_backward_mul_scalar                 1040           4.4840           0.0030           0.0160           0.0043
DeleteVariable                      44480         315.0500           0.0010           0.9010           0.0071
Flatten                              1200          49.6610           0.0080           0.1120           0.0414
Activation                           4800         217.4930           0.0030           0.3430           0.0453
SetValueOp                           1040           6.6500           0.0050           0.0180           0.0064
pick                                 1040           8.1060           0.0060           0.0280           0.0078
Pooling                              2400        3301.5620           0.0640           3.1720           1.3757
Convolution                          2400       13599.8574           0.2260          13.2050           5.6666
CopyCPU2CPU                          1200           6.8710           0.0030           0.0360           0.0057
log_softmax                          1040          32.0420           0.0150           0.0500           0.0308
_backward_copy                       1040          53.6290           0.0220           0.0760           0.0516
_backward_Convolution                2080       19162.1816           2.6370          12.5610           9.2126
_mul_scalar                          1040           3.6690           0.0020           0.0230           0.0035
_backward_log_softmax                1040          17.3890           0.0090           0.0400           0.0167
mean                                 3280          62.6000           0.0080           0.0730           0.0191
_backward_mean                       1040          11.3040           0.0080           0.1030           0.0109
_backward_FullyConnected             3120         583.3000           0.0280           0.5940           0.1870
WaitForVar                           2240          19.8910           0.0060           0.0280           0.0089
broadcast_equal                      1200           5.9290           0.0030           0.0100           0.0049
sgd_update                          10400         100.7870           0.0020           0.0640           0.0097
_backward_Activation                 4160         305.0350           0.0070           0.3900           0.0733



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       40954       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3606        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             520        2062.7930           0.3060          73.5850           3.9669
MXNDArrayCreateEx                     601          20.5540           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      521       11255.4268           5.6130          24.8060          21.6035
MXNDArraySyncCopyToCPU               1122        8821.7666           0.1180          24.1980           7.8625
MXNDArrayGetDType                    1122           0.3900           0.0000           0.0010           0.0003
MXNDArrayGetShape                    2845           1.3030           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1202          10.5440           0.0070           0.0280           0.0088
MXNDArrayFree                       13423         137.1620           0.0000           0.9140           0.0102
MXNet C API Calls                   60147         547.5040         487.3580         547.5040          30.0730
MXNet C API Concurrency            120293           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1042           0.4950           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5210           2.7140           0.0000           0.0230           0.0005
MXNDArraySetGradState                5210           2.6600           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1042           0.4450           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  521         283.0820           0.5250           0.6810           0.5433
MXNDArrayGetContext                  8334           3.5870           0.0000           0.0070           0.0004
MXImperativeInvokeEx                17431         442.9460           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2084        5067.9341           0.7010           3.7500           2.4318
FullyConnected                       3606         342.5020           0.0080           0.3430           0.0950
argmax                               1202          23.4820           0.0050           0.0480           0.0195
_backward_pick                       1042          16.3320           0.0130           0.0260           0.0157
_backward_mul_scalar                 1042           4.4930           0.0030           0.0160           0.0043
DeleteVariable                      44560         315.6310           0.0010           0.9010           0.0071
Flatten                              1202          49.7730           0.0080           0.1120           0.0414
Activation                           4808         217.8610           0.0030           0.3430           0.0453
SetValueOp                           1042           6.6630           0.0050           0.0180           0.0064
pick                                 1042           8.1220           0.0060           0.0280           0.0078
Pooling                              2404        3306.8811           0.0640           3.1720           1.3756
Convolution                          2404       13622.1494           0.2260          13.2050           5.6665
CopyCPU2CPU                          1202           6.8820           0.0030           0.0360           0.0057
log_softmax                          1042          32.1520           0.0150           0.0550           0.0309
_backward_copy                       1042          53.7320           0.0220           0.0760           0.0516
_backward_Convolution                2084       19199.2598           2.6370          12.5610           9.2127
_mul_scalar                          1042           3.6760           0.0020           0.0230           0.0035
_backward_log_softmax                1042          17.4220           0.0090           0.0400           0.0167
mean                                 3286          62.7190           0.0080           0.0730           0.0191
_backward_mean                       1042          11.3270           0.0080           0.1030           0.0109
_backward_FullyConnected             3126         584.3920           0.0280           0.5940           0.1869
WaitForVar                           2244          19.9250           0.0060           0.0280           0.0089
broadcast_equal                      1202           5.9410           0.0030           0.0100           0.0049
sgd_update                          10420         100.9890           0.0020           0.0640           0.0097
_backward_Activation                 4168         305.5980           0.0070           0.3900           0.0733



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       41028       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3612        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             521        2066.7920           0.3060          73.5850           3.9670
MXNDArrayCreateEx                     602          20.5910           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      522       11277.2764           5.6130          24.8060          21.6040
MXNDArraySyncCopyToCPU               1124        8836.6328           0.1180          24.1980           7.8618
MXNDArrayGetDType                    1124           0.3910           0.0000           0.0010           0.0003
MXNDArrayGetShape                    2850           1.3050           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1204          10.5630           0.0070           0.0280           0.0088
MXNDArrayFree                       13446         137.4320           0.0000           0.9140           0.0102
MXNet C API Calls                   60254         547.6110         487.3580         547.6110          30.1265
MXNet C API Concurrency            120507           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1044           0.4960           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5220           2.7200           0.0000           0.0230           0.0005
MXNDArraySetGradState                5220           2.6650           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1044           0.4450           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  522         283.6490           0.5250           0.6810           0.5434
MXNDArrayGetContext                  8348           3.5930           0.0000           0.0070           0.0004
MXImperativeInvokeEx                17462         443.7620           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2088        5077.6631           0.7010           3.7500           2.4318
FullyConnected                       3612         343.3060           0.0080           0.3430           0.0950
argmax                               1204          23.5280           0.0050           0.0480           0.0195
_backward_pick                       1044          16.3670           0.0130           0.0260           0.0157
_backward_mul_scalar                 1044           4.5020           0.0030           0.0160           0.0043
DeleteVariable                      44640         316.2510           0.0010           0.9010           0.0071
Flatten                              1204          49.8850           0.0080           0.1120           0.0414
Activation                           4816         218.2640           0.0030           0.3430           0.0453
SetValueOp                           1044           6.6750           0.0050           0.0180           0.0064
pick                                 1044           8.1380           0.0060           0.0280           0.0078
Pooling                              2408        3312.2739           0.0640           3.1720           1.3755
Convolution                          2408       13644.6328           0.2260          13.2050           5.6664
CopyCPU2CPU                          1204           6.8920           0.0030           0.0360           0.0057
log_softmax                          1044          32.2270           0.0150           0.0550           0.0309
_backward_copy                       1044          53.8320           0.0220           0.0760           0.0516
_backward_Convolution                2088       19236.3105           2.6370          12.5610           9.2128
_mul_scalar                          1044           3.6830           0.0020           0.0230           0.0035
_backward_log_softmax                1044          17.4660           0.0090           0.0400           0.0167
mean                                 3292          62.8270           0.0080           0.0730           0.0191
_backward_mean                       1044          11.3500           0.0080           0.1030           0.0109
_backward_FullyConnected             3132         585.8360           0.0280           0.5940           0.1870
WaitForVar                           2248          19.9590           0.0060           0.0280           0.0089
broadcast_equal                      1204           5.9630           0.0030           0.0110           0.0050
sgd_update                          10440         101.2600           0.0020           0.0640           0.0097
_backward_Activation                 4176         306.1670           0.0070           0.3900           0.0733



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       41102       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3618        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             522        2070.7151           0.3060          73.5850           3.9669
MXNDArrayCreateEx                     603          20.6240           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      523       11299.0039           5.6130          24.8060          21.6042
MXNDArraySyncCopyToCPU               1126        8850.8135           0.1180          24.1980           7.8604
MXNDArrayGetDType                    1126           0.3930           0.0000           0.0010           0.0003
MXNDArrayGetShape                    2855           1.3080           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1206          10.5810           0.0070           0.0280           0.0088
MXNDArrayFree                       13469         137.6650           0.0000           0.9140           0.0102
MXNet C API Calls                   60361         547.7180         487.3580         547.7180          30.1800
MXNet C API Concurrency            120721           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1046           0.4970           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5230           2.7260           0.0000           0.0230           0.0005
MXNDArraySetGradState                5230           2.6720           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1046           0.4450           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  523         284.2140           0.5250           0.6810           0.5434
MXNDArrayGetContext                  8362           3.6000           0.0000           0.0070           0.0004
MXImperativeInvokeEx                17493         444.5720           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2092        5087.3569           0.7010           3.7500           2.4318
FullyConnected                       3618         343.8570           0.0080           0.3430           0.0950
argmax                               1206          23.5670           0.0050           0.0480           0.0195
_backward_pick                       1046          16.3980           0.0130           0.0260           0.0157
_backward_mul_scalar                 1046           4.5090           0.0030           0.0160           0.0043
DeleteVariable                      44720         316.7920           0.0010           0.9010           0.0071
Flatten                              1206          49.9990           0.0080           0.1120           0.0415
Activation                           4824         218.6210           0.0030           0.3430           0.0453
SetValueOp                           1046           6.6880           0.0050           0.0180           0.0064
pick                                 1046           8.1530           0.0060           0.0280           0.0078
Pooling                              2412        3317.5891           0.0640           3.1720           1.3755
Convolution                          2412       13666.8594           0.2260          13.2050           5.6662
CopyCPU2CPU                          1206           6.9020           0.0030           0.0360           0.0057
log_softmax                          1046          32.2880           0.0150           0.0550           0.0309
_backward_copy                       1046          53.9350           0.0220           0.0760           0.0516
_backward_Convolution                2092       19273.0996           2.6370          12.5610           9.2128
_mul_scalar                          1046           3.6900           0.0020           0.0230           0.0035
_backward_log_softmax                1046          17.4970           0.0090           0.0400           0.0167
mean                                 3298          62.9400           0.0080           0.0730           0.0191
_backward_mean                       1046          11.3720           0.0080           0.1030           0.0109
_backward_FullyConnected             3138         586.9000           0.0280           0.5940           0.1870
WaitForVar                           2252          19.9940           0.0060           0.0280           0.0089
broadcast_equal                      1206           5.9720           0.0030           0.0110           0.0050
sgd_update                          10460         101.4620           0.0020           0.0640           0.0097
_backward_Activation                 4184         306.7190           0.0070           0.3900           0.0733



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       41176       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3624        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             523        2074.6050           0.3060          73.5850           3.9667
MXNDArrayCreateEx                     604          20.6590           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      524       11320.7051           5.6130          24.8060          21.6044
MXNDArraySyncCopyToCPU               1128        8865.1377           0.1180          24.1980           7.8592
MXNDArrayGetDType                    1128           0.3930           0.0000           0.0010           0.0003
MXNDArrayGetShape                    2860           1.3100           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1208          10.5970           0.0070           0.0280           0.0088
MXNDArrayFree                       13492         137.8940           0.0000           0.9140           0.0102
MXNet C API Calls                   60468         547.8250         487.3580         547.8250          30.2335
MXNet C API Concurrency            120935           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1048           0.4980           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5240           2.7310           0.0000           0.0230           0.0005
MXNDArraySetGradState                5240           2.6760           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1048           0.4460           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  524         284.7550           0.5250           0.6810           0.5434
MXNDArrayGetContext                  8376           3.6030           0.0000           0.0070           0.0004
MXImperativeInvokeEx                17524         445.3750           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2096        5097.0718           0.7010           3.7500           2.4318
FullyConnected                       3624         344.3800           0.0080           0.3430           0.0950
argmax                               1208          23.6050           0.0050           0.0480           0.0195
_backward_pick                       1048          16.4290           0.0130           0.0260           0.0157
_backward_mul_scalar                 1048           4.5180           0.0030           0.0160           0.0043
DeleteVariable                      44800         317.3040           0.0010           0.9010           0.0071
Flatten                              1208          50.0800           0.0080           0.1120           0.0415
Activation                           4832         218.9720           0.0030           0.3430           0.0453
SetValueOp                           1048           6.7000           0.0050           0.0180           0.0064
pick                                 1048           8.1680           0.0060           0.0280           0.0078
Pooling                              2416        3322.9851           0.0640           3.1720           1.3754
Convolution                          2416       13688.9688           0.2260          13.2050           5.6660
CopyCPU2CPU                          1208           6.9110           0.0030           0.0360           0.0057
log_softmax                          1048          32.3470           0.0150           0.0550           0.0309
_backward_copy                       1048          54.0380           0.0220           0.0760           0.0516
_backward_Convolution                2096       19309.8496           2.6370          12.5610           9.2127
_mul_scalar                          1048           3.6970           0.0020           0.0230           0.0035
_backward_log_softmax                1048          17.5290           0.0090           0.0400           0.0167
mean                                 3304          63.0530           0.0080           0.0730           0.0191
_backward_mean                       1048          11.3930           0.0080           0.1030           0.0109
_backward_FullyConnected             3144         587.9690           0.0280           0.5940           0.1870
WaitForVar                           2256          20.0270           0.0060           0.0280           0.0089
broadcast_equal                      1208           5.9820           0.0030           0.0110           0.0050
sgd_update                          10480         101.6130           0.0020           0.0640           0.0097
_backward_Activation                 4192         307.3520           0.0070           0.3900           0.0733



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       41250       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3630        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             524        2078.5090           0.3060          73.5850           3.9666
MXNDArrayCreateEx                     605          20.6920           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      525       11332.4287           5.6130          24.8060          21.5856
MXNDArraySyncCopyToCPU               1130        8889.0127           0.1180          24.1980           7.8664
MXNDArrayGetDType                    1130           0.3950           0.0000           0.0010           0.0003
MXNDArrayGetShape                    2865           1.3120           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1210          10.6160           0.0070           0.0280           0.0088
MXNDArrayFree                       13515         138.1260           0.0000           0.9140           0.0102
MXNet C API Calls                   60575         547.9320         487.3580         547.9320          30.2870
MXNet C API Concurrency            121149           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1050           0.4980           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5250           2.7340           0.0000           0.0230           0.0005
MXNDArraySetGradState                5250           2.6810           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1050           0.4470           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  525         285.2880           0.5250           0.6810           0.5434
MXNDArrayGetContext                  8390           3.6100           0.0000           0.0070           0.0004
MXImperativeInvokeEx                17555         446.1520           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2100        5106.8018           0.7010           3.7500           2.4318
FullyConnected                       3630         344.9030           0.0080           0.3430           0.0950
argmax                               1210          23.6440           0.0050           0.0480           0.0195
_backward_pick                       1050          16.4600           0.0130           0.0260           0.0157
_backward_mul_scalar                 1050           4.5260           0.0030           0.0160           0.0043
DeleteVariable                      44880         317.8420           0.0010           0.9010           0.0071
Flatten                              1210          50.1590           0.0080           0.1120           0.0415
Activation                           4840         219.3240           0.0030           0.3430           0.0453
SetValueOp                           1050           6.7130           0.0050           0.0180           0.0064
pick                                 1050           8.1820           0.0060           0.0280           0.0078
Pooling                              2420        3328.3320           0.0640           3.1720           1.3753
Convolution                          2420       13711.1406           0.2260          13.2050           5.6658
CopyCPU2CPU                          1210           6.9720           0.0030           0.0360           0.0058
log_softmax                          1050          32.4080           0.0150           0.0550           0.0309
_backward_copy                       1050          54.1420           0.0220           0.0760           0.0516
_backward_Convolution                2100       19346.8320           2.6370          12.5610           9.2128
_mul_scalar                          1050           3.7040           0.0020           0.0230           0.0035
_backward_log_softmax                1050          17.5600           0.0090           0.0400           0.0167
mean                                 3310          63.1280           0.0080           0.0730           0.0191
_backward_mean                       1050          11.4140           0.0080           0.1030           0.0109
_backward_FullyConnected             3150         589.0370           0.0280           0.5940           0.1870
WaitForVar                           2260          20.0580           0.0060           0.0280           0.0089
broadcast_equal                      1210           5.9910           0.0030           0.0110           0.0050
sgd_update                          10500         101.8110           0.0020           0.0640           0.0097
_backward_Activation                 4200         307.9320           0.0070           0.3900           0.0733



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       41324       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3636        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             525        2082.4319           0.3060          73.5850           3.9665
MXNDArrayCreateEx                     606          20.7270           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      526       11354.2930           5.6130          24.8060          21.5861
MXNDArraySyncCopyToCPU               1132        8903.8838           0.1180          24.1980           7.8656
MXNDArrayGetDType                    1132           0.3960           0.0000           0.0010           0.0003
MXNDArrayGetShape                    2870           1.3140           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1212          10.6320           0.0070           0.0280           0.0088
MXNDArrayFree                       13538         138.3640           0.0000           0.9140           0.0102
MXNet C API Calls                   60682         548.0390         487.3580         548.0390          30.3405
MXNet C API Concurrency            121363           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1052           0.4990           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5260           2.7400           0.0000           0.0230           0.0005
MXNDArraySetGradState                5260           2.6860           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1052           0.4470           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  526         285.8580           0.5250           0.6810           0.5435
MXNDArrayGetContext                  8404           3.6170           0.0000           0.0070           0.0004
MXImperativeInvokeEx                17586         446.9450           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2104        5116.6118           0.7010           3.7500           2.4318
FullyConnected                       3636         345.7190           0.0080           0.3430           0.0951
argmax                               1212          23.6880           0.0050           0.0480           0.0195
_backward_pick                       1052          16.4930           0.0130           0.0260           0.0157
_backward_mul_scalar                 1052           4.5350           0.0030           0.0160           0.0043
DeleteVariable                      44960         318.4010           0.0010           0.9010           0.0071
Flatten                              1212          50.2510           0.0080           0.1120           0.0415
Activation                           4848         219.7160           0.0030           0.3430           0.0453
SetValueOp                           1052           6.7260           0.0050           0.0180           0.0064
pick                                 1052           8.1980           0.0060           0.0280           0.0078
Pooling                              2424        3333.7490           0.0640           3.1720           1.3753
Convolution                          2424       13733.5361           0.2260          13.2050           5.6657
CopyCPU2CPU                          1212           6.9830           0.0030           0.0360           0.0058
log_softmax                          1052          32.4810           0.0150           0.0550           0.0309
_backward_copy                       1052          54.2430           0.0220           0.0760           0.0516
_backward_Convolution                2104       19383.8203           2.6370          12.5610           9.2128
_mul_scalar                          1052           3.7110           0.0020           0.0230           0.0035
_backward_log_softmax                1052          17.6030           0.0090           0.0400           0.0167
mean                                 3316          63.2350           0.0080           0.0730           0.0191
_backward_mean                       1052          11.4350           0.0080           0.1030           0.0109
_backward_FullyConnected             3156         590.4760           0.0280           0.5940           0.1871
WaitForVar                           2264          20.0930           0.0060           0.0280           0.0089
broadcast_equal                      1212           6.0010           0.0030           0.0110           0.0050
sgd_update                          10520         102.0830           0.0020           0.0640           0.0097
_backward_Activation                 4208         308.5380           0.0070           0.3900           0.0733



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       41398       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3642        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             526        2086.3850           0.3060          73.5850           3.9665
MXNDArrayCreateEx                     607          20.7610           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      527       11375.9863           5.6130          24.8060          21.5863
MXNDArraySyncCopyToCPU               1134        8918.2988           0.1180          24.1980           7.8645
MXNDArrayGetDType                    1134           0.3980           0.0000           0.0010           0.0004
MXNDArrayGetShape                    2875           1.3160           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1214          10.6500           0.0070           0.0280           0.0088
MXNDArrayFree                       13561         138.6060           0.0000           0.9140           0.0102
MXNet C API Calls                   60789         548.1460         487.3580         548.1460          30.3940
MXNet C API Concurrency            121577           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1054           0.5000           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5270           2.7430           0.0000           0.0230           0.0005
MXNDArraySetGradState                5270           2.6880           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1054           0.4480           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  527         286.4020           0.5250           0.6810           0.5435
MXNDArrayGetContext                  8418           3.6250           0.0000           0.0070           0.0004
MXImperativeInvokeEx                17617         447.7250           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2108        5126.3081           0.7010           3.7500           2.4318
FullyConnected                       3642         346.2770           0.0080           0.3430           0.0951
argmax                               1214          23.7740           0.0050           0.0480           0.0196
_backward_pick                       1054          16.5260           0.0130           0.0260           0.0157
_backward_mul_scalar                 1054           4.5430           0.0030           0.0160           0.0043
DeleteVariable                      45040         318.9560           0.0010           0.9010           0.0071
Flatten                              1214          50.3390           0.0080           0.1120           0.0415
Activation                           4856         220.0740           0.0030           0.3430           0.0453
SetValueOp                           1054           6.7390           0.0050           0.0180           0.0064
pick                                 1054           8.2140           0.0060           0.0280           0.0078
Pooling                              2428        3339.0879           0.0640           3.1720           1.3752
Convolution                          2428       13755.7637           0.2260          13.2050           5.6655
CopyCPU2CPU                          1214           6.9930           0.0030           0.0360           0.0058
log_softmax                          1054          32.5410           0.0150           0.0550           0.0309
_backward_copy                       1054          54.3450           0.0220           0.0760           0.0516
_backward_Convolution                2108       19420.5547           2.6370          12.5610           9.2128
_mul_scalar                          1054           3.7180           0.0020           0.0230           0.0035
_backward_log_softmax                1054          17.6360           0.0090           0.0400           0.0167
mean                                 3322          63.3500           0.0080           0.0730           0.0191
_backward_mean                       1054          11.4560           0.0080           0.1030           0.0109
_backward_FullyConnected             3162         591.5530           0.0280           0.5940           0.1871
WaitForVar                           2268          20.1280           0.0060           0.0280           0.0089
broadcast_equal                      1214           6.0120           0.0030           0.0110           0.0050
sgd_update                          10540         102.2350           0.0020           0.0640           0.0097
_backward_Activation                 4216         309.1680           0.0070           0.3900           0.0733



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       41472       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3648        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             527        2090.3120           0.3060          73.5850           3.9664
MXNDArrayCreateEx                     608          20.7940           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      528       11397.6670           5.6130          24.8060          21.5865
MXNDArraySyncCopyToCPU               1136        8932.5859           0.1180          24.1980           7.8632
MXNDArrayGetDType                    1136           0.3990           0.0000           0.0010           0.0004
MXNDArrayGetShape                    2880           1.3180           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1216          10.6670           0.0070           0.0280           0.0088
MXNDArrayFree                       13584         138.8420           0.0000           0.9140           0.0102
MXNet C API Calls                   60896         548.2530         487.3580         548.2530          30.4475
MXNet C API Concurrency            121791           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1056           0.5010           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5280           2.7490           0.0000           0.0230           0.0005
MXNDArraySetGradState                5280           2.6920           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1056           0.4490           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  528         286.9810           0.5250           0.6810           0.5435
MXNDArrayGetContext                  8432           3.6330           0.0000           0.0070           0.0004
MXImperativeInvokeEx                17648         448.5170           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2112        5135.8911           0.7010           3.7500           2.4318
FullyConnected                       3648         346.8070           0.0080           0.3430           0.0951
argmax                               1216          23.8140           0.0050           0.0480           0.0196
_backward_pick                       1056          16.5580           0.0130           0.0260           0.0157
_backward_mul_scalar                 1056           4.5510           0.0030           0.0160           0.0043
DeleteVariable                      45120         319.5120           0.0010           0.9010           0.0071
Flatten                              1216          50.4250           0.0080           0.1120           0.0415
Activation                           4864         220.4320           0.0030           0.3430           0.0453
SetValueOp                           1056           6.7520           0.0050           0.0180           0.0064
pick                                 1056           8.2300           0.0060           0.0280           0.0078
Pooling                              2432        3344.4900           0.0640           3.1720           1.3752
Convolution                          2432       13777.9043           0.2260          13.2050           5.6653
CopyCPU2CPU                          1216           7.0030           0.0030           0.0360           0.0058
log_softmax                          1056          32.6010           0.0150           0.0550           0.0309
_backward_copy                       1056          54.4500           0.0220           0.0760           0.0516
_backward_Convolution                2112       19457.3105           2.6370          12.5610           9.2127
_mul_scalar                          1056           3.7250           0.0020           0.0230           0.0035
_backward_log_softmax                1056          17.6690           0.0090           0.0400           0.0167
mean                                 3328          63.4580           0.0080           0.0730           0.0191
_backward_mean                       1056          11.4780           0.0080           0.1030           0.0109
_backward_FullyConnected             3168         592.6280           0.0280           0.5940           0.1871
WaitForVar                           2272          20.1620           0.0060           0.0280           0.0089
broadcast_equal                      1216           6.0230           0.0030           0.0110           0.0050
sgd_update                          10560         102.3850           0.0020           0.0640           0.0097
_backward_Activation                 4224         309.7860           0.0070           0.3900           0.0733



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       41546       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3654        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             528        2094.2200           0.3060          73.5850           3.9663
MXNDArrayCreateEx                     609          20.8270           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      529       11419.4873           5.6130          24.8060          21.5869
MXNDArraySyncCopyToCPU               1138        8946.9902           0.1180          24.1980           7.8620
MXNDArrayGetDType                    1138           0.4000           0.0000           0.0010           0.0004
MXNDArrayGetShape                    2885           1.3200           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1218          10.6840           0.0070           0.0280           0.0088
MXNDArrayFree                       13607         139.0710           0.0000           0.9140           0.0102
MXNet C API Calls                   61003         548.3600         487.3580         548.3600          30.5010
MXNet C API Concurrency            122005           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1058           0.5020           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5290           2.7550           0.0000           0.0230           0.0005
MXNDArraySetGradState                5290           2.6930           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1058           0.4500           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  529         287.5150           0.5250           0.6810           0.5435
MXNDArrayGetContext                  8446           3.6410           0.0000           0.0070           0.0004
MXImperativeInvokeEx                17679         449.3000           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2116        5145.6421           0.7010           3.7500           2.4318
FullyConnected                       3654         347.3490           0.0080           0.3430           0.0951
argmax                               1218          23.8520           0.0050           0.0480           0.0196
_backward_pick                       1058          16.5900           0.0130           0.0260           0.0157
_backward_mul_scalar                 1058           4.5600           0.0030           0.0160           0.0043
DeleteVariable                      45200         320.0580           0.0010           0.9010           0.0071
Flatten                              1218          50.5030           0.0080           0.1120           0.0415
Activation                           4872         220.7860           0.0030           0.3430           0.0453
SetValueOp                           1058           6.7650           0.0050           0.0180           0.0064
pick                                 1058           8.2450           0.0060           0.0280           0.0078
Pooling                              2436        3349.8811           0.0640           3.1720           1.3752
Convolution                          2436       13800.0762           0.2260          13.2050           5.6651
CopyCPU2CPU                          1218           7.0120           0.0030           0.0360           0.0058
log_softmax                          1058          32.6610           0.0150           0.0550           0.0309
_backward_copy                       1058          54.5520           0.0220           0.0760           0.0516
_backward_Convolution                2116       19494.2988           2.6370          12.5610           9.2128
_mul_scalar                          1058           3.7320           0.0020           0.0230           0.0035
_backward_log_softmax                1058          17.7000           0.0090           0.0400           0.0167
mean                                 3334          63.5710           0.0080           0.0730           0.0191
_backward_mean                       1058          11.4990           0.0080           0.1030           0.0109
_backward_FullyConnected             3174         593.6920           0.0280           0.5940           0.1870
WaitForVar                           2276          20.1970           0.0060           0.0280           0.0089
broadcast_equal                      1218           6.0310           0.0030           0.0110           0.0050
sgd_update                          10580         102.5860           0.0020           0.0640           0.0097
_backward_Activation                 4232         310.3530           0.0070           0.3900           0.0733



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       41620       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3660        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             529        2098.1431           0.3060          73.5850           3.9662
MXNDArrayCreateEx                     610          20.8610           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      530       11441.3574           5.6130          24.8060          21.5875
MXNDArraySyncCopyToCPU               1140        8961.6641           0.1180          24.1980           7.8611
MXNDArrayGetDType                    1140           0.4000           0.0000           0.0010           0.0004
MXNDArrayGetShape                    2890           1.3220           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1220          10.7000           0.0070           0.0280           0.0088
MXNDArrayFree                       13630         139.3060           0.0000           0.9140           0.0102
MXNet C API Calls                   61110         548.4670         487.3580         548.4670          30.5545
MXNet C API Concurrency            122219           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1060           0.5030           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5300           2.7640           0.0000           0.0230           0.0005
MXNDArraySetGradState                5300           2.7010           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1060           0.4500           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  530         288.1380           0.5250           0.6810           0.5437
MXNDArrayGetContext                  8460           3.6470           0.0000           0.0070           0.0004
MXImperativeInvokeEx                17710         450.1460           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2120        5155.2671           0.7010           3.7500           2.4317
FullyConnected                       3660         348.2080           0.0080           0.3430           0.0951
argmax                               1220          23.8970           0.0050           0.0480           0.0196
_backward_pick                       1060          16.6250           0.0130           0.0260           0.0157
_backward_mul_scalar                 1060           4.5680           0.0030           0.0160           0.0043
DeleteVariable                      45280         320.6070           0.0010           0.9010           0.0071
Flatten                              1220          50.5830           0.0080           0.1120           0.0415
Activation                           4880         221.1730           0.0030           0.3430           0.0453
SetValueOp                           1060           6.7770           0.0050           0.0180           0.0064
pick                                 1060           8.2620           0.0060           0.0280           0.0078
Pooling                              2440        3355.2351           0.0640           3.1720           1.3751
Convolution                          2440       13822.4219           0.2260          13.2050           5.6649
CopyCPU2CPU                          1220           7.0220           0.0030           0.0360           0.0058
log_softmax                          1060          32.7350           0.0150           0.0550           0.0309
_backward_copy                       1060          54.6520           0.0220           0.0760           0.0516
_backward_Convolution                2120       19531.4141           2.6370          12.5610           9.2129
_mul_scalar                          1060           3.7380           0.0020           0.0230           0.0035
_backward_log_softmax                1060          17.7430           0.0090           0.0400           0.0167
mean                                 3340          63.6790           0.0080           0.0730           0.0191
_backward_mean                       1060          11.5210           0.0080           0.1030           0.0109
_backward_FullyConnected             3180         595.1110           0.0280           0.5940           0.1871
WaitForVar                           2280          20.2330           0.0060           0.0280           0.0089
broadcast_equal                      1220           6.0410           0.0030           0.0110           0.0050
sgd_update                          10600         102.8630           0.0020           0.0640           0.0097
_backward_Activation                 4240         310.9440           0.0070           0.3900           0.0733



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       41694       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3666        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             530        2100.8979           0.3060          73.5850           3.9640
MXNDArrayCreateEx                     611          20.8940           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      531       11463.1787           5.6130          24.8060          21.5879
MXNDArraySyncCopyToCPU               1142        8975.8984           0.1180          24.1980           7.8598
MXNDArrayGetDType                    1142           0.4010           0.0000           0.0010           0.0004
MXNDArrayGetShape                    2895           1.3230           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1222          10.7170           0.0070           0.0280           0.0088
MXNDArrayFree                       13653         139.5780           0.0000           0.9140           0.0102
MXNet C API Calls                   61217         548.5740         487.3580         548.5740          30.6080
MXNet C API Concurrency            122433           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1062           0.5040           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5310           2.7670           0.0000           0.0230           0.0005
MXNDArraySetGradState                5310           2.7060           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1062           0.4510           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  531         288.7010           0.5250           0.6810           0.5437
MXNDArrayGetContext                  8474           3.6570           0.0000           0.0070           0.0004
MXImperativeInvokeEx                17741         450.9460           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2124        5165.1958           0.7010           3.7500           2.4318
FullyConnected                       3666         348.7370           0.0080           0.3430           0.0951
argmax                               1222          23.9350           0.0050           0.0480           0.0196
_backward_pick                       1062          16.6560           0.0130           0.0260           0.0157
_backward_mul_scalar                 1062           4.5770           0.0030           0.0160           0.0043
DeleteVariable                      45360         321.1630           0.0010           0.9010           0.0071
Flatten                              1222          50.6680           0.0080           0.1120           0.0415
Activation                           4888         221.5240           0.0030           0.3430           0.0453
SetValueOp                           1062           6.7900           0.0050           0.0180           0.0064
pick                                 1062           8.2770           0.0060           0.0280           0.0078
Pooling                              2444        3360.6331           0.0640           3.1720           1.3751
Convolution                          2444       13844.5889           0.2260          13.2050           5.6647
CopyCPU2CPU                          1222           7.0310           0.0030           0.0360           0.0058
log_softmax                          1062          32.7950           0.0150           0.0550           0.0309
_backward_copy                       1062          54.7560           0.0220           0.0760           0.0516
_backward_Convolution                2124       19568.2324           2.6370          12.5610           9.2129
_mul_scalar                          1062           3.7450           0.0020           0.0230           0.0035
_backward_log_softmax                1062          17.7750           0.0090           0.0400           0.0167
mean                                 3346          63.7960           0.0080           0.0730           0.0191
_backward_mean                       1062          11.5420           0.0080           0.1030           0.0109
_backward_FullyConnected             3186         596.1830           0.0280           0.5940           0.1871
WaitForVar                           2284          20.2670           0.0060           0.0280           0.0089
broadcast_equal                      1222           6.0500           0.0030           0.0110           0.0050
sgd_update                          10620         103.0640           0.0020           0.0640           0.0097
_backward_Activation                 4248         311.5130           0.0070           0.3900           0.0733



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       41768       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3672        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             531        2104.8000           0.3060          73.5850           3.9638
MXNDArrayCreateEx                     612          20.9280           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      532       11484.8721           5.6130          24.8060          21.5881
MXNDArraySyncCopyToCPU               1144        8990.1914           0.1180          24.1980           7.8586
MXNDArrayGetDType                    1144           0.4010           0.0000           0.0010           0.0004
MXNDArrayGetShape                    2900           1.3240           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1224          10.7340           0.0070           0.0280           0.0088
MXNDArrayFree                       13676         139.8000           0.0000           0.9140           0.0102
MXNet C API Calls                   61324         548.6810         487.3580         548.6810          30.6615
MXNet C API Concurrency            122647           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1064           0.5050           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5320           2.7710           0.0000           0.0230           0.0005
MXNDArraySetGradState                5320           2.7130           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1064           0.4510           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  532         289.2390           0.5250           0.6810           0.5437
MXNDArrayGetContext                  8488           3.6600           0.0000           0.0070           0.0004
MXImperativeInvokeEx                17772         451.7200           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2128        5174.8979           0.7010           3.7500           2.4318
FullyConnected                       3672         349.2660           0.0080           0.3430           0.0951
argmax                               1224          23.9720           0.0050           0.0480           0.0196
_backward_pick                       1064          16.6870           0.0130           0.0260           0.0157
_backward_mul_scalar                 1064           4.5860           0.0030           0.0160           0.0043
DeleteVariable                      45440         321.6960           0.0010           0.9010           0.0071
Flatten                              1224          50.7480           0.0080           0.1120           0.0415
Activation                           4896         221.8770           0.0030           0.3430           0.0453
SetValueOp                           1064           6.8020           0.0050           0.0180           0.0064
pick                                 1064           8.2910           0.0060           0.0280           0.0078
Pooling                              2448        3365.9761           0.0640           3.1720           1.3750
Convolution                          2448       13866.6553           0.2260          13.2050           5.6645
CopyCPU2CPU                          1224           7.0410           0.0030           0.0360           0.0058
log_softmax                          1064          32.8550           0.0150           0.0550           0.0309
_backward_copy                       1064          54.8570           0.0220           0.0760           0.0516
_backward_Convolution                2128       19604.9551           2.6370          12.5610           9.2129
_mul_scalar                          1064           3.7520           0.0020           0.0230           0.0035
_backward_log_softmax                1064          17.8070           0.0090           0.0400           0.0167
mean                                 3352          63.9160           0.0080           0.0730           0.0191
_backward_mean                       1064          11.5630           0.0080           0.1030           0.0109
_backward_FullyConnected             3192         597.2420           0.0280           0.5940           0.1871
WaitForVar                           2288          20.3010           0.0060           0.0280           0.0089
broadcast_equal                      1224           6.0590           0.0030           0.0110           0.0050
sgd_update                          10640         103.2670           0.0020           0.0640           0.0097
_backward_Activation                 4256         312.0800           0.0070           0.3900           0.0733



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       41842       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3678        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             532        2108.7141           0.3060          73.5850           3.9637
MXNDArrayCreateEx                     613          20.9620           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      533       11506.7461           5.6130          24.8060          21.5886
MXNDArraySyncCopyToCPU               1146        9004.5420           0.1180          24.1980           7.8574
MXNDArrayGetDType                    1146           0.4010           0.0000           0.0010           0.0003
MXNDArrayGetShape                    2905           1.3270           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1226          10.7510           0.0070           0.0280           0.0088
MXNDArrayFree                       13699         140.0300           0.0000           0.9140           0.0102
MXNet C API Calls                   61431         548.7880         487.3580         548.7880          30.7150
MXNet C API Concurrency            122861           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1066           0.5050           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5330           2.7760           0.0000           0.0230           0.0005
MXNDArraySetGradState                5330           2.7180           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1066           0.4520           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  533         289.7770           0.5250           0.6810           0.5437
MXNDArrayGetContext                  8502           3.6700           0.0000           0.0070           0.0004
MXImperativeInvokeEx                17803         452.5040           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2132        5184.6001           0.7010           3.7500           2.4318
FullyConnected                       3678         349.8170           0.0080           0.3430           0.0951
argmax                               1226          24.0100           0.0050           0.0480           0.0196
_backward_pick                       1066          16.7200           0.0130           0.0260           0.0157
_backward_mul_scalar                 1066           4.5940           0.0030           0.0160           0.0043
DeleteVariable                      45520         322.2660           0.0010           0.9010           0.0071
Flatten                              1226          50.8310           0.0080           0.1120           0.0415
Activation                           4904         222.2310           0.0030           0.3430           0.0453
SetValueOp                           1066           6.8150           0.0050           0.0180           0.0064
pick                                 1066           8.3070           0.0060           0.0280           0.0078
Pooling                              2452        3371.3279           0.0640           3.1720           1.3749
Convolution                          2452       13888.8223           0.2260          13.2050           5.6643
CopyCPU2CPU                          1226           7.0500           0.0030           0.0360           0.0058
log_softmax                          1066          32.9140           0.0150           0.0550           0.0309
_backward_copy                       1066          54.9610           0.0220           0.0760           0.0516
_backward_Convolution                2132       19642.0430           2.6370          12.5610           9.2130
_mul_scalar                          1066           3.7600           0.0020           0.0230           0.0035
_backward_log_softmax                1066          17.8390           0.0090           0.0400           0.0167
mean                                 3358          64.0360           0.0080           0.0730           0.0191
_backward_mean                       1066          11.5850           0.0080           0.1030           0.0109
_backward_FullyConnected             3198         598.3100           0.0280           0.5940           0.1871
WaitForVar                           2292          20.3330           0.0060           0.0280           0.0089
broadcast_equal                      1226           6.0690           0.0030           0.0110           0.0050
sgd_update                          10660         103.4170           0.0020           0.0640           0.0097
_backward_Activation                 4264         312.6670           0.0070           0.3900           0.0733



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       41916       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3684        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             533        2112.6160           0.3060          73.5850           3.9636
MXNDArrayCreateEx                     614          20.9960           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      534       11528.6172           5.6130          24.8060          21.5892
MXNDArraySyncCopyToCPU               1148        9019.3760           0.1180          24.1980           7.8566
MXNDArrayGetDType                    1148           0.4030           0.0000           0.0010           0.0004
MXNDArrayGetShape                    2910           1.3300           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1228          10.7670           0.0070           0.0280           0.0088
MXNDArrayFree                       13722         140.2630           0.0000           0.9140           0.0102
MXNet C API Calls                   61538         548.8950         487.3580         548.8950          30.7685
MXNet C API Concurrency            123075           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1068           0.5050           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5340           2.7800           0.0000           0.0230           0.0005
MXNDArraySetGradState                5340           2.7190           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1068           0.4530           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  534         290.3140           0.5250           0.6810           0.5437
MXNDArrayGetContext                  8516           3.6750           0.0000           0.0070           0.0004
MXImperativeInvokeEx                17834         453.2830           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2136        5194.3569           0.7010           3.7500           2.4318
FullyConnected                       3684         350.5900           0.0080           0.3430           0.0952
argmax                               1228          24.0540           0.0050           0.0480           0.0196
_backward_pick                       1068          16.7520           0.0130           0.0260           0.0157
_backward_mul_scalar                 1068           4.6030           0.0030           0.0160           0.0043
DeleteVariable                      45600         322.8100           0.0010           0.9010           0.0071
Flatten                              1228          50.9100           0.0080           0.1120           0.0415
Activation                           4912         222.6200           0.0030           0.3430           0.0453
SetValueOp                           1068           6.8270           0.0050           0.0180           0.0064
pick                                 1068           8.3220           0.0060           0.0280           0.0078
Pooling                              2456        3376.7251           0.0640           3.1720           1.3749
Convolution                          2456       13911.1738           0.2260          13.2050           5.6642
CopyCPU2CPU                          1228           7.0600           0.0030           0.0360           0.0057
log_softmax                          1068          32.9870           0.0150           0.0550           0.0309
_backward_copy                       1068          55.0610           0.0220           0.0760           0.0516
_backward_Convolution                2136       19679.0898           2.6370          12.5610           9.2131
_mul_scalar                          1068           3.7670           0.0020           0.0230           0.0035
_backward_log_softmax                1068          17.8820           0.0090           0.0400           0.0167
mean                                 3364          64.1420           0.0080           0.0730           0.0191
_backward_mean                       1068          11.6060           0.0080           0.1030           0.0109
_backward_FullyConnected             3204         599.7310           0.0280           0.5940           0.1872
WaitForVar                           2296          20.3700           0.0060           0.0280           0.0089
broadcast_equal                      1228           6.0780           0.0030           0.0110           0.0049
sgd_update                          10680         103.6340           0.0020           0.0640           0.0097
_backward_Activation                 4272         313.3440           0.0070           0.3900           0.0733



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       41990       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3690        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             534        2116.5530           0.3060          73.5850           3.9636
MXNDArrayCreateEx                     615          21.0300           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      535       11550.4531           5.6130          24.8060          21.5896
MXNDArraySyncCopyToCPU               1150        9033.7568           0.1180          24.1980           7.8554
MXNDArrayGetDType                    1150           0.4050           0.0000           0.0010           0.0004
MXNDArrayGetShape                    2915           1.3330           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1230          10.7830           0.0070           0.0280           0.0088
MXNDArrayFree                       13745         140.4900           0.0000           0.9140           0.0102
MXNet C API Calls                   61645         549.0020         487.3580         549.0020          30.8220
MXNet C API Concurrency            123289           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1070           0.5070           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5350           2.7830           0.0000           0.0230           0.0005
MXNDArraySetGradState                5350           2.7260           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1070           0.4550           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  535         290.8460           0.5250           0.6810           0.5436
MXNDArrayGetContext                  8530           3.6830           0.0000           0.0070           0.0004
MXImperativeInvokeEx                17865         454.0570           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2140        5204.2192           0.7010           3.7500           2.4319
FullyConnected                       3690         351.1120           0.0080           0.3430           0.0952
argmax                               1230          24.0930           0.0050           0.0480           0.0196
_backward_pick                       1070          16.7830           0.0130           0.0260           0.0157
_backward_mul_scalar                 1070           4.6110           0.0030           0.0160           0.0043
DeleteVariable                      45680         323.3390           0.0010           0.9010           0.0071
Flatten                              1230          50.9890           0.0080           0.1120           0.0415
Activation                           4920         222.9720           0.0030           0.3430           0.0453
SetValueOp                           1070           6.8390           0.0050           0.0180           0.0064
pick                                 1070           8.3360           0.0060           0.0280           0.0078
Pooling                              2460        3382.0540           0.0640           3.1720           1.3748
Convolution                          2460       13933.3711           0.2260          13.2050           5.6640
CopyCPU2CPU                          1230           7.0690           0.0030           0.0360           0.0057
log_softmax                          1070          33.0470           0.0150           0.0550           0.0309
_backward_copy                       1070          55.1650           0.0220           0.0760           0.0516
_backward_Convolution                2140       19715.9805           2.6370          12.5610           9.2131
_mul_scalar                          1070           3.7750           0.0020           0.0230           0.0035
_backward_log_softmax                1070          17.9130           0.0090           0.0400           0.0167
mean                                 3370          64.2610           0.0080           0.0730           0.0191
_backward_mean                       1070          11.6270           0.0080           0.1030           0.0109
_backward_FullyConnected             3210         600.7950           0.0280           0.5940           0.1872
WaitForVar                           2300          20.4040           0.0060           0.0280           0.0089
broadcast_equal                      1230           6.0880           0.0030           0.0110           0.0049
sgd_update                          10700         103.7880           0.0020           0.0640           0.0097
_backward_Activation                 4280         313.9960           0.0070           0.3900           0.0734



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       42064       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3696        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             535        2120.4709           0.3060          73.5850           3.9635
MXNDArrayCreateEx                     616          21.0640           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      536       11572.1191           5.6130          24.8060          21.5898
MXNDArraySyncCopyToCPU               1152        9048.0684           0.1180          24.1980           7.8542
MXNDArrayGetDType                    1152           0.4060           0.0000           0.0010           0.0004
MXNDArrayGetShape                    2920           1.3360           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1232          10.8010           0.0070           0.0280           0.0088
MXNDArrayFree                       13768         140.7230           0.0000           0.9140           0.0102
MXNet C API Calls                   61752         549.1090         487.3580         549.1090          30.8755
MXNet C API Concurrency            123503           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1072           0.5070           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5360           2.7850           0.0000           0.0230           0.0005
MXNDArraySetGradState                5360           2.7320           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1072           0.4550           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  536         291.3920           0.5250           0.6810           0.5436
MXNDArrayGetContext                  8544           3.6910           0.0000           0.0070           0.0004
MXImperativeInvokeEx                17896         454.8390           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2144        5213.9580           0.7010           3.7500           2.4319
FullyConnected                       3696         351.6370           0.0080           0.3430           0.0951
argmax                               1232          24.1300           0.0050           0.0480           0.0196
_backward_pick                       1072          16.8150           0.0130           0.0260           0.0157
_backward_mul_scalar                 1072           4.6200           0.0030           0.0160           0.0043
DeleteVariable                      45760         323.8770           0.0010           0.9010           0.0071
Flatten                              1232          51.0730           0.0080           0.1120           0.0415
Activation                           4928         223.3280           0.0030           0.3430           0.0453
SetValueOp                           1072           6.8510           0.0050           0.0180           0.0064
pick                                 1072           8.3500           0.0060           0.0280           0.0078
Pooling                              2464        3387.4121           0.0640           3.1720           1.3748
Convolution                          2464       13955.4639           0.2260          13.2050           5.6637
CopyCPU2CPU                          1232           7.0790           0.0030           0.0360           0.0057
log_softmax                          1072          33.1070           0.0150           0.0550           0.0309
_backward_copy                       1072          55.2690           0.0220           0.0760           0.0516
_backward_Convolution                2144       19752.6641           2.6370          12.5610           9.2130
_mul_scalar                          1072           3.7830           0.0020           0.0230           0.0035
_backward_log_softmax                1072          17.9450           0.0090           0.0400           0.0167
mean                                 3376          64.3770           0.0080           0.0730           0.0191
_backward_mean                       1072          11.6470           0.0080           0.1030           0.0109
_backward_FullyConnected             3216         601.8660           0.0280           0.5940           0.1871
WaitForVar                           2304          20.4370           0.0060           0.0280           0.0089
broadcast_equal                      1232           6.0980           0.0030           0.0110           0.0049
sgd_update                          10720         103.9890           0.0020           0.0640           0.0097
_backward_Activation                 4288         314.5330           0.0070           0.3900           0.0734



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       42138       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3702        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             536        2124.3750           0.3060          73.5850           3.9634
MXNDArrayCreateEx                     617          21.0970           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      537       11593.9629           5.6130          24.8060          21.5902
MXNDArraySyncCopyToCPU               1154        9062.4443           0.1180          24.1980           7.8531
MXNDArrayGetDType                    1154           0.4070           0.0000           0.0010           0.0004
MXNDArrayGetShape                    2925           1.3380           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1234          10.8190           0.0070           0.0280           0.0088
MXNDArrayFree                       13791         140.9700           0.0000           0.9140           0.0102
MXNet C API Calls                   61859         549.2160         487.3580         549.2160          30.9290
MXNet C API Concurrency            123717           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1074           0.5070           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5370           2.7900           0.0000           0.0230           0.0005
MXNDArraySetGradState                5370           2.7350           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1074           0.4560           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  537         291.9310           0.5250           0.6810           0.5436
MXNDArrayGetContext                  8558           3.6960           0.0000           0.0070           0.0004
MXImperativeInvokeEx                17927         455.6130           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2148        5223.6338           0.7010           3.7500           2.4319
FullyConnected                       3702         352.1610           0.0080           0.3430           0.0951
argmax                               1234          24.1690           0.0050           0.0480           0.0196
_backward_pick                       1074          16.8470           0.0130           0.0260           0.0157
_backward_mul_scalar                 1074           4.6290           0.0030           0.0160           0.0043
DeleteVariable                      45840         324.3920           0.0010           0.9010           0.0071
Flatten                              1234          51.1530           0.0080           0.1120           0.0415
Activation                           4936         223.7220           0.0030           0.3430           0.0453
SetValueOp                           1074           6.8650           0.0050           0.0180           0.0064
pick                                 1074           8.3650           0.0060           0.0280           0.0078
Pooling                              2468        3392.7581           0.0640           3.1720           1.3747
Convolution                          2468       13977.6494           0.2260          13.2050           5.6636
CopyCPU2CPU                          1234           7.0890           0.0030           0.0360           0.0057
log_softmax                          1074          33.1670           0.0150           0.0550           0.0309
_backward_copy                       1074          55.3710           0.0220           0.0760           0.0516
_backward_Convolution                2148       19789.6777           2.6370          12.5610           9.2131
_mul_scalar                          1074           3.7900           0.0020           0.0230           0.0035
_backward_log_softmax                1074          17.9770           0.0090           0.0400           0.0167
mean                                 3382          64.4910           0.0080           0.0730           0.0191
_backward_mean                       1074          11.6680           0.0080           0.1030           0.0109
_backward_FullyConnected             3222         602.9300           0.0280           0.5940           0.1871
WaitForVar                           2308          20.4720           0.0060           0.0280           0.0089
broadcast_equal                      1234           6.1080           0.0030           0.0110           0.0049
sgd_update                          10740         104.1420           0.0020           0.0640           0.0097
_backward_Activation                 4296         315.1730           0.0070           0.3900           0.0734



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       42212       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3708        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             537        2128.2700           0.3060          73.5850           3.9633
MXNDArrayCreateEx                     618          21.1310           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      538       11615.8291           5.6130          24.8060          21.5908
MXNDArraySyncCopyToCPU               1156        9077.3740           0.1180          24.1980           7.8524
MXNDArrayGetDType                    1156           0.4070           0.0000           0.0010           0.0004
MXNDArrayGetShape                    2930           1.3400           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1236          10.8360           0.0070           0.0280           0.0088
MXNDArrayFree                       13814         141.1980           0.0000           0.9140           0.0102
MXNet C API Calls                   61966         549.3230         487.3580         549.3230          30.9825
MXNet C API Concurrency            123931           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1076           0.5070           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5380           2.7960           0.0000           0.0230           0.0005
MXNDArraySetGradState                5380           2.7380           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1076           0.4580           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  538         292.4920           0.5250           0.6810           0.5437
MXNDArrayGetContext                  8572           3.7000           0.0000           0.0070           0.0004
MXImperativeInvokeEx                17958         456.3870           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2152        5233.5889           0.7010           3.7500           2.4320
FullyConnected                       3708         352.9600           0.0080           0.3430           0.0952
argmax                               1236          24.2150           0.0050           0.0480           0.0196
_backward_pick                       1076          16.8790           0.0130           0.0260           0.0157
_backward_mul_scalar                 1076           4.6380           0.0030           0.0160           0.0043
DeleteVariable                      45920         324.9420           0.0010           0.9010           0.0071
Flatten                              1236          51.2320           0.0080           0.1120           0.0414
Activation                           4944         224.1020           0.0030           0.3430           0.0453
SetValueOp                           1076           6.8780           0.0050           0.0180           0.0064
pick                                 1076           8.3800           0.0060           0.0280           0.0078
Pooling                              2472        3398.1541           0.0640           3.1720           1.3747
Convolution                          2472       13999.9629           0.2260          13.2050           5.6634
CopyCPU2CPU                          1236           7.0990           0.0030           0.0360           0.0057
log_softmax                          1076          33.2400           0.0150           0.0550           0.0309
_backward_copy                       1076          55.4720           0.0220           0.0760           0.0516
_backward_Convolution                2152       19826.7031           2.6370          12.5610           9.2132
_mul_scalar                          1076           3.7970           0.0020           0.0230           0.0035
_backward_log_softmax                1076          18.0180           0.0090           0.0400           0.0167
mean                                 3388          64.5980           0.0080           0.0730           0.0191
_backward_mean                       1076          11.6890           0.0080           0.1030           0.0109
_backward_FullyConnected             3228         604.3410           0.0280           0.5940           0.1872
WaitForVar                           2312          20.5060           0.0060           0.0280           0.0089
broadcast_equal                      1236           6.1180           0.0030           0.0110           0.0049
sgd_update                          10760         104.3540           0.0020           0.0640           0.0097
_backward_Activation                 4304         315.8440           0.0070           0.3900           0.0734



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       42286       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3714        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             538        2132.1709           0.3060          73.5850           3.9631
MXNDArrayCreateEx                     619          21.1640           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      539       11637.5732           5.6130          24.8060          21.5910
MXNDArraySyncCopyToCPU               1158        9091.8799           0.1180          24.1980           7.8514
MXNDArrayGetDType                    1158           0.4090           0.0000           0.0010           0.0004
MXNDArrayGetShape                    2935           1.3440           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1238          10.8530           0.0070           0.0280           0.0088
MXNDArrayFree                       13837         141.4200           0.0000           0.9140           0.0102
MXNet C API Calls                   62073         549.4300         487.3580         549.4300          31.0360
MXNet C API Concurrency            124145           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1078           0.5090           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5390           2.8010           0.0000           0.0230           0.0005
MXNDArraySetGradState                5390           2.7410           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1078           0.4600           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  539         293.0240           0.5250           0.6810           0.5436
MXNDArrayGetContext                  8586           3.7080           0.0000           0.0070           0.0004
MXImperativeInvokeEx                17989         457.1610           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2156        5243.3408           0.7010           3.7500           2.4320
FullyConnected                       3714         353.5630           0.0080           0.3430           0.0952
argmax                               1238          24.2520           0.0050           0.0480           0.0196
_backward_pick                       1078          16.9100           0.0130           0.0260           0.0157
_backward_mul_scalar                 1078           4.6460           0.0030           0.0160           0.0043
DeleteVariable                      46000         325.4470           0.0010           0.9010           0.0071
Flatten                              1238          51.3110           0.0080           0.1120           0.0414
Activation                           4952         224.4860           0.0030           0.3430           0.0453
SetValueOp                           1078           6.8890           0.0050           0.0180           0.0064
pick                                 1078           8.3950           0.0060           0.0280           0.0078
Pooling                              2476        3403.5061           0.0640           3.1720           1.3746
Convolution                          2476       14022.1211           0.2260          13.2050           5.6632
CopyCPU2CPU                          1238           7.1080           0.0030           0.0360           0.0057
log_softmax                          1078          33.3010           0.0150           0.0550           0.0309
_backward_copy                       1078          55.5750           0.0220           0.0760           0.0516
_backward_Convolution                2156       19863.4922           2.6370          12.5610           9.2131
_mul_scalar                          1078           3.8040           0.0020           0.0230           0.0035
_backward_log_softmax                1078          18.0580           0.0090           0.0400           0.0168
mean                                 3394          64.7060           0.0080           0.0730           0.0191
_backward_mean                       1078          11.7100           0.0080           0.1030           0.0109
_backward_FullyConnected             3234         605.4760           0.0280           0.5940           0.1872
WaitForVar                           2316          20.5400           0.0060           0.0280           0.0089
broadcast_equal                      1238           6.1280           0.0030           0.0110           0.0049
sgd_update                          10780         104.5900           0.0020           0.0640           0.0097
_backward_Activation                 4312         316.4260           0.0070           0.3900           0.0734



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       42360       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3720        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             539        2136.0801           0.3060          73.5850           3.9630
MXNDArrayCreateEx                     620          21.1990           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      540       11662.1816           5.6130          24.8060          21.5966
MXNDArraySyncCopyToCPU               1160        9109.7939           0.1180          24.1980           7.8533
MXNDArrayGetDType                    1160           0.4090           0.0000           0.0010           0.0004
MXNDArrayGetShape                    2940           1.3440           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1240          10.8700           0.0070           0.0280           0.0088
MXNDArrayFree                       13860         141.6450           0.0000           0.9140           0.0102
MXNet C API Calls                   62180         549.5370         487.3580         549.5370          31.0895
MXNet C API Concurrency            124359           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1080           0.5110           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5400           2.8080           0.0000           0.0230           0.0005
MXNDArraySetGradState                5400           2.7480           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1080           0.4600           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  540         293.5900           0.5250           0.6810           0.5437
MXNDArrayGetContext                  8600           3.7180           0.0000           0.0070           0.0004
MXImperativeInvokeEx                18020         457.9420           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2160        5255.5508           0.7010           3.7500           2.4331
FullyConnected                       3720         354.4650           0.0080           0.3430           0.0953
argmax                               1240          24.3020           0.0050           0.0480           0.0196
_backward_pick                       1080          16.9450           0.0130           0.0260           0.0157
_backward_mul_scalar                 1080           4.6550           0.0030           0.0160           0.0043
DeleteVariable                      46080         326.0320           0.0010           0.9010           0.0071
Flatten                              1240          51.4130           0.0080           0.1120           0.0415
Activation                           4960         225.0930           0.0030           0.3430           0.0454
SetValueOp                           1080           6.9050           0.0050           0.0180           0.0064
pick                                 1080           8.4140           0.0060           0.0280           0.0078
Pooling                              2480        3412.9729           0.0640           3.1720           1.3762
Convolution                          2480       14044.3770           0.2260          13.2050           5.6631
CopyCPU2CPU                          1240           7.1190           0.0030           0.0360           0.0057
log_softmax                          1080          33.3790           0.0150           0.0550           0.0309
_backward_copy                       1080          55.6730           0.0220           0.0760           0.0515
_backward_Convolution                2160       19904.4277           2.6370          12.5610           9.2150
_mul_scalar                          1080           3.8130           0.0020           0.0230           0.0035
_backward_log_softmax                1080          18.1040           0.0090           0.0400           0.0168
mean                                 3400          64.8310           0.0080           0.0730           0.0191
_backward_mean                       1080          11.7370           0.0080           0.1030           0.0109
_backward_FullyConnected             3240         607.2040           0.0280           0.5940           0.1874
WaitForVar                           2320          20.5810           0.0060           0.0280           0.0089
broadcast_equal                      1240           6.1410           0.0030           0.0110           0.0050
sgd_update                          10800         104.8870           0.0020           0.0640           0.0097
_backward_Activation                 4320         317.2430           0.0070           0.3900           0.0734



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       42434       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3726        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             540        2139.9810           0.3060          73.5850           3.9629
MXNDArrayCreateEx                     621          21.2320           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      541       11686.9072           5.6130          24.8060          21.6024
MXNDArraySyncCopyToCPU               1162        9127.5947           0.1180          24.1980           7.8551
MXNDArrayGetDType                    1162           0.4100           0.0000           0.0010           0.0004
MXNDArrayGetShape                    2945           1.3470           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1242          10.8880           0.0070           0.0280           0.0088
MXNDArrayFree                       13883         141.8700           0.0000           0.9140           0.0102
MXNet C API Calls                   62287         549.6440         487.3580         549.6440          31.1430
MXNet C API Concurrency            124573           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1082           0.5130           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5410           2.8140           0.0000           0.0230           0.0005
MXNDArraySetGradState                5410           2.7520           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1082           0.4620           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  541         294.1520           0.5250           0.6810           0.5437
MXNDArrayGetContext                  8614           3.7210           0.0000           0.0070           0.0004
MXImperativeInvokeEx                18051         458.7150           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2164        5267.7861           0.7010           3.7500           2.4343
FullyConnected                       3726         355.3590           0.0080           0.3430           0.0954
argmax                               1242          24.3530           0.0050           0.0480           0.0196
_backward_pick                       1082          16.9810           0.0130           0.0260           0.0157
_backward_mul_scalar                 1082           4.6640           0.0030           0.0160           0.0043
DeleteVariable                      46160         326.6040           0.0010           0.9010           0.0071
Flatten                              1242          51.4930           0.0080           0.1120           0.0415
Activation                           4968         225.6260           0.0030           0.3430           0.0454
SetValueOp                           1082           6.9190           0.0050           0.0180           0.0064
pick                                 1082           8.4330           0.0060           0.0280           0.0078
Pooling                              2484        3422.3979           0.0640           3.1720           1.3778
Convolution                          2484       14066.5225           0.2260          13.2050           5.6629
CopyCPU2CPU                          1242           7.1310           0.0030           0.0360           0.0057
log_softmax                          1082          33.4560           0.0150           0.0550           0.0309
_backward_copy                       1082          55.7710           0.0220           0.0760           0.0515
_backward_Convolution                2164       19945.6230           2.6370          12.5610           9.2170
_mul_scalar                          1082           3.8220           0.0020           0.0230           0.0035
_backward_log_softmax                1082          18.1500           0.0090           0.0400           0.0168
mean                                 3406          64.9590           0.0080           0.0730           0.0191
_backward_mean                       1082          11.7630           0.0080           0.1030           0.0109
_backward_FullyConnected             3246         608.9260           0.0280           0.5940           0.1876
WaitForVar                           2324          20.6220           0.0060           0.0280           0.0089
broadcast_equal                      1242           6.1540           0.0030           0.0110           0.0050
sgd_update                          10820         105.1860           0.0020           0.0640           0.0097
_backward_Activation                 4328         318.0530           0.0070           0.3900           0.0735



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       42508       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3732        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             541        2143.8850           0.3060          73.5850           3.9628
MXNDArrayCreateEx                     622          21.2670           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      542       11711.5801           5.6130          24.8060          21.6081
MXNDArraySyncCopyToCPU               1164        9145.4326           0.1180          24.1980           7.8569
MXNDArrayGetDType                    1164           0.4100           0.0000           0.0010           0.0004
MXNDArrayGetShape                    2950           1.3500           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1244          10.9050           0.0070           0.0280           0.0088
MXNDArrayFree                       13906         142.0990           0.0000           0.9140           0.0102
MXNet C API Calls                   62394         549.7510         487.3580         549.7510          31.1965
MXNet C API Concurrency            124787           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1084           0.5140           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5420           2.8180           0.0000           0.0230           0.0005
MXNDArraySetGradState                5420           2.7570           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1084           0.4620           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  542         294.7140           0.5250           0.6810           0.5438
MXNDArrayGetContext                  8628           3.7290           0.0000           0.0070           0.0004
MXImperativeInvokeEx                18082         459.4890           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2168        5279.8652           0.7010           3.7500           2.4354
FullyConnected                       3732         356.2300           0.0080           0.3430           0.0955
argmax                               1244          24.4030           0.0050           0.0480           0.0196
_backward_pick                       1084          17.0170           0.0130           0.0260           0.0157
_backward_mul_scalar                 1084           4.6720           0.0030           0.0160           0.0043
DeleteVariable                      46240         327.1830           0.0010           0.9010           0.0071
Flatten                              1244          51.5740           0.0080           0.1120           0.0415
Activation                           4976         226.1580           0.0030           0.3430           0.0454
SetValueOp                           1084           6.9340           0.0050           0.0180           0.0064
pick                                 1084           8.4520           0.0060           0.0280           0.0078
Pooling                              2488        3431.8401           0.0640           3.1720           1.3794
Convolution                          2488       14088.7686           0.2260          13.2050           5.6627
CopyCPU2CPU                          1244           7.1420           0.0030           0.0360           0.0057
log_softmax                          1084          33.5340           0.0150           0.0550           0.0309
_backward_copy                       1084          55.8690           0.0220           0.0760           0.0515
_backward_Convolution                2168       19986.7832           2.6370          12.5610           9.2190
_mul_scalar                          1084           3.8300           0.0020           0.0230           0.0035
_backward_log_softmax                1084          18.1970           0.0090           0.0400           0.0168
mean                                 3412          65.1080           0.0080           0.0730           0.0191
_backward_mean                       1084          11.7890           0.0080           0.1030           0.0109
_backward_FullyConnected             3252         610.6450           0.0280           0.5940           0.1878
WaitForVar                           2328          20.6630           0.0060           0.0280           0.0089
broadcast_equal                      1244           6.1670           0.0030           0.0110           0.0050
sgd_update                          10840         105.4940           0.0020           0.0640           0.0097
_backward_Activation                 4336         318.8610           0.0070           0.3900           0.0735



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       42582       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3738        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             542        2147.7920           0.3060          73.5850           3.9627
MXNDArrayCreateEx                     623          21.3010           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      543       11736.1533           5.6130          24.8060          21.6135
MXNDArraySyncCopyToCPU               1166        9163.2285           0.1180          24.1980           7.8587
MXNDArrayGetDType                    1166           0.4100           0.0000           0.0010           0.0004
MXNDArrayGetShape                    2955           1.3520           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1246          10.9240           0.0070           0.0280           0.0088
MXNDArrayFree                       13929         142.3220           0.0000           0.9140           0.0102
MXNet C API Calls                   62501         549.8580         487.3580         549.8580          31.2500
MXNet C API Concurrency            125001           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1086           0.5160           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5430           2.8230           0.0000           0.0230           0.0005
MXNDArraySetGradState                5430           2.7590           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1086           0.4640           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  543         295.2480           0.5250           0.6810           0.5437
MXNDArrayGetContext                  8642           3.7370           0.0000           0.0070           0.0004
MXImperativeInvokeEx                18113         460.2640           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2172        5292.0078           0.7010           3.7500           2.4365
FullyConnected                       3738         357.1430           0.0080           0.3430           0.0955
argmax                               1246          24.4530           0.0050           0.0480           0.0196
_backward_pick                       1086          17.0510           0.0130           0.0260           0.0157
_backward_mul_scalar                 1086           4.6800           0.0030           0.0160           0.0043
DeleteVariable                      46320         327.7220           0.0010           0.9010           0.0071
Flatten                              1246          51.6530           0.0080           0.1120           0.0415
Activation                           4984         226.6910           0.0030           0.3430           0.0455
SetValueOp                           1086           6.9480           0.0050           0.0180           0.0064
pick                                 1086           8.4710           0.0060           0.0280           0.0078
Pooling                              2492        3441.2871           0.0640           3.1720           1.3809
Convolution                          2492       14110.9170           0.2260          13.2050           5.6625
CopyCPU2CPU                          1246           7.1540           0.0030           0.0360           0.0057
log_softmax                          1086          33.6100           0.0150           0.0550           0.0309
_backward_copy                       1086          55.9650           0.0220           0.0760           0.0515
_backward_Convolution                2172       20027.7227           2.6370          12.5610           9.2209
_mul_scalar                          1086           3.8380           0.0020           0.0230           0.0035
_backward_log_softmax                1086          18.2440           0.0090           0.0400           0.0168
mean                                 3418          65.2360           0.0080           0.0730           0.0191
_backward_mean                       1086          11.8150           0.0080           0.1030           0.0109
_backward_FullyConnected             3258         612.3730           0.0280           0.5940           0.1880
WaitForVar                           2332          20.7040           0.0060           0.0280           0.0089
broadcast_equal                      1246           6.1800           0.0030           0.0110           0.0050
sgd_update                          10860         105.7940           0.0020           0.0640           0.0097
_backward_Activation                 4344         319.6690           0.0070           0.3900           0.0736



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       42656       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3744        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             543        2151.6960           0.3060          73.5850           3.9626
MXNDArrayCreateEx                     624          21.3350           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      544       11760.6641           5.6130          24.8060          21.6189
MXNDArraySyncCopyToCPU               1168        9180.9072           0.1180          24.1980           7.8604
MXNDArrayGetDType                    1168           0.4110           0.0000           0.0010           0.0004
MXNDArrayGetShape                    2960           1.3540           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1248          10.9410           0.0070           0.0280           0.0088
MXNDArrayFree                       13952         142.5460           0.0000           0.9140           0.0102
MXNet C API Calls                   62608         549.9650         487.3580         549.9650          31.3035
MXNet C API Concurrency            125215           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1088           0.5160           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5440           2.8300           0.0000           0.0230           0.0005
MXNDArraySetGradState                5440           2.7630           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1088           0.4640           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  544         295.7850           0.5250           0.6810           0.5437
MXNDArrayGetContext                  8656           3.7450           0.0000           0.0070           0.0004
MXImperativeInvokeEx                18144         461.0420           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2176        5304.0469           0.7010           3.7500           2.4375
FullyConnected                       3744         358.0400           0.0080           0.3430           0.0956
argmax                               1248          24.5030           0.0050           0.0480           0.0196
_backward_pick                       1088          17.0850           0.0130           0.0260           0.0157
_backward_mul_scalar                 1088           4.6880           0.0030           0.0160           0.0043
DeleteVariable                      46400         328.2820           0.0010           0.9010           0.0071
Flatten                              1248          51.7330           0.0080           0.1120           0.0415
Activation                           4992         227.2240           0.0030           0.3430           0.0455
SetValueOp                           1088           6.9640           0.0050           0.0180           0.0064
pick                                 1088           8.4890           0.0060           0.0280           0.0078
Pooling                              2496        3450.6589           0.0640           3.1720           1.3825
Convolution                          2496       14133.0020           0.2260          13.2050           5.6623
CopyCPU2CPU                          1248           7.1640           0.0030           0.0360           0.0057
log_softmax                          1088          33.6860           0.0150           0.0550           0.0310
_backward_copy                       1088          56.0620           0.0220           0.0760           0.0515
_backward_Convolution                2176       20068.5020           2.6370          12.5610           9.2227
_mul_scalar                          1088           3.8460           0.0020           0.0230           0.0035
_backward_log_softmax                1088          18.2900           0.0090           0.0400           0.0168
mean                                 3424          65.3590           0.0080           0.0730           0.0191
_backward_mean                       1088          11.8400           0.0080           0.1030           0.0109
_backward_FullyConnected             3264         614.0620           0.0280           0.5940           0.1881
WaitForVar                           2336          20.7460           0.0060           0.0280           0.0089
broadcast_equal                      1248           6.1930           0.0030           0.0110           0.0050
sgd_update                          10880         106.1960           0.0020           0.0790           0.0098
_backward_Activation                 4352         320.4700           0.0070           0.3900           0.0736



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       42730       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3750        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             544        2155.6069           0.3060          73.5850           3.9625
MXNDArrayCreateEx                     625          21.3690           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      545       11785.3057           5.6130          24.8060          21.6244
MXNDArraySyncCopyToCPU               1170        9198.7461           0.1180          24.1980           7.8622
MXNDArrayGetDType                    1170           0.4120           0.0000           0.0010           0.0004
MXNDArrayGetShape                    2965           1.3580           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1250          10.9590           0.0070           0.0280           0.0088
MXNDArrayFree                       13975         142.7750           0.0000           0.9140           0.0102
MXNet C API Calls                   62715         550.0720         487.3580         550.0720          31.3570
MXNet C API Concurrency            125429           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1090           0.5170           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5450           2.8360           0.0000           0.0230           0.0005
MXNDArraySetGradState                5450           2.7670           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1090           0.4650           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  545         296.3180           0.5250           0.6810           0.5437
MXNDArrayGetContext                  8670           3.7540           0.0000           0.0070           0.0004
MXImperativeInvokeEx                18175         461.8450           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2180        5316.1968           0.7010           3.7500           2.4386
FullyConnected                       3750         358.9450           0.0080           0.3430           0.0957
argmax                               1250          24.5530           0.0050           0.0480           0.0196
_backward_pick                       1090          17.1200           0.0130           0.0260           0.0157
_backward_mul_scalar                 1090           4.6960           0.0030           0.0160           0.0043
DeleteVariable                      46480         328.8360           0.0010           0.9010           0.0071
Flatten                              1250          51.8140           0.0080           0.1120           0.0415
Activation                           5000         227.7640           0.0030           0.3430           0.0456
SetValueOp                           1090           6.9780           0.0050           0.0180           0.0064
pick                                 1090           8.5080           0.0060           0.0280           0.0078
Pooling                              2500        3460.0601           0.0640           3.1720           1.3840
Convolution                          2500       14155.2188           0.2260          13.2050           5.6621
CopyCPU2CPU                          1250           7.1750           0.0030           0.0360           0.0057
log_softmax                          1090          33.7630           0.0150           0.0550           0.0310
_backward_copy                       1090          56.1590           0.0220           0.0760           0.0515
_backward_Convolution                2180       20109.6230           2.6370          12.5610           9.2246
_mul_scalar                          1090           3.8550           0.0020           0.0230           0.0035
_backward_log_softmax                1090          18.3370           0.0090           0.0400           0.0168
mean                                 3430          65.4840           0.0080           0.0730           0.0191
_backward_mean                       1090          11.8660           0.0080           0.1030           0.0109
_backward_FullyConnected             3270         615.7540           0.0280           0.5940           0.1883
WaitForVar                           2340          20.7860           0.0060           0.0280           0.0089
broadcast_equal                      1250           6.2060           0.0030           0.0110           0.0050
sgd_update                          10900         106.4960           0.0020           0.0790           0.0098
_backward_Activation                 4360         321.2730           0.0070           0.3900           0.0737



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       42804       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3756        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             545        2159.5190           0.3060          73.5850           3.9624
MXNDArrayCreateEx                     626          21.4030           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      546       11809.9170           5.6130          24.8060          21.6299
MXNDArraySyncCopyToCPU               1172        9216.5381           0.1180          24.1980           7.8639
MXNDArrayGetDType                    1172           0.4130           0.0000           0.0010           0.0004
MXNDArrayGetShape                    2970           1.3610           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1252          10.9760           0.0070           0.0280           0.0088
MXNDArrayFree                       13998         142.9980           0.0000           0.9140           0.0102
MXNet C API Calls                   62822         550.1790         487.3580         550.1790          31.4105
MXNet C API Concurrency            125643           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1092           0.5180           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5460           2.8420           0.0000           0.0230           0.0005
MXNDArraySetGradState                5460           2.7730           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1092           0.4660           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  546         296.8500           0.5250           0.6810           0.5437
MXNDArrayGetContext                  8684           3.7630           0.0000           0.0070           0.0004
MXImperativeInvokeEx                18206         462.6200           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2184        5328.2710           0.7010           3.7500           2.4397
FullyConnected                       3756         359.8370           0.0080           0.3430           0.0958
argmax                               1252          24.6020           0.0050           0.0480           0.0197
_backward_pick                       1092          17.1560           0.0130           0.0260           0.0157
_backward_mul_scalar                 1092           4.7050           0.0030           0.0160           0.0043
DeleteVariable                      46560         329.3990           0.0010           0.9010           0.0071
Flatten                              1252          51.8940           0.0080           0.1120           0.0414
Activation                           5008         228.3230           0.0030           0.3430           0.0456
SetValueOp                           1092           6.9930           0.0050           0.0180           0.0064
pick                                 1092           8.5270           0.0060           0.0280           0.0078
Pooling                              2504        3469.4719           0.0640           3.1720           1.3856
Convolution                          2504       14177.4521           0.2260          13.2050           5.6619
CopyCPU2CPU                          1252           7.1850           0.0030           0.0360           0.0057
log_softmax                          1092          33.8400           0.0150           0.0550           0.0310
_backward_copy                       1092          56.2550           0.0220           0.0760           0.0515
_backward_Convolution                2184       20150.6562           2.6370          12.5610           9.2265
_mul_scalar                          1092           3.8640           0.0020           0.0230           0.0035
_backward_log_softmax                1092          18.3840           0.0090           0.0400           0.0168
mean                                 3436          65.6300           0.0080           0.0730           0.0191
_backward_mean                       1092          11.8910           0.0080           0.1030           0.0109
_backward_FullyConnected             3276         617.4350           0.0280           0.5940           0.1885
WaitForVar                           2344          20.8270           0.0060           0.0280           0.0089
broadcast_equal                      1252           6.2190           0.0030           0.0110           0.0050
sgd_update                          10920         106.7930           0.0020           0.0790           0.0098
_backward_Activation                 4368         322.0750           0.0070           0.3900           0.0737



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       42878       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3762        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             546        2163.4131           0.3060          73.5850           3.9623
MXNDArrayCreateEx                     627          21.4380           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      547       11834.4336           5.6130          24.8060          21.6352
MXNDArraySyncCopyToCPU               1174        9234.3467           0.1180          24.1980           7.8657
MXNDArrayGetDType                    1174           0.4150           0.0000           0.0010           0.0004
MXNDArrayGetShape                    2975           1.3620           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1254          10.9930           0.0070           0.0280           0.0088
MXNDArrayFree                       14021         143.2190           0.0000           0.9140           0.0102
MXNet C API Calls                   62929         550.2860         487.3580         550.2860          31.4640
MXNet C API Concurrency            125857           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1094           0.5190           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5470           2.8460           0.0000           0.0230           0.0005
MXNDArraySetGradState                5470           2.7800           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1094           0.4670           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  547         297.3810           0.5250           0.6810           0.5437
MXNDArrayGetContext                  8698           3.7680           0.0000           0.0070           0.0004
MXImperativeInvokeEx                18237         463.3920           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2188        5340.3481           0.7010           3.7500           2.4407
FullyConnected                       3762         360.7100           0.0080           0.3430           0.0959
argmax                               1254          24.6510           0.0050           0.0480           0.0197
_backward_pick                       1094          17.1900           0.0130           0.0260           0.0157
_backward_mul_scalar                 1094           4.7140           0.0030           0.0160           0.0043
DeleteVariable                      46640         329.9560           0.0010           0.9010           0.0071
Flatten                              1254          51.9750           0.0080           0.1120           0.0414
Activation                           5016         228.8580           0.0030           0.3430           0.0456
SetValueOp                           1094           7.0070           0.0050           0.0180           0.0064
pick                                 1094           8.5450           0.0060           0.0280           0.0078
Pooling                              2508        3478.9460           0.0640           3.1720           1.3871
Convolution                          2508       14199.6133           0.2260          13.2050           5.6617
CopyCPU2CPU                          1254           7.1960           0.0030           0.0360           0.0057
log_softmax                          1094          33.9160           0.0150           0.0550           0.0310
_backward_copy                       1094          56.3520           0.0220           0.0760           0.0515
_backward_Convolution                2188       20191.5156           2.6370          12.5610           9.2283
_mul_scalar                          1094           3.8730           0.0020           0.0230           0.0035
_backward_log_softmax                1094          18.4290           0.0090           0.0400           0.0168
mean                                 3442          65.7570           0.0080           0.0730           0.0191
_backward_mean                       1094          11.9170           0.0080           0.1030           0.0109
_backward_FullyConnected             3282         619.1170           0.0280           0.5940           0.1886
WaitForVar                           2348          20.8680           0.0060           0.0280           0.0089
broadcast_equal                      1254           6.2320           0.0030           0.0110           0.0050
sgd_update                          10940         107.0290           0.0020           0.0790           0.0098
_backward_Activation                 4376         322.9420           0.0070           0.3900           0.0738



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       42952       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3768        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             547        2167.3091           0.3060          73.5850           3.9622
MXNDArrayCreateEx                     628          21.4720           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      548       11858.9639           5.6130          24.8060          21.6404
MXNDArraySyncCopyToCPU               1176        9252.1445           0.1180          24.1980           7.8675
MXNDArrayGetDType                    1176           0.4160           0.0000           0.0010           0.0004
MXNDArrayGetShape                    2980           1.3650           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1256          11.0100           0.0070           0.0280           0.0088
MXNDArrayFree                       14044         143.4390           0.0000           0.9140           0.0102
MXNet C API Calls                   63036         550.3930         487.3580         550.3930          31.5175
MXNet C API Concurrency            126071           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1096           0.5190           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5480           2.8510           0.0000           0.0230           0.0005
MXNDArraySetGradState                5480           2.7870           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1096           0.4670           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  548         297.9110           0.5250           0.6810           0.5436
MXNDArrayGetContext                  8712           3.7730           0.0000           0.0070           0.0004
MXImperativeInvokeEx                18268         464.1610           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2192        5352.4609           0.7010           3.7500           2.4418
FullyConnected                       3768         361.6180           0.0080           0.3430           0.0960
argmax                               1256          24.7000           0.0050           0.0480           0.0197
_backward_pick                       1096          17.2250           0.0130           0.0260           0.0157
_backward_mul_scalar                 1096           4.7230           0.0030           0.0160           0.0043
DeleteVariable                      46720         330.5180           0.0010           0.9010           0.0071
Flatten                              1256          52.0530           0.0080           0.1120           0.0414
Activation                           5024         229.3900           0.0030           0.3430           0.0457
SetValueOp                           1096           7.0220           0.0050           0.0180           0.0064
pick                                 1096           8.5630           0.0060           0.0280           0.0078
Pooling                              2512        3488.3391           0.0640           3.1720           1.3887
Convolution                          2512       14221.7031           0.2260          13.2050           5.6615
CopyCPU2CPU                          1256           7.2080           0.0030           0.0360           0.0057
log_softmax                          1096          33.9930           0.0150           0.0550           0.0310
_backward_copy                       1096          56.4500           0.0220           0.0760           0.0515
_backward_Convolution                2192       20232.4336           2.6370          12.5610           9.2301
_mul_scalar                          1096           3.8820           0.0020           0.0230           0.0035
_backward_log_softmax                1096          18.4750           0.0090           0.0400           0.0169
mean                                 3448          65.8810           0.0080           0.0730           0.0191
_backward_mean                       1096          11.9420           0.0080           0.1030           0.0109
_backward_FullyConnected             3288         620.8130           0.0280           0.5940           0.1888
WaitForVar                           2352          20.9090           0.0060           0.0280           0.0089
broadcast_equal                      1256           6.2440           0.0030           0.0110           0.0050
sgd_update                          10960         107.2640           0.0020           0.0790           0.0098
_backward_Activation                 4384         323.7990           0.0070           0.3900           0.0739



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       43026       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3774        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             548        2171.2100           0.3060          73.5850           3.9621
MXNDArrayCreateEx                     629          21.5060           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      549       11883.6494           5.6130          24.8060          21.6460
MXNDArraySyncCopyToCPU               1178        9269.9766           0.1180          24.1980           7.8693
MXNDArrayGetDType                    1178           0.4160           0.0000           0.0010           0.0004
MXNDArrayGetShape                    2985           1.3680           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1258          11.0280           0.0070           0.0280           0.0088
MXNDArrayFree                       14067         143.6620           0.0000           0.9140           0.0102
MXNet C API Calls                   63143         550.5000         487.3580         550.5000          31.5710
MXNet C API Concurrency            126285           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1098           0.5200           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5490           2.8560           0.0000           0.0230           0.0005
MXNDArraySetGradState                5490           2.7920           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1098           0.4670           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  549         298.4440           0.5250           0.6810           0.5436
MXNDArrayGetContext                  8726           3.7780           0.0000           0.0070           0.0004
MXImperativeInvokeEx                18299         464.9400           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2196        5364.5918           0.7010           3.7500           2.4429
FullyConnected                       3774         362.5090           0.0080           0.3430           0.0961
argmax                               1258          24.7490           0.0050           0.0480           0.0197
_backward_pick                       1098          17.2600           0.0130           0.0260           0.0157
_backward_mul_scalar                 1098           4.7310           0.0030           0.0160           0.0043
DeleteVariable                      46800         331.0840           0.0010           0.9010           0.0071
Flatten                              1258          52.1350           0.0080           0.1120           0.0414
Activation                           5032         229.9240           0.0030           0.3430           0.0457
SetValueOp                           1098           7.0360           0.0050           0.0180           0.0064
pick                                 1098           8.5820           0.0060           0.0280           0.0078
Pooling                              2516        3497.8101           0.0640           3.1720           1.3902
Convolution                          2516       14243.9004           0.2260          13.2050           5.6613
CopyCPU2CPU                          1258           7.2190           0.0030           0.0360           0.0057
log_softmax                          1098          34.0690           0.0150           0.0550           0.0310
_backward_copy                       1098          56.5470           0.0220           0.0760           0.0515
_backward_Convolution                2196       20273.6074           2.6370          12.5610           9.2321
_mul_scalar                          1098           3.8910           0.0020           0.0230           0.0035
_backward_log_softmax                1098          18.5220           0.0090           0.0400           0.0169
mean                                 3454          66.0080           0.0080           0.0730           0.0191
_backward_mean                       1098          11.9680           0.0080           0.1030           0.0109
_backward_FullyConnected             3294         622.5060           0.0280           0.5940           0.1890
WaitForVar                           2356          20.9510           0.0060           0.0280           0.0089
broadcast_equal                      1258           6.2570           0.0030           0.0110           0.0050
sgd_update                          10980         107.5620           0.0020           0.0790           0.0098
_backward_Activation                 4392         324.6030           0.0070           0.3900           0.0739



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       43100       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3780        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             549        2175.1150           0.3060          73.5850           3.9620
MXNDArrayCreateEx                     630          21.5390           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      550       11908.2588           5.6130          24.8060          21.6514
MXNDArraySyncCopyToCPU               1180        9287.8223           0.1180          24.1980           7.8710
MXNDArrayGetDType                    1180           0.4170           0.0000           0.0010           0.0004
MXNDArrayGetShape                    2990           1.3700           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1260          11.0450           0.0070           0.0280           0.0088
MXNDArrayFree                       14090         143.8840           0.0000           0.9140           0.0102
MXNet C API Calls                   63250         550.6070         487.3580         550.6070          31.6245
MXNet C API Concurrency            126499           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1100           0.5210           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5500           2.8590           0.0000           0.0230           0.0005
MXNDArraySetGradState                5500           2.7980           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1100           0.4690           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  550         298.9740           0.5250           0.6810           0.5436
MXNDArrayGetContext                  8740           3.7830           0.0000           0.0070           0.0004
MXImperativeInvokeEx                18330         465.7140           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2200        5376.6841           0.7010           3.7500           2.4439
FullyConnected                       3780         363.4000           0.0080           0.3430           0.0961
argmax                               1260          24.7980           0.0050           0.0480           0.0197
_backward_pick                       1100          17.2970           0.0130           0.0260           0.0157
_backward_mul_scalar                 1100           4.7390           0.0030           0.0160           0.0043
DeleteVariable                      46880         331.6540           0.0010           0.9010           0.0071
Flatten                              1260          52.2150           0.0080           0.1120           0.0414
Activation                           5040         230.4660           0.0030           0.3430           0.0457
SetValueOp                           1100           7.0500           0.0050           0.0180           0.0064
pick                                 1100           8.6000           0.0060           0.0280           0.0078
Pooling                              2520        3507.2351           0.0640           3.1720           1.3918
Convolution                          2520       14266.1338           0.2260          13.2050           5.6612
CopyCPU2CPU                          1260           7.2300           0.0030           0.0360           0.0057
log_softmax                          1100          34.1470           0.0150           0.0550           0.0310
_backward_copy                       1100          56.6430           0.0220           0.0760           0.0515
_backward_Convolution                2200       20314.6621           2.6370          12.5610           9.2339
_mul_scalar                          1100           3.9000           0.0020           0.0230           0.0035
_backward_log_softmax                1100          18.5680           0.0090           0.0400           0.0169
mean                                 3460          66.1520           0.0080           0.0730           0.0191
_backward_mean                       1100          11.9940           0.0080           0.1030           0.0109
_backward_FullyConnected             3300         624.1880           0.0280           0.5940           0.1891
WaitForVar                           2360          20.9930           0.0060           0.0280           0.0089
broadcast_equal                      1260           6.2690           0.0030           0.0110           0.0050
sgd_update                          11000         107.8620           0.0020           0.0790           0.0098
_backward_Activation                 4400         325.4060           0.0070           0.3900           0.0740



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       43174       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3786        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             550        2175.5659           0.3060          73.5850           3.9556
MXNDArrayCreateEx                     631          21.5720           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      551       11932.7217           5.6130          24.8060          21.6565
MXNDArraySyncCopyToCPU               1182        9305.5400           0.1180          24.1980           7.8727
MXNDArrayGetDType                    1182           0.4180           0.0000           0.0010           0.0004
MXNDArrayGetShape                    2995           1.3720           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1262          11.0630           0.0070           0.0280           0.0088
MXNDArrayFree                       14113         144.1140           0.0000           0.9140           0.0102
MXNet C API Calls                   63357         550.7140         487.3580         550.7140          31.6780
MXNet C API Concurrency            126713           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1102           0.5220           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5510           2.8640           0.0000           0.0230           0.0005
MXNDArraySetGradState                5510           2.8060           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1102           0.4690           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  551         299.5080           0.5250           0.6810           0.5436
MXNDArrayGetContext                  8754           3.7880           0.0000           0.0070           0.0004
MXImperativeInvokeEx                18361         466.5010           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2204        5388.9009           0.7010           3.7500           2.4451
FullyConnected                       3786         364.3060           0.0080           0.3430           0.0962
argmax                               1262          24.8460           0.0050           0.0480           0.0197
_backward_pick                       1102          17.3320           0.0130           0.0260           0.0157
_backward_mul_scalar                 1102           4.7480           0.0030           0.0160           0.0043
DeleteVariable                      46960         332.2080           0.0010           0.9010           0.0071
Flatten                              1262          52.2960           0.0080           0.1120           0.0414
Activation                           5048         230.9980           0.0030           0.3430           0.0458
SetValueOp                           1102           7.0660           0.0050           0.0180           0.0064
pick                                 1102           8.6190           0.0060           0.0280           0.0078
Pooling                              2524        3516.7109           0.0640           3.1720           1.3933
Convolution                          2524       14288.3047           0.2260          13.2050           5.6610
CopyCPU2CPU                          1262           7.2410           0.0030           0.0360           0.0057
log_softmax                          1102          34.2230           0.0150           0.0550           0.0311
_backward_copy                       1102          56.7420           0.0220           0.0760           0.0515
_backward_Convolution                2204       20355.4141           2.6370          12.5610           9.2357
_mul_scalar                          1102           3.9090           0.0020           0.0230           0.0035
_backward_log_softmax                1102          18.6140           0.0090           0.0400           0.0169
mean                                 3466          66.2790           0.0080           0.0730           0.0191
_backward_mean                       1102          12.0210           0.0080           0.1030           0.0109
_backward_FullyConnected             3306         625.8750           0.0280           0.5940           0.1893
WaitForVar                           2364          21.0340           0.0060           0.0280           0.0089
broadcast_equal                      1262           6.2810           0.0030           0.0110           0.0050
sgd_update                          11020         108.1550           0.0020           0.0790           0.0098
_backward_Activation                 4408         326.2070           0.0070           0.3900           0.0740



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       43248       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3792        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             551        2179.4719           0.3060          73.5850           3.9555
MXNDArrayCreateEx                     632          21.6060           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      552       11957.2861           5.6130          24.8060          21.6618
MXNDArraySyncCopyToCPU               1184        9323.2930           0.1180          24.1980           7.8744
MXNDArrayGetDType                    1184           0.4190           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3000           1.3730           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1264          11.0810           0.0070           0.0280           0.0088
MXNDArrayFree                       14136         144.3240           0.0000           0.9140           0.0102
MXNet C API Calls                   63464         550.8210         487.3580         550.8210          31.7315
MXNet C API Concurrency            126927           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1104           0.5220           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5520           2.8680           0.0000           0.0230           0.0005
MXNDArraySetGradState                5520           2.8110           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1104           0.4690           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  552         300.0420           0.5250           0.6810           0.5436
MXNDArrayGetContext                  8768           3.7930           0.0000           0.0070           0.0004
MXImperativeInvokeEx                18392         467.2720           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2208        5401.0488           0.7010           3.7500           2.4461
FullyConnected                       3792         365.1660           0.0080           0.3430           0.0963
argmax                               1264          24.8950           0.0050           0.0480           0.0197
_backward_pick                       1104          17.3670           0.0130           0.0260           0.0157
_backward_mul_scalar                 1104           4.7560           0.0030           0.0160           0.0043
DeleteVariable                      47040         332.7450           0.0010           0.9010           0.0071
Flatten                              1264          52.3800           0.0080           0.1120           0.0414
Activation                           5056         231.5330           0.0030           0.3430           0.0458
SetValueOp                           1104           7.0810           0.0050           0.0180           0.0064
pick                                 1104           8.6360           0.0060           0.0280           0.0078
Pooling                              2528        3526.1101           0.0640           3.1720           1.3948
Convolution                          2528       14310.4131           0.2260          13.2050           5.6608
CopyCPU2CPU                          1264           7.2520           0.0030           0.0360           0.0057
log_softmax                          1104          34.3000           0.0150           0.0550           0.0311
_backward_copy                       1104          56.8390           0.0220           0.0760           0.0515
_backward_Convolution                2208       20396.3477           2.6370          12.5610           9.2375
_mul_scalar                          1104           3.9180           0.0020           0.0230           0.0035
_backward_log_softmax                1104          18.6600           0.0090           0.0400           0.0169
mean                                 3472          66.4030           0.0080           0.0730           0.0191
_backward_mean                       1104          12.0480           0.0080           0.1030           0.0109
_backward_FullyConnected             3312         627.5620           0.0280           0.5940           0.1895
WaitForVar                           2368          21.0740           0.0060           0.0280           0.0089
broadcast_equal                      1264           6.2930           0.0030           0.0110           0.0050
sgd_update                          11040         108.4380           0.0020           0.0790           0.0098
_backward_Activation                 4416         327.0120           0.0070           0.3900           0.0741



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       43322       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3798        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             552        2183.3840           0.3060          73.5850           3.9554
MXNDArrayCreateEx                     633          21.6390           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      553       11981.9482           5.6130          24.8060          21.6672
MXNDArraySyncCopyToCPU               1186        9341.1475           0.1180          24.1980           7.8762
MXNDArrayGetDType                    1186           0.4200           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3005           1.3750           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1266          11.0990           0.0070           0.0280           0.0088
MXNDArrayFree                       14159         144.5450           0.0000           0.9140           0.0102
MXNet C API Calls                   63571         550.9280         487.3580         550.9280          31.7850
MXNet C API Concurrency            127141           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1106           0.5240           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5530           2.8700           0.0000           0.0230           0.0005
MXNDArraySetGradState                5530           2.8150           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1106           0.4690           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  553         300.5740           0.5250           0.6810           0.5435
MXNDArrayGetContext                  8782           3.7990           0.0000           0.0070           0.0004
MXImperativeInvokeEx                18423         468.0450           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2212        5413.3018           0.7010           3.7500           2.4472
FullyConnected                       3798         366.0710           0.0080           0.3430           0.0964
argmax                               1266          24.9440           0.0050           0.0480           0.0197
_backward_pick                       1106          17.4000           0.0130           0.0260           0.0157
_backward_mul_scalar                 1106           4.7650           0.0030           0.0160           0.0043
DeleteVariable                      47120         333.3130           0.0010           0.9010           0.0071
Flatten                              1266          52.4620           0.0080           0.1120           0.0414
Activation                           5064         232.0670           0.0030           0.3430           0.0458
SetValueOp                           1106           7.0950           0.0050           0.0180           0.0064
pick                                 1106           8.6550           0.0060           0.0280           0.0078
Pooling                              2532        3535.5581           0.0640           3.1720           1.3963
Convolution                          2532       14332.5654           0.2260          13.2050           5.6606
CopyCPU2CPU                          1266           7.2630           0.0030           0.0360           0.0057
log_softmax                          1106          34.3770           0.0150           0.0550           0.0311
_backward_copy                       1106          56.9360           0.0220           0.0760           0.0515
_backward_Convolution                2212       20437.4336           2.6370          12.5610           9.2393
_mul_scalar                          1106           3.9270           0.0020           0.0230           0.0036
_backward_log_softmax                1106          18.7070           0.0090           0.0400           0.0169
mean                                 3478          66.5280           0.0080           0.0730           0.0191
_backward_mean                       1106          12.0740           0.0080           0.1030           0.0109
_backward_FullyConnected             3318         629.2580           0.0280           0.5940           0.1896
WaitForVar                           2372          21.1150           0.0060           0.0280           0.0089
broadcast_equal                      1266           6.3060           0.0030           0.0110           0.0050
sgd_update                          11060         108.6770           0.0020           0.0790           0.0098
_backward_Activation                 4424         327.8780           0.0070           0.3900           0.0741



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       43396       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3804        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             553        2187.2959           0.3060          73.5850           3.9553
MXNDArrayCreateEx                     634          21.6720           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      554       12006.6309           5.6130          24.8060          21.6726
MXNDArraySyncCopyToCPU               1188        9358.9912           0.1180          24.1980           7.8779
MXNDArrayGetDType                    1188           0.4220           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3010           1.3780           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1268          11.1160           0.0070           0.0280           0.0088
MXNDArrayFree                       14182         144.7710           0.0000           0.9140           0.0102
MXNet C API Calls                   63678         551.0350         487.3580         551.0350          31.8385
MXNet C API Concurrency            127355           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1108           0.5250           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5540           2.8750           0.0000           0.0230           0.0005
MXNDArraySetGradState                5540           2.8210           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1108           0.4690           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  554         301.1050           0.5250           0.6810           0.5435
MXNDArrayGetContext                  8796           3.8030           0.0000           0.0070           0.0004
MXImperativeInvokeEx                18454         468.8150           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2216        5425.4521           0.7010           3.7500           2.4483
FullyConnected                       3804         366.9630           0.0080           0.3430           0.0965
argmax                               1268          24.9930           0.0050           0.0480           0.0197
_backward_pick                       1108          17.4360           0.0130           0.0260           0.0157
_backward_mul_scalar                 1108           4.7730           0.0030           0.0160           0.0043
DeleteVariable                      47200         333.8740           0.0010           0.9010           0.0071
Flatten                              1268          52.5410           0.0080           0.1120           0.0414
Activation                           5072         232.5970           0.0030           0.3430           0.0459
SetValueOp                           1108           7.1090           0.0050           0.0180           0.0064
pick                                 1108           8.6740           0.0060           0.0280           0.0078
Pooling                              2536        3544.9451           0.0640           3.1720           1.3978
Convolution                          2536       14354.8213           0.2260          13.2050           5.6604
CopyCPU2CPU                          1268           7.2740           0.0030           0.0360           0.0057
log_softmax                          1108          34.4520           0.0150           0.0550           0.0311
_backward_copy                       1108          57.0320           0.0220           0.0760           0.0515
_backward_Convolution                2216       20478.5938           2.6370          12.5610           9.2412
_mul_scalar                          1108           3.9350           0.0020           0.0230           0.0036
_backward_log_softmax                1108          18.7540           0.0090           0.0400           0.0169
mean                                 3484          66.6750           0.0080           0.0730           0.0191
_backward_mean                       1108          12.1000           0.0080           0.1030           0.0109
_backward_FullyConnected             3324         630.9370           0.0280           0.5940           0.1898
WaitForVar                           2376          21.1560           0.0060           0.0280           0.0089
broadcast_equal                      1268           6.3180           0.0030           0.0110           0.0050
sgd_update                          11080         108.9750           0.0020           0.0790           0.0098
_backward_Activation                 4432         328.6770           0.0070           0.3900           0.0742



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       43470       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3810        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             554        2191.2041           0.3060          73.5850           3.9552
MXNDArrayCreateEx                     635          21.7050           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      555       12031.1885           5.6130          24.8060          21.6778
MXNDArraySyncCopyToCPU               1190        9376.8252           0.1180          24.1980           7.8797
MXNDArrayGetDType                    1190           0.4230           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3015           1.3800           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1270          11.1330           0.0070           0.0280           0.0088
MXNDArrayFree                       14205         144.9960           0.0000           0.9140           0.0102
MXNet C API Calls                   63785         551.1420         487.3580         551.1420          31.8920
MXNet C API Concurrency            127569           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1110           0.5260           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5550           2.8830           0.0000           0.0230           0.0005
MXNDArraySetGradState                5550           2.8250           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1110           0.4700           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  555         301.6330           0.5250           0.6810           0.5435
MXNDArrayGetContext                  8810           3.8090           0.0000           0.0070           0.0004
MXImperativeInvokeEx                18485         469.5930           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2220        5437.5000           0.7010           3.7500           2.4493
FullyConnected                       3810         367.8670           0.0080           0.3430           0.0966
argmax                               1270          25.0420           0.0050           0.0480           0.0197
_backward_pick                       1110          17.4700           0.0130           0.0260           0.0157
_backward_mul_scalar                 1110           4.7800           0.0030           0.0160           0.0043
DeleteVariable                      47280         334.4300           0.0010           0.9010           0.0071
Flatten                              1270          52.6210           0.0080           0.1120           0.0414
Activation                           5080         233.1300           0.0030           0.3430           0.0459
SetValueOp                           1110           7.1230           0.0050           0.0180           0.0064
pick                                 1110           8.6930           0.0060           0.0280           0.0078
Pooling                              2540        3554.3950           0.0640           3.1720           1.3994
Convolution                          2540       14377.0020           0.2260          13.2050           5.6602
CopyCPU2CPU                          1270           7.2850           0.0030           0.0360           0.0057
log_softmax                          1110          34.5340           0.0150           0.0550           0.0311
_backward_copy                       1110          57.1280           0.0220           0.0760           0.0515
_backward_Convolution                2220       20519.5527           2.6370          12.5610           9.2430
_mul_scalar                          1110           3.9430           0.0020           0.0230           0.0036
_backward_log_softmax                1110          18.8020           0.0090           0.0400           0.0169
mean                                 3490          66.8010           0.0080           0.0730           0.0191
_backward_mean                       1110          12.1260           0.0080           0.1030           0.0109
_backward_FullyConnected             3330         632.6310           0.0280           0.5940           0.1900
WaitForVar                           2380          21.1970           0.0060           0.0280           0.0089
broadcast_equal                      1270           6.3300           0.0030           0.0110           0.0050
sgd_update                          11100         109.2130           0.0020           0.0790           0.0098
_backward_Activation                 4440         329.5400           0.0070           0.3900           0.0742



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       43544       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3816        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             555        2195.0979           0.3060          73.5850           3.9551
MXNDArrayCreateEx                     636          21.7390           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      556       12055.6611           5.6130          24.8060          21.6828
MXNDArraySyncCopyToCPU               1192        9394.6514           0.1180          24.1980           7.8814
MXNDArrayGetDType                    1192           0.4240           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3020           1.3820           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1272          11.1510           0.0070           0.0280           0.0088
MXNDArrayFree                       14228         145.2120           0.0000           0.9140           0.0102
MXNet C API Calls                   63892         551.2490         487.3580         551.2490          31.9455
MXNet C API Concurrency            127783           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1112           0.5280           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5560           2.8900           0.0000           0.0230           0.0005
MXNDArraySetGradState                5560           2.8310           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1112           0.4710           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  556         302.1630           0.5250           0.6810           0.5435
MXNDArrayGetContext                  8824           3.8150           0.0000           0.0070           0.0004
MXImperativeInvokeEx                18516         470.3660           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2224        5449.6699           0.7010           3.7500           2.4504
FullyConnected                       3816         368.7680           0.0080           0.3430           0.0966
argmax                               1272          25.0930           0.0050           0.0480           0.0197
_backward_pick                       1112          17.5040           0.0130           0.0260           0.0157
_backward_mul_scalar                 1112           4.7880           0.0030           0.0160           0.0043
DeleteVariable                      47360         334.9640           0.0010           0.9010           0.0071
Flatten                              1272          52.7010           0.0080           0.1120           0.0414
Activation                           5088         233.6650           0.0030           0.3430           0.0459
SetValueOp                           1112           7.1380           0.0050           0.0180           0.0064
pick                                 1112           8.7120           0.0060           0.0280           0.0078
Pooling                              2544        3563.8311           0.0640           3.1720           1.4009
Convolution                          2544       14399.1016           0.2260          13.2050           5.6600
CopyCPU2CPU                          1272           7.2960           0.0030           0.0360           0.0057
log_softmax                          1112          34.6100           0.0150           0.0550           0.0311
_backward_copy                       1112          57.2240           0.0220           0.0760           0.0515
_backward_Convolution                2224       20560.3242           2.6370          12.5610           9.2448
_mul_scalar                          1112           3.9520           0.0020           0.0230           0.0036
_backward_log_softmax                1112          18.8490           0.0090           0.0400           0.0170
mean                                 3496          66.9280           0.0080           0.0730           0.0191
_backward_mean                       1112          12.1530           0.0080           0.1030           0.0109
_backward_FullyConnected             3336         634.3270           0.0280           0.5940           0.1901
WaitForVar                           2384          21.2360           0.0060           0.0280           0.0089
broadcast_equal                      1272           6.3420           0.0030           0.0110           0.0050
sgd_update                          11120         109.5110           0.0020           0.0790           0.0098
_backward_Activation                 4448         330.3400           0.0070           0.3900           0.0743



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       43618       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3822        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             556        2199.0071           0.3060          73.5850           3.9550
MXNDArrayCreateEx                     637          21.7720           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      557       12077.4805           5.6130          24.8060          21.6831
MXNDArraySyncCopyToCPU               1194        9410.6953           0.1180          24.1980           7.8817
MXNDArrayGetDType                    1194           0.4250           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3025           1.3850           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1274          11.1690           0.0070           0.0280           0.0088
MXNDArrayFree                       14251         145.4550           0.0000           0.9140           0.0102
MXNet C API Calls                   63999         551.3560         487.3580         551.3560          31.9990
MXNet C API Concurrency            127997           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1114           0.5280           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5570           2.8980           0.0000           0.0230           0.0005
MXNDArraySetGradState                5570           2.8360           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1114           0.4710           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  557         302.7180           0.5250           0.6810           0.5435
MXNDArrayGetContext                  8838           3.8190           0.0000           0.0070           0.0004
MXImperativeInvokeEx                18547         471.1640           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2228        5459.3501           0.7010           3.7500           2.4503
FullyConnected                       3822         369.3190           0.0080           0.3430           0.0966
argmax                               1274          25.1310           0.0050           0.0480           0.0197
_backward_pick                       1114          17.5370           0.0130           0.0260           0.0157
_backward_mul_scalar                 1114           4.7970           0.0030           0.0160           0.0043
DeleteVariable                      47440         335.5600           0.0010           0.9010           0.0071
Flatten                              1274          52.7990           0.0080           0.1120           0.0414
Activation                           5096         237.6890           0.0030           1.9440           0.0466
SetValueOp                           1114           7.1520           0.0050           0.0180           0.0064
pick                                 1114           8.7270           0.0060           0.0280           0.0078
Pooling                              2548        3569.0830           0.0640           3.1720           1.4007
Convolution                          2548       14421.2881           0.2260          13.2050           5.6598
CopyCPU2CPU                          1274           7.3060           0.0030           0.0360           0.0057
log_softmax                          1114          34.6700           0.0150           0.0550           0.0311
_backward_copy                       1114          57.3260           0.0220           0.0760           0.0515
_backward_Convolution                2228       20597.3320           2.6370          12.5610           9.2448
_mul_scalar                          1114           3.9590           0.0020           0.0230           0.0036
_backward_log_softmax                1114          18.8800           0.0090           0.0400           0.0169
mean                                 3502          67.0450           0.0080           0.0730           0.0191
_backward_mean                       1114          12.1800           0.0080           0.1030           0.0109
_backward_FullyConnected             3342         635.3970           0.0280           0.5940           0.1901
WaitForVar                           2388          21.2730           0.0060           0.0280           0.0089
broadcast_equal                      1274           6.3520           0.0030           0.0110           0.0050
sgd_update                          11140         109.6600           0.0020           0.0790           0.0098
_backward_Activation                 4456         330.9330           0.0070           0.3900           0.0743



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       43692       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3828        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             557        2202.9021           0.3060          73.5850           3.9549
MXNDArrayCreateEx                     638          21.8060           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      558       12102.4678           5.6130          24.9880          21.6890
MXNDArraySyncCopyToCPU               1196        9436.8516           0.1180          24.1980           7.8903
MXNDArrayGetDType                    1196           0.4250           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3030           1.3900           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1276          11.1860           0.0070           0.0280           0.0088
MXNDArrayFree                       14274         145.6800           0.0000           0.9140           0.0102
MXNet C API Calls                   64106         551.4630         487.3580         551.4630          32.0525
MXNet C API Concurrency            128211           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1116           0.5300           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5580           2.9000           0.0000           0.0230           0.0005
MXNDArraySetGradState                5580           2.8390           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1116           0.4720           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  558         303.2540           0.5250           0.6810           0.5435
MXNDArrayGetContext                  8852           3.8230           0.0000           0.0070           0.0004
MXImperativeInvokeEx                18578         471.9750           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2232        5470.3408           0.7010           3.7500           2.4509
FullyConnected                       3828         370.2100           0.0080           0.3430           0.0967
argmax                               1276          25.1840           0.0050           0.0480           0.0197
_backward_pick                       1116          17.5780           0.0130           0.0260           0.0158
_backward_mul_scalar                 1116           4.8120           0.0030           0.0160           0.0043
DeleteVariable                      47520         336.1320           0.0010           0.9010           0.0071
Flatten                              1276          52.8920           0.0080           0.1120           0.0415
Activation                           5104         238.1110           0.0030           1.9440           0.0467
SetValueOp                           1116           7.1700           0.0050           0.0180           0.0064
pick                                 1116           8.7500           0.0060           0.0280           0.0078
Pooling                              2552        3578.6089           0.0640           3.1720           1.4023
Convolution                          2552       14459.6533           0.2260          13.2050           5.6660
CopyCPU2CPU                          1276           7.3180           0.0030           0.0360           0.0057
log_softmax                          1116          34.7490           0.0150           0.0550           0.0311
_backward_copy                       1116          57.4450           0.0220           0.0760           0.0515
_backward_Convolution                2232       20640.6133           2.6370          12.5610           9.2476
_mul_scalar                          1116           3.9700           0.0020           0.0230           0.0036
_backward_log_softmax                1116          18.9260           0.0090           0.0400           0.0170
mean                                 3508          67.2030           0.0080           0.0730           0.0192
_backward_mean                       1116          12.2100           0.0080           0.1030           0.0109
_backward_FullyConnected             3348         637.1240           0.0280           0.5940           0.1903
WaitForVar                           2392          21.3230           0.0060           0.0280           0.0089
broadcast_equal                      1276           6.3660           0.0030           0.0110           0.0050
sgd_update                          11160         109.9010           0.0020           0.0790           0.0098
_backward_Activation                 4464         331.5860           0.0070           0.3900           0.0743



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       43766       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3834        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             558        2206.7971           0.3060          73.5850           3.9548
MXNDArrayCreateEx                     639          21.8390           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      559       12124.1270           5.6130          24.9880          21.6890
MXNDArraySyncCopyToCPU               1198        9451.2080           0.1180          24.1980           7.8892
MXNDArrayGetDType                    1198           0.4260           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3035           1.3930           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1278          11.2050           0.0070           0.0280           0.0088
MXNDArrayFree                       14297         145.9250           0.0000           0.9140           0.0102
MXNet C API Calls                   64213         551.5700         487.3580         551.5700          32.1060
MXNet C API Concurrency            128425           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1118           0.5320           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5590           2.9050           0.0000           0.0230           0.0005
MXNDArraySetGradState                5590           2.8450           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1118           0.4720           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  559         303.7850           0.5250           0.6810           0.5434
MXNDArrayGetContext                  8866           3.8290           0.0000           0.0070           0.0004
MXImperativeInvokeEx                18609         472.7440           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2236        5479.9468           0.7010           3.7500           2.4508
FullyConnected                       3834         370.7540           0.0080           0.3430           0.0967
argmax                               1278          25.2220           0.0050           0.0480           0.0197
_backward_pick                       1118          17.6110           0.0130           0.0260           0.0158
_backward_mul_scalar                 1118           4.8200           0.0030           0.0160           0.0043
DeleteVariable                      47600         336.7110           0.0010           0.9010           0.0071
Flatten                              1278          52.9700           0.0080           0.1120           0.0414
Activation                           5112         238.4620           0.0030           1.9440           0.0466
SetValueOp                           1118           7.1830           0.0050           0.0180           0.0064
pick                                 1118           8.7650           0.0060           0.0280           0.0078
Pooling                              2556        3583.9341           0.0640           3.1720           1.4022
Convolution                          2556       14481.8242           0.2260          13.2050           5.6658
CopyCPU2CPU                          1278           7.3270           0.0030           0.0360           0.0057
log_softmax                          1118          34.8090           0.0150           0.0550           0.0311
_backward_copy                       1118          57.5460           0.0220           0.0760           0.0515
_backward_Convolution                2236       20677.3418           2.6370          12.5610           9.2475
_mul_scalar                          1118           3.9770           0.0020           0.0230           0.0036
_backward_log_softmax                1118          18.9590           0.0090           0.0400           0.0170
mean                                 3514          67.3220           0.0080           0.0730           0.0192
_backward_mean                       1118          12.2320           0.0080           0.1030           0.0109
_backward_FullyConnected             3354         638.1920           0.0280           0.5940           0.1903
WaitForVar                           2396          21.3600           0.0060           0.0280           0.0089
broadcast_equal                      1278           6.3760           0.0030           0.0110           0.0050
sgd_update                          11180         110.1030           0.0020           0.0790           0.0098
_backward_Activation                 4472         332.1550           0.0070           0.3900           0.0743



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       43840       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3840        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             559        2210.7080           0.3060          73.5850           3.9548
MXNDArrayCreateEx                     640          21.8720           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      560       12145.8145           5.6130          24.9880          21.6890
MXNDArraySyncCopyToCPU               1200        9465.4893           0.1180          24.1980           7.8879
MXNDArrayGetDType                    1200           0.4270           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3040           1.3950           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1280          11.2220           0.0070           0.0280           0.0088
MXNDArrayFree                       14320         146.1470           0.0000           0.9140           0.0102
MXNet C API Calls                   64320         551.6770         487.3580         551.6770          32.1595
MXNet C API Concurrency            128639           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1120           0.5320           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5600           2.9090           0.0000           0.0230           0.0005
MXNDArraySetGradState                5600           2.8510           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1120           0.4740           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  560         304.3380           0.5250           0.6810           0.5435
MXNDArrayGetContext                  8880           3.8380           0.0000           0.0070           0.0004
MXImperativeInvokeEx                18640         473.5260           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2240        5489.6152           0.7010           3.7500           2.4507
FullyConnected                       3840         371.2740           0.0080           0.3430           0.0967
argmax                               1280          25.2590           0.0050           0.0480           0.0197
_backward_pick                       1120          17.6430           0.0130           0.0260           0.0158
_backward_mul_scalar                 1120           4.8280           0.0030           0.0160           0.0043
DeleteVariable                      47680         337.2180           0.0010           0.9010           0.0071
Flatten                              1280          53.0470           0.0080           0.1120           0.0414
Activation                           5120         238.8140           0.0030           1.9440           0.0466
SetValueOp                           1120           7.1950           0.0050           0.0180           0.0064
pick                                 1120           8.7800           0.0060           0.0280           0.0078
Pooling                              2560        3589.3301           0.0640           3.1720           1.4021
Convolution                          2560       14503.8926           0.2260          13.2050           5.6656
CopyCPU2CPU                          1280           7.3360           0.0030           0.0360           0.0057
log_softmax                          1120          34.8690           0.0150           0.0550           0.0311
_backward_copy                       1120          57.6500           0.0220           0.0760           0.0515
_backward_Convolution                2240       20714.0645           2.6370          12.5610           9.2473
_mul_scalar                          1120           3.9840           0.0020           0.0230           0.0036
_backward_log_softmax                1120          18.9910           0.0090           0.0400           0.0170
mean                                 3520          67.4330           0.0080           0.0730           0.0192
_backward_mean                       1120          12.2530           0.0080           0.1030           0.0109
_backward_FullyConnected             3360         639.2530           0.0280           0.5940           0.1903
WaitForVar                           2400          21.3940           0.0060           0.0280           0.0089
broadcast_equal                      1280           6.3860           0.0030           0.0110           0.0050
sgd_update                          11200         110.3040           0.0020           0.0790           0.0098
_backward_Activation                 4480         332.7040           0.0070           0.3900           0.0743



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       43914       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3846        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             560        2214.6060           0.3060          73.5850           3.9547
MXNDArrayCreateEx                     641          21.9060           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      561       12167.6533           5.6130          24.9880          21.6892
MXNDArraySyncCopyToCPU               1202        9479.8008           0.1180          24.1980           7.8867
MXNDArrayGetDType                    1202           0.4270           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3045           1.3980           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1282          11.2390           0.0070           0.0280           0.0088
MXNDArrayFree                       14343         146.3900           0.0000           0.9140           0.0102
MXNet C API Calls                   64427         551.7840         487.3580         551.7840          32.2130
MXNet C API Concurrency            128853           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1122           0.5340           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5610           2.9120           0.0000           0.0230           0.0005
MXNDArraySetGradState                5610           2.8570           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1122           0.4760           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  561         304.8750           0.5250           0.6810           0.5434
MXNDArrayGetContext                  8894           3.8440           0.0000           0.0070           0.0004
MXImperativeInvokeEx                18671         474.3280           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2244        5499.3101           0.7010           3.7500           2.4507
FullyConnected                       3846         371.7980           0.0080           0.3430           0.0967
argmax                               1282          25.2990           0.0050           0.0480           0.0197
_backward_pick                       1122          17.6750           0.0130           0.0260           0.0158
_backward_mul_scalar                 1122           4.8370           0.0030           0.0160           0.0043
DeleteVariable                      47760         337.7880           0.0010           0.9010           0.0071
Flatten                              1282          53.1270           0.0080           0.1120           0.0414
Activation                           5128         239.1660           0.0030           1.9440           0.0466
SetValueOp                           1122           7.2080           0.0050           0.0180           0.0064
pick                                 1122           8.7950           0.0060           0.0280           0.0078
Pooling                              2564        3594.7061           0.0640           3.1720           1.4020
Convolution                          2564       14526.0557           0.2260          13.2050           5.6654
CopyCPU2CPU                          1282           7.3450           0.0030           0.0360           0.0057
log_softmax                          1122          34.9290           0.0150           0.0550           0.0311
_backward_copy                       1122          57.7510           0.0220           0.0760           0.0515
_backward_Convolution                2244       20751.1172           2.6370          12.5610           9.2474
_mul_scalar                          1122           3.9920           0.0020           0.0230           0.0036
_backward_log_softmax                1122          19.0230           0.0090           0.0400           0.0170
mean                                 3526          67.5530           0.0080           0.0730           0.0192
_backward_mean                       1122          12.2740           0.0080           0.1030           0.0109
_backward_FullyConnected             3366         640.3210           0.0280           0.5940           0.1902
WaitForVar                           2404          21.4300           0.0060           0.0280           0.0089
broadcast_equal                      1282           6.3950           0.0030           0.0110           0.0050
sgd_update                          11220         110.5050           0.0020           0.0790           0.0098
_backward_Activation                 4488         333.2870           0.0070           0.3900           0.0743



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       43988       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3852        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             561        2218.5161           0.3060          73.5850           3.9546
MXNDArrayCreateEx                     642          21.9400           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      562       12192.5322           5.6130          24.9880          21.6949
MXNDArraySyncCopyToCPU               1204        9505.8604           0.1180          24.1980           7.8952
MXNDArrayGetDType                    1204           0.4270           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3050           1.4000           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1284          11.2570           0.0070           0.0280           0.0088
MXNDArrayFree                       14366         146.6230           0.0000           0.9140           0.0102
MXNet C API Calls                   64534         551.8910         487.3580         551.8910          32.2665
MXNet C API Concurrency            129067           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1124           0.5360           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5620           2.9220           0.0000           0.0230           0.0005
MXNDArraySetGradState                5620           2.8630           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1124           0.4770           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  562         305.4040           0.5250           0.6810           0.5434
MXNDArrayGetContext                  8908           3.8500           0.0000           0.0070           0.0004
MXImperativeInvokeEx                18702         475.1120           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2248        5510.2368           0.7010           3.7500           2.4512
FullyConnected                       3852         372.6730           0.0080           0.3430           0.0967
argmax                               1284          25.3520           0.0050           0.0480           0.0197
_backward_pick                       1124          17.7140           0.0130           0.0260           0.0158
_backward_mul_scalar                 1124           4.8520           0.0030           0.0160           0.0043
DeleteVariable                      47840         338.3810           0.0010           0.9010           0.0071
Flatten                              1284          53.2200           0.0080           0.1120           0.0414
Activation                           5136         239.5940           0.0030           1.9440           0.0466
SetValueOp                           1124           7.2250           0.0050           0.0180           0.0064
pick                                 1124           8.8170           0.0060           0.0280           0.0078
Pooling                              2568        3604.1509           0.0640           3.1720           1.4035
Convolution                          2568       14564.3945           0.2260          13.2050           5.6715
CopyCPU2CPU                          1284           7.3570           0.0030           0.0360           0.0057
log_softmax                          1124          35.0080           0.0150           0.0550           0.0311
_backward_copy                       1124          57.8690           0.0220           0.0760           0.0515
_backward_Convolution                2248       20794.2266           2.6370          12.5610           9.2501
_mul_scalar                          1124           4.0040           0.0020           0.0230           0.0036
_backward_log_softmax                1124          19.0720           0.0090           0.0400           0.0170
mean                                 3532          67.7120           0.0080           0.0730           0.0192
_backward_mean                       1124          12.3040           0.0080           0.1030           0.0109
_backward_FullyConnected             3372         642.0270           0.0280           0.5940           0.1904
WaitForVar                           2408          21.4740           0.0060           0.0280           0.0089
broadcast_equal                      1284           6.4110           0.0030           0.0110           0.0050
sgd_update                          11240         110.8070           0.0020           0.0790           0.0099
_backward_Activation                 4496         333.8920           0.0070           0.3900           0.0743



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       44062       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3858        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             562        2222.4089           0.3060          73.5850           3.9545
MXNDArrayCreateEx                     643          21.9740           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      563       12214.2861           5.6130          24.9880          21.6950
MXNDArraySyncCopyToCPU               1206        9520.2012           0.1180          24.1980           7.8940
MXNDArrayGetDType                    1206           0.4290           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3055           1.4030           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1286          11.2750           0.0070           0.0280           0.0088
MXNDArrayFree                       14389         146.8530           0.0000           0.9140           0.0102
MXNet C API Calls                   64641         551.9980         487.3580         551.9980          32.3200
MXNet C API Concurrency            129281           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1126           0.5360           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5630           2.9260           0.0000           0.0230           0.0005
MXNDArraySetGradState                5630           2.8660           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1126           0.4780           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  563         305.9340           0.5250           0.6810           0.5434
MXNDArrayGetContext                  8922           3.8540           0.0000           0.0070           0.0004
MXImperativeInvokeEx                18733         475.8960           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2252        5520.0010           0.7010           3.7500           2.4512
FullyConnected                       3858         373.2510           0.0080           0.3430           0.0967
argmax                               1286          25.3920           0.0050           0.0480           0.0197
_backward_pick                       1126          17.7460           0.0130           0.0260           0.0158
_backward_mul_scalar                 1126           4.8610           0.0030           0.0160           0.0043
DeleteVariable                      47920         338.9080           0.0010           0.9010           0.0071
Flatten                              1286          53.2980           0.0080           0.1120           0.0414
Activation                           5144         239.9420           0.0030           1.9440           0.0466
SetValueOp                           1126           7.2380           0.0050           0.0180           0.0064
pick                                 1126           8.8320           0.0060           0.0280           0.0078
Pooling                              2572        3609.5100           0.0640           3.1720           1.4034
Convolution                          2572       14586.5830           0.2260          13.2050           5.6713
CopyCPU2CPU                          1286           7.3670           0.0030           0.0360           0.0057
log_softmax                          1126          35.0680           0.0150           0.0550           0.0311
_backward_copy                       1126          57.9730           0.0220           0.0760           0.0515
_backward_Convolution                2252       20830.9883           2.6370          12.5610           9.2500
_mul_scalar                          1126           4.0120           0.0020           0.0230           0.0036
_backward_log_softmax                1126          19.1040           0.0090           0.0400           0.0170
mean                                 3538          67.8300           0.0080           0.0730           0.0192
_backward_mean                       1126          12.3260           0.0080           0.1030           0.0109
_backward_FullyConnected             3378         643.0940           0.0280           0.5940           0.1904
WaitForVar                           2412          21.5080           0.0060           0.0280           0.0089
broadcast_equal                      1286           6.4200           0.0030           0.0110           0.0050
sgd_update                          11260         111.0060           0.0020           0.0790           0.0099
_backward_Activation                 4504         334.4400           0.0070           0.3900           0.0743



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       44136       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3864        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             563        2226.3101           0.3060          73.5850           3.9544
MXNDArrayCreateEx                     644          22.0080           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      564       12235.9248           5.6130          24.9880          21.6949
MXNDArraySyncCopyToCPU               1208        9534.5576           0.1180          24.1980           7.8928
MXNDArrayGetDType                    1208           0.4290           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3060           1.4060           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1288          11.2920           0.0070           0.0280           0.0088
MXNDArrayFree                       14412         147.0770           0.0000           0.9140           0.0102
MXNet C API Calls                   64748         552.1050         487.3580         552.1050          32.3735
MXNet C API Concurrency            129495           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1128           0.5370           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5640           2.9300           0.0000           0.0230           0.0005
MXNDArraySetGradState                5640           2.8660           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1128           0.4800           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  564         306.4660           0.5250           0.6810           0.5434
MXNDArrayGetContext                  8936           3.8620           0.0000           0.0070           0.0004
MXImperativeInvokeEx                18764         476.6750           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2256        5529.6528           0.7010           3.7500           2.4511
FullyConnected                       3864         373.7720           0.0080           0.3430           0.0967
argmax                               1288          25.4300           0.0050           0.0480           0.0197
_backward_pick                       1128          17.7770           0.0130           0.0260           0.0158
_backward_mul_scalar                 1128           4.8690           0.0030           0.0160           0.0043
DeleteVariable                      48000         339.4390           0.0010           0.9010           0.0071
Flatten                              1288          53.3770           0.0080           0.1120           0.0414
Activation                           5152         240.2950           0.0030           1.9440           0.0466
SetValueOp                           1128           7.2500           0.0050           0.0180           0.0064
pick                                 1128           8.8470           0.0060           0.0280           0.0078
Pooling                              2576        3614.9060           0.0640           3.1720           1.4033
Convolution                          2576       14608.6934           0.2260          13.2050           5.6711
CopyCPU2CPU                          1288           7.3770           0.0030           0.0360           0.0057
log_softmax                          1128          35.1270           0.0150           0.0550           0.0311
_backward_copy                       1128          58.0750           0.0220           0.0760           0.0515
_backward_Convolution                2256       20867.7168           2.6370          12.5610           9.2499
_mul_scalar                          1128           4.0190           0.0020           0.0230           0.0036
_backward_log_softmax                1128          19.1350           0.0090           0.0400           0.0170
mean                                 3544          67.9440           0.0080           0.0730           0.0192
_backward_mean                       1128          12.3470           0.0080           0.1030           0.0109
_backward_FullyConnected             3384         644.1580           0.0280           0.5940           0.1904
WaitForVar                           2416          21.5420           0.0060           0.0280           0.0089
broadcast_equal                      1288           6.4300           0.0030           0.0110           0.0050
sgd_update                          11280         111.2070           0.0020           0.0790           0.0099
_backward_Activation                 4512         334.9870           0.0070           0.3900           0.0742



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       44210       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3870        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             564        2230.2090           0.3060          73.5850           3.9543
MXNDArrayCreateEx                     645          22.0410           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      565       12257.7529           5.6130          24.9880          21.6951
MXNDArraySyncCopyToCPU               1210        9548.9150           0.1180          24.1980           7.8917
MXNDArrayGetDType                    1210           0.4290           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3065           1.4070           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1290          11.3090           0.0070           0.0280           0.0088
MXNDArrayFree                       14435         147.3000           0.0000           0.9140           0.0102
MXNet C API Calls                   64855         552.2120         487.3580         552.2120          32.4270
MXNet C API Concurrency            129709           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1130           0.5370           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5650           2.9340           0.0000           0.0230           0.0005
MXNDArraySetGradState                5650           2.8700           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1130           0.4800           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  565         307.0010           0.5250           0.6810           0.5434
MXNDArrayGetContext                  8950           3.8710           0.0000           0.0070           0.0004
MXImperativeInvokeEx                18795         477.4460           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2260        5539.3379           0.7010           3.7500           2.4510
FullyConnected                       3870         374.3160           0.0080           0.3430           0.0967
argmax                               1290          25.4680           0.0050           0.0480           0.0197
_backward_pick                       1130          17.8080           0.0130           0.0260           0.0158
_backward_mul_scalar                 1130           4.8780           0.0030           0.0160           0.0043
DeleteVariable                      48080         339.9730           0.0010           0.9010           0.0071
Flatten                              1290          53.4540           0.0080           0.1120           0.0414
Activation                           5160         240.6470           0.0030           1.9440           0.0466
SetValueOp                           1130           7.2620           0.0050           0.0180           0.0064
pick                                 1130           8.8620           0.0060           0.0280           0.0078
Pooling                              2580        3620.2329           0.0640           3.1720           1.4032
Convolution                          2580       14630.8486           0.2260          13.2050           5.6709
CopyCPU2CPU                          1290           7.3870           0.0030           0.0360           0.0057
log_softmax                          1130          35.1860           0.0150           0.0550           0.0311
_backward_copy                       1130          58.1770           0.0220           0.0760           0.0515
_backward_Convolution                2260       20904.7070           2.6370          12.5610           9.2499
_mul_scalar                          1130           4.0260           0.0020           0.0230           0.0036
_backward_log_softmax                1130          19.1670           0.0090           0.0400           0.0170
mean                                 3550          68.0580           0.0080           0.0730           0.0192
_backward_mean                       1130          12.3680           0.0080           0.1030           0.0109
_backward_FullyConnected             3390         645.2210           0.0280           0.5940           0.1903
WaitForVar                           2420          21.5780           0.0060           0.0280           0.0089
broadcast_equal                      1290           6.4390           0.0030           0.0110           0.0050
sgd_update                          11300         111.4260           0.0020           0.0790           0.0099
_backward_Activation                 4520         335.5460           0.0070           0.3900           0.0742



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       44284       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3876        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             565        2234.0840           0.3060          73.5850           3.9541
MXNDArrayCreateEx                     646          22.0750           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      566       12282.7256           5.6130          24.9880          21.7009
MXNDArraySyncCopyToCPU               1212        9574.6533           0.1180          24.1980           7.8999
MXNDArrayGetDType                    1212           0.4310           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3070           1.4110           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1292          11.3270           0.0070           0.0280           0.0088
MXNDArrayFree                       14458         147.5300           0.0000           0.9140           0.0102
MXNet C API Calls                   64962         552.3190         487.3580         552.3190          32.4805
MXNet C API Concurrency            129923           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1132           0.5380           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5660           2.9400           0.0000           0.0230           0.0005
MXNDArraySetGradState                5660           2.8740           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1132           0.4810           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  566         307.5590           0.5250           0.6810           0.5434
MXNDArrayGetContext                  8964           3.8760           0.0000           0.0070           0.0004
MXImperativeInvokeEx                18826         478.2370           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2264        5550.3408           0.7010           3.7500           2.4516
FullyConnected                       3876         375.2010           0.0080           0.3430           0.0968
argmax                               1292          25.5230           0.0050           0.0480           0.0198
_backward_pick                       1132          17.8500           0.0130           0.0260           0.0158
_backward_mul_scalar                 1132           4.8940           0.0030           0.0160           0.0043
DeleteVariable                      48160         340.5760           0.0010           0.9010           0.0071
Flatten                              1292          53.5470           0.0080           0.1120           0.0414
Activation                           5168         241.0710           0.0030           1.9440           0.0466
SetValueOp                           1132           7.2810           0.0050           0.0180           0.0064
pick                                 1132           8.8840           0.0060           0.0280           0.0078
Pooling                              2584        3629.7629           0.0640           3.1720           1.4047
Convolution                          2584       14669.2891           0.2260          13.2050           5.6770
CopyCPU2CPU                          1292           7.3990           0.0030           0.0360           0.0057
log_softmax                          1132          35.2640           0.0150           0.0550           0.0312
_backward_copy                       1132          58.2970           0.0220           0.0760           0.0515
_backward_Convolution                2264       20947.9609           2.6370          12.5610           9.2526
_mul_scalar                          1132           4.0380           0.0020           0.0230           0.0036
_backward_log_softmax                1132          19.2150           0.0090           0.0400           0.0170
mean                                 3556          68.2160           0.0080           0.0730           0.0192
_backward_mean                       1132          12.3990           0.0080           0.1030           0.0110
_backward_FullyConnected             3396         646.9680           0.0280           0.5940           0.1905
WaitForVar                           2424          21.6250           0.0060           0.0280           0.0089
broadcast_equal                      1292           6.4550           0.0030           0.0110           0.0050
sgd_update                          11320         111.7210           0.0020           0.0790           0.0099
_backward_Activation                 4528         336.1440           0.0070           0.3900           0.0742



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       44358       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3882        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             566        2238.0220           0.3060          73.5850           3.9541
MXNDArrayCreateEx                     647          22.1090           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      567       12304.3496           5.6130          24.9880          21.7008
MXNDArraySyncCopyToCPU               1214        9589.0381           0.1180          24.1980           7.8987
MXNDArrayGetDType                    1214           0.4320           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3075           1.4120           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1294          11.3440           0.0070           0.0280           0.0088
MXNDArrayFree                       14481         147.7480           0.0000           0.9140           0.0102
MXNet C API Calls                   65069         552.4260         487.3580         552.4260          32.5340
MXNet C API Concurrency            130137           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1134           0.5390           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5670           2.9450           0.0000           0.0230           0.0005
MXNDArraySetGradState                5670           2.8800           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1134           0.4820           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  567         308.0920           0.5250           0.6810           0.5434
MXNDArrayGetContext                  8978           3.8830           0.0000           0.0070           0.0004
MXImperativeInvokeEx                18857         479.0220           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2268        5559.9321           0.7010           3.7500           2.4515
FullyConnected                       3882         375.7240           0.0080           0.3430           0.0968
argmax                               1294          25.5610           0.0050           0.0480           0.0198
_backward_pick                       1134          17.8810           0.0130           0.0260           0.0158
_backward_mul_scalar                 1134           4.9030           0.0030           0.0160           0.0043
DeleteVariable                      48240         341.1090           0.0010           0.9010           0.0071
Flatten                              1294          53.6250           0.0080           0.1120           0.0414
Activation                           5176         241.4230           0.0030           1.9440           0.0466
SetValueOp                           1134           7.2940           0.0050           0.0180           0.0064
pick                                 1134           8.8990           0.0060           0.0280           0.0078
Pooling                              2588        3635.1470           0.0640           3.1720           1.4046
Convolution                          2588       14691.4912           0.2260          13.2050           5.6768
CopyCPU2CPU                          1294           7.4090           0.0030           0.0360           0.0057
log_softmax                          1134          35.3250           0.0150           0.0550           0.0312
_backward_copy                       1134          58.4010           0.0220           0.0760           0.0515
_backward_Convolution                2268       20984.6953           2.6370          12.5610           9.2525
_mul_scalar                          1134           4.0460           0.0020           0.0230           0.0036
_backward_log_softmax                1134          19.2460           0.0090           0.0400           0.0170
mean                                 3562          68.3340           0.0080           0.0730           0.0192
_backward_mean                       1134          12.4210           0.0080           0.1030           0.0110
_backward_FullyConnected             3402         648.0390           0.0280           0.5940           0.1905
WaitForVar                           2428          21.6600           0.0060           0.0280           0.0089
broadcast_equal                      1294           6.4650           0.0030           0.0110           0.0050
sgd_update                          11340         111.9240           0.0020           0.0790           0.0099
_backward_Activation                 4536         336.6940           0.0070           0.3900           0.0742



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       44432       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3888        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             567        2241.9260           0.3060          73.5850           3.9540
MXNDArrayCreateEx                     648          22.1420           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      568       12326.0391           5.6130          24.9880          21.7008
MXNDArraySyncCopyToCPU               1216        9603.3818           0.1180          24.1980           7.8975
MXNDArrayGetDType                    1216           0.4330           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3080           1.4160           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1296          11.3610           0.0070           0.0280           0.0088
MXNDArrayFree                       14504         147.9680           0.0000           0.9140           0.0102
MXNet C API Calls                   65176         552.5330         487.3580         552.5330          32.5875
MXNet C API Concurrency            130351           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1136           0.5410           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5680           2.9510           0.0000           0.0230           0.0005
MXNDArraySetGradState                5680           2.8840           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1136           0.4820           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  568         308.6220           0.5250           0.6810           0.5433
MXNDArrayGetContext                  8992           3.8910           0.0000           0.0070           0.0004
MXImperativeInvokeEx                18888         479.7950           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2272        5569.6528           0.7010           3.7500           2.4514
FullyConnected                       3888         376.2770           0.0080           0.3430           0.0968
argmax                               1296          25.5980           0.0050           0.0480           0.0198
_backward_pick                       1136          17.9120           0.0130           0.0260           0.0158
_backward_mul_scalar                 1136           4.9120           0.0030           0.0160           0.0043
DeleteVariable                      48320         341.6420           0.0010           0.9010           0.0071
Flatten                              1296          53.7030           0.0080           0.1120           0.0414
Activation                           5184         241.7750           0.0030           1.9440           0.0466
SetValueOp                           1136           7.3120           0.0050           0.0180           0.0064
pick                                 1136           8.9140           0.0060           0.0280           0.0078
Pooling                              2592        3640.5139           0.0640           3.1720           1.4045
Convolution                          2592       14713.5654           0.2260          13.2050           5.6765
CopyCPU2CPU                          1296           7.4200           0.0030           0.0360           0.0057
log_softmax                          1136          35.3850           0.0150           0.0550           0.0311
_backward_copy                       1136          58.5040           0.0220           0.0760           0.0515
_backward_Convolution                2272       21021.4102           2.6370          12.5610           9.2524
_mul_scalar                          1136           4.0540           0.0020           0.0230           0.0036
_backward_log_softmax                1136          19.2780           0.0090           0.0400           0.0170
mean                                 3568          68.4500           0.0080           0.0730           0.0192
_backward_mean                       1136          12.4420           0.0080           0.1030           0.0110
_backward_FullyConnected             3408         649.1120           0.0280           0.5940           0.1905
WaitForVar                           2432          21.6950           0.0060           0.0280           0.0089
broadcast_equal                      1296           6.4740           0.0030           0.0110           0.0050
sgd_update                          11360         112.0740           0.0020           0.0790           0.0099
_backward_Activation                 4544         337.3170           0.0070           0.3900           0.0742



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       44506       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3894        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             568        2245.8159           0.3060          73.5850           3.9539
MXNDArrayCreateEx                     649          22.1750           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      569       12347.8779           5.6130          24.9880          21.7010
MXNDArraySyncCopyToCPU               1218        9617.7324           0.1180          24.1980           7.8963
MXNDArrayGetDType                    1218           0.4330           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3085           1.4190           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1298          11.3780           0.0070           0.0280           0.0088
MXNDArrayFree                       14527         148.1910           0.0000           0.9140           0.0102
MXNet C API Calls                   65283         552.6400         487.3580         552.6400          32.6410
MXNet C API Concurrency            130565           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1138           0.5420           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5690           2.9560           0.0000           0.0230           0.0005
MXNDArraySetGradState                5690           2.8890           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1138           0.4820           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  569         309.1530           0.5250           0.6810           0.5433
MXNDArrayGetContext                  9006           3.8990           0.0000           0.0070           0.0004
MXImperativeInvokeEx                18919         480.5640           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2276        5579.3599           0.7010           3.7500           2.4514
FullyConnected                       3894         376.8450           0.0080           0.3430           0.0968
argmax                               1298          25.6380           0.0050           0.0480           0.0198
_backward_pick                       1138          17.9430           0.0130           0.0260           0.0158
_backward_mul_scalar                 1138           4.9200           0.0030           0.0160           0.0043
DeleteVariable                      48400         342.1580           0.0010           0.9010           0.0071
Flatten                              1298          53.7820           0.0080           0.1120           0.0414
Activation                           5192         242.1290           0.0030           1.9440           0.0466
SetValueOp                           1138           7.3260           0.0050           0.0180           0.0064
pick                                 1138           8.9290           0.0060           0.0280           0.0078
Pooling                              2596        3645.8650           0.0640           3.1720           1.4044
Convolution                          2596       14735.7178           0.2260          13.2050           5.6763
CopyCPU2CPU                          1298           7.4300           0.0030           0.0360           0.0057
log_softmax                          1138          35.4450           0.0150           0.0550           0.0311
_backward_copy                       1138          58.6050           0.0220           0.0760           0.0515
_backward_Convolution                2276       21058.4395           2.6370          12.5610           9.2524
_mul_scalar                          1138           4.0610           0.0020           0.0230           0.0036
_backward_log_softmax                1138          19.3090           0.0090           0.0400           0.0170
mean                                 3574          68.5660           0.0080           0.0730           0.0192
_backward_mean                       1138          12.4620           0.0080           0.1030           0.0110
_backward_FullyConnected             3414         650.1840           0.0280           0.5940           0.1904
WaitForVar                           2436          21.7290           0.0060           0.0280           0.0089
broadcast_equal                      1298           6.4830           0.0030           0.0110           0.0050
sgd_update                          11380         112.2770           0.0020           0.0790           0.0099
_backward_Activation                 4552         337.8780           0.0070           0.3900           0.0742



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       44580       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3900        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             569        2249.7261           0.3060          73.5850           3.9538
MXNDArrayCreateEx                     650          22.2090           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      570       12372.6982           5.6130          24.9880          21.7065
MXNDArraySyncCopyToCPU               1220        9643.8740           0.1180          24.1980           7.9048
MXNDArrayGetDType                    1220           0.4340           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3090           1.4210           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1300          11.3950           0.0070           0.0280           0.0088
MXNDArrayFree                       14550         148.4150           0.0000           0.9140           0.0102
MXNet C API Calls                   65390         552.7470         487.3580         552.7470          32.6945
MXNet C API Concurrency            130779           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1140           0.5430           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5700           2.9620           0.0000           0.0230           0.0005
MXNDArraySetGradState                5700           2.8910           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1140           0.4830           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  570         309.6860           0.5250           0.6810           0.5433
MXNDArrayGetContext                  9020           3.9050           0.0000           0.0070           0.0004
MXImperativeInvokeEx                18950         481.3470           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2280        5590.3501           0.7010           3.7500           2.4519
FullyConnected                       3900         377.7280           0.0080           0.3430           0.0969
argmax                               1300          25.6910           0.0050           0.0480           0.0198
_backward_pick                       1140          17.9840           0.0130           0.0260           0.0158
_backward_mul_scalar                 1140           4.9330           0.0030           0.0160           0.0043
DeleteVariable                      48480         342.7340           0.0010           0.9010           0.0071
Flatten                              1300          53.8760           0.0080           0.1120           0.0414
Activation                           5200         242.5540           0.0030           1.9440           0.0466
SetValueOp                           1140           7.3440           0.0050           0.0180           0.0064
pick                                 1140           8.9520           0.0060           0.0280           0.0079
Pooling                              2600        3655.4290           0.0640           3.1720           1.4059
Convolution                          2600       14774.0752           0.2260          13.2050           5.6823
CopyCPU2CPU                          1300           7.4420           0.0030           0.0360           0.0057
log_softmax                          1140          35.5230           0.0150           0.0550           0.0312
_backward_copy                       1140          58.7250           0.0220           0.0760           0.0515
_backward_Convolution                2280       21101.4160           2.6370          12.5610           9.2550
_mul_scalar                          1140           4.0720           0.0020           0.0230           0.0036
_backward_log_softmax                1140          19.3570           0.0090           0.0400           0.0170
mean                                 3580          68.7200           0.0080           0.0730           0.0192
_backward_mean                       1140          12.4930           0.0080           0.1030           0.0110
_backward_FullyConnected             3420         651.8970           0.0280           0.5940           0.1906
WaitForVar                           2440          21.7730           0.0060           0.0280           0.0089
broadcast_equal                      1300           6.4990           0.0030           0.0110           0.0050
sgd_update                          11400         112.5760           0.0020           0.0790           0.0099
_backward_Activation                 4560         338.4570           0.0070           0.3900           0.0742



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       44654       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3906        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             570        2250.1990           0.3060          73.5850           3.9477
MXNDArrayCreateEx                     651          22.2430           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      571       12394.3711           5.6130          24.9880          21.7064
MXNDArraySyncCopyToCPU               1222        9658.0674           0.1180          24.1980           7.9035
MXNDArrayGetDType                    1222           0.4340           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3095           1.4250           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1302          11.4130           0.0070           0.0280           0.0088
MXNDArrayFree                       14573         148.6470           0.0000           0.9140           0.0102
MXNet C API Calls                   65497         552.8540         487.3580         552.8540          32.7480
MXNet C API Concurrency            130993           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1142           0.5440           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5710           2.9660           0.0000           0.0230           0.0005
MXNDArraySetGradState                5710           2.8970           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1142           0.4850           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  571         310.2440           0.5250           0.6810           0.5433
MXNDArrayGetContext                  9034           3.9110           0.0000           0.0070           0.0004
MXImperativeInvokeEx                18981         482.1740           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2284        5599.9678           0.7010           3.7500           2.4518
FullyConnected                       3906         378.2660           0.0080           0.3430           0.0968
argmax                               1302          25.7290           0.0050           0.0480           0.0198
_backward_pick                       1142          18.0150           0.0130           0.0260           0.0158
_backward_mul_scalar                 1142           4.9420           0.0030           0.0160           0.0043
DeleteVariable                      48560         343.2840           0.0010           0.9010           0.0071
Flatten                              1302          53.9550           0.0080           0.1120           0.0414
Activation                           5208         242.9050           0.0030           1.9440           0.0466
SetValueOp                           1142           7.3580           0.0050           0.0180           0.0064
pick                                 1142           8.9670           0.0060           0.0280           0.0079
Pooling                              2604        3660.7749           0.0640           3.1720           1.4058
Convolution                          2604       14796.2686           0.2260          13.2050           5.6821
CopyCPU2CPU                          1302           7.4530           0.0030           0.0360           0.0057
log_softmax                          1142          35.5830           0.0150           0.0550           0.0312
_backward_copy                       1142          58.8290           0.0220           0.0760           0.0515
_backward_Convolution                2284       21138.1641           2.6370          12.5610           9.2549
_mul_scalar                          1142           4.0800           0.0020           0.0230           0.0036
_backward_log_softmax                1142          19.3890           0.0090           0.0400           0.0170
mean                                 3586          68.8410           0.0080           0.0730           0.0192
_backward_mean                       1142          12.5150           0.0080           0.1030           0.0110
_backward_FullyConnected             3426         653.0050           0.0280           0.5940           0.1906
WaitForVar                           2444          21.8060           0.0060           0.0280           0.0089
broadcast_equal                      1302           6.5080           0.0030           0.0110           0.0050
sgd_update                          11420         112.7760           0.0020           0.0790           0.0099
_backward_Activation                 4568         339.0080           0.0070           0.3900           0.0742



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       44728       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3912        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             571        2254.0920           0.3060          73.5850           3.9476
MXNDArrayCreateEx                     652          22.2760           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      572       12416.0254           5.6130          24.9880          21.7063
MXNDArraySyncCopyToCPU               1224        9672.4346           0.1180          24.1980           7.9023
MXNDArrayGetDType                    1224           0.4340           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3100           1.4270           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1304          11.4310           0.0070           0.0280           0.0088
MXNDArrayFree                       14596         148.8760           0.0000           0.9140           0.0102
MXNet C API Calls                   65604         552.9610         487.3580         552.9610          32.8015
MXNet C API Concurrency            131207           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1144           0.5440           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5720           2.9710           0.0000           0.0230           0.0005
MXNDArraySetGradState                5720           2.9030           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1144           0.4860           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  572         310.8070           0.5250           0.6810           0.5434
MXNDArrayGetContext                  9048           3.9190           0.0000           0.0070           0.0004
MXImperativeInvokeEx                19012         482.9490           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2288        5609.5991           0.7010           3.7500           2.4517
FullyConnected                       3912         378.8170           0.0080           0.3430           0.0968
argmax                               1304          25.7680           0.0050           0.0480           0.0198
_backward_pick                       1144          18.0450           0.0130           0.0260           0.0158
_backward_mul_scalar                 1144           4.9500           0.0030           0.0160           0.0043
DeleteVariable                      48640         343.8120           0.0010           0.9010           0.0071
Flatten                              1304          54.0360           0.0080           0.1120           0.0414
Activation                           5216         243.2580           0.0030           1.9440           0.0466
SetValueOp                           1144           7.3710           0.0050           0.0180           0.0064
pick                                 1144           8.9830           0.0060           0.0280           0.0079
Pooling                              2608        3666.1880           0.0640           3.1720           1.4057
Convolution                          2608       14818.3379           0.2260          13.2050           5.6819
CopyCPU2CPU                          1304           7.4630           0.0030           0.0360           0.0057
log_softmax                          1144          35.6420           0.0150           0.0550           0.0312
_backward_copy                       1144          58.9320           0.0220           0.0760           0.0515
_backward_Convolution                2288       21174.9258           2.6370          12.5610           9.2548
_mul_scalar                          1144           4.0870           0.0020           0.0230           0.0036
_backward_log_softmax                1144          19.4200           0.0090           0.0400           0.0170
mean                                 3592          68.9620           0.0080           0.0730           0.0192
_backward_mean                       1144          12.5350           0.0080           0.1030           0.0110
_backward_FullyConnected             3432         654.0720           0.0280           0.5940           0.1906
WaitForVar                           2448          21.8380           0.0060           0.0280           0.0089
broadcast_equal                      1304           6.5170           0.0030           0.0110           0.0050
sgd_update                          11440         112.9770           0.0020           0.0790           0.0099
_backward_Activation                 4576         339.5990           0.0070           0.3900           0.0742



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       44802       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3918        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             572        2258.0090           0.3060          73.5850           3.9476
MXNDArrayCreateEx                     653          22.3090           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      573       12437.8682           5.6130          24.9880          21.7066
MXNDArraySyncCopyToCPU               1226        9686.8281           0.1180          24.1980           7.9012
MXNDArrayGetDType                    1226           0.4350           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3105           1.4270           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1306          11.4480           0.0070           0.0280           0.0088
MXNDArrayFree                       14619         149.0990           0.0000           0.9140           0.0102
MXNet C API Calls                   65711         553.0680         487.3580         553.0680          32.8550
MXNet C API Concurrency            131421           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1146           0.5440           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5730           2.9730           0.0000           0.0230           0.0005
MXNDArraySetGradState                5730           2.9070           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1146           0.4860           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  573         311.3370           0.5250           0.6810           0.5433
MXNDArrayGetContext                  9062           3.9260           0.0000           0.0070           0.0004
MXImperativeInvokeEx                19043         483.7380           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2292        5619.3408           0.7010           3.7500           2.4517
FullyConnected                       3918         379.3500           0.0080           0.3430           0.0968
argmax                               1306          25.8060           0.0050           0.0480           0.0198
_backward_pick                       1146          18.0760           0.0130           0.0260           0.0158
_backward_mul_scalar                 1146           4.9590           0.0030           0.0160           0.0043
DeleteVariable                      48720         344.3410           0.0010           0.9010           0.0071
Flatten                              1306          54.1140           0.0080           0.1120           0.0414
Activation                           5224         243.6080           0.0030           1.9440           0.0466
SetValueOp                           1146           7.3840           0.0050           0.0180           0.0064
pick                                 1146           9.0000           0.0060           0.0280           0.0079
Pooling                              2612        3671.5371           0.0640           3.1720           1.4056
Convolution                          2612       14840.4961           0.2260          13.2050           5.6817
CopyCPU2CPU                          1306           7.4730           0.0030           0.0360           0.0057
log_softmax                          1146          35.7010           0.0150           0.0550           0.0312
_backward_copy                       1146          59.0350           0.0220           0.0760           0.0515
_backward_Convolution                2292       21211.9746           2.6370          12.5610           9.2548
_mul_scalar                          1146           4.0950           0.0020           0.0230           0.0036
_backward_log_softmax                1146          19.4520           0.0090           0.0400           0.0170
mean                                 3598          69.0770           0.0080           0.0730           0.0192
_backward_mean                       1146          12.5570           0.0080           0.1030           0.0110
_backward_FullyConnected             3438         655.1390           0.0280           0.5940           0.1906
WaitForVar                           2452          21.8740           0.0060           0.0280           0.0089
broadcast_equal                      1306           6.5270           0.0030           0.0110           0.0050
sgd_update                          11460         113.1250           0.0020           0.0790           0.0099
_backward_Activation                 4584         340.2150           0.0070           0.3900           0.0742



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       44876       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3924        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             573        2261.9050           0.3060          73.5850           3.9475
MXNDArrayCreateEx                     654          22.3420           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      574       12459.7168           5.6130          24.9880          21.7068
MXNDArraySyncCopyToCPU               1228        9701.2080           0.1180          24.1980           7.9000
MXNDArrayGetDType                    1228           0.4350           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3110           1.4290           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1308          11.4660           0.0070           0.0280           0.0088
MXNDArrayFree                       14642         149.3270           0.0000           0.9140           0.0102
MXNet C API Calls                   65818         553.1750         487.3580         553.1750          32.9085
MXNet C API Concurrency            131635           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1148           0.5450           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5740           2.9790           0.0000           0.0230           0.0005
MXNDArraySetGradState                5740           2.9100           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1148           0.4860           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  574         311.8680           0.5250           0.6810           0.5433
MXNDArrayGetContext                  9076           3.9300           0.0000           0.0070           0.0004
MXImperativeInvokeEx                19074         484.5150           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2296        5628.9922           0.7010           3.7500           2.4517
FullyConnected                       3924         379.8680           0.0080           0.3430           0.0968
argmax                               1308          25.8430           0.0050           0.0480           0.0198
_backward_pick                       1148          18.1080           0.0130           0.0260           0.0158
_backward_mul_scalar                 1148           4.9670           0.0030           0.0160           0.0043
DeleteVariable                      48800         344.8710           0.0010           0.9010           0.0071
Flatten                              1308          54.1910           0.0080           0.1120           0.0414
Activation                           5232         244.0010           0.0030           1.9440           0.0466
SetValueOp                           1148           7.3970           0.0050           0.0180           0.0064
pick                                 1148           9.0150           0.0060           0.0280           0.0079
Pooling                              2616        3676.8840           0.0640           3.1720           1.4055
Convolution                          2616       14862.7305           0.2260          13.2050           5.6815
CopyCPU2CPU                          1308           7.4830           0.0030           0.0360           0.0057
log_softmax                          1148          35.7600           0.0150           0.0550           0.0311
_backward_copy                       1148          59.1400           0.0220           0.0760           0.0515
_backward_Convolution                2296       21249.0859           2.6370          12.5610           9.2548
_mul_scalar                          1148           4.1020           0.0020           0.0230           0.0036
_backward_log_softmax                1148          19.4840           0.0090           0.0400           0.0170
mean                                 3604          69.1920           0.0080           0.0730           0.0192
_backward_mean                       1148          12.5780           0.0080           0.1030           0.0110
_backward_FullyConnected             3444         656.2030           0.0280           0.5940           0.1905
WaitForVar                           2456          21.9090           0.0060           0.0280           0.0089
broadcast_equal                      1308           6.5370           0.0030           0.0110           0.0050
sgd_update                          11480         113.3280           0.0020           0.0790           0.0099
_backward_Activation                 4592         340.7610           0.0070           0.3900           0.0742



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       44950       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3930        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             574        2265.8069           0.3060          73.5850           3.9474
MXNDArrayCreateEx                     655          22.3760           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      575       12481.3604           5.6130          24.9880          21.7067
MXNDArraySyncCopyToCPU               1230        9715.5840           0.1180          24.1980           7.8988
MXNDArrayGetDType                    1230           0.4370           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3115           1.4330           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1310          11.4830           0.0070           0.0280           0.0088
MXNDArrayFree                       14665         149.5470           0.0000           0.9140           0.0102
MXNet C API Calls                   65925         553.2820         487.3580         553.2820          32.9620
MXNet C API Concurrency            131849           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1150           0.5460           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5750           2.9840           0.0000           0.0230           0.0005
MXNDArraySetGradState                5750           2.9160           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1150           0.4870           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  575         312.4020           0.5250           0.6810           0.5433
MXNDArrayGetContext                  9090           3.9350           0.0000           0.0070           0.0004
MXImperativeInvokeEx                19105         485.2940           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2300        5638.5962           0.7010           3.7500           2.4516
FullyConnected                       3930         380.4100           0.0080           0.3430           0.0968
argmax                               1310          25.8800           0.0050           0.0480           0.0198
_backward_pick                       1150          18.1390           0.0130           0.0260           0.0158
_backward_mul_scalar                 1150           4.9750           0.0030           0.0160           0.0043
DeleteVariable                      48880         345.3870           0.0010           0.9010           0.0071
Flatten                              1310          54.2700           0.0080           0.1120           0.0414
Activation                           5240         244.3520           0.0030           1.9440           0.0466
SetValueOp                           1150           7.4090           0.0050           0.0180           0.0064
pick                                 1150           9.0300           0.0060           0.0280           0.0079
Pooling                              2620        3682.2749           0.0640           3.1720           1.4054
Convolution                          2620       14884.9424           0.2260          13.2050           5.6813
CopyCPU2CPU                          1310           7.4930           0.0030           0.0360           0.0057
log_softmax                          1150          35.8250           0.0150           0.0550           0.0312
_backward_copy                       1150          59.2430           0.0220           0.0760           0.0515
_backward_Convolution                2300       21285.8027           2.6370          12.5610           9.2547
_mul_scalar                          1150           4.1090           0.0020           0.0230           0.0036
_backward_log_softmax                1150          19.5150           0.0090           0.0400           0.0170
mean                                 3610          69.3030           0.0080           0.0730           0.0192
_backward_mean                       1150          12.5990           0.0080           0.1030           0.0110
_backward_FullyConnected             3450         657.2650           0.0280           0.5940           0.1905
WaitForVar                           2460          21.9430           0.0060           0.0280           0.0089
broadcast_equal                      1310           6.5460           0.0030           0.0110           0.0050
sgd_update                          11500         113.4740           0.0020           0.0790           0.0099
_backward_Activation                 4600         341.3850           0.0070           0.3900           0.0742



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       45024       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3936        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             575        2269.7019           0.3060          73.5850           3.9473
MXNDArrayCreateEx                     656          22.4100           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      576       12503.0898           5.6130          24.9880          21.7068
MXNDArraySyncCopyToCPU               1232        9729.8506           0.1180          24.1980           7.8976
MXNDArrayGetDType                    1232           0.4390           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3120           1.4360           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1312          11.4990           0.0070           0.0280           0.0088
MXNDArrayFree                       14688         149.7770           0.0000           0.9140           0.0102
MXNet C API Calls                   66032         553.3890         487.3580         553.3890          33.0155
MXNet C API Concurrency            132063           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1152           0.5460           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5760           2.9870           0.0000           0.0230           0.0005
MXNDArraySetGradState                5760           2.9210           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1152           0.4880           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  576         312.9350           0.5250           0.6810           0.5433
MXNDArrayGetContext                  9104           3.9430           0.0000           0.0070           0.0004
MXImperativeInvokeEx                19136         486.0700           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2304        5648.3472           0.7010           3.7500           2.4515
FullyConnected                       3936         380.9300           0.0080           0.3430           0.0968
argmax                               1312          25.9180           0.0050           0.0480           0.0198
_backward_pick                       1152          18.1690           0.0130           0.0260           0.0158
_backward_mul_scalar                 1152           4.9840           0.0030           0.0160           0.0043
DeleteVariable                      48960         345.9250           0.0010           0.9010           0.0071
Flatten                              1312          54.3470           0.0080           0.1120           0.0414
Activation                           5248         244.7030           0.0030           1.9440           0.0466
SetValueOp                           1152           7.4220           0.0050           0.0180           0.0064
pick                                 1152           9.0450           0.0060           0.0280           0.0079
Pooling                              2624        3687.6179           0.0640           3.1720           1.4053
Convolution                          2624       14907.0000           0.2260          13.2050           5.6810
CopyCPU2CPU                          1312           7.5030           0.0030           0.0360           0.0057
log_softmax                          1152          35.8850           0.0150           0.0550           0.0312
_backward_copy                       1152          59.3470           0.0220           0.0760           0.0515
_backward_Convolution                2304       21322.5996           2.6370          12.5610           9.2546
_mul_scalar                          1152           4.1160           0.0020           0.0230           0.0036
_backward_log_softmax                1152          19.5470           0.0090           0.0400           0.0170
mean                                 3616          69.4150           0.0080           0.0730           0.0192
_backward_mean                       1152          12.6200           0.0080           0.1030           0.0110
_backward_FullyConnected             3456         658.3280           0.0280           0.5940           0.1905
WaitForVar                           2464          21.9800           0.0060           0.0280           0.0089
broadcast_equal                      1312           6.5550           0.0030           0.0110           0.0050
sgd_update                          11520         113.6720           0.0020           0.0790           0.0099
_backward_Activation                 4608         341.9630           0.0070           0.3900           0.0742



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       45098       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3942        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             576        2273.6121           0.3060          73.5850           3.9472
MXNDArrayCreateEx                     657          22.4430           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      577       12525.0332           5.6130          24.9880          21.7072
MXNDArraySyncCopyToCPU               1234        9744.2090           0.1180          24.1980           7.8964
MXNDArrayGetDType                    1234           0.4390           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3125           1.4370           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1314          11.5180           0.0070           0.0280           0.0088
MXNDArrayFree                       14711         150.0040           0.0000           0.9140           0.0102
MXNet C API Calls                   66139         553.4960         487.3580         553.4960          33.0690
MXNet C API Concurrency            132277           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1154           0.5470           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5770           2.9900           0.0000           0.0230           0.0005
MXNDArraySetGradState                5770           2.9270           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1154           0.4880           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  577         313.4990           0.5250           0.6810           0.5433
MXNDArrayGetContext                  9118           3.9500           0.0000           0.0070           0.0004
MXImperativeInvokeEx                19167         486.8510           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2308        5658.1802           0.7010           3.7500           2.4516
FullyConnected                       3942         381.4520           0.0080           0.3430           0.0968
argmax                               1314          25.9550           0.0050           0.0480           0.0198
_backward_pick                       1154          18.2000           0.0130           0.0260           0.0158
_backward_mul_scalar                 1154           4.9920           0.0030           0.0160           0.0043
DeleteVariable                      49040         346.4540           0.0010           0.9010           0.0071
Flatten                              1314          54.4280           0.0080           0.1120           0.0414
Activation                           5256         245.0550           0.0030           1.9440           0.0466
SetValueOp                           1154           7.4350           0.0050           0.0180           0.0064
pick                                 1154           9.0600           0.0060           0.0280           0.0079
Pooling                              2628        3693.0259           0.0640           3.1720           1.4053
Convolution                          2628       14929.1631           0.2260          13.2050           5.6808
CopyCPU2CPU                          1314           7.5120           0.0030           0.0360           0.0057
log_softmax                          1154          35.9440           0.0150           0.0550           0.0311
_backward_copy                       1154          59.4490           0.0220           0.0760           0.0515
_backward_Convolution                2308       21359.6797           2.6370          12.5610           9.2546
_mul_scalar                          1154           4.1230           0.0020           0.0230           0.0036
_backward_log_softmax                1154          19.5790           0.0090           0.0400           0.0170
mean                                 3622          69.5290           0.0080           0.0730           0.0192
_backward_mean                       1154          12.6410           0.0080           0.1030           0.0110
_backward_FullyConnected             3462         659.3960           0.0280           0.5940           0.1905
WaitForVar                           2468          22.0160           0.0060           0.0280           0.0089
broadcast_equal                      1314           6.5650           0.0030           0.0110           0.0050
sgd_update                          11540         113.8220           0.0020           0.0790           0.0099
_backward_Activation                 4616         342.5890           0.0070           0.3900           0.0742



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       45172       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3948        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             577        2277.5120           0.3060          73.5850           3.9472
MXNDArrayCreateEx                     658          22.4770           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      578       12546.9287           5.6130          24.9880          21.7075
MXNDArraySyncCopyToCPU               1236        9758.5938           0.1180          24.1980           7.8953
MXNDArrayGetDType                    1236           0.4400           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3130           1.4380           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1316          11.5340           0.0070           0.0280           0.0088
MXNDArrayFree                       14734         150.2320           0.0000           0.9140           0.0102
MXNet C API Calls                   66246         553.6030         487.3580         553.6030          33.1225
MXNet C API Concurrency            132491           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1156           0.5470           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5780           2.9970           0.0000           0.0230           0.0005
MXNDArraySetGradState                5780           2.9320           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1156           0.4890           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  578         314.0280           0.5250           0.6810           0.5433
MXNDArrayGetContext                  9132           3.9560           0.0000           0.0070           0.0004
MXImperativeInvokeEx                19198         487.6460           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2312        5667.9282           0.7010           3.7500           2.4515
FullyConnected                       3948         381.9710           0.0080           0.3430           0.0968
argmax                               1316          25.9920           0.0050           0.0480           0.0198
_backward_pick                       1156          18.2310           0.0130           0.0260           0.0158
_backward_mul_scalar                 1156           5.0010           0.0030           0.0160           0.0043
DeleteVariable                      49120         347.0030           0.0010           0.9010           0.0071
Flatten                              1316          54.5060           0.0080           0.1120           0.0414
Activation                           5264         245.4080           0.0030           1.9440           0.0466
SetValueOp                           1156           7.4470           0.0050           0.0180           0.0064
pick                                 1156           9.0750           0.0060           0.0280           0.0079
Pooling                              2632        3698.4260           0.0640           3.1720           1.4052
Convolution                          2632       14951.3496           0.2260          13.2050           5.6806
CopyCPU2CPU                          1316           7.5210           0.0030           0.0360           0.0057
log_softmax                          1156          36.0040           0.0150           0.0550           0.0311
_backward_copy                       1156          59.5510           0.0220           0.0760           0.0515
_backward_Convolution                2312       21396.8223           2.6370          12.5610           9.2547
_mul_scalar                          1156           4.1300           0.0020           0.0230           0.0036
_backward_log_softmax                1156          19.6100           0.0090           0.0400           0.0170
mean                                 3628          69.6400           0.0080           0.0730           0.0192
_backward_mean                       1156          12.6620           0.0080           0.1030           0.0110
_backward_FullyConnected             3468         660.4600           0.0280           0.5940           0.1904
WaitForVar                           2472          22.0510           0.0060           0.0280           0.0089
broadcast_equal                      1316           6.5740           0.0030           0.0110           0.0050
sgd_update                          11560         113.9680           0.0020           0.0790           0.0099
_backward_Activation                 4624         343.1990           0.0070           0.3900           0.0742



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       45246       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3954        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             578        2281.4131           0.3060          73.5850           3.9471
MXNDArrayCreateEx                     659          22.5100           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      579       12568.6787           5.6130          24.9880          21.7076
MXNDArraySyncCopyToCPU               1238        9772.9688           0.1180          24.1980           7.8942
MXNDArrayGetDType                    1238           0.4410           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3135           1.4430           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1318          11.5510           0.0070           0.0280           0.0088
MXNDArrayFree                       14757         150.4600           0.0000           0.9140           0.0102
MXNet C API Calls                   66353         553.7100         487.3580         553.7100          33.1760
MXNet C API Concurrency            132705           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1158           0.5470           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5790           3.0050           0.0000           0.0230           0.0005
MXNDArraySetGradState                5790           2.9340           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1158           0.4890           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  579         314.5600           0.5250           0.6810           0.5433
MXNDArrayGetContext                  9146           3.9590           0.0000           0.0070           0.0004
MXImperativeInvokeEx                19229         488.4450           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2316        5677.7280           0.7010           3.7500           2.4515
FullyConnected                       3954         382.5490           0.0080           0.3430           0.0967
argmax                               1318          26.0310           0.0050           0.0480           0.0198
_backward_pick                       1158          18.2610           0.0130           0.0260           0.0158
_backward_mul_scalar                 1158           5.0100           0.0030           0.0160           0.0043
DeleteVariable                      49200         347.5370           0.0010           0.9010           0.0071
Flatten                              1318          54.5850           0.0080           0.1120           0.0414
Activation                           5272         245.7620           0.0030           1.9440           0.0466
SetValueOp                           1158           7.4590           0.0050           0.0180           0.0064
pick                                 1158           9.0900           0.0060           0.0280           0.0078
Pooling                              2636        3703.7571           0.0640           3.1720           1.4051
Convolution                          2636       14973.5107           0.2260          13.2050           5.6804
CopyCPU2CPU                          1318           7.5300           0.0030           0.0360           0.0057
log_softmax                          1158          36.0630           0.0150           0.0550           0.0311
_backward_copy                       1158          59.6530           0.0220           0.0760           0.0515
_backward_Convolution                2316       21433.6504           2.6370          12.5610           9.2546
_mul_scalar                          1158           4.1370           0.0020           0.0230           0.0036
_backward_log_softmax                1158          19.6420           0.0090           0.0400           0.0170
mean                                 3634          69.7540           0.0080           0.0730           0.0192
_backward_mean                       1158          12.6830           0.0080           0.1030           0.0110
_backward_FullyConnected             3474         661.5230           0.0280           0.5940           0.1904
WaitForVar                           2476          22.0860           0.0060           0.0280           0.0089
broadcast_equal                      1318           6.5830           0.0030           0.0110           0.0050
sgd_update                          11580         114.1650           0.0020           0.0790           0.0099
_backward_Activation                 4632         343.7440           0.0070           0.3900           0.0742



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       45320       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3960        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             579        2285.3201           0.3060          73.5850           3.9470
MXNDArrayCreateEx                     660          22.5440           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      580       12590.3623           5.6130          24.9880          21.7075
MXNDArraySyncCopyToCPU               1240        9787.2676           0.1180          24.1980           7.8930
MXNDArrayGetDType                    1240           0.4420           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3140           1.4470           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1320          11.5680           0.0070           0.0280           0.0088
MXNDArrayFree                       14780         150.6820           0.0000           0.9140           0.0102
MXNet C API Calls                   66460         553.8170         487.3580         553.8170          33.2295
MXNet C API Concurrency            132919           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1160           0.5480           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5800           3.0090           0.0000           0.0230           0.0005
MXNDArraySetGradState                5800           2.9370           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1160           0.4890           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  580         315.0900           0.5250           0.6810           0.5433
MXNDArrayGetContext                  9160           3.9670           0.0000           0.0070           0.0004
MXImperativeInvokeEx                19260         489.2440           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2320        5687.4282           0.7010           3.7500           2.4515
FullyConnected                       3960         383.0680           0.0080           0.3430           0.0967
argmax                               1320          26.0680           0.0050           0.0480           0.0197
_backward_pick                       1160          18.2920           0.0130           0.0260           0.0158
_backward_mul_scalar                 1160           5.0180           0.0030           0.0160           0.0043
DeleteVariable                      49280         348.0690           0.0010           0.9010           0.0071
Flatten                              1320          54.6640           0.0080           0.1120           0.0414
Activation                           5280         246.1140           0.0030           1.9440           0.0466
SetValueOp                           1160           7.4710           0.0050           0.0180           0.0064
pick                                 1160           9.1050           0.0060           0.0280           0.0078
Pooling                              2640        3709.1079           0.0640           3.1720           1.4050
Convolution                          2640       14995.5381           0.2260          13.2050           5.6801
CopyCPU2CPU                          1320           7.5390           0.0030           0.0360           0.0057
log_softmax                          1160          36.1230           0.0150           0.0550           0.0311
_backward_copy                       1160          59.7560           0.0220           0.0760           0.0515
_backward_Convolution                2320       21470.4258           2.6370          12.5610           9.2545
_mul_scalar                          1160           4.1440           0.0020           0.0230           0.0036
_backward_log_softmax                1160          19.6740           0.0090           0.0400           0.0170
mean                                 3640          69.8660           0.0080           0.0730           0.0192
_backward_mean                       1160          12.7040           0.0080           0.1030           0.0110
_backward_FullyConnected             3480         662.5860           0.0280           0.5940           0.1904
WaitForVar                           2480          22.1220           0.0060           0.0280           0.0089
broadcast_equal                      1320           6.5920           0.0030           0.0110           0.0050
sgd_update                          11600         114.3640           0.0020           0.0790           0.0099
_backward_Activation                 4640         344.2940           0.0070           0.3900           0.0742



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       45394       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3966        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             580        2289.2151           0.3060          73.5850           3.9469
MXNDArrayCreateEx                     661          22.5770           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      581       12612.2148           5.6130          24.9880          21.7078
MXNDArraySyncCopyToCPU               1242        9801.7363           0.1180          24.1980           7.8919
MXNDArrayGetDType                    1242           0.4440           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3145           1.4490           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1322          11.5860           0.0070           0.0280           0.0088
MXNDArrayFree                       14803         150.9040           0.0000           0.9140           0.0102
MXNet C API Calls                   66567         553.9240         487.3580         553.9240          33.2830
MXNet C API Concurrency            133133           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1162           0.5480           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5810           3.0140           0.0000           0.0230           0.0005
MXNDArraySetGradState                5810           2.9440           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1162           0.4890           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  581         315.6270           0.5250           0.6810           0.5432
MXNDArrayGetContext                  9174           3.9720           0.0000           0.0070           0.0004
MXImperativeInvokeEx                19291         490.0130           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2324        5697.3662           0.7010           3.7500           2.4515
FullyConnected                       3966         383.5890           0.0080           0.3430           0.0967
argmax                               1322          26.1060           0.0050           0.0480           0.0197
_backward_pick                       1162          18.3240           0.0130           0.0260           0.0158
_backward_mul_scalar                 1162           5.0260           0.0030           0.0160           0.0043
DeleteVariable                      49360         348.5900           0.0010           0.9010           0.0071
Flatten                              1322          54.7430           0.0080           0.1120           0.0414
Activation                           5288         246.4640           0.0030           1.9440           0.0466
SetValueOp                           1162           7.4830           0.0050           0.0180           0.0064
pick                                 1162           9.1200           0.0060           0.0280           0.0078
Pooling                              2644        3714.4580           0.0640           3.1720           1.4049
Convolution                          2644       15017.6768           0.2260          13.2050           5.6799
CopyCPU2CPU                          1322           7.5490           0.0030           0.0360           0.0057
log_softmax                          1162          36.1820           0.0150           0.0550           0.0311
_backward_copy                       1162          59.8580           0.0220           0.0760           0.0515
_backward_Convolution                2324       21507.4844           2.6370          12.5610           9.2545
_mul_scalar                          1162           4.1510           0.0020           0.0230           0.0036
_backward_log_softmax                1162          19.7050           0.0090           0.0400           0.0170
mean                                 3646          69.9860           0.0080           0.0730           0.0192
_backward_mean                       1162          12.7250           0.0080           0.1030           0.0110
_backward_FullyConnected             3486         663.6550           0.0280           0.5940           0.1904
WaitForVar                           2484          22.1570           0.0060           0.0280           0.0089
broadcast_equal                      1322           6.6020           0.0030           0.0110           0.0050
sgd_update                          11620         114.5650           0.0020           0.0790           0.0099
_backward_Activation                 4648         344.8540           0.0070           0.3900           0.0742



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       45468       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3972        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             581        2293.1040           0.3060          73.5850           3.9468
MXNDArrayCreateEx                     662          22.6110           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      582       12634.1250           5.6130          24.9880          21.7081
MXNDArraySyncCopyToCPU               1244        9816.1172           0.1180          24.1980           7.8908
MXNDArrayGetDType                    1244           0.4440           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3150           1.4510           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1324          11.6030           0.0070           0.0280           0.0088
MXNDArrayFree                       14826         151.1240           0.0000           0.9140           0.0102
MXNet C API Calls                   66674         554.0310         487.3580         554.0310          33.3365
MXNet C API Concurrency            133347           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1164           0.5490           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5820           3.0200           0.0000           0.0230           0.0005
MXNDArraySetGradState                5820           2.9460           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1164           0.4900           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  582         316.1860           0.5250           0.6810           0.5433
MXNDArrayGetContext                  9188           3.9810           0.0000           0.0070           0.0004
MXImperativeInvokeEx                19322         490.7840           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2328        5707.1279           0.7010           3.7500           2.4515
FullyConnected                       3972         384.1380           0.0080           0.3430           0.0967
argmax                               1324          26.1440           0.0050           0.0480           0.0197
_backward_pick                       1164          18.3550           0.0130           0.0260           0.0158
_backward_mul_scalar                 1164           5.0340           0.0030           0.0160           0.0043
DeleteVariable                      49440         349.1200           0.0010           0.9010           0.0071
Flatten                              1324          54.8240           0.0080           0.1120           0.0414
Activation                           5296         246.8120           0.0030           1.9440           0.0466
SetValueOp                           1164           7.4940           0.0050           0.0180           0.0064
pick                                 1164           9.1350           0.0060           0.0280           0.0078
Pooling                              2648        3719.8459           0.0640           3.1720           1.4048
Convolution                          2648       15039.9062           0.2260          13.2050           5.6797
CopyCPU2CPU                          1324           7.5580           0.0030           0.0360           0.0057
log_softmax                          1164          36.2420           0.0150           0.0550           0.0311
_backward_copy                       1164          59.9610           0.0220           0.0760           0.0515
_backward_Convolution                2328       21544.6133           2.6370          12.5610           9.2546
_mul_scalar                          1164           4.1590           0.0020           0.0230           0.0036
_backward_log_softmax                1164          19.7360           0.0090           0.0400           0.0170
mean                                 3652          70.1020           0.0080           0.0730           0.0192
_backward_mean                       1164          12.7460           0.0080           0.1030           0.0110
_backward_FullyConnected             3492         664.7270           0.0280           0.5940           0.1904
WaitForVar                           2488          22.1920           0.0060           0.0280           0.0089
broadcast_equal                      1324           6.6100           0.0030           0.0110           0.0050
sgd_update                          11640         114.7630           0.0020           0.0790           0.0099
_backward_Activation                 4656         345.3810           0.0070           0.3900           0.0742



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       45542       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3978        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             582        2297.0061           0.3060          73.5850           3.9467
MXNDArrayCreateEx                     663          22.6440           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      583       12655.7998           5.6130          24.9880          21.7081
MXNDArraySyncCopyToCPU               1246        9830.5020           0.1180          24.1980           7.8896
MXNDArrayGetDType                    1246           0.4450           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3155           1.4540           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1326          11.6200           0.0070           0.0280           0.0088
MXNDArrayFree                       14849         151.3510           0.0000           0.9140           0.0102
MXNet C API Calls                   66781         554.1380         487.3580         554.1380          33.3900
MXNet C API Concurrency            133561           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1166           0.5500           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5830           3.0220           0.0000           0.0230           0.0005
MXNDArraySetGradState                5830           2.9520           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1166           0.4900           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  583         316.7190           0.5250           0.6810           0.5433
MXNDArrayGetContext                  9202           3.9860           0.0000           0.0070           0.0004
MXImperativeInvokeEx                19353         491.5750           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2332        5716.8359           0.7010           3.7500           2.4515
FullyConnected                       3978         384.6680           0.0080           0.3430           0.0967
argmax                               1326          26.1810           0.0050           0.0480           0.0197
_backward_pick                       1166          18.3860           0.0130           0.0260           0.0158
_backward_mul_scalar                 1166           5.0430           0.0030           0.0160           0.0043
DeleteVariable                      49520         349.6490           0.0010           0.9010           0.0071
Flatten                              1326          54.9010           0.0080           0.1120           0.0414
Activation                           5304         247.1630           0.0030           1.9440           0.0466
SetValueOp                           1166           7.5080           0.0050           0.0180           0.0064
pick                                 1166           9.1500           0.0060           0.0280           0.0078
Pooling                              2652        3725.2029           0.0640           3.1720           1.4047
Convolution                          2652       15062.0527           0.2260          13.2050           5.6795
CopyCPU2CPU                          1326           7.5670           0.0030           0.0360           0.0057
log_softmax                          1166          36.3010           0.0150           0.0550           0.0311
_backward_copy                       1166          60.0640           0.0220           0.0760           0.0515
_backward_Convolution                2332       21581.3730           2.6370          12.5610           9.2544
_mul_scalar                          1166           4.1660           0.0020           0.0230           0.0036
_backward_log_softmax                1166          19.7690           0.0090           0.0400           0.0170
mean                                 3658          70.2120           0.0080           0.0730           0.0192
_backward_mean                       1166          12.7670           0.0080           0.1030           0.0109
_backward_FullyConnected             3498         665.7870           0.0280           0.5940           0.1903
WaitForVar                           2492          22.2270           0.0060           0.0280           0.0089
broadcast_equal                      1326           6.6190           0.0030           0.0110           0.0050
sgd_update                          11660         114.9610           0.0020           0.0790           0.0099
_backward_Activation                 4664         345.9460           0.0070           0.3900           0.0742



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       45616       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3984        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             583        2300.9150           0.3060          73.5850           3.9467
MXNDArrayCreateEx                     664          22.6790           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      584       12677.4463           5.6130          24.9880          21.7080
MXNDArraySyncCopyToCPU               1248        9844.6650           0.1180          24.1980           7.8884
MXNDArrayGetDType                    1248           0.4450           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3160           1.4550           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1328          11.6370           0.0070           0.0280           0.0088
MXNDArrayFree                       14872         151.5840           0.0000           0.9140           0.0102
MXNet C API Calls                   66888         554.2450         487.3580         554.2450          33.4435
MXNet C API Concurrency            133775           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1168           0.5520           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5840           3.0260           0.0000           0.0230           0.0005
MXNDArraySetGradState                5840           2.9540           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1168           0.4900           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  584         317.2510           0.5250           0.6810           0.5432
MXNDArrayGetContext                  9216           3.9920           0.0000           0.0070           0.0004
MXImperativeInvokeEx                19384         492.3640           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2336        5726.4009           0.7010           3.7500           2.4514
FullyConnected                       3984         385.2210           0.0080           0.3430           0.0967
argmax                               1328          26.2190           0.0050           0.0480           0.0197
_backward_pick                       1168          18.4160           0.0130           0.0260           0.0158
_backward_mul_scalar                 1168           5.0520           0.0030           0.0160           0.0043
DeleteVariable                      49600         350.1730           0.0010           0.9010           0.0071
Flatten                              1328          54.9790           0.0080           0.1120           0.0414
Activation                           5312         247.5150           0.0030           1.9440           0.0466
SetValueOp                           1168           7.5210           0.0050           0.0180           0.0064
pick                                 1168           9.1640           0.0060           0.0280           0.0078
Pooling                              2656        3730.5471           0.0640           3.1720           1.4046
Convolution                          2656       15084.1299           0.2260          13.2050           5.6793
CopyCPU2CPU                          1328           7.5770           0.0030           0.0360           0.0057
log_softmax                          1168          36.3610           0.0150           0.0550           0.0311
_backward_copy                       1168          60.1670           0.0220           0.0760           0.0515
_backward_Convolution                2336       21618.1582           2.6370          12.5610           9.2543
_mul_scalar                          1168           4.1730           0.0020           0.0230           0.0036
_backward_log_softmax                1168          19.8000           0.0090           0.0400           0.0170
mean                                 3664          70.3240           0.0080           0.0730           0.0192
_backward_mean                       1168          12.7880           0.0080           0.1030           0.0109
_backward_FullyConnected             3504         666.8490           0.0280           0.5940           0.1903
WaitForVar                           2496          22.2610           0.0060           0.0280           0.0089
broadcast_equal                      1328           6.6280           0.0030           0.0110           0.0050
sgd_update                          11680         115.1580           0.0020           0.0790           0.0099
_backward_Activation                 4672         346.4920           0.0070           0.3900           0.0742



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       45690       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3990        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             584        2304.8130           0.3060          73.5850           3.9466
MXNDArrayCreateEx                     665          22.7120           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      585       12699.2842           5.6130          24.9880          21.7082
MXNDArraySyncCopyToCPU               1250        9859.0186           0.1180          24.1980           7.8872
MXNDArrayGetDType                    1250           0.4460           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3165           1.4560           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1330          11.6540           0.0070           0.0280           0.0088
MXNDArrayFree                       14895         151.8170           0.0000           0.9140           0.0102
MXNet C API Calls                   66995         554.3520         487.3580         554.3520          33.4970
MXNet C API Concurrency            133989           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1170           0.5530           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5850           3.0310           0.0000           0.0230           0.0005
MXNDArraySetGradState                5850           2.9570           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1170           0.4900           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  585         317.7820           0.5250           0.6810           0.5432
MXNDArrayGetContext                  9230           4.0000           0.0000           0.0070           0.0004
MXImperativeInvokeEx                19415         493.1400           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2340        5736.1318           0.7010           3.7500           2.4513
FullyConnected                       3990         385.7670           0.0080           0.3430           0.0967
argmax                               1330          26.2560           0.0050           0.0480           0.0197
_backward_pick                       1170          18.4470           0.0130           0.0260           0.0158
_backward_mul_scalar                 1170           5.0610           0.0030           0.0160           0.0043
DeleteVariable                      49680         350.7180           0.0010           0.9010           0.0071
Flatten                              1330          55.0560           0.0080           0.1120           0.0414
Activation                           5320         247.8670           0.0030           1.9440           0.0466
SetValueOp                           1170           7.5320           0.0050           0.0180           0.0064
pick                                 1170           9.1790           0.0060           0.0280           0.0078
Pooling                              2660        3735.9089           0.0640           3.1720           1.4045
Convolution                          2660       15106.2734           0.2260          13.2050           5.6790
CopyCPU2CPU                          1330           7.5860           0.0030           0.0360           0.0057
log_softmax                          1170          36.4200           0.0150           0.0550           0.0311
_backward_copy                       1170          60.2710           0.0220           0.0760           0.0515
_backward_Convolution                2340       21655.2012           2.6370          12.5610           9.2544
_mul_scalar                          1170           4.1800           0.0020           0.0230           0.0036
_backward_log_softmax                1170          19.8310           0.0090           0.0400           0.0169
mean                                 3670          70.4380           0.0080           0.0730           0.0192
_backward_mean                       1170          12.8100           0.0080           0.1030           0.0109
_backward_FullyConnected             3510         667.9150           0.0280           0.5940           0.1903
WaitForVar                           2500          22.2940           0.0060           0.0280           0.0089
broadcast_equal                      1330           6.6370           0.0030           0.0110           0.0050
sgd_update                          11700         115.3600           0.0020           0.0790           0.0099
_backward_Activation                 4680         347.0210           0.0070           0.3900           0.0741



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       45764       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  3996        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             585        2308.7161           0.3060          73.5850           3.9465
MXNDArrayCreateEx                     666          22.7450           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      586       12721.1836           5.6130          24.9880          21.7085
MXNDArraySyncCopyToCPU               1252        9873.4043           0.1180          24.1980           7.8861
MXNDArrayGetDType                    1252           0.4460           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3170           1.4580           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1332          11.6710           0.0070           0.0280           0.0088
MXNDArrayFree                       14918         152.0460           0.0000           0.9140           0.0102
MXNet C API Calls                   67102         554.4590         487.3580         554.4590          33.5505
MXNet C API Concurrency            134203           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1172           0.5530           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5860           3.0390           0.0000           0.0230           0.0005
MXNDArraySetGradState                5860           2.9600           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1172           0.4900           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  586         318.3110           0.5250           0.6810           0.5432
MXNDArrayGetContext                  9244           4.0060           0.0000           0.0070           0.0004
MXImperativeInvokeEx                19446         493.9060           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2344        5745.8481           0.7010           3.7500           2.4513
FullyConnected                       3996         386.2860           0.0080           0.3430           0.0967
argmax                               1332          26.3330           0.0050           0.0480           0.0198
_backward_pick                       1172          18.4780           0.0130           0.0260           0.0158
_backward_mul_scalar                 1172           5.0700           0.0030           0.0160           0.0043
DeleteVariable                      49760         351.2350           0.0010           0.9010           0.0071
Flatten                              1332          55.1330           0.0080           0.1120           0.0414
Activation                           5328         248.2190           0.0030           1.9440           0.0466
SetValueOp                           1172           7.5440           0.0050           0.0180           0.0064
pick                                 1172           9.1950           0.0060           0.0280           0.0078
Pooling                              2664        3741.2549           0.0640           3.1720           1.4044
Convolution                          2664       15128.4941           0.2260          13.2050           5.6789
CopyCPU2CPU                          1332           7.5960           0.0030           0.0360           0.0057
log_softmax                          1172          36.4790           0.0150           0.0550           0.0311
_backward_copy                       1172          60.3720           0.0220           0.0760           0.0515
_backward_Convolution                2344       21692.3340           2.6370          12.5610           9.2544
_mul_scalar                          1172           4.1870           0.0020           0.0230           0.0036
_backward_log_softmax                1172          19.8630           0.0090           0.0400           0.0169
mean                                 3676          70.5490           0.0080           0.0730           0.0192
_backward_mean                       1172          12.8310           0.0080           0.1030           0.0109
_backward_FullyConnected             3516         668.9790           0.0280           0.5940           0.1903
WaitForVar                           2504          22.3280           0.0060           0.0280           0.0089
broadcast_equal                      1332           6.6470           0.0030           0.0110           0.0050
sgd_update                          11720         115.5600           0.0020           0.0790           0.0099
_backward_Activation                 4688         347.5710           0.0070           0.3900           0.0741



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       45838       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  4002        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             586        2312.6311           0.3060          73.5850           3.9465
MXNDArrayCreateEx                     667          22.7770           0.0310           0.0640           0.0341
MXNDArrayWaitAll                      587       12742.8779           5.6130          24.9880          21.7085
MXNDArraySyncCopyToCPU               1254        9887.7959           0.1180          24.1980           7.8850
MXNDArrayGetDType                    1254           0.4470           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3175           1.4580           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1334          11.6880           0.0070           0.0280           0.0088
MXNDArrayFree                       14941         152.2770           0.0000           0.9140           0.0102
MXNet C API Calls                   67209         554.5660         487.3580         554.5660          33.6040
MXNet C API Concurrency            134417           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1174           0.5540           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5870           3.0430           0.0000           0.0230           0.0005
MXNDArraySetGradState                5870           2.9660           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1174           0.4900           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  587         318.8630           0.5250           0.6810           0.5432
MXNDArrayGetContext                  9258           4.0110           0.0000           0.0070           0.0004
MXImperativeInvokeEx                19477         494.6750           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2348        5755.5659           0.7010           3.7500           2.4513
FullyConnected                       4002         386.8350           0.0080           0.3430           0.0967
argmax                               1334          26.3700           0.0050           0.0480           0.0198
_backward_pick                       1174          18.5090           0.0130           0.0260           0.0158
_backward_mul_scalar                 1174           5.0780           0.0030           0.0160           0.0043
DeleteVariable                      49840         351.7910           0.0010           0.9010           0.0071
Flatten                              1334          55.2120           0.0080           0.1120           0.0414
Activation                           5336         248.5710           0.0030           1.9440           0.0466
SetValueOp                           1174           7.5570           0.0050           0.0180           0.0064
pick                                 1174           9.2100           0.0060           0.0280           0.0078
Pooling                              2668        3746.6399           0.0640           3.1720           1.4043
Convolution                          2668       15150.6523           0.2260          13.2050           5.6787
CopyCPU2CPU                          1334           7.6050           0.0030           0.0360           0.0057
log_softmax                          1174          36.5380           0.0150           0.0550           0.0311
_backward_copy                       1174          60.4760           0.0220           0.0760           0.0515
_backward_Convolution                2348       21729.0586           2.6370          12.5610           9.2543
_mul_scalar                          1174           4.1940           0.0020           0.0230           0.0036
_backward_log_softmax                1174          19.8950           0.0090           0.0400           0.0169
mean                                 3682          70.6600           0.0080           0.0730           0.0192
_backward_mean                       1174          12.8530           0.0080           0.1030           0.0109
_backward_FullyConnected             3522         670.0450           0.0280           0.5940           0.1902
WaitForVar                           2508          22.3630           0.0060           0.0280           0.0089
broadcast_equal                      1334           6.6560           0.0030           0.0110           0.0050
sgd_update                          11740         115.7580           0.0020           0.0790           0.0099
_backward_Activation                 4696         348.1420           0.0070           0.3900           0.0741



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       45912       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  4008        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             587        2316.5339           0.3060          73.5850           3.9464
MXNDArrayCreateEx                     668          22.8100           0.0310           0.0640           0.0341
MXNDArrayWaitAll                      588       12764.5645           5.6130          24.9880          21.7084
MXNDArraySyncCopyToCPU               1256        9902.1064           0.1180          24.1980           7.8838
MXNDArrayGetDType                    1256           0.4490           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3180           1.4610           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1336          11.7040           0.0070           0.0280           0.0088
MXNDArrayFree                       14964         152.5010           0.0000           0.9140           0.0102
MXNet C API Calls                   67316         554.6730         487.3580         554.6730          33.6575
MXNet C API Concurrency            134631           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1176           0.5540           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5880           3.0470           0.0000           0.0230           0.0005
MXNDArraySetGradState                5880           2.9720           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1176           0.4900           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  588         319.4010           0.5250           0.6810           0.5432
MXNDArrayGetContext                  9272           4.0180           0.0000           0.0070           0.0004
MXImperativeInvokeEx                19508         495.4440           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2352        5765.2041           0.7010           3.7500           2.4512
FullyConnected                       4008         387.3740           0.0080           0.3430           0.0967
argmax                               1336          26.4070           0.0050           0.0480           0.0198
_backward_pick                       1176          18.5380           0.0130           0.0260           0.0158
_backward_mul_scalar                 1176           5.0860           0.0030           0.0160           0.0043
DeleteVariable                      49920         352.3140           0.0010           0.9010           0.0071
Flatten                              1336          55.2890           0.0080           0.1120           0.0414
Activation                           5344         248.9200           0.0030           1.9440           0.0466
SetValueOp                           1176           7.5680           0.0050           0.0180           0.0064
pick                                 1176           9.2250           0.0060           0.0280           0.0078
Pooling                              2672        3752.0039           0.0640           3.1720           1.4042
Convolution                          2672       15172.6924           0.2260          13.2050           5.6784
CopyCPU2CPU                          1336           7.6140           0.0030           0.0360           0.0057
log_softmax                          1176          36.5970           0.0150           0.0550           0.0311
_backward_copy                       1176          60.5790           0.0220           0.0760           0.0515
_backward_Convolution                2352       21765.8828           2.6370          12.5610           9.2542
_mul_scalar                          1176           4.2010           0.0020           0.0230           0.0036
_backward_log_softmax                1176          19.9270           0.0090           0.0400           0.0169
mean                                 3688          70.7710           0.0080           0.0730           0.0192
_backward_mean                       1176          12.8740           0.0080           0.1030           0.0109
_backward_FullyConnected             3528         671.1140           0.0280           0.5940           0.1902
WaitForVar                           2512          22.3980           0.0060           0.0280           0.0089
broadcast_equal                      1336           6.6650           0.0030           0.0110           0.0050
sgd_update                          11760         115.9110           0.0020           0.0790           0.0099
_backward_Activation                 4704         348.7540           0.0070           0.3900           0.0741



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       45986       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  4014        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             588        2320.4460           0.3060          73.5850           3.9463
MXNDArrayCreateEx                     669          22.8430           0.0310           0.0640           0.0341
MXNDArrayWaitAll                      589       12786.3760           5.6130          24.9880          21.7086
MXNDArraySyncCopyToCPU               1258        9916.4277           0.1180          24.1980           7.8827
MXNDArrayGetDType                    1258           0.4500           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3185           1.4640           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1338          11.7210           0.0070           0.0280           0.0088
MXNDArrayFree                       14987         152.7290           0.0000           0.9140           0.0102
MXNet C API Calls                   67423         554.7800         487.3580         554.7800          33.7110
MXNet C API Concurrency            134845           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1178           0.5550           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5890           3.0520           0.0000           0.0230           0.0005
MXNDArraySetGradState                5890           2.9780           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1178           0.4900           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  589         319.9340           0.5250           0.6810           0.5432
MXNDArrayGetContext                  9286           4.0250           0.0000           0.0070           0.0004
MXImperativeInvokeEx                19539         496.2190           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2356        5774.8071           0.7010           3.7500           2.4511
FullyConnected                       4014         387.8910           0.0080           0.3430           0.0966
argmax                               1338          26.4450           0.0050           0.0480           0.0198
_backward_pick                       1178          18.5690           0.0130           0.0260           0.0158
_backward_mul_scalar                 1178           5.0940           0.0030           0.0160           0.0043
DeleteVariable                      50000         352.8470           0.0010           0.9010           0.0071
Flatten                              1338          55.3670           0.0080           0.1120           0.0414
Activation                           5352         249.2710           0.0030           1.9440           0.0466
SetValueOp                           1178           7.5810           0.0050           0.0180           0.0064
pick                                 1178           9.2390           0.0060           0.0280           0.0078
Pooling                              2676        3757.3469           0.0640           3.1720           1.4041
Convolution                          2676       15194.8818           0.2260          13.2050           5.6782
CopyCPU2CPU                          1338           7.6230           0.0030           0.0360           0.0057
log_softmax                          1178          36.6550           0.0150           0.0550           0.0311
_backward_copy                       1178          60.6800           0.0220           0.0760           0.0515
_backward_Convolution                2356       21802.9121           2.6370          12.5610           9.2542
_mul_scalar                          1178           4.2080           0.0020           0.0230           0.0036
_backward_log_softmax                1178          19.9590           0.0090           0.0400           0.0169
mean                                 3694          70.8880           0.0080           0.0730           0.0192
_backward_mean                       1178          12.8950           0.0080           0.1030           0.0109
_backward_FullyConnected             3534         672.1800           0.0280           0.5940           0.1902
WaitForVar                           2516          22.4310           0.0060           0.0280           0.0089
broadcast_equal                      1338           6.6740           0.0030           0.0110           0.0050
sgd_update                          11780         116.1160           0.0020           0.0790           0.0099
_backward_Activation                 4712         349.2890           0.0070           0.3900           0.0741



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       46060       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  4020        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             589        2324.3530           0.3060          73.5850           3.9463
MXNDArrayCreateEx                     670          22.8760           0.0310           0.0640           0.0341
MXNDArrayWaitAll                      590       12808.2422           5.6130          24.9880          21.7089
MXNDArraySyncCopyToCPU               1260        9930.8174           0.1180          24.1980           7.8816
MXNDArrayGetDType                    1260           0.4520           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3190           1.4660           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1340          11.7390           0.0070           0.0280           0.0088
MXNDArrayFree                       15010         152.9500           0.0000           0.9140           0.0102
MXNet C API Calls                   67530         554.8870         487.3580         554.8870          33.7645
MXNet C API Concurrency            135059           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1180           0.5560           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5900           3.0560           0.0000           0.0230           0.0005
MXNDArraySetGradState                5900           2.9860           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1180           0.4900           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  590         320.4660           0.5250           0.6810           0.5432
MXNDArrayGetContext                  9300           4.0320           0.0000           0.0070           0.0004
MXImperativeInvokeEx                19570         497.0050           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2360        5784.5591           0.7010           3.7500           2.4511
FullyConnected                       4020         388.4370           0.0080           0.3430           0.0966
argmax                               1340          26.4830           0.0050           0.0480           0.0198
_backward_pick                       1180          18.5990           0.0130           0.0260           0.0158
_backward_mul_scalar                 1180           5.1040           0.0030           0.0160           0.0043
DeleteVariable                      50080         353.3580           0.0010           0.9010           0.0071
Flatten                              1340          55.4450           0.0080           0.1120           0.0414
Activation                           5360         249.6550           0.0030           1.9440           0.0466
SetValueOp                           1180           7.5930           0.0050           0.0180           0.0064
pick                                 1180           9.2550           0.0060           0.0280           0.0078
Pooling                              2680        3762.7620           0.0640           3.1720           1.4040
Convolution                          2680       15217.0576           0.2260          13.2050           5.6780
CopyCPU2CPU                          1340           7.6320           0.0030           0.0360           0.0057
log_softmax                          1180          36.7140           0.0150           0.0550           0.0311
_backward_copy                       1180          60.7840           0.0220           0.0760           0.0515
_backward_Convolution                2360       21839.9902           2.6370          12.5610           9.2542
_mul_scalar                          1180           4.2160           0.0020           0.0230           0.0036
_backward_log_softmax                1180          19.9910           0.0090           0.0400           0.0169
mean                                 3700          70.9990           0.0080           0.0730           0.0192
_backward_mean                       1180          12.9160           0.0080           0.1030           0.0109
_backward_FullyConnected             3540         673.2450           0.0280           0.5940           0.1902
WaitForVar                           2520          22.4650           0.0060           0.0280           0.0089
broadcast_equal                      1340           6.6830           0.0030           0.0110           0.0050
sgd_update                          11800         116.3150           0.0020           0.0790           0.0099
_backward_Activation                 4720         349.8360           0.0070           0.3900           0.0741



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       46134       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  4026        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             590        2328.2671           0.3060          73.5850           3.9462
MXNDArrayCreateEx                     671          22.9080           0.0310           0.0640           0.0341
MXNDArrayWaitAll                      591       12829.9346           5.6130          24.9880          21.7089
MXNDArraySyncCopyToCPU               1262        9945.1699           0.1180          24.1980           7.8805
MXNDArrayGetDType                    1262           0.4540           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3195           1.4690           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1342          11.7560           0.0070           0.0280           0.0088
MXNDArrayFree                       15033         153.1740           0.0000           0.9140           0.0102
MXNet C API Calls                   67637         554.9940         487.3580         554.9940          33.8180
MXNet C API Concurrency            135273           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1182           0.5570           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5910           3.0630           0.0000           0.0230           0.0005
MXNDArraySetGradState                5910           2.9900           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1182           0.4910           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  591         321.0190           0.5250           0.6810           0.5432
MXNDArrayGetContext                  9314           4.0360           0.0000           0.0070           0.0004
MXImperativeInvokeEx                19601         497.8020           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2364        5794.2769           0.7010           3.7500           2.4510
FullyConnected                       4026         389.0250           0.0080           0.3430           0.0966
argmax                               1342          26.5230           0.0050           0.0480           0.0198
_backward_pick                       1182          18.6330           0.0130           0.0260           0.0158
_backward_mul_scalar                 1182           5.1130           0.0030           0.0160           0.0043
DeleteVariable                      50160         353.8910           0.0010           0.9010           0.0071
Flatten                              1342          55.5220           0.0080           0.1120           0.0414
Activation                           5368         250.0510           0.0030           1.9440           0.0466
SetValueOp                           1182           7.6040           0.0050           0.0180           0.0064
pick                                 1182           9.2720           0.0060           0.0280           0.0078
Pooling                              2684        3768.0891           0.0640           3.1720           1.4039
Convolution                          2684       15239.2305           0.2260          13.2050           5.6778
CopyCPU2CPU                          1342           7.6420           0.0030           0.0360           0.0057
log_softmax                          1182          36.7860           0.0150           0.0550           0.0311
_backward_copy                       1182          60.8850           0.0220           0.0760           0.0515
_backward_Convolution                2364       21876.7051           2.6370          12.5610           9.2541
_mul_scalar                          1182           4.2230           0.0020           0.0230           0.0036
_backward_log_softmax                1182          20.0230           0.0090           0.0400           0.0169
mean                                 3706          71.1050           0.0080           0.0730           0.0192
_backward_mean                       1182          12.9390           0.0080           0.1030           0.0109
_backward_FullyConnected             3546         674.4350           0.0280           0.5940           0.1902
WaitForVar                           2524          22.5000           0.0060           0.0280           0.0089
broadcast_equal                      1342           6.6920           0.0030           0.0110           0.0050
sgd_update                          11820         116.5280           0.0020           0.0790           0.0099
_backward_Activation                 4728         350.4220           0.0070           0.3900           0.0741



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       46208       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  4032        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             591        2332.1941           0.3060          73.5850           3.9462
MXNDArrayCreateEx                     672          22.9430           0.0310           0.0640           0.0341
MXNDArrayWaitAll                      592       12851.7129           5.6130          24.9880          21.7090
MXNDArraySyncCopyToCPU               1264        9959.4307           0.1180          24.1980           7.8793
MXNDArrayGetDType                    1264           0.4550           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3200           1.4720           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1344          11.7740           0.0070           0.0280           0.0088
MXNDArrayFree                       15056         153.4090           0.0000           0.9140           0.0102
MXNet C API Calls                   67744         555.1010         487.3580         555.1010          33.8715
MXNet C API Concurrency            135487           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1184           0.5580           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5920           3.0670           0.0000           0.0230           0.0005
MXNDArraySetGradState                5920           2.9950           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1184           0.4910           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  592         321.5830           0.5250           0.6810           0.5432
MXNDArrayGetContext                  9328           4.0380           0.0000           0.0070           0.0004
MXImperativeInvokeEx                19632         498.5890           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2368        5804.0601           0.7010           3.7500           2.4510
FullyConnected                       4032         389.5760           0.0080           0.3430           0.0966
argmax                               1344          26.5610           0.0050           0.0480           0.0198
_backward_pick                       1184          18.6640           0.0130           0.0260           0.0158
_backward_mul_scalar                 1184           5.1220           0.0030           0.0160           0.0043
DeleteVariable                      50240         354.4380           0.0010           0.9010           0.0071
Flatten                              1344          55.6130           0.0080           0.1120           0.0414
Activation                           5376         250.4120           0.0030           1.9440           0.0466
SetValueOp                           1184           7.6160           0.0050           0.0180           0.0064
pick                                 1184           9.2880           0.0060           0.0280           0.0078
Pooling                              2688        3773.4890           0.0640           3.1720           1.4038
Convolution                          2688       15261.3740           0.2260          13.2050           5.6776
CopyCPU2CPU                          1344           7.6520           0.0030           0.0360           0.0057
log_softmax                          1184          36.8460           0.0150           0.0550           0.0311
_backward_copy                       1184          60.9880           0.0220           0.0760           0.0515
_backward_Convolution                2368       21913.4863           2.6370          12.5610           9.2540
_mul_scalar                          1184           4.2300           0.0020           0.0230           0.0036
_backward_log_softmax                1184          20.0560           0.0090           0.0400           0.0169
mean                                 3712          71.2190           0.0080           0.0730           0.0192
_backward_mean                       1184          12.9610           0.0080           0.1030           0.0109
_backward_FullyConnected             3552         675.5100           0.0280           0.5940           0.1902
WaitForVar                           2528          22.5350           0.0060           0.0280           0.0089
broadcast_equal                      1344           6.7020           0.0030           0.0110           0.0050
sgd_update                          11840         116.7310           0.0020           0.0790           0.0099
_backward_Activation                 4736         350.9990           0.0070           0.3900           0.0741



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       46282       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  4038        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             592        2332.6509           0.3060          73.5850           3.9403
MXNDArrayCreateEx                     673          22.9760           0.0310           0.0640           0.0341
MXNDArrayWaitAll                      593       12873.6201           5.6130          24.9880          21.7093
MXNDArraySyncCopyToCPU               1266        9973.7900           0.1180          24.1980           7.8782
MXNDArrayGetDType                    1266           0.4550           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3205           1.4750           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1346          11.7910           0.0070           0.0280           0.0088
MXNDArrayFree                       15079         153.6560           0.0000           0.9140           0.0102
MXNet C API Calls                   67851         555.2080         487.3580         555.2080          33.9250
MXNet C API Concurrency            135701           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1186           0.5580           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5930           3.0710           0.0000           0.0230           0.0005
MXNDArraySetGradState                5930           3.0010           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1186           0.4930           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  593         322.1230           0.5250           0.6810           0.5432
MXNDArrayGetContext                  9342           4.0430           0.0000           0.0070           0.0004
MXImperativeInvokeEx                19663         499.3770           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2372        5813.8481           0.7010           3.7500           2.4510
FullyConnected                       4038         390.1020           0.0080           0.3430           0.0966
argmax                               1346          26.6000           0.0050           0.0480           0.0198
_backward_pick                       1186          18.6940           0.0130           0.0260           0.0158
_backward_mul_scalar                 1186           5.1300           0.0030           0.0160           0.0043
DeleteVariable                      50320         354.9920           0.0010           0.9010           0.0071
Flatten                              1346          55.6940           0.0080           0.1120           0.0414
Activation                           5384         250.7620           0.0030           1.9440           0.0466
SetValueOp                           1186           7.6280           0.0050           0.0180           0.0064
pick                                 1186           9.3030           0.0060           0.0280           0.0078
Pooling                              2692        3778.8301           0.0640           3.1720           1.4037
Convolution                          2692       15283.5791           0.2260          13.2050           5.6774
CopyCPU2CPU                          1346           7.6610           0.0030           0.0360           0.0057
log_softmax                          1186          36.9060           0.0150           0.0550           0.0311
_backward_copy                       1186          61.1220           0.0220           0.0760           0.0515
_backward_Convolution                2372       21950.5762           2.6370          12.5610           9.2540
_mul_scalar                          1186           4.2370           0.0020           0.0230           0.0036
_backward_log_softmax                1186          20.0890           0.0090           0.0400           0.0169
mean                                 3718          71.3300           0.0080           0.0730           0.0192
_backward_mean                       1186          12.9820           0.0080           0.1030           0.0109
_backward_FullyConnected             3558         676.5740           0.0280           0.5940           0.1902
WaitForVar                           2532          22.5700           0.0060           0.0280           0.0089
broadcast_equal                      1346           6.7110           0.0030           0.0110           0.0050
sgd_update                          11860         116.8780           0.0020           0.0790           0.0099
_backward_Activation                 4744         351.6140           0.0070           0.3900           0.0741



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       46356       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  4044        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             593        2336.5759           0.3060          73.5850           3.9403
MXNDArrayCreateEx                     674          23.0090           0.0310           0.0640           0.0341
MXNDArrayWaitAll                      594       12895.4932           5.6130          24.9880          21.7096
MXNDArraySyncCopyToCPU               1268        9988.1826           0.1180          24.1980           7.8771
MXNDArrayGetDType                    1268           0.4560           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3210           1.4790           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1348          11.8090           0.0070           0.0280           0.0088
MXNDArrayFree                       15102         153.8860           0.0000           0.9140           0.0102
MXNet C API Calls                   67958         555.3150         487.3580         555.3150          33.9785
MXNet C API Concurrency            135915           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1188           0.5590           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5940           3.0780           0.0000           0.0230           0.0005
MXNDArraySetGradState                5940           3.0050           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1188           0.4940           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  594         322.6880           0.5250           0.6810           0.5432
MXNDArrayGetContext                  9356           4.0470           0.0000           0.0070           0.0004
MXImperativeInvokeEx                19694         500.1530           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2376        5823.5479           0.7010           3.7500           2.4510
FullyConnected                       4044         390.6550           0.0080           0.3430           0.0966
argmax                               1348          26.6380           0.0050           0.0480           0.0198
_backward_pick                       1188          18.7260           0.0130           0.0260           0.0158
_backward_mul_scalar                 1188           5.1380           0.0030           0.0160           0.0043
DeleteVariable                      50400         355.5240           0.0010           0.9010           0.0071
Flatten                              1348          55.7760           0.0080           0.1120           0.0414
Activation                           5392         251.1180           0.0030           1.9440           0.0466
SetValueOp                           1188           7.6400           0.0050           0.0180           0.0064
pick                                 1188           9.3200           0.0060           0.0280           0.0078
Pooling                              2696        3784.2180           0.0640           3.1720           1.4036
Convolution                          2696       15305.8574           0.2260          13.2050           5.6772
CopyCPU2CPU                          1348           7.6700           0.0030           0.0360           0.0057
log_softmax                          1188          36.9660           0.0150           0.0550           0.0311
_backward_copy                       1188          61.2260           0.0220           0.0760           0.0515
_backward_Convolution                2376       21987.6738           2.6370          12.5610           9.2541
_mul_scalar                          1188           4.2440           0.0020           0.0230           0.0036
_backward_log_softmax                1188          20.1210           0.0090           0.0400           0.0169
mean                                 3724          71.4460           0.0080           0.0730           0.0192
_backward_mean                       1188          13.0030           0.0080           0.1030           0.0109
_backward_FullyConnected             3564         677.6380           0.0280           0.5940           0.1901
WaitForVar                           2536          22.6050           0.0060           0.0280           0.0089
broadcast_equal                      1348           6.7200           0.0030           0.0110           0.0050
sgd_update                          11880         117.0840           0.0020           0.0790           0.0099
_backward_Activation                 4752         352.1450           0.0070           0.3900           0.0741



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       46430       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  4050        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             594        2340.4919           0.3060          73.5850           3.9402
MXNDArrayCreateEx                     675          23.0430           0.0310           0.0640           0.0341
MXNDArrayWaitAll                      595       12917.1729           5.6130          24.9880          21.7095
MXNDArraySyncCopyToCPU               1270       10002.5557           0.1180          24.1980           7.8760
MXNDArrayGetDType                    1270           0.4560           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3215           1.4810           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1350          11.8270           0.0070           0.0280           0.0088
MXNDArrayFree                       15125         154.1140           0.0000           0.9140           0.0102
MXNet C API Calls                   68065         555.4220         487.3580         555.4220          34.0320
MXNet C API Concurrency            136129           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1190           0.5590           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5950           3.0850           0.0000           0.0230           0.0005
MXNDArraySetGradState                5950           3.0100           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1190           0.4940           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  595         323.2470           0.5250           0.6810           0.5433
MXNDArrayGetContext                  9370           4.0540           0.0000           0.0070           0.0004
MXImperativeInvokeEx                19725         500.9750           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2380        5833.2339           0.7010           3.7500           2.4509
FullyConnected                       4050         391.2470           0.0080           0.3430           0.0966
argmax                               1350          26.6760           0.0050           0.0480           0.0198
_backward_pick                       1190          18.7610           0.0130           0.0260           0.0158
_backward_mul_scalar                 1190           5.1470           0.0030           0.0160           0.0043
DeleteVariable                      50480         356.0600           0.0010           0.9010           0.0071
Flatten                              1350          55.8580           0.0080           0.1120           0.0414
Activation                           5400         251.4890           0.0030           1.9440           0.0466
SetValueOp                           1190           7.6530           0.0050           0.0180           0.0064
pick                                 1190           9.3360           0.0060           0.0280           0.0078
Pooling                              2700        3789.5669           0.0640           3.1720           1.4035
Convolution                          2700       15328.0664           0.2260          13.2050           5.6771
CopyCPU2CPU                          1350           7.6800           0.0030           0.0360           0.0057
log_softmax                          1190          37.0380           0.0150           0.0550           0.0311
_backward_copy                       1190          61.3270           0.0220           0.0760           0.0515
_backward_Convolution                2380       22024.4199           2.6370          12.5610           9.2540
_mul_scalar                          1190           4.2510           0.0020           0.0230           0.0036
_backward_log_softmax                1190          20.1540           0.0090           0.0400           0.0169
mean                                 3730          71.5600           0.0080           0.0730           0.0192
_backward_mean                       1190          13.0240           0.0080           0.1030           0.0109
_backward_FullyConnected             3570         678.8240           0.0280           0.5940           0.1901
WaitForVar                           2540          22.6390           0.0060           0.0280           0.0089
broadcast_equal                      1350           6.7300           0.0030           0.0110           0.0050
sgd_update                          11900         117.2560           0.0020           0.0790           0.0099
_backward_Activation                 4760         352.7720           0.0070           0.3900           0.0741



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       46504       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  4056        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             595        2344.4331           0.3060          73.5850           3.9402
MXNDArrayCreateEx                     676          23.0780           0.0310           0.0640           0.0341
MXNDArrayWaitAll                      596       12938.9023           5.6130          24.9880          21.7096
MXNDArraySyncCopyToCPU               1272       10016.8701           0.1180          24.1980           7.8749
MXNDArrayGetDType                    1272           0.4560           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3220           1.4830           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1352          11.8450           0.0070           0.0280           0.0088
MXNDArrayFree                       15148         154.3580           0.0000           0.9140           0.0102
MXNet C API Calls                   68172         555.5290         487.3580         555.5290          34.0855
MXNet C API Concurrency            136343           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1192           0.5590           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5960           3.0900           0.0000           0.0230           0.0005
MXNDArraySetGradState                5960           3.0150           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1192           0.4940           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  596         323.7940           0.5250           0.6810           0.5433
MXNDArrayGetContext                  9384           4.0620           0.0000           0.0070           0.0004
MXImperativeInvokeEx                19756         501.7590           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2384        5842.8760           0.7010           3.7500           2.4509
FullyConnected                       4056         391.8120           0.0080           0.3430           0.0966
argmax                               1352          26.7150           0.0050           0.0480           0.0198
_backward_pick                       1192          18.7940           0.0130           0.0260           0.0158
_backward_mul_scalar                 1192           5.1540           0.0030           0.0160           0.0043
DeleteVariable                      50560         356.6310           0.0010           0.9010           0.0071
Flatten                              1352          55.9450           0.0080           0.1120           0.0414
Activation                           5408         251.8480           0.0030           1.9440           0.0466
SetValueOp                           1192           7.6640           0.0050           0.0180           0.0064
pick                                 1192           9.3510           0.0060           0.0280           0.0078
Pooling                              2704        3794.9250           0.0640           3.1720           1.4034
Convolution                          2704       15350.2031           0.2260          13.2050           5.6769
CopyCPU2CPU                          1352           7.6900           0.0030           0.0360           0.0057
log_softmax                          1192          37.0980           0.0150           0.0550           0.0311
_backward_copy                       1192          61.4300           0.0220           0.0760           0.0515
_backward_Convolution                2384       22061.2891           2.6370          12.5610           9.2539
_mul_scalar                          1192           4.2580           0.0020           0.0230           0.0036
_backward_log_softmax                1192          20.1850           0.0090           0.0400           0.0169
mean                                 3736          71.6750           0.0080           0.0730           0.0192
_backward_mean                       1192          13.0450           0.0080           0.1030           0.0109
_backward_FullyConnected             3576         679.8980           0.0280           0.5940           0.1901
WaitForVar                           2544          22.6720           0.0060           0.0280           0.0089
broadcast_equal                      1352           6.7400           0.0030           0.0110           0.0050
sgd_update                          11920         117.4580           0.0020           0.0790           0.0099
_backward_Activation                 4768         353.3240           0.0070           0.3900           0.0741



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       46578       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  4062        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             596        2348.3870           0.3060          73.5850           3.9402
MXNDArrayCreateEx                     677          23.1130           0.0310           0.0640           0.0341
MXNDArrayWaitAll                      597       12960.7764           5.6130          24.9880          21.7098
MXNDArraySyncCopyToCPU               1274       10031.0654           0.1180          24.1980           7.8737
MXNDArrayGetDType                    1274           0.4580           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3225           1.4870           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1354          11.8630           0.0070           0.0280           0.0088
MXNDArrayFree                       15171         154.6030           0.0000           0.9140           0.0102
MXNet C API Calls                   68279         555.6360         487.3580         555.6360          34.1390
MXNet C API Concurrency            136557           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1194           0.5600           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5970           3.0950           0.0000           0.0230           0.0005
MXNDArraySetGradState                5970           3.0240           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1194           0.4950           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  597         324.3700           0.5250           0.6810           0.5433
MXNDArrayGetContext                  9398           4.0670           0.0000           0.0070           0.0004
MXImperativeInvokeEx                19787         502.5780           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2388        5852.5742           0.7010           3.7500           2.4508
FullyConnected                       4062         392.3480           0.0080           0.3430           0.0966
argmax                               1354          26.7520           0.0050           0.0480           0.0198
_backward_pick                       1194          18.8250           0.0130           0.0260           0.0158
_backward_mul_scalar                 1194           5.1620           0.0030           0.0160           0.0043
DeleteVariable                      50640         357.1750           0.0010           0.9010           0.0071
Flatten                              1354          56.0380           0.0080           0.1120           0.0414
Activation                           5416         252.2080           0.0030           1.9440           0.0466
SetValueOp                           1194           7.6760           0.0050           0.0180           0.0064
pick                                 1194           9.3680           0.0060           0.0280           0.0078
Pooling                              2708        3800.3311           0.0640           3.1720           1.4034
Convolution                          2708       15372.3975           0.2260          13.2050           5.6767
CopyCPU2CPU                          1354           7.7000           0.0030           0.0360           0.0057
log_softmax                          1194          37.1580           0.0150           0.0550           0.0311
_backward_copy                       1194          61.5330           0.0220           0.0760           0.0515
_backward_Convolution                2388       22098.4180           2.6370          12.5610           9.2539
_mul_scalar                          1194           4.2650           0.0020           0.0230           0.0036
_backward_log_softmax                1194          20.2170           0.0090           0.0400           0.0169
mean                                 3742          71.7920           0.0080           0.0730           0.0192
_backward_mean                       1194          13.0680           0.0080           0.1030           0.0109
_backward_FullyConnected             3582         680.9710           0.0280           0.5940           0.1901
WaitForVar                           2548          22.7060           0.0060           0.0280           0.0089
broadcast_equal                      1354           6.7490           0.0030           0.0110           0.0050
sgd_update                          11940         117.6060           0.0020           0.0790           0.0098
_backward_Activation                 4776         353.9440           0.0070           0.3900           0.0741



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       46652       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  4068        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             597        2352.3401           0.3060          73.5850           3.9403
MXNDArrayCreateEx                     678          23.1490           0.0310           0.0640           0.0341
MXNDArrayWaitAll                      598       12982.6904           5.6130          24.9880          21.7102
MXNDArraySyncCopyToCPU               1276       10045.4346           0.1180          24.1980           7.8726
MXNDArrayGetDType                    1276           0.4600           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3230           1.4910           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1356          11.8810           0.0070           0.0280           0.0088
MXNDArrayFree                       15194         154.8520           0.0000           0.9140           0.0102
MXNet C API Calls                   68386         555.7430         487.3580         555.7430          34.1925
MXNet C API Concurrency            136771           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1196           0.5610           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5980           3.0980           0.0000           0.0230           0.0005
MXNDArraySetGradState                5980           3.0260           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1196           0.4950           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  598         324.9200           0.5250           0.6810           0.5433
MXNDArrayGetContext                  9412           4.0730           0.0000           0.0070           0.0004
MXImperativeInvokeEx                19818         503.3940           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2392        5862.2109           0.7010           3.7500           2.4508
FullyConnected                       4068         392.8920           0.0080           0.3430           0.0966
argmax                               1356          26.7900           0.0050           0.0480           0.0198
_backward_pick                       1196          18.8570           0.0130           0.0260           0.0158
_backward_mul_scalar                 1196           5.1700           0.0030           0.0160           0.0043
DeleteVariable                      50720         357.7670           0.0010           0.9010           0.0071
Flatten                              1356          56.1320           0.0080           0.1120           0.0414
Activation                           5424         252.5690           0.0030           1.9440           0.0466
SetValueOp                           1196           7.6890           0.0050           0.0180           0.0064
pick                                 1196           9.3830           0.0060           0.0280           0.0078
Pooling                              2712        3805.6790           0.0640           3.1720           1.4033
Convolution                          2712       15394.7207           0.2260          13.2050           5.6765
CopyCPU2CPU                          1356           7.7090           0.0030           0.0360           0.0057
log_softmax                          1196          37.2180           0.0150           0.0550           0.0311
_backward_copy                       1196          61.6360           0.0220           0.0760           0.0515
_backward_Convolution                2392       22135.5918           2.6370          12.5610           9.2540
_mul_scalar                          1196           4.2720           0.0020           0.0230           0.0036
_backward_log_softmax                1196          20.2490           0.0090           0.0400           0.0169
mean                                 3748          71.9150           0.0080           0.0730           0.0192
_backward_mean                       1196          13.0900           0.0080           0.1030           0.0109
_backward_FullyConnected             3588         682.0990           0.0280           0.5940           0.1901
WaitForVar                           2552          22.7400           0.0060           0.0280           0.0089
broadcast_equal                      1356           6.7600           0.0030           0.0110           0.0050
sgd_update                          11960         117.7550           0.0020           0.0790           0.0098
_backward_Activation                 4784         354.5410           0.0070           0.3900           0.0741



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       46726       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  4074        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             598        2356.2710           0.3060          73.5850           3.9403
MXNDArrayCreateEx                     679          23.1840           0.0310           0.0640           0.0341
MXNDArrayWaitAll                      599       13004.4287           5.6130          24.9880          21.7102
MXNDArraySyncCopyToCPU               1278       10059.9346           0.1180          24.1980           7.8716
MXNDArrayGetDType                    1278           0.4610           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3235           1.4930           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1358          11.8990           0.0070           0.0280           0.0088
MXNDArrayFree                       15217         155.0770           0.0000           0.9140           0.0102
MXNet C API Calls                   68493         555.8500         487.3580         555.8500          34.2460
MXNet C API Concurrency            136985           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1198           0.5620           0.0000           0.0040           0.0005
MXNDArrayGetGradState                5990           3.0990           0.0000           0.0230           0.0005
MXNDArraySetGradState                5990           3.0300           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1198           0.4950           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  599         325.4640           0.5250           0.6810           0.5433
MXNDArrayGetContext                  9426           4.0780           0.0000           0.0070           0.0004
MXImperativeInvokeEx                19849         504.1790           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2396        5871.9438           0.7010           3.7500           2.4507
FullyConnected                       4074         393.4930           0.0080           0.3430           0.0966
argmax                               1358          26.8330           0.0050           0.0480           0.0198
_backward_pick                       1198          18.8880           0.0130           0.0260           0.0158
_backward_mul_scalar                 1198           5.1780           0.0030           0.0160           0.0043
DeleteVariable                      50800         358.3040           0.0010           0.9010           0.0071
Flatten                              1358          56.2130           0.0080           0.1120           0.0414
Activation                           5432         252.9570           0.0030           1.9440           0.0466
SetValueOp                           1198           7.7020           0.0050           0.0180           0.0064
pick                                 1198           9.3990           0.0060           0.0280           0.0078
Pooling                              2716        3811.0371           0.0640           3.1720           1.4032
Convolution                          2716       15416.9141           0.2260          13.2050           5.6763
CopyCPU2CPU                          1358           7.7190           0.0030           0.0360           0.0057
log_softmax                          1198          37.2780           0.0150           0.0550           0.0311
_backward_copy                       1198          61.7370           0.0220           0.0760           0.0515
_backward_Convolution                2396       22172.4160           2.6370          12.5610           9.2539
_mul_scalar                          1198           4.2790           0.0020           0.0230           0.0036
_backward_log_softmax                1198          20.2920           0.0090           0.0400           0.0169
mean                                 3754          72.0160           0.0080           0.0730           0.0192
_backward_mean                       1198          13.1120           0.0080           0.1030           0.0109
_backward_FullyConnected             3594         683.2830           0.0280           0.5940           0.1901
WaitForVar                           2556          22.7740           0.0060           0.0280           0.0089
broadcast_equal                      1358           6.7690           0.0030           0.0110           0.0050
sgd_update                          11980         117.9950           0.0020           0.0790           0.0098
_backward_Activation                 4792         355.1000           0.0070           0.3900           0.0741



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       46800       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  4080        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             599        2360.1931           0.3060          73.5850           3.9402
MXNDArrayCreateEx                     680          23.2190           0.0310           0.0640           0.0341
MXNDArrayWaitAll                      600       13026.1094           5.6130          24.9880          21.7102
MXNDArraySyncCopyToCPU               1280       10074.3018           0.1180          24.1980           7.8705
MXNDArrayGetDType                    1280           0.4620           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3240           1.4940           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1360          11.9170           0.0070           0.0280           0.0088
MXNDArrayFree                       15240         155.3100           0.0000           0.9140           0.0102
MXNet C API Calls                   68600         555.9570         487.3580         555.9570          34.2995
MXNet C API Concurrency            137199           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1200           0.5640           0.0000           0.0040           0.0005
MXNDArrayGetGradState                6000           3.1030           0.0000           0.0230           0.0005
MXNDArraySetGradState                6000           3.0340           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1200           0.4960           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  600         326.0060           0.5250           0.6810           0.5433
MXNDArrayGetContext                  9440           4.0880           0.0000           0.0070           0.0004
MXImperativeInvokeEx                19880         504.9580           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2400        5881.5620           0.7010           3.7500           2.4507
FullyConnected                       4080         394.0450           0.0080           0.3430           0.0966
argmax                               1360          26.8710           0.0050           0.0480           0.0198
_backward_pick                       1200          18.9180           0.0130           0.0260           0.0158
_backward_mul_scalar                 1200           5.1860           0.0030           0.0160           0.0043
DeleteVariable                      50880         358.8600           0.0010           0.9010           0.0071
Flatten                              1360          56.2970           0.0080           0.1120           0.0414
Activation                           5440         253.3110           0.0030           1.9440           0.0466
SetValueOp                           1200           7.7140           0.0050           0.0180           0.0064
pick                                 1200           9.4150           0.0060           0.0280           0.0078
Pooling                              2720        3816.3721           0.0640           3.1720           1.4031
Convolution                          2720       15439.0518           0.2260          13.2050           5.6761
CopyCPU2CPU                          1360           7.7290           0.0030           0.0360           0.0057
log_softmax                          1200          37.3370           0.0150           0.0550           0.0311
_backward_copy                       1200          61.8410           0.0220           0.0760           0.0515
_backward_Convolution                2400       22209.2285           2.6370          12.5610           9.2538
_mul_scalar                          1200           4.2860           0.0020           0.0230           0.0036
_backward_log_softmax                1200          20.3250           0.0090           0.0400           0.0169
mean                                 3760          72.1310           0.0080           0.0730           0.0192
_backward_mean                       1200          13.1330           0.0080           0.1030           0.0109
_backward_FullyConnected             3600         684.3600           0.0280           0.5940           0.1901
WaitForVar                           2560          22.8070           0.0060           0.0280           0.0089
broadcast_equal                      1360           6.7800           0.0030           0.0110           0.0050
sgd_update                          12000         118.1990           0.0020           0.0790           0.0098
_backward_Activation                 4800         355.6790           0.0070           0.3900           0.0741



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       46874       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  4086        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             600        2364.1331           0.3060          73.5850           3.9402
MXNDArrayCreateEx                     681          23.2530           0.0310           0.0640           0.0341
MXNDArrayWaitAll                      601       13047.9707           5.6130          24.9880          21.7104
MXNDArraySyncCopyToCPU               1282       10088.4600           0.1180          24.1980           7.8693
MXNDArrayGetDType                    1282           0.4630           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3245           1.4990           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1362          11.9350           0.0070           0.0280           0.0088
MXNDArrayFree                       15263         155.5470           0.0000           0.9140           0.0102
MXNet C API Calls                   68707         556.0640         487.3580         556.0640          34.3530
MXNet C API Concurrency            137413           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1202           0.5650           0.0000           0.0040           0.0005
MXNDArrayGetGradState                6010           3.1080           0.0000           0.0230           0.0005
MXNDArraySetGradState                6010           3.0390           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1202           0.4970           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  601         326.5960           0.5250           0.6810           0.5434
MXNDArrayGetContext                  9454           4.0940           0.0000           0.0070           0.0004
MXImperativeInvokeEx                19911         505.7680           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2404        5891.2290           0.7010           3.7500           2.4506
FullyConnected                       4086         394.5690           0.0080           0.3430           0.0966
argmax                               1362          26.9090           0.0050           0.0480           0.0198
_backward_pick                       1202          18.9500           0.0130           0.0260           0.0158
_backward_mul_scalar                 1202           5.1950           0.0030           0.0160           0.0043
DeleteVariable                      50960         359.4180           0.0010           0.9010           0.0071
Flatten                              1362          56.3760           0.0080           0.1120           0.0414
Activation                           5448         253.6640           0.0030           1.9440           0.0466
SetValueOp                           1202           7.7260           0.0050           0.0180           0.0064
pick                                 1202           9.4310           0.0060           0.0280           0.0078
Pooling                              2724        3821.7429           0.0640           3.1720           1.4030
Convolution                          2724       15461.2490           0.2260          13.2050           5.6759
CopyCPU2CPU                          1362           7.7390           0.0030           0.0360           0.0057
log_softmax                          1202          37.3960           0.0150           0.0550           0.0311
_backward_copy                       1202          61.9440           0.0220           0.0760           0.0515
_backward_Convolution                2404       22246.3281           2.6370          12.5610           9.2539
_mul_scalar                          1202           4.2920           0.0020           0.0230           0.0036
_backward_log_softmax                1202          20.3580           0.0090           0.0400           0.0169
mean                                 3766          72.2480           0.0080           0.0730           0.0192
_backward_mean                       1202          13.1550           0.0080           0.1030           0.0109
_backward_FullyConnected             3606         685.4320           0.0280           0.5940           0.1901
WaitForVar                           2564          22.8440           0.0060           0.0280           0.0089
broadcast_equal                      1362           6.7900           0.0030           0.0110           0.0050
sgd_update                          12020         118.4040           0.0020           0.0790           0.0099
_backward_Activation                 4808         356.2100           0.0070           0.3900           0.0741



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       46948       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  4092        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             601        2368.0659           0.3060          73.5850           3.9402
MXNDArrayCreateEx                     682          23.2880           0.0310           0.0640           0.0341
MXNDArrayWaitAll                      602       13069.7910           5.6130          24.9880          21.7106
MXNDArraySyncCopyToCPU               1284       10102.8662           0.1180          24.1980           7.8683
MXNDArrayGetDType                    1284           0.4630           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3250           1.5030           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1364          11.9510           0.0070           0.0280           0.0088
MXNDArrayFree                       15286         155.7790           0.0000           0.9140           0.0102
MXNet C API Calls                   68814         556.1710         487.3580         556.1710          34.4065
MXNet C API Concurrency            137627           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1204           0.5660           0.0000           0.0040           0.0005
MXNDArrayGetGradState                6020           3.1140           0.0000           0.0230           0.0005
MXNDArraySetGradState                6020           3.0430           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1204           0.4970           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  602         327.1370           0.5250           0.6810           0.5434
MXNDArrayGetContext                  9468           4.0980           0.0000           0.0070           0.0004
MXImperativeInvokeEx                19942         506.5510           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2408        5900.8818           0.7010           3.7500           2.4505
FullyConnected                       4092         395.1220           0.0080           0.3430           0.0966
argmax                               1364          26.9480           0.0050           0.0480           0.0198
_backward_pick                       1204          18.9820           0.0130           0.0260           0.0158
_backward_mul_scalar                 1204           5.2020           0.0030           0.0160           0.0043
DeleteVariable                      51040         359.9620           0.0010           0.9010           0.0071
Flatten                              1364          56.4610           0.0080           0.1120           0.0414
Activation                           5456         254.0190           0.0030           1.9440           0.0466
SetValueOp                           1204           7.7390           0.0050           0.0180           0.0064
pick                                 1204           9.4460           0.0060           0.0280           0.0078
Pooling                              2728        3827.1001           0.0640           3.1720           1.4029
Convolution                          2728       15483.4883           0.2260          13.2050           5.6758
CopyCPU2CPU                          1364           7.7490           0.0030           0.0360           0.0057
log_softmax                          1204          37.4560           0.0150           0.0550           0.0311
_backward_copy                       1204          62.0460           0.0220           0.0760           0.0515
_backward_Convolution                2408       22283.3574           2.6370          12.5610           9.2539
_mul_scalar                          1204           4.2990           0.0020           0.0230           0.0036
_backward_log_softmax                1204          20.3910           0.0090           0.0400           0.0169
mean                                 3772          72.3640           0.0080           0.0730           0.0192
_backward_mean                       1204          13.1750           0.0080           0.1030           0.0109
_backward_FullyConnected             3612         686.5040           0.0280           0.5940           0.1901
WaitForVar                           2568          22.8790           0.0060           0.0280           0.0089
broadcast_equal                      1364           6.8000           0.0030           0.0110           0.0050
sgd_update                          12040         118.6080           0.0020           0.0790           0.0099
_backward_Activation                 4816         356.7600           0.0070           0.3900           0.0741



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       47022       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  4098        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             602        2371.9839           0.3060          73.5850           3.9402
MXNDArrayCreateEx                     683          23.3220           0.0310           0.0640           0.0341
MXNDArrayWaitAll                      603       13091.4932           5.6130          24.9880          21.7106
MXNDArraySyncCopyToCPU               1286       10117.3232           0.1180          24.1980           7.8673
MXNDArrayGetDType                    1286           0.4640           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3255           1.5060           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1366          11.9680           0.0070           0.0280           0.0088
MXNDArrayFree                       15309         156.0130           0.0000           0.9140           0.0102
MXNet C API Calls                   68921         556.2780         487.3580         556.2780          34.4600
MXNet C API Concurrency            137841           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1206           0.5680           0.0000           0.0040           0.0005
MXNDArrayGetGradState                6030           3.1210           0.0000           0.0230           0.0005
MXNDArraySetGradState                6030           3.0490           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1206           0.4980           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  603         327.6790           0.5250           0.6810           0.5434
MXNDArrayGetContext                  9482           4.1090           0.0000           0.0070           0.0004
MXImperativeInvokeEx                19973         507.3340           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2412        5910.5542           0.7010           3.7500           2.4505
FullyConnected                       4098         395.7640           0.0080           0.3430           0.0966
argmax                               1366          26.9910           0.0050           0.0480           0.0198
_backward_pick                       1206          19.0130           0.0130           0.0260           0.0158
_backward_mul_scalar                 1206           5.2110           0.0030           0.0160           0.0043
DeleteVariable                      51120         360.5100           0.0010           0.9010           0.0071
Flatten                              1366          56.5410           0.0080           0.1120           0.0414
Activation                           5464         254.3870           0.0030           1.9440           0.0466
SetValueOp                           1206           7.7500           0.0050           0.0180           0.0064
pick                                 1206           9.4630           0.0060           0.0280           0.0078
Pooling                              2732        3832.4600           0.0640           3.1720           1.4028
Convolution                          2732       15505.6758           0.2260          13.2050           5.6756
CopyCPU2CPU                          1366           7.7590           0.0030           0.0360           0.0057
log_softmax                          1206          37.5280           0.0150           0.0550           0.0311
_backward_copy                       1206          62.1490           0.0220           0.0760           0.0515
_backward_Convolution                2412       22320.1191           2.6370          12.5610           9.2538
_mul_scalar                          1206           4.3060           0.0020           0.0230           0.0036
_backward_log_softmax                1206          20.4220           0.0090           0.0400           0.0169
mean                                 3778          72.4700           0.0080           0.0730           0.0192
_backward_mean                       1206          13.1970           0.0080           0.1030           0.0109
_backward_FullyConnected             3618         687.6900           0.0280           0.5940           0.1901
WaitForVar                           2572          22.9150           0.0060           0.0280           0.0089
broadcast_equal                      1366           6.8100           0.0030           0.0110           0.0050
sgd_update                          12060         118.8220           0.0020           0.0790           0.0099
_backward_Activation                 4824         357.3220           0.0070           0.3900           0.0741



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       47096       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  4104        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             603        2375.8999           0.3060          73.5850           3.9401
MXNDArrayCreateEx                     684          23.3570           0.0310           0.0640           0.0341
MXNDArrayWaitAll                      604       13113.2051           5.6130          24.9880          21.7106
MXNDArraySyncCopyToCPU               1288       10131.6641           0.1180          24.1980           7.8662
MXNDArrayGetDType                    1288           0.4650           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3260           1.5090           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1368          11.9860           0.0070           0.0280           0.0088
MXNDArrayFree                       15332         156.2370           0.0000           0.9140           0.0102
MXNet C API Calls                   69028         556.3850         487.3580         556.3850          34.5135
MXNet C API Concurrency            138055           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1208           0.5690           0.0000           0.0040           0.0005
MXNDArrayGetGradState                6040           3.1280           0.0000           0.0230           0.0005
MXNDArraySetGradState                6040           3.0550           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1208           0.4990           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  604         328.2220           0.5250           0.6810           0.5434
MXNDArrayGetContext                  9496           4.1150           0.0000           0.0070           0.0004
MXImperativeInvokeEx                20004         508.1190           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2416        5920.2598           0.7010           3.7500           2.4504
FullyConnected                       4104         396.3060           0.0080           0.3430           0.0966
argmax                               1368          27.0290           0.0050           0.0480           0.0198
_backward_pick                       1208          19.0440           0.0130           0.0260           0.0158
_backward_mul_scalar                 1208           5.2200           0.0030           0.0160           0.0043
DeleteVariable                      51200         361.0380           0.0010           0.9010           0.0071
Flatten                              1368          56.6220           0.0080           0.1120           0.0414
Activation                           5472         254.7380           0.0030           1.9440           0.0466
SetValueOp                           1208           7.7620           0.0050           0.0180           0.0064
pick                                 1208           9.4780           0.0060           0.0280           0.0078
Pooling                              2736        3837.8621           0.0640           3.1720           1.4027
Convolution                          2736       15527.7998           0.2260          13.2050           5.6754
CopyCPU2CPU                          1368           7.7690           0.0030           0.0360           0.0057
log_softmax                          1208          37.5870           0.0150           0.0550           0.0311
_backward_copy                       1208          62.2500           0.0220           0.0760           0.0515
_backward_Convolution                2416       22356.9238           2.6370          12.5610           9.2537
_mul_scalar                          1208           4.3130           0.0020           0.0230           0.0036
_backward_log_softmax                1208          20.4540           0.0090           0.0400           0.0169
mean                                 3784          72.5800           0.0080           0.0730           0.0192
_backward_mean                       1208          13.2180           0.0080           0.1030           0.0109
_backward_FullyConnected             3624         688.7620           0.0280           0.5940           0.1901
WaitForVar                           2576          22.9500           0.0060           0.0280           0.0089
broadcast_equal                      1368           6.8190           0.0030           0.0110           0.0050
sgd_update                          12080         119.0220           0.0020           0.0790           0.0099
_backward_Activation                 4832         357.8750           0.0070           0.3900           0.0741



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       47170       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  4110        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             604        2379.8159           0.3060          73.5850           3.9401
MXNDArrayCreateEx                     685          23.3920           0.0310           0.0640           0.0341
MXNDArrayWaitAll                      605       13135.0000           5.6130          24.9880          21.7107
MXNDArraySyncCopyToCPU               1290       10146.0420           0.1180          24.1980           7.8651
MXNDArrayGetDType                    1290           0.4670           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3265           1.5100           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1370          12.0040           0.0070           0.0280           0.0088
MXNDArrayFree                       15355         156.4750           0.0000           0.9140           0.0102
MXNet C API Calls                   69135         556.4920         487.3580         556.4920          34.5670
MXNet C API Concurrency            138269           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1210           0.5700           0.0000           0.0040           0.0005
MXNDArrayGetGradState                6050           3.1310           0.0000           0.0230           0.0005
MXNDArraySetGradState                6050           3.0600           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1210           0.4990           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  605         328.7630           0.5250           0.6810           0.5434
MXNDArrayGetContext                  9510           4.1230           0.0000           0.0070           0.0004
MXImperativeInvokeEx                20035         508.8970           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2420        5929.8271           0.7010           3.7500           2.4503
FullyConnected                       4110         396.8510           0.0080           0.3430           0.0966
argmax                               1370          27.0660           0.0050           0.0480           0.0198
_backward_pick                       1210          19.0770           0.0130           0.0260           0.0158
_backward_mul_scalar                 1210           5.2290           0.0030           0.0160           0.0043
DeleteVariable                      51280         361.5820           0.0010           0.9010           0.0071
Flatten                              1370          56.7040           0.0080           0.1120           0.0414
Activation                           5480         255.0920           0.0030           1.9440           0.0465
SetValueOp                           1210           7.7740           0.0050           0.0180           0.0064
pick                                 1210           9.4950           0.0060           0.0280           0.0078
Pooling                              2740        3843.2190           0.0640           3.1720           1.4026
Convolution                          2740       15550.0391           0.2260          13.2050           5.6752
CopyCPU2CPU                          1370           7.7790           0.0030           0.0360           0.0057
log_softmax                          1210          37.6470           0.0150           0.0550           0.0311
_backward_copy                       1210          62.3930           0.0220           0.0760           0.0516
_backward_Convolution                2420       22393.9473           2.6370          12.5610           9.2537
_mul_scalar                          1210           4.3200           0.0020           0.0230           0.0036
_backward_log_softmax                1210          20.4860           0.0090           0.0400           0.0169
mean                                 3790          72.6970           0.0080           0.0730           0.0192
_backward_mean                       1210          13.2390           0.0080           0.1030           0.0109
_backward_FullyConnected             3630         689.8310           0.0280           0.5940           0.1900
WaitForVar                           2580          22.9860           0.0060           0.0280           0.0089
broadcast_equal                      1370           6.8290           0.0030           0.0110           0.0050
sgd_update                          12100         119.2240           0.0020           0.0790           0.0099
_backward_Activation                 4840         358.4030           0.0070           0.3900           0.0741



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       47244       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  4116        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             605        2383.7329           0.3060          73.5850           3.9401
MXNDArrayCreateEx                     686          23.4270           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      606       13156.8330           5.6130          24.9880          21.7109
MXNDArraySyncCopyToCPU               1292       10160.3965           0.1180          24.1980           7.8641
MXNDArrayGetDType                    1292           0.4680           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3270           1.5120           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1372          12.0210           0.0070           0.0280           0.0088
MXNDArrayFree                       15378         156.6990           0.0000           0.9140           0.0102
MXNet C API Calls                   69242         556.5990         487.3580         556.5990          34.6205
MXNet C API Concurrency            138483           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1212           0.5700           0.0000           0.0040           0.0005
MXNDArrayGetGradState                6060           3.1380           0.0000           0.0230           0.0005
MXNDArraySetGradState                6060           3.0650           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1212           0.5010           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  606         329.3270           0.5250           0.6810           0.5434
MXNDArrayGetContext                  9524           4.1300           0.0000           0.0070           0.0004
MXImperativeInvokeEx                20066         509.6860           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2424        5939.4482           0.7010           3.7500           2.4503
FullyConnected                       4116         397.3740           0.0080           0.3430           0.0965
argmax                               1372          27.1040           0.0050           0.0480           0.0198
_backward_pick                       1212          19.1080           0.0130           0.0260           0.0158
_backward_mul_scalar                 1212           5.2370           0.0030           0.0160           0.0043
DeleteVariable                      51360         362.1100           0.0010           0.9010           0.0071
Flatten                              1372          56.7830           0.0080           0.1120           0.0414
Activation                           5488         255.4450           0.0030           1.9440           0.0465
SetValueOp                           1212           7.7860           0.0050           0.0180           0.0064
pick                                 1212           9.5100           0.0060           0.0280           0.0078
Pooling                              2744        3848.6030           0.0640           3.1720           1.4026
Convolution                          2744       15572.2939           0.2260          13.2050           5.6750
CopyCPU2CPU                          1372           7.7890           0.0030           0.0360           0.0057
log_softmax                          1212          37.7060           0.0150           0.0550           0.0311
_backward_copy                       1212          62.4970           0.0220           0.0760           0.0516
_backward_Convolution                2424       22431.0039           2.6370          12.5610           9.2537
_mul_scalar                          1212           4.3260           0.0020           0.0230           0.0036
_backward_log_softmax                1212          20.5190           0.0090           0.0400           0.0169
mean                                 3796          72.8140           0.0080           0.0730           0.0192
_backward_mean                       1212          13.2600           0.0080           0.1030           0.0109
_backward_FullyConnected             3636         690.8990           0.0280           0.5940           0.1900
WaitForVar                           2584          23.0210           0.0060           0.0280           0.0089
broadcast_equal                      1372           6.8380           0.0030           0.0110           0.0050
sgd_update                          12120         119.4250           0.0020           0.0790           0.0099
_backward_Activation                 4848         358.9700           0.0070           0.3900           0.0740



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       47318       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  4122        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             606        2387.6599           0.3060          73.5850           3.9400
MXNDArrayCreateEx                     687          23.4610           0.0310           0.0640           0.0341
MXNDArrayWaitAll                      607       13178.5840           5.6130          24.9880          21.7110
MXNDArraySyncCopyToCPU               1294       10174.9160           0.1180          24.1980           7.8632
MXNDArrayGetDType                    1294           0.4680           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3275           1.5150           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1374          12.0380           0.0070           0.0280           0.0088
MXNDArrayFree                       15401         156.9360           0.0000           0.9140           0.0102
MXNet C API Calls                   69349         556.7060         487.3580         556.7060          34.6740
MXNet C API Concurrency            138697           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1214           0.5700           0.0000           0.0040           0.0005
MXNDArrayGetGradState                6070           3.1410           0.0000           0.0230           0.0005
MXNDArraySetGradState                6070           3.0670           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1214           0.5010           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  607         329.8660           0.5250           0.6810           0.5434
MXNDArrayGetContext                  9538           4.1370           0.0000           0.0070           0.0004
MXImperativeInvokeEx                20097         510.4690           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2428        5949.2388           0.7010           3.7500           2.4503
FullyConnected                       4122         397.9910           0.0080           0.3430           0.0966
argmax                               1374          27.1440           0.0050           0.0480           0.0198
_backward_pick                       1214          19.1400           0.0130           0.0260           0.0158
_backward_mul_scalar                 1214           5.2450           0.0030           0.0160           0.0043
DeleteVariable                      51440         362.6760           0.0010           0.9010           0.0071
Flatten                              1374          56.8680           0.0080           0.1120           0.0414
Activation                           5496         255.8200           0.0030           1.9440           0.0465
SetValueOp                           1214           7.7980           0.0050           0.0180           0.0064
pick                                 1214           9.5280           0.0060           0.0280           0.0078
Pooling                              2748        3853.9541           0.0640           3.1720           1.4025
Convolution                          2748       15594.4668           0.2260          13.2050           5.6748
CopyCPU2CPU                          1374           7.7980           0.0030           0.0360           0.0057
log_softmax                          1214          37.7650           0.0150           0.0550           0.0311
_backward_copy                       1214          62.5990           0.0220           0.0760           0.0516
_backward_Convolution                2428       22467.7383           2.6370          12.5610           9.2536
_mul_scalar                          1214           4.3330           0.0020           0.0230           0.0036
_backward_log_softmax                1214          20.5620           0.0090           0.0400           0.0169
mean                                 3802          72.9160           0.0080           0.0730           0.0192
_backward_mean                       1214          13.2810           0.0080           0.1030           0.0109
_backward_FullyConnected             3642         692.0900           0.0280           0.5940           0.1900
WaitForVar                           2588          23.0590           0.0060           0.0280           0.0089
broadcast_equal                      1374           6.8480           0.0030           0.0110           0.0050
sgd_update                          12140         119.6440           0.0020           0.0790           0.0099
_backward_Activation                 4856         359.5690           0.0070           0.3900           0.0740



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       47392       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  4128        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             607        2391.5730           0.3060          73.5850           3.9400
MXNDArrayCreateEx                     688          23.4950           0.0310           0.0640           0.0341
MXNDArrayWaitAll                      608       13200.3398           5.6130          24.9880          21.7111
MXNDArraySyncCopyToCPU               1296       10189.2041           0.1180          24.1980           7.8620
MXNDArrayGetDType                    1296           0.4680           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3280           1.5160           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1376          12.0560           0.0070           0.0280           0.0088
MXNDArrayFree                       15424         157.1690           0.0000           0.9140           0.0102
MXNet C API Calls                   69456         556.8130         487.3580         556.8130          34.7275
MXNet C API Concurrency            138911           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1216           0.5720           0.0000           0.0040           0.0005
MXNDArrayGetGradState                6080           3.1470           0.0000           0.0230           0.0005
MXNDArraySetGradState                6080           3.0690           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1216           0.5020           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  608         330.4140           0.5250           0.6810           0.5434
MXNDArrayGetContext                  9552           4.1400           0.0000           0.0070           0.0004
MXImperativeInvokeEx                20128         511.2550           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2432        5958.9790           0.7010           3.7500           2.4502
FullyConnected                       4128         398.5580           0.0080           0.3430           0.0965
argmax                               1376          27.1820           0.0050           0.0480           0.0198
_backward_pick                       1216          19.1710           0.0130           0.0260           0.0158
_backward_mul_scalar                 1216           5.2530           0.0030           0.0160           0.0043
DeleteVariable                      51520         363.2060           0.0010           0.9010           0.0070
Flatten                              1376          56.9510           0.0080           0.1120           0.0414
Activation                           5504         256.1740           0.0030           1.9440           0.0465
SetValueOp                           1216           7.8100           0.0050           0.0180           0.0064
pick                                 1216           9.5440           0.0060           0.0280           0.0078
Pooling                              2752        3859.2930           0.0640           3.1720           1.4024
Convolution                          2752       15616.5693           0.2260          13.2050           5.6746
CopyCPU2CPU                          1376           7.8080           0.0030           0.0360           0.0057
log_softmax                          1216          37.8240           0.0150           0.0550           0.0311
_backward_copy                       1216          62.7030           0.0220           0.0760           0.0516
_backward_Convolution                2432       22504.5195           2.6370          12.5610           9.2535
_mul_scalar                          1216           4.3410           0.0020           0.0230           0.0036
_backward_log_softmax                1216          20.5940           0.0090           0.0400           0.0169
mean                                 3808          73.0360           0.0080           0.0730           0.0192
_backward_mean                       1216          13.3020           0.0080           0.1030           0.0109
_backward_FullyConnected             3648         693.1570           0.0280           0.5940           0.1900
WaitForVar                           2592          23.0940           0.0060           0.0280           0.0089
broadcast_equal                      1376           6.8570           0.0030           0.0110           0.0050
sgd_update                          12160         119.7920           0.0020           0.0790           0.0099
_backward_Activation                 4864         360.2140           0.0070           0.3900           0.0741



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       47466       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  4134        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             608        2395.4890           0.3060          73.5850           3.9399
MXNDArrayCreateEx                     689          23.5290           0.0310           0.0640           0.0341
MXNDArrayWaitAll                      609       13225.2939           5.6130          24.9880          21.7164
MXNDArraySyncCopyToCPU               1298       10215.3096           0.1180          24.1980           7.8700
MXNDArrayGetDType                    1298           0.4680           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3285           1.5180           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1378          12.0730           0.0070           0.0280           0.0088
MXNDArrayFree                       15447         157.4050           0.0000           0.9140           0.0102
MXNet C API Calls                   69563         556.9200         487.3580         556.9200          34.7810
MXNet C API Concurrency            139125           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1218           0.5720           0.0000           0.0040           0.0005
MXNDArrayGetGradState                6090           3.1570           0.0000           0.0230           0.0005
MXNDArraySetGradState                6090           3.0730           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1218           0.5020           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  609         330.9540           0.5250           0.6810           0.5434
MXNDArrayGetContext                  9566           4.1470           0.0000           0.0070           0.0004
MXImperativeInvokeEx                20159         512.0430           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2436        5969.9570           0.7010           3.7500           2.4507
FullyConnected                       4134         399.4450           0.0080           0.3430           0.0966
argmax                               1378          27.2370           0.0050           0.0480           0.0198
_backward_pick                       1218          19.2150           0.0130           0.0260           0.0158
_backward_mul_scalar                 1218           5.2670           0.0030           0.0160           0.0043
DeleteVariable                      51600         363.8120           0.0010           0.9010           0.0071
Flatten                              1378          57.0510           0.0080           0.1120           0.0414
Activation                           5512         256.5990           0.0030           1.9440           0.0466
SetValueOp                           1218           7.8280           0.0050           0.0180           0.0064
pick                                 1218           9.5670           0.0060           0.0280           0.0079
Pooling                              2756        3868.7849           0.0640           3.1720           1.4038
Convolution                          2756       15654.9707           0.2260          13.2050           5.6803
CopyCPU2CPU                          1378           7.8250           0.0030           0.0360           0.0057
log_softmax                          1218          37.9040           0.0150           0.0550           0.0311
_backward_copy                       1218          62.8290           0.0220           0.0760           0.0516
_backward_Convolution                2436       22547.7832           2.6370          12.5610           9.2561
_mul_scalar                          1218           4.3530           0.0020           0.0230           0.0036
_backward_log_softmax                1218          20.6410           0.0090           0.0400           0.0169
mean                                 3814          73.1950           0.0080           0.0730           0.0192
_backward_mean                       1218          13.3330           0.0080           0.1030           0.0109
_backward_FullyConnected             3654         694.8810           0.0280           0.5940           0.1902
WaitForVar                           2596          23.1430           0.0060           0.0280           0.0089
broadcast_equal                      1378           6.8710           0.0030           0.0110           0.0050
sgd_update                          12180         120.0850           0.0020           0.0790           0.0099
_backward_Activation                 4872         360.8020           0.0070           0.3900           0.0741



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       47540       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  4140        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             609        2399.4150           0.3060          73.5850           3.9399
MXNDArrayCreateEx                     690          23.5630           0.0310           0.0640           0.0341
MXNDArrayWaitAll                      610       13247.1230           5.6130          24.9880          21.7166
MXNDArraySyncCopyToCPU               1300       10229.7275           0.1180          24.1980           7.8690
MXNDArrayGetDType                    1300           0.4680           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3290           1.5190           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1380          12.0900           0.0070           0.0280           0.0088
MXNDArrayFree                       15470         157.6430           0.0000           0.9140           0.0102
MXNet C API Calls                   69670         557.0270         487.3580         557.0270          34.8345
MXNet C API Concurrency            139339           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1220           0.5730           0.0000           0.0040           0.0005
MXNDArrayGetGradState                6100           3.1610           0.0000           0.0230           0.0005
MXNDArraySetGradState                6100           3.0770           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1220           0.5020           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  610         331.4890           0.5250           0.6810           0.5434
MXNDArrayGetContext                  9580           4.1530           0.0000           0.0070           0.0004
MXImperativeInvokeEx                20190         512.8470           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2440        5979.6558           0.7010           3.7500           2.4507
FullyConnected                       4140         399.9910           0.0080           0.3430           0.0966
argmax                               1380          27.2770           0.0050           0.0480           0.0198
_backward_pick                       1220          19.2460           0.0130           0.0260           0.0158
_backward_mul_scalar                 1220           5.2760           0.0030           0.0160           0.0043
DeleteVariable                      51680         364.3680           0.0010           0.9010           0.0071
Flatten                              1380          57.1310           0.0080           0.1120           0.0414
Activation                           5520         256.9520           0.0030           1.9440           0.0465
SetValueOp                           1220           7.8410           0.0050           0.0180           0.0064
pick                                 1220           9.5830           0.0060           0.0280           0.0079
Pooling                              2760        3874.1780           0.0640           3.1720           1.4037
Convolution                          2760       15677.1836           0.2260          13.2050           5.6801
CopyCPU2CPU                          1380           7.8350           0.0030           0.0360           0.0057
log_softmax                          1220          37.9640           0.0150           0.0550           0.0311
_backward_copy                       1220          62.9340           0.0220           0.0760           0.0516
_backward_Convolution                2440       22584.8301           2.6370          12.5610           9.2561
_mul_scalar                          1220           4.3600           0.0020           0.0230           0.0036
_backward_log_softmax                1220          20.6720           0.0090           0.0400           0.0169
mean                                 3820          73.3110           0.0080           0.0730           0.0192
_backward_mean                       1220          13.3550           0.0080           0.1030           0.0109
_backward_FullyConnected             3660         695.9510           0.0280           0.5940           0.1902
WaitForVar                           2600          23.1790           0.0060           0.0280           0.0089
broadcast_equal                      1380           6.8810           0.0030           0.0110           0.0050
sgd_update                          12200         120.2870           0.0020           0.0790           0.0099
_backward_Activation                 4880         361.3520           0.0070           0.3900           0.0740



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       47614       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  4146        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             610        2403.3259           0.3060          73.5850           3.9399
MXNDArrayCreateEx                     691          23.5960           0.0310           0.0640           0.0341
MXNDArrayWaitAll                      611       13268.8730           5.6130          24.9880          21.7167
MXNDArraySyncCopyToCPU               1302       10243.6680           0.1180          24.1980           7.8676
MXNDArrayGetDType                    1302           0.4700           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3295           1.5210           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1382          12.1070           0.0070           0.0280           0.0088
MXNDArrayFree                       15493         157.8890           0.0000           0.9140           0.0102
MXNet C API Calls                   69777         557.1340         487.3580         557.1340          34.8880
MXNet C API Concurrency            139553           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1222           0.5740           0.0000           0.0040           0.0005
MXNDArrayGetGradState                6110           3.1670           0.0000           0.0230           0.0005
MXNDArraySetGradState                6110           3.0820           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1222           0.5040           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  611         332.0580           0.5250           0.6810           0.5435
MXNDArrayGetContext                  9594           4.1620           0.0000           0.0070           0.0004
MXImperativeInvokeEx                20221         513.6350           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2444        5989.3628           0.7010           3.7500           2.4506
FullyConnected                       4146         400.6190           0.0080           0.3430           0.0966
argmax                               1382          27.3220           0.0050           0.0480           0.0198
_backward_pick                       1222          19.2810           0.0130           0.0260           0.0158
_backward_mul_scalar                 1222           5.2860           0.0030           0.0160           0.0043
DeleteVariable                      51760         364.9300           0.0010           0.9010           0.0071
Flatten                              1382          57.2130           0.0080           0.1120           0.0414
Activation                           5528         257.3210           0.0030           1.9440           0.0465
SetValueOp                           1222           7.8550           0.0050           0.0180           0.0064
pick                                 1222           9.6000           0.0060           0.0280           0.0079
Pooling                              2764        3879.5320           0.0640           3.1720           1.4036
Convolution                          2764       15699.4941           0.2260          13.2050           5.6800
CopyCPU2CPU                          1382           7.8450           0.0030           0.0360           0.0057
log_softmax                          1222          38.0270           0.0150           0.0550           0.0311
_backward_copy                       1222          63.0370           0.0220           0.0760           0.0516
_backward_Convolution                2444       22621.6445           2.6370          12.5610           9.2560
_mul_scalar                          1222           4.3670           0.0020           0.0230           0.0036
_backward_log_softmax                1222          20.7120           0.0090           0.0400           0.0169
mean                                 3826          73.4190           0.0080           0.0730           0.0192
_backward_mean                       1222          13.3770           0.0080           0.1030           0.0109
_backward_FullyConnected             3666         697.1380           0.0280           0.5940           0.1902
WaitForVar                           2604          23.2160           0.0060           0.0280           0.0089
broadcast_equal                      1382           6.8920           0.0030           0.0110           0.0050
sgd_update                          12220         120.5010           0.0020           0.0790           0.0099
_backward_Activation                 4888         361.9220           0.0070           0.3900           0.0740



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       47688       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  4152        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             611        2407.2500           0.3060          73.5850           3.9399
MXNDArrayCreateEx                     692          23.6300           0.0310           0.0640           0.0341
MXNDArrayWaitAll                      612       13290.5566           5.6130          24.9880          21.7166
MXNDArraySyncCopyToCPU               1304       10257.9609           0.1180          24.1980           7.8665
MXNDArrayGetDType                    1304           0.4710           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3300           1.5230           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1384          12.1240           0.0070           0.0280           0.0088
MXNDArrayFree                       15516         158.1180           0.0000           0.9140           0.0102
MXNet C API Calls                   69884         557.2410         487.3580         557.2410          34.9415
MXNet C API Concurrency            139767           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1224           0.5750           0.0000           0.0040           0.0005
MXNDArrayGetGradState                6120           3.1710           0.0000           0.0230           0.0005
MXNDArraySetGradState                6120           3.0880           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1224           0.5060           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  612         332.5970           0.5250           0.6810           0.5435
MXNDArrayGetContext                  9608           4.1660           0.0000           0.0070           0.0004
MXImperativeInvokeEx                20252         514.4420           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2448        5998.9990           0.7010           3.7500           2.4506
FullyConnected                       4152         401.1480           0.0080           0.3430           0.0966
argmax                               1384          27.3610           0.0050           0.0480           0.0198
_backward_pick                       1224          19.3120           0.0130           0.0260           0.0158
_backward_mul_scalar                 1224           5.2930           0.0030           0.0160           0.0043
DeleteVariable                      51840         365.4740           0.0010           0.9010           0.0071
Flatten                              1384          57.2960           0.0080           0.1120           0.0414
Activation                           5536         257.6710           0.0030           1.9440           0.0465
SetValueOp                           1224           7.8680           0.0050           0.0180           0.0064
pick                                 1224           9.6150           0.0060           0.0280           0.0079
Pooling                              2768        3884.9180           0.0640           3.1720           1.4035
Convolution                          2768       15721.5605           0.2260          13.2050           5.6798
CopyCPU2CPU                          1384           7.8540           0.0030           0.0360           0.0057
log_softmax                          1224          38.0870           0.0150           0.0550           0.0311
_backward_copy                       1224          63.1390           0.0220           0.0760           0.0516
_backward_Convolution                2448       22658.4453           2.6370          12.5610           9.2559
_mul_scalar                          1224           4.3740           0.0020           0.0230           0.0036
_backward_log_softmax                1224          20.7430           0.0090           0.0400           0.0169
mean                                 3832          73.5340           0.0080           0.0730           0.0192
_backward_mean                       1224          13.3980           0.0080           0.1030           0.0109
_backward_FullyConnected             3672         698.2110           0.0280           0.5940           0.1901
WaitForVar                           2608          23.2510           0.0060           0.0280           0.0089
broadcast_equal                      1384           6.9020           0.0030           0.0110           0.0050
sgd_update                          12240         120.6960           0.0020           0.0790           0.0099
_backward_Activation                 4896         362.4500           0.0070           0.3900           0.0740



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       47762       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  4158        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             612        2411.1580           0.3060          73.5850           3.9398
MXNDArrayCreateEx                     693          23.6640           0.0310           0.0640           0.0341
MXNDArrayWaitAll                      613       13315.5781           5.6130          25.0210          21.7220
MXNDArraySyncCopyToCPU               1306       10284.1035           0.1180          24.1980           7.8745
MXNDArrayGetDType                    1306           0.4720           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3305           1.5240           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1386          12.1410           0.0070           0.0280           0.0088
MXNDArrayFree                       15539         158.3620           0.0000           0.9140           0.0102
MXNet C API Calls                   69991         557.3480         487.3580         557.3480          34.9950
MXNet C API Concurrency            139981           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1226           0.5760           0.0000           0.0040           0.0005
MXNDArrayGetGradState                6130           3.1770           0.0000           0.0230           0.0005
MXNDArraySetGradState                6130           3.0930           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1226           0.5080           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  613         333.1350           0.5250           0.6810           0.5435
MXNDArrayGetContext                  9622           4.1720           0.0000           0.0070           0.0004
MXImperativeInvokeEx                20283         515.2260           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2452        6009.9111           0.7010           3.7500           2.4510
FullyConnected                       4158         402.0360           0.0080           0.3430           0.0967
argmax                               1386          27.4140           0.0050           0.0480           0.0198
_backward_pick                       1226          19.3550           0.0130           0.0260           0.0158
_backward_mul_scalar                 1226           5.3080           0.0030           0.0160           0.0043
DeleteVariable                      51920         366.0790           0.0010           0.9010           0.0071
Flatten                              1386          57.3940           0.0080           0.1120           0.0414
Activation                           5544         258.0920           0.0030           1.9440           0.0466
SetValueOp                           1226           7.8870           0.0050           0.0180           0.0064
pick                                 1226           9.6380           0.0060           0.0280           0.0079
Pooling                              2772        3894.4460           0.0640           3.1720           1.4049
Convolution                          2772       15759.9043           0.2260          13.2050           5.6854
CopyCPU2CPU                          1386           7.8670           0.0030           0.0360           0.0057
log_softmax                          1226          38.1660           0.0150           0.0550           0.0311
_backward_copy                       1226          63.2610           0.0220           0.0760           0.0516
_backward_Convolution                2452       22701.8516           2.6370          12.5610           9.2585
_mul_scalar                          1226           4.3870           0.0020           0.0230           0.0036
_backward_log_softmax                1226          20.7900           0.0090           0.0400           0.0170
mean                                 3838          73.6900           0.0080           0.0730           0.0192
_backward_mean                       1226          13.4300           0.0080           0.1030           0.0110
_backward_FullyConnected             3678         699.9300           0.0280           0.5940           0.1903
WaitForVar                           2612          23.3020           0.0060           0.0280           0.0089
broadcast_equal                      1386           6.9180           0.0030           0.0110           0.0050
sgd_update                          12260         120.9520           0.0020           0.0790           0.0099
_backward_Activation                 4904         363.1080           0.0070           0.3900           0.0740



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       47836       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  4164        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             613        2414.8269           0.3060          73.5850           3.9394
MXNDArrayCreateEx                     694          23.6990           0.0310           0.0640           0.0341
MXNDArrayWaitAll                      614       13337.4521           5.6130          25.0210          21.7222
MXNDArraySyncCopyToCPU               1308       10298.5137           0.1180          24.1980           7.8735
MXNDArrayGetDType                    1308           0.4730           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3310           1.5250           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1388          12.1580           0.0070           0.0280           0.0088
MXNDArrayFree                       15562         158.6030           0.0000           0.9140           0.0102
MXNet C API Calls                   70098         557.4550         487.3580         557.4550          35.0485
MXNet C API Concurrency            140195           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1228           0.5760           0.0000           0.0040           0.0005
MXNDArrayGetGradState                6140           3.1830           0.0000           0.0230           0.0005
MXNDArraySetGradState                6140           3.0960           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1228           0.5080           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  614         333.6790           0.5250           0.6810           0.5435
MXNDArrayGetContext                  9636           4.1770           0.0000           0.0070           0.0004
MXImperativeInvokeEx                20314         516.0140           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2456        6019.5601           0.7010           3.7500           2.4510
FullyConnected                       4164         402.5610           0.0080           0.3430           0.0967
argmax                               1388          27.4520           0.0050           0.0480           0.0198
_backward_pick                       1228          19.3870           0.0130           0.0260           0.0158
_backward_mul_scalar                 1228           5.3160           0.0030           0.0160           0.0043
DeleteVariable                      52000         366.6220           0.0010           0.9010           0.0071
Flatten                              1388          57.4750           0.0080           0.1120           0.0414
Activation                           5552         258.4470           0.0030           1.9440           0.0466
SetValueOp                           1228           7.9010           0.0050           0.0180           0.0064
pick                                 1228           9.6530           0.0060           0.0280           0.0079
Pooling                              2776        3899.8230           0.0640           3.1720           1.4048
Convolution                          2776       15782.1885           0.2260          13.2050           5.6852
CopyCPU2CPU                          1388           7.8770           0.0030           0.0360           0.0057
log_softmax                          1228          38.2260           0.0150           0.0550           0.0311
_backward_copy                       1228          63.3650           0.0220           0.0760           0.0516
_backward_Convolution                2456       22738.9707           2.6370          12.5610           9.2585
_mul_scalar                          1228           4.3940           0.0020           0.0230           0.0036
_backward_log_softmax                1228          20.8220           0.0090           0.0400           0.0170
mean                                 3844          73.8050           0.0080           0.0730           0.0192
_backward_mean                       1228          13.4520           0.0080           0.1030           0.0110
_backward_FullyConnected             3684         701.0150           0.0280           0.5940           0.1903
WaitForVar                           2616          23.3370           0.0060           0.0280           0.0089
broadcast_equal                      1388           6.9280           0.0030           0.0110           0.0050
sgd_update                          12280         121.1480           0.0020           0.0790           0.0099
_backward_Activation                 4912         363.6580           0.0070           0.3900           0.0740



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       47910       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  4170        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             614        2418.7351           0.3060          73.5850           3.9393
MXNDArrayCreateEx                     695          23.7320           0.0310           0.0640           0.0341
MXNDArrayWaitAll                      615       13359.1836           5.6130          25.0210          21.7222
MXNDArraySyncCopyToCPU               1310       10313.1221           0.1180          24.1980           7.8726
MXNDArrayGetDType                    1310           0.4740           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3315           1.5270           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1390          12.1770           0.0070           0.0280           0.0088
MXNDArrayFree                       15585         158.8490           0.0000           0.9140           0.0102
MXNet C API Calls                   70205         557.5620         487.3580         557.5620          35.1020
MXNet C API Concurrency            140409           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1230           0.5760           0.0000           0.0040           0.0005
MXNDArrayGetGradState                6150           3.1900           0.0000           0.0230           0.0005
MXNDArraySetGradState                6150           3.1010           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1230           0.5080           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  615         334.2240           0.5250           0.6810           0.5435
MXNDArrayGetContext                  9650           4.1790           0.0000           0.0070           0.0004
MXImperativeInvokeEx                20345         516.8180           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2460        6029.3721           0.7010           3.7500           2.4510
FullyConnected                       4170         403.1620           0.0080           0.3430           0.0967
argmax                               1390          27.4900           0.0050           0.0480           0.0198
_backward_pick                       1230          19.4350           0.0130           0.0320           0.0158
_backward_mul_scalar                 1230           5.3260           0.0030           0.0160           0.0043
DeleteVariable                      52080         367.1880           0.0010           0.9010           0.0071
Flatten                              1390          57.5550           0.0080           0.1120           0.0414
Activation                           5560         258.8470           0.0030           1.9440           0.0466
SetValueOp                           1230           7.9160           0.0050           0.0180           0.0064
pick                                 1230           9.6700           0.0060           0.0280           0.0079
Pooling                              2780        3905.2390           0.0640           3.1720           1.4048
Convolution                          2780       15804.4258           0.2260          13.2050           5.6850
CopyCPU2CPU                          1390           7.8870           0.0030           0.0360           0.0057
log_softmax                          1230          38.2850           0.0150           0.0550           0.0311
_backward_copy                       1230          63.4680           0.0220           0.0760           0.0516
_backward_Convolution                2460       22775.7422           2.6370          12.5610           9.2584
_mul_scalar                          1230           4.4010           0.0020           0.0230           0.0036
_backward_log_softmax                1230          20.8640           0.0090           0.0400           0.0170
mean                                 3850          73.9110           0.0080           0.0730           0.0192
_backward_mean                       1230          13.4740           0.0080           0.1030           0.0110
_backward_FullyConnected             3690         702.1980           0.0280           0.5940           0.1903
WaitForVar                           2620          23.3740           0.0060           0.0280           0.0089
broadcast_equal                      1390           6.9390           0.0030           0.0110           0.0050
sgd_update                          12300         121.3170           0.0020           0.0790           0.0099
_backward_Activation                 4920         364.2900           0.0070           0.3900           0.0740



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       47984       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  4176        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             615        2422.6521           0.3060          73.5850           3.9393
MXNDArrayCreateEx                     696          23.7670           0.0310           0.0640           0.0341
MXNDArrayWaitAll                      616       13380.9111           5.6130          25.0210          21.7223
MXNDArraySyncCopyToCPU               1312       10326.9980           0.1180          24.1980           7.8712
MXNDArrayGetDType                    1312           0.4750           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3320           1.5310           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1392          12.1950           0.0070           0.0280           0.0088
MXNDArrayFree                       15608         159.0810           0.0000           0.9140           0.0102
MXNet C API Calls                   70312         557.6690         487.3580         557.6690          35.1555
MXNet C API Concurrency            140623           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1232           0.5770           0.0000           0.0040           0.0005
MXNDArrayGetGradState                6160           3.1920           0.0000           0.0230           0.0005
MXNDArraySetGradState                6160           3.1040           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1232           0.5100           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  616         334.7640           0.5250           0.6810           0.5434
MXNDArrayGetContext                  9664           4.1860           0.0000           0.0070           0.0004
MXImperativeInvokeEx                20376         517.6110           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2464        6039.1279           0.7010           3.7500           2.4509
FullyConnected                       4176         403.6890           0.0080           0.3430           0.0967
argmax                               1392          27.5280           0.0050           0.0480           0.0198
_backward_pick                       1232          19.4690           0.0130           0.0320           0.0158
_backward_mul_scalar                 1232           5.3350           0.0030           0.0160           0.0043
DeleteVariable                      52160         367.7320           0.0010           0.9010           0.0071
Flatten                              1392          57.6380           0.0080           0.1120           0.0414
Activation                           5568         259.2010           0.0030           1.9440           0.0466
SetValueOp                           1232           7.9290           0.0050           0.0180           0.0064
pick                                 1232           9.6840           0.0060           0.0280           0.0079
Pooling                              2784        3910.5791           0.0640           3.1720           1.4047
Convolution                          2784       15826.5713           0.2260          13.2050           5.6848
CopyCPU2CPU                          1392           7.8960           0.0030           0.0360           0.0057
log_softmax                          1232          38.3450           0.0150           0.0550           0.0311
_backward_copy                       1232          63.5720           0.0220           0.0760           0.0516
_backward_Convolution                2464       22812.5020           2.6370          12.5610           9.2583
_mul_scalar                          1232           4.4080           0.0020           0.0230           0.0036
_backward_log_softmax                1232          20.8960           0.0090           0.0400           0.0170
mean                                 3856          74.0490           0.0080           0.0730           0.0192
_backward_mean                       1232          13.4970           0.0080           0.1030           0.0110
_backward_FullyConnected             3696         703.2790           0.0280           0.5940           0.1903
WaitForVar                           2624          23.4080           0.0060           0.0280           0.0089
broadcast_equal                      1392           6.9490           0.0030           0.0110           0.0050
sgd_update                          12320         121.5180           0.0020           0.0790           0.0099
_backward_Activation                 4928         364.8540           0.0070           0.3900           0.0740



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       48058       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  4182        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             616        2426.5630           0.3060          73.5850           3.9392
MXNDArrayCreateEx                     697          23.8010           0.0310           0.0640           0.0341
MXNDArrayWaitAll                      617       13405.7129           5.6130          25.0210          21.7272
MXNDArraySyncCopyToCPU               1314       10352.9766           0.1180          24.1980           7.8790
MXNDArrayGetDType                    1314           0.4750           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3325           1.5350           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1394          12.2130           0.0070           0.0280           0.0088
MXNDArrayFree                       15631         159.3310           0.0000           0.9140           0.0102
MXNet C API Calls                   70419         557.7760         487.3580         557.7760          35.2090
MXNet C API Concurrency            140837           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1234           0.5790           0.0000           0.0040           0.0005
MXNDArrayGetGradState                6170           3.1970           0.0000           0.0230           0.0005
MXNDArraySetGradState                6170           3.1080           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1234           0.5100           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  617         335.3290           0.5250           0.6810           0.5435
MXNDArrayGetContext                  9678           4.1890           0.0000           0.0070           0.0004
MXImperativeInvokeEx                20407         518.4140           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2468        6050.0381           0.7010           3.7500           2.4514
FullyConnected                       4182         404.5840           0.0080           0.3430           0.0967
argmax                               1394          27.5830           0.0050           0.0480           0.0198
_backward_pick                       1234          19.5120           0.0130           0.0320           0.0158
_backward_mul_scalar                 1234           5.3500           0.0030           0.0160           0.0043
DeleteVariable                      52240         368.3670           0.0010           0.9010           0.0071
Flatten                              1394          57.7590           0.0080           0.1120           0.0414
Activation                           5576         259.6240           0.0030           1.9440           0.0466
SetValueOp                           1234           7.9460           0.0050           0.0180           0.0064
pick                                 1234           9.7070           0.0060           0.0280           0.0079
Pooling                              2788        3919.9951           0.0640           3.1720           1.4060
Convolution                          2788       15864.9971           0.2260          13.2050           5.6905
CopyCPU2CPU                          1394           7.9090           0.0030           0.0360           0.0057
log_softmax                          1234          38.4240           0.0150           0.0550           0.0311
_backward_copy                       1234          63.6900           0.0220           0.0760           0.0516
_backward_Convolution                2468       22855.4668           2.6370          12.5610           9.2607
_mul_scalar                          1234           4.4190           0.0020           0.0230           0.0036
_backward_log_softmax                1234          20.9450           0.0090           0.0400           0.0170
mean                                 3862          74.2100           0.0080           0.0730           0.0192
_backward_mean                       1234          13.5280           0.0080           0.1030           0.0110
_backward_FullyConnected             3702         705.0340           0.0280           0.5940           0.1904
WaitForVar                           2628          23.4540           0.0060           0.0280           0.0089
broadcast_equal                      1394           6.9640           0.0030           0.0110           0.0050
sgd_update                          12340         121.7610           0.0020           0.0790           0.0099
_backward_Activation                 4936         365.5210           0.0070           0.3900           0.0741



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       48132       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  4188        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             617        2430.4719           0.3060          73.5850           3.9392
MXNDArrayCreateEx                     698          23.8350           0.0310           0.0640           0.0341
MXNDArrayWaitAll                      618       13427.5889           5.6130          25.0210          21.7275
MXNDArraySyncCopyToCPU               1316       10367.3779           0.1180          24.1980           7.8779
MXNDArrayGetDType                    1316           0.4750           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3330           1.5370           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1396          12.2310           0.0070           0.0280           0.0088
MXNDArrayFree                       15654         159.5660           0.0000           0.9140           0.0102
MXNet C API Calls                   70526         557.8830         487.3580         557.8830          35.2625
MXNet C API Concurrency            141051           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1236           0.5800           0.0000           0.0040           0.0005
MXNDArrayGetGradState                6180           3.2020           0.0000           0.0230           0.0005
MXNDArraySetGradState                6180           3.1120           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1236           0.5110           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  618         335.8700           0.5250           0.6810           0.5435
MXNDArrayGetContext                  9692           4.1930           0.0000           0.0070           0.0004
MXImperativeInvokeEx                20438         519.2010           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2472        6059.8179           0.7010           3.7500           2.4514
FullyConnected                       4188         405.1050           0.0080           0.3430           0.0967
argmax                               1396          27.6230           0.0050           0.0480           0.0198
_backward_pick                       1236          19.5420           0.0130           0.0320           0.0158
_backward_mul_scalar                 1236           5.3590           0.0030           0.0160           0.0043
DeleteVariable                      52320         368.9070           0.0010           0.9010           0.0071
Flatten                              1396          57.8410           0.0080           0.1120           0.0414
Activation                           5584         260.0070           0.0030           1.9440           0.0466
SetValueOp                           1236           7.9590           0.0050           0.0180           0.0064
pick                                 1236           9.7230           0.0060           0.0280           0.0079
Pooling                              2792        3925.3630           0.0640           3.1720           1.4059
Convolution                          2792       15887.2451           0.2260          13.2050           5.6903
CopyCPU2CPU                          1396           7.9190           0.0030           0.0360           0.0057
log_softmax                          1236          38.4840           0.0150           0.0550           0.0311
_backward_copy                       1236          63.7920           0.0220           0.0760           0.0516
_backward_Convolution                2472       22892.5293           2.6370          12.5610           9.2607
_mul_scalar                          1236           4.4260           0.0020           0.0230           0.0036
_backward_log_softmax                1236          20.9780           0.0090           0.0400           0.0170
mean                                 3868          74.3230           0.0080           0.0730           0.0192
_backward_mean                       1236          13.5500           0.0080           0.1030           0.0110
_backward_FullyConnected             3708         706.1050           0.0280           0.5940           0.1904
WaitForVar                           2632          23.4890           0.0060           0.0280           0.0089
broadcast_equal                      1396           6.9740           0.0030           0.0110           0.0050
sgd_update                          12360         121.9100           0.0020           0.0790           0.0099
_backward_Activation                 4944         366.1470           0.0070           0.3900           0.0741



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       48206       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  4194        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             618        2434.3889           0.3060          73.5850           3.9391
MXNDArrayCreateEx                     699          23.8690           0.0310           0.0640           0.0341
MXNDArrayWaitAll                      619       13449.3252           5.6130          25.0210          21.7275
MXNDArraySyncCopyToCPU               1318       10381.9014           0.1180          24.1980           7.8770
MXNDArrayGetDType                    1318           0.4750           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3335           1.5390           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1398          12.2490           0.0070           0.0280           0.0088
MXNDArrayFree                       15677         159.8000           0.0000           0.9140           0.0102
MXNet C API Calls                   70633         557.9900         487.3580         557.9900          35.3160
MXNet C API Concurrency            141265           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1238           0.5810           0.0000           0.0040           0.0005
MXNDArrayGetGradState                6190           3.2050           0.0000           0.0230           0.0005
MXNDArraySetGradState                6190           3.1170           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1238           0.5130           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  619         336.4060           0.5250           0.6810           0.5435
MXNDArrayGetContext                  9706           4.1980           0.0000           0.0070           0.0004
MXImperativeInvokeEx                20469         519.9810           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2476        6069.5151           0.7010           3.7500           2.4513
FullyConnected                       4194         405.7160           0.0080           0.3430           0.0967
argmax                               1398          27.6650           0.0050           0.0480           0.0198
_backward_pick                       1238          19.5730           0.0130           0.0320           0.0158
_backward_mul_scalar                 1238           5.3680           0.0030           0.0160           0.0043
DeleteVariable                      52400         369.4790           0.0010           0.9010           0.0071
Flatten                              1398          57.9220           0.0080           0.1120           0.0414
Activation                           5592         260.3820           0.0030           1.9440           0.0466
SetValueOp                           1238           7.9730           0.0050           0.0180           0.0064
pick                                 1238           9.7420           0.0060           0.0280           0.0079
Pooling                              2796        3930.6919           0.0640           3.1720           1.4058
Convolution                          2796       15909.5146           0.2260          13.2050           5.6901
CopyCPU2CPU                          1398           7.9290           0.0030           0.0360           0.0057
log_softmax                          1238          38.5430           0.0150           0.0550           0.0311
_backward_copy                       1238          63.8920           0.0220           0.0760           0.0516
_backward_Convolution                2476       22929.3594           2.6370          12.5610           9.2606
_mul_scalar                          1238           4.4330           0.0020           0.0230           0.0036
_backward_log_softmax                1238          21.0200           0.0090           0.0400           0.0170
mean                                 3874          74.4280           0.0080           0.0730           0.0192
_backward_mean                       1238          13.5730           0.0080           0.1030           0.0110
_backward_FullyConnected             3714         707.2910           0.0280           0.5940           0.1904
WaitForVar                           2636          23.5250           0.0060           0.0280           0.0089
broadcast_equal                      1398           6.9840           0.0030           0.0110           0.0050
sgd_update                          12380         122.1420           0.0020           0.0790           0.0099
_backward_Activation                 4952         366.7150           0.0070           0.3900           0.0741



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       48280       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  4200        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             619        2438.5200           0.3060          73.5850           3.9395
MXNDArrayCreateEx                     700          23.9030           0.0310           0.0640           0.0341
MXNDArrayWaitAll                      620       13471.0879           5.6130          25.0210          21.7276
MXNDArraySyncCopyToCPU               1320       10396.3291           0.1180          24.1980           7.8760
MXNDArrayGetDType                    1320           0.4750           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3340           1.5410           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1400          12.2660           0.0070           0.0280           0.0088
MXNDArrayFree                       15700         160.0300           0.0000           0.9140           0.0102
MXNet C API Calls                   70740         558.0970         487.3580         558.0970          35.3695
MXNet C API Concurrency            141479           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1240           0.5830           0.0000           0.0040           0.0005
MXNDArrayGetGradState                6200           3.2090           0.0000           0.0230           0.0005
MXNDArraySetGradState                6200           3.1230           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1240           0.5140           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  620         336.9680           0.5250           0.6810           0.5435
MXNDArrayGetContext                  9720           4.2030           0.0000           0.0070           0.0004
MXImperativeInvokeEx                20500         520.7590           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2480        6079.2139           0.7010           3.7500           2.4513
FullyConnected                       4200         406.3350           0.0080           0.3430           0.0967
argmax                               1400          27.7080           0.0050           0.0480           0.0198
_backward_pick                       1240          19.6040           0.0130           0.0320           0.0158
_backward_mul_scalar                 1240           5.3760           0.0030           0.0160           0.0043
DeleteVariable                      52480         370.0240           0.0010           0.9010           0.0071
Flatten                              1400          58.0020           0.0080           0.1120           0.0414
Activation                           5600         260.7540           0.0030           1.9440           0.0466
SetValueOp                           1240           7.9850           0.0050           0.0180           0.0064
pick                                 1240           9.7570           0.0060           0.0280           0.0079
Pooling                              2800        3936.1130           0.0640           3.1720           1.4058
Convolution                          2800       15931.6133           0.2260          13.2050           5.6899
CopyCPU2CPU                          1400           7.9400           0.0030           0.0360           0.0057
log_softmax                          1240          38.6030           0.0150           0.0550           0.0311
_backward_copy                       1240          63.9940           0.0220           0.0760           0.0516
_backward_Convolution                2480       22966.1602           2.6370          12.5610           9.2605
_mul_scalar                          1240           4.4400           0.0020           0.0230           0.0036
_backward_log_softmax                1240          21.0620           0.0090           0.0400           0.0170
mean                                 3880          74.5320           0.0080           0.0730           0.0192
_backward_mean                       1240          13.5950           0.0080           0.1030           0.0110
_backward_FullyConnected             3720         708.4650           0.0280           0.5940           0.1904
WaitForVar                           2640          23.5610           0.0060           0.0280           0.0089
broadcast_equal                      1400           6.9950           0.0030           0.0110           0.0050
sgd_update                          12400         122.3720           0.0020           0.0790           0.0099
_backward_Activation                 4960         367.2730           0.0070           0.3900           0.0740



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       48354       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  4206        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             620        2442.4241           0.3060          73.5850           3.9394
MXNDArrayCreateEx                     701          23.9370           0.0310           0.0640           0.0341
MXNDArrayWaitAll                      621       13496.1494           5.6130          25.0610          21.7329
MXNDArraySyncCopyToCPU               1322       10421.9121           0.1180          24.1980           7.8834
MXNDArrayGetDType                    1322           0.4750           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3345           1.5420           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1402          12.2840           0.0070           0.0280           0.0088
MXNDArrayFree                       15723         160.2730           0.0000           0.9140           0.0102
MXNet C API Calls                   70847         558.2040         487.3580         558.2040          35.4230
MXNet C API Concurrency            141693           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1242           0.5830           0.0000           0.0040           0.0005
MXNDArrayGetGradState                6210           3.2140           0.0000           0.0230           0.0005
MXNDArraySetGradState                6210           3.1280           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1242           0.5150           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  621         337.5100           0.5250           0.6810           0.5435
MXNDArrayGetContext                  9734           4.2100           0.0000           0.0070           0.0004
MXImperativeInvokeEx                20531         521.5490           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2484        6090.2969           0.7010           3.7500           2.4518
FullyConnected                       4206         407.1970           0.0080           0.3430           0.0968
argmax                               1402          27.7640           0.0050           0.0480           0.0198
_backward_pick                       1242          19.6470           0.0130           0.0320           0.0158
_backward_mul_scalar                 1242           5.3910           0.0030           0.0160           0.0043
DeleteVariable                      52560         370.6610           0.0010           0.9010           0.0071
Flatten                              1402          58.1030           0.0080           0.1120           0.0414
Activation                           5608         261.1750           0.0030           1.9440           0.0466
SetValueOp                           1242           8.0040           0.0050           0.0180           0.0064
pick                                 1242           9.7790           0.0060           0.0280           0.0079
Pooling                              2804        3945.6060           0.0640           3.1720           1.4071
Convolution                          2804       15969.9365           0.2260          13.2050           5.6954
CopyCPU2CPU                          1402           7.9520           0.0030           0.0360           0.0057
log_softmax                          1242          38.6830           0.0150           0.0550           0.0311
_backward_copy                       1242          64.1130           0.0220           0.0760           0.0516
_backward_Convolution                2484       23009.5840           2.6370          12.5610           9.2631
_mul_scalar                          1242           4.4520           0.0020           0.0230           0.0036
_backward_log_softmax                1242          21.1090           0.0090           0.0400           0.0170
mean                                 3886          74.6900           0.0080           0.0730           0.0192
_backward_mean                       1242          13.6260           0.0080           0.1030           0.0110
_backward_FullyConnected             3726         710.1840           0.0280           0.5940           0.1906
WaitForVar                           2644          23.6110           0.0060           0.0280           0.0089
broadcast_equal                      1402           7.0090           0.0030           0.0110           0.0050
sgd_update                          12420         122.6610           0.0020           0.0790           0.0099
_backward_Activation                 4968         367.8630           0.0070           0.3900           0.0740



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       48428       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  4212        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             621        2446.4021           0.3060          73.5850           3.9395
MXNDArrayCreateEx                     702          23.9720           0.0310           0.0640           0.0341
MXNDArrayWaitAll                      622       13518.0410           5.6130          25.0610          21.7332
MXNDArraySyncCopyToCPU               1324       10436.3203           0.1180          24.1980           7.8824
MXNDArrayGetDType                    1324           0.4760           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3350           1.5630           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1404          12.3020           0.0070           0.0280           0.0088
MXNDArrayFree                       15746         160.5090           0.0000           0.9140           0.0102
MXNet C API Calls                   70954         558.3110         487.3580         558.3110          35.4765
MXNet C API Concurrency            141907           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1244           0.5850           0.0000           0.0040           0.0005
MXNDArrayGetGradState                6220           3.2200           0.0000           0.0230           0.0005
MXNDArraySetGradState                6220           3.1320           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1244           0.5160           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  622         338.0500           0.5250           0.6810           0.5435
MXNDArrayGetContext                  9748           4.2170           0.0000           0.0070           0.0004
MXImperativeInvokeEx                20562         522.3360           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2488        6100.0171           0.7010           3.7500           2.4518
FullyConnected                       4212         407.7440           0.0080           0.3430           0.0968
argmax                               1404          27.8020           0.0050           0.0480           0.0198
_backward_pick                       1244          19.6770           0.0130           0.0320           0.0158
_backward_mul_scalar                 1244           5.4010           0.0030           0.0160           0.0043
DeleteVariable                      52640         371.1990           0.0010           0.9010           0.0071
Flatten                              1404          58.1830           0.0080           0.1120           0.0414
Activation                           5616         261.5280           0.0030           1.9440           0.0466
SetValueOp                           1244           8.0160           0.0050           0.0180           0.0064
pick                                 1244           9.7950           0.0060           0.0280           0.0079
Pooling                              2808        3950.9360           0.0640           3.1720           1.4070
Convolution                          2808       15992.2002           0.2260          13.2050           5.6952
CopyCPU2CPU                          1404           7.9620           0.0030           0.0360           0.0057
log_softmax                          1244          38.7430           0.0150           0.0550           0.0311
_backward_copy                       1244          64.2160           0.0220           0.0760           0.0516
_backward_Convolution                2488       23046.7285           2.6370          12.5610           9.2632
_mul_scalar                          1244           4.4590           0.0020           0.0230           0.0036
_backward_log_softmax                1244          21.1410           0.0090           0.0400           0.0170
mean                                 3892          74.8080           0.0080           0.0730           0.0192
_backward_mean                       1244          13.6480           0.0080           0.1030           0.0110
_backward_FullyConnected             3732         711.2840           0.0280           0.5940           0.1906
WaitForVar                           2648          23.6460           0.0060           0.0280           0.0089
broadcast_equal                      1404           7.0190           0.0030           0.0110           0.0050
sgd_update                          12440         122.8580           0.0020           0.0790           0.0099
_backward_Activation                 4976         368.4110           0.0070           0.3900           0.0740



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       48502       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  4218        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             622        2450.3210           0.3060          73.5850           3.9394
MXNDArrayCreateEx                     703          24.0060           0.0310           0.0640           0.0341
MXNDArrayWaitAll                      623       13539.7842           5.6130          25.0610          21.7332
MXNDArraySyncCopyToCPU               1326       10450.8965           0.1180          24.1980           7.8815
MXNDArrayGetDType                    1326           0.4770           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3355           1.5670           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1406          12.3190           0.0070           0.0280           0.0088
MXNDArrayFree                       15769         160.7460           0.0000           0.9140           0.0102
MXNet C API Calls                   71061         558.4180         487.3580         558.4180          35.5300
MXNet C API Concurrency            142121           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1246           0.5870           0.0000           0.0040           0.0005
MXNDArrayGetGradState                6230           3.2240           0.0000           0.0230           0.0005
MXNDArraySetGradState                6230           3.1400           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1246           0.5170           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  623         338.5930           0.5250           0.6810           0.5435
MXNDArrayGetContext                  9762           4.2230           0.0000           0.0070           0.0004
MXImperativeInvokeEx                20593         523.1110           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2492        6109.7329           0.7010           3.7500           2.4517
FullyConnected                       4218         408.3580           0.0080           0.3430           0.0968
argmax                               1406          27.8460           0.0050           0.0480           0.0198
_backward_pick                       1246          19.7090           0.0130           0.0320           0.0158
_backward_mul_scalar                 1246           5.4100           0.0030           0.0160           0.0043
DeleteVariable                      52720         371.7700           0.0010           0.9010           0.0071
Flatten                              1406          58.2620           0.0080           0.1120           0.0414
Activation                           5624         261.8970           0.0030           1.9440           0.0466
SetValueOp                           1246           8.0290           0.0050           0.0180           0.0064
pick                                 1246           9.8100           0.0060           0.0280           0.0079
Pooling                              2812        3956.3730           0.0640           3.1720           1.4070
Convolution                          2812       16014.4746           0.2260          13.2050           5.6950
CopyCPU2CPU                          1406           7.9720           0.0030           0.0360           0.0057
log_softmax                          1246          38.8030           0.0150           0.0550           0.0311
_backward_copy                       1246          64.3190           0.0220           0.0760           0.0516
_backward_Convolution                2492       23083.5840           2.6370          12.5610           9.2631
_mul_scalar                          1246           4.4660           0.0020           0.0230           0.0036
_backward_log_softmax                1246          21.1830           0.0090           0.0400           0.0170
mean                                 3898          74.9120           0.0080           0.0730           0.0192
_backward_mean                       1246          13.6700           0.0080           0.1030           0.0110
_backward_FullyConnected             3738         712.4590           0.0280           0.5940           0.1906
WaitForVar                           2652          23.6830           0.0060           0.0280           0.0089
broadcast_equal                      1406           7.0290           0.0030           0.0110           0.0050
sgd_update                          12460         123.0740           0.0020           0.0790           0.0099
_backward_Activation                 4984         368.9740           0.0070           0.3900           0.0740



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       48576       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  4224        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             623        2454.2319           0.3060          73.5850           3.9394
MXNDArrayCreateEx                     704          24.0440           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      624       13561.4912           5.6130          25.0610          21.7332
MXNDArraySyncCopyToCPU               1328       10465.2930           0.1180          24.1980           7.8805
MXNDArrayGetDType                    1328           0.4770           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3360           1.5700           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1408          12.3380           0.0070           0.0280           0.0088
MXNDArrayFree                       15792         160.9860           0.0000           0.9140           0.0102
MXNet C API Calls                   71168         558.5250         487.3580         558.5250          35.5835
MXNet C API Concurrency            142335           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1248           0.5870           0.0000           0.0040           0.0005
MXNDArrayGetGradState                6240           3.2290           0.0000           0.0230           0.0005
MXNDArraySetGradState                6240           3.1430           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1248           0.5170           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  624         339.1440           0.5250           0.6810           0.5435
MXNDArrayGetContext                  9776           4.2280           0.0000           0.0070           0.0004
MXImperativeInvokeEx                20624         523.9150           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2496        6119.3008           0.7010           3.7500           2.4516
FullyConnected                       4224         408.9880           0.0080           0.3430           0.0968
argmax                               1408          27.8890           0.0050           0.0480           0.0198
_backward_pick                       1248          19.7390           0.0130           0.0320           0.0158
_backward_mul_scalar                 1248           5.4190           0.0030           0.0160           0.0043
DeleteVariable                      52800         372.3700           0.0010           0.9010           0.0071
Flatten                              1408          58.3430           0.0080           0.1120           0.0414
Activation                           5632         262.2720           0.0030           1.9440           0.0466
SetValueOp                           1248           8.0420           0.0050           0.0180           0.0064
pick                                 1248           9.8260           0.0060           0.0280           0.0079
Pooling                              2816        3961.7329           0.0640           3.1720           1.4069
Convolution                          2816       16036.5869           0.2260          13.2050           5.6948
CopyCPU2CPU                          1408           7.9830           0.0030           0.0360           0.0057
log_softmax                          1248          38.8630           0.0150           0.0550           0.0311
_backward_copy                       1248          64.4200           0.0220           0.0760           0.0516
_backward_Convolution                2496       23120.3828           2.6370          12.5610           9.2630
_mul_scalar                          1248           4.4730           0.0020           0.0230           0.0036
_backward_log_softmax                1248          21.2250           0.0090           0.0400           0.0170
mean                                 3904          75.0420           0.0080           0.0730           0.0192
_backward_mean                       1248          13.6910           0.0080           0.1030           0.0110
_backward_FullyConnected             3744         713.6470           0.0280           0.5940           0.1906
WaitForVar                           2656          23.7200           0.0060           0.0280           0.0089
broadcast_equal                      1408           7.0380           0.0030           0.0110           0.0050
sgd_update                          12480         123.2920           0.0020           0.0790           0.0099
_backward_Activation                 4992         369.5540           0.0070           0.3900           0.0740



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       48650       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  4230        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             624        2458.1709           0.3060          73.5850           3.9394
MXNDArrayCreateEx                     705          24.0780           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      625       13583.3359           5.6130          25.0610          21.7333
MXNDArraySyncCopyToCPU               1330       10479.6396           0.1180          24.1980           7.8794
MXNDArrayGetDType                    1330           0.4790           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3365           1.5710           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1410          12.3570           0.0070           0.0280           0.0088
MXNDArrayFree                       15815         161.2210           0.0000           0.9140           0.0102
MXNet C API Calls                   71275         558.6320         487.3580         558.6320          35.6370
MXNet C API Concurrency            142549           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1250           0.5880           0.0000           0.0040           0.0005
MXNDArrayGetGradState                6250           3.2320           0.0000           0.0230           0.0005
MXNDArraySetGradState                6250           3.1470           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1250           0.5180           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  625         339.6850           0.5250           0.6810           0.5435
MXNDArrayGetContext                  9790           4.2350           0.0000           0.0070           0.0004
MXImperativeInvokeEx                20655         524.7000           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2500        6128.9570           0.7010           3.7500           2.4516
FullyConnected                       4230         409.5110           0.0080           0.3430           0.0968
argmax                               1410          27.9280           0.0050           0.0480           0.0198
_backward_pick                       1250          19.7710           0.0130           0.0320           0.0158
_backward_mul_scalar                 1250           5.4270           0.0030           0.0160           0.0043
DeleteVariable                      52880         372.9340           0.0010           0.9010           0.0071
Flatten                              1410          58.4250           0.0080           0.1120           0.0414
Activation                           5640         262.6240           0.0030           1.9440           0.0466
SetValueOp                           1250           8.0550           0.0050           0.0180           0.0064
pick                                 1250           9.8410           0.0060           0.0280           0.0079
Pooling                              2820        3967.0811           0.0640           3.1720           1.4068
Convolution                          2820       16058.7676           0.2260          13.2050           5.6946
CopyCPU2CPU                          1410           7.9930           0.0030           0.0360           0.0057
log_softmax                          1250          38.9230           0.0150           0.0550           0.0311
_backward_copy                       1250          64.5240           0.0220           0.0760           0.0516
_backward_Convolution                2500       23157.4746           2.6370          12.5610           9.2630
_mul_scalar                          1250           4.4800           0.0020           0.0230           0.0036
_backward_log_softmax                1250          21.2560           0.0090           0.0400           0.0170
mean                                 3910          75.1620           0.0080           0.0730           0.0192
_backward_mean                       1250          13.7140           0.0080           0.1030           0.0110
_backward_FullyConnected             3750         714.7220           0.0280           0.5940           0.1906
WaitForVar                           2660          23.7560           0.0060           0.0280           0.0089
broadcast_equal                      1410           7.0490           0.0030           0.0110           0.0050
sgd_update                          12500         123.4930           0.0020           0.0790           0.0099
_backward_Activation                 5000         370.1030           0.0070           0.3900           0.0740



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       48724       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  4236        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             625        2462.0911           0.3060          73.5850           3.9393
MXNDArrayCreateEx                     706          24.1120           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      626       13605.1309           5.6130          25.0610          21.7334
MXNDArraySyncCopyToCPU               1332       10494.0430           0.1180          24.1980           7.8784
MXNDArrayGetDType                    1332           0.4800           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3370           1.5730           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1412          12.3740           0.0070           0.0280           0.0088
MXNDArrayFree                       15838         161.4510           0.0000           0.9140           0.0102
MXNet C API Calls                   71382         558.7390         487.3580         558.7390          35.6905
MXNet C API Concurrency            142763           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1252           0.5890           0.0000           0.0040           0.0005
MXNDArrayGetGradState                6260           3.2380           0.0000           0.0230           0.0005
MXNDArraySetGradState                6260           3.1510           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1252           0.5190           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  626         340.2290           0.5250           0.6810           0.5435
MXNDArrayGetContext                  9804           4.2410           0.0000           0.0070           0.0004
MXImperativeInvokeEx                20686         525.4950           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2504        6138.5278           0.7010           3.7500           2.4515
FullyConnected                       4236         410.0630           0.0080           0.3430           0.0968
argmax                               1412          27.9670           0.0050           0.0480           0.0198
_backward_pick                       1252          19.8010           0.0130           0.0320           0.0158
_backward_mul_scalar                 1252           5.4360           0.0030           0.0160           0.0043
DeleteVariable                      52960         373.4720           0.0010           0.9010           0.0071
Flatten                              1412          58.5070           0.0080           0.1120           0.0414
Activation                           5648         262.9810           0.0030           1.9440           0.0466
SetValueOp                           1252           8.0680           0.0050           0.0180           0.0064
pick                                 1252           9.8560           0.0060           0.0280           0.0079
Pooling                              2824        3972.4651           0.0640           3.1720           1.4067
Convolution                          2824       16081.0303           0.2260          13.2050           5.6944
CopyCPU2CPU                          1412           8.0040           0.0030           0.0360           0.0057
log_softmax                          1252          38.9820           0.0150           0.0550           0.0311
_backward_copy                       1252          64.6280           0.0220           0.0760           0.0516
_backward_Convolution                2504       23194.5625           2.6370          12.5610           9.2630
_mul_scalar                          1252           4.4870           0.0020           0.0230           0.0036
_backward_log_softmax                1252          21.2880           0.0090           0.0400           0.0170
mean                                 3916          75.2770           0.0080           0.0730           0.0192
_backward_mean                       1252          13.7350           0.0080           0.1030           0.0110
_backward_FullyConnected             3756         715.7920           0.0280           0.5940           0.1906
WaitForVar                           2664          23.7910           0.0060           0.0280           0.0089
broadcast_equal                      1412           7.0590           0.0030           0.0110           0.0050
sgd_update                          12520         123.6980           0.0020           0.0790           0.0099
_backward_Activation                 5008         370.6580           0.0070           0.3900           0.0740



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       48798       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  4242        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             626        2466.0581           0.3060          73.5850           3.9394
MXNDArrayCreateEx                     707          24.1580           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      627       13626.8906           5.6130          25.0610          21.7335
MXNDArraySyncCopyToCPU               1334       10508.7881           0.1180          24.1980           7.8777
MXNDArrayGetDType                    1334           0.4800           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3375           1.5770           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1414          12.3920           0.0070           0.0280           0.0088
MXNDArrayFree                       15861         161.6980           0.0000           0.9140           0.0102
MXNet C API Calls                   71489         558.8460         487.3580         558.8460          35.7440
MXNet C API Concurrency            142977           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1254           0.5900           0.0000           0.0040           0.0005
MXNDArrayGetGradState                6270           3.2460           0.0000           0.0230           0.0005
MXNDArraySetGradState                6270           3.1570           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1254           0.5210           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  627         341.1740           0.5250           0.9450           0.5441
MXNDArrayGetContext                  9818           4.2470           0.0000           0.0070           0.0004
MXImperativeInvokeEx                20717         526.6710           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2508        6148.2778           0.7010           3.7500           2.4515
FullyConnected                       4242         410.6740           0.0080           0.3430           0.0968
argmax                               1414          28.0130           0.0050           0.0480           0.0198
_backward_pick                       1254          19.8380           0.0130           0.0320           0.0158
_backward_mul_scalar                 1254           5.4450           0.0030           0.0160           0.0043
DeleteVariable                      53040         374.0330           0.0010           0.9010           0.0071
Flatten                              1414          58.5910           0.0080           0.1120           0.0414
Activation                           5656         263.3480           0.0030           1.9440           0.0466
SetValueOp                           1254           8.0830           0.0050           0.0180           0.0064
pick                                 1254           9.8730           0.0060           0.0280           0.0079
Pooling                              2828        3977.8799           0.0640           3.1720           1.4066
Convolution                          2828       16107.0684           0.2260          13.2050           5.6956
CopyCPU2CPU                          1414           8.0140           0.0030           0.0360           0.0057
log_softmax                          1254          39.0430           0.0150           0.0550           0.0311
_backward_copy                       1254          64.7270           0.0220           0.0760           0.0516
_backward_Convolution                2508       23231.4785           2.6370          12.5610           9.2629
_mul_scalar                          1254           4.4950           0.0020           0.0230           0.0036
_backward_log_softmax                1254          21.3310           0.0090           0.0400           0.0170
mean                                 3922          75.3850           0.0080           0.0730           0.0192
_backward_mean                       1254          13.7580           0.0080           0.1030           0.0110
_backward_FullyConnected             3762         717.2630           0.0280           0.5940           0.1907
WaitForVar                           2668          23.8270           0.0060           0.0280           0.0089
broadcast_equal                      1414           7.0690           0.0030           0.0110           0.0050
sgd_update                          12540         123.9240           0.0020           0.0790           0.0099
_backward_Activation                 5016         371.2370           0.0070           0.3900           0.0740



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       48872       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  4248        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             627        2470.0061           0.3060          73.5850           3.9394
MXNDArrayCreateEx                     708          24.2040           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      628       13648.5713           5.6130          25.0610          21.7334
MXNDArraySyncCopyToCPU               1336       10523.5283           0.1180          24.1980           7.8769
MXNDArrayGetDType                    1336           0.4810           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3380           1.5800           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1416          12.4090           0.0070           0.0280           0.0088
MXNDArrayFree                       15884         161.9450           0.0000           0.9140           0.0102
MXNet C API Calls                   71596         558.9530         487.3580         558.9530          35.7975
MXNet C API Concurrency            143191           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1256           0.5910           0.0000           0.0040           0.0005
MXNDArrayGetGradState                6280           3.2540           0.0000           0.0230           0.0005
MXNDArraySetGradState                6280           3.1640           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1256           0.5230           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  628         342.1040           0.5250           0.9450           0.5448
MXNDArrayGetContext                  9832           4.2550           0.0000           0.0070           0.0004
MXImperativeInvokeEx                20748         527.8260           0.0090           0.1450           0.0254

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2512        6157.9351           0.7010           3.7500           2.4514
FullyConnected                       4248         411.2820           0.0080           0.3430           0.0968
argmax                               1416          28.0550           0.0050           0.0480           0.0198
_backward_pick                       1256          19.8710           0.0130           0.0320           0.0158
_backward_mul_scalar                 1256           5.4540           0.0030           0.0160           0.0043
DeleteVariable                      53120         374.5760           0.0010           0.9010           0.0071
Flatten                              1416          58.6710           0.0080           0.1120           0.0414
Activation                           5664         263.7210           0.0030           1.9440           0.0466
SetValueOp                           1256           8.0980           0.0050           0.0180           0.0064
pick                                 1256           9.8880           0.0060           0.0280           0.0079
Pooling                              2832        3983.2830           0.0640           3.1720           1.4065
Convolution                          2832       16132.9912           0.2260          13.2050           5.6967
CopyCPU2CPU                          1416           8.0240           0.0030           0.0360           0.0057
log_softmax                          1256          39.1150           0.0150           0.0550           0.0311
_backward_copy                       1256          64.8290           0.0220           0.0760           0.0516
_backward_Convolution                2512       23268.2988           2.6370          12.5610           9.2629
_mul_scalar                          1256           4.5020           0.0020           0.0230           0.0036
_backward_log_softmax                1256          21.3640           0.0090           0.0400           0.0170
mean                                 3928          75.4920           0.0080           0.0730           0.0192
_backward_mean                       1256          13.7830           0.0080           0.1030           0.0110
_backward_FullyConnected             3768         718.7420           0.0280           0.5940           0.1907
WaitForVar                           2672          23.8630           0.0060           0.0280           0.0089
broadcast_equal                      1416           7.0790           0.0030           0.0110           0.0050
sgd_update                          12560         124.1270           0.0020           0.0790           0.0099
_backward_Activation                 5024         371.8630           0.0070           0.3900           0.0740



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       48946       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  4254        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             628        2473.9441           0.3060          73.5850           3.9394
MXNDArrayCreateEx                     709          24.2490           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      629       13670.4170           5.6130          25.0610          21.7336
MXNDArraySyncCopyToCPU               1338       10538.1895           0.1180          24.1980           7.8761
MXNDArrayGetDType                    1338           0.4830           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3385           1.5840           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1418          12.4260           0.0070           0.0280           0.0088
MXNDArrayFree                       15907         162.1930           0.0000           0.9140           0.0102
MXNet C API Calls                   71703         559.0600         487.3580         559.0600          35.8510
MXNet C API Concurrency            143405           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1258           0.5910           0.0000           0.0040           0.0005
MXNDArrayGetGradState                6290           3.2600           0.0000           0.0230           0.0005
MXNDArraySetGradState                6290           3.1720           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1258           0.5230           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  629         343.0220           0.5250           0.9450           0.5453
MXNDArrayGetContext                  9846           4.2630           0.0000           0.0070           0.0004
MXImperativeInvokeEx                20779         528.9830           0.0090           0.1450           0.0255

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2516        6167.6641           0.7010           3.7500           2.4514
FullyConnected                       4254         411.8110           0.0080           0.3430           0.0968
argmax                               1418          28.0970           0.0050           0.0480           0.0198
_backward_pick                       1258          19.9030           0.0130           0.0320           0.0158
_backward_mul_scalar                 1258           5.4630           0.0030           0.0160           0.0043
DeleteVariable                      53200         375.1230           0.0010           0.9010           0.0071
Flatten                              1418          58.7510           0.0080           0.1120           0.0414
Activation                           5672         264.0760           0.0030           1.9440           0.0466
SetValueOp                           1258           8.1120           0.0050           0.0180           0.0064
pick                                 1258           9.9030           0.0060           0.0280           0.0079
Pooling                              2836        3988.6550           0.0640           3.1720           1.4064
Convolution                          2836       16158.9873           0.2260          13.2050           5.6978
CopyCPU2CPU                          1418           8.0340           0.0030           0.0360           0.0057
log_softmax                          1258          39.1760           0.0150           0.0550           0.0311
_backward_copy                       1258          64.9300           0.0220           0.0760           0.0516
_backward_Convolution                2516       23305.3535           2.6370          12.5610           9.2629
_mul_scalar                          1258           4.5100           0.0020           0.0230           0.0036
_backward_log_softmax                1258          21.3960           0.0090           0.0400           0.0170
mean                                 3934          75.6090           0.0080           0.0730           0.0192
_backward_mean                       1258          13.8050           0.0080           0.1030           0.0110
_backward_FullyConnected             3774         720.2050           0.0280           0.5940           0.1908
WaitForVar                           2676          23.8990           0.0060           0.0280           0.0089
broadcast_equal                      1418           7.0890           0.0030           0.0110           0.0050
sgd_update                          12580         124.3480           0.0020           0.0790           0.0099
_backward_Activation                 5032         372.4340           0.0070           0.3900           0.0740



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       49020       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  4260        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             629        2477.8931           0.3060          73.5850           3.9394
MXNDArrayCreateEx                     710          24.2950           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      630       13692.2656           5.6130          25.0610          21.7338
MXNDArraySyncCopyToCPU               1340       10552.9102           0.1180          24.1980           7.8753
MXNDArrayGetDType                    1340           0.4830           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3390           1.5880           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1420          12.4430           0.0070           0.0280           0.0088
MXNDArrayFree                       15930         162.4300           0.0000           0.9140           0.0102
MXNet C API Calls                   71810         559.1670         487.3580         559.1670          35.9045
MXNet C API Concurrency            143619           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1260           0.5910           0.0000           0.0040           0.0005
MXNDArrayGetGradState                6300           3.2660           0.0000           0.0230           0.0005
MXNDArraySetGradState                6300           3.1780           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1260           0.5230           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  630         343.9410           0.5250           0.9450           0.5459
MXNDArrayGetContext                  9860           4.2710           0.0000           0.0070           0.0004
MXImperativeInvokeEx                20810         530.1540           0.0090           0.1450           0.0255

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2520        6177.3179           0.7010           3.7500           2.4513
FullyConnected                       4260         412.3350           0.0080           0.3430           0.0968
argmax                               1420          28.1390           0.0050           0.0480           0.0198
_backward_pick                       1260          19.9340           0.0130           0.0320           0.0158
_backward_mul_scalar                 1260           5.4720           0.0030           0.0160           0.0043
DeleteVariable                      53280         375.6630           0.0010           0.9010           0.0071
Flatten                              1420          58.8330           0.0080           0.1120           0.0414
Activation                           5680         264.4300           0.0030           1.9440           0.0466
SetValueOp                           1260           8.1260           0.0050           0.0180           0.0064
pick                                 1260           9.9180           0.0060           0.0280           0.0079
Pooling                              2840        3994.0720           0.0640           3.1720           1.4064
Convolution                          2840       16185.0215           0.2260          13.2050           5.6990
CopyCPU2CPU                          1420           8.0450           0.0030           0.0360           0.0057
log_softmax                          1260          39.2370           0.0150           0.0550           0.0311
_backward_copy                       1260          65.0320           0.0220           0.0760           0.0516
_backward_Convolution                2520       23342.5293           2.6370          12.5610           9.2629
_mul_scalar                          1260           4.5170           0.0020           0.0230           0.0036
_backward_log_softmax                1260          21.4280           0.0090           0.0400           0.0170
mean                                 3940          75.7320           0.0080           0.0730           0.0192
_backward_mean                       1260          13.8260           0.0080           0.1030           0.0110
_backward_FullyConnected             3780         721.6610           0.0280           0.5940           0.1909
WaitForVar                           2680          23.9360           0.0060           0.0280           0.0089
broadcast_equal                      1420           7.0980           0.0030           0.0110           0.0050
sgd_update                          12600         124.5670           0.0020           0.0790           0.0099
_backward_Activation                 5040         372.9910           0.0070           0.3900           0.0740



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       49094       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  4266        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             630        2481.8391           0.3060          73.5850           3.9394
MXNDArrayCreateEx                     711          24.3410           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      631       13713.9463           5.6130          25.0610          21.7337
MXNDArraySyncCopyToCPU               1342       10567.6484           0.1180          24.1980           7.8746
MXNDArrayGetDType                    1342           0.4840           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3395           1.5920           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1422          12.4600           0.0070           0.0280           0.0088
MXNDArrayFree                       15953         162.6860           0.0000           0.9140           0.0102
MXNet C API Calls                   71917         559.2740         487.3580         559.2740          35.9580
MXNet C API Concurrency            143833           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1262           0.5930           0.0000           0.0040           0.0005
MXNDArrayGetGradState                6310           3.2740           0.0000           0.0230           0.0005
MXNDArraySetGradState                6310           3.1840           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1262           0.5250           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  631         344.8780           0.5250           0.9450           0.5466
MXNDArrayGetContext                  9874           4.2810           0.0000           0.0070           0.0004
MXImperativeInvokeEx                20841         531.3120           0.0090           0.1450           0.0255

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2524        6186.9009           0.7010           3.7500           2.4512
FullyConnected                       4266         412.9610           0.0080           0.3430           0.0968
argmax                               1422          28.1860           0.0050           0.0480           0.0198
_backward_pick                       1262          19.9650           0.0130           0.0320           0.0158
_backward_mul_scalar                 1262           5.4810           0.0030           0.0160           0.0043
DeleteVariable                      53360         376.2500           0.0010           0.9010           0.0071
Flatten                              1422          58.9140           0.0080           0.1120           0.0414
Activation                           5688         264.8020           0.0030           1.9440           0.0466
SetValueOp                           1262           8.1410           0.0050           0.0180           0.0065
pick                                 1262           9.9330           0.0060           0.0280           0.0079
Pooling                              2844        3999.4441           0.0640           3.1720           1.4063
Convolution                          2844       16211.0088           0.2260          13.2050           5.7001
CopyCPU2CPU                          1422           8.0550           0.0030           0.0360           0.0057
log_softmax                          1262          39.2970           0.0150           0.0550           0.0311
_backward_copy                       1262          65.1320           0.0220           0.0760           0.0516
_backward_Convolution                2524       23379.3809           2.6370          12.5610           9.2628
_mul_scalar                          1262           4.5230           0.0020           0.0230           0.0036
_backward_log_softmax                1262          21.4700           0.0090           0.0400           0.0170
mean                                 3946          75.8380           0.0080           0.0730           0.0192
_backward_mean                       1262          13.8490           0.0080           0.1030           0.0110
_backward_FullyConnected             3786         723.1420           0.0280           0.5940           0.1910
WaitForVar                           2684          23.9720           0.0060           0.0280           0.0089
broadcast_equal                      1422           7.1070           0.0030           0.0110           0.0050
sgd_update                          12620         124.7910           0.0020           0.0790           0.0099
_backward_Activation                 5048         373.5690           0.0070           0.3900           0.0740



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       49168       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  4272        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             631        2485.7649           0.3060          73.5850           3.9394
MXNDArrayCreateEx                     712          24.3860           0.0310           0.0640           0.0342
MXNDArrayWaitAll                      632       13735.6992           5.6130          25.0610          21.7337
MXNDArraySyncCopyToCPU               1344       10582.3145           0.1180          24.1980           7.8737
MXNDArrayGetDType                    1344           0.4840           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3400           1.5930           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1424          12.4770           0.0070           0.0280           0.0088
MXNDArrayFree                       15976         162.9330           0.0000           0.9140           0.0102
MXNet C API Calls                   72024         559.3810         487.3580         559.3810          36.0115
MXNet C API Concurrency            144047           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1264           0.5940           0.0000           0.0040           0.0005
MXNDArrayGetGradState                6320           3.2790           0.0000           0.0230           0.0005
MXNDArraySetGradState                6320           3.1930           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1264           0.5270           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  632         345.7960           0.5250           0.9450           0.5471
MXNDArrayGetContext                  9888           4.2880           0.0000           0.0070           0.0004
MXImperativeInvokeEx                20872         532.4680           0.0090           0.1450           0.0255

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2528        6196.5581           0.7010           3.7500           2.4512
FullyConnected                       4272         413.5280           0.0080           0.3430           0.0968
argmax                               1424          28.2330           0.0050           0.0480           0.0198
_backward_pick                       1264          20.0000           0.0130           0.0320           0.0158
_backward_mul_scalar                 1264           5.4900           0.0030           0.0160           0.0043
DeleteVariable                      53440         376.7990           0.0010           0.9010           0.0071
Flatten                              1424          58.9990           0.0080           0.1120           0.0414
Activation                           5696         265.1710           0.0030           1.9440           0.0466
SetValueOp                           1264           8.1550           0.0050           0.0180           0.0065
pick                                 1264           9.9500           0.0060           0.0280           0.0079
Pooling                              2848        4004.8689           0.0640           3.1720           1.4062
Convolution                          2848       16236.9180           0.2260          13.2050           5.7012
CopyCPU2CPU                          1424           8.0650           0.0030           0.0360           0.0057
log_softmax                          1264          39.3570           0.0150           0.0550           0.0311
_backward_copy                       1264          65.2320           0.0220           0.0760           0.0516
_backward_Convolution                2528       23416.3027           2.6370          12.5610           9.2628
_mul_scalar                          1264           4.5300           0.0020           0.0230           0.0036
_backward_log_softmax                1264          21.5120           0.0090           0.0400           0.0170
mean                                 3952          75.9450           0.0080           0.0730           0.0192
_backward_mean                       1264          13.8720           0.0080           0.1030           0.0110
_backward_FullyConnected             3792         724.6100           0.0280           0.5940           0.1911
WaitForVar                           2688          24.0080           0.0060           0.0280           0.0089
broadcast_equal                      1424           7.1160           0.0030           0.0110           0.0050
sgd_update                          12640         125.0230           0.0020           0.0790           0.0099
_backward_Activation                 5056         374.1380           0.0070           0.3900           0.0740



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       49242       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  4278        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             632        2489.6880           0.3060          73.5850           3.9394
MXNDArrayCreateEx                     713          24.4310           0.0310           0.0640           0.0343
MXNDArrayWaitAll                      633       13757.5791           5.6130          25.0610          21.7339
MXNDArraySyncCopyToCPU               1346       10597.0039           0.1180          24.1980           7.8730
MXNDArrayGetDType                    1346           0.4860           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3405           1.5940           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1426          12.4940           0.0070           0.0280           0.0088
MXNDArrayFree                       15999         163.1810           0.0000           0.9140           0.0102
MXNet C API Calls                   72131         559.4880         487.3580         559.4880          36.0650
MXNet C API Concurrency            144261           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1266           0.5960           0.0000           0.0040           0.0005
MXNDArrayGetGradState                6330           3.2870           0.0000           0.0230           0.0005
MXNDArraySetGradState                6330           3.2000           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1266           0.5280           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  633         346.6860           0.5250           0.9450           0.5477
MXNDArrayGetContext                  9902           4.2970           0.0000           0.0070           0.0004
MXImperativeInvokeEx                20903         533.6300           0.0090           0.1450           0.0255

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2532        6206.3418           0.7010           3.7500           2.4512
FullyConnected                       4278         414.0520           0.0080           0.3430           0.0968
argmax                               1426          28.2760           0.0050           0.0480           0.0198
_backward_pick                       1266          20.0330           0.0130           0.0320           0.0158
_backward_mul_scalar                 1266           5.4990           0.0030           0.0160           0.0043
DeleteVariable                      53520         377.3430           0.0010           0.9010           0.0071
Flatten                              1426          59.0800           0.0080           0.1120           0.0414
Activation                           5704         265.5610           0.0030           1.9440           0.0466
SetValueOp                           1266           8.1700           0.0050           0.0180           0.0065
pick                                 1266           9.9660           0.0060           0.0280           0.0079
Pooling                              2852        4010.2549           0.0640           3.1720           1.4061
Convolution                          2852       16262.8281           0.2260          13.2050           5.7023
CopyCPU2CPU                          1426           8.0750           0.0030           0.0360           0.0057
log_softmax                          1266          39.4160           0.0150           0.0550           0.0311
_backward_copy                       1266          65.3330           0.0220           0.0760           0.0516
_backward_Convolution                2532       23453.4004           2.6370          12.5610           9.2628
_mul_scalar                          1266           4.5370           0.0020           0.0230           0.0036
_backward_log_softmax                1266          21.5450           0.0090           0.0400           0.0170
mean                                 3958          76.0620           0.0080           0.0730           0.0192
_backward_mean                       1266          13.8940           0.0080           0.1030           0.0110
_backward_FullyConnected             3798         726.0690           0.0280           0.5940           0.1912
WaitForVar                           2692          24.0500           0.0060           0.0280           0.0089
broadcast_equal                      1426           7.1260           0.0030           0.0110           0.0050
sgd_update                          12660         125.1980           0.0020           0.0790           0.0099
_backward_Activation                 5064         374.7690           0.0070           0.3900           0.0740



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       49316       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  4284        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             633        2493.5950           0.3060          73.5850           3.9393
MXNDArrayCreateEx                     714          24.4770           0.0310           0.0640           0.0343
MXNDArrayWaitAll                      634       13779.5166           5.6130          25.0610          21.7343
MXNDArraySyncCopyToCPU               1348       10611.7578           0.1180          24.1980           7.8722
MXNDArrayGetDType                    1348           0.4880           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3410           1.5970           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1428          12.5130           0.0070           0.0280           0.0088
MXNDArrayFree                       16022         163.4260           0.0000           0.9140           0.0102
MXNet C API Calls                   72238         559.5950         487.3580         559.5950          36.1185
MXNet C API Concurrency            144475           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1268           0.5970           0.0000           0.0040           0.0005
MXNDArrayGetGradState                6340           3.2950           0.0000           0.0230           0.0005
MXNDArraySetGradState                6340           3.2040           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1268           0.5300           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  634         347.5700           0.5250           0.9450           0.5482
MXNDArrayGetContext                  9916           4.3080           0.0000           0.0070           0.0004
MXImperativeInvokeEx                20934         534.7880           0.0090           0.1450           0.0255

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2536        6216.1348           0.7010           3.7500           2.4512
FullyConnected                       4284         414.6250           0.0080           0.3430           0.0968
argmax                               1428          28.3180           0.0050           0.0480           0.0198
_backward_pick                       1268          20.0640           0.0130           0.0320           0.0158
_backward_mul_scalar                 1268           5.5080           0.0030           0.0160           0.0043
DeleteVariable                      53600         377.8930           0.0010           0.9010           0.0071
Flatten                              1428          59.1790           0.0080           0.1120           0.0414
Activation                           5712         265.9550           0.0030           1.9440           0.0466
SetValueOp                           1268           8.1850           0.0050           0.0180           0.0065
pick                                 1268           9.9810           0.0060           0.0280           0.0079
Pooling                              2856        4015.6450           0.0640           3.1720           1.4060
Convolution                          2856       16288.7676           0.2260          13.2050           5.7034
CopyCPU2CPU                          1428           8.0840           0.0030           0.0360           0.0057
log_softmax                          1268          39.4750           0.0150           0.0550           0.0311
_backward_copy                       1268          65.4340           0.0220           0.0760           0.0516
_backward_Convolution                2536       23490.6094           2.6370          12.5610           9.2629
_mul_scalar                          1268           4.5440           0.0020           0.0230           0.0036
_backward_log_softmax                1268          21.5770           0.0090           0.0400           0.0170
mean                                 3964          76.1830           0.0080           0.0730           0.0192
_backward_mean                       1268          13.9160           0.0080           0.1030           0.0110
_backward_FullyConnected             3804         727.5260           0.0280           0.5940           0.1913
WaitForVar                           2696          24.0840           0.0060           0.0280           0.0089
broadcast_equal                      1428           7.1370           0.0030           0.0110           0.0050
sgd_update                          12680         125.4240           0.0020           0.0790           0.0099
_backward_Activation                 5072         375.3250           0.0070           0.3900           0.0740



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       49390       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  4290        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             634        2493.9221           0.3060          73.5850           3.9336
MXNDArrayCreateEx                     715          24.5220           0.0310           0.0640           0.0343
MXNDArrayWaitAll                      635       13801.2432           5.6130          25.0610          21.7342
MXNDArraySyncCopyToCPU               1350       10626.5332           0.1180          24.1980           7.8715
MXNDArrayGetDType                    1350           0.4890           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3415           1.6020           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1430          12.5310           0.0070           0.0280           0.0088
MXNDArrayFree                       16045         163.6780           0.0000           0.9140           0.0102
MXNet C API Calls                   72345         559.7020         487.3580         559.7020          36.1720
MXNet C API Concurrency            144689           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1270           0.5990           0.0000           0.0040           0.0005
MXNDArrayGetGradState                6350           3.3010           0.0000           0.0230           0.0005
MXNDArraySetGradState                6350           3.2120           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1270           0.5310           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  635         348.4900           0.5250           0.9450           0.5488
MXNDArrayGetContext                  9930           4.3140           0.0000           0.0070           0.0004
MXImperativeInvokeEx                20965         535.9370           0.0090           0.1450           0.0256

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2540        6225.9312           0.7010           3.7500           2.4512
FullyConnected                       4290         415.2230           0.0080           0.3430           0.0968
argmax                               1430          28.3620           0.0050           0.0480           0.0198
_backward_pick                       1270          20.0970           0.0130           0.0320           0.0158
_backward_mul_scalar                 1270           5.5170           0.0030           0.0160           0.0043
DeleteVariable                      53680         378.4560           0.0010           0.9010           0.0071
Flatten                              1430          59.2600           0.0080           0.1120           0.0414
Activation                           5720         266.3240           0.0030           1.9440           0.0466
SetValueOp                           1270           8.2000           0.0050           0.0180           0.0065
pick                                 1270           9.9960           0.0060           0.0280           0.0079
Pooling                              2860        4021.0549           0.0640           3.1720           1.4060
Convolution                          2860       16314.7461           0.2260          13.2050           5.7045
CopyCPU2CPU                          1430           8.0940           0.0030           0.0360           0.0057
log_softmax                          1270          39.5490           0.0150           0.0550           0.0311
_backward_copy                       1270          65.5340           0.0220           0.0760           0.0516
_backward_Convolution                2540       23527.4121           2.6370          12.5610           9.2628
_mul_scalar                          1270           4.5500           0.0020           0.0230           0.0036
_backward_log_softmax                1270          21.6090           0.0090           0.0400           0.0170
mean                                 3970          76.2910           0.0080           0.0730           0.0192
_backward_mean                       1270          13.9390           0.0080           0.1030           0.0110
_backward_FullyConnected             3810         729.0020           0.0280           0.5940           0.1913
WaitForVar                           2700          24.1200           0.0060           0.0280           0.0089
broadcast_equal                      1430           7.1470           0.0030           0.0110           0.0050
sgd_update                          12700         125.6260           0.0020           0.0790           0.0099
_backward_Activation                 5080         375.9500           0.0070           0.3900           0.0740



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       49464       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  4296        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             635        2497.8220           0.3060          73.5850           3.9336
MXNDArrayCreateEx                     716          24.5690           0.0310           0.0640           0.0343
MXNDArrayWaitAll                      636       13822.9863           5.6130          25.0610          21.7343
MXNDArraySyncCopyToCPU               1352       10641.2598           0.1180          24.1980           7.8708
MXNDArrayGetDType                    1352           0.4890           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3420           1.6040           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1432          12.5490           0.0070           0.0280           0.0088
MXNDArrayFree                       16068         163.9220           0.0000           0.9140           0.0102
MXNet C API Calls                   72452         559.8090         487.3580         559.8090          36.2255
MXNet C API Concurrency            144903           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1272           0.6000           0.0000           0.0040           0.0005
MXNDArrayGetGradState                6360           3.3080           0.0000           0.0230           0.0005
MXNDArraySetGradState                6360           3.2200           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1272           0.5310           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  636         349.4040           0.5250           0.9450           0.5494
MXNDArrayGetContext                  9944           4.3240           0.0000           0.0070           0.0004
MXImperativeInvokeEx                20996         537.1030           0.0090           0.1450           0.0256

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2544        6235.6958           0.7010           3.7500           2.4511
FullyConnected                       4296         415.8090           0.0080           0.3430           0.0968
argmax                               1432          28.4040           0.0050           0.0480           0.0198
_backward_pick                       1272          20.1310           0.0130           0.0320           0.0158
_backward_mul_scalar                 1272           5.5260           0.0030           0.0160           0.0043
DeleteVariable                      53760         379.0090           0.0010           0.9010           0.0071
Flatten                              1432          59.3430           0.0080           0.1120           0.0414
Activation                           5728         266.6950           0.0030           1.9440           0.0466
SetValueOp                           1272           8.2140           0.0050           0.0180           0.0065
pick                                 1272          10.0130           0.0060           0.0280           0.0079
Pooling                              2864        4026.4609           0.0640           3.1720           1.4059
Convolution                          2864       16340.6650           0.2260          13.2050           5.7055
CopyCPU2CPU                          1432           8.1040           0.0030           0.0360           0.0057
log_softmax                          1272          39.6230           0.0150           0.0550           0.0312
_backward_copy                       1272          65.6330           0.0220           0.0760           0.0516
_backward_Convolution                2544       23564.2363           2.6370          12.5610           9.2627
_mul_scalar                          1272           4.5570           0.0020           0.0230           0.0036
_backward_log_softmax                1272          21.6400           0.0090           0.0400           0.0170
mean                                 3976          76.4000           0.0080           0.0730           0.0192
_backward_mean                       1272          13.9610           0.0080           0.1030           0.0110
_backward_FullyConnected             3816         730.4900           0.0280           0.5940           0.1914
WaitForVar                           2704          24.1570           0.0060           0.0280           0.0089
broadcast_equal                      1432           7.1570           0.0030           0.0110           0.0050
sgd_update                          12720         125.8560           0.0020           0.0790           0.0099
_backward_Activation                 5088         376.5160           0.0070           0.3900           0.0740



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       49538       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  4302        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             636        2501.7271           0.3060          73.5850           3.9335
MXNDArrayCreateEx                     717          24.6160           0.0310           0.0640           0.0343
MXNDArrayWaitAll                      637       13844.8857           5.6130          25.0610          21.7345
MXNDArraySyncCopyToCPU               1354       10655.9199           0.1180          24.1980           7.8700
MXNDArrayGetDType                    1354           0.4910           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3425           1.6070           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1434          12.5670           0.0070           0.0280           0.0088
MXNDArrayFree                       16091         164.1760           0.0000           0.9140           0.0102
MXNet C API Calls                   72559         559.9160         487.3580         559.9160          36.2790
MXNet C API Concurrency            145117           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1274           0.6010           0.0000           0.0040           0.0005
MXNDArrayGetGradState                6370           3.3150           0.0000           0.0230           0.0005
MXNDArraySetGradState                6370           3.2290           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1274           0.5330           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  637         350.3190           0.5250           0.9450           0.5500
MXNDArrayGetContext                  9958           4.3310           0.0000           0.0070           0.0004
MXImperativeInvokeEx                21027         538.2640           0.0090           0.1450           0.0256

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2548        6245.4121           0.7010           3.7500           2.4511
FullyConnected                       4302         416.3610           0.0080           0.3430           0.0968
argmax                               1434          28.4460           0.0050           0.0480           0.0198
_backward_pick                       1274          20.1640           0.0130           0.0320           0.0158
_backward_mul_scalar                 1274           5.5350           0.0030           0.0160           0.0043
DeleteVariable                      53840         379.5620           0.0010           0.9010           0.0070
Flatten                              1434          59.4280           0.0080           0.1120           0.0414
Activation                           5736         267.0690           0.0030           1.9440           0.0466
SetValueOp                           1274           8.2290           0.0050           0.0180           0.0065
pick                                 1274          10.0290           0.0060           0.0280           0.0079
Pooling                              2868        4031.8640           0.0640           3.1720           1.4058
Convolution                          2868       16366.6035           0.2260          13.2050           5.7066
CopyCPU2CPU                          1434           8.1130           0.0030           0.0360           0.0057
log_softmax                          1274          39.6830           0.0150           0.0550           0.0311
_backward_copy                       1274          65.7340           0.0220           0.0760           0.0516
_backward_Convolution                2548       23601.4180           2.6370          12.5610           9.2627
_mul_scalar                          1274           4.5640           0.0020           0.0230           0.0036
_backward_log_softmax                1274          21.6720           0.0090           0.0400           0.0170
mean                                 3982          76.5150           0.0080           0.0730           0.0192
_backward_mean                       1274          13.9830           0.0080           0.1030           0.0110
_backward_FullyConnected             3822         731.9520           0.0280           0.5940           0.1915
WaitForVar                           2708          24.1940           0.0060           0.0280           0.0089
broadcast_equal                      1434           7.1670           0.0030           0.0110           0.0050
sgd_update                          12740         126.0280           0.0020           0.0790           0.0099
_backward_Activation                 5096         377.1370           0.0070           0.3900           0.0740



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       49612       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  4308        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             637        2505.6560           0.3060          73.5850           3.9335
MXNDArrayCreateEx                     718          24.6610           0.0310           0.0640           0.0343
MXNDArrayWaitAll                      638       13866.7744           5.6130          25.0610          21.7348
MXNDArraySyncCopyToCPU               1356       10670.6387           0.1180          24.1980           7.8692
MXNDArrayGetDType                    1356           0.4910           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3430           1.6080           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1436          12.5830           0.0070           0.0280           0.0088
MXNDArrayFree                       16114         164.4240           0.0000           0.9140           0.0102
MXNet C API Calls                   72666         560.0230         487.3580         560.0230          36.3325
MXNet C API Concurrency            145331           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1276           0.6030           0.0000           0.0040           0.0005
MXNDArrayGetGradState                6380           3.3220           0.0000           0.0230           0.0005
MXNDArraySetGradState                6380           3.2360           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1276           0.5340           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  638         351.2330           0.5250           0.9450           0.5505
MXNDArrayGetContext                  9972           4.3420           0.0000           0.0070           0.0004
MXImperativeInvokeEx                21058         539.4180           0.0090           0.1450           0.0256

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2552        6255.2021           0.7010           3.7500           2.4511
FullyConnected                       4308         416.8960           0.0080           0.3430           0.0968
argmax                               1436          28.4870           0.0050           0.0480           0.0198
_backward_pick                       1276          20.1960           0.0130           0.0320           0.0158
_backward_mul_scalar                 1276           5.5440           0.0030           0.0160           0.0043
DeleteVariable                      53920         380.1140           0.0010           0.9010           0.0070
Flatten                              1436          59.5230           0.0080           0.1120           0.0415
Activation                           5744         267.4570           0.0030           1.9440           0.0466
SetValueOp                           1276           8.2430           0.0050           0.0180           0.0065
pick                                 1276          10.0450           0.0060           0.0280           0.0079
Pooling                              2872        4037.2710           0.0640           3.1720           1.4057
Convolution                          2872       16392.5527           0.2260          13.2050           5.7077
CopyCPU2CPU                          1436           8.1220           0.0030           0.0360           0.0057
log_softmax                          1276          39.7420           0.0150           0.0550           0.0311
_backward_copy                       1276          65.8360           0.0220           0.0760           0.0516
_backward_Convolution                2552       23638.5352           2.6370          12.5610           9.2627
_mul_scalar                          1276           4.5710           0.0020           0.0230           0.0036
_backward_log_softmax                1276          21.7030           0.0090           0.0400           0.0170
mean                                 3988          76.6380           0.0080           0.0730           0.0192
_backward_mean                       1276          14.0050           0.0080           0.1030           0.0110
_backward_FullyConnected             3828         733.4100           0.0280           0.5940           0.1916
WaitForVar                           2712          24.2300           0.0060           0.0280           0.0089
broadcast_equal                      1436           7.1760           0.0030           0.0110           0.0050
sgd_update                          12760         126.1970           0.0020           0.0790           0.0099
_backward_Activation                 5104         377.7590           0.0070           0.3900           0.0740



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       49686       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  4314        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             638        2509.5740           0.3060          73.5850           3.9335
MXNDArrayCreateEx                     719          24.7070           0.0310           0.0640           0.0344
MXNDArrayWaitAll                      639       13888.5752           5.6130          25.0610          21.7349
MXNDArraySyncCopyToCPU               1358       10685.4238           0.1180          24.1980           7.8685
MXNDArrayGetDType                    1358           0.4930           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3435           1.6110           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1438          12.6010           0.0070           0.0280           0.0088
MXNDArrayFree                       16137         164.6670           0.0000           0.9140           0.0102
MXNet C API Calls                   72773         560.1300         487.3580         560.1300          36.3860
MXNet C API Concurrency            145545           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1278           0.6040           0.0000           0.0040           0.0005
MXNDArrayGetGradState                6390           3.3300           0.0000           0.0230           0.0005
MXNDArraySetGradState                6390           3.2450           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1278           0.5350           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  639         352.1300           0.5250           0.9450           0.5511
MXNDArrayGetContext                  9986           4.3490           0.0000           0.0070           0.0004
MXImperativeInvokeEx                21089         540.5750           0.0090           0.1450           0.0256

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2556        6265.1162           0.7010           3.7500           2.4511
FullyConnected                       4314         417.5110           0.0080           0.3430           0.0968
argmax                               1438          28.5330           0.0050           0.0480           0.0198
_backward_pick                       1278          20.2270           0.0130           0.0320           0.0158
_backward_mul_scalar                 1278           5.5530           0.0030           0.0160           0.0043
DeleteVariable                      54000         380.6810           0.0010           0.9010           0.0070
Flatten                              1438          59.6040           0.0080           0.1120           0.0414
Activation                           5752         267.8280           0.0030           1.9440           0.0466
SetValueOp                           1278           8.2580           0.0050           0.0180           0.0065
pick                                 1278          10.0610           0.0060           0.0280           0.0079
Pooling                              2876        4042.6970           0.0640           3.1720           1.4057
Convolution                          2876       16418.4844           0.2260          13.2050           5.7088
CopyCPU2CPU                          1438           8.1330           0.0030           0.0360           0.0057
log_softmax                          1278          39.8010           0.0150           0.0550           0.0311
_backward_copy                       1278          65.9370           0.0220           0.0760           0.0516
_backward_Convolution                2556       23675.4023           2.6370          12.5610           9.2627
_mul_scalar                          1278           4.5790           0.0020           0.0230           0.0036
_backward_log_softmax                1278          21.7450           0.0090           0.0400           0.0170
mean                                 3994          76.7610           0.0080           0.0730           0.0192
_backward_mean                       1278          14.0280           0.0080           0.1030           0.0110
_backward_FullyConnected             3834         734.8670           0.0280           0.5940           0.1917
WaitForVar                           2716          24.2660           0.0060           0.0280           0.0089
broadcast_equal                      1438           7.1860           0.0030           0.0110           0.0050
sgd_update                          12780         126.4220           0.0020           0.0790           0.0099
_backward_Activation                 5112         378.3210           0.0070           0.3900           0.0740



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       49760       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  4320        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             639        2513.4910           0.3060          73.5850           3.9335
MXNDArrayCreateEx                     720          24.7530           0.0310           0.0640           0.0344
MXNDArrayWaitAll                      640       13910.3105           5.6130          25.0610          21.7349
MXNDArraySyncCopyToCPU               1360       10700.1582           0.1180          24.1980           7.8678
MXNDArrayGetDType                    1360           0.4940           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3440           1.6130           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1440          12.6180           0.0070           0.0280           0.0088
MXNDArrayFree                       16160         164.9160           0.0000           0.9140           0.0102
MXNet C API Calls                   72880         560.2370         487.3580         560.2370          36.4395
MXNet C API Concurrency            145759           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1280           0.6040           0.0000           0.0040           0.0005
MXNDArrayGetGradState                6400           3.3380           0.0000           0.0230           0.0005
MXNDArraySetGradState                6400           3.2510           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1280           0.5350           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  640         353.0160           0.5250           0.9450           0.5516
MXNDArrayGetContext                 10000           4.3580           0.0000           0.0070           0.0004
MXImperativeInvokeEx                21120         541.7590           0.0090           0.1450           0.0257

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2560        6274.8408           0.7010           3.7500           2.4511
FullyConnected                       4320         418.1220           0.0080           0.3430           0.0968
argmax                               1440          28.5790           0.0050           0.0480           0.0198
_backward_pick                       1280          20.2580           0.0130           0.0320           0.0158
_backward_mul_scalar                 1280           5.5620           0.0030           0.0160           0.0043
DeleteVariable                      54080         381.2540           0.0010           0.9010           0.0070
Flatten                              1440          59.6870           0.0080           0.1120           0.0414
Activation                           5760         268.2040           0.0030           1.9440           0.0466
SetValueOp                           1280           8.2710           0.0050           0.0180           0.0065
pick                                 1280          10.0790           0.0060           0.0280           0.0079
Pooling                              2880        4048.1709           0.0640           3.1720           1.4056
Convolution                          2880       16444.3164           0.2260          13.2050           5.7098
CopyCPU2CPU                          1440           8.1430           0.0030           0.0360           0.0057
log_softmax                          1280          39.8610           0.0150           0.0550           0.0311
_backward_copy                       1280          66.0360           0.0220           0.0760           0.0516
_backward_Convolution                2560       23712.2676           2.6370          12.5610           9.2626
_mul_scalar                          1280           4.5860           0.0020           0.0230           0.0036
_backward_log_softmax                1280          21.7870           0.0090           0.0400           0.0170
mean                                 4000          76.8690           0.0080           0.0730           0.0192
_backward_mean                       1280          14.0500           0.0080           0.1030           0.0110
_backward_FullyConnected             3840         736.3360           0.0280           0.5940           0.1918
WaitForVar                           2720          24.3020           0.0060           0.0280           0.0089
broadcast_equal                      1440           7.1960           0.0030           0.0110           0.0050
sgd_update                          12800         126.6420           0.0020           0.0790           0.0099
_backward_Activation                 5120         378.8870           0.0070           0.3900           0.0740



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       49834       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  4326        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             640        2517.4309           0.3060          73.5850           3.9335
MXNDArrayCreateEx                     721          24.8040           0.0310           0.0640           0.0344
MXNDArrayWaitAll                      641       13932.2119           5.6130          25.0610          21.7351
MXNDArraySyncCopyToCPU               1362       10714.8770           0.1180          24.1980           7.8670
MXNDArrayGetDType                    1362           0.4960           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3445           1.6140           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1442          12.6360           0.0070           0.0280           0.0088
MXNDArrayFree                       16183         165.1660           0.0000           0.9140           0.0102
MXNet C API Calls                   72987         560.3440         487.3580         560.3440          36.4930
MXNet C API Concurrency            145973           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1282           0.6050           0.0000           0.0040           0.0005
MXNDArrayGetGradState                6410           3.3460           0.0000           0.0230           0.0005
MXNDArraySetGradState                6410           3.2570           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1282           0.5370           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  641         353.9090           0.5250           0.9450           0.5521
MXNDArrayGetContext                 10014           4.3660           0.0000           0.0070           0.0004
MXImperativeInvokeEx                21151         542.9130           0.0090           0.1450           0.0257

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2564        6284.6011           0.7010           3.7500           2.4511
FullyConnected                       4326         418.6510           0.0080           0.3430           0.0968
argmax                               1442          28.6210           0.0050           0.0480           0.0198
_backward_pick                       1282          20.2900           0.0130           0.0320           0.0158
_backward_mul_scalar                 1282           5.6040           0.0030           0.0220           0.0044
DeleteVariable                      54160         381.8170           0.0010           0.9010           0.0070
Flatten                              1442          59.7720           0.0080           0.1120           0.0415
Activation                           5768         268.5610           0.0030           1.9440           0.0466
SetValueOp                           1282           8.2860           0.0050           0.0180           0.0065
pick                                 1282          10.0940           0.0060           0.0280           0.0079
Pooling                              2884        4053.6121           0.0640           3.1720           1.4056
Convolution                          2884       16470.2246           0.2260          13.2050           5.7109
CopyCPU2CPU                          1442           8.1530           0.0030           0.0360           0.0057
log_softmax                          1282          39.9210           0.0150           0.0550           0.0311
_backward_copy                       1282          66.1370           0.0220           0.0760           0.0516
_backward_Convolution                2564       23749.3926           2.6370          12.5610           9.2626
_mul_scalar                          1282           4.5930           0.0020           0.0230           0.0036
_backward_log_softmax                1282          21.8190           0.0090           0.0400           0.0170
mean                                 4006          77.0370           0.0080           0.0730           0.0192
_backward_mean                       1282          14.0720           0.0080           0.1030           0.0110
_backward_FullyConnected             3846         737.8060           0.0280           0.5940           0.1918
WaitForVar                           2724          24.3370           0.0060           0.0280           0.0089
broadcast_equal                      1442           7.2060           0.0030           0.0110           0.0050
sgd_update                          12820         126.8660           0.0020           0.0790           0.0099
_backward_Activation                 5128         379.4610           0.0070           0.3900           0.0740



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       49908       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  4332        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             641        2521.3630           0.3060          73.5850           3.9335
MXNDArrayCreateEx                     722          24.8500           0.0310           0.0640           0.0344
MXNDArrayWaitAll                      642       13954.1699           5.6130          25.0610          21.7355
MXNDArraySyncCopyToCPU               1364       10729.6016           0.1180          24.1980           7.8663
MXNDArrayGetDType                    1364           0.4980           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3450           1.6180           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1444          12.6520           0.0070           0.0280           0.0088
MXNDArrayFree                       16206         165.4130           0.0000           0.9140           0.0102
MXNet C API Calls                   73094         560.4510         487.3580         560.4510          36.5465
MXNet C API Concurrency            146187           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1284           0.6060           0.0000           0.0040           0.0005
MXNDArrayGetGradState                6420           3.3520           0.0000           0.0230           0.0005
MXNDArraySetGradState                6420           3.2640           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1284           0.5390           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  642         354.7980           0.5250           0.9450           0.5526
MXNDArrayGetContext                 10028           4.3710           0.0000           0.0070           0.0004
MXImperativeInvokeEx                21182         544.0750           0.0090           0.1450           0.0257

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2568        6294.4199           0.7010           3.7500           2.4511
FullyConnected                       4332         419.2010           0.0080           0.3430           0.0968
argmax                               1444          28.6620           0.0050           0.0480           0.0198
_backward_pick                       1284          20.3220           0.0130           0.0320           0.0158
_backward_mul_scalar                 1284           5.6130           0.0030           0.0220           0.0044
DeleteVariable                      54240         382.4060           0.0010           0.9010           0.0071
Flatten                              1444          59.8530           0.0080           0.1120           0.0414
Activation                           5776         268.9150           0.0030           1.9440           0.0466
SetValueOp                           1284           8.3000           0.0050           0.0180           0.0065
pick                                 1284          10.1090           0.0060           0.0280           0.0079
Pooling                              2888        4059.0591           0.0640           3.1720           1.4055
Convolution                          2888       16496.2324           0.2260          13.2050           5.7120
CopyCPU2CPU                          1444           8.1630           0.0030           0.0360           0.0057
log_softmax                          1284          39.9810           0.0150           0.0550           0.0311
_backward_copy                       1284          66.2390           0.0220           0.0760           0.0516
_backward_Convolution                2568       23786.6406           2.6370          12.5610           9.2627
_mul_scalar                          1284           4.6010           0.0020           0.0230           0.0036
_backward_log_softmax                1284          21.8510           0.0090           0.0400           0.0170
mean                                 4012          77.1520           0.0080           0.0730           0.0192
_backward_mean                       1284          14.0950           0.0080           0.1030           0.0110
_backward_FullyConnected             3852         739.2690           0.0280           0.5940           0.1919
WaitForVar                           2728          24.3750           0.0060           0.0280           0.0089
broadcast_equal                      1444           7.2160           0.0030           0.0110           0.0050
sgd_update                          12840         127.0850           0.0020           0.0790           0.0099
_backward_Activation                 5136         380.0330           0.0070           0.3900           0.0740



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       49982       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  4338        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             642        2525.2871           0.3060          73.5850           3.9335
MXNDArrayCreateEx                     723          24.8950           0.0310           0.0640           0.0344
MXNDArrayWaitAll                      643       13975.9082           5.6130          25.0610          21.7355
MXNDArraySyncCopyToCPU               1366       10744.3291           0.1180          24.1980           7.8655
MXNDArrayGetDType                    1366           0.5000           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3455           1.6220           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1446          12.6710           0.0070           0.0280           0.0088
MXNDArrayFree                       16229         165.6560           0.0000           0.9140           0.0102
MXNet C API Calls                   73201         560.5580         487.3580         560.5580          36.6000
MXNet C API Concurrency            146401           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1286           0.6080           0.0000           0.0040           0.0005
MXNDArrayGetGradState                6430           3.3590           0.0000           0.0230           0.0005
MXNDArraySetGradState                6430           3.2730           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1286           0.5400           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  643         355.6850           0.5250           0.9450           0.5532
MXNDArrayGetContext                 10042           4.3810           0.0000           0.0070           0.0004
MXImperativeInvokeEx                21213         545.2350           0.0090           0.1450           0.0257

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2572        6304.2031           0.7010           3.7500           2.4511
FullyConnected                       4338         419.7910           0.0080           0.3430           0.0968
argmax                               1446          28.7070           0.0050           0.0480           0.0199
_backward_pick                       1286          20.3560           0.0130           0.0320           0.0158
_backward_mul_scalar                 1286           5.6220           0.0030           0.0220           0.0044
DeleteVariable                      54320         382.9630           0.0010           0.9010           0.0071
Flatten                              1446          59.9320           0.0080           0.1120           0.0414
Activation                           5784         269.2830           0.0030           1.9440           0.0466
SetValueOp                           1286           8.3150           0.0050           0.0180           0.0065
pick                                 1286          10.1250           0.0060           0.0280           0.0079
Pooling                              2892        4064.4890           0.0640           3.1720           1.4054
Convolution                          2892       16522.1348           0.2260          13.2050           5.7130
CopyCPU2CPU                          1446           8.1720           0.0030           0.0360           0.0057
log_softmax                          1286          40.0440           0.0150           0.0550           0.0311
_backward_copy                       1286          66.3380           0.0220           0.0760           0.0516
_backward_Convolution                2572       23823.4668           2.6370          12.5610           9.2626
_mul_scalar                          1286           4.6080           0.0020           0.0230           0.0036
_backward_log_softmax                1286          21.8910           0.0090           0.0400           0.0170
mean                                 4018          77.2570           0.0080           0.0730           0.0192
_backward_mean                       1286          14.1160           0.0080           0.1030           0.0110
_backward_FullyConnected             3858         740.7410           0.0280           0.5940           0.1920
WaitForVar                           2732          24.4120           0.0060           0.0280           0.0089
broadcast_equal                      1446           7.2270           0.0030           0.0110           0.0050
sgd_update                          12860         127.3090           0.0020           0.0790           0.0099
_backward_Activation                 5144         380.5960           0.0070           0.3900           0.0740



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       50056       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  4344        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             643        2529.1909           0.3060          73.5850           3.9334
MXNDArrayCreateEx                     724          24.9400           0.0310           0.0640           0.0344
MXNDArrayWaitAll                      644       13997.6289           5.6130          25.0610          21.7354
MXNDArraySyncCopyToCPU               1368       10758.9766           0.1180          24.1980           7.8647
MXNDArrayGetDType                    1368           0.5000           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3460           1.6260           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1448          12.6880           0.0070           0.0280           0.0088
MXNDArrayFree                       16252         165.8970           0.0000           0.9140           0.0102
MXNet C API Calls                   73308         560.6650         487.3580         560.6650          36.6535
MXNet C API Concurrency            146615           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1288           0.6090           0.0000           0.0040           0.0005
MXNDArrayGetGradState                6440           3.3670           0.0000           0.0230           0.0005
MXNDArraySetGradState                6440           3.2810           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1288           0.5420           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  644         356.5700           0.5250           0.9450           0.5537
MXNDArrayGetContext                 10056           4.3860           0.0000           0.0070           0.0004
MXImperativeInvokeEx                21244         546.3950           0.0090           0.1450           0.0257

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2576        6313.8452           0.7010           3.7500           2.4510
FullyConnected                       4344         420.4210           0.0080           0.3430           0.0968
argmax                               1448          28.7550           0.0050           0.0480           0.0199
_backward_pick                       1288          20.3910           0.0130           0.0320           0.0158
_backward_mul_scalar                 1288           5.6310           0.0030           0.0220           0.0044
DeleteVariable                      54400         383.5110           0.0010           0.9010           0.0070
Flatten                              1448          60.0120           0.0080           0.1120           0.0414
Activation                           5792         269.6470           0.0030           1.9440           0.0466
SetValueOp                           1288           8.3300           0.0050           0.0180           0.0065
pick                                 1288          10.1400           0.0060           0.0280           0.0079
Pooling                              2896        4069.8940           0.0640           3.1720           1.4054
Convolution                          2896       16548.0273           0.2260          13.2050           5.7141
CopyCPU2CPU                          1448           8.1820           0.0030           0.0360           0.0057
log_softmax                          1288          40.1090           0.0150           0.0550           0.0311
_backward_copy                       1288          66.4390           0.0220           0.0760           0.0516
_backward_Convolution                2576       23860.3398           2.6370          12.5610           9.2626
_mul_scalar                          1288           4.6150           0.0020           0.0230           0.0036
_backward_log_softmax                1288          21.9270           0.0090           0.0400           0.0170
mean                                 4024          77.3680           0.0080           0.0730           0.0192
_backward_mean                       1288          14.1390           0.0080           0.1030           0.0110
_backward_FullyConnected             3864         742.1960           0.0280           0.5940           0.1921
WaitForVar                           2736          24.4480           0.0060           0.0280           0.0089
broadcast_equal                      1448           7.2360           0.0030           0.0110           0.0050
sgd_update                          12880         127.5270           0.0020           0.0790           0.0099
_backward_Activation                 5152         381.1580           0.0070           0.3900           0.0740



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       50130       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  4350        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             644        2533.1221           0.3060          73.5850           3.9334
MXNDArrayCreateEx                     725          24.9790           0.0310           0.0640           0.0345
MXNDArrayWaitAll                      645       14019.4287           5.6130          25.0610          21.7355
MXNDArraySyncCopyToCPU               1370       10773.2842           0.1180          24.1980           7.8637
MXNDArrayGetDType                    1370           0.5010           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3465           1.6290           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1450          12.7050           0.0070           0.0280           0.0088
MXNDArrayFree                       16275         166.1290           0.0000           0.9140           0.0102
MXNet C API Calls                   73415         560.7720         487.3580         560.7720          36.7070
MXNet C API Concurrency            146829           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1290           0.6100           0.0000           0.0040           0.0005
MXNDArrayGetGradState                6450           3.3720           0.0000           0.0230           0.0005
MXNDArraySetGradState                6450           3.2870           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1290           0.5430           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  645         357.1110           0.5250           0.9450           0.5537
MXNDArrayGetContext                 10070           4.3910           0.0000           0.0070           0.0004
MXImperativeInvokeEx                21275         547.2130           0.0090           0.1450           0.0257

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2580        6323.5190           0.7010           3.7500           2.4510
FullyConnected                       4350         420.9500           0.0080           0.3430           0.0968
argmax                               1450          28.7940           0.0050           0.0480           0.0199
_backward_pick                       1290          20.4230           0.0130           0.0320           0.0158
_backward_mul_scalar                 1290           5.6400           0.0030           0.0220           0.0044
DeleteVariable                      54480         384.0520           0.0010           0.9010           0.0070
Flatten                              1450          60.0920           0.0080           0.1120           0.0414
Activation                           5800         269.9990           0.0030           1.9440           0.0466
SetValueOp                           1290           8.3430           0.0050           0.0180           0.0065
pick                                 1290          10.1550           0.0060           0.0280           0.0079
Pooling                              2900        4075.2710           0.0640           3.1720           1.4053
Convolution                          2900       16570.3457           0.2260          13.2050           5.7139
CopyCPU2CPU                          1450           8.1930           0.0030           0.0360           0.0057
log_softmax                          1290          40.1680           0.0150           0.0550           0.0311
_backward_copy                       1290          66.5420           0.0220           0.0760           0.0516
_backward_Convolution                2580       23897.3555           2.6370          12.5610           9.2625
_mul_scalar                          1290           4.6220           0.0020           0.0230           0.0036
_backward_log_softmax                1290          21.9600           0.0090           0.0400           0.0170
mean                                 4030          77.4830           0.0080           0.0730           0.0192
_backward_mean                       1290          14.1610           0.0080           0.1030           0.0110
_backward_FullyConnected             3870         743.2640           0.0280           0.5940           0.1921
WaitForVar                           2740          24.4850           0.0060           0.0280           0.0089
broadcast_equal                      1450           7.2460           0.0030           0.0110           0.0050
sgd_update                          12900         127.7330           0.0020           0.0790           0.0099
_backward_Activation                 5160         381.7210           0.0070           0.3900           0.0740



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       50204       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  4356        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             645        2537.0681           0.3060          73.5850           3.9334
MXNDArrayCreateEx                     726          25.0120           0.0310           0.0640           0.0345
MXNDArrayWaitAll                      646       14041.2773           5.6130          25.0610          21.7357
MXNDArraySyncCopyToCPU               1372       10787.6748           0.1180          24.1980           7.8627
MXNDArrayGetDType                    1372           0.5020           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3470           1.6320           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1452          12.7220           0.0070           0.0280           0.0088
MXNDArrayFree                       16298         166.3500           0.0000           0.9140           0.0102
MXNet C API Calls                   73522         560.8790         487.3580         560.8790          36.7605
MXNet C API Concurrency            147043           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1292           0.6110           0.0000           0.0040           0.0005
MXNDArrayGetGradState                6460           3.3760           0.0000           0.0230           0.0005
MXNDArraySetGradState                6460           3.2920           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1292           0.5440           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  646         357.6450           0.5250           0.9450           0.5536
MXNDArrayGetContext                 10084           4.3960           0.0000           0.0070           0.0004
MXImperativeInvokeEx                21306         547.9810           0.0090           0.1450           0.0257

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2584        6333.1748           0.7010           3.7500           2.4509
FullyConnected                       4356         421.4780           0.0080           0.3430           0.0968
argmax                               1452          28.8330           0.0050           0.0480           0.0199
_backward_pick                       1292          20.4540           0.0130           0.0320           0.0158
_backward_mul_scalar                 1292           5.6480           0.0030           0.0220           0.0044
DeleteVariable                      54560         384.5890           0.0010           0.9010           0.0070
Flatten                              1452          60.1720           0.0080           0.1120           0.0414
Activation                           5808         270.3500           0.0030           1.9440           0.0465
SetValueOp                           1292           8.3560           0.0050           0.0180           0.0065
pick                                 1292          10.1710           0.0060           0.0280           0.0079
Pooling                              2904        4080.6350           0.0640           3.1720           1.4052
Convolution                          2904       16592.5918           0.2260          13.2050           5.7137
CopyCPU2CPU                          1452           8.2020           0.0030           0.0360           0.0056
log_softmax                          1292          40.2270           0.0150           0.0550           0.0311
_backward_copy                       1292          66.6470           0.0220           0.0760           0.0516
_backward_Convolution                2584       23934.4180           2.6370          12.5610           9.2625
_mul_scalar                          1292           4.6290           0.0020           0.0230           0.0036
_backward_log_softmax                1292          21.9930           0.0090           0.0400           0.0170
mean                                 4036          77.5980           0.0080           0.0730           0.0192
_backward_mean                       1292          14.1820           0.0080           0.1030           0.0110
_backward_FullyConnected             3876         744.3260           0.0280           0.5940           0.1920
WaitForVar                           2744          24.5200           0.0060           0.0280           0.0089
broadcast_equal                      1452           7.2560           0.0030           0.0110           0.0050
sgd_update                          12920         127.9320           0.0020           0.0790           0.0099
_backward_Activation                 5168         382.2790           0.0070           0.3900           0.0740



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       50278       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  4362        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             646        2540.9651           0.3060          73.5850           3.9334
MXNDArrayCreateEx                     727          25.0450           0.0310           0.0640           0.0344
MXNDArrayWaitAll                      647       14062.9609           5.6130          25.0610          21.7356
MXNDArraySyncCopyToCPU               1374       10802.2383           0.1180          24.1980           7.8619
MXNDArrayGetDType                    1374           0.5020           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3475           1.6350           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1454          12.7380           0.0070           0.0280           0.0088
MXNDArrayFree                       16321         166.5740           0.0000           0.9140           0.0102
MXNet C API Calls                   73629         560.9860         487.3580         560.9860          36.8140
MXNet C API Concurrency            147257           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1294           0.6110           0.0000           0.0040           0.0005
MXNDArrayGetGradState                6470           3.3810           0.0000           0.0230           0.0005
MXNDArraySetGradState                6470           3.2970           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1294           0.5440           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  647         358.1790           0.5250           0.9450           0.5536
MXNDArrayGetContext                 10098           4.4020           0.0000           0.0070           0.0004
MXImperativeInvokeEx                21337         548.7780           0.0090           0.1450           0.0257

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2588        6342.8779           0.7010           3.7500           2.4509
FullyConnected                       4362         422.1010           0.0080           0.3430           0.0968
argmax                               1454          28.8770           0.0050           0.0480           0.0199
_backward_pick                       1294          20.4840           0.0130           0.0320           0.0158
_backward_mul_scalar                 1294           5.6560           0.0030           0.0220           0.0044
DeleteVariable                      54640         385.1210           0.0010           0.9010           0.0070
Flatten                              1454          60.2500           0.0080           0.1120           0.0414
Activation                           5816         270.7220           0.0030           1.9440           0.0465
SetValueOp                           1294           8.3690           0.0050           0.0180           0.0065
pick                                 1294          10.1860           0.0060           0.0280           0.0079
Pooling                              2908        4086.0449           0.0640           3.1720           1.4051
Convolution                          2908       16614.7598           0.2260          13.2050           5.7135
CopyCPU2CPU                          1454           8.2130           0.0030           0.0360           0.0056
log_softmax                          1294          40.2860           0.0150           0.0550           0.0311
_backward_copy                       1294          66.7490           0.0220           0.0760           0.0516
_backward_Convolution                2588       23971.2070           2.6370          12.5610           9.2624
_mul_scalar                          1294           4.6370           0.0020           0.0230           0.0036
_backward_log_softmax                1294          22.0370           0.0090           0.0400           0.0170
mean                                 4042          77.7280           0.0080           0.0730           0.0192
_backward_mean                       1294          14.2040           0.0080           0.1030           0.0110
_backward_FullyConnected             3882         745.4920           0.0280           0.5940           0.1920
WaitForVar                           2748          24.5560           0.0060           0.0280           0.0089
broadcast_equal                      1454           7.2650           0.0030           0.0110           0.0050
sgd_update                          12940         128.1430           0.0020           0.0790           0.0099
_backward_Activation                 5176         382.8470           0.0070           0.3900           0.0740



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       50352       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  4368        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             647        2544.8601           0.3060          73.5850           3.9333
MXNDArrayCreateEx                     728          25.0800           0.0310           0.0640           0.0345
MXNDArrayWaitAll                      648       14084.6924           5.6130          25.0610          21.7356
MXNDArraySyncCopyToCPU               1376       10816.6426           0.1180          24.1980           7.8609
MXNDArrayGetDType                    1376           0.5030           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3480           1.6370           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1456          12.7550           0.0070           0.0280           0.0088
MXNDArrayFree                       16344         166.8010           0.0000           0.9140           0.0102
MXNet C API Calls                   73736         561.0930         487.3580         561.0930          36.8675
MXNet C API Concurrency            147471           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1296           0.6130           0.0000           0.0040           0.0005
MXNDArrayGetGradState                6480           3.3870           0.0000           0.0230           0.0005
MXNDArraySetGradState                6480           3.3020           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1296           0.5450           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  648         358.7100           0.5250           0.9450           0.5536
MXNDArrayGetContext                 10112           4.4050           0.0000           0.0070           0.0004
MXImperativeInvokeEx                21368         549.5500           0.0090           0.1450           0.0257

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2592        6352.5942           0.7010           3.7500           2.4508
FullyConnected                       4368         422.7020           0.0080           0.3430           0.0968
argmax                               1456          28.9160           0.0050           0.0480           0.0199
_backward_pick                       1296          20.5160           0.0130           0.0320           0.0158
_backward_mul_scalar                 1296           5.6650           0.0030           0.0220           0.0044
DeleteVariable                      54720         385.6370           0.0010           0.9010           0.0070
Flatten                              1456          60.3280           0.0080           0.1120           0.0414
Activation                           5824         271.0920           0.0030           1.9440           0.0465
SetValueOp                           1296           8.3800           0.0050           0.0180           0.0065
pick                                 1296          10.2010           0.0060           0.0280           0.0079
Pooling                              2912        4091.4060           0.0640           3.1720           1.4050
Convolution                          2912       16636.8242           0.2260          13.2050           5.7132
CopyCPU2CPU                          1456           8.2230           0.0030           0.0360           0.0056
log_softmax                          1296          40.3570           0.0150           0.0550           0.0311
_backward_copy                       1296          66.8500           0.0220           0.0760           0.0516
_backward_Convolution                2592       24007.9766           2.6370          12.5610           9.2623
_mul_scalar                          1296           4.6440           0.0020           0.0230           0.0036
_backward_log_softmax                1296          22.0690           0.0090           0.0400           0.0170
mean                                 4048          77.8320           0.0080           0.0730           0.0192
_backward_mean                       1296          14.2260           0.0080           0.1030           0.0110
_backward_FullyConnected             3888         746.6830           0.0280           0.5940           0.1920
WaitForVar                           2752          24.5910           0.0060           0.0280           0.0089
broadcast_equal                      1456           7.2740           0.0030           0.0110           0.0050
sgd_update                          12960         128.2990           0.0020           0.0790           0.0099
_backward_Activation                 5184         383.4620           0.0070           0.3900           0.0740



Profile Statistics.
	Note that counter items are counter values and not time units.
Device Storage
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
Memory: cpu/0                       50426       55485.6250       55478.5859       66102.4609        5311.9380
Memory: cpu shared/                  4374        1557.4399         803.8400        2361.2800         778.7200

MXNET_C_API
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
MXAggregateProfileStatsPrint             648        2548.7629           0.3060          73.5850           3.9333
MXNDArrayCreateEx                     729          25.1140           0.0310           0.0640           0.0344
MXNDArrayWaitAll                      649       14106.5527           5.6130          25.0610          21.7358
MXNDArraySyncCopyToCPU               1378       10831.0146           0.1180          24.1980           7.8600
MXNDArrayGetDType                    1378           0.5040           0.0000           0.0010           0.0004
MXNDArrayGetShape                    3485           1.6410           0.0000           0.0230           0.0005
MXNDArrayCreateFromSharedMem            1458          12.7720           0.0070           0.0280           0.0088
MXNDArrayFree                       16367         167.0320           0.0000           0.9140           0.0102
MXNet C API Calls                   73843         561.2000         487.3580         561.2000          36.9210
MXNet C API Concurrency            147685           0.0010           0.0000           0.0010           0.0005
MXAutogradSetIsRecording             1298           0.6130           0.0000           0.0040           0.0005
MXNDArrayGetGradState                6490           3.3910           0.0000           0.0230           0.0005
MXNDArraySetGradState                6490           3.3060           0.0000           0.0010           0.0005
MXAutogradSetIsTraining              1298           0.5460           0.0000           0.0010           0.0004
MXAutogradBackwardEx                  649         359.2710           0.5250           0.9450           0.5536
MXNDArrayGetContext                 10126           4.4130           0.0000           0.0070           0.0004
MXImperativeInvokeEx                21399         550.3220           0.0090           0.1450           0.0257

operator
=================
Name                          Total Count        Time (ms)    Min Time (ms)    Max Time (ms)    Avg Time (ms)
----                          -----------        ---------    -------------    -------------    -------------
_backward_Pooling                    2596        6362.2339           0.7010           3.7500           2.4508
FullyConnected                       4374         423.2350           0.0080           0.3430           0.0968
argmax                               1458          28.9540           0.0050           0.0480           0.0199
_backward_pick                       1298          20.5470           0.0130           0.0320           0.0158
_backward_mul_scalar                 1298           5.6740           0.0030           0.0220           0.0044
DeleteVariable                      54800         386.1490           0.0010           0.9010           0.0070
Flatten                              1458          60.4110           0.0080           0.1120           0.0414
Activation                           5832         271.4430           0.0030           1.9440           0.0465
SetValueOp                           1298           8.3920           0.0050           0.0180           0.0065
pick                                 1298          10.2170           0.0060           0.0280           0.0079
Pooling                              2916        4096.8188           0.0640           3.1720           1.4049
Convolution                          2916       16658.9902           0.2260          13.2050           5.7130
CopyCPU2CPU                          1458           8.2320           0.0030           0.0360           0.0056
log_softmax                          1298          40.4160           0.0150           0.0550           0.0311
_backward_copy                       1298          66.9520           0.0220           0.0760           0.0516
_backward_Convolution                2596       24045.0684           2.6370          12.5610           9.2624
_mul_scalar                          1298           4.6510           0.0020           0.0230           0.0036
_backward_log_softmax                1298          22.1010           0.0090           0.0400           0.0170
mean                                 4054          77.9470           0.0080           0.0730           0.0192
_backward_mean                       1298          14.2470           0.0080           0.1030           0.0110
_backward_FullyConnected             3894         747.7490           0.0280           0.5940           0.1920
WaitForVar                           2756          24.6270           0.0060           0.0280           0.0089
broadcast_equal                      1458           7.2830           0.0030           0.0110           0.0050
sgd_update                          12980         128.5010           0.0020           0.0790           0.0099
_backward_Activation                 5192         384.0270           0.0070           0.3900